Infrared signal based position recognition system for use with a robot-assisted surgery

Information

  • Patent Grant
  • 11744657
  • Patent Number
    11,744,657
  • Date Filed
    Monday, July 26, 2021
    2 years ago
  • Date Issued
    Tuesday, September 5, 2023
    8 months ago
Abstract
An improved device for regenerating an infrared signal transmitted over the air for use in detecting a 3-dimensional position of an object. The regeneration device includes an infrared signal transmitter and detector that receives from the object a responsive infrared signal in response to the infrared signal transmitted by the transmitter. A low pass filter receives the responsive infrared signal from the detector and outputs a low-pass filtered signal. A comparator compares the output of the infrared signal detector and output of the low pass filter and generates an output representing a logic state based on the comparison.
Description
FIELD

The present disclosure relates to position recognition systems and in particular, infrared based position recognition system for use with a robot assisted surgery.


BACKGROUND

Position recognition systems are used to determine the position of and track a particular object in 3-dimensions. In robot assisted surgeries, for example, certain objects, such as a surgical instrument, needs to be tracked with a high degree of precision as the instrument is being positioned and moved by a physician.


An infrared signal based position recognition systems use either passive sensors or active sensors. In passive sensors, objects to be tracked such as spherical balls are positioned at strategic locations of the object to be tracked. Infrared transmitters transmit a signal having a predetermined waveform pattern. The spherical balls reflect the signal and the reflected signals are received by infrared signal detectors that are generally located near the transmitters.


In active sensors, the objects to be tracked have their own infrared transmitters and thus generate their own infrared signals in response to the signals transmitted from an infrared transmitter of the position recognition system.


In either active or passive sensors, the responsive infrared signals from the objects to be tracked are received and amplified in a form which is as close to the original infrared signals as possible. The amplified signal is then converted into a digital signal which is usable by a signal processor. The system then geometrically resolves the 3-dimensional position of the spherical balls based on one or more of the converted digital signals, cameras, digital waveform shape of the amplified signals, known locations of the spherical balls, distance, the time it took to receive the responsive signals, or a combination thereof.


One problem is that due to attenuation of infrared signals, the conventional position recognition systems have a relatively limited working range of distance between the system and objects to be tracked. Typically, the working range is limited to about 3-5 meters, at best, before the amplified signal loses sufficient original waveform information to be useful.


Moreover, conventional systems require relatively high bandwidth, high slew rate amplifiers which involve complex and expensive circuits. Therefore there is a need to provide an improved system and method for recognizing the 3-dimensional position of an object, which has a longer working range, is accurate, and is less expensive.


SUMMARY

To meet this and other needs, devices, systems, and methods for determining the 3-dimensional position of an object is provided. For example, an improved device for regenerating an infrared signal transmitted over the air for use in detecting a 3-dimensional position of an object is provided.


According to one embodiment, a surgical robot system includes a robot having a robot base and a display, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector having one or more tracking markers, wherein movement of the end-effector is electronically controlled by the robot. The system further includes a camera stand including at least one camera able to detect the one or more tracking markers, the camera including at least one infrared signal detector that receives from the one or more tracking markers an infrared signal, wherein the robot determines a 3-dimensional position of the one or more tracking markers based on the infrared signal, and wherein the infrared signal includes a burst signal. The infrared signal may include a burst pattern including the burst signal for a fixed amount of time and a non-burst signal for a fixed amount of time.


According to another embodiment, the regeneration device includes an infrared signal transmitter and an infrared signal detector that receives from the object a responsive infrared signal in response to the infrared signal transmitted by the infrared transmitter. A low pass filter receives the responsive infrared signal from the detector and outputs a low-pass filtered signal. A comparator has a first input connected to the output of the infrared signal detector and a second input connected to the output of the low pass filter. The comparator generates an output representing a logic state based on comparison between the first and second inputs.


Advantageously, the present invention relaxes the requirement of a high bandwidth, high slew output amplification and allows position recognition of the object over a longer distance due to less sensitivity of the signal amplitude variation.





DESCRIPTION OF THE DRAWINGS


FIG. 1 is an overhead view of a potential arrangement for locations of the robotic system, patient, surgeon, and other medical personnel during a surgical procedure;



FIG. 2 illustrates the robotic system including positioning of the surgical robot and the camera relative to the patient according to one embodiment;



FIG. 3 illustrates a surgical robotic system in accordance with an exemplary embodiment;



FIG. 4 illustrates a portion of a surgical robot in accordance with an exemplary embodiment;



FIG. 5 illustrates a block diagram of a surgical robot in accordance with an exemplary embodiment;



FIG. 6 illustrates a surgical robot in accordance with an exemplary embodiment;



FIGS. 7A-7C illustrate an end-effector in accordance with an exemplary embodiment;



FIG. 8 illustrates a surgical instrument and the end effector, before and after, inserting the surgical instrument into the guide tube of the end effector according to one embodiment;



FIGS. 9A-9C illustrate portions of an end-effector and robot arm in accordance with an exemplary embodiment;



FIG. 10 illustrates a dynamic reference array, an imaging array, and other components in accordance with an exemplary embodiment;



FIG. 11 illustrates a method of registration in accordance with an exemplary embodiment;



FIG. 12A-12B illustrate embodiments of imaging devices according to exemplary embodiments;



FIG. 13 is a waveform of an exemplary infrared signal;



FIG. 14 is a functional diagram of an infrared signal regeneration circuit according to one embodiment;



FIG. 15 is a functional diagram of an infrared signal based position recognition system for use with a robot-assisted surgery according to one aspect; and



FIG. 16 is a graph illustrating signal outputs at various nodes of the infrared signal regeneration circuit of FIG. 14.





DETAILED DESCRIPTION

It is to be understood that the present disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the description herein or illustrated in the drawings. The teachings of the present disclosure may be used and practiced in other embodiments and practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.


The following discussion is presented to enable a person skilled in the art to make and use embodiments of the present disclosure. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the principles herein can be applied to other embodiments and applications without departing from embodiments of the present disclosure. Thus, the embodiments are not intended to be limited to embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of the embodiments. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of the embodiments.



FIGS. 1 and 2 illustrate a surgical robot system 100 in accordance with an exemplary embodiment. Surgical robot system 100 may include, for example, a surgical robot 102, one or more robot arms 104, a base 106, a display 110, an end-effector 112, for example, including a guide tube 114, and one or more tracking markers 118. The surgical robot system 100 may include a patient tracking device 116 also including one or more tracking markers 118, which is adapted to be secured directly to the patient 210 (e.g., to the bone of the patient 210). The surgical robot system 100 may also utilize a camera 200, for example, positioned on a camera stand 202. The camera stand 202 can have any suitable configuration to move, orient, and support the camera 200 in a desired position. The camera 200 may include any suitable camera or cameras, such as one or more infrared cameras (e.g., bifocal cameras), able to identify, for example, active and passive tracking markers 118 in a given measurement volume viewable from the perspective of the camera 200. The camera 200 may scan the given measurement volume and detect the light that comes from the markers 118 in order to identify and determine the position of the markers 118 in three-dimensions. For example, active markers 118 may include infrared-emitting markers that are activated by an electrical signal (e.g., infrared light emitting diodes (LEDs)), and passive markers 118 may include retro-reflective markers that reflect infrared light (e.g., they reflect incoming IR radiation into the direction of the incoming light), for example, emitted by illuminators on the camera 200 or other suitable device.



FIGS. 1 and 2 illustrate a potential configuration for the placement of the surgical robot system 100 in an operating room environment. For example, the robot 102 may be positioned near or next to patient 210. Although depicted near the head of the patient 210, it will be appreciated that the robot 102 can be positioned at any suitable location near the patient 210 depending on the area of the patient 210 undergoing the operation. The camera 200 may be separated from the robot system 100 and positioned at the foot of patient 210. This location allows the camera 200 to have a direct visual line of sight to the surgical field 208. Again, it is contemplated that the camera 200 may be located at any suitable position having line of sight to the surgical field 208. In the configuration shown, the surgeon 120 may be positioned across from the robot 102, but is still able to manipulate the end-effector 112 and the display 110. A surgical assistant 126 may be positioned across from the surgeon 120 again with access to both the end-effector 112 and the display 110. If desired, the locations of the surgeon 120 and the assistant 126 may be reversed. The traditional areas for the anesthesiologist 122 and the nurse or scrub tech 124 remain unimpeded by the locations of the robot 102 and camera 200.


With respect to the other components of the robot 102, the display 110 can be attached to the surgical robot 102 and in other exemplary embodiments, display 110 can be detached from surgical robot 102, either within a surgical room with the surgical robot 102, or in a remote location. End-effector 112 may be coupled to the robot arm 104 and controlled by at least one motor. In exemplary embodiments, end-effector 112 can comprise a guide tube 114, which is able to receive and orient a surgical instrument 608 (described further herein) used to perform surgery on the patient 210. As used herein, the term “end-effector” is used interchangeably with the terms “end-effectuator” and “effectuator element.” Although generally shown with a guide tube 114, it will be appreciated that the end-effector 112 may be replaced with any suitable instrumentation suitable for use in surgery. In some embodiments, end-effector 112 can comprise any known structure for effecting the movement of the surgical instrument 608 in a desired manner.


The surgical robot 102 is able to control the translation and orientation of the end-effector 112. The robot 102 is able to move end-effector 112 along x-, y-, and z-axes, for example. The end-effector 112 can be configured for selective rotation about one or more of the x-, y-, and z-axis, and a Z Frame axis (such that one or more of the Euler Angles (e.g., roll, pitch, and/or yaw) associated with end-effector 112 can be selectively controlled). In some exemplary embodiments, selective control of the translation and orientation of end-effector 112 can permit performance of medical procedures with significantly improved accuracy compared to conventional robots that utilize, for example, a six degree of freedom robot arm comprising only rotational axes. For example, the surgical robot system 100 may be used to operate on patient 210, and robot arm 104 can be positioned above the body of patient 210, with end-effector 112 selectively angled relative to the z-axis toward the body of patient 210.


In some exemplary embodiments, the position of the surgical instrument 608 can be dynamically updated so that surgical robot 102 can be aware of the location of the surgical instrument 608 at all times during the procedure. Consequently, in some exemplary embodiments, surgical robot 102 can move the surgical instrument 608 to the desired position quickly without any further assistance from a physician (unless the physician so desires). In some further embodiments, surgical robot 102 can be configured to correct the path of the surgical instrument 608 if the surgical instrument 608 strays from the selected, preplanned trajectory. In some exemplary embodiments, surgical robot 102 can be configured to permit stoppage, modification, and/or manual control of the movement of end-effector 112 and/or the surgical instrument 608. Thus, in use, in exemplary embodiments, a physician or other user can operate the system 100, and has the option to stop, modify, or manually control the autonomous movement of end-effector 112 and/or the surgical instrument 608. Further details of surgical robot system 100 including the control and movement of a surgical instrument 608 by surgical robot 102 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.


The robotic surgical system 100 can comprise one or more tracking markers 118 configured to track the movement of robot arm 104, end-effector 112, patient 210, and/or the surgical instrument 608 in three dimensions. In exemplary embodiments, a plurality of tracking markers 118 can be mounted (or otherwise secured) thereon to an outer surface of the robot 102, such as, for example and without limitation, on base 106 of robot 102, on robot arm 104, or on the end effector 112. In exemplary embodiments, at least one tracking marker 118 of the plurality of tracking markers 118 can be mounted or otherwise secured to the end-effector 112. One or more tracking markers 118 can further be mounted (or otherwise secured) to the patient 210. In exemplary embodiments, the plurality of tracking markers 118 can be positioned on the patient 210 spaced apart from the surgical field 208 to reduce the likelihood of being obscured by the surgeon, surgical tools, or other parts of the robot 102. Further, one or more tracking markers 118 can be further mounted (or otherwise secured) to the surgical tools 608 (e.g., a screw driver, dilator, implant inserter, or the like). Thus, the tracking markers 118 enable each of the marked objects (e.g., the end effector 112, the patient 210, and the surgical tools 608) to be tracked by the robot 102. In exemplary embodiments, system 100 can use tracking information collected from each of the marked objects to calculate the orientation and location, for example, of the end effector 112, the surgical instrument 608 (e.g., positioned in the tube 114 of the end effector 112), and the relative position of the patient 210.


In exemplary embodiments, one or more of markers 118 may be optical markers. In some embodiments, the positioning of one or more tracking markers 118 on end-effector 112 can maximize the accuracy of the positional measurements by serving to check or verify the position of end-effector 112. Further details of surgical robot system 100 including the control, movement and tracking of surgical robot 102 and of a surgical instrument 608 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.


Exemplary embodiments include one or more markers 118 coupled to the surgical instrument 608. In exemplary embodiments, these markers 118, for example, coupled to the patient 210 and surgical instruments 608, as well as markers 118 coupled to the end effector 112 of the robot 102 can comprise conventional infrared light-emitting diodes (LEDs) or an Optotrak® diode capable of being tracked using a commercially available infrared optical tracking system such as Optotrak®. Optotrak® is a registered trademark of Northern Digital Inc., Waterloo, Ontario, Canada. In other embodiments, markers 118 can comprise conventional reflective spheres capable of being tracked using a commercially available optical tracking system such as Polaris Spectra. Polaris Spectra is also a registered trademark of Northern Digital, Inc. In an exemplary embodiment, the markers 118 coupled to the end effector 112 are active markers which comprise infrared light-emitting diodes which may be turned on and off, and the markers 118 coupled to the patient 210 and the surgical instruments 608 comprise passive reflective spheres.


In exemplary embodiments, light emitted from and/or reflected by markers 118 can be detected by camera 200 and can be used to monitor the location and movement of the marked objects. In alternative embodiments, markers 118 can comprise a radio-frequency and/or electromagnetic reflector or transceiver and the camera 200 can include or be replaced by a radio-frequency and/or electromagnetic transceiver.


Similar to surgical robot system 100, FIG. 3 illustrates a surgical robot system 300 and camera stand 302, in a docked configuration, consistent with an exemplary embodiment of the present disclosure. Surgical robot system 300 may comprise a robot 301 including a display 304, upper arm 306, lower arm 308, end-effector 310, vertical column 312, casters 314, cabinet 316, tablet drawer 318, connector panel 320, control panel 322, and ring of information 324. Camera stand 302 may comprise camera 326. These components are described in greater with respect to FIG. 5. FIG. 3 illustrates the surgical robot system 300 in a docked configuration where the camera stand 302 is nested with the robot 301, for example, when not in use. It will be appreciated by those skilled in the art that the camera 326 and robot 301 may be separated from one another and positioned at any appropriate location during the surgical procedure, for example, as shown in FIGS. 1 and 2.



FIG. 4 illustrates a base 400 consistent with an exemplary embodiment of the present disclosure. Base 400 may be a portion of surgical robot system 300 and comprise cabinet 316. Cabinet 316 may house certain components of surgical robot system 300 including but not limited to a battery 402, a power distribution module 404, a platform interface board module 406, a computer 408, a handle 412, and a tablet drawer 414. The connections and relationship between these components is described in greater detail with respect to FIG. 5.



FIG. 5 illustrates a block diagram of certain components of an exemplary embodiment of surgical robot system 300. Surgical robot system 300 may comprise platform subsystem 502, computer subsystem 504, motion control subsystem 506, and tracking subsystem 532. Platform subsystem 502 may further comprise battery 402, power distribution module 404, platform interface board module 406, and tablet charging station 534. Computer subsystem 504 may further comprise computer 408, display 304, and speaker 536. Motion control subsystem 506 may further comprise driver circuit 508, motors 510, 512, 514, 516, 518, stabilizers 520, 522, 524, 526, end-effector 310, and controller 538. Tracking subsystem 532 may further comprise position sensor 540 and camera converter 542. System 300 may also comprise a foot pedal 544 and tablet 546.


Input power is supplied to system 300 via a power source 548 which may be provided to power distribution module 404. Power distribution module 404 receives input power and is configured to generate different power supply voltages that are provided to other modules, components, and subsystems of system 300. Power distribution module 404 may be configured to provide different voltage supplies to platform interface module 406, which may be provided to other components such as computer 408, display 304, speaker 536, driver 508 to, for example, power motors 512, 514, 516, 518 and end-effector 310, motor 510, ring 324, camera converter 542, and other components for system 300 for example, fans for cooling the electrical components within cabinet 316.


Power distribution module 404 may also provide power to other components such as tablet charging station 534 that may be located within tablet drawer 318. Tablet charging station 534 may be in wireless or wired communication with tablet 546 for charging table 546. Tablet 546 may be used by a surgeon consistent with the present disclosure and described herein.


Power distribution module 404 may also be connected to battery 402, which serves as temporary power source in the event that power distribution module 404 does not receive power from input power 548. At other times, power distribution module 404 may serve to charge battery 402 if necessary.


Other components of platform subsystem 502 may also include connector panel 320, control panel 322, and ring 324. Connector panel 320 may serve to connect different devices and components to system 300 and/or associated components and modules. Connector panel 320 may contain one or more ports that receive lines or connections from different components. For example, connector panel 320 may have a ground terminal port that may ground system 300 to other equipment, a port to connect foot pedal 544 to system 300, a port to connect to tracking subsystem 532, which may comprise position sensor 540, camera converter 542, and cameras 326 associated with camera stand 302. Connector panel 320 may also include other ports to allow USB, Ethernet, HDMI communications to other components, such as computer 408.


Control panel 322 may provide various buttons or indicators that control operation of system 300 and/or provide information regarding system 300. For example, control panel 322 may include buttons to power on or off system 300, lift or lower vertical column 312, and lift or lower stabilizers 520-526 that may be designed to engage casters 314 to lock system 300 from physically moving. Other buttons may stop system 300 in the event of an emergency, which may remove all motor power and apply mechanical brakes to stop all motion from occurring. Control panel 322 may also have indicators notifying the user of certain system conditions such as a line power indicator or status of charge for battery 402.


Ring 324 may be a visual indicator to notify the user of system 300 of different modes that system 300 is operating under and certain warnings to the user.


Computer subsystem 504 includes computer 408, display 304, and speaker 536. Computer 504 includes an operating system and software to operate system 300. Computer 504 may receive and process information from other components (for example, tracking subsystem 532, platform subsystem 502, and/or motion control subsystem 506) in order to display information to the user. Further, computer subsystem 504 may also include speaker 536 to provide audio to the user.


Tracking subsystem 532 may include position sensor 504 and converter 542. Tracking subsystem 532 may correspond to camera stand 302 including camera 326 as described with respect to FIG. 3. Position sensor 504 may be camera 326. Tracking subsystem may track the location of certain markers that are located on the different components of system 300 and/or instruments used by a user during a surgical procedure. This tracking may be conducted in a manner consistent with the present disclosure including the use of infrared technology that tracks the location of active or passive elements, such as LEDs or reflective markers, respectively. The location, orientation, and position of structures having these types of markers may be provided to computer 408 which may be shown to a user on display 304. For example, a surgical instrument 608 having these types of markers and tracked in this manner (which may be referred to as a navigational space) may be shown to a user in relation to a three dimensional image of a patient's anatomical structure.


Motion control subsystem 506 may be configured to physically move vertical column 312, upper arm 306, lower arm 308, or rotate end-effector 310. The physical movement may be conducted through the use of one or more motors 510-518. For example, motor 510 may be configured to vertically lift or lower vertical column 312. Motor 512 may be configured to laterally move upper arm 308 around a point of engagement with vertical column 312 as shown in FIG. 3. Motor 514 may be configured to laterally move lower arm 308 around a point of engagement with upper arm 308 as shown in FIG. 3. Motors 516 and 518 may be configured to move end-effector 310 in a manner such that one may control the roll and one may control the tilt, thereby providing multiple angles that end-effector 310 may be moved. These movements may be achieved by controller 538 which may control these movements through load cells disposed on end-effector 310 and activated by a user engaging these load cells to move system 300 in a desired manner.


Moreover, system 300 may provide for automatic movement of vertical column 312, upper arm 306, and lower arm 308 through a user indicating on display 304 (which may be a touchscreen input device) the location of a surgical instrument or component on three dimensional image of the patient's anatomy on display 304. The user may initiate this automatic movement by stepping on foot pedal 544 or some other input means.



FIG. 6 illustrates a surgical robot system 600 consistent with an exemplary embodiment. Surgical robot system 600 may comprise end-effector 602, robot arm 604, guide tube 606, instrument 608, and robot base 610. Instrument tool 608 may be attached to a tracking array 612 including one or more tracking markers (such as markers 118) and have an associated trajectory 614. Trajectory 614 may represent a path of movement that instrument tool 608 is configured to travel once it is positioned through or secured in guide tube 606, for example, a path of insertion of instrument tool 608 into a patient. In an exemplary operation, robot base 610 may be configured to be in electronic communication with robot arm 604 and end-effector 602 so that surgical robot system 600 may assist a user (for example, a surgeon) in operating on the patient 210. Surgical robot system 600 may be consistent with previously described surgical robot system 100 and 300.


A tracking array 612 may be mounted on instrument 608 to monitor the location and orientation of instrument tool 608. The tracking array 612 may be attached to an instrument 608 and may comprise tracking markers 804. As best seen in FIG. 8, tracking markers 804 may be, for example, light emitting diodes and/or other types of reflective markers (e.g., markers 118 as described elsewhere herein). The tracking devices may be one or more line of sight devices associated with the surgical robot system. As an example, the tracking devices may be one or more cameras 200, 326 associated with the surgical robot system 100, 300 and may also track tracking array 612 for a defined domain or relative orientations of the instrument 608 in relation to the robot arm 604, the robot base 610, end-effector 602, and/or the patient 210. The tracking devices may be consistent with those structures described in connection with camera stand 302 and tracking subsystem 532.



FIGS. 7A, 7B, and 7C illustrate a top view, front view, and side view, respectively, of end-effector 602 consistent with an exemplary embodiment. End-effector 602 may comprise one or more tracking markers 702. Tracking markers 702 may be light emitting diodes or other types of active and passive markers, such as tracking markers 118 that have been previously described. In an exemplary embodiment, the tracking markers 702 are active infrared-emitting markers that are activated by an electrical signal (e.g., infrared light emitting diodes (LEDs)). Thus, tracking markers 702 may be activated such that the infrared markers 702 are visible to the camera 200, 326 or may be deactivated such that the infrared markers 702 are not visible to the camera 200, 326. Thus, when the markers 702 are active, the end effector 602 may be controlled by the system 100, 300, 600, and when the markers 702 are deactivated, the end effector 602 may be locked in position and unable to be moved by the system 100, 300, 600.


Markers 702 may be disposed on or within end-effector 602 in a manner such that the markers 702 are visible by one or more cameras 200, 326 or other tracking devices associated with the surgical robot system 100, 300, 600. The camera 200, 326 or other tracking devices may track end-effector 602 as it moves to different positions and viewing angles by following the movement of tracking markers 702. The location of markers 702 and/or end-effector 602 may be shown on a display 110, 304 associated with the surgical robot system 100, 300, 600, for example, display 110 as shown in FIG. 2 and/or display 304 shown in FIG. 3. This display 110, 304 may allow a user to ensure that end-effector 602 is in a desirable position in relation to robot arm 604, robot base 610, the patient 210, and/or the user.


For example, as shown in FIG. 7A, markers 702 may be placed around the surface of end-effector 602 so that a tracking device placed away from the surgical field 208 and facing toward the robot 102, 301 and the camera 200, 326 is able to view at least 3 of the markers 702 through a range of common orientations of the end effector 602 relative to the tracking device 100, 300, 600. For example, distribution of markers 702 in this way allows end-effector 602 to be monitored by the tracking devices when end-effector 602 is translated and rotated in the surgical field 208.


In addition, in exemplary embodiments, end-effector 602 may be equipped with infrared (IR) receivers that can detect when an external camera 200, 326 is getting ready to read markers 702. Upon this detection, end-effector 602 may then illuminate markers 702. The detection by the IR receivers that the external camera 200, 326 is ready to read markers 702 may signal the need to synchronize a duty cycle of markers 702, which may be light emitting diodes, to an external camera 200, 326. This may also allow for lower power consumption by the robotic system as a whole, whereby markers 702 would only be illuminated at the appropriate time instead of being illuminated continuously. Further, in exemplary embodiments, markers 702 may be powered off to prevent interference with other navigation tools, such as different types of surgical instruments 608.



FIG. 8 depicts one type of surgical instrument 608 including a tracking array 612 and tracking markers 804. Tracking markers 804 may be of any type described herein including but not limited to light emitting diodes or reflective spheres. Markers 804 are monitored by tracking devices associated with the surgical robot system 100, 300, 600 and may be one or more of the line of sight cameras 200, 326. The cameras 200, 326 may track the location of instrument 608 based on the position and orientation of tracking array 612 and markers 804. A user, such as a surgeon 120, may orient instrument 608 in a manner so that tracking array 612 and markers 804 are sufficiently recognized by the tracking device or camera 200, 326 to display instrument 608 and markers 804 on, for example, display 110 of the exemplary surgical robot system.


The manner in which a surgeon 120 may place instrument 608 into guide tube 606 of the end effector 602 and adjust the instrument 608 is evident in FIG. 8. The hollow tube or guide tube 114, 606 of the end-effector 112, 310, 602 is sized and configured to receive at least a portion of the surgical instrument 608. The guide tube 114, 606 is configured to be oriented by the robot arm 104 such that insertion and trajectory for the surgical instrument 608 is able to reach a desired anatomical target within or upon the body of the patient 210. The surgical instrument 608 may include at least a portion of a generally cylindrical instrument. Although a screw driver is exemplified as the surgical tool 608, it will be appreciated that any suitable surgical tool 608 may be positioned by the end-effector 602. By way of example, the surgical instrument 608 may include one or more of a guide wire, cannula, a retractor, a drill, a reamer, a screw driver, an insertion tool, a removal tool, or the like. Although the hollow tube 114, 606 is generally shown as having a cylindrical configuration, it will be appreciated by those of skill in the art that the guide tube 114, 606 may have any suitable shape, size and configuration desired to accommodate the surgical instrument 608 and access the surgical site.



FIGS. 9A-9C illustrate end-effector 602 and a portion of robot arm 604 consistent with an exemplary embodiment. End-effector 602 may further comprise body 1202 and clamp 1204. Clamp 1204 may comprise handle 1206, balls 1208, spring 1210, and lip 1212. Robot arm 604 may further comprise depressions 1214, mounting plate 1216, lip 1218, and magnets 1220.


End-effector 602 may mechanically interface and/or engage with the surgical robot system and robot arm 604 through one or more couplings. For example, end-effector 602 may engage with robot arm 604 through a locating coupling and/or a reinforcing coupling. Through these couplings, end-effector 602 may fasten with robot arm 604 outside a flexible and sterile barrier. In an exemplary embodiment, the locating coupling may be a magnetically kinematic mount and the reinforcing coupling may be a five bar over center clamping linkage.


With respect to the locating coupling, robot arm 604 may comprise mounting plate 1216, which may be non-magnetic material, one or more depressions 1214, lip 1218, and magnets 1220. Magnet 1220 is mounted below each of depressions 1214. Portions of clamp 1204 may comprise magnetic material and be attracted by one or more magnets 1220. Through the magnetic attraction of clamp 1204 and robot arm 604, balls 1208 become seated into respective depressions 1214. For example, balls 1208 as shown in FIG. 9B would be seated in depressions 1214 as shown in FIG. 9A. This seating may be considered a magnetically-assisted kinematic coupling. Magnets 1220 may be configured to be strong enough to support the entire weight of end-effector 602 regardless of the orientation of end-effector 602. The locating coupling may be any style of kinematic mount that uniquely restrains six degrees of freedom.


With respect to the reinforcing coupling, portions of clamp 1204 may be configured to be a fixed ground link and as such clamp 1204 may serve as a five bar linkage. Closing clamp handle 1206 may fasten end-effector 602 to robot arm 604 as lip 1212 and lip 1218 engage clamp 1204 in a manner to secure end-effector 602 and robot arm 604. When clamp handle 1206 is closed, spring 1210 may be stretched or stressed while clamp 1204 is in a locked position. The locked position may be a position that provides for linkage past center. Because of a closed position that is past center, the linkage will not open absent a force applied to clamp handle 1206 to release clamp 1204. Thus, in a locked position end-effector 602 may be robustly secured to robot arm 604.


Spring 1210 may be a curved beam in tension. Spring 1210 may be comprised of a material that exhibits high stiffness and high yield strain such as virgin PEEK (poly-ether-ether-ketone). The linkage between end-effector 602 and robot arm 604 may provide for a sterile barrier between end-effector 602 and robot arm 604 without impeding fastening of the two couplings.


The reinforcing coupling may be a linkage with multiple spring members. The reinforcing coupling may latch with a cam or friction based mechanism. The reinforcing coupling may also be a sufficiently powerful electromagnet that will support fastening end-effector 102 to robot arm 604. The reinforcing coupling may be a multi-piece collar completely separate from either end-effector 602 and/or robot arm 604 that slips over an interface between end-effector 602 and robot arm 604 and tightens with a screw mechanism, an over center linkage, or a cam mechanism.


Referring to FIGS. 10 and 11, prior to or during a surgical procedure, certain registration procedures may be conducted in order to track objects and a target anatomical structure of the patient 210 both in a navigation space and an image space. In order to conduct such registration, a registration system 1400 may be used as illustrated in FIG. 10.


In order to track the position of the patient 210, a patient tracking device 116 may include a patient fixation instrument 1402 to be secured to a rigid anatomical structure of the patient 210 and a dynamic reference base (DRB) 1404 may be securely attached to the patient fixation instrument 1402. For example, patient fixation instrument 1402 may be inserted into opening 1406 of dynamic reference base 1404. Dynamic reference base 1404 may contain markers 1408 that are visible to tracking devices, such as tracking subsystem 532. These markers 1408 may be optical markers or reflective spheres, such as tracking markers 118, as previously discussed herein.


Patient fixation instrument 1402 is attached to a rigid anatomy of the patient 210 and may remain attached throughout the surgical procedure. In an exemplary embodiment, patient fixation instrument 1402 is attached to a rigid area of the patient 210, for example a bone that is located away from the targeted anatomical structure subject to the surgical procedure. In order to track the targeted anatomical structure, dynamic reference base 1404 is associated with the targeted anatomical structure through the use of a registration fixture that is temporarily placed on or near the targeted anatomical structure in order to register the dynamic reference base 1404 with the location of the targeted anatomical structure.


A registration fixture 1410 is attached to patient fixation instrument 1402 through the use of a pivot arm 1412. Pivot arm 1412 is attached to patient fixation instrument 1402 by inserting patient fixation instrument 1402 through an opening 1414 of registration fixture 1410. Pivot arm 1412 is attached to registration fixture 1410 by, for example, inserting a knob 1416 through an opening 1418 of pivot arm 1412.


Using pivot arm 1412, registration fixture 1410 may be placed over the targeted anatomical structure and its location may be determined in an image space and navigation space using tracking markers 1420 and/or fiducials 1422 on registration fixture 1410. Registration fixture 1410 may contain a collection of markers 1420 that are visible in a navigational space (for example, markers 1420 may be detectable by tracking subsystem 532). Tracking markers 1420 may be optical markers visible in infrared light as previously described herein. Registration fixture 1410 may also contain a collection of fiducials 1422, for example, such as bearing balls, that are visible in an imaging space (for example, a three dimension CT image). As described in greater detail with respect to FIG. 11, using registration fixture 1410, the targeted anatomical structure may be associated with dynamic reference base 1404 thereby allowing depictions of objects in the navigational space to be overlaid on images of the anatomical structure. Dynamic reference base 1404, located at a position away from the targeted anatomical structure, may become a reference point thereby allowing removal of registration fixture 1410 and/or pivot arm 1412 from the surgical area.



FIG. 11 provides an exemplary method 1500 for registration consistent with the present disclosure. Method 1500 begins at step 1502 wherein a graphical representation (or image(s)) of the targeted anatomical structure may be imported into system 100, 300600, for example computer 408. The graphical representation may be three dimensional CT or a fluoroscope scan of the targeted anatomical structure of the patient 210 which includes registration fixture 1410 and a detectable imaging pattern of fiducials 1420.


At step 1504, an imaging pattern of fiducials 1420 is detected and registered in the imaging space and stored in computer 408. Optionally, at this time at step 1506, a graphical representation of the registration fixture 1410 may be overlaid on the images of the targeted anatomical structure.


At step 1508, a navigational pattern of registration fixture 1410 is detected and registered by recognizing markers 1420. Markers 1420 may be optical markers that are recognized in the navigation space through infrared light by tracking subsystem 532 via position sensor 540. Thus, the location, orientation, and other information of the targeted anatomical structure is registered in the navigation space. Therefore, registration fixture 1410 may be recognized in both the image space through the use of fiducials 1422 and the navigation space through the use of markers 1420. At step 1510, the registration of registration fixture 1410 in the image space is transferred to the navigation space. This transferal is done, for example, by using the relative position of the imaging pattern of fiducials 1422 compared to the position of the navigation pattern of markers 1420.


At step 1512, registration of the navigation space of registration fixture 1410 (having been registered with the image space) is further transferred to the navigation space of dynamic registration array 1404 attached to patient fixture instrument 1402. Thus, registration fixture 1410 may be removed and dynamic reference base 1404 may be used to track the targeted anatomical structure in both the navigation and image space because the navigation space is associated with the image space.


At steps 1514 and 1516, the navigation space may be overlaid on the image space and objects with markers visible in the navigation space (for example, surgical instruments 608 with optical markers 804). The objects may be tracked through graphical representations of the surgical instrument 608 on the images of the targeted anatomical structure.



FIGS. 12A-12B illustrate imaging devices 1304 that may be used in conjunction with robot systems 100, 300, 600 to acquire pre-operative, intra-operative, post-operative, and/or real-time image data of patient 210. Any appropriate subject matter may be imaged for any appropriate procedure using the imaging system 1304. The imaging system 1304 may be any imaging device such as imaging device 1306 and/or a C-arm 1308 device. It may be desirable to take x-rays of patient 210 from a number of different positions, without the need for frequent manual repositioning of patient 210 which may be required in an x-ray system. As illustrated in FIG. 12A, the imaging system 1304 may be in the form of a C-arm 1308 that includes an elongated C-shaped member terminating in opposing distal ends 1312 of the “C” shape. C-shaped member 1130 may further comprise an x-ray source 1314 and an image receptor 1316. The space within C-arm 1308 of the arm may provide room for the physician to attend to the patient substantially free of interference from x-ray support structure 1318. As illustrated in FIG. 12B, the imaging system may include imaging device 1306 having a gantry housing 1324 attached to a support structure imaging device support structure 1328, such as a wheeled mobile cart 1330 with wheels 1332, which may enclose an image capturing portion, not illustrated. The image capturing portion may include an x-ray source and/or emission portion and an x-ray receiving and/or image receiving portion, which may be disposed about one hundred and eighty degrees from each other and mounted on a rotor (not illustrated) relative to a track of the image capturing portion. The image capturing portion may be operable to rotate three hundred and sixty degrees during image acquisition. The image capturing portion may rotate around a central point and/or axis, allowing image data of patient 210 to be acquired from multiple directions or in multiple planes. Although certain imaging systems 1304 are exemplified herein, it will be appreciated that any suitable imaging system may be selected by one of ordinary skill in the art.


Turning now to FIGS. 13-16, the surgical robot system 100, 300, 600 relies on accurate positioning of the end-effector 112, 602, surgical instruments 608, and the patient 210 (e.g., patient tracking device 116) relative to the desired surgical area. As best seen in FIG. 14, an infrared signal based method may be used to determine the 3-dimensional position of the tracking markers described herein, such as markers 118, 702 and the like. In an exemplary embodiment, the infrared signal method described herein may be especially suitable with active markers 702 on the end-effector 112, 602 and/or passive markers 118 on the surgical instrument 608 or the patient tracking device 116.


As shown in FIGS. 13 and 14, an infrared signal transmitter (e.g., infrared LED) 1602 is capable of transmitting an infrared signal 1600 which can be comprised of a burst signal 1604, non-burst signal 1606, or a combination of both as shown. The infrared signal 1600 may be in the form of a burst pattern. For example, the burst pattern may include the burst signal 1604 for a fixed amount of time and a non-burst signal 1606 for a fixed amount of time. This burst pattern may repeat for a given amount of time. The burst pattern may include any suitable combination of the burst signal 1604 and the non-burst signal 1606 for any suitable duration. For example, the frequency of the burst signal 1604 can be about 110 KHz with a burst duration of about 340 μsec. The duration of the non-burst signal 1606 can be about 730 μsec. Infrared signal transmitters 1602 and infrared signal detectors D1 can be incorporated with the camera or cameras 200, 326. Alternatively, the infrared signal transmitters 1602 and infrared signal detectors D1 can be attached to a portion of the camera stand 202, for example, near or proximate to the camera or cameras 200, 326.


The robot-assisted surgery system 100, 300, 600 uses an improved circuit/device 1672 for regenerating an infrared signal transmitted over the air for use in determining a 3-dimensional position of an object, such as the surgical tool 608. The infrared signal regeneration device 1672 of FIG. 14 amplifies the received infrared signal as Vsig and creates a reference signal Vref which is slightly below Vsig. The regeneration device 1672 then peak detects the amplitude of Vsig by comparing its level to Vref, thus creating a toggling voltage for the burst signal 1604, and a single edge for the non-burst signal 1606.


As previously described, tracking markers 118, 702, such as spherical balls (objects to be tracked) 208 can be positioned on the surgical tool 608, the end-effector 112, 602, the patient 210, or other suitable locations. As identified in FIG. 14 as spherical ball 1608, the transmitted signal 1600 may be reflected from the one or more spherical balls 1608 and the reflected signal in the form of a responsive signal 1664 is received by infrared detectors D1. Alternatively, in a system with active sensors, for example, tracking markers 702 on end-effector 601 in FIGS. 7A-7C, the objects 1608 include their own infrared transmitters 1662 which transmit an infrared signal with a known pattern (e.g., the same waveform pattern as received) in response to the infrared signal transmitted by the transmitters 1602.


A responsive infrared signal 1664 (transmitted by infrared transmitters in the objects 1608 in response to the signal from the infrared transmitter 1602 in the case of an active sensor or reflected by the objects from the signal from the infrared transmitter 1602 in the case of a passive sensor) is received by the infrared detectors D1 in analog form. While only one is shown in FIG. 14 for illustrative purpose, there are typically multiple infrared detectors that are strategically positioned in the robotic system 100, 300, 600.


The analog signal 1664 received by the infrared detectors D1 is then fed into an amplifier 1666. The amplifier can be, for example, a relatively inexpensive operational amplifier, such as part no. OPA2381 from Texas Instruments of Dallas, Tex. Although only one amplifier 1666 is shown, amplification of the analog signal 1664 may involve multiple amplifiers that are coupled in parallel or in series or both.


The output of the amplifier 1666 is fed into a diode D2 which is connected to a low pass filter 1668. The diode provides a small voltage drop to prepare the signal for comparison against the original output Vsig of the amplifier 1666. The diode D2 can be, for example, a Schottky diode having a forward bias voltage of about 400 mV. A Schottky diode may be preferable to a normal p-n junction type diode due to its fast response time.


The low pass filter 1668 includes an RC circuit (resistor R1, capacitor C1) and resistor R2 connected in parallel to the capacitor C1. The resistors R1 and R2 act as a voltage divider to divide the output of the diode D2. The values of the resistors R1, R2 can be, for example, 300 Ohms and 5 KOhms, respectively. Accordingly, most of the voltage drop occurs over the resistor R2.


As can be seen in FIG. 14, the output Vref of the low pass filter 1668 is the same as the voltage divider output. The output Vref is fed into one input (− input) of a comparator 1670 while the output of the amplifier 16266 is fed into the other input (+ input) of the comparator. The comparator 1670 can be, for example, a CMOS comparator, such as part no. TLV7211 from Texas Instruments of Dallas, Tex.


Referring to FIGS. 14 and 16, the operation of the signal regeneration circuit 1672 will now be described. At the output of the amplifier 1666, the amplified signal may not be a perfectly scaled replica of the input due to bandwidth and output slew limitations of the amplifier. According to one aspect of the present invention, however, this is acceptable for reasons now described.


D2, R1, C1 and R2 form a passive peak detector, and a voltage level Vref is generated. Its average value is:











V
¯

ref

=



V

s

i

g

p

k


·


R

2



R

2

+

R

1




-

V

D

2

f







(
1
)









    • Where:
      • Vsigpk=peak voltage of the amplified infrared signal Vsig;
      • VD2f forward voltage of D2.





The voltage signal Vref is fed to the comparator 1670 and is compared against Vsig. Based on the comparison, the comparator 1670 generates a voltage Vout representing the low and high logic states which can be used by a digital signal processor for determining the 3-dimensional positions of the various objects being tracked. In other words, the comparator 1670 converts an analog signal into a digital signal, which can be easily processed by a processor 1646 such as a microcontroller or similar devices.



FIG. 16 shows the waveforms Vsig, Vref and Vout when the infrared detector D1 receives the responsive infrared signal 1664 which may be a reflection of the infrared signal 1600 transmitted by the infrared transmitter 1602. Due to limitations of the bandwidth and output slew of the amplifier, the signal Vsig appears as a sinusoidal wave, rather than the original signal 1600 with sharply defined leading and falling edges.


The signal Vref is lower in voltage than the signal Vsig. The amount of the voltage drop is predetermined based on the forward bias voltage drop of the diode D2 and the voltage drop across the resistor R1. The signal Vref has a relatively flat waveform due to the low pass filter 268.


The comparator 1670 generates a logic high signal (e.g., 5 Volt signal) when Vsig is greater than Vsig and a logic low signal (e.g., 0 Volt signal) when Vsig falls below Vref. As can be seen, the voltage at Vref is proportional to Vsig. At lower voltages (i.e., when the distance between the object 1608 and the infrared detector D1 is relatively long, the difference between Vsig and Vref may not be sufficient to toggle the comparator 1670 without the presence of the diode D2. The diode D2 ensures that there is at least a preset voltage difference between Vsig and Vref (i.e., forward bias voltage of diode D2). Thus, the presence of a diode D2 between the operational amplifier 1666 and the low pass filter 1668 may be important.


As can be seen by the waveform Vout in FIG. 16, it generates a fairly accurate regeneration of the original signal 1600 over longer distance between the infrared transmitter 1602 and the objects 1608 even though the responsive signal 1664 has been substantially degraded.


Advantageously, this configuration relaxes the requirement of a high bandwidth, high slew output amplification. It is also not as sensitive to amplitude variations as simple amplification would be. This is because as Vsig decreases when the distance between the objects 1608 and infrared transmitter 1602 becomes longer, Vref also decreases. That allows the comparator 1670 to continue to toggle correctly when needed. This results in the effective working distance between the objects 1608 and infrared transmitter 1602 to increase by 75%-200% (7-10 meters).



FIG. 15 is a functional diagram of an infrared signal based position recognition system 1640 for use with a robot-assisted surgery according to an aspect of the present invention.


The system 1640 is connected to the output of the comparator 1670 through a communication link 1652 which is connected to an I/O interface 1642, which receives information from and sends information over the communication link 1652. The system 1640 includes memory storage 1644 such as RAM (random access memory), processor (CPU) 1646, program storage 1648 such as FPGA, ROM or EEPROM, and data storage 1650 such as a hard disk, all commonly connected to each other through a bus 1653. The program storage 1648 stores, among others, a position recognition module 1654 containing software to be executed by the processor 1646. The position recognition module 1654 receives the digital waveform Vout through the communication link 1652 and determines the 3-dimensional position of the object 1608 based on the digital waveform, shape of the amplified signals, known locations of the objects and infrared detectors D1, and possibly the time it took to receive the responsive signals 1664. The position recognition module 1654 may also determine the 3-dimensional position of the objects 1608 with the help of the cameras 200, 326 (e.g. stereo cameras) and the tracking system 100, 300, 600. The camera or cameras 200, 326 can record regular optical images or infrared images or both.


The position recognition module 1654 also determines whether the objects being tracked are passive or active objects by analyzing the time it takes for the responsive signals to be received from the time the initial signal 1606 is transmitted. Since active objects will have a longer known delay amount between the transmission of signal 1606 and the receipt of the responsive signal, the module 1654 can distinguish the type of objects (e.g., passive or active) being tracked.


The position recognition module 1654 includes a user interface module that interacts with the user through the display device 1611 and input devices such as keyboard 1612 and pointing device 1614 such as arrow keys, mouse or track ball. The user interface module assists the user in programming the module 1654 to perform 3-dimensional position recognition of the objects 1608. Any of the software program modules in the program storage 1648 and data from the data storage 1650 can be transferred to the memory 1644 as needed and is executed by the CPU 1646.


One exemplary system 1640 may be 8051 microcontroller from Intel Corporation of Santa Clara, Calif.. However, any digital signal processor, processor or microcontroller can be used.


In one embodiment, parts of or the entire system 1640 including the input devices 1612, 1614 and display device 1611 can be incorporated into the robot system 100, 300, 600 or any suitable robotic surgical system. For example, the display 1611 can be the same as display 110, 304.


While the position recognition system 1640 has been described with reference to an infrared signal, the principles disclosed herein could be used with any optical signal as well as other signals such as ultrasound signal. Also, while only a single infrared signal has been described, the present system can transmit a set of infrared signals having either different wavelengths or waveform shapes each for reflection or transmission by a respective spherical ball to be tracked.


Although several embodiments of the invention have been disclosed in the foregoing specification, it is understood that many modifications and other embodiments of the invention will come to mind to which the invention pertains, having the benefit of the teaching presented in the foregoing description and associated drawings. It is thus understood that the invention is not limited to the specific embodiments disclosed hereinabove, and that many modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although specific terms are employed herein, as well as in the claims which follow, they are used only in a generic and descriptive sense, and not for the purposes of limiting the described invention, nor the claims which follow.


It will be appreciated by those skilled in the art that while the invention has been described above in connection with particular embodiments and examples, the invention is not necessarily so limited, and that numerous other embodiments, examples, uses, modifications and departures from the embodiments, examples and uses are intended to be encompassed by the claims attached hereto. The entire disclosure of each patent and publication cited herein is incorporated by reference, as if each such patent or publication were individually incorporated by reference herein. Various features and advantages of the invention are set forth in the following claims.

Claims
  • 1. A device for regenerating an infrared signal transmitted over the air for use in detecting a 3-dimensional position of an object, comprising: a transmitter configured to transmit an infrared signal over the air, wherein the infrared signal includes a burst pattern and a non-burst pattern;a detector configured to receive from a plurality of tracking markers of an object to be tracked a responsive infrared signal in response to the transmitted infrared signal;a filter configured to receive the responsive infrared signal and output a filtered signal, wherein the filter is a low-pass filter;a comparator configured to generate a comparator output representing a logic state based on a first input receiving the responsive infrared signal from the detector and a second input receiving the low-pass filtered signal from the filter; anda position recognition module configured to continuously determine a 3-dimensional position of the object based on the burst and non-burst pattern contained in the responsive infrared signal coming from the plurality of tracking markers as detected by the detector.
  • 2. The device of claim 1, wherein the detector is configured to receive a reflection of the infrared signal transmitted by the transmitter as the responsive infrared signal.
  • 3. The device of claim 1, further comprising an amplifier configured to generate an amplified responsive infrared signal as input to the low-pass filter and the comparator.
  • 4. The device of claim 3, further comprising a diode configured to reduce the voltage of the amplified responsive infrared signal by a predetermined amount.
  • 5. The device of claim 4, wherein the diode has a forward bias voltage of 0.4 Volt or less.
  • 6. The device of claim 1, wherein the transmitter includes an infrared transmitter contained in each of the tracking markers.
  • 7. The device of claim 3, further comprising a diode connected between the amplifier and the low pass filter, wherein the diode is configured to reduce the voltage of the amplified responsive infrared signal by a predetermined amount, and wherein the filter includes a capacitor coupled between the diode and ground.
  • 8. The device of claim 1, wherein the filter includes: a voltage divider having first and second resistors connected in series between the output of the detector and ground, a node between the first and second resistors defining an output of the voltage divider.
  • 9. The device of claim 8, wherein the filter further includes a capacitor coupled between the voltage divider output and ground.
  • 10. The device of claim 1, further comprising: a signal processor configured to receive the comparator output and determining a 3-dimensional position of the object.
  • 11. A device for recognizing a position of an object via an infrared signal for use with a robot-assisted surgery comprising: a transmitter configured to transmit an infrared signal, wherein the infrared signal includes a burst pattern;a detector configured to receive from a plurality of tracking markers of an object to be tracked a responsive infrared signal in response to the transmitted infrared signal;a low-pass filter configured to receive the responsive infrared signal and output a low-pass filtered signal;a comparator configured to generate a comparator output representing a logic state based on a first input receiving the responsive infrared signal from the detector and a second input receiving the filtered signal from the low-pass filter; andan amplifier configured to amplify the responsive infrared signal prior to the filter receiving the responsive infrared signal;a position recognition module configured to continuously determine a 3-dimensional position of the object based on the burst pattern contained in the responsive infrared signal coming from the plurality of tracking markers as detected by the detector.
  • 12. The position recognition system of claim 11, wherein the amplifier is coupled between the receiver and the filter.
  • 13. The position recognition system of claim 12, further comprising a diode configured to reduce the voltage of the amplified responsive infrared signal by a predetermined amount.
  • 14. The position recognition system of claim 11, further comprising a diode configured to reduce the voltage of the responsive infrared signal after being amplified by the amplifier by a predetermined amount via a diode connected between the amplifier and the low pass filter.
  • 15. The position recognition system of claim 14, wherein the low pass filter includes a capacitor coupled between the diode and ground.
  • 16. The position recognition system of claim 11, wherein the low pass filter includes: a voltage divider having first and second resistors connected in series between the output of the infrared signal receiver and ground, a node between the first and second resistors defining an output of the voltage divider.
  • 17. The position recognition system of claim 16, wherein the low pass filter further includes a capacitor coupled between the voltage divider output and ground.
  • 18. The position recognition system of claim 15, further comprising a signal processor configured to receive the comparator output and determine a 3-dimensional position of the object.
  • 19. The position recognition system of claim 11, wherein the detector is configured to receive a reflection of the infrared signal transmitted by the transmitter as the responsive infrared signal.
  • 20. The position recognition system of claim 11, further comprising a Schottky diode coupled between the amplifier and filter.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 16/837,433, filed on Apr. 1, 2020 (published as U.S. Pat. Pub. No. 2020-0229881), which is a continuation of U.S. patent application Ser. No. 16/260,249, filed on Jan. 29, 2019 (now U.S. Pat. No. 10,639,112), which is a divisional patent application of U.S. patent application Ser. No. 15/135,658, filed on Apr. 22, 2016 (now U.S. Pat. No. 10,231,791), which is a continuation-in-part of U.S. patent application Ser. No. 15/095,883, filed Apr. 11, 2016 (now U.S. Pat. No. 10,893,912), which is a continuation-in-part of U.S. patent application Ser. No. 14/062,707 (now U.S. Pat. No. 10,357,184), filed on Oct. 24, 2013, which is a continuation-in-part application of U.S. patent application Ser. No. 13/924,505, filed on Jun. 21, 2013 (now U.S. Pat. No. 9,782,229), which claims priority to provisional application No. 61/662,702 filed on Jun. 21, 2012 and claims priority to provisional application No. 61/800,527 filed on Mar. 15, 2013, all of which are incorporated by reference herein in their entireties for all purposes.

US Referenced Citations (547)
Number Name Date Kind
5354314 Hardy et al. Oct 1994 A
5397323 Taylor et al. Mar 1995 A
5602568 Kim Feb 1997 A
5772594 Barrick Jun 1998 A
5791908 Gillio Aug 1998 A
5820559 Ng et al. Oct 1998 A
5825982 Wright et al. Oct 1998 A
5887121 Funda et al. Mar 1999 A
5911449 Daniele et al. Jun 1999 A
5951475 Gueziec et al. Sep 1999 A
6012216 Esteves et al. Jan 2000 A
6033415 Mittelstadt et al. Mar 2000 A
6080181 Jensen et al. Jun 2000 A
6106511 Jensen Aug 2000 A
6122541 Cosman et al. Sep 2000 A
6157853 Blume et al. Dec 2000 A
6167145 Foley et al. Dec 2000 A
6167292 Badano et al. Dec 2000 A
6201984 Funda et al. Mar 2001 B1
6205411 DiGioia, III et al. Mar 2001 B1
6212419 Blume et al. Apr 2001 B1
6231565 Tovey et al. May 2001 B1
6236875 Bucholz et al. May 2001 B1
6246900 Cosman et al. Jun 2001 B1
6301495 Gueziec et al. Oct 2001 B1
6312435 Wallace et al. Nov 2001 B1
6314311 Williams et al. Nov 2001 B1
6322567 Mittelstadt et al. Nov 2001 B1
6325808 Bernard et al. Dec 2001 B1
6340363 Bolger et al. Jan 2002 B1
6377011 Ben-Ur Apr 2002 B1
6379302 Kessman et al. Apr 2002 B1
6402762 Hunter et al. Jun 2002 B2
6424885 Niemeyer et al. Jul 2002 B1
6447503 Wynne et al. Sep 2002 B1
6451027 Cooper et al. Sep 2002 B1
6477400 Barrick Nov 2002 B1
6484049 Seeley et al. Nov 2002 B1
6490467 Bucholz et al. Dec 2002 B1
6490475 Seeley et al. Dec 2002 B1
6499488 Hunter et al. Dec 2002 B1
6507751 Blume et al. Jan 2003 B2
6535756 Simon et al. Mar 2003 B1
6560354 Maurer, Jr. et al. May 2003 B1
6565554 Niemeyer May 2003 B1
6587750 Gerbi et al. Jul 2003 B2
6614453 Suri et al. Sep 2003 B1
6636757 Jascob et al. Oct 2003 B1
6645196 Nixon et al. Nov 2003 B1
6669635 Kessman et al. Dec 2003 B2
6701173 Nowinski et al. Mar 2004 B2
6782287 Grzeszczuk et al. Aug 2004 B2
6783524 Anderson et al. Aug 2004 B2
6786896 Madhani et al. Sep 2004 B1
6788018 Blumenkranz Sep 2004 B1
6804581 Wang et al. Oct 2004 B2
6823207 Jensen et al. Nov 2004 B1
6827351 Graziani et al. Dec 2004 B2
6837892 Shoham Jan 2005 B2
6839612 Sanchez et al. Jan 2005 B2
6856826 Seeley et al. Feb 2005 B2
6856827 Seeley et al. Feb 2005 B2
6879880 Nowlin et al. Apr 2005 B2
6892090 Verard et al. May 2005 B2
6920347 Simon et al. Jul 2005 B2
6968224 Kessman et al. Nov 2005 B2
6978166 Foley et al. Dec 2005 B2
6991627 Madhani et al. Jan 2006 B2
6999852 Green Feb 2006 B2
7007699 Martinelli et al. Mar 2006 B2
7063705 Young et al. Jun 2006 B2
7072707 Galloway, Jr. et al. Jul 2006 B2
7083615 Peterson et al. Aug 2006 B2
7097640 Wang et al. Aug 2006 B2
7130676 Barrick Oct 2006 B2
7139418 Abovitz et al. Nov 2006 B2
7139601 Bucholz et al. Nov 2006 B2
7155316 Sutherland et al. Dec 2006 B2
7164968 Treat et al. Jan 2007 B2
7167738 Schweikard et al. Jan 2007 B2
7169141 Brock et al. Jan 2007 B2
7172627 Fiere et al. Feb 2007 B2
7239940 Wang et al. Jul 2007 B2
7248914 Hastings et al. Jul 2007 B2
7302288 Schellenberg Nov 2007 B1
7313430 Urquhart et al. Dec 2007 B2
7318827 Leitner et al. Jan 2008 B2
7319897 Leitner et al. Jan 2008 B2
7327865 Fu et al. Feb 2008 B2
7331967 Lee et al. Feb 2008 B2
7333642 Green Feb 2008 B2
7339341 Oleynikov et al. Mar 2008 B2
7366562 Dukesherer et al. Apr 2008 B2
7379790 Toth et al. May 2008 B2
7386365 Nixon Jun 2008 B2
7422592 Morley et al. Sep 2008 B2
7435216 Kwon et al. Oct 2008 B2
7440793 Chauhan et al. Oct 2008 B2
7466303 Yi et al. Dec 2008 B2
7493153 Ahmed et al. Feb 2009 B2
7505617 Fu et al. Mar 2009 B2
7533892 Schena et al. May 2009 B2
7542791 Mire et al. Jun 2009 B2
7555331 Viswanathan Jun 2009 B2
7567834 Clayton et al. Jul 2009 B2
7594912 Cooper et al. Sep 2009 B2
7606613 Simon et al. Oct 2009 B2
7607440 Coste-Maniere et al. Oct 2009 B2
7630752 Viswanathan Dec 2009 B2
7630753 Simon et al. Dec 2009 B2
7643862 Schoenefeld Jan 2010 B2
7660623 Hunter et al. Feb 2010 B2
7689320 Prisco et al. Mar 2010 B2
7691098 Wallace et al. Apr 2010 B2
7702379 Avinash et al. Apr 2010 B2
7711406 Kuhn et al. May 2010 B2
7720523 Omernick et al. May 2010 B2
7742801 Neubauer et al. Jun 2010 B2
7751865 Jascob et al. Jul 2010 B2
7762825 Burbank et al. Jul 2010 B2
7763015 Cooper et al. Jul 2010 B2
7787699 Mahesh et al. Aug 2010 B2
7818044 Dukesherer et al. Oct 2010 B2
7819859 Prisco et al. Oct 2010 B2
7824401 Manzo et al. Nov 2010 B2
7831294 Viswanathan Nov 2010 B2
7834484 Sartor Nov 2010 B2
7835557 Kendrick et al. Nov 2010 B2
7835778 Foley et al. Nov 2010 B2
7835784 Mire et al. Nov 2010 B2
7840253 Tremblay et al. Nov 2010 B2
7840256 Lakin et al. Nov 2010 B2
7843158 Prisco Nov 2010 B2
7844320 Shahidi Nov 2010 B2
7853305 Simon et al. Dec 2010 B2
7865269 Prisco et al. Jan 2011 B2
D631966 Perloff et al. Feb 2011 S
7879045 Gielen et al. Feb 2011 B2
7881767 Strommer et al. Feb 2011 B2
7881770 Melkent et al. Feb 2011 B2
7886743 Cooper et al. Feb 2011 B2
RE42194 Foley et al. Mar 2011 E
RE42226 Foley et al. Mar 2011 E
7907166 Lamprecht et al. Mar 2011 B2
7909122 Schena et al. Mar 2011 B2
7925653 Saptharishi Apr 2011 B2
7930065 Larkin et al. Apr 2011 B2
7935130 Willliams May 2011 B2
7940999 Liao et al. May 2011 B2
7953470 Vetter et al. May 2011 B2
7954397 Choi et al. Jun 2011 B2
7971341 Dukesherer et al. Jul 2011 B2
7974674 Hauck et al. Jul 2011 B2
7974677 Mire et al. Jul 2011 B2
7974681 Wallace et al. Jul 2011 B2
7979157 Anvari Jul 2011 B2
7983733 Viswanathan Jul 2011 B2
3004121 Sartor Aug 2011 A1
3010177 Csavoy et al. Aug 2011 A1
7988215 Seibold Aug 2011 B2
7996110 Lipow et al. Aug 2011 B2
8004229 Nowlin et al. Aug 2011 B2
8018579 Krah Sep 2011 B1
3046057 Clarke Oct 2011 A1
8035685 Jensen Oct 2011 B2
8046054 Kim et al. Oct 2011 B2
3054184 Cline et al. Nov 2011 A1
3057407 Martinelli et al. Nov 2011 A1
8054752 Druke et al. Nov 2011 B2
8057397 Li et al. Nov 2011 B2
8062288 Cooper et al. Nov 2011 B2
8062375 Glerum et al. Nov 2011 B2
8066524 Burbank et al. Nov 2011 B2
8073335 Labonville et al. Dec 2011 B2
8079950 Stern et al. Dec 2011 B2
8092370 Roberts et al. Jan 2012 B2
8105320 Manzo Jan 2012 B2
8108025 Csavoy et al. Jan 2012 B2
8109877 Moctezuma de la Barrera et al. Feb 2012 B2
8112292 Simon Feb 2012 B2
8120301 Goldberg et al. Feb 2012 B2
8123675 Funda et al. Feb 2012 B2
8133229 Bonutti Mar 2012 B1
8142420 Schena Mar 2012 B2
8147494 Leitner et al. Apr 2012 B2
8150494 Simon et al. Apr 2012 B2
8150497 Gielen et al. Apr 2012 B2
8150498 Gielen et al. Apr 2012 B2
8165658 Waynik et al. Apr 2012 B2
8170313 Kendrick et al. May 2012 B2
8179073 Farritor et al. May 2012 B2
8182476 Julian et al. May 2012 B2
8184880 Zhao et al. May 2012 B2
8202278 Orban, III et al. Jun 2012 B2
8208988 Jensen Jun 2012 B2
8219177 Smith et al. Jul 2012 B2
8219178 Smith et al. Jul 2012 B2
8220468 Cooper et al. Jul 2012 B2
8224484 Swarup et al. Jul 2012 B2
8225798 Baldwin et al. Jul 2012 B2
8228368 Zhao et al. Jul 2012 B2
8231610 Jo et al. Jul 2012 B2
8263933 Hartmann et al. Jul 2012 B2
8239001 Verard et al. Aug 2012 B2
8241271 Millman et al. Aug 2012 B2
8248413 Gattani et al. Aug 2012 B2
8256319 Cooper et al. Sep 2012 B2
8271069 Jascob et al. Sep 2012 B2
8271130 Hourtash Sep 2012 B2
8281670 Larkin et al. Oct 2012 B2
8282653 Nelson et al. Oct 2012 B2
8301226 Csavoy et al. Oct 2012 B2
8311611 Csavoy et al. Nov 2012 B2
8320991 Jascob et al. Nov 2012 B2
8332012 Kienzle, III Dec 2012 B2
8333755 Cooper et al. Dec 2012 B2
8335552 Stiles Dec 2012 B2
8348931 Cooper et al. Jan 2013 B2
8353963 Glerum Jan 2013 B2
8358818 Miga et al. Jan 2013 B2
8359730 Burg Jan 2013 B2
8374673 Adcox et al. Feb 2013 B2
8374723 Zhao et al. Feb 2013 B2
8392022 Ortmaier et al. Mar 2013 B2
8394099 Patwardhan Mar 2013 B2
8395342 Prisco Mar 2013 B2
8398634 Manzo et al. Mar 2013 B2
8400094 Schena Mar 2013 B2
8414957 Enzerink et al. Apr 2013 B2
8418073 Mohr et al. Apr 2013 B2
8450694 Baviera et al. May 2013 B2
8452447 Nixon May 2013 B2
RE44305 Foley et al. Jun 2013 E
8465476 Rogers et al. Jun 2013 B2
8465771 Wan et al. Jun 2013 B2
8467851 Mire et al. Jun 2013 B2
8467852 Csavoy et al. Jun 2013 B2
8469947 Devengenzo et al. Jun 2013 B2
RE44392 Hynes Jul 2013 E
8483434 Buehner et al. Jul 2013 B2
8483800 Jensen et al. Jul 2013 B2
8486532 Enzerink et al. Jul 2013 B2
8489235 Moll et al. Jul 2013 B2
8500722 Cooper Aug 2013 B2
8500728 Newton et al. Aug 2013 B2
8504201 Moll et al. Aug 2013 B2
8506555 Ruiz Morales Aug 2013 B2
8506556 Schena Aug 2013 B2
8508173 Goldberg et al. Aug 2013 B2
8512318 Tovey et al. Aug 2013 B2
8515576 Lipow et al. Aug 2013 B2
8518120 Glerum et al. Aug 2013 B2
8521331 Itkowitz Aug 2013 B2
8526688 Groszmann et al. Sep 2013 B2
8526700 Issacs Sep 2013 B2
8527094 Kumar et al. Sep 2013 B2
8528440 Morley et al. Sep 2013 B2
8532741 Heruth et al. Sep 2013 B2
8541970 Nowlin et al. Sep 2013 B2
8548563 Simon et al. Oct 2013 B2
8549732 Burg et al. Oct 2013 B2
8551114 Ramos de la Pena Oct 2013 B2
8551116 Julian et al. Oct 2013 B2
8556807 Scott et al. Oct 2013 B2
8556979 Glerum et al. Oct 2013 B2
8561473 Blumenkranz Oct 2013 B2
8562594 Cooper et al. Oct 2013 B2
8571638 Shoham Oct 2013 B2
8571710 Coste-Maniere et al. Oct 2013 B2
8573465 Shelton, IV Nov 2013 B2
8574303 Sharkey et al. Nov 2013 B2
8585420 Burbank et al. Nov 2013 B2
8594841 Zhao et al. Nov 2013 B2
8600478 Verard et al. Dec 2013 B2
8603077 Cooper et al. Dec 2013 B2
8611985 Lavallee et al. Dec 2013 B2
8613230 Blumenkranz et al. Dec 2013 B2
8621939 Blumenkranz et al. Jan 2014 B2
8624537 Nowlin et al. Jan 2014 B2
8634897 Simon et al. Jan 2014 B2
8634957 Toth et al. Jan 2014 B2
8638056 Goldberg et al. Jan 2014 B2
8638057 Goldberg et al. Jan 2014 B2
8639000 Zhao et al. Jan 2014 B2
8641726 Bonutti Feb 2014 B2
8644907 Hartmann et al. Feb 2014 B2
8657809 Schoepp Feb 2014 B2
8660635 Simon et al. Feb 2014 B2
8666544 Moll et al. Mar 2014 B2
8675939 Moctezuma de la Barrera Mar 2014 B2
8679125 Smith et al. Mar 2014 B2
8679183 Glerum et al. Mar 2014 B2
8682413 Lloyd Mar 2014 B2
8684253 Giordano et al. Apr 2014 B2
8685098 Glerum et al. Apr 2014 B2
8693730 Umasuthan et al. Apr 2014 B2
8694075 Groszmann et al. Apr 2014 B2
8700123 Okamura et al. Apr 2014 B2
8706086 Glerum Apr 2014 B2
8706185 Foley et al. Apr 2014 B2
8706301 Zhao et al. Apr 2014 B2
8717430 Simon et al. May 2014 B2
8734432 Tuma et al. May 2014 B2
8738181 Greer et al. May 2014 B2
8740882 Jun et al. Jun 2014 B2
8746252 McGrogan et al. Jun 2014 B2
8749189 Nowlin et al. Jun 2014 B2
8749190 Nowlin et al. Jun 2014 B2
8761930 Nixon Jun 2014 B2
8764448 Yang et al. Jul 2014 B2
8771170 Mesallum et al. Jul 2014 B2
8781186 Clements et al. Jul 2014 B2
8781630 Banks et al. Jul 2014 B2
8784385 Boyden et al. Jul 2014 B2
8786241 Nowlin et al. Jul 2014 B2
8792704 Isaacs Jul 2014 B2
8800838 Shelton, IV Aug 2014 B2
8808164 Hoffman et al. Aug 2014 B2
8812077 Dempsey Aug 2014 B2
8816628 Nowlin et al. Aug 2014 B2
8818105 Myronenko et al. Aug 2014 B2
8820605 Shelton, IV Sep 2014 B2
8821511 von Jako et al. Sep 2014 B2
8823308 Nowlin et al. Sep 2014 B2
8827996 Scott et al. Sep 2014 B2
8828024 Farritor et al. Sep 2014 B2
8830224 Zhao et al. Sep 2014 B2
8834489 Cooper et al. Sep 2014 B2
8834490 Bonutti Sep 2014 B2
8838270 Druke et al. Sep 2014 B2
8844789 Shelton, IV et al. Sep 2014 B2
8855822 Bartol et al. Oct 2014 B2
8858598 Seifert et al. Oct 2014 B2
8860753 Bhandarkar et al. Oct 2014 B2
8864751 Prisco et al. Oct 2014 B2
8864798 Weiman et al. Oct 2014 B2
8864833 Glerum et al. Oct 2014 B2
8870880 Himmelberger et al. Oct 2014 B2
8876866 Zappacosta et al. Nov 2014 B2
8880223 Raj et al. Nov 2014 B2
8882803 Iott et al. Nov 2014 B2
8883210 Truncale et al. Nov 2014 B1
8888853 Glerum et al. Nov 2014 B2
8888854 Glerum et al. Nov 2014 B2
8894652 Seifert et al. Nov 2014 B2
8894688 Suh Nov 2014 B2
8894691 Iott et al. Nov 2014 B2
8906069 Hansell et al. Dec 2014 B2
10231791 LeBoeuf, II Mar 2019 B2
10639112 LeBoeuf, II May 2020 B2
11103320 LeBoeuf, II Aug 2021 B2
20010036302 Miller Nov 2001 A1
20020035321 Bucholz et al. Mar 2002 A1
20040068172 Nowinski et al. Apr 2004 A1
20040076259 Jensen et al. Apr 2004 A1
20050096502 Khalili May 2005 A1
20050143651 Verard et al. Jun 2005 A1
20050171558 Abovitz et al. Aug 2005 A1
20060100610 Wallace et al. May 2006 A1
20060173329 Marquart et al. Aug 2006 A1
20060184396 Dennis et al. Aug 2006 A1
20060241416 Marquart et al. Oct 2006 A1
20070015987 Benlloch Baviera et al. Jan 2007 A1
20070021738 Hasser et al. Jan 2007 A1
20070038059 Sheffer et al. Feb 2007 A1
20070073133 Schoenefeld Mar 2007 A1
20070156121 Millman et al. Jul 2007 A1
20070156157 Nahum et al. Jul 2007 A1
20070167712 Keglovich et al. Jul 2007 A1
20070233238 Huynh et al. Oct 2007 A1
20080004523 Jensen Jan 2008 A1
20080013809 Zhu et al. Jan 2008 A1
20080033283 Dellaca et al. Feb 2008 A1
20080046122 Manzo et al. Feb 2008 A1
20080082109 Moll et al. Apr 2008 A1
20080108912 Node-Langlois May 2008 A1
20080108991 von Jako May 2008 A1
20080109012 Falco et al. May 2008 A1
20080144906 Allred et al. Jun 2008 A1
20080161680 von Jako et al. Jul 2008 A1
20080161682 Kendrick et al. Jul 2008 A1
20080177203 von Jako Jul 2008 A1
20080214922 Hartmann et al. Sep 2008 A1
20080228068 Viswanathan et al. Sep 2008 A1
20080228196 Wang et al. Sep 2008 A1
20080235052 Node-Langlois et al. Sep 2008 A1
20080269596 Revie et al. Oct 2008 A1
20080287771 Anderson Nov 2008 A1
20080287781 Revie et al. Nov 2008 A1
20080300477 Lloyd et al. Dec 2008 A1
20080300478 Zuhars et al. Dec 2008 A1
20080306490 Lakin et al. Dec 2008 A1
20080319311 Hamadeh Dec 2008 A1
20090012509 Csavoy et al. Jan 2009 A1
20090030428 Omori et al. Jan 2009 A1
20090080737 Battle et al. Mar 2009 A1
20090216113 Meier et al. Aug 2009 A1
20090228019 Gross et al. Sep 2009 A1
20090259123 Navab et al. Oct 2009 A1
20090259230 Khadem et al. Oct 2009 A1
20090264899 Appenrodt et al. Oct 2009 A1
20090281417 Hartmann et al. Nov 2009 A1
20100022874 Wang et al. Jan 2010 A1
20100039506 Sarvestani et al. Feb 2010 A1
20100125286 Wang et al. May 2010 A1
20100130986 Mailloux et al. May 2010 A1
20100228117 Hartmann Sep 2010 A1
20100228265 Prisco Sep 2010 A1
20100249571 Jensen et al. Sep 2010 A1
20100280363 Skarda et al. Nov 2010 A1
20100331858 Simaan et al. Dec 2010 A1
20110022229 Jang et al. Jan 2011 A1
20110077504 Fischer et al. Mar 2011 A1
20110098553 Robbins et al. Apr 2011 A1
20110137152 Li Jun 2011 A1
20110213384 Jeong Sep 2011 A1
20110224684 Larkin et al. Sep 2011 A1
20110224685 Larkin et al. Sep 2011 A1
20110224686 Larkin et al. Sep 2011 A1
20110224687 Larkin et al. Sep 2011 A1
20110224688 Larkin et al. Sep 2011 A1
20110224689 Larkin et al. Sep 2011 A1
20110224825 Larkin et al. Sep 2011 A1
20110230967 O'Halloran et al. Sep 2011 A1
20110238080 Ranjit et al. Sep 2011 A1
20110276058 Choi et al. Nov 2011 A1
20110282189 Graumann Nov 2011 A1
20110295062 Gratacos Solsona et al. Dec 2011 A1
20110295370 Suh et al. Dec 2011 A1
20110306986 Lee et al. Dec 2011 A1
20120046668 Gantes Feb 2012 A1
20120053597 Anvari et al. Mar 2012 A1
20120059248 Holsing et al. Mar 2012 A1
20120071753 Hunter et al. Mar 2012 A1
20120108954 Schulhauser et al. May 2012 A1
20120136372 Amat Girbau et al. May 2012 A1
20120184839 Woerlein Jul 2012 A1
20120197182 Millman et al. Aug 2012 A1
20120226145 Chang et al. Sep 2012 A1
20120235909 Birkenbach et al. Sep 2012 A1
20120245596 Meenink Sep 2012 A1
20120253332 Moll Oct 2012 A1
20120253360 White et al. Oct 2012 A1
20120256092 Zingerman Oct 2012 A1
20120294498 Popovic Nov 2012 A1
20120296203 Hartmann et al. Nov 2012 A1
20130006267 Odermatt et al. Jan 2013 A1
20130016889 Myronenko et al. Jan 2013 A1
20130030571 Ruiz Morales et al. Jan 2013 A1
20130035583 Park et al. Feb 2013 A1
20130060146 Yang et al. Mar 2013 A1
20130060337 Petersheim et al. Mar 2013 A1
20130094742 Feilkas Apr 2013 A1
20130096574 Kang et al. Apr 2013 A1
20130113791 Isaacs et al. May 2013 A1
20130116706 Lee et al. May 2013 A1
20130131695 Scarfogliero et al. May 2013 A1
20130144307 Jeong et al. Jun 2013 A1
20130158542 Manzo et al. Jun 2013 A1
20130165937 Patwardhan Jun 2013 A1
20130178867 Farritor et al. Jul 2013 A1
20130178868 Roh Jul 2013 A1
20130178870 Schena Jul 2013 A1
20130204271 Brisson et al. Aug 2013 A1
20130211419 Jensen Aug 2013 A1
20130211420 Jensen Aug 2013 A1
20130218142 Tuma et al. Aug 2013 A1
20130223702 Holsing et al. Aug 2013 A1
20130225942 Holsing et al. Aug 2013 A1
20130225943 Holsing et al. Aug 2013 A1
20130231556 Holsing et al. Sep 2013 A1
20130237995 Lee et al. Sep 2013 A1
20130245375 DiMaio et al. Sep 2013 A1
20130261640 Kim et al. Oct 2013 A1
20130272488 Bailey et al. Oct 2013 A1
20130272489 Dickman et al. Oct 2013 A1
20130274761 Devengenzo et al. Oct 2013 A1
20130281821 Liu et al. Oct 2013 A1
20130296884 Taylor et al. Nov 2013 A1
20130303887 Holsing et al. Nov 2013 A1
20130307955 Deitz et al. Nov 2013 A1
20130317521 Choi et al. Nov 2013 A1
20130325033 Schena et al. Dec 2013 A1
20130325035 Hauck et al. Dec 2013 A1
20130331686 Freysinger et al. Dec 2013 A1
20130331858 Devengenzo et al. Dec 2013 A1
20130331861 Yoon Dec 2013 A1
20130342578 Isaacs Dec 2013 A1
20130345717 Markvicka et al. Dec 2013 A1
20140001235 Shelton, IV Jan 2014 A1
20140012131 Heruth et al. Jan 2014 A1
20140031664 Kang et al. Jan 2014 A1
20140046128 Lee et al. Feb 2014 A1
20140046132 Hoeg et al. Feb 2014 A1
20140046340 Wilson et al. Feb 2014 A1
20140058406 Tsekos Feb 2014 A1
20140073914 Lavallee et al. Mar 2014 A1
20140080086 Chen Mar 2014 A1
20140081128 Verard et al. Mar 2014 A1
20140088612 Bartol et al. Mar 2014 A1
20140094694 Moctezuma de la Barrera Apr 2014 A1
20140094851 Gordon Apr 2014 A1
20140096369 Matsumoto et al. Apr 2014 A1
20140100587 Farritor et al. Apr 2014 A1
20140121676 Kostrzewski et al. May 2014 A1
20140128882 Kwak et al. May 2014 A1
20140135796 Simon et al. May 2014 A1
20140142591 Alvarez et al. May 2014 A1
20140142592 Moon et al. May 2014 A1
20140148692 Hartmann et al. May 2014 A1
20140163581 Devengenzo et al. Jun 2014 A1
20140171781 Stiles Jun 2014 A1
20140171900 Stiles Jun 2014 A1
20140171965 Loh et al. Jun 2014 A1
20140180308 von Grunberg Jun 2014 A1
20140180309 Seeber et al. Jun 2014 A1
20140187915 Yaroshenko et al. Jul 2014 A1
20140188132 Kang Jul 2014 A1
20140194699 Roh et al. Jul 2014 A1
20140221819 Sarment Aug 2014 A1
20140222023 Kim et al. Aug 2014 A1
20140228631 Kwak et al. Aug 2014 A1
20140234804 Huang et al. Aug 2014 A1
20140257328 Kim et al. Sep 2014 A1
20140257329 Jang et al. Sep 2014 A1
20140257330 Choi et al. Sep 2014 A1
20140275760 Lee et al. Sep 2014 A1
20140275985 Walker et al. Sep 2014 A1
20140276931 Parihar et al. Sep 2014 A1
20140276940 Seo Sep 2014 A1
20140276944 Farritor et al. Sep 2014 A1
20140288413 Hwang et al. Sep 2014 A1
20140299648 Shelton, IV et al. Oct 2014 A1
20140303434 Farritor et al. Oct 2014 A1
20140303643 Ha et al. Oct 2014 A1
20140305995 Shelton, IV et al. Oct 2014 A1
20140309659 Roh et al. Oct 2014 A1
20140316436 Bar et al. Oct 2014 A1
20140323803 Hoffman et al. Oct 2014 A1
20140324070 Min et al. Oct 2014 A1
20140330288 Date et al. Nov 2014 A1
20140364720 Darrow et al. Dec 2014 A1
20150192664 Sato et al. Jul 2015 A1
20150260831 Lewis Sep 2015 A1
20160235493 LeBoeuf, II Aug 2016 A1
20190239964 LeBoeuf, II Aug 2019 A1
20200229881 LeBoeuf, II Jul 2020 A1
Foreign Referenced Citations (1)
Number Date Country
2015534480 Dec 2015 JP
Non-Patent Literature Citations (1)
Entry
US 8,231,638 B2, 07/2012, Swarup et al. (withdrawn)
Related Publications (1)
Number Date Country
20210346106 A1 Nov 2021 US
Provisional Applications (2)
Number Date Country
61800527 Mar 2013 US
61662702 Jun 2012 US
Divisions (1)
Number Date Country
Parent 15135658 Apr 2016 US
Child 16260249 US
Continuations (2)
Number Date Country
Parent 16837433 Apr 2020 US
Child 17385405 US
Parent 16260249 Jan 2019 US
Child 16837433 US
Continuation in Parts (3)
Number Date Country
Parent 15095883 Apr 2016 US
Child 15135658 US
Parent 14062707 Oct 2013 US
Child 15095883 US
Parent 13924505 Jun 2013 US
Child 14062707 US