The present disclosure relates to position recognition systems and in particular, infrared based position recognition system for use with a robot assisted surgery.
Position recognition systems are used to determine the position of and track a particular object in 3-dimensions. In robot assisted surgeries, for example, certain objects, such as a surgical instrument, needs to be tracked with a high degree of precision as the instrument is being positioned and moved by a physician.
An infrared signal based position recognition systems use either passive sensors or active sensors. In passive sensors, objects to be tracked such as spherical balls are positioned at strategic locations of the object to be tracked. Infrared transmitters transmit a signal having a predetermined waveform pattern. The spherical balls reflect the signal and the reflected signals are received by infrared signal detectors that are generally located near the transmitters.
In active sensors, the objects to be tracked have their own infrared transmitters and thus generate their own infrared signals in response to the signals transmitted from an infrared transmitter of the position recognition system.
In either active or passive sensors, the responsive infrared signals from the objects to be tracked are received and amplified in a form which is as close to the original infrared signals as possible. The amplified signal is then converted into a digital signal which is usable by a signal processor. The system then geometrically resolves the 3-dimensional position of the spherical balls based on one or more of the converted digital signals, cameras, digital waveform shape of the amplified signals, known locations of the spherical balls, distance, the time it took to receive the responsive signals, or a combination thereof.
One problem is that due to attenuation of infrared signals, the conventional position recognition systems have a relatively limited working range of distance between the system and objects to be tracked. Typically, the working range is limited to about 3-5 meters, at best, before the amplified signal loses sufficient original waveform information to be useful.
Moreover, conventional systems require relatively high bandwidth, high slew rate amplifiers which involve complex and expensive circuits. Therefore there is a need to provide an improved system and method for recognizing the 3-dimensional position of an object, which has a longer working range, is accurate, and is less expensive.
To meet this and other needs, devices, systems, and methods for determining the 3-dimensional position of an object is provided. For example, an improved device for regenerating an infrared signal transmitted over the air for use in detecting a 3-dimensional position of an object is provided.
According to one embodiment, a surgical robot system includes a robot having a robot base and a display, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector having one or more tracking markers, wherein movement of the end-effector is electronically controlled by the robot. The system further includes a camera stand including at least one camera able to detect the one or more tracking markers, the camera including at least one infrared signal detector that receives from the one or more tracking markers an infrared signal, wherein the robot determines a 3-dimensional position of the one or more tracking markers based on the infrared signal, and wherein the infrared signal includes a burst signal. The infrared signal may include a burst pattern including the burst signal for a fixed amount of time and a non-burst signal for a fixed amount of time.
According to another embodiment, the regeneration device includes an infrared signal transmitter and an infrared signal detector that receives from the object a responsive infrared signal in response to the infrared signal transmitted by the infrared transmitter. A low pass filter receives the responsive infrared signal from the detector and outputs a low-pass filtered signal. A comparator has a first input connected to the output of the infrared signal detector and a second input connected to the output of the low pass filter. The comparator generates an output representing a logic state based on comparison between the first and second inputs.
Advantageously, the present invention relaxes the requirement of a high bandwidth, high slew output amplification and allows position recognition of the object over a longer distance due to less sensitivity of the signal amplitude variation.
It is to be understood that the present disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the description herein or illustrated in the drawings. The teachings of the present disclosure may be used and practiced in other embodiments and practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.
The following discussion is presented to enable a person skilled in the art to make and use embodiments of the present disclosure. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the principles herein can be applied to other embodiments and applications without departing from embodiments of the present disclosure. Thus, the embodiments are not intended to be limited to embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of the embodiments. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of the embodiments.
With respect to the other components of the robot 102, the display 110 can be attached to the surgical robot 102 and in other exemplary embodiments, display 110 can be detached from surgical robot 102, either within a surgical room with the surgical robot 102, or in a remote location. End-effector 112 may be coupled to the robot arm 104 and controlled by at least one motor. In exemplary embodiments, end-effector 112 can comprise a guide tube 114, which is able to receive and orient a surgical instrument 608 (described further herein) used to perform surgery on the patient 210. As used herein, the term “end-effector” is used interchangeably with the terms “end-effectuator” and “effectuator element.” Although generally shown with a guide tube 114, it will be appreciated that the end-effector 112 may be replaced with any suitable instrumentation suitable for use in surgery. In some embodiments, end-effector 112 can comprise any known structure for effecting the movement of the surgical instrument 608 in a desired manner.
The surgical robot 102 is able to control the translation and orientation of the end-effector 112. The robot 102 is able to move end-effector 112 along x-, y-, and z-axes, for example. The end-effector 112 can be configured for selective rotation about one or more of the x-, y-, and z-axis, and a Z Frame axis (such that one or more of the Euler Angles (e.g., roll, pitch, and/or yaw) associated with end-effector 112 can be selectively controlled). In some exemplary embodiments, selective control of the translation and orientation of end-effector 112 can permit performance of medical procedures with significantly improved accuracy compared to conventional robots that utilize, for example, a six degree of freedom robot arm comprising only rotational axes. For example, the surgical robot system 100 may be used to operate on patient 210, and robot arm 104 can be positioned above the body of patient 210, with end-effector 112 selectively angled relative to the z-axis toward the body of patient 210.
In some exemplary embodiments, the position of the surgical instrument 608 can be dynamically updated so that surgical robot 102 can be aware of the location of the surgical instrument 608 at all times during the procedure. Consequently, in some exemplary embodiments, surgical robot 102 can move the surgical instrument 608 to the desired position quickly without any further assistance from a physician (unless the physician so desires). In some further embodiments, surgical robot 102 can be configured to correct the path of the surgical instrument 608 if the surgical instrument 608 strays from the selected, preplanned trajectory. In some exemplary embodiments, surgical robot 102 can be configured to permit stoppage, modification, and/or manual control of the movement of end-effector 112 and/or the surgical instrument 608. Thus, in use, in exemplary embodiments, a physician or other user can operate the system 100, and has the option to stop, modify, or manually control the autonomous movement of end-effector 112 and/or the surgical instrument 608. Further details of surgical robot system 100 including the control and movement of a surgical instrument 608 by surgical robot 102 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.
The robotic surgical system 100 can comprise one or more tracking markers 118 configured to track the movement of robot arm 104, end-effector 112, patient 210, and/or the surgical instrument 608 in three dimensions. In exemplary embodiments, a plurality of tracking markers 118 can be mounted (or otherwise secured) thereon to an outer surface of the robot 102, such as, for example and without limitation, on base 106 of robot 102, on robot arm 104, or on the end effector 112. In exemplary embodiments, at least one tracking marker 118 of the plurality of tracking markers 118 can be mounted or otherwise secured to the end-effector 112. One or more tracking markers 118 can further be mounted (or otherwise secured) to the patient 210. In exemplary embodiments, the plurality of tracking markers 118 can be positioned on the patient 210 spaced apart from the surgical field 208 to reduce the likelihood of being obscured by the surgeon, surgical tools, or other parts of the robot 102. Further, one or more tracking markers 118 can be further mounted (or otherwise secured) to the surgical tools 608 (e.g., a screw driver, dilator, implant inserter, or the like). Thus, the tracking markers 118 enable each of the marked objects (e.g., the end effector 112, the patient 210, and the surgical tools 608) to be tracked by the robot 102. In exemplary embodiments, system 100 can use tracking information collected from each of the marked objects to calculate the orientation and location, for example, of the end effector 112, the surgical instrument 608 (e.g., positioned in the tube 114 of the end effector 112), and the relative position of the patient 210.
In exemplary embodiments, one or more of markers 118 may be optical markers. In some embodiments, the positioning of one or more tracking markers 118 on end-effector 112 can maximize the accuracy of the positional measurements by serving to check or verify the position of end-effector 112. Further details of surgical robot system 100 including the control, movement and tracking of surgical robot 102 and of a surgical instrument 608 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.
Exemplary embodiments include one or more markers 118 coupled to the surgical instrument 608. In exemplary embodiments, these markers 118, for example, coupled to the patient 210 and surgical instruments 608, as well as markers 118 coupled to the end effector 112 of the robot 102 can comprise conventional infrared light-emitting diodes (LEDs) or an Optotrak® diode capable of being tracked using a commercially available infrared optical tracking system such as Optotrak®. Optotrak® is a registered trademark of Northern Digital Inc., Waterloo, Ontario, Canada. In other embodiments, markers 118 can comprise conventional reflective spheres capable of being tracked using a commercially available optical tracking system such as Polaris Spectra. Polaris Spectra is also a registered trademark of Northern Digital, Inc. In an exemplary embodiment, the markers 118 coupled to the end effector 112 are active markers which comprise infrared light-emitting diodes which may be turned on and off, and the markers 118 coupled to the patient 210 and the surgical instruments 608 comprise passive reflective spheres.
In exemplary embodiments, light emitted from and/or reflected by markers 118 can be detected by camera 200 and can be used to monitor the location and movement of the marked objects. In alternative embodiments, markers 118 can comprise a radio-frequency and/or electromagnetic reflector or transceiver and the camera 200 can include or be replaced by a radio-frequency and/or electromagnetic transceiver.
Similar to surgical robot system 100,
Input power is supplied to system 300 via a power source 548 which may be provided to power distribution module 404. Power distribution module 404 receives input power and is configured to generate different power supply voltages that are provided to other modules, components, and subsystems of system 300. Power distribution module 404 may be configured to provide different voltage supplies to platform interface module 406, which may be provided to other components such as computer 408, display 304, speaker 536, driver 508 to, for example, power motors 512, 514, 516, 518 and end-effector 310, motor 510, ring 324, camera converter 542, and other components for system 300 for example, fans for cooling the electrical components within cabinet 316.
Power distribution module 404 may also provide power to other components such as tablet charging station 534 that may be located within tablet drawer 318. Tablet charging station 534 may be in wireless or wired communication with tablet 546 for charging table 546. Tablet 546 may be used by a surgeon consistent with the present disclosure and described herein.
Power distribution module 404 may also be connected to battery 402, which serves as temporary power source in the event that power distribution module 404 does not receive power from input power 548. At other times, power distribution module 404 may serve to charge battery 402 if necessary.
Other components of platform subsystem 502 may also include connector panel 320, control panel 322, and ring 324. Connector panel 320 may serve to connect different devices and components to system 300 and/or associated components and modules. Connector panel 320 may contain one or more ports that receive lines or connections from different components. For example, connector panel 320 may have a ground terminal port that may ground system 300 to other equipment, a port to connect foot pedal 544 to system 300, a port to connect to tracking subsystem 532, which may comprise position sensor 540, camera converter 542, and cameras 326 associated with camera stand 302. Connector panel 320 may also include other ports to allow USB, Ethernet, HDMI communications to other components, such as computer 408.
Control panel 322 may provide various buttons or indicators that control operation of system 300 and/or provide information regarding system 300. For example, control panel 322 may include buttons to power on or off system 300, lift or lower vertical column 312, and lift or lower stabilizers 520-526 that may be designed to engage casters 314 to lock system 300 from physically moving. Other buttons may stop system 300 in the event of an emergency, which may remove all motor power and apply mechanical brakes to stop all motion from occurring. Control panel 322 may also have indicators notifying the user of certain system conditions such as a line power indicator or status of charge for battery 402.
Ring 324 may be a visual indicator to notify the user of system 300 of different modes that system 300 is operating under and certain warnings to the user.
Computer subsystem 504 includes computer 408, display 304, and speaker 536. Computer 504 includes an operating system and software to operate system 300. Computer 504 may receive and process information from other components (for example, tracking subsystem 532, platform subsystem 502, and/or motion control subsystem 506) in order to display information to the user. Further, computer subsystem 504 may also include speaker 536 to provide audio to the user.
Tracking subsystem 532 may include position sensor 504 and converter 542. Tracking subsystem 532 may correspond to camera stand 302 including camera 326 as described with respect to
Motion control subsystem 506 may be configured to physically move vertical column 312, upper arm 306, lower arm 308, or rotate end-effector 310. The physical movement may be conducted through the use of one or more motors 510-518. For example, motor 510 may be configured to vertically lift or lower vertical column 312. Motor 512 may be configured to laterally move upper arm 308 around a point of engagement with vertical column 312 as shown in
Moreover, system 300 may provide for automatic movement of vertical column 312, upper arm 306, and lower arm 308 through a user indicating on display 304 (which may be a touchscreen input device) the location of a surgical instrument or component on three dimensional image of the patient's anatomy on display 304. The user may initiate this automatic movement by stepping on foot pedal 544 or some other input means.
A tracking array 612 may be mounted on instrument 608 to monitor the location and orientation of instrument tool 608. The tracking array 612 may be attached to an instrument 608 and may comprise tracking markers 804. As best seen in
Markers 702 may be disposed on or within end-effector 602 in a manner such that the markers 702 are visible by one or more cameras 200, 326 or other tracking devices associated with the surgical robot system 100, 300, 600. The camera 200, 326 or other tracking devices may track end-effector 602 as it moves to different positions and viewing angles by following the movement of tracking markers 702. The location of markers 702 and/or end-effector 602 may be shown on a display 110, 304 associated with the surgical robot system 100, 300, 600, for example, display 110 as shown in
For example, as shown in
In addition, in exemplary embodiments, end-effector 602 may be equipped with infrared (IR) receivers that can detect when an external camera 200, 326 is getting ready to read markers 702. Upon this detection, end-effector 602 may then illuminate markers 702. The detection by the IR receivers that the external camera 200, 326 is ready to read markers 702 may signal the need to synchronize a duty cycle of markers 702, which may be light emitting diodes, to an external camera 200, 326. This may also allow for lower power consumption by the robotic system as a whole, whereby markers 702 would only be illuminated at the appropriate time instead of being illuminated continuously. Further, in exemplary embodiments, markers 702 may be powered off to prevent interference with other navigation tools, such as different types of surgical instruments 608.
The manner in which a surgeon 120 may place instrument 608 into guide tube 606 of the end effector 602 and adjust the instrument 608 is evident in
End-effector 602 may mechanically interface and/or engage with the surgical robot system and robot arm 604 through one or more couplings. For example, end-effector 602 may engage with robot arm 604 through a locating coupling and/or a reinforcing coupling. Through these couplings, end-effector 602 may fasten with robot arm 604 outside a flexible and sterile barrier. In an exemplary embodiment, the locating coupling may be a magnetically kinematic mount and the reinforcing coupling may be a five bar over center clamping linkage.
With respect to the locating coupling, robot arm 604 may comprise mounting plate 1216, which may be non-magnetic material, one or more depressions 1214, lip 1218, and magnets 1220. Magnet 1220 is mounted below each of depressions 1214. Portions of clamp 1204 may comprise magnetic material and be attracted by one or more magnets 1220. Through the magnetic attraction of clamp 1204 and robot arm 604, balls 1208 become seated into respective depressions 1214. For example, balls 1208 as shown in
With respect to the reinforcing coupling, portions of clamp 1204 may be configured to be a fixed ground link and as such clamp 1204 may serve as a five bar linkage. Closing clamp handle 1206 may fasten end-effector 602 to robot arm 604 as lip 1212 and lip 1218 engage clamp 1204 in a manner to secure end-effector 602 and robot arm 604. When clamp handle 1206 is closed, spring 1210 may be stretched or stressed while clamp 1204 is in a locked position. The locked position may be a position that provides for linkage past center. Because of a closed position that is past center, the linkage will not open absent a force applied to clamp handle 1206 to release clamp 1204. Thus, in a locked position end-effector 602 may be robustly secured to robot arm 604.
Spring 1210 may be a curved beam in tension. Spring 1210 may be comprised of a material that exhibits high stiffness and high yield strain such as virgin PEEK (poly-ether-ether-ketone). The linkage between end-effector 602 and robot arm 604 may provide for a sterile barrier between end-effector 602 and robot arm 604 without impeding fastening of the two couplings.
The reinforcing coupling may be a linkage with multiple spring members. The reinforcing coupling may latch with a cam or friction based mechanism. The reinforcing coupling may also be a sufficiently powerful electromagnet that will support fastening end-effector 102 to robot arm 604. The reinforcing coupling may be a multi-piece collar completely separate from either end-effector 602 and/or robot arm 604 that slips over an interface between end-effector 602 and robot arm 604 and tightens with a screw mechanism, an over center linkage, or a cam mechanism.
Referring to
In order to track the position of the patient 210, a patient tracking device 116 may include a patient fixation instrument 1402 to be secured to a rigid anatomical structure of the patient 210 and a dynamic reference base (DRB) 1404 may be securely attached to the patient fixation instrument 1402. For example, patient fixation instrument 1402 may be inserted into opening 1406 of dynamic reference base 1404. Dynamic reference base 1404 may contain markers 1408 that are visible to tracking devices, such as tracking subsystem 532. These markers 1408 may be optical markers or reflective spheres, such as tracking markers 118, as previously discussed herein.
Patient fixation instrument 1402 is attached to a rigid anatomy of the patient 210 and may remain attached throughout the surgical procedure. In an exemplary embodiment, patient fixation instrument 1402 is attached to a rigid area of the patient 210, for example a bone that is located away from the targeted anatomical structure subject to the surgical procedure. In order to track the targeted anatomical structure, dynamic reference base 1404 is associated with the targeted anatomical structure through the use of a registration fixture that is temporarily placed on or near the targeted anatomical structure in order to register the dynamic reference base 1404 with the location of the targeted anatomical structure.
A registration fixture 1410 is attached to patient fixation instrument 1402 through the use of a pivot arm 1412. Pivot arm 1412 is attached to patient fixation instrument 1402 by inserting patient fixation instrument 1402 through an opening 1414 of registration fixture 1410. Pivot arm 1412 is attached to registration fixture 1410 by, for example, inserting a knob 1416 through an opening 1418 of pivot arm 1412.
Using pivot arm 1412, registration fixture 1410 may be placed over the targeted anatomical structure and its location may be determined in an image space and navigation space using tracking markers 1420 and/or fiducials 1422 on registration fixture 1410. Registration fixture 1410 may contain a collection of markers 1420 that are visible in a navigational space (for example, markers 1420 may be detectable by tracking subsystem 532). Tracking markers 1420 may be optical markers visible in infrared light as previously described herein. Registration fixture 1410 may also contain a collection of fiducials 1422, for example, such as bearing balls, that are visible in an imaging space (for example, a three dimension CT image). As described in greater detail with respect to
At step 1504, an imaging pattern of fiducials 1420 is detected and registered in the imaging space and stored in computer 408. Optionally, at this time at step 1506, a graphical representation of the registration fixture 1410 may be overlaid on the images of the targeted anatomical structure.
At step 1508, a navigational pattern of registration fixture 1410 is detected and registered by recognizing markers 1420. Markers 1420 may be optical markers that are recognized in the navigation space through infrared light by tracking subsystem 532 via position sensor 540. Thus, the location, orientation, and other information of the targeted anatomical structure is registered in the navigation space. Therefore, registration fixture 1410 may be recognized in both the image space through the use of fiducials 1422 and the navigation space through the use of markers 1420. At step 1510, the registration of registration fixture 1410 in the image space is transferred to the navigation space. This transferal is done, for example, by using the relative position of the imaging pattern of fiducials 1422 compared to the position of the navigation pattern of markers 1420.
At step 1512, registration of the navigation space of registration fixture 1410 (having been registered with the image space) is further transferred to the navigation space of dynamic registration array 1404 attached to patient fixture instrument 1402. Thus, registration fixture 1410 may be removed and dynamic reference base 1404 may be used to track the targeted anatomical structure in both the navigation and image space because the navigation space is associated with the image space.
At steps 1514 and 1516, the navigation space may be overlaid on the image space and objects with markers visible in the navigation space (for example, surgical instruments 608 with optical markers 804). The objects may be tracked through graphical representations of the surgical instrument 608 on the images of the targeted anatomical structure.
Turning now to
As shown in
The robot-assisted surgery system 100, 300, 600 uses an improved circuit/device 1672 for regenerating an infrared signal transmitted over the air for use in determining a 3-dimensional position of an object, such as the surgical tool 608. The infrared signal regeneration device 1672 of
As previously described, tracking markers 118, 702, such as spherical balls (objects to be tracked) 208 can be positioned on the surgical tool 608, the end-effector 112, 602, the patient 210, or other suitable locations. As identified in
A responsive infrared signal 1664 (transmitted by infrared transmitters in the objects 1608 in response to the signal from the infrared transmitter 1602 in the case of an active sensor or reflected by the objects from the signal from the infrared transmitter 1602 in the case of a passive sensor) is received by the infrared detectors D1 in analog form. While only one is shown in
The analog signal 1664 received by the infrared detectors D1 is then fed into an amplifier 1666. The amplifier can be, for example, a relatively inexpensive operational amplifier, such as part no. OPA2381 from Texas Instruments of Dallas, Tex. Although only one amplifier 1666 is shown, amplification of the analog signal 1664 may involve multiple amplifiers that are coupled in parallel or in series or both.
The output of the amplifier 1666 is fed into a diode D2 which is connected to a low pass filter 1668. The diode provides a small voltage drop to prepare the signal for comparison against the original output Vsig of the amplifier 1666. The diode D2 can be, for example, a Schottky diode having a forward bias voltage of about 400 mV. A Schottky diode may be preferable to a normal p-n junction type diode due to its fast response time.
The low pass filter 1668 includes an RC circuit (resistor R1, capacitor C1) and resistor R2 connected in parallel to the capacitor C1. The resistors R1 and R2 act as a voltage divider to divide the output of the diode D2. The values of the resistors R1, R2 can be, for example, 300 Ohms and 5 KOhms, respectively. Accordingly, most of the voltage drop occurs over the resistor R2.
As can be seen in
Referring to
D2, R1, C1 and R2 form a passive peak detector, and a voltage level
The voltage signal Vref is fed to the comparator 1670 and is compared against Vsig. Based on the comparison, the comparator 1670 generates a voltage Vout representing the low and high logic states which can be used by a digital signal processor for determining the 3-dimensional positions of the various objects being tracked. In other words, the comparator 1670 converts an analog signal into a digital signal, which can be easily processed by a processor 1646 such as a microcontroller or similar devices.
The signal Vref is lower in voltage than the signal Vsig. The amount of the voltage drop is predetermined based on the forward bias voltage drop of the diode D2 and the voltage drop across the resistor R1. The signal Vref has a relatively flat waveform due to the low pass filter 268.
The comparator 1670 generates a logic high signal (e.g., 5 Volt signal) when Vsig is greater than Vsig and a logic low signal (e.g., 0 Volt signal) when Vsig falls below Vref. As can be seen, the voltage at Vref is proportional to Vsig. At lower voltages (i.e., when the distance between the object 1608 and the infrared detector D1 is relatively long, the difference between Vsig and Vref may not be sufficient to toggle the comparator 1670 without the presence of the diode D2. The diode D2 ensures that there is at least a preset voltage difference between Vsig and Vref (i.e., forward bias voltage of diode D2). Thus, the presence of a diode D2 between the operational amplifier 1666 and the low pass filter 1668 may be important.
As can be seen by the waveform Vout in
Advantageously, this configuration relaxes the requirement of a high bandwidth, high slew output amplification. It is also not as sensitive to amplitude variations as simple amplification would be. This is because as Vsig decreases when the distance between the objects 1608 and infrared transmitter 1602 becomes longer, Vref also decreases. That allows the comparator 1670 to continue to toggle correctly when needed. This results in the effective working distance between the objects 1608 and infrared transmitter 1602 to increase by 75%-200% (7-10 meters).
The system 1640 is connected to the output of the comparator 1670 through a communication link 1652 which is connected to an I/O interface 1642, which receives information from and sends information over the communication link 1652. The system 1640 includes memory storage 1644 such as RAM (random access memory), processor (CPU) 1646, program storage 1648 such as FPGA, ROM or EEPROM, and data storage 1650 such as a hard disk, all commonly connected to each other through a bus 1653. The program storage 1648 stores, among others, a position recognition module 1654 containing software to be executed by the processor 1646. The position recognition module 1654 receives the digital waveform Vout through the communication link 1652 and determines the 3-dimensional position of the object 1608 based on the digital waveform, shape of the amplified signals, known locations of the objects and infrared detectors D1, and possibly the time it took to receive the responsive signals 1664. The position recognition module 1654 may also determine the 3-dimensional position of the objects 1608 with the help of the cameras 200, 326 (e.g. stereo cameras) and the tracking system 100, 300, 600. The camera or cameras 200, 326 can record regular optical images or infrared images or both.
The position recognition module 1654 also determines whether the objects being tracked are passive or active objects by analyzing the time it takes for the responsive signals to be received from the time the initial signal 1606 is transmitted. Since active objects will have a longer known delay amount between the transmission of signal 1606 and the receipt of the responsive signal, the module 1654 can distinguish the type of objects (e.g., passive or active) being tracked.
The position recognition module 1654 includes a user interface module that interacts with the user through the display device 1611 and input devices such as keyboard 1612 and pointing device 1614 such as arrow keys, mouse or track ball. The user interface module assists the user in programming the module 1654 to perform 3-dimensional position recognition of the objects 1608. Any of the software program modules in the program storage 1648 and data from the data storage 1650 can be transferred to the memory 1644 as needed and is executed by the CPU 1646.
One exemplary system 1640 may be 8051 microcontroller from Intel Corporation of Santa Clara, Calif.. However, any digital signal processor, processor or microcontroller can be used.
In one embodiment, parts of or the entire system 1640 including the input devices 1612, 1614 and display device 1611 can be incorporated into the robot system 100, 300, 600 or any suitable robotic surgical system. For example, the display 1611 can be the same as display 110, 304.
While the position recognition system 1640 has been described with reference to an infrared signal, the principles disclosed herein could be used with any optical signal as well as other signals such as ultrasound signal. Also, while only a single infrared signal has been described, the present system can transmit a set of infrared signals having either different wavelengths or waveform shapes each for reflection or transmission by a respective spherical ball to be tracked.
Although several embodiments of the invention have been disclosed in the foregoing specification, it is understood that many modifications and other embodiments of the invention will come to mind to which the invention pertains, having the benefit of the teaching presented in the foregoing description and associated drawings. It is thus understood that the invention is not limited to the specific embodiments disclosed hereinabove, and that many modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although specific terms are employed herein, as well as in the claims which follow, they are used only in a generic and descriptive sense, and not for the purposes of limiting the described invention, nor the claims which follow.
It will be appreciated by those skilled in the art that while the invention has been described above in connection with particular embodiments and examples, the invention is not necessarily so limited, and that numerous other embodiments, examples, uses, modifications and departures from the embodiments, examples and uses are intended to be encompassed by the claims attached hereto. The entire disclosure of each patent and publication cited herein is incorporated by reference, as if each such patent or publication were individually incorporated by reference herein. Various features and advantages of the invention are set forth in the following claims.
This application is a continuation of U.S. patent application Ser. No. 16/837,433, filed on Apr. 1, 2020 (published as U.S. Pat. Pub. No. 2020-0229881), which is a continuation of U.S. patent application Ser. No. 16/260,249, filed on Jan. 29, 2019 (now U.S. Pat. No. 10,639,112), which is a divisional patent application of U.S. patent application Ser. No. 15/135,658, filed on Apr. 22, 2016 (now U.S. Pat. No. 10,231,791), which is a continuation-in-part of U.S. patent application Ser. No. 15/095,883, filed Apr. 11, 2016 (now U.S. Pat. No. 10,893,912), which is a continuation-in-part of U.S. patent application Ser. No. 14/062,707 (now U.S. Pat. No. 10,357,184), filed on Oct. 24, 2013, which is a continuation-in-part application of U.S. patent application Ser. No. 13/924,505, filed on Jun. 21, 2013 (now U.S. Pat. No. 9,782,229), which claims priority to provisional application No. 61/662,702 filed on Jun. 21, 2012 and claims priority to provisional application No. 61/800,527 filed on Mar. 15, 2013, all of which are incorporated by reference herein in their entireties for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
5354314 | Hardy et al. | Oct 1994 | A |
5397323 | Taylor et al. | Mar 1995 | A |
5602568 | Kim | Feb 1997 | A |
5772594 | Barrick | Jun 1998 | A |
5791908 | Gillio | Aug 1998 | A |
5820559 | Ng et al. | Oct 1998 | A |
5825982 | Wright et al. | Oct 1998 | A |
5887121 | Funda et al. | Mar 1999 | A |
5911449 | Daniele et al. | Jun 1999 | A |
5951475 | Gueziec et al. | Sep 1999 | A |
6012216 | Esteves et al. | Jan 2000 | A |
6033415 | Mittelstadt et al. | Mar 2000 | A |
6080181 | Jensen et al. | Jun 2000 | A |
6106511 | Jensen | Aug 2000 | A |
6122541 | Cosman et al. | Sep 2000 | A |
6157853 | Blume et al. | Dec 2000 | A |
6167145 | Foley et al. | Dec 2000 | A |
6167292 | Badano et al. | Dec 2000 | A |
6201984 | Funda et al. | Mar 2001 | B1 |
6205411 | DiGioia, III et al. | Mar 2001 | B1 |
6212419 | Blume et al. | Apr 2001 | B1 |
6231565 | Tovey et al. | May 2001 | B1 |
6236875 | Bucholz et al. | May 2001 | B1 |
6246900 | Cosman et al. | Jun 2001 | B1 |
6301495 | Gueziec et al. | Oct 2001 | B1 |
6312435 | Wallace et al. | Nov 2001 | B1 |
6314311 | Williams et al. | Nov 2001 | B1 |
6322567 | Mittelstadt et al. | Nov 2001 | B1 |
6325808 | Bernard et al. | Dec 2001 | B1 |
6340363 | Bolger et al. | Jan 2002 | B1 |
6377011 | Ben-Ur | Apr 2002 | B1 |
6379302 | Kessman et al. | Apr 2002 | B1 |
6402762 | Hunter et al. | Jun 2002 | B2 |
6424885 | Niemeyer et al. | Jul 2002 | B1 |
6447503 | Wynne et al. | Sep 2002 | B1 |
6451027 | Cooper et al. | Sep 2002 | B1 |
6477400 | Barrick | Nov 2002 | B1 |
6484049 | Seeley et al. | Nov 2002 | B1 |
6490467 | Bucholz et al. | Dec 2002 | B1 |
6490475 | Seeley et al. | Dec 2002 | B1 |
6499488 | Hunter et al. | Dec 2002 | B1 |
6507751 | Blume et al. | Jan 2003 | B2 |
6535756 | Simon et al. | Mar 2003 | B1 |
6560354 | Maurer, Jr. et al. | May 2003 | B1 |
6565554 | Niemeyer | May 2003 | B1 |
6587750 | Gerbi et al. | Jul 2003 | B2 |
6614453 | Suri et al. | Sep 2003 | B1 |
6636757 | Jascob et al. | Oct 2003 | B1 |
6645196 | Nixon et al. | Nov 2003 | B1 |
6669635 | Kessman et al. | Dec 2003 | B2 |
6701173 | Nowinski et al. | Mar 2004 | B2 |
6782287 | Grzeszczuk et al. | Aug 2004 | B2 |
6783524 | Anderson et al. | Aug 2004 | B2 |
6786896 | Madhani et al. | Sep 2004 | B1 |
6788018 | Blumenkranz | Sep 2004 | B1 |
6804581 | Wang et al. | Oct 2004 | B2 |
6823207 | Jensen et al. | Nov 2004 | B1 |
6827351 | Graziani et al. | Dec 2004 | B2 |
6837892 | Shoham | Jan 2005 | B2 |
6839612 | Sanchez et al. | Jan 2005 | B2 |
6856826 | Seeley et al. | Feb 2005 | B2 |
6856827 | Seeley et al. | Feb 2005 | B2 |
6879880 | Nowlin et al. | Apr 2005 | B2 |
6892090 | Verard et al. | May 2005 | B2 |
6920347 | Simon et al. | Jul 2005 | B2 |
6968224 | Kessman et al. | Nov 2005 | B2 |
6978166 | Foley et al. | Dec 2005 | B2 |
6991627 | Madhani et al. | Jan 2006 | B2 |
6999852 | Green | Feb 2006 | B2 |
7007699 | Martinelli et al. | Mar 2006 | B2 |
7063705 | Young et al. | Jun 2006 | B2 |
7072707 | Galloway, Jr. et al. | Jul 2006 | B2 |
7083615 | Peterson et al. | Aug 2006 | B2 |
7097640 | Wang et al. | Aug 2006 | B2 |
7130676 | Barrick | Oct 2006 | B2 |
7139418 | Abovitz et al. | Nov 2006 | B2 |
7139601 | Bucholz et al. | Nov 2006 | B2 |
7155316 | Sutherland et al. | Dec 2006 | B2 |
7164968 | Treat et al. | Jan 2007 | B2 |
7167738 | Schweikard et al. | Jan 2007 | B2 |
7169141 | Brock et al. | Jan 2007 | B2 |
7172627 | Fiere et al. | Feb 2007 | B2 |
7239940 | Wang et al. | Jul 2007 | B2 |
7248914 | Hastings et al. | Jul 2007 | B2 |
7302288 | Schellenberg | Nov 2007 | B1 |
7313430 | Urquhart et al. | Dec 2007 | B2 |
7318827 | Leitner et al. | Jan 2008 | B2 |
7319897 | Leitner et al. | Jan 2008 | B2 |
7327865 | Fu et al. | Feb 2008 | B2 |
7331967 | Lee et al. | Feb 2008 | B2 |
7333642 | Green | Feb 2008 | B2 |
7339341 | Oleynikov et al. | Mar 2008 | B2 |
7366562 | Dukesherer et al. | Apr 2008 | B2 |
7379790 | Toth et al. | May 2008 | B2 |
7386365 | Nixon | Jun 2008 | B2 |
7422592 | Morley et al. | Sep 2008 | B2 |
7435216 | Kwon et al. | Oct 2008 | B2 |
7440793 | Chauhan et al. | Oct 2008 | B2 |
7466303 | Yi et al. | Dec 2008 | B2 |
7493153 | Ahmed et al. | Feb 2009 | B2 |
7505617 | Fu et al. | Mar 2009 | B2 |
7533892 | Schena et al. | May 2009 | B2 |
7542791 | Mire et al. | Jun 2009 | B2 |
7555331 | Viswanathan | Jun 2009 | B2 |
7567834 | Clayton et al. | Jul 2009 | B2 |
7594912 | Cooper et al. | Sep 2009 | B2 |
7606613 | Simon et al. | Oct 2009 | B2 |
7607440 | Coste-Maniere et al. | Oct 2009 | B2 |
7630752 | Viswanathan | Dec 2009 | B2 |
7630753 | Simon et al. | Dec 2009 | B2 |
7643862 | Schoenefeld | Jan 2010 | B2 |
7660623 | Hunter et al. | Feb 2010 | B2 |
7689320 | Prisco et al. | Mar 2010 | B2 |
7691098 | Wallace et al. | Apr 2010 | B2 |
7702379 | Avinash et al. | Apr 2010 | B2 |
7711406 | Kuhn et al. | May 2010 | B2 |
7720523 | Omernick et al. | May 2010 | B2 |
7742801 | Neubauer et al. | Jun 2010 | B2 |
7751865 | Jascob et al. | Jul 2010 | B2 |
7762825 | Burbank et al. | Jul 2010 | B2 |
7763015 | Cooper et al. | Jul 2010 | B2 |
7787699 | Mahesh et al. | Aug 2010 | B2 |
7818044 | Dukesherer et al. | Oct 2010 | B2 |
7819859 | Prisco et al. | Oct 2010 | B2 |
7824401 | Manzo et al. | Nov 2010 | B2 |
7831294 | Viswanathan | Nov 2010 | B2 |
7834484 | Sartor | Nov 2010 | B2 |
7835557 | Kendrick et al. | Nov 2010 | B2 |
7835778 | Foley et al. | Nov 2010 | B2 |
7835784 | Mire et al. | Nov 2010 | B2 |
7840253 | Tremblay et al. | Nov 2010 | B2 |
7840256 | Lakin et al. | Nov 2010 | B2 |
7843158 | Prisco | Nov 2010 | B2 |
7844320 | Shahidi | Nov 2010 | B2 |
7853305 | Simon et al. | Dec 2010 | B2 |
7865269 | Prisco et al. | Jan 2011 | B2 |
D631966 | Perloff et al. | Feb 2011 | S |
7879045 | Gielen et al. | Feb 2011 | B2 |
7881767 | Strommer et al. | Feb 2011 | B2 |
7881770 | Melkent et al. | Feb 2011 | B2 |
7886743 | Cooper et al. | Feb 2011 | B2 |
RE42194 | Foley et al. | Mar 2011 | E |
RE42226 | Foley et al. | Mar 2011 | E |
7907166 | Lamprecht et al. | Mar 2011 | B2 |
7909122 | Schena et al. | Mar 2011 | B2 |
7925653 | Saptharishi | Apr 2011 | B2 |
7930065 | Larkin et al. | Apr 2011 | B2 |
7935130 | Willliams | May 2011 | B2 |
7940999 | Liao et al. | May 2011 | B2 |
7953470 | Vetter et al. | May 2011 | B2 |
7954397 | Choi et al. | Jun 2011 | B2 |
7971341 | Dukesherer et al. | Jul 2011 | B2 |
7974674 | Hauck et al. | Jul 2011 | B2 |
7974677 | Mire et al. | Jul 2011 | B2 |
7974681 | Wallace et al. | Jul 2011 | B2 |
7979157 | Anvari | Jul 2011 | B2 |
7983733 | Viswanathan | Jul 2011 | B2 |
3004121 | Sartor | Aug 2011 | A1 |
3010177 | Csavoy et al. | Aug 2011 | A1 |
7988215 | Seibold | Aug 2011 | B2 |
7996110 | Lipow et al. | Aug 2011 | B2 |
8004229 | Nowlin et al. | Aug 2011 | B2 |
8018579 | Krah | Sep 2011 | B1 |
3046057 | Clarke | Oct 2011 | A1 |
8035685 | Jensen | Oct 2011 | B2 |
8046054 | Kim et al. | Oct 2011 | B2 |
3054184 | Cline et al. | Nov 2011 | A1 |
3057407 | Martinelli et al. | Nov 2011 | A1 |
8054752 | Druke et al. | Nov 2011 | B2 |
8057397 | Li et al. | Nov 2011 | B2 |
8062288 | Cooper et al. | Nov 2011 | B2 |
8062375 | Glerum et al. | Nov 2011 | B2 |
8066524 | Burbank et al. | Nov 2011 | B2 |
8073335 | Labonville et al. | Dec 2011 | B2 |
8079950 | Stern et al. | Dec 2011 | B2 |
8092370 | Roberts et al. | Jan 2012 | B2 |
8105320 | Manzo | Jan 2012 | B2 |
8108025 | Csavoy et al. | Jan 2012 | B2 |
8109877 | Moctezuma de la Barrera et al. | Feb 2012 | B2 |
8112292 | Simon | Feb 2012 | B2 |
8120301 | Goldberg et al. | Feb 2012 | B2 |
8123675 | Funda et al. | Feb 2012 | B2 |
8133229 | Bonutti | Mar 2012 | B1 |
8142420 | Schena | Mar 2012 | B2 |
8147494 | Leitner et al. | Apr 2012 | B2 |
8150494 | Simon et al. | Apr 2012 | B2 |
8150497 | Gielen et al. | Apr 2012 | B2 |
8150498 | Gielen et al. | Apr 2012 | B2 |
8165658 | Waynik et al. | Apr 2012 | B2 |
8170313 | Kendrick et al. | May 2012 | B2 |
8179073 | Farritor et al. | May 2012 | B2 |
8182476 | Julian et al. | May 2012 | B2 |
8184880 | Zhao et al. | May 2012 | B2 |
8202278 | Orban, III et al. | Jun 2012 | B2 |
8208988 | Jensen | Jun 2012 | B2 |
8219177 | Smith et al. | Jul 2012 | B2 |
8219178 | Smith et al. | Jul 2012 | B2 |
8220468 | Cooper et al. | Jul 2012 | B2 |
8224484 | Swarup et al. | Jul 2012 | B2 |
8225798 | Baldwin et al. | Jul 2012 | B2 |
8228368 | Zhao et al. | Jul 2012 | B2 |
8231610 | Jo et al. | Jul 2012 | B2 |
8263933 | Hartmann et al. | Jul 2012 | B2 |
8239001 | Verard et al. | Aug 2012 | B2 |
8241271 | Millman et al. | Aug 2012 | B2 |
8248413 | Gattani et al. | Aug 2012 | B2 |
8256319 | Cooper et al. | Sep 2012 | B2 |
8271069 | Jascob et al. | Sep 2012 | B2 |
8271130 | Hourtash | Sep 2012 | B2 |
8281670 | Larkin et al. | Oct 2012 | B2 |
8282653 | Nelson et al. | Oct 2012 | B2 |
8301226 | Csavoy et al. | Oct 2012 | B2 |
8311611 | Csavoy et al. | Nov 2012 | B2 |
8320991 | Jascob et al. | Nov 2012 | B2 |
8332012 | Kienzle, III | Dec 2012 | B2 |
8333755 | Cooper et al. | Dec 2012 | B2 |
8335552 | Stiles | Dec 2012 | B2 |
8348931 | Cooper et al. | Jan 2013 | B2 |
8353963 | Glerum | Jan 2013 | B2 |
8358818 | Miga et al. | Jan 2013 | B2 |
8359730 | Burg | Jan 2013 | B2 |
8374673 | Adcox et al. | Feb 2013 | B2 |
8374723 | Zhao et al. | Feb 2013 | B2 |
8392022 | Ortmaier et al. | Mar 2013 | B2 |
8394099 | Patwardhan | Mar 2013 | B2 |
8395342 | Prisco | Mar 2013 | B2 |
8398634 | Manzo et al. | Mar 2013 | B2 |
8400094 | Schena | Mar 2013 | B2 |
8414957 | Enzerink et al. | Apr 2013 | B2 |
8418073 | Mohr et al. | Apr 2013 | B2 |
8450694 | Baviera et al. | May 2013 | B2 |
8452447 | Nixon | May 2013 | B2 |
RE44305 | Foley et al. | Jun 2013 | E |
8465476 | Rogers et al. | Jun 2013 | B2 |
8465771 | Wan et al. | Jun 2013 | B2 |
8467851 | Mire et al. | Jun 2013 | B2 |
8467852 | Csavoy et al. | Jun 2013 | B2 |
8469947 | Devengenzo et al. | Jun 2013 | B2 |
RE44392 | Hynes | Jul 2013 | E |
8483434 | Buehner et al. | Jul 2013 | B2 |
8483800 | Jensen et al. | Jul 2013 | B2 |
8486532 | Enzerink et al. | Jul 2013 | B2 |
8489235 | Moll et al. | Jul 2013 | B2 |
8500722 | Cooper | Aug 2013 | B2 |
8500728 | Newton et al. | Aug 2013 | B2 |
8504201 | Moll et al. | Aug 2013 | B2 |
8506555 | Ruiz Morales | Aug 2013 | B2 |
8506556 | Schena | Aug 2013 | B2 |
8508173 | Goldberg et al. | Aug 2013 | B2 |
8512318 | Tovey et al. | Aug 2013 | B2 |
8515576 | Lipow et al. | Aug 2013 | B2 |
8518120 | Glerum et al. | Aug 2013 | B2 |
8521331 | Itkowitz | Aug 2013 | B2 |
8526688 | Groszmann et al. | Sep 2013 | B2 |
8526700 | Issacs | Sep 2013 | B2 |
8527094 | Kumar et al. | Sep 2013 | B2 |
8528440 | Morley et al. | Sep 2013 | B2 |
8532741 | Heruth et al. | Sep 2013 | B2 |
8541970 | Nowlin et al. | Sep 2013 | B2 |
8548563 | Simon et al. | Oct 2013 | B2 |
8549732 | Burg et al. | Oct 2013 | B2 |
8551114 | Ramos de la Pena | Oct 2013 | B2 |
8551116 | Julian et al. | Oct 2013 | B2 |
8556807 | Scott et al. | Oct 2013 | B2 |
8556979 | Glerum et al. | Oct 2013 | B2 |
8561473 | Blumenkranz | Oct 2013 | B2 |
8562594 | Cooper et al. | Oct 2013 | B2 |
8571638 | Shoham | Oct 2013 | B2 |
8571710 | Coste-Maniere et al. | Oct 2013 | B2 |
8573465 | Shelton, IV | Nov 2013 | B2 |
8574303 | Sharkey et al. | Nov 2013 | B2 |
8585420 | Burbank et al. | Nov 2013 | B2 |
8594841 | Zhao et al. | Nov 2013 | B2 |
8600478 | Verard et al. | Dec 2013 | B2 |
8603077 | Cooper et al. | Dec 2013 | B2 |
8611985 | Lavallee et al. | Dec 2013 | B2 |
8613230 | Blumenkranz et al. | Dec 2013 | B2 |
8621939 | Blumenkranz et al. | Jan 2014 | B2 |
8624537 | Nowlin et al. | Jan 2014 | B2 |
8634897 | Simon et al. | Jan 2014 | B2 |
8634957 | Toth et al. | Jan 2014 | B2 |
8638056 | Goldberg et al. | Jan 2014 | B2 |
8638057 | Goldberg et al. | Jan 2014 | B2 |
8639000 | Zhao et al. | Jan 2014 | B2 |
8641726 | Bonutti | Feb 2014 | B2 |
8644907 | Hartmann et al. | Feb 2014 | B2 |
8657809 | Schoepp | Feb 2014 | B2 |
8660635 | Simon et al. | Feb 2014 | B2 |
8666544 | Moll et al. | Mar 2014 | B2 |
8675939 | Moctezuma de la Barrera | Mar 2014 | B2 |
8679125 | Smith et al. | Mar 2014 | B2 |
8679183 | Glerum et al. | Mar 2014 | B2 |
8682413 | Lloyd | Mar 2014 | B2 |
8684253 | Giordano et al. | Apr 2014 | B2 |
8685098 | Glerum et al. | Apr 2014 | B2 |
8693730 | Umasuthan et al. | Apr 2014 | B2 |
8694075 | Groszmann et al. | Apr 2014 | B2 |
8700123 | Okamura et al. | Apr 2014 | B2 |
8706086 | Glerum | Apr 2014 | B2 |
8706185 | Foley et al. | Apr 2014 | B2 |
8706301 | Zhao et al. | Apr 2014 | B2 |
8717430 | Simon et al. | May 2014 | B2 |
8734432 | Tuma et al. | May 2014 | B2 |
8738181 | Greer et al. | May 2014 | B2 |
8740882 | Jun et al. | Jun 2014 | B2 |
8746252 | McGrogan et al. | Jun 2014 | B2 |
8749189 | Nowlin et al. | Jun 2014 | B2 |
8749190 | Nowlin et al. | Jun 2014 | B2 |
8761930 | Nixon | Jun 2014 | B2 |
8764448 | Yang et al. | Jul 2014 | B2 |
8771170 | Mesallum et al. | Jul 2014 | B2 |
8781186 | Clements et al. | Jul 2014 | B2 |
8781630 | Banks et al. | Jul 2014 | B2 |
8784385 | Boyden et al. | Jul 2014 | B2 |
8786241 | Nowlin et al. | Jul 2014 | B2 |
8792704 | Isaacs | Jul 2014 | B2 |
8800838 | Shelton, IV | Aug 2014 | B2 |
8808164 | Hoffman et al. | Aug 2014 | B2 |
8812077 | Dempsey | Aug 2014 | B2 |
8816628 | Nowlin et al. | Aug 2014 | B2 |
8818105 | Myronenko et al. | Aug 2014 | B2 |
8820605 | Shelton, IV | Sep 2014 | B2 |
8821511 | von Jako et al. | Sep 2014 | B2 |
8823308 | Nowlin et al. | Sep 2014 | B2 |
8827996 | Scott et al. | Sep 2014 | B2 |
8828024 | Farritor et al. | Sep 2014 | B2 |
8830224 | Zhao et al. | Sep 2014 | B2 |
8834489 | Cooper et al. | Sep 2014 | B2 |
8834490 | Bonutti | Sep 2014 | B2 |
8838270 | Druke et al. | Sep 2014 | B2 |
8844789 | Shelton, IV et al. | Sep 2014 | B2 |
8855822 | Bartol et al. | Oct 2014 | B2 |
8858598 | Seifert et al. | Oct 2014 | B2 |
8860753 | Bhandarkar et al. | Oct 2014 | B2 |
8864751 | Prisco et al. | Oct 2014 | B2 |
8864798 | Weiman et al. | Oct 2014 | B2 |
8864833 | Glerum et al. | Oct 2014 | B2 |
8870880 | Himmelberger et al. | Oct 2014 | B2 |
8876866 | Zappacosta et al. | Nov 2014 | B2 |
8880223 | Raj et al. | Nov 2014 | B2 |
8882803 | Iott et al. | Nov 2014 | B2 |
8883210 | Truncale et al. | Nov 2014 | B1 |
8888853 | Glerum et al. | Nov 2014 | B2 |
8888854 | Glerum et al. | Nov 2014 | B2 |
8894652 | Seifert et al. | Nov 2014 | B2 |
8894688 | Suh | Nov 2014 | B2 |
8894691 | Iott et al. | Nov 2014 | B2 |
8906069 | Hansell et al. | Dec 2014 | B2 |
10231791 | LeBoeuf, II | Mar 2019 | B2 |
10639112 | LeBoeuf, II | May 2020 | B2 |
11103320 | LeBoeuf, II | Aug 2021 | B2 |
20010036302 | Miller | Nov 2001 | A1 |
20020035321 | Bucholz et al. | Mar 2002 | A1 |
20040068172 | Nowinski et al. | Apr 2004 | A1 |
20040076259 | Jensen et al. | Apr 2004 | A1 |
20050096502 | Khalili | May 2005 | A1 |
20050143651 | Verard et al. | Jun 2005 | A1 |
20050171558 | Abovitz et al. | Aug 2005 | A1 |
20060100610 | Wallace et al. | May 2006 | A1 |
20060173329 | Marquart et al. | Aug 2006 | A1 |
20060184396 | Dennis et al. | Aug 2006 | A1 |
20060241416 | Marquart et al. | Oct 2006 | A1 |
20070015987 | Benlloch Baviera et al. | Jan 2007 | A1 |
20070021738 | Hasser et al. | Jan 2007 | A1 |
20070038059 | Sheffer et al. | Feb 2007 | A1 |
20070073133 | Schoenefeld | Mar 2007 | A1 |
20070156121 | Millman et al. | Jul 2007 | A1 |
20070156157 | Nahum et al. | Jul 2007 | A1 |
20070167712 | Keglovich et al. | Jul 2007 | A1 |
20070233238 | Huynh et al. | Oct 2007 | A1 |
20080004523 | Jensen | Jan 2008 | A1 |
20080013809 | Zhu et al. | Jan 2008 | A1 |
20080033283 | Dellaca et al. | Feb 2008 | A1 |
20080046122 | Manzo et al. | Feb 2008 | A1 |
20080082109 | Moll et al. | Apr 2008 | A1 |
20080108912 | Node-Langlois | May 2008 | A1 |
20080108991 | von Jako | May 2008 | A1 |
20080109012 | Falco et al. | May 2008 | A1 |
20080144906 | Allred et al. | Jun 2008 | A1 |
20080161680 | von Jako et al. | Jul 2008 | A1 |
20080161682 | Kendrick et al. | Jul 2008 | A1 |
20080177203 | von Jako | Jul 2008 | A1 |
20080214922 | Hartmann et al. | Sep 2008 | A1 |
20080228068 | Viswanathan et al. | Sep 2008 | A1 |
20080228196 | Wang et al. | Sep 2008 | A1 |
20080235052 | Node-Langlois et al. | Sep 2008 | A1 |
20080269596 | Revie et al. | Oct 2008 | A1 |
20080287771 | Anderson | Nov 2008 | A1 |
20080287781 | Revie et al. | Nov 2008 | A1 |
20080300477 | Lloyd et al. | Dec 2008 | A1 |
20080300478 | Zuhars et al. | Dec 2008 | A1 |
20080306490 | Lakin et al. | Dec 2008 | A1 |
20080319311 | Hamadeh | Dec 2008 | A1 |
20090012509 | Csavoy et al. | Jan 2009 | A1 |
20090030428 | Omori et al. | Jan 2009 | A1 |
20090080737 | Battle et al. | Mar 2009 | A1 |
20090216113 | Meier et al. | Aug 2009 | A1 |
20090228019 | Gross et al. | Sep 2009 | A1 |
20090259123 | Navab et al. | Oct 2009 | A1 |
20090259230 | Khadem et al. | Oct 2009 | A1 |
20090264899 | Appenrodt et al. | Oct 2009 | A1 |
20090281417 | Hartmann et al. | Nov 2009 | A1 |
20100022874 | Wang et al. | Jan 2010 | A1 |
20100039506 | Sarvestani et al. | Feb 2010 | A1 |
20100125286 | Wang et al. | May 2010 | A1 |
20100130986 | Mailloux et al. | May 2010 | A1 |
20100228117 | Hartmann | Sep 2010 | A1 |
20100228265 | Prisco | Sep 2010 | A1 |
20100249571 | Jensen et al. | Sep 2010 | A1 |
20100280363 | Skarda et al. | Nov 2010 | A1 |
20100331858 | Simaan et al. | Dec 2010 | A1 |
20110022229 | Jang et al. | Jan 2011 | A1 |
20110077504 | Fischer et al. | Mar 2011 | A1 |
20110098553 | Robbins et al. | Apr 2011 | A1 |
20110137152 | Li | Jun 2011 | A1 |
20110213384 | Jeong | Sep 2011 | A1 |
20110224684 | Larkin et al. | Sep 2011 | A1 |
20110224685 | Larkin et al. | Sep 2011 | A1 |
20110224686 | Larkin et al. | Sep 2011 | A1 |
20110224687 | Larkin et al. | Sep 2011 | A1 |
20110224688 | Larkin et al. | Sep 2011 | A1 |
20110224689 | Larkin et al. | Sep 2011 | A1 |
20110224825 | Larkin et al. | Sep 2011 | A1 |
20110230967 | O'Halloran et al. | Sep 2011 | A1 |
20110238080 | Ranjit et al. | Sep 2011 | A1 |
20110276058 | Choi et al. | Nov 2011 | A1 |
20110282189 | Graumann | Nov 2011 | A1 |
20110295062 | Gratacos Solsona et al. | Dec 2011 | A1 |
20110295370 | Suh et al. | Dec 2011 | A1 |
20110306986 | Lee et al. | Dec 2011 | A1 |
20120046668 | Gantes | Feb 2012 | A1 |
20120053597 | Anvari et al. | Mar 2012 | A1 |
20120059248 | Holsing et al. | Mar 2012 | A1 |
20120071753 | Hunter et al. | Mar 2012 | A1 |
20120108954 | Schulhauser et al. | May 2012 | A1 |
20120136372 | Amat Girbau et al. | May 2012 | A1 |
20120184839 | Woerlein | Jul 2012 | A1 |
20120197182 | Millman et al. | Aug 2012 | A1 |
20120226145 | Chang et al. | Sep 2012 | A1 |
20120235909 | Birkenbach et al. | Sep 2012 | A1 |
20120245596 | Meenink | Sep 2012 | A1 |
20120253332 | Moll | Oct 2012 | A1 |
20120253360 | White et al. | Oct 2012 | A1 |
20120256092 | Zingerman | Oct 2012 | A1 |
20120294498 | Popovic | Nov 2012 | A1 |
20120296203 | Hartmann et al. | Nov 2012 | A1 |
20130006267 | Odermatt et al. | Jan 2013 | A1 |
20130016889 | Myronenko et al. | Jan 2013 | A1 |
20130030571 | Ruiz Morales et al. | Jan 2013 | A1 |
20130035583 | Park et al. | Feb 2013 | A1 |
20130060146 | Yang et al. | Mar 2013 | A1 |
20130060337 | Petersheim et al. | Mar 2013 | A1 |
20130094742 | Feilkas | Apr 2013 | A1 |
20130096574 | Kang et al. | Apr 2013 | A1 |
20130113791 | Isaacs et al. | May 2013 | A1 |
20130116706 | Lee et al. | May 2013 | A1 |
20130131695 | Scarfogliero et al. | May 2013 | A1 |
20130144307 | Jeong et al. | Jun 2013 | A1 |
20130158542 | Manzo et al. | Jun 2013 | A1 |
20130165937 | Patwardhan | Jun 2013 | A1 |
20130178867 | Farritor et al. | Jul 2013 | A1 |
20130178868 | Roh | Jul 2013 | A1 |
20130178870 | Schena | Jul 2013 | A1 |
20130204271 | Brisson et al. | Aug 2013 | A1 |
20130211419 | Jensen | Aug 2013 | A1 |
20130211420 | Jensen | Aug 2013 | A1 |
20130218142 | Tuma et al. | Aug 2013 | A1 |
20130223702 | Holsing et al. | Aug 2013 | A1 |
20130225942 | Holsing et al. | Aug 2013 | A1 |
20130225943 | Holsing et al. | Aug 2013 | A1 |
20130231556 | Holsing et al. | Sep 2013 | A1 |
20130237995 | Lee et al. | Sep 2013 | A1 |
20130245375 | DiMaio et al. | Sep 2013 | A1 |
20130261640 | Kim et al. | Oct 2013 | A1 |
20130272488 | Bailey et al. | Oct 2013 | A1 |
20130272489 | Dickman et al. | Oct 2013 | A1 |
20130274761 | Devengenzo et al. | Oct 2013 | A1 |
20130281821 | Liu et al. | Oct 2013 | A1 |
20130296884 | Taylor et al. | Nov 2013 | A1 |
20130303887 | Holsing et al. | Nov 2013 | A1 |
20130307955 | Deitz et al. | Nov 2013 | A1 |
20130317521 | Choi et al. | Nov 2013 | A1 |
20130325033 | Schena et al. | Dec 2013 | A1 |
20130325035 | Hauck et al. | Dec 2013 | A1 |
20130331686 | Freysinger et al. | Dec 2013 | A1 |
20130331858 | Devengenzo et al. | Dec 2013 | A1 |
20130331861 | Yoon | Dec 2013 | A1 |
20130342578 | Isaacs | Dec 2013 | A1 |
20130345717 | Markvicka et al. | Dec 2013 | A1 |
20140001235 | Shelton, IV | Jan 2014 | A1 |
20140012131 | Heruth et al. | Jan 2014 | A1 |
20140031664 | Kang et al. | Jan 2014 | A1 |
20140046128 | Lee et al. | Feb 2014 | A1 |
20140046132 | Hoeg et al. | Feb 2014 | A1 |
20140046340 | Wilson et al. | Feb 2014 | A1 |
20140058406 | Tsekos | Feb 2014 | A1 |
20140073914 | Lavallee et al. | Mar 2014 | A1 |
20140080086 | Chen | Mar 2014 | A1 |
20140081128 | Verard et al. | Mar 2014 | A1 |
20140088612 | Bartol et al. | Mar 2014 | A1 |
20140094694 | Moctezuma de la Barrera | Apr 2014 | A1 |
20140094851 | Gordon | Apr 2014 | A1 |
20140096369 | Matsumoto et al. | Apr 2014 | A1 |
20140100587 | Farritor et al. | Apr 2014 | A1 |
20140121676 | Kostrzewski et al. | May 2014 | A1 |
20140128882 | Kwak et al. | May 2014 | A1 |
20140135796 | Simon et al. | May 2014 | A1 |
20140142591 | Alvarez et al. | May 2014 | A1 |
20140142592 | Moon et al. | May 2014 | A1 |
20140148692 | Hartmann et al. | May 2014 | A1 |
20140163581 | Devengenzo et al. | Jun 2014 | A1 |
20140171781 | Stiles | Jun 2014 | A1 |
20140171900 | Stiles | Jun 2014 | A1 |
20140171965 | Loh et al. | Jun 2014 | A1 |
20140180308 | von Grunberg | Jun 2014 | A1 |
20140180309 | Seeber et al. | Jun 2014 | A1 |
20140187915 | Yaroshenko et al. | Jul 2014 | A1 |
20140188132 | Kang | Jul 2014 | A1 |
20140194699 | Roh et al. | Jul 2014 | A1 |
20140221819 | Sarment | Aug 2014 | A1 |
20140222023 | Kim et al. | Aug 2014 | A1 |
20140228631 | Kwak et al. | Aug 2014 | A1 |
20140234804 | Huang et al. | Aug 2014 | A1 |
20140257328 | Kim et al. | Sep 2014 | A1 |
20140257329 | Jang et al. | Sep 2014 | A1 |
20140257330 | Choi et al. | Sep 2014 | A1 |
20140275760 | Lee et al. | Sep 2014 | A1 |
20140275985 | Walker et al. | Sep 2014 | A1 |
20140276931 | Parihar et al. | Sep 2014 | A1 |
20140276940 | Seo | Sep 2014 | A1 |
20140276944 | Farritor et al. | Sep 2014 | A1 |
20140288413 | Hwang et al. | Sep 2014 | A1 |
20140299648 | Shelton, IV et al. | Oct 2014 | A1 |
20140303434 | Farritor et al. | Oct 2014 | A1 |
20140303643 | Ha et al. | Oct 2014 | A1 |
20140305995 | Shelton, IV et al. | Oct 2014 | A1 |
20140309659 | Roh et al. | Oct 2014 | A1 |
20140316436 | Bar et al. | Oct 2014 | A1 |
20140323803 | Hoffman et al. | Oct 2014 | A1 |
20140324070 | Min et al. | Oct 2014 | A1 |
20140330288 | Date et al. | Nov 2014 | A1 |
20140364720 | Darrow et al. | Dec 2014 | A1 |
20150192664 | Sato et al. | Jul 2015 | A1 |
20150260831 | Lewis | Sep 2015 | A1 |
20160235493 | LeBoeuf, II | Aug 2016 | A1 |
20190239964 | LeBoeuf, II | Aug 2019 | A1 |
20200229881 | LeBoeuf, II | Jul 2020 | A1 |
Number | Date | Country |
---|---|---|
2015534480 | Dec 2015 | JP |
Entry |
---|
US 8,231,638 B2, 07/2012, Swarup et al. (withdrawn) |
Number | Date | Country | |
---|---|---|---|
20210346106 A1 | Nov 2021 | US |
Number | Date | Country | |
---|---|---|---|
61800527 | Mar 2013 | US | |
61662702 | Jun 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15135658 | Apr 2016 | US |
Child | 16260249 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16837433 | Apr 2020 | US |
Child | 17385405 | US | |
Parent | 16260249 | Jan 2019 | US |
Child | 16837433 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15095883 | Apr 2016 | US |
Child | 15135658 | US | |
Parent | 14062707 | Oct 2013 | US |
Child | 15095883 | US | |
Parent | 13924505 | Jun 2013 | US |
Child | 14062707 | US |