User controller with user presence detection and related systems and methods

Information

  • Patent Grant
  • 11701193
  • Patent Number
    11,701,193
  • Date Filed
    Tuesday, March 29, 2022
    2 years ago
  • Date Issued
    Tuesday, July 18, 2023
    10 months ago
Abstract
The present invention is relates to a user controller having a thumb sheath with an open side defined in the thumb sheath. Further embodiments relate to thumb presence sensors and sensory feedback components associated with the thumb sheath. Additional embodiments relate to an adjustable thumb sheath. Still other embodiments relate to systems comprising such user controllers.
Description
FIELD OF THE INVENTION

The various embodiments herein relate to user presence detection on a multi-degree-of-freedom (DOF) user input device for use in systems such as, for example, robotic medical device systems.


BACKGROUND OF THE INVENTION

User input devices with many degrees of freedom require the user to support the mass of the input device.


One example of such a known input device is depicted in FIGS. 1-2B. FIG. 1 depicts the multi-DOF user input device 8 for the left hand of the user. To interface with the device 8, the user places the left palm on the main body 10 of the user controller 8, the forefinger on the forefinger interface 12 that is able to move relative to the main body 10 via a rotary link 14, and the thumb in the thumb groove 16. The main body 10 of the user interface 8 is connected to a multi-DOF positioning or sensing system through a linkage 18. In order to supply forces and torques to move the user interface 8 both a thumb restraint 20 and forefinger restraint 22 to constrain the users hand to the device 8.



FIGS. 2A and 2B depict the ability of the user to further input an open/close motion of the forefinger interface 12, which is connected to the main body 10 using a link 14 and rotary joint 30. The minimum displacement 32 (as shown in FIG. 2A) and maximum displacement 34 (as shown in FIG. 2B) can be measured and used as an additional control signal. The thumb restraint 20 and forefinger restraint 22 supply constraints such that the user maintains control of the main body 10 while moving the grasper throughout its range of motion. Such restraints, while enabling the user to input another control signal, make it difficult for the user to disengage with the device 8 in a controlled manner.


Further, in order for the user to exit the device in a controlled fashion, support of the input device must transferred to the input device itself or the signal being output by the device must cease. That is, during use, the input device is supported or maintained in its operable position by the hand of the user, but removal of the user's hand from the input device without any mechanical force applied by the system itself causes the input device to be pulled downward by gravity, which can result in the robotic device or component operably coupled to the input device to move or be actuated in an undesirable fashion.


There is a need in the art for improved methods and devices for detecting the presence of a user at, on, or using a user input device.


BRIEF SUMMARY OF THE INVENTION

Discussed herein are various user controllers for use with various systems, including robotic surgical systems.


In Example 1, a user controller comprises a controller body and a thumb sheath coupled to the controller body. The thumb sheath comprises a first sheath section extending from the controller body, and a second sheath section extending from the first sheath section, wherein the second sheath section is transverse to the first sheath segment. The first sheath section, the second sheath section, and the controller body define a thumb opening and an open side.


Example 2 relates to the user controller according to Example 1, wherein the first sheath section, the second sheath section, and the controller body do not form a 360° enclosure around the thumb opening.


Example 3 relates to the user controller according to Example 1, further comprising a light sensor disposed within the thumb opening.


Example 4 relates to the user controller according to Example 1, further comprising a light emitter disposed on an inner wall of the thumb sheath and a light receiver disposed on the controller body, wherein the light receiver is positioned to receive light transmitted by the light emitter.


Example 5 relates to the user controller according to Example 1, further comprising a light emitter disposed on the controller body and a light receiver disposed on an inner wall of the thumb sheath, wherein the light receiver is positioned to receive light transmitted by the light emitter.


Example 6 relates to the user controller according to Example 1, further comprising a light emitter and a light receiver, wherein the light emitter and light receiver are disposed on the controller body.


Example 7 relates to the user controller according to Example 1, further comprising a capacitive sensor disposed on the controller body within the thumb sheath.


Example 8 relates to the user controller according to Example 1, further comprising a mechanical sensor disposed on the controller body within the thumb sheath.


Example 9 relates to the user controller according to Example 1, wherein the thumb sheath is adjustable between a retracted position and an extended position.


Example 10 relates to the user controller according to Example 1, further comprising a feedback signal component disposed on an outer surface of the thumb sheath, wherein the feedback signal component is visible to a user.


Example 11 relates to the user controller according to Example 1, wherein a user's thumb is removable from the thumb sheath via the thumb opening or the open side.


In Example 12, a robotic surgical system comprises a system controller, a robotic surgical device operably coupled to the system controller, and a user controller operably coupled to the system controller. The robotic surgical device comprises a device body, at least one robotic arm operably coupled to the device body, and at least one end effector operably coupled to the robotic arm. The user controller comprises a controller body, and a thumb sheath coupled to the controller body, wherein the thumb sheath and the controller body define a thumb opening and a side opening.


Example 13 relates to the robotic surgical system according to Example 12, wherein the thumb sheath comprises a first sheath section extending from the controller body and defining a first wall of the thumb opening, a second sheath section extending from the first sheath second and defining a second wall of the thumb opening, and a third wall of the thumb opening defined by the controller body.


Example 14 relates to the robotic surgical system according to Example 13, wherein the side opening is defined between the second wall and the third wall.


Example 15 relates to the robotic surgical system according to Example 12, wherein the thumb sheath does not form a 360° enclosure around the thumb opening.


Example 16 relates to the robotic surgical system according to Example 12, further comprising a thumb presence sensor disposed within the thumb opening.


Example 17 relates to the robotic surgical system according to Example 16, wherein the thumb presence sensor comprises a light sensor, a capacitive sensor, or a mechanical sensor.


Example 18 relates to the robotic surgical system according to Example 12, wherein the thumb sheath is adjustable between a retracted position and an extended position.


Example 19 relates to the robotic surgical system according to Example 12, further comprising a feedback signal component disposed on an outer surface of the thumb sheath, wherein the feedback signal component is visible to a user.


Example 20 relates to the robotic surgical system according to Example 12, wherein a user's thumb is removable from the thumb sheath via the thumb opening or the side opening.


While multiple embodiments are disclosed, still other embodiments of the present invention will become apparent to those skilled in the art from the following detailed description, which shows and describes illustrative embodiments of the invention. As will be realized, the invention is capable of modifications in various obvious aspects, all without departing from the spirit and scope of the present invention. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not restrictive.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a perspective view of a known user input device.



FIG. 2A is a top view of the known user input device of FIG. 1.



FIG. 2B is another top view of the known user input device of FIG. 1.



FIG. 3 is a perspective view of a user input device with a thumb sheath, according to one embodiment.



FIG. 4 is a perspective view of a user input device with a thumb sheath and a light-based sensor, according to one embodiment.



FIG. 5 is a perspective view of a user input device with a thumb sheath and another light-based sensor, according to a further embodiment.



FIG. 6 is a schematic depiction of a known circuit configuration for use with a light-based sensor, according to one embodiment.



FIG. 7 is a perspective view of a user input device with a thumb sheath and a capacitive sensor, according to one embodiment.



FIG. 8 is a schematic depiction of a known circuit configuration for use with a capacitive sensor, according to one embodiment.



FIG. 9 is a schematic depiction of a known circuit configuration for use with a mechanical sensor, according to one embodiment.



FIG. 10 is a perspective view of a user input device with a thumb sheath and a sensory signal, according to one embodiment.



FIG. 11A is a perspective view of a user input device with an adjustable thumb sheath in a retracted position, according to a further embodiment.



FIG. 11B is a perspective view of a user input device with an adjustable thumb sheath in an extended position, according to a further embodiment.



FIG. 12 is a perspective view of a user input device with a thumb sheath and a mechanical sensor, according to one embodiment.





DETAILED DESCRIPTION

The various embodiments herein relate to methods and devices for detecting the presence of a user at, on, or using a multi-DOF user input device in which the user grasps the device using a pincer grasp. That is, the various embodiments have a sheath mounted on the input device that is configured to detect the presence of the user's hand. If the user's hand (or more specifically the thumb, according to certain embodiments) is detected by the sheath, the device transmits a signal (“the presence signal”) to the system (such as, for example, the system controller component of the system) that the user is in position and control should be enabled. When the hand is removed, the absence of the “presence signal” can be used to cease use of the device output or, if it is haptically enabled, lock the device in place.


It is understood that the various user controller embodiments herein can be used with various robotic surgical systems in which the user controller is the user interface and is coupled to the surgical system such that the user controller can be used to control a robotic surgical device positioned into or within a cavity of a patient. That is, the various user controller embodiments and related systems and methods disclosed herein can be incorporated into, used in conjunction with, or used as part of any other known robotic surgical systems, devices, or methods. For example, the various embodiments disclosed herein may be incorporated into or used with any of the medical devices and systems disclosed in U.S. Pat. No. 8,968,332 (issued on Mar. 3, 2015 and entitled “Magnetically Coupleable Robotic Devices and Related Methods”), U.S. Pat. No. 8,834,488 (issued on Sep. 16, 2014 and entitled “Magnetically Coupleable Surgical Robotic Devices and Related Methods”), U.S. patent application Ser. No. 14/617,232 (filed on Feb. 9, 2015 and entitled “Robotic Surgical Devices and Related Methods”), U.S. Pat. No. 9,579,088 (issued on Feb. 28, 2017 and entitled “Methods, Systems, and Devices for Surgical Visualization and Device Manipulation”), U.S. Pat. No. 8,343,171 (issued on Jan. 1, 2013 and entitled “Methods and Systems of Actuation in Robotic Devices”), U.S. Pat. No. 8,828,024 (issued on Sep. 9, 2014 and entitled “Methods and Systems of Actuation in Robotic Devices”), U.S. patent application Ser. No. 14/454,035 (filed Aug. 7, 2014 and entitled “Methods and Systems of Actuation in Robotic Devices”), U.S. patent application Ser. No. 12/192,663 (filed Aug. 15, 2008 and entitled Medical Inflation, Attachment, and Delivery Devices and Related Methods”), U.S. patent application Ser. No. 15/018,530 (filed Feb. 8, 2016 and entitled “Medical Inflation, Attachment, and Delivery Devices and Related Methods”), U.S. Pat. No. 8,974,440 (issued on Mar. 10, 2015 and entitled “Modular and Cooperative Medical Devices and Related Systems and Methods”), U.S. Pat. No. 8,679,096 (issued on Mar. 25, 2014 and entitled “Multifunctional Operational Component for Robotic Devices”), U.S. Pat. No. 9,179,981 (issued on Nov. 10, 2015 and entitled “Multifunctional Operational Component for Robotic Devices”), U.S. patent application Ser. No. 14/936,234 (filed on Nov. 9, 2015 and entitled “Multifunctional Operational Component for Robotic Devices”), U.S. Pat. No. 8,894,633 (issued on Nov. 25, 2014 and entitled “Modular and Cooperative Medical Devices and Related Systems and Methods”), U.S. Pat. No. 8,968,267 (issued on Mar. 3, 2015 and entitled “Methods and Systems for Handling or Delivering Materials for Natural Orifice Surgery”), U.S. Pat. No. 9,060,781 (issued on Jun. 23, 2015 and entitled “Methods, Systems, and Devices Relating to Surgical End Effectors”), U.S. patent application Ser. No. 14/745,587 (filed on Jun. 22, 2015 and entitled “Methods, Systems, and Devices Relating to Surgical End Effectors”), U.S. Pat. No. 9,089,353 (issued on Jul. 28, 2015 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 14/800,423 (filed on Jul. 15, 2015 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 13/573,849 (filed Oct. 9, 2012 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 13/738,706 (filed Jan. 10, 2013 and entitled “Methods, Systems, and Devices for Surgical Access and Insertion”), U.S. patent application Ser. No. 13/833,605 (filed Mar. 15, 2013 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 14/661,465 (filed Mar. 18, 2015 and entitled “Methods, Systems, and Devices for Surgical Access and Insertion”), U.S. Pat. No. 9,498,292 (issued on Nov. 22, 2016 and entitled “Single Site Robotic Devices and Related Systems and Methods”), U.S. patent application Ser. No. 15/357,663 (filed Nov. 21, 2016 and entitled “Single Site Robotic Devices and Related Systems and Methods”), U.S. Pat. No. 9,010,214 (issued on Apr. 21, 2015 and entitled “Local Control Robotic Surgical Devices and Related Methods”), U.S. patent application Ser. No. 14/656,109 (filed on Mar. 12, 2015 and entitled “Local Control Robotic Surgical Devices and Related Methods”), U.S. patent application Ser. No. 14/208,515 (filed Mar. 13, 2014 and entitled “Methods, Systems, and Devices Relating to Robotic Surgical Devices, End Effectors, and Controllers”), U.S. patent application Ser. No. 14/210,934 (filed Mar. 14, 2014 and entitled “Methods, Systems, and Devices Relating to Force Control Surgical Systems), U.S. patent application Ser. No. 14/212,686 (filed Mar. 14, 2014 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 14/334,383 (filed Jul. 17, 2014 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 14/853,477 (filed Sep. 14, 2015 and entitled “Quick-Release End Effectors and Related Systems and Methods”), U.S. patent application Ser. No. 14/938,667 (filed Nov. 11, 2015 and entitled “Robotic Device with Compact Joint Design and Related Systems and Methods”), U.S. patent application Ser. No. 15/227,813 (filed Aug. 3, 2016 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 15/599,231 (filed May 18, 2017 and entitled “Robotic Surgical Devices, Systems, and Related Methods”), U.S. patent application Ser. No. 15/691,087 (filed Aug. 30, 2017 and entitled “Robotic Device with Compact Joint Design and an Additional Degree of Freedom and Related Systems and Methods”), U.S. Patent Application 62/425,149 (filed Nov. 22, 2016 and entitled “Improved Gross Positioning Device and Related Systems and Methods”), U.S. Patent Application 62/433,837 (filed Dec. 14, 2016 and entitled “Releasable Attachment Device for Coupling to Medical Devices and Related Systems and Methods”), and U.S. Pat. No. 7,492,116 (filed on Oct. 31, 2007 and entitled “Robot for Surgical Applications”), U.S. Pat. No. 7,772,796 (filed on Apr. 3, 2007 and entitled “Robot for Surgical Applications”), and U.S. Pat. No. 8,179,073 (issued May 15, 2011, and entitled “Robotic Devices with Agent Delivery Components and Related Methods”), all of which are hereby incorporated herein by reference in their entireties.


Thus, the various user controller 8 embodiments disclosed or contemplated herein can be used with any robotic surgical system to operate a robotic device or a component thereof, including such a device that is positioned in or through an incision into a target cavity or tissue of a patient. As such, the user utilizes her thumb and forefinger to manipulate the user controller 8, which thereby actuates the device or components thereof to perform a desired procedure.



FIG. 3 depicts a user controller 8 according to one embodiment having a thumb sheath (also referred to as a “enclosure,” “sleeve,” or “shroud”) 40, instead of a thumb restraint as discussed above in relation to FIGS. 1-2B. As used herein, “sheath,” “enclosure,” “sleeve,” or “shroud” is intended to mean any structure that encloses the user's thumb on three sides while defining an opening on the fourth side through which the user can remove her thumb. The thumb sheath 40 surrounds the thumb on two sides, with the main body 10 restraining on a third side, leaving a single side open. More specifically, the sheath 40 has a first section 40A extending from the body 10 and a second section 40B extending from the first section 40A in a direction substantially transverse to the first section 40A, thereby enclosing two sides around the thumb opening 48 such that the thumb opening 48 is defined by the first section 40A, the second section 40B, and the thumb groove 16. Alternatively, the device 8 need not have a thumb groove—the body 10 can define the third side in such implementations. As a result, the thumb sheath 40 and the thumb groove 16 or body 10 further define an open side 49 as shown. In contrast, the known thumb restraint 20 discussed above operates in conjunction with the thumb groove 16 to entirely surround or enclose the thumb on four sides—the entire 360° around the thumb.


In one embodiment, the thumb sheath 40 can sufficiently constrains the user's thumb when it is positioned within the thumb opening 48 such that the thumb can be used to perform a “pinching motion” in conjunction with the forefinger to cause the forefinger restraint 22 to move away from or closer to the body 10 in the directions represented by arrow 42. As such, the thumb sheath 40 can operate in a fashion similar to the known thumb restraint 20 discussed above. In contrast to that restraint 20, however, the sheath 40 also allows two methods of egress for the thumb. That is, the user's thumb can not only be retracted proximally in the direction represented by arrow 46 in the same fashion as possible with the known thumb restraint 20, but can also be moved out of the thumb opening 48 in the direction represented by arrow 44 through the open side 49. As can be seen in FIG. 3, the two directions of potential egress are normal to the direction of pinching (represented by arrow 42) and each other. As such, this configuration of the sheath 40 allows for both fine control of pinching motion while enabling the user to disengage from the device 8 by removing her thumb in a controlled and simple manner.


To clarify, the term “user controller” as used herein will refer to the various embodiments of a user input device to be manipulated by a user to provide input to and thereby operate some portion of a robotic system. In contrast, the term “system controller” will refer to any processor, computer or other system controller component (such as a microprocessor or the like) that can be used to operate a system.



FIG. 4 depicts a further implementation of a user controller 8 having a sensor 51 configured to detect the presence of the user's thumb. It is understood that this embodiment of the controller 8 has a thumb sheath 40 substantially similar to the sheath 40 described above, including the features and benefits as described. Further, in this exemplary implementation, a user presence sensor 51 is incorporated into the sheath 40. The device 8 has a matched light emitter 50 disposed on the sheath 40 and a receiver 52 disposed on the body 10. Alternatively, the emitter can be on the body 10 and the receiver can be on the sheath 40. In a further alternative, two or more such sensors can be incorporated into the device 8. The emitter 50 and receiver 52 are positioned in a manner which generally aligns the path of light 54 transmitted by the emitter 50 with the direction of motion of the pinching motion as represented by arrow 42. In use, the emitter 50 and receiver 52 are placed such that when the user's thumb is not present, light (visible or otherwise) from the emitter 50 reaches the receiver 52. In contrast, when the user's thumb is present within the thumb opening 48, the path of the light 54 is blocked. The absence of this signal can then be used as an indicator of user presence (that is, the presence of the user's thumb within the thumb opening 48), thereby indicating that the user is grasping the user controller 8. Once the light path is blocked by the user's thumb, restoration of this signal, an indicator of user absence, is achieved by retracting the thumb in either of two directions as represented by arrows 44 and 46, which are normal to the direction of pinching represented by arrow 42 and the path of light 54 (as discussed above). This configuration of sheath 40 and sensor 51 allows for motion of the thumb in the direction of pinching (as represented by arrow 42) without allowing light to pass. This allows for the sheath 40 to be sufficiently loose such that egress is easily achieved. That is, the size of the thumb opening 48 in relation to the user's thumb does not impact the ability of the sensor 51 to detect the presence therein or the ability of the user to utilize the sheath 40 to allow the user to utilize the pinching motion to move the forefinger restraint as discussed above.


Alternatively, any known sensor or sensor technology can be used with the user controller 8 to detect the presence (and absence) of the user's thumb within the sheath 40.


The sensor 51 allows for the user controller 8 (and the system to which the controller 8 is coupled) to utilize the information about the presence or absence of the user's thumb to activate or deactivate mechanical support of the user controller 8. That is, the sensor 51 can be configured to transmit a “presence” signal to the system controller (not shown) of the system (not shown) when the thumb is inserted into the sheath 40 such that the system controller deactivates any mechanical support of the user controller 8. Similarly, the sensor 51 can also be configured to transmit an “absence” signal to the system controller (not shown) when the thumb is retracted from the sheath 40 such that the system controller activates mechanical support of the user controller 8, thereby preventing gravity from causing the user controller 8 from moving in an undesirable fashion that causes the controlled robotic device to also move in an undesirable fashion.



FIG. 5 depicts an alternative embodiment of a user controller 8 having a reflected light sensor 61. That is, the user controller 8 has an emitter 60 and a receiver 62 that are both embedded in the main body 10 as shown such that the emitted light 64 from the emitter 60 returns to the receiver 62 as reflected light 66 by the nearest occlusion. In this configuration, the presence of the user's thumb within the sheath 40 provides a much shorter path than the sheath 40 and thus a corresponding stronger return signal than would be detected in the absence of the thumb. This signal can then be thresholded to determine the binary presence/absence of the user's thumb. That is, a predetermined threshold can be established above which it is understood that a user's thumb is present in the sheath 40 such that a presence signal is transmitted to the system controller (not shown). In one implementation, it is understood that this embodiment has substantially the same features, modes of egress, and advantages, including insensitivity to motion in the direction of pinching motion, as the previously described embodiments.



FIG. 6 depicts an exemplary known circuit for use in conjunction with a sensor such as either of the sensors 51, 61 discussed above with respect to FIGS. 4 and 5 for detecting the presence of a user's thumb within the sheath 40. In this embodiment, one or more pairs of infrared (IR) emitters and detectors are provided that are similar to those described in FIG. 4 or FIG. 5. The presence of the user's thumb blocks the IR light from the emitter from reaching the detector, changing the output state of the circuit. Each emitter/detector pair described uses the circuit in FIG. 6 to detect presence. When the user's thumb is absent from the device, phototransistor Q1 receives IR light from LED1. This turns the transistor on, causing a current to flow through resistor R1, and a non-zero voltage to appear on the non-inverting input (pin 5) of the comparator U1. If this voltage is higher than the inverting input of U1, set by the voltage divider of R2 and R3, the output of the comparator is switched on, lowering the output voltage to 0. When the detector Q1 is blocked, the transistor is off, and the output of the circuit is 5 volts. Alternatively, any known circuit or circuit configuration can be used for this purpose.



FIG. 7 depicts a further embodiment of a sensor 70 for use in a user controller 8. In this specific implementation, instead of a light-based technology, the sensor 70 is a known capacitive sensor 70 positioned in the main body 10 as shown. The capacitive sensor 70 functions as a known capacitive sensor 70 operates to detect the presence of the user's thumb within the sheath 40. According to one embodiment, it is understood that this embodiment has substantially the same features, modes of egress, and advantages, including insensitivity to motion in the direction of pinching motion, as the previously described embodiments.



FIG. 8 depicts an exemplary known circuit for use in conjunction with a capacitive sensor such as the sensor 70 discussed above with respect to FIG. 7 for detecting the presence of a user's thumb within the sheath 40, according to another implementation. One or more capacitive sensors are placed on the inner surface of the thumb sheath, such as the sensor 70 in FIG. 7. In use, when the user's thumb is placed in the sheath 40, the change in capacitance changes the output state of the circuit. Alternatively, any known circuit or circuit configuration that operates in conjunction with a capacitive sensor can be used for this purpose.



FIG. 12 depicts a further embodiment of a sensor 120 for use in a user controller 8. In this specific implementation, instead of a light- or capacitive-based technology, the sensor 120 is a known mechanical sensor 120 positioned in the main body 10 as shown. The mechanical sensor 120 functions as a known mechanical sensor 120 operates to detect the presence of the user's thumb within the sheath 40. For example, the mechanical sensor 120 can be actuated by the user's thumb depressing the sensor 120, thereby indicating that the thumb is present within the sheath 40. According to one embodiment, it is understood that this embodiment has substantially the same features, modes of egress, and advantages, including insensitivity to motion in the direction of pinching motion, as the previously described embodiments.



FIG. 9 depicts an exemplary known circuit for use in conjunction with a mechanical sensor such as sensor 120 discussed above with respect to FIG. 12 for detecting the presence of a user's thumb within the sheath 40, according to a further embodiment. In this embodiment, a mechanical switch (such as switch 120) is placed inside of the thumb sheath 40. In use, when the user's thumb is in place, the switch is actuated and the output state of the circuit changes. When the user's thumb is not in the sheath, the switch is open, and the output of the switch is pulled up to 5 volts. V1 inverts this signal to a 0 volt output. When the thumb is placed in the sheath, the switch is depressed, which changes the output of the circuit to 5 V. The switch debouncing circuitry is a circuit which filters out short duration transitions of the output when the mechanical switch is engaged and disengaged. Alternatively, any known circuit or circuit configuration that operates in conjunction with a mechanical sensor can be used for this purpose.



FIG. 10 depicts a user controller 8 having a user sensory feedback signal component 100, according to one embodiment. That is, this specific implementation has a signal component 100 that provides some type of sensory feedback to the user about whether the user's thumb is positioned within the sheath 40. In the specific embodiment depicted in FIG. 10, the feedback signal component 100 is a visual feedback component 100 in the form of an LED 100 that is disposed on the thumb sheath 40. Alternatively, any form of sensory feedback signal can be used. This feedback component 100 provides feedback to the user regarding whether the system (not shown) detects the presence of the user's thumb within the sheath 40. Feedback may be provided by multiple LEDs, auditory, or other visual signals. In use, according to this embodiment, the LED 100 would illuminate if the user's thumb is detected, thereby indicating that the thumb is positioned within the sheath 40. It is understood that the user controller 8 with the user feedback signal component 100 can have any of the various sensor components disclosed or contemplated herein. In addition, it is understood that the user feedback signal component 100 can be incorporated into any other embodiment disclosed or contemplated herein.



FIGS. 11A and 11B depict an adjustable sheath 40, according to one embodiment. More specifically, the sheath 40 in this specific implementation can move between a retracted position as shown in FIG. 11A and an extended position as shown in FIG. 11B. As such, the sheath 40 can be adjusted to be positioned with respect to the main body 10 in the retracted positioned in which the thumb opening 48 has a minimum width represented by arrow 110 (as shown in FIG. 11A) or can be extended out away from the body 10 up to the extended position in which the thumb opening 48 has a maximum width represented by arrow 112 (as shown in FIG. 11B). This adjustability enables the sheath 40 to conform to a wide array of user thumb sizes while supplying sufficient control authority to the user while still enabling the user to disengage in a controlled manner. It is further understood that the user controller 8 with the adjustable sheath 40 can have any of the various sensor or sensory feedback components disclosed or contemplated herein. In addition, it is understood that the adjustable sheath 40 can be incorporated into any other embodiment disclosed or contemplated herein.


Although the present invention has been described with reference to preferred embodiments, persons skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention.

Claims
  • 1. A user controller comprising: (a) a controller body;(b) a forefinger restraint operably coupled to the controller body such that the forefinger restraint is movable away from or closer to the controller body via a pinching motion of a user;(c) a thumb sheath coupled to the controller body, the thumb sheath and the controller body defining a thumb opening and a side opening, the thumb opening defined by a side of the controller body, a first section of the thumb sheath extending from the controller body, and a second section of the thumb sheath extending from the first section of the thumb sheath, and the side opening defined by the second sheath section and the controller body; and(d) a thumb presence sensor disposed within the thumb sheath, wherein the thumb presence sensor is configured to detect a presence of a thumb of the user disposed in the thumb opening, including during the pinching motion.
  • 2. The user controller of claim 1, wherein the thumb sheath and the controller body do not form a 360° enclosure around the thumb opening.
  • 3. The user controller of claim 1, wherein the thumb presence sensor comprises a light sensor disposed within the thumb opening.
  • 4. The user controller of claim 1, wherein the thumb presence sensor comprises a light emitter disposed on an inner wall of the thumb sheath and a light receiver disposed on the controller body, wherein the light receiver is positioned to receive light transmitted by the light emitter.
  • 5. The user controller of claim 1, wherein the thumb presence sensor comprises a light emitter disposed on the controller body and a light receiver disposed on an inner wall of the thumb sheath, wherein the light receiver is positioned to receive light transmitted by the light emitter.
  • 6. The user controller of claim 1, wherein the thumb presence sensor comprises a light emitter and a light receiver, wherein the light emitter and light receiver are disposed on the controller body.
  • 7. The user controller of claim 1, wherein the thumb presence sensor comprises a capacitive sensor disposed on the controller body within the thumb sheath.
  • 8. The user controller of claim 1, wherein the thumb presence sensor comprises a mechanical sensor disposed on the controller body within the thumb sheath.
  • 9. The user controller of claim 1, wherein the thumb sheath is adjustable between a retracted position and an extended position.
  • 10. The user controller of claim 1, wherein the thumb presence sensor comprises a feedback signal component disposed on an outer surface of the thumb sheath, wherein the feedback signal component is visible to a user.
  • 11. The user controller of claim 1, wherein a user's thumb is removable from the thumb sheath via the thumb opening or the side opening.
  • 12. A robotic surgical system comprising: (a) a system controller;(b) a robotic surgical device operably coupled to the system controller; and(c) a user controller operably coupled to the system controller, the user controller comprising: (i) a controller body;(ii) a forefinger restraint operably coupled to the controller body such that the forefinger restraint is movable away from or closer to the controller body via a pinching motion of a user;(iii) a thumb sheath coupled to the controller body, wherein the thumb sheath and the controller body define a thumb opening and a side opening, and wherein the thumb sheath comprises: (A) a first sheath section extending from the controller body, the first sheath section defining a first wall of the thumb opening;(B) a second sheath section extending from the first sheath second, the second sheath section defining a second wall of the thumb opening; and(C) a third wall of the thumb opening defined by the controller body;and(iv) a thumb presence sensor disposed within the thumb sheath, wherein the thumb presence sensor is configured to detect a presence of a thumb of the user disposed in the thumb opening, including during the pinching motion.
  • 13. The robotic surgical system of claim 12, wherein the side opening is defined between the second wall and the third wall.
  • 14. The robotic surgical system of claim 12, wherein the thumb sheath does not form a 360° enclosure around the thumb opening.
  • 15. The robotic surgical system of claim 12, wherein the thumb presence sensor comprises a light sensor, a capacitive sensor, or a mechanical sensor.
  • 16. The robotic surgical system of claim 12, wherein the thumb sheath is adjustable between a retracted position and an extended position.
  • 17. The robotic surgical system of claim 12, further comprising a feedback signal component disposed on an outer surface of the thumb sheath, wherein the feedback signal component is visible to a user.
  • 18. The robotic surgical system of claim 12, wherein a user's thumb is removable from the thumb sheath via the thumb opening or the side opening.
  • 19. A user controller comprising: (a) a controller body;(b) a forefinger restraint operably coupled to the controller body such that the forefinger restraint is movable away from or closer to the controller body via a pinching motion of a user;(c) a thumb sheath coupled to the controller body, the thumb sheath being adjustable between a retracted position and an extended position, the thumb sheath comprising: (i) a first sheath section extending from the controller body;(ii) a second sheath section extending from the first sheath section, wherein the second sheath section is substantially transverse to the first sheath section;(iii) a thumb opening defined by the first sheath section, the second sheath section, and the controller body; and(iv) an open side defined by the second sheath section and the controller body; and(d) a thumb presence sensor disposed within the thumb sheath, wherein the thumb presence sensor is configured to detect a presence of a thumb of the user disposed in the thumb opening, including during the pinching motion.
  • 20. The user controller of claim 19, wherein the first sheath section, the second sheath section, and the controller body do not form a 360° enclosure around the thumb opening.
  • 21. The user controller of claim 19, wherein the thumb presence sensor comprises a light emitter and a light receiver, wherein the light receiver is positioned to receive light transmitted by the light emitter.
  • 22. The user controller of claim 19, wherein a user's thumb is removable from the thumb sheath via the thumb opening or the open side.
CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority as a continuation application to U.S. patent application Ser. No. 16/896,678, filed Jun. 9, 2020 and entitled “User Controller with User Presence Detection and Related Systems and Methods,” which issued as U.S. Pat. No. 11,284,958 on Mar. 29, 2022, which claims priority as a continuation to U.S. patent application Ser. No. 15/826,166, filed Nov. 29, 2017, and entitled “User Controller with User Presence Detection and Related Systems and Methods,” which issued as U.S. Pat. No. 10,675,110 on Jun. 9, 2020, which claims priority to U.S. Provisional Application 62/427,357, filed Nov. 29, 2016, and entitled “Controller with User Presence Detection and Related Systems and Methods,” all of which are hereby incorporated herein by reference in their entireties.

US Referenced Citations (180)
Number Name Date Kind
5307447 Asano et al. Apr 1994 A
5388528 Pelrine et al. Feb 1995 A
5624398 Smith et al. Apr 1997 A
5657429 Wang et al. Aug 1997 A
5762458 Wang et al. Jun 1998 A
5791231 Cohn et al. Aug 1998 A
5825982 Wright et al. Oct 1998 A
5855583 Wang et al. Jan 1999 A
5876325 Mizuno et al. Mar 1999 A
6001108 Wang et al. Dec 1999 A
6223100 Green Apr 2001 B1
6240312 Alfano et al. May 2001 B1
6246200 Blumenkranz et al. Jun 2001 B1
6296635 Smith et al. Oct 2001 B1
6309397 Julian et al. Oct 2001 B1
6312435 Wallace et al. Nov 2001 B1
6331181 Tierney et al. Dec 2001 B1
6364888 Niemeyer et al. Apr 2002 B1
6398726 Ramans et al. Jun 2002 B1
6424885 Niemeyer et al. Jul 2002 B1
6436107 Wang et al. Aug 2002 B1
6441577 Blumenkranz et al. Aug 2002 B2
6450104 Grant et al. Sep 2002 B1
6451027 Cooper et al. Sep 2002 B1
6459926 Nowlin et al. Oct 2002 B1
6463361 Wang et al. Oct 2002 B1
6468265 Evans et al. Oct 2002 B1
6470236 Ohtsuki Oct 2002 B2
6491701 Nemeyer et al. Dec 2002 B2
6493608 Niemeyer et al. Dec 2002 B1
6522906 Salisbury, Jr. et al. Feb 2003 B1
6544276 Azizi Apr 2003 B1
6565554 Niemeyer May 2003 B1
6574355 Green Jun 2003 B2
6587750 Gerbi et al. Jul 2003 B2
6594552 Nowlin et al. Jul 2003 B1
6620173 Gerbi et al. Sep 2003 B2
6645196 Nixon et al. Nov 2003 B1
6659939 Moll et al. Dec 2003 B2
6671581 Niemeyer et al. Dec 2003 B2
6684129 Salisbury, Jr. et al. Jan 2004 B2
6699177 Wang et al. Mar 2004 B1
6714839 Salisbury, Jr. et al. Mar 2004 B2
6714841 Wright et al. Mar 2004 B1
6728599 Wright et al. Apr 2004 B2
6764445 Ramans et al. Jul 2004 B2
6766204 Niemeyer et al. Jul 2004 B2
6770081 Cooper et al. Aug 2004 B1
6783524 Anderson et al. Aug 2004 B2
6785593 Wang et al. Aug 2004 B2
6793653 Sanchez et al. Sep 2004 B2
6799065 Niemeyer Sep 2004 B1
6817972 Snow Nov 2004 B2
6837883 Moll et al. Jan 2005 B2
6839612 Sanchez et al. Jan 2005 B2
6852107 Wang et al. Feb 2005 B2
6858003 Evans et al. Feb 2005 B2
6879880 Nowlin et al. Apr 2005 B2
6899705 Niemeyer May 2005 B2
6905460 Wang et al. Jun 2005 B2
6905491 Wang et al. Jun 2005 B1
6936001 Snow Aug 2005 B1
6951535 Ghodoussi et al. Oct 2005 B2
6965812 Wang et al. Nov 2005 B2
6974449 Niemeyer Dec 2005 B2
6994703 Wang et al. Feb 2006 B2
7025064 Wang et al. Apr 2006 B2
7027892 Wang et al. Apr 2006 B2
7048745 Tierney et al. May 2006 B2
7074179 Wang et al. Jul 2006 B2
7083571 Wang et al. Aug 2006 B2
7083615 Peterson et al. Aug 2006 B2
7118582 Wang et al. Oct 2006 B1
7121781 Sanchez et al. Oct 2006 B2
7125403 Julian et al. Oct 2006 B2
7126303 Farritor et al. Oct 2006 B2
7155315 Niemeyer et al. Dec 2006 B2
7169141 Brock et al. Jan 2007 B2
7199545 Oleynikov et al. Apr 2007 B2
7217240 Snow May 2007 B2
7239940 Wang et al. Jul 2007 B2
7372229 Farritor et al. May 2008 B2
7492116 Oleynikov et al. Feb 2009 B2
7574250 Niemeyer Aug 2009 B2
7772796 Farritor et al. Aug 2010 B2
7789825 Nobis et al. Sep 2010 B2
7865266 Moll et al. Jan 2011 B2
7960935 Farritor et al. Jun 2011 B2
8179073 Farritor et al. May 2012 B2
8343171 Farritor et al. Jan 2013 B2
8679096 Farritor et al. Mar 2014 B2
8828024 Farritor et al. Sep 2014 B2
8834488 Farritor et al. Sep 2014 B2
8894633 Farritor et al. Nov 2014 B2
8968267 Nelson et al. Mar 2015 B2
8968332 Farritor et al. Mar 2015 B2
8974440 Farritor et al. Mar 2015 B2
9010214 Markvicka et al. Apr 2015 B2
9020644 Greeley et al. Apr 2015 B2
9060781 Farritor et al. Jun 2015 B2
9089353 Farritor et al. Jul 2015 B2
9117129 Koch Aug 2015 B1
9179981 Farritor et al. Nov 2015 B2
9498292 Mondry et al. Nov 2016 B2
9579088 Farritor et al. Feb 2017 B2
9743987 Farritor et al. Aug 2017 B2
9757187 Farritor et al. Sep 2017 B2
9770305 Farritor et al. Sep 2017 B2
9883911 Farritor et al. Feb 2018 B2
9888966 Farritor et al. Feb 2018 B2
9956043 Farritor et al. May 2018 B2
10111711 Farritor et al. Oct 2018 B2
10219870 Mondry et al. Mar 2019 B2
10307199 Farritor et al. Jun 2019 B2
10335024 Rentschler et al. Jul 2019 B2
10342561 Farritor et al. Jul 2019 B2
10376322 Frederick et al. Aug 2019 B2
10470828 Markvicka et al. Nov 2019 B2
10582973 Wilson et al. Mar 2020 B2
10667883 Farritor et al. Jun 2020 B2
10702347 Farritor et al. Jul 2020 B2
10751136 Farritor et al. Aug 2020 B2
10806538 Farritor et al. Oct 2020 B2
10966700 Farritor et al. Apr 2021 B2
11284958 Farritor Mar 2022 B2
20020091374 Cooper Jun 2002 A1
20020120254 Julian et al. Aug 2002 A1
20020128552 Nowlin et al. Sep 2002 A1
20020171385 Kim et al. Nov 2002 A1
20030020810 Takizawa et al. Jan 2003 A1
20030100817 Wang et al. May 2003 A1
20030135203 Wang et al. Jun 2003 A1
20040024311 Quaid Feb 2004 A1
20040106916 Quaid et al. Jun 2004 A1
20040254680 Sunaoshi Dec 2004 A1
20050064378 Toly Mar 2005 A1
20060119304 Farritor et al. Jun 2006 A1
20060155263 Lipow Jul 2006 A1
20060241570 Wilk Oct 2006 A1
20060253109 Chu Nov 2006 A1
20070156019 Larkin et al. Jul 2007 A1
20080004634 Farritor et al. Jan 2008 A1
20080058835 Farritor et al. Mar 2008 A1
20080111513 Farritor et al. May 2008 A1
20080221591 Farritor et al. Sep 2008 A1
20090024142 Ruiz Morales Jan 2009 A1
20090048612 Farritor et al. Feb 2009 A1
20090054909 Farritor et al. Feb 2009 A1
20090069821 Farritor et al. Mar 2009 A1
20090076536 Rentschler et al. Mar 2009 A1
20090137952 Ramamurthy et al. May 2009 A1
20090163929 Yeung et al. Jun 2009 A1
20090240246 Devill et al. Sep 2009 A1
20090248038 Blumenkranz et al. Oct 2009 A1
20090281377 Newell et al. Nov 2009 A1
20090305210 Guru et al. Dec 2009 A1
20100010294 Conlon et al. Jan 2010 A1
20100042097 Newton et al. Feb 2010 A1
20100139436 Kawashima et al. Jun 2010 A1
20100262162 Omori Oct 2010 A1
20100318059 Farritor et al. Dec 2010 A1
20110071347 Rogers et al. Mar 2011 A1
20110071544 Steger et al. Mar 2011 A1
20110224605 Farritor et al. Sep 2011 A1
20110237890 Farritor et al. Sep 2011 A1
20110238080 Ranjit et al. Sep 2011 A1
20110264078 Lipow et al. Oct 2011 A1
20120041595 Greeley et al. Feb 2012 A1
20120109150 Quaid et al. May 2012 A1
20120179168 Farritor et al. Jul 2012 A1
20120253515 Coste-Maniere et al. Oct 2012 A1
20130197697 Schaible et al. Aug 2013 A1
20130345717 Markvicka et al. Dec 2013 A1
20140039515 Mondry et al. Feb 2014 A1
20140046340 Wilson et al. Feb 2014 A1
20140058205 Frederick et al. Feb 2014 A1
20140303434 Farritor et al. Oct 2014 A1
20150051446 Farritor et al. Feb 2015 A1
20150190170 Frederick et al. Jul 2015 A1
20180168758 Lutzow Jun 2018 A1
Foreign Referenced Citations (21)
Number Date Country
113017841 Jun 2021 CN
113017841 Jun 2021 CN
2286756 Feb 2011 EP
08224248 Sep 1996 JP
2004180781 Jul 2004 JP
2009106606 May 2009 JP
2010533045 Oct 2010 JP
2010536436 Dec 2010 JP
2011045500 Mar 2011 JP
2002082979 Oct 2002 WO
2006079108 Jul 2006 WO
2007149559 Dec 2007 WO
2009023851 Feb 2009 WO
2010050771 May 2010 WO
2011060187 May 2011 WO
2011075693 Jun 2011 WO
2013009887 Jan 2013 WO
2014011238 Jan 2014 WO
2016114090 Jul 2016 WO
2016126334 Aug 2016 WO
2016201544 Dec 2016 WO
Non-Patent Literature Citations (14)
Entry
Abbott et al. , “Design of an Endoluminal NOTES Robotic System,” from the Proceedings of the 2007 IEEE/RSJ Int'l Conf. on Intelligent Robot Systems, San Diego, CA, Oct. 29-Nov. 2, 2007, pp. 410-416.
Ballantyne, “Robotic Surgery, Telerobotic Surgery, Telepresence, and Telementoring,” Surgical Endoscopy, 2002; 16: 1389-1402.
Bauer et al., “Case Report: Remote Percutaneous Renal Percutaneous Renal Access Using a New Automated Telesurgical Robotic System,” Telemedicine Journal and e-Health 2001; (4): 341-347.
Berg et al., “Surgery with Cooperative Robots,” Medicine Meets Virtual Reality, Feb. 2007, 1 pg.
Camarillo et al., “Robotic Technology in Surgery: Past, Present and Future,” The American Journal of Surgery, 2004; 188: 2S-15.
Cavusoglu et al., “Telesurgery and Surgical Simulation: Haptic Interfaces to Real and Virtual Surgical Environments,” In McLaughliin, M.L., Hespanha, J.P., and Sukhatme, G., editors. Touch in virtual environments, IMSC Series in Multimedia 2001, 28pp.
Green, “Telepresence Surgery”, Jan. 1, 1995, Publisher: IEEE Engineering in Medicine and Biology.
Cleary et al., “State of the Art in Surgical Rooties: Clinical Applications and Technology Challenges”, “Computer Aided Surgery”, Jan. 1, 2002, pp. 312-328, vol. 6.
Stoianovici et al., “Robotic Tools for Minimally Invasive Urologic Surgery”, Jan. 1, 2002, pp. 1-17.
Franzino, “The Laprotek Surgical System and the Next Generation of Robotics,” Surg Clin North Am, 2003 83(6): 1317-1320.
Falcone et al., “Robotic Surgery,” Clin. Obstet. Gynecol. 2003, 46(1): 37-13.
Fraulob et al., “Miniature assistance module for robot-assisted heart surgery,” Biomed. Tech. 2002, 47 Suppl. 1, Pt. 1: 12-15.
Dakin et al., “Comparison of laparoscopic skills performance between standard instruments and two surgical robotic systems,” Surg Endosc., 2003; 17: 574-579.
Cavusoglu et al., “Robotics for Telesurgery: Second Generation Berkeley/UCSF Laparoscopic Telesurgical Workstation and Looking Towards the Future Applications,” Industrial Robot: An International Journal, 2003; 30(1):22-29.
Related Publications (1)
Number Date Country
20220218430 A1 Jul 2022 US
Provisional Applications (1)
Number Date Country
62427357 Nov 2016 US
Continuations (2)
Number Date Country
Parent 16896678 Jun 2020 US
Child 17706893 US
Parent 15826166 Nov 2017 US
Child 16896678 US