The present invention relates to a method and a system for controlling a telerobotic robot using an input device which comprises a movable actuator, and to a computer program or computer program product for carrying out the method.
From company-internal practice, it is known to control a telerobotic robot using an input device which comprises a movable actuator. Target pose changes of the telerobotic robot, for example of its end effector or TCP, are commanded by an operator on the basis of a detected manual adjustment of the actuator and, conversely, target forces of the actuator are commanded on the basis of sensor-determined external forces on the telerobotic robot, so that the operator experiences haptic (force) feedback on the actuator.
The object of the present invention is to improve the control of a telerobotic robot by actuation of an actuator of an input device.
This object is achieved by a method, a system, and computer program product for carrying out a method as described herein.
According to one embodiment of the present invention, a method for controlling a telerobotic robot using an input device which comprises a movable actuator, comprises the following steps, which are, cyclically in one embodiment, preferably repeated multiple times:
By commanding target poses, the telerobotic robot can advantageously be controlled (more) precisely in one embodiment, by commanding target forces in one embodiment, a (more) advantageous, in particular (more) reliable, (more) ergonomic and/or (more) intuitive operation of the actuator is realized and thus in one embodiment teleoperation is simplified and/or its reliability is improved.
In one embodiment, the telerobotic robot comprises a ((telerobotic) robot) arm having at least three, in particular at least six, in one embodiment at least seven, joints or movement axes. In one embodiment, the robot-fixed reference is stationary with respect to a distal end flange of the telerobotic robot (arm); in one embodiment, the robot-fixed reference comprises an end effector or TCP of the telerobotic robot (arm), and can in particular be an end effector or TCP of the telerobotic robot (arm).
In one embodiment, the actuator is spatially separated from the telerobotic robot and/or a (robot) controller of the telerobotic robot. In one embodiment, the input device, in particular an input device controller, is signal-connected to the telerobotic robot and/or a (robot) controller of the telerobotic robot; in a further development it is wired, which can increase security in one embodiment, and in another further development it is wireless, which in one embodiment can increase flexibility and/or range. In one embodiment, the actuator is movably mounted, in particular via one or more joints, on a base of the input device, wherein a position of the actuator relative to the base of the input device is detected in one embodiment, preferably by sensors.
In one embodiment, a pose of the telerobotic robot comprises a one-, two- or three-dimensional position and/or a one-, two- or three-dimensional orientation, in one embodiment a or the robot-fixed reference, in particular an end effector or TCP, of the telerobotic robot. Additionally or alternatively, in one embodiment, a pose of the telerobotic robot comprises the joint position of one or more joints of the telerobotic robot. In one embodiment, a position of the actuator comprises a one-, two- or three-dimensional position and/or a one-, two- or three-dimensional orientation of the actuator relative to a or the base of the input device and/or the joint position of one or more joints, via which the actuator is movably mounted relative to a or the base of the input device.
A force within the meaning of the present invention may also in particular comprise, in particular be, a pair of forces or torque that are parallel in opposite directions. Controlling within the meaning of the present invention may also be regulation.
In one embodiment, drives of the telerobotic robot adjust its axes or joints in order to approach the commanded target pose(s), wherein corresponding target joint adjustments are determined in a manner known per se by means of inverse kinematics in one embodiment, optionally with redundancy resolution in a manner known per se.
In one embodiment, drives of the input device actuate the actuator in order to exert the commanded target force, in particular via the actuator on an operator who manually actuates the actuator.
According to one embodiment of the present invention, one or more virtual borders between (in each case) a permissible and an impermissible region are specified for the telerobotic robot in particular.
The one or more virtual borders are in one embodiment (each) specified as a virtual, in particular straight or curved, wall in a working space of the telerobotic robot.
As a result, in one embodiment, the teleoperation can be improved, in particular an environment of the telerobotic robot can be protected and/or controlling the telerobotic robot by an operator can be improved, in particular guided, using the input device.
In one embodiment, the virtual borders(s) are (each) specified as a virtual stop of one or more joints of the telerobotic robot.
In one embodiment, the telerobotic robot can thereby be protected.
According to one embodiment of the present invention, the commanded target force of the actuator comprises a restoring force component starting from this virtual border, said restoring force component counteracting an actuation of the actuator for commanding a movement of the telerobotic robot away from the border in the direction of the impermissible region or is determined or commanded in such a way.
In one embodiment, this provides the operator who controls the telerobotic robot via the actuator(s) with advantageous haptic feedback in the form of an artificially or additionally generated counterforce. In one embodiment, the control of the telerobotic robot can thereby be improved using the input device or by an operator actuating the actuator, in particular the operator can control the telerobotic robot (more) easily, (more) reliably, (more) precisely, (more) ergonomically and/or (more) intuitively.
In one embodiment, the restoring force component simulates, preferably only or exclusively, contact of the telerobotic robot with an obstacle; in one embodiment, contact of a or the robot-fixed reference of the telerobotic robot with an environmental obstacle. In one embodiment, this means that an operator of the actuator only feels this restoring force component as a force (component) which, scaled in one embodiment, corresponds to an external force on the telerobotic robot, in particular the robot-fixed reference, in a direction that is perpendicular to a (virtual) surface of the (virtual) obstacle and is directed away from this (virtual) surface (in the permissible region), or the target force or restoring force component is determined or commanded accordingly.
In one embodiment, the control of the telerobotic robot can thereby be improved using the input device or by an operator actuating the actuator, in particular the operator can control the telerobotic robot (more) easily, (more) reliably, (more) precisely, (more) ergonomically and/or (more) intuitively.
In one embodiment, the restoring force component is a force of a virtual compression spring, wherein, in a further development, this virtual compression spring is only (virtually) tensioned or compressed by or in the event of an actuation of the actuator for commanding a movement of the telerobotic robot away from the border in the direction of the impermissible region and/or by or in the event of a movement of the telerobotic robot away from the border in the direction of the impermissible region and/or a spring (pressure) force of this virtual compression spring depends on a current and/or previous position of the actuator and/or on a current and/or previous pose of the telerobotic robot, in particular the robot-fixed reference, and is determined in particular on the basis of a current and/or previous position of the actuator and/or a current and/or previous pose of the telerobotic robot, in particular the robot-fixed reference. In one embodiment, this virtual spring thus acts only as a pressure spring and not as a tension spring. In one embodiment, this restoring force component or virtual compression spring only transmits or simulates a force on the telerobotic robot in the opposite direction to a contact or penetration direction which is directed away from the border in the direction of the impermissible region, but not in any other direction, or a corresponding force (component) on the actuator.
In one embodiment, the restoring force component can thereby be determined particularly easily, reliably and/or precisely and/or contact of the telerobotic robot with an obstacle can be simulated particularly easily and/or realistically.
In one embodiment, the spring (pressure) force of the virtual compression spring (also) depends on a specified spring stiffness of the virtual compression spring, which in one embodiment may be set by an operator of the input device, and is determined in particular on the basis of a specified spring stiffness of this virtual spring, which may be set by an operator of the input device.
Additionally or alternatively, in one embodiment, the spring (pressure) force of the virtual compression spring (also) depends on a specified scaling between adjustments of the actuator and movements of the telerobotic robot, in particular the robot-fixed reference, which in one embodiment may be set by an operator of the input device, and is determined in particular on the basis of a specified scaling between adjustments of the actuator and movements of the telerobotic robot, in particular the robot-fixed reference, which in one embodiment may be set by an operator of the input device.
In one embodiment, a particularly advantageous spring characteristic of the virtual spring or contact force component or the simulated contact can thereby be realized and, in one embodiment, teleoperation can be simplified and/or its reliability can be improved.
In one embodiment, commanding a movement of the telerobotic robot starting from the border in the direction of the impermissible region is suppressed during an actuation of the actuator for commanding this movement of the telerobotic robot or, in the event of an actuation of the actuator for commanding a movement of the telerobotic robot, a component of this movement starting from the border in the direction of the impermissible region is hidden or not commanded or only components of this movement are commanded in the direction of the permissible region and/or along the border.
As a result, in one embodiment, the teleoperation can be improved, in particular an environment of the telerobotic robot can be protected and/or controlling the telerobotic robot by an operator can be improved, in particular guided, using the input device.
In one embodiment, the target force comprises a force feedback component which depends on an external force acting on or at the telerobotic robot, in a further development on or at its robot-fixed reference, which emulates said external force in one embodiment and emulates it in a scaled manner in a further development.
In one embodiment, the external force on or at the telerobotic robot is determined by means of at least one distal or end effector-side force sensor of the telerobotic robot and/or, preferably model-based, on the basis of joint forces of the telerobotic robot.
As a result, in one embodiment, advantageous haptic feedback can be realized and the teleoperation can thereby be improved, preferably the operator can control the telerobotic robot (more) easily, (more) reliably, (more) precisely, (more) ergonomically and/or (more) intuitively.
In one embodiment, the desired force comprises a damping component which depends on an adjustment speed of the actuator, which in one embodiment is directed in the opposite direction.
As a result, in one embodiment, the operator can control the telerobotic robot (more) easily, (more) reliably, (more) precisely, and/or (more) ergonomically.
In one embodiment, provided that the telerobotic robot is in the permissible range or not at the border or in the impermissible range, a target force fd,HD of the actuator is determined, which comprises a force feedback component which depends on an external force fe of the telerobotic robot, in one embodiment on a or the robot-fixed reference, in particular the end effector or TCP, and in particular emulates said external force (in a scaled manner), and in one embodiment additionally comprises a damping component which depends on a current adjustment speed (dX/dt)c,HD of the actuator:
with the damping coefficient D.
In one embodiment, a target pose Xd,r of a or the robot-fixed reference, in particular the end effector or TCP, is determined according to
with the current position Xc,HD of the actuator, the previous position Xini,HD of the actuator, the previous pose Xini,r of the telerobotic robot or the robot-fixed reference and a specified scaling s between adjustments of the actuator and movements of the telerobotic robot or the robot-fixed reference provided that the telerobotic robot is in the permissible region or not at the border or in the impermissible region.
In one embodiment, an impermissible or limiting direction uL is determined for one or more virtual borders, preferably perpendicular to the virtual border and in the direction of the impermissible region. If, for example, a virtual border in the form of a virtual wall at ymax is specified in the Cartesian working space, this is the impermissible or limiting direction uL=[0 1 0]T.
In one embodiment, a rotation matrix 0RL which transforms a coordinate system 0 of Cartesian space and a coordinate system L which is aligned with the impermissible or limiting direction, in one embodiment comprises a z-axis aligned with this, is determined, wherein a rotation axis U and a rotation angle θ of this transformation or rotation matrix are determined in one embodiment from
and the rotation matrix 0RL is transformed from the coordinate system L into the coordinate system 0, its transpose (0RL)T correspondingly from the coordinate system 0 into the coordinate system L. Of course, another axis can be used instead of the z-axis and this can be taken into account in the corresponding equations.
Starting from the virtual border, in one embodiment, a restoring force component
of a virtual compression spring is added:
to the target force fd,HD of the actuator according to equation (1). Here, K is a spring stiffness of the virtual spring and Xd, HD is a target position of the actuator, in particular according to:
with the current Pose Xc,r of the robot-fixed reference. It can be seen that the spring force of the virtual compression spring depends on the current and previous position of the actuator and the current and previous pose of the telerobotic robot:
and only counteracts an actuation of the actuator for commanding a movement of the telerobotic robot away from the border in the direction of the impermissible region (LeHD [3]<0). The index *[3] denotes the z component of the corresponding vector.
If, for example, a virtual border in the form of a virtual wall is specified in the working space at ymax, starting from the border, i.e. for yd,r>ymax with the y component yd,r of the Cartesian position of the end effector or TCP, commanding a movement of the telerobotic robot in the direction of the impermissible region is suppressed during an actuation of the actuator for commanding this movement of the telerobotic robot
If a virtual border is specified as a virtual stop of one or more joints, in one embodiment in a one-matrix, the rows or columns of the joints which are at the stop or the virtual border are assigned zero, for example in a telerobotic robot with seven joints and the second and sixth joints at the virtual stop:
In addition, a speed direction according to
with the pseudo-inverse J# and the Cartesian target speed to achieve the desired pose is determined under the assumption that no joint stops are present, and the (corresponding) angle θ between this speed direction and the corresponding column vector(s0 U[:, m] of the matrix U is determined:
If this angle is greater than 90°, the negative (normalized) column vector(s) U[:, m] of the matrix U are used as the impermissible or limiting direction uL, otherwise the (normalized) column vector(s) U[:, m] of the matrix U are used:
This impermissible or limiting direction uL is then used in the manner described above in order to determine or command the associated restoring force component in the case of a virtual border in the form of a virtual stop of one or more joints of the telerobotic robot.
According to one embodiment of the present invention, a system, in particular in terms of hardware and/or software, in particular in terms of programming, is configured to perform a method described herein and/or comprises:
In one embodiment, the system or its means comprises:
Means for suppressing commanding a movement of the telerobotic robot starting from the border in the direction of the impermissible region during an actuation of the actuator for commanding this movement of the telerobotic robot.
A system and/or a means within the meaning of the present invention may be designed in hardware and/or in software, and in particular may comprise at least one data-connected or signal-connected, in particular, digital, processing unit, in particular microprocessor unit (CPU), graphic card (GPU) having a memory and/or bus system or the like and/or one or multiple programs or program modules. The processing unit may be designed to process commands that are implemented as a program stored in a memory system, to detect input signals from a data bus and/or to output output signals to a data bus. A storage system may comprise one or a plurality of, in particular different, storage media, in particular optical, magnetic, solid-state, and/or other non-volatile media. The program may be designed in such a way that it embodies or is capable of carrying out the methods described herein, so that the processing unit is able to carry out the steps of such methods and thus, in particular, is able to control the telerobotic robot. In one embodiment, a computer program product may comprise, in particular, a storage medium, in particular a computer-readable and/or non-volatile storage medium for storing a program or instructions or with a program or with instructions stored thereon. In one embodiment, executing this program or these instructions by a system or a controller, in particular a computer or an arrangement of a plurality of computers, causes the system or the controller, in particular the computer(s), to carry out a method described here or one or more of its steps, or the program or the instructions are configured for this purpose.
In one embodiment, one or more, in particular all, steps of the method are performed completely or partially automatically, in particular by the system or its means.
In one embodiment, the system comprises the telerobotic robot and/or its robot controller and/or the input device.
Contact within the meaning of the present invention is understood in particular as single-sided contact or contact of two surfaces in a manner known per se.
In one embodiment, the target pose, in a further development commanding and/or approaching the target pose, is realized by means of a position, speed or force control in the joint space or space of the joint coordinates of the telerobotic robot. In one embodiment, the telerobotic robot can thereby advantageously be operated, in particular (more) precisely, (more) easily and/or (more) reliably.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and, together with a general description of the invention given above, and the detailed description given below, serve to explain the principles of the invention.
In one step S10, a current pose of the actuator 3 relative to the input device 2.1 and an external force fe at a robot-fixed reference in the form of an end effector 5 are determined using sensors, in one embodiment by means of at least one distal or end effector-side force sensor 6 of the telerobotic robot (arm) or model-based on the basis of joint forces of the telerobotic robot (arm). In addition, a current position Xc,HD of the actuator and a current pose Xc,r of the end effector 5 are determined, wherein the (current) adjustment speed (dX/dt)c,HD is determined in one embodiment by time differentiation of the current position Xc,HD or, conversely, the current position Xc,HD is determined by time integration.
In one step S20, it is determined whether the telerobotic robot is located at one or more specified virtual borders or impermissible regions delimited thereby.
If this is not the case (S20: “N”), a new target force fd,HD of the actuator 3 and a new target pose Xd,r of the telerobotic robot, in one embodiment of the end effector 5, are determined in one step S30 according to the above equations (1), (2).
Otherwise (S20: “Y”), in one step S34 according to the above equations (2)-(13), a new target force fd,HD of the actuator 3 and a new target pose Xd,r of the telerobotic robot, in one embodiment of the end effector 5, are determined, in particular commanding a movement of the telerobotic robot during an actuation of the actuator for commanding this movement of the telerobotic robot (cf. equation (8)) is suppressed and the target force is determined with the corresponding restoring force component(s) (cf. equation (5)), so that an operator of or on the actuator 3 feels the telerobotic robot come into contact with a virtual obstacle.
In one step S50, the corresponding target pose and target force are commanded.
The method then returns to step S10, wherein the previous current position of the actuator 3 forms the new previous position of the actuator 3 and the previous current pose of the end effector 5 forms the new previous pose of the end effector 5.
Although embodiments have been explained in the preceding description, it is noted that a large number of modifications are possible. It is also noted that the embodiments are merely examples that are not intended to restrict the scope of protection, the applications, and the structure in any way. Rather, the preceding description provides a person skilled in the art with guidelines for implementing at least one embodiment, various changes—in particular with regard to the function and arrangement of the described components—being able to be made without departing from the scope of protection as it arises from the claims and from these equivalent combinations of features.
While the present invention has been illustrated by a description of various embodiments, and while these embodiments have been described in considerable detail, it is not intended to restrict or in any way limit the scope of the appended claims to such de-tail. The various features shown and described herein may be used alone or in any combination. Additional advantages and modifications will readily appear to those skilled in the art. The invention in its broader aspects is therefore not limited to the specific details, representative apparatus and method, and illustrative example shown and described. Accordingly, departures may be made from such details without departing from the spirit and scope of the general inventive concept.
Number | Date | Country | Kind |
---|---|---|---|
10 2021 204 495.6 | May 2021 | DE | national |
This application is a national phase application under 35 U.S.C. § 371 of International Patent Application No. PCT/EP2022/060748, filed Apr. 22, 2022 (pending), which claims the benefit of priority to German Patent Application No. DE 10 2021 204 495.6, filed May 4, 2021, the disclosures of which are incorporated by reference herein in their entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/060748 | 4/22/2022 | WO |