This application claims priority as a continuation of PCT/CN2022/093228, filed May 17, 2022, published as WO2022252976A1, and entitled “METHOD AND DEVICE FOR CONTROLLING ROBOT TO PERFORM SOMERSAULT MOTION AND ROBOT” which claims priority to Chinese Patent Application No. 202110601860.0, filed on May 31, 2021 and entitled “METHOD FOR CONTROLLING ROBOT TO PERFORM SOMERSAULT MOTION, AND ROBOT”, each of which are hereby incorporated herein by reference in their entirety.
This disclosure relates to the field of artificial intelligence and robotics, and specifically to a method and apparatus for controlling a robot to perform a somersault motion, and a robot.
As artificial intelligence (AI) and robotics technologies have been widely applied in civil and commercial fields, robots based on AI and robotics technologies play an increasingly important role in various scenarios such as intelligent transportation, smart homes, and the like.
Generally, motion control of a robot, especially a wheel-legged robot, involves control over a motion process (e.g., forward motion process) of a wheel-leg portion of the robot in the forward direction of the robot. For example, the robot is controlled to be at a target position or target velocity. However, the robot has no corresponding motion mode when facing an obstacle that cannot be avoided by the forward motion, such as a hole, ditch, trench, ravine, river, and the like.
In view of the foregoing problems, the present disclosure provides a method for controlling a robot to perform a somersault motion, a robot, and a non-transitory computer-readable storage medium. By using the robot control method provided, the robot, when facing an obstacle that cannot be avoided by a forward motion can cross the obstacle by performing a somersault motion.
In some embodiments, a method for controlling a robot to perform a somersault motion is provided, the robot including a wheel-leg portion and a base portion connected to the wheel-leg portion, the wheel-leg portion including at least one joint, and the method including: receiving a motion instruction; and controlling a torque of the at least one joint according to the motion instruction to allow the robot to perform the somersault motion; in a takeoff phase of the somersault motion, a center of mass of the wheel-leg portion being lower than a center of mass of the base portion; in a flight phase of the somersault motion, there being a time at which the center of mass of the wheel-leg portion is higher than the center of mass of the base portion; and in a landing phase of the somersault motion, the center of mass of the wheel-leg portion being lower than the center of mass of the base portion.
In some embodiments, a robot is provided and includes: a wheel-leg portion including a plurality of joints; a base portion, the base portion being connected to the wheel-leg portion; and a controller, the controller being arranged on the robot, and configured to perform the foregoing method.
In some embodiments, an apparatus for controlling a robot to perform a somersault motion is provided and includes a processor and a memory, the memory storing at least one instruction, at least one program, a code set, or an instruction set, the at least one instruction, the at least one program, the code set, or the instruction set being loaded and executed by the processor to perform the foregoing method.
By using the method for controlling a robot to perform a somersault motion, the robot, and the non-transitory computer-readable storage medium provided by the present disclosure, the robot can better perform the somersault motion, thereby avoiding obstacles.
The following describes the solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. The accompanying drawings and the following description show and describe some of the embodiments within the scope of this disclosure.
As shown in the present disclosure and the claims, words such as “a/an”, “one”, “one kind”, and/or “the” may also include plural forms, unless the context expressly indicates an exception. In general, terms “comprise” and “include” merely indicate including clearly identified steps and elements. The steps and elements do not constitute an exclusive list. A method or a device may also include other steps or elements.
In addition, although the present disclosure makes various references to some modules in the system according to the embodiments of the present disclosure, any quantity of different modules may be used and run on a client and/or a server device. The modules are illustrative, and accordingly may vary.
In addition, flowcharts are used in the present disclosure for illustrating operations performed by the system according to the embodiments of the present disclosure. The foregoing or following operations may be performed in various order, for example in a reverse order, or some operation may be performed simultaneously. Additional operations may be added to the processes or one or more operations may be omitted.
AI involves a theory, a method, a technology, and an application system that use a digital computer or a machine controlled by a digital computer to simulate, extend, and expand human intelligence, perceive environments, obtain knowledge, and use knowledge to obtain an optimal result. In other words, AI is a comprehensive technology in computer science, which attempts to understand the essence of intelligence and produces a new intelligent machine that can react in a manner similar to human intelligence. AI is to study design principles and implementation manners of various intelligent machines, to enable the machine to have the functions of perception, reasoning, and decision-making.
The technical solution of the present disclosure relates to robotics technology in AI technology, especially robot intelligent control. A robot is a type of mechanical and electronic device which takes advantages of mechanical transmission and modern microelectronic technology and can imitate a skill. The robot is developed on the basis of electronic, mechanical and information technologies. The robot can complete tasks and commands given by humans, but does not have to like a human. The robot is a type of automatic machine, which has intelligent abilities similar to human or biological, such as perception ability, planning ability, motion ability and coordination ability. The robot is an automatic machine with high flexibility. As computer technology and artificial intelligence technology advance, the robot has been greatly improved in function and technology level, typical representatives of which include mobile robots as well as robot vision and touch technologies.
The present disclosure relates to an application of AI in robot control. Specifically, the present disclosure provides a robot control method based on AI. The control method enhances the control of the somersault motion of the robot, and determines the torque of each joint and the drive forces of the wheels based on comprehensive consideration of the whole-body dynamics and the set of constraint equations of the robot, thereby realizing the control of the somersault motion of the robot.
The robot may include a base portion and a wheel-leg portion with active wheels (such as feet as the active wheels). The wheel-leg portion with active wheels enables a wheel-legged robot to walk or navigate using the wheel. In some embodiments, the wheel-legged robot may further include a controllable tail, which may be configured to balance the wheel-legged robot and assist the wheel-legged robot to move. For example, the tail can assist the motion of the wheel-legged robot in a flight phase. In some embodiments, the wheel-legged robot may further include controllable mechanical arms, which may be configured to perform tasks, such as lifting or picking objects. The wheel-legged robot may include a bipedal wheel-legged robot, a four-leg wheel-legged robot, and or any other suitable wheel-legged robot.
Based on the above, the present disclosure provides a robot control method. The robot according to the present disclosure can realize autonomic motion control. The robot includes a wheel-leg portion, including at least one joint. The wheel-leg portion refers to a wheeled component used by the robot to realize motion. In some embodiments, the wheel-leg portion includes a left wheel-leg portion and a right wheel-leg portion. The left wheel-leg portion and the right wheel-leg portion each includes at least one joint.
For example, the left wheel-leg portion and the right wheel-leg portion each includes an active wheel, and a leg portion that is connected to a central shaft of the active wheel and is configured to realize motion control of the active wheel. The active wheel may have an active wheel configuration of a single wheel, two wheels, four wheels, and the like. Each active wheel may be controlled by two leg portions connected in parallel or a plurality of leg portions connected in series. The embodiments of the present disclosure are not limited to a type of the left wheel-leg portion and the right wheel-leg portion or a number of the active wheels.
For example, the left wheel-leg portion and the right wheel-leg portion may include the same number of joints and have the same joint configuration. Alternatively, in some embodiments, the left wheel-leg portion and the right wheel-leg portion may include different numbers of joints and have different joint configurations. The embodiments of the present disclosure are not limited to a number of joints and joint configurations of the left wheel-leg portion and the right wheel-leg portion.
In some embodiments, the robot may further include a base portion connected to the wheel-leg portion, and an additional component arranged on the base portion. The base portion refers to a main body portion of the robot, for example, the trunk of the robot. The base portion may be a plane plate-shaped component or a cuboid-shaped component connected to the wheel-leg portion of the robot. In addition, the base portion may be connected to the wheel-leg portion via a bracket. The foregoing description merely provides a structural example of an example robot, and the embodiments of the present disclosure.
The robot control method includes: during a somersault motion of the robot, controlling at least one joint in the wheel-leg portion (and the active wheels), to allow the robot to perform the somersault motion. In a takeoff phase of the somersault motion, a center of mass of the wheel-leg portion is lower than a center of mass of the base portion; in a flight phase of the somersault motion, there is a time at which the center of mass of the wheel-leg portion is higher than the center of mass of the base portion; and in the landing phase of the somersault motion, the center of mass of the wheel-leg portion is lower than the center of mass of the base portion.
Based on the above, the embodiments of the present disclosure improve the motion ability of the robot through the joint control of each joint and the control of the torque of the active wheels of the robot. In particular, the present disclosure can control the robot to perform the somersault in the air in some embodiments so that the robot jumps to a further position with its configuration remaining unchanged, thereby realizing obstacle avoidance or other task requirements.
In some embodiments, the left wheel-leg portion and the right wheel-leg portion each has a single wheel-leg configuration. The single wheel-leg configuration means that the corresponding wheel-leg portion includes a single active wheel.
As shown in
For example, compared with a serial leg structure, the parallel leg structure has stronger rigidity, and therefore can withstand an impact in a motion (such as somersault motion, jumping, and the like) having a flight phase. When in contact with the ground, the active wheels 104 provide the wheel-legged robot 100 with sliding motion capability. In some embodiments, the bipedal wheel-legged robot 100 may further include an additional component 102, which is connected to the base portion 101. A passive wheel 105 may be arranged on the additional component 102. The additional component 102 includes one rotational degree of freedom. The motion of the additional component 102 affects the change of the base portion 101 and the wheel-leg portion 103, such as driving the base portion, to allow it to have a rotational speed. Therefore, balance and pose control of the robot 100 may be realized by adjusting a position of the additional component 102.
Referring to
In the present disclosure, by setting each of the left wheel-leg portion and the right wheel-leg portion to have the single wheel-leg configuration, during the motion of the two-wheeled robot (including two active wheels, corresponding to that the left wheel-leg portion and the right wheel-leg portions each has the single leg configuration), the control over the motion process of the wheel-leg portion of the robot in a vertical direction is enhanced. On one hand, the rotational degree of freedom of the joints of the robot is increased, so that the robot can realize a variety of task functions through different poses and positions. For example, a distance between the center of mass of the wheel-leg portion and the center of mass of the base portion of the robot can be changed by the left wheel-leg portion or the right wheel-leg portion. In addition, the joints in the wheel-leg portion of the robot and any of the active wheels can be controlled so as to allow the robot to perform the somersault motion, thereby realizing obstacle avoidance or other tasks. On the other hand, through the joint control of each joint of the robot and the control of the torques of the active wheels of the robot, the robot can have improved motion capacity, and thereby being able to move along a predetermined somersault motion trajectory with minimum energy consumption.
Referring to
Referring to
Referring to
In the following, the configuration of the robot is further described with reference to
For example, as shown in
The left wheel-leg portion 320 and the right wheel-leg portion 330 being in mirror symmetry refers to that there is a plane about which the left wheel-leg portion 320 and the right wheel-leg portion 330 are symmetrical. In addition, since the left wheel-leg portion 320 and the right wheel-leg portion 330 are mechanisms with parameters, their structural states may change. Therefore, in the embodiments of the present disclosure, the structural states of the left wheel-leg portion 320 and the right wheel-leg portion 330 are not limited to be always in mirror symmetry. For example, in an initial mounting state, the left wheel-leg portion 320 and the right wheel-leg portion 330 are in mirror symmetry; however, as the left wheel-leg portion 320 and the right wheel-leg portion 330 perform asynchronous motions, the left wheel-leg portion 320 and the right wheel-leg portion 330 may not be in mirror symmetry.
For example, the left wheel-leg portion 320 and the right wheel-leg portion 330 may have the same structure. Alternatively, the robot provided by at least one embodiment of the present disclosure may further include more leg mechanisms, such as four parallel leg mechanisms. Except for the left wheel-leg portion 320 and the right wheel-leg portion 330, the remaining parallel leg mechanisms may have the same or mirror-symmetrical structures as the left wheel-leg portion 320 and the right wheel-leg portion 330. The number of the leg mechanisms may vary.
For example, the left wheel-leg portion 320 and the right wheel-leg portion 330 are respectively mounted at two ends of the base portion 101. The mounting positions of the left wheel-leg portion 320 and the right wheel-leg portion 330 on the base portion 101 may vary. The left wheel-leg portion 320 and the right wheel-leg portion 330 each includes at least one joint, and each has the single wheel-leg configuration. In the following, the structure and the joints of the parallel leg mechanisms of the robot are described with the left wheel-leg portion 320 as an example.
For example, as shown in
For example, as shown in
For example, as shown in
With reference to
A first end portion 32211 of the first left leg link 3221 is fixedly connected with the first left leg rotation shaft of the first motor. A second end portion 32212 of the first left leg link 3221 and a first end portion 32221 of the second left leg link 3222 are hinged with each other, and have the same rotation axis, to form a first left leg revolute. A second end portion 32222 of the second left leg link 3222 and a first end portion 32231 of the third left leg link 3223 are hinged with each other, and have the same rotation axis, to form a second left wheel revolute. A second end portion 32232 of the third left leg link 3223 and a first end portion 32241 of the fourth left leg link 3224 are hinged with each other, and have the same rotation axis, to form a third left wheel revolute. A second end portion 32242 of the fourth left leg link 3224 is fixedly connected with the second left leg rotation shaft of the second motor. In this way, the power output apparatus 321 can control the pose of the left wheel-leg portion 320 by driving the linkage assembly to move.
For example, as shown in
For example, the first left leg link 3221, the second left leg link 3222, the third left leg link 3223, the fourth left leg link 3224, and a connecting line 3225 (dotted line in the figure, which may be called a base link 3225) between a center of the first left leg rotation shaft 32110 and a center of the second left leg rotation shaft 32120 together form a planar five-link mechanism. The first end portion 32211 of the first left leg link 3221 (or the first left leg rotation shaft) and the second end portion 32242 of the fourth link (or the second left leg rotation shaft) are fixed in a XY plane. In addition, the first left leg link 3221 is rotatable around the first left leg rotation shaft 32110 under the driven action of the first left leg rotation shaft, and the fourth left leg link 3224 is rotatable around the second left leg rotation shaft under the driven action of the second left leg rotation shaft. Therefore, in the planar five-link mechanism, the first left leg link 3221 and the fourth left leg link 3224 are driving links, the second left leg link 3222 and the third link 3223 are driven links, and the base link 3225 (the connecting line 3225 between the center of the first left leg rotation shaft 32110 and the center of the second left leg rotation shaft 32120, which is the broken line in the figure) is a fixed link.
For example, the first left leg link 3221 and the fourth left leg link 3224 are located in the same plane perpendicular to an axis of the left active wheel 323. In a direction perpendicular to the axis of the left active wheel 323, the second left leg link 3222 is located between the first left leg link 3221 and the left active wheel 323; the third left leg link 3223 is located at a side of the left active wheel 323 away from the second left leg link 3222; a third motor is fixedly connected with the third left leg link 3223, and is located at a side of the third left leg link 3223 away from the left active wheel 323.
In the direction perpendicular to the axis of the left active wheel 323, the relative positions of the first left leg link, the second left leg link, the third left leg link and the fourth left leg link are interchangeable, as long as the planar five-link mechanism can be formed. For example, the third left leg link 3223 may be located at a side of the second left leg link 3222 close to the left active wheel 323. The third motor may be fixedly connected to the second left leg link 3222, and located at a side of the second left leg link 3222 away from the left active wheel 323.
Similar to the left wheel-leg portion, the right wheel-leg portion includes: a first right leg link, a second right leg link, a third right leg link, and a fourth right leg link. A first end portion of the first right leg link is connected with the base portion. A second end portion of the first right leg link is hinged with a first end portion of the second right leg link, to form a first right leg revolute. A second end portion of the second right leg link is connected with the right active wheel. A first end portion of the third right leg link is connected with the right active wheel. A second end portion of the third right leg link is hinged with a first end portion of the fourth right leg link, to form a second right leg revolute. A second end portion of the fourth right leg link is connected with the base portion. The right wheel-leg portion may have a similar configuration and motion mode with the left wheel-leg portion.
As described above, the robot 100 has the foregoing mechanical structure, and there is a linkage relationship between the joints. The motion instruction may include additional information to allow the robot to better complete the somersault motion (such as flipping to a desired height and jumping to a desired distance with less energy consumption).
In order to further control the robot with the foregoing mechanical structure, an equivalent model of the robot may be designed based on the foregoing mechanical structure. For example, the robot may be equivalent to different multi-rigid body models. In some embodiments, these multi-rigid body models may be further simplified to plane models. For example, the multi-rigid body models may be a variable-leg-length wheeled inverted pendulum model, and another embodiment of the multi-rigid body models may be a plane-with-floating-base whole-body dynamic model. The model type may vary. In the following, the variable-leg-length wheeled inverted pendulum model is described with reference to
For example, the motion instruction includes target motion parameters corresponding to different times in the somersault motion of the robot, so as to allow the robot to move along a target trajectory. Further, the motion instruction is obtained through whole-body dynamics planning. The whole-body dynamics may further plan the motion instruction based on the variable-leg-length wheeled inverted pendulum model and/or the plane-with-floating-base whole-body dynamic model, so that the robot can move along the target trajectory at each time in the motion.
For example, the whole-body dynamics planning may correspond to a dynamic model and a set of constraint equations of the robot. The dynamic model and the set of constraint equations of the robot are associated with a somersault initial target state and a somersault final target state.
For example, the whole-body dynamics control may be based on the set of constraint equations corresponding to the robot. The set of constraint equations includes at least one of the following: a motion state equation, configured for constraining that a motion between the robot and the bearing surface in the takeoff phase and the landing phase is pure rolling, and configured for constraining that there is no interactive force between the robot and the bearing surface in the flight phase; a friction constraint equation, configured for constraining that a bearing surface reaction force meets a friction cone; an anti-collision constraint equation, configured for constraining the mechanisms of the wheel-legged robot other than the active wheel from colliding with the bearing surface; a boundary constraint equation, configured for constraining an upper limit value and a lower limit value of a state quantity of the wheel-legged robot, and an upper limit value and a lower limit value of a control quantity of the wheel-legged robot, a state quantity constraint being configured for constraining the state quantity of the wheel-legged robot; and a continuity constraint equation, configured for constraining an inelastic collision between the wheel-legged robot and the bearing surface in the landing phase.
For example, the set of constraint equations further includes: a joint control constraint, configured for constraining a constraint relationship between a motion state corresponding to the robot and a motion state of each joint of the robot.
For example, step S202 may further include: determining an actual control signal for controlling the at least one joint, based on the whole-body dynamics control and according to parameter differences between actual motion parameters of the robot in the somersault motion and the target motion parameters, to regress the actual motion parameters of the robot toward the target motion parameters.
In the following, with reference to
As described above, in some embodiments, the motion instruction is designed based on the variable-leg-length wheeled inverted pendulum model 400. The variable-leg-length wheeled inverted pendulum model includes: a virtual leg 402 with a variable leg length, a virtual active wheel 401 connected to a first end of the virtual leg 402, and a virtual base portion 403 connected to a second end of the virtual leg. With referenced to
In some embodiments, the variable-leg-length wheeled inverted pendulum model 400 further includes a virtual tail 404, which is equivalent to the additional component. The virtual tail may be used as a floating base, so that the robot can be simplified to a plane model with a floating base, thereby reducing complexity of the motion planning problem. If the additional component is fixed, the additional component and the base portion may be simplified to a single rigid body. If the additional component moves, the additional component may be used as a rigid body connected to the base portion. The additional component may be configured to adjust the pose of the robot. In some embodiments, the additional component may be used to adjust balance of the robot during the motion of the robot.
Therefore, for example, referring to
Further, the dynamic model corresponding to the variable-leg-length wheeled inverted pendulum model may be constructed based on at least one of the following: a mass mw and an inertia Iw of the active wheel 401, a radius r of the active wheel 401, a total mass mb and a total inertia Ib of the base portion 403 and the additional component 404, relative positions hx and hz of the centers of the additional component 404 and the base portion 403, a mass mt and an inertia It of the additional component 404, a distance ct from a center of mass to a drive joint of the additional component 404, a length It and a rotated angle qt of the additional component 404.
The generalized coordinates may include a position parameter (such as the position of the active wheel), a rotation parameter (such as the rotated angle of the active wheel), and the like of the variable-leg-length wheeled inverted pendulum model. A pose (namely position and pose) of the variable-leg-length wheeled inverted pendulum model can be described using these parameters. For example, the relationship between the foregoing parameters in the world coordinate system and the generalized coordinate system may be described in the following manner.
When there is no additional component, the generalized coordinates may be expressed as follows:
q=(x, z, ϕ,l, θ)T Equation (4-1)
Where q is the generalized coordinates of the variable-leg-length wheeled inverted pendulum model.
The control quantity may be expressed as follows:
u=(τw, ƒl)T Equation (4-2)
Where u is the control quantity of the variable-leg-length wheeled inverted pendulum model, τw is the execution torque of the virtual active wheel 401, and ƒl is a main power of the virtual leg 402.
The bearing surface reaction force may be expressed as follows:
ƒc=(ƒc,x, ƒc,z)T Equation (4-3)
Where ƒc is the bearing surface reaction force of the variable-leg-length wheeled inverted pendulum model.
When there is an additional component, the generalized coordinates may be expressed as follows:
q=(x, z, ϕ,l, θ, qt)T Equation (4-4)
The control quantity may be expressed as follows:
u=(τw, ƒl, τt)T Equation (4-5)
Where τw is the execution torque of the virtual active wheel 401, ƒl is the main power of the virtual leg 402, and τt is an execution torque of a drive motor of the virtual tail 404.
The bearing surface reaction force may be expressed as follows:
ƒc=(ƒx, ƒz)T Equation (4-6)
In the following, according to the foregoing relationship, construction processes of the dynamic model corresponding to the variable-leg-length wheeled inverted pendulum model in the takeoff phase, the flight phase and the landing phase are described with reference to
In some embodiments, the motion instruction is designed based on the plane-with-floating-base whole-body dynamic model 500. The plane-with-floating-base whole-body dynamic model includes a virtual front leg 501, a virtual back leg 502, a virtual active wheel 503 connected with a first end of the virtual front leg and a first end of the virtual back leg, and a virtual base portion 504 connected with a second end of the virtual front leg and a second end of the virtual back leg. The virtual front leg and the virtual back leg are equivalent to the joints and the links in the wheel-leg portion. The virtual active wheel is equivalent to the active wheels in the wheel-leg portion. The virtual base portion is equivalent to the base portion.
In some examples, the plane-with-floating-base whole-body dynamic model further includes a virtual tail (not shown), which is equivalent to the additional component. The virtual tail may be used as a floating base, so that the robot can be simplified to a plane model with a floating base, thereby reducing complexity of the motion planning problem.
For example, when the plane-with-floating-base whole-body dynamic model does not include the virtual tail, the virtual base portion may be simplified to a single rigid body. Since the wheel-leg portion is relatively light, the wheel-leg portion may be simplified to two motion chains, and the two motion chains are closed at the virtual active wheel. When the robot includes the additional component and the additional component is fixed, the additional component and the base portion may be simplified to a single rigid body. When the robot includes the additional component and the additional component moves, the additional component may be used as a rigid body connected to the base portion.
Therefore, the dynamic model corresponding to the plane-with-floating-base whole-body dynamic model may be constructed based on at least one of the following: a center position of the virtual base portion, a rotated angle of the virtual active wheel, a pose of the virtual front leg, a pose of the virtual back leg, a pitch angle of the virtual base portion, an execution torque of the virtual active wheel, a rotational torque at a connection between the virtual legs and the virtual base portion, a friction force and a support force of the bearing surface to the plane-with-floating-base whole-body dynamic model.
For example, referring to
The virtual front leg includes a virtual front thigh and a virtual front calf. The virtual back leg includes a virtual back thigh and a virtual back calf. mFH, IFH, CFH, lFH, qFH respectively represent a mass of the virtual front thigh, an inertia of the virtual front thigh, a position of a center of mass of the virtual front thigh relative to the joint, a length of the virtual front thigh, and a rotated angle of the virtual front thigh. Similarly, mFK, IFK, CFK, lFK, qFK, mBH, IBH, CBH, lBH, qBH, and mBK, IBK, CBK, lBK, qBK represent related variables of the virtual front calf, the virtual back thigh, and the virtual back calf. mw, Iw, qw, r respectively represent a mass, an inertia, a rotated angle, and a radius of the virtual active wheel. The dashed line between the ends of the virtual front calf and the virtual back calf in the figure indicates that the two points are coincided in the actual motion, and a length of the dashed line is 0, forming a closed-loop constraint.
For example, the relationship between the foregoing parameters in the world coordinate system and the generalized coordinate system may be described in the following manner.
When there is no additional component, the generalized coordinates may be expressed as follows:
q=(x,z, θ, qFH, qFK, qBH, qBK, qw)T Equation (5-1)
Where q is the generalized coordinates of the plane-with-floating-base whole-body dynamic model.
The control quantity may be expressed as follows:
u=(τFH, τBH, τw)T Equation (5-2)
Where u is the control quantity of the plane-with-floating-base whole-body dynamic model, τw is the execution torque of the virtual active wheel 503, τFH is an execution torque of the joint of the virtual front thigh and the virtual base portion, and τBH is an execution torque of the joint of the virtual back thigh and the virtual base portion.
The bearing surface reaction force may be expressed as follows:
ƒc=(ƒc,x, ƒc,z)T Equation (5-3)
Where ƒc is the bearing surface reaction force of the plane-with-floating-base whole-body dynamic model.
A closed-loop force may be expressed as follows:
ƒL=(ƒL,x,ƒL,z)T Equation (5-4)
Where ƒL,x, ƒL,z are the closed-loop forces in the x-direction and the z-direction respectively.
Similarly, when there is the additional component, the relationship between the parameters corresponding to the plane-with-floating-base whole-body dynamic model may be further designed with reference to the relevant equations for designing the virtual tail as shown in
In the following, according to the foregoing relationship, construction processes of the dynamic model corresponding to the plane-with-floating-base whole-body dynamic model in the takeoff phase, the flight phase and the landing phase are described with reference to
The following describes in stages, how to realize, under the assumptions of the two different models, the control during the somersault motion by controlling the joints and designing the motion instruction.
Referring to
As shown in
For example, through the control of the active wheels in the wheel-leg portion by the motion instruction, the robot may accelerate in a horizontal positive direction corresponding to the takeoff direction. For example, in some embodiments, at a middle of the takeoff phase, the motion instruction may instruct to control the active wheels to rotate in the same direction as the takeoff direction. As such the robot is able to accelerate in the horizontal positive direction corresponding to the takeoff direction, to ensure a large forward acceleration when jumping off the ground, which helps to cross obstacles.
For example, the joints in the wheel-leg portion that are connected to the base portion are controlled by the motion instruction, so as to allow the robot to accelerate vertically upward and accelerate in the horizontal positive direction corresponding to the takeoff direction. For example, in some embodiments, at an end of the takeoff phase, the motion instruction controls the power output apparatus in the base portion, to adjust the first left leg link and the fourth left leg link to rotate in a direction away from each other, thereby realizing the effect of extending legs.
In some embodiments, the white stick as shown in
In order to design the motion instruction that can realize the foregoing control mode, the corresponding dynamic model and the set of constraint equations may be further designed according to the variable-leg-length wheeled inverted pendulum model and the plane-with-floating-base whole-body dynamic model.
When the motion instruction is designed according to the variable-leg-length wheeled inverted pendulum model as shown in
Based on the generalized coordinates and the generalized velocity, a total kinetic energy E and a total potential energy V corresponding to the robot are calculated, and the Lagrangian of the system may be expressed as L=E-V. In the takeoff phase, the robot includes an internal force and an external force (such as the bearing surface reaction force). According to the Lagrangian Equation, the dynamic model corresponding to the takeoff phase may be obtained as follows:
D(q){umlaut over (q)}+C(q, {dot over (q)}){dot over (q)}+G)q)=Stu+JcTƒc Equation (4-7)
Where q represents the generalized coordinates, {dot over (q)} represents the generalized velocity corresponding to the generalized coordinates, {umlaut over (q)} represents a generalized acceleration corresponding to the generalized coordinates, u represents the control quantity of the robot, D represents an inertia matrix, C represents a centrifugal force and a Coriolis force vector, G represents a gravity vector,
represents a selection matrix, and
represents a Jacobian matrix of a contact point between the virtual active wheel and the bearing surface of the robot, nc=[nc,1 nc,2]T represents a unit outer normal vector of the contact point between the virtual active wheel and the bearing surface, nc,1 and nc,2 represent parameters in the unit outer normal vector.
In the takeoff phase, it is assumed that there is pure rolling between the virtual active wheel and the bearing surface, an acceleration of the contact point between the virtual active wheel and the bearing surface in the world coordinate system is as follows:
Jc{umlaut over (q)}+{dot over (J)}c{dot over (q)}=0 Equation (4-8)
By combining Equation (4-7) and Equation (4-8), the following is obtained:
Since D(q) is a square matrix and full rank, and Jc is full row rank, it can be determined that the first item on the left side of Equation (4-9) is full rank. Then, the generalized acceleration and bearing surface reaction force may be expressed as follows:
The state quantity of the robot is taken as x=[qT {dot over (q)}T]T, and the dynamic constraint equation in the takeoff phase may be expressed as follows:
Where AupA is the first n rows of a matrix A, b is a matrix, n is the number of parameters in the generalized coordinates of the robot, {dot over (x)} is a derivative of the state quantity of the robot, q is the generalized coordinates, {dot over (q)} is the generalized velocity corresponding to the generalized coordinates, and {umlaut over (q)} is the generalized acceleration corresponding to the generalized coordinates.
Further, at any time tin the takeoff phase, the dynamic constraint equation may be expressed as follows:
A derivation process of the friction constraint equation may be as follows.
Based on the assumption of pure rolling, the bearing surface reaction force meets a friction cone constraint. By linearizing the bearing surface reaction force, the friction constraint equation is obtained, which may be expressed as follows:
Where Adown is the last two rows of the matrix A, m is a product of the number of contact points between the virtual active wheel and the bearing surface and the dimension of the world coordinate system (for example, when one contact point between the robot and the bearing surface, m=2; and when two contact points between the robot and the bearing surface, m=4), μ is a friction factor, nc is the unit outer normal vector of the contact point between the robot and the bearing surface, oc is the unit tangent vector of the contact point, q is the generalized coordinates of the robot, {dot over (q)} is the generalized velocity corresponding to the generalized coordinates, and {umlaut over (q)} is the generalized acceleration corresponding to the generalized coordinates.
Further, at any time tin the takeoff phase, the friction constraint equation may be expressed as follows:
A derivation process of the anti-collision constraint equation may be as follows:
When the variable-leg-length wheeled inverted pendulum model does not include the virtual tail connected to the virtual base portion or the virtual tail is fixed, in the takeoff phase, the virtual base portion, the virtual leg and the virtual active wheel of the robot cannot get embedded inside the ground, so the anti-collision constraint equation may be obtained as follows:
z+αl cos(θ) ≥hm(x+lsin(θ)), z+r cos(β) ≥hm(x+rsin(β)) Equation (4-15)
Where α∈[0,1], β∈[0,2π], z represents the coordinate of the virtual active wheel of the robot in the z-axis direction of the world coordinate system, x represents the coordinate of the virtual active wheel in the x-axis direction of the world coordinate system, l is the length of the virtual leg, θ is the pitch angle of the virtual base portion in the world coordinate system, r is the radius of the virtual active wheel, hm represents a height function of any point in the world coordinate system, α and β represent range parameters.
Further, at any time tin the takeoff phase, the anti-collision constraint equation may be expressed as follows:
z(t)+αl(t) cos(θ(t))≥hm(x(t)+l(t) sin(θ(t))), α∈[0,1]z(t)+rcos(β)≥hm(x(t)+r sin(β)), β∈[0,2π] Equation (4-16)
When the variable-leg-length wheeled inverted pendulum model includes the virtual tail and the virtual tail moves, in the takeoff phase, the virtual base portion, the virtual leg, the virtual active wheel and the virtual tail of the robot cannot get embedded inside the ground, so the anti-collision constraint equation may be obtained as follows:
z(t)+αl(t) cos(θ(t)) ≥hm(x(t)+l(t) sin(θ(t))), α∈[0,1]z+r cos(β) ≥hm(x+rsin(β)), β∈[0,2π]pt,z+α(pt,e,z−pt,z)≥hm(pt,x+α(pt,e,x−pt,x)), α∈[0,1] Equation (4-17)
Where z represents the coordinate of the virtual active wheel in the z-axis direction of the world coordinate system, x represents the coordinate of the virtual active wheel in the x-axis direction of the world coordinate system, l represents the length of the virtual leg of the robot, θ(t) represents the pitch angle of the virtual base portion at time tin the world coordinate system, r represents the radius of the virtual active wheel, hm represents a height function of any point in the world coordinate system, α and β represent range parameters, pt,z represents the coordinate of the drive joint of the virtual tail (namely the joint connected to the virtual tail and the virtual base portion) in the z-axis direction of the world coordinate system, pt,x represents the coordinate of the drive joint of the virtual tail in the x-axis direction of the world coordinate system, pt,e,z represents the coordinate of the end of the virtual tail in the z-axis direction of the world coordinate system, and pt,e,x represents the coordinate of the end of the virtual tail in the x-axis direction of the world coordinate system.
When the state quantity constraint limits the state quantity of the target time, the state quantity of the robot at the time may be constrained based on the state quantity constraint at the time.
The boundary constraint equation may be expressed as follows:
xmin≤x(t)≤xmax umin≤u(t) ≤umax Equation (4-18)
Where xmax and xmin respectively represent an upper limit value and a lower limit value of the state quantity corresponding to the somersault motion, umax and umin respectively represent an upper limit value and a lower limit value of the control quantity corresponding to the somersault motion, and x(t) represents the state quantity constraint at time t.
In some embodiments, it is assumed that the state quantity constraint limits that an initial state quantity corresponding to the somersault motion is x1,s, then at a start time of the takeoff phase, the state quantity of the robot meets the constraint: x(t)=x1,s, t=t1,s, where t1,s represents the start time of the takeoff phase.
The continuity constraint equation between the takeoff phase and the flight phase may be expressed as follows:
x1,e=x2,s Equation (4-19
Where x1,e and x2,s respectively represent the state quantity at an end time of the takeoff phase and the state quantity at a start time of the flight phase.
According to the foregoing equations, it can be solved that, corresponding to some embodiments, at the start of the takeoff phase, the torque direction of the virtual active wheel corresponds to the opposite direction of the takeoff direction, so that the central axis of the robot is inclined to the horizontal direction corresponding to the takeoff direction (that is, θ as shown in
When the motion instruction is designed according to the plane-with-floating-base whole-body dynamic model as shown in
Based on the generalized coordinates and the generalized velocity, a total kinetic energy E and a total potential energy V corresponding to the robot are calculated, and the Lagrangian of the system may be expressed as L=E-V. In the takeoff phase, the robot includes an internal force and an external force (such as the bearing surface reaction force). According to the Lagrangian Equation, the dynamic model corresponding to the takeoff phase may be obtained as follows:
D(q){umlaut over (q)}+C(q,{dot over (q)}){dot over (q)}+G(q)=STu+JcTƒc+JLTƒL Equation (5-5)
Where q represents the generalized coordinates, {dot over (q)} represents the generalized velocity corresponding to the generalized coordinates, {umlaut over (q)} represents a generalized acceleration corresponding to the generalized coordinates, u represents the control quantity of the robot, D represents an inertia matrix, C represents a centrifugal force and a Coriolis force vector, G represents a gravity vector, S represents a transformation matrix, Jc represents a Jacobian matrix of a contact point between a wheel (the active wheel) and the ground (the bearing surface), and JL represents a difference between Jacobi matrices of end points of the virtual front calf and the virtual back calf.
In the takeoff phase, it is assumed that there is pure rolling between the virtual active wheel and the bearing surface, an acceleration of the contact point between the virtual active wheel and the bearing surface in the world coordinate system is as follows:
Jc{umlaut over (q)}+{dot over (J)}c{dot over (q)}=0 Equation (5-6)
Since the virtual front calf and the virtual back calf are fixedly connected to the virtual active wheel with no separation, an acceleration difference of a virtual closed point (a connection point of the virtual front calf and the virtual back calf) is 0, namely,
JL{umlaut over (q)}+{dot over (J)}L{dot over (q)}=0 Equation (5-7)
With combination of Equation (5-5), the following may be obtained:
Since D(q) is a square matrix and full rank, Jc, JL are full row rank, it can be determined that the first item on the left in Equation (5-8) is full rank. Then, the generalized acceleration, the closed-chain contact force and the bearing surface reaction force may be expressed as follows:
The state quantity of the robot is taken as x=[qT{dot over (q)}T]T, and the dynamic constraint equation in the takeoff phase may be expressed as follows:
Where A1,up represents the first n rows of the matrix A1 on the right of Equation (5-9), n is the number of parameters in the generalized coordinates of the robot, {dot over (x)} is a derivative of the state quantity of the robot, q is the generalized coordinates, {dot over (q)} is the generalized velocity corresponding to the generalized coordinates, and {umlaut over (q)} is the generalized acceleration corresponding to the generalized coordinates.
Further, at any time tin the takeoff phase, the dynamic constraint equation may be expressed as follows:
A derivation process of the friction constraint equation may be as follows.
Based on the assumption of pure rolling, the bearing surface reaction force meets the friction cone constraint. By linearizing the bearing surface reaction force, the friction constraint equation is obtained, which may be expressed as follows:
Where A1,down is the last two rows of the matrix A1 on the right of Equation (5-9), μ is the friction factor, nc is the unit outer normal vector of the contact point between the robot and the bearing surface, and oc is the unit tangent vector of the contact point.
A derivation process of the anti-collision constraint equation may be as follows.
In When the plane-with-floating-base whole-body dynamic model does not include the virtual tail connected to the virtual base portion or the virtual tail is fixed, in the takeoff phase, the virtual base portion, the virtual leg and the virtual active wheel of the robot cannot get embedded inside the ground, so the anti-collision constraint equation may be obtained as follows:
pj,z+α(pk,z−pj,z)≥hm(pk,x+α(pj,x−pk,x)), Equation (5-13)
z+r cos(β)≤hm(x+rsin(β)), Equation (5-14)
Where α∈[0,1], j, k ∈[1,6], k,j are the numbers of two adjacent joints, (pj,x, pj,z) (pk,x, pk,z) are the coordinates of the two adjacent joints in the world coordinate system, pj,z is the coordinate of the joint j in the world coordinate system, pj,x is the coordinate of the joint j on the x-axis of the world coordinate system, pk,z is the coordinate of the joint k on the z-axis of the world coordinate system, pk,x is the coordinate of the joint k on the x-axis of the world coordinate system x-axis, r is the radius of the virtual active wheel, hm is the height function of any point in the world coordinate system, α and β are range parameters.
Further, at any time tin the takeoff phase, the anti-collision constraint equation may be expressed as follows:
p(t)j,z+α(p(t)k,z−p(t)j,z)≥hm(p(t)k,x+α(p(t)j,x−p(t)k,x)), z(t)+rcos(β)≥hm(z(t)+r sin(β), Equation (5-15)
Where β∈[0,2π], α∈[0,1], j,k ∈[1,6]. When the plane-with-floating-base whole-body dynamic model includes the virtual tail and the virtual tail moves, the anti-collision between the tail and the ground may be considered. With reference to Equation (5-15), the anti-collision constraint equation can be similarly solved.
The larger one of the lower limit value of the state quantity and the lower limit value corresponding to the state quantity constraint may be taken as the lower limit value of the state quantity during the somersault motion, and the smaller one of the upper limit value of the state quantity and the upper limit value corresponding to the state quantity constraint may be taken as the upper limit value of the state quantity during the somersault motion. When the state quantity constraint limits the state quantity of the target time, the state quantity of the robot at this time may be constrained based on the state quantity constraint at this time.
The boundary constraint equation at the start time of the takeoff phase may be expressed as follows:
x(t)=x1,s, t=t1,s Equation (5-16)
Where t1,s is the start time of the takeoff phase. The state quantity and the control quantity of the robot in the takeoff phase are further described by:
xmin≤x(t)≤xmax
min≤u(t)≤umax Equation (5-17)
Where xmax and xmin respectively represent the upper limit value and the lower limit value of the state quantity corresponding to the somersault motion, umax and umin respectively represent the upper limit value and the lower limit value of the control quantity corresponding to the somersault motion, and x(t) represents the state quantity at the time t.
The continuity constraint equation between the takeoff phase and the flight phase may be expressed as follows:
x(t1,e)=x(t2,s) Equation (5-18)
Where t1,e and t2,s respectively represent an end time of the takeoff phase and a start time of the flight phase.
According to the foregoing equations, it can be solved that, corresponding to some embodiments, at the start of the takeoff phase, the torque direction of the virtual active wheel corresponds to the opposite direction of the takeoff direction, so that the central axis of the robot is inclined to the horizontal direction corresponding to the takeoff direction (that is, θ as shown in
Referring to
As shown in
For example, in some embodiments, at a start of the flight phase, the motion instruction may instruct to control the joints in the wheel-leg portion that are connected to the base portion, so as to shorten a distance between the center of mass of the wheel-leg portion and the center of mass of the base portion. The robot may change from the pose of extending legs to the pose of retracting legs. Under the condition of conservation of angular momentum, the rotational inertia is reduced and the rotational angular velocity is increased, which facilitates control of the somersault motion, and realize a higher height in the somersault motion.
As shown in
For example, in some embodiments, at a middle of the flight phase, the motion instruction may instruct to control the joints in the wheel-leg portion that are connected to the base portion, so as to maintain the distance between the center of mass of the wheel-leg portion and the center of mass of the base portion at a relatively short distance, thereby allowing the robot to perform the somersault motion at a relatively great angular velocity.
For example, in some embodiments, at an end of the flight phase, the motion instruction controls the joints in the wheel-leg portion that are connected to the base portion, to increase the distance between the center of mass of the wheel-leg portion and the center of mass of the base portion, thereby realizing the effect of extending legs. The pose of extending legs is conducive to landing buffer.
For example, in some embodiments, when there is the additional component, during rotation of the additional component, an included angle between the central axis of the additional link and the perpendicular bisector of the base portion is gradually increased and then gradually decreased. At the start of the flight phase, the robot throws out the additional component, so as to provide a greater kinetic energy with the additional component. Then, after the flight phase, the additional component is retracted, to reduce the rotational inertia and increase the rotation angular velocity, which facilitates the completion of the somersault motion.
In order to design the motion instruction that can realize the foregoing control mode, the corresponding dynamic model and the set of constraint equations may be further designed according to the variable-leg-length wheeled inverted pendulum model and the plane-with-floating-base whole-body dynamic model.
When the motion instruction is designed according to the variable-leg-length wheeled inverted pendulum model as shown in
Similarly, based on the generalized coordinates and the generalized velocity, the total kinetic energy E and the total potential energy V corresponding to the robot are calculated, and the Lagrangian of the system may be expressed as L=E-V. In the flight phase, the robot includes no external force (such as the bearing surface reaction force), and according to the Lagrangian Equation, the dynamic equation corresponding to the flight phase may be obtained:
D(q){umlaut over (q)}+C(q, {dot over (q)}){dot over (q)}+G(q)=STu Equation (4-21)
Therefore, the dynamic constraint equation corresponding to the flight phase is expressed as follows:
Where {dot over (x)} represents a derivative of the state quantity of the robot, q represents the generalized coordinates of the robot, {dot over (q)} represents the generalized velocity corresponding to the generalized coordinates, {umlaut over (q)} represents the generalized acceleration corresponding to the generalized coordinates, u represents the control quantity of the robot, D is the inertia matrix, C is the centrifugal force and Coriolis force vector, G is the gravity vector, and S represents the selection matrix.
Further, at any time tin the flight phase, the dynamic constraint equation may be expressed as follows:
(t)=ƒ(t,q,{dot over (q)},u) Equation (4-23)
In the flight phase, since the robot is out of contact with the bearing surface, the flight phase does not involve the friction constraint equation. The anti-collision constraint equation in the flight phase is the same as that in the takeoff phase.
A derivation process of the continuity constraint equation between the flight phase and the landing phase may be as follows.
In the landing phase, it is assumed that there is an inelastic collision between the robot and the bearing surface, that is, the collision is completed in an instant. According to the law of conservation of momentum, the state quantity after the collision and the state quantity before the collision may satisfy the following relationship:
D(q3,s){dot over (q)}3,s−D(q2,e){dot over (q)}2,e=Jc(q3,s)Tƒc Equation (4-24)
Where {dot over (q)}2,e represents the generalized velocity at an end time of the flight phase, q2,e represents the generalized coordinates at the end time of the flight phase, q3,s represents the generalized coordinates at a start time of the landing phase, 43,s represents the generalized velocity at the start time of the landing phase, and q2,e=q3,s{dot over (q)}2,e≠{dot over (q)}3,s.
At the start time of the landing phase, a velocity of the contact point between the active wheel and the receiving surface is 0, then:
Jc(q3,s){dot over (q)}3,s=0 Equation (4-25)
From the above, the following may be obtained:
Since D(q2,e) is a square matrix and full rank, and Jc(q2,e) is full row rank, it can be determined that the first item on the left side of Equation (4-26) is full rank. Then, at the start time of the landing phase, the generalized velocity and the bearing surface reaction force may be expressed as follows:
The continuity constraint equation between the flight phase and the landing phase may be expressed as follows:
Where matrix matrix
matrix
Qupp represents a product of the first n rows of the matrix Q and the matrix p, n is the number of parameters in the generalized coordinates of the robot, q3,s represents the generalized coordinates of the robot at the start time of the landing phase, {dot over (q)}3,s represents the generalized velocity of the robot at the start time of the landing phase, q2,e represents the generalized coordinates of the robot at the end time of the flight phase, {dot over (q)}2,e represents the generalized velocity of the robot at the end time of the flight phase, D is the inertia matrix, and Jc represents the Jacobian matrix of the contact point between the virtual active wheel and the bearing surface.
According to the foregoing equations, it can be solved that, corresponding to some embodiments, at the start of the flight phase, the length of the virtual leg is decreased (similar to the process of retracting legs), so as to produce a greater acceleration in the takeoff direction. When there is the virtual tail, the additional component rotates in the rotational direction corresponding to the takeoff direction. In addition, during the rotation of the additional component, the included angle between the central axis of the additional link and the perpendicular bisector of the base portion is gradually decreased, so as to realize the process of retracting the virtual tail. At the end of the flight phase, the length of the virtual leg is increased, to achieve the effect of extending legs. The pose of the extending legs is conducive to landing buffer.
When the motion instruction is designed according to the plane-with-floating-base whole-body dynamic model as shown in
Similarly, based on the generalized coordinates and the generalized velocity, the total kinetic energy E and the total potential energy V corresponding to the robot are calculated, and the Lagrangian of the system may be expressed as L=E-V. In the flight phase, since the robot includes no external force (such as the bearing surface reaction force), but a closed-loop constraint is desired, the dynamic equation corresponding to the flight phase may be obtained according to the Lagrangian equation:
Since D(q) is a square matrix and full rank, JL is full row rank, it can be determined that the first term on the left side of Equation (5-19) is full rank. Then, the acceleration and the closed-loop contact force in the generalized coordinates may be obtained as follows:
The state quantity is taken as x=[qT {dot over (q)}T]T, so the dynamic constraint in the flight phase may be expressed as follows:
Where A2,up is the first n rows of the matrix A2 on the right of Equation (5-20), and n is the number of generalized coordinates. Therefore, at any time t during the flight, the dynamic constraint is as follows:
In the flight phase, since the robot is out of contact with the bearing surface, the flight phase does not involve the friction constraint equation. The anti-collision constraint equation in the flight phase is the same as that in the takeoff phase. A derivation process of the continuity constraint equation between the flight phase and the landing phase may be as follows.
In the landing phase, it is assumed that there is an inelastic collision between the robot and the bearing surface, that is, the collision is completed in an instant. According to the law of conservation of momentum, the state quantity after the collision and the state quantity before the collision may satisfy the following relationship:
D(q3,s){dot over (q)}3,s−D(q2,e){dot over (q)}2,e=Jc(q3,s)Tc+JL(q3,s)TƒL Equation (5-23)
Where {dot over (q)}2,e represents the generalized velocity at the end time of the flight phase, q2,e represents the generalized coordinates at the end time of the flight phase, q3,s represents the generalized coordinates at the start time of the landing phase, {dot over (q)}3,s represents the generalized velocity at the start time of the landing phase, and q2,e=q3,s, {dot over (q)}2,e≠{dot over (q)}3,s.
In addition, the start time of the landing phase meets the closed-loop constraint, and the velocity of the contact point between the wheels and the ground is 0, so JL(q3,s){dot over (q)}3,s0 and Jc(q3,s) {dot over (q)}3,2=0.
From the above, the following may be obtained:
Therefore, the generalized velocity at the start time of the landing phase obtained according to the inelastic collision is:
The continuity constraint between the flight phase and the landing phase is:
Where Qup is the first n rows of the matrix Q on the right side of Equation (5-25), and n is the number of the generalized coordinates.
According to the foregoing equations, it can be solved that, corresponding to some embodiments, at the start of the flight phase, the included angle between the virtual thigh and the virtual calf is reduced (similar to the process of retracing legs), so that the rotational inertia of the robot is reduced, thereby producing a greater rotation velocity. When there is the virtual tail, the additional component rotates in the rotational direction corresponding to the takeoff direction. In addition, when the additional component includes the first link and the second link connected by the passive wheel, the included angle between the first link and the second link is gradually decreased during the rotation of the additional component, which realizes the process of retracting the virtual tail. At the end of the flight phase, the included angle between the virtual thigh and the virtual calf is increased (similar to the process of extending legs), which achieves the effect of extending legs. The pose of extending legs is conducive to landing buffer.
Referring to
As shown in
For example, in some embodiments, at a start of the landing phase, the motion instruction may instruct to control the joints in the wheel-leg portion that are connected to the base portion, so as to shorten a distance between the center of mass of the wheel-leg portion and the center of mass of the base portion. The robot may change from the pose of extending legs to the pose of retracting legs, thereby reducing the impact of landing.
For example, in some embodiments, at an end of the landing phase, the motion instruction controls the joints in the wheel-leg portion that are connected with the base portion and the active wheel, to allow the connecting line between the center of the active wheel in the wheel-leg portion and the center of the base portion to be coincided with the perpendicular bisector of the base portion, thereby realizing the balanced and upright state.
In order to design the motion instruction that can realize the foregoing control mode, the corresponding dynamic model and the set of constraint equations may be further designed according to the variable-leg-length wheeled inverted pendulum model and the plane-with-floating-base whole-body dynamic model. The dynamic model and the constrains in the landing phase are similar to those in the takeoff phase.
The following describes a process of setting the joint control constraint of the robot. The process of joint control constraint is described with reference to the example model as shown in
In the process of setting the joint control constraint function of the robot, first, the dynamic model of the robot is established, and a constraint relationship between an acceleration for each sub-task control (such as the dynamic constraint, the friction constraint, the collision constraint, and the like in the different phases) and an actual input joint torque is established.
In addition, under the assumption of pure rolling friction between the wheels and the ground and no sliding friction, there is a constraint that the accelerations of the contact point in the x-direction (forward direction) and the z-direction (vertical direction) of the local coordinate system are 0. By calculating a Jacobi matrix Jc of the velocities v1 of the left wheel-leg portion and the right wheel-leg portion in the x-direction and the z-direction of the local coordinate system relative to the generalized joint motion velocity {dot over (q)}, according to the acceleration constraint, the following may be obtained:
α1={dot over (v)}1Jc{umlaut over (q)}+Jc{dot over (q)}=0 Equation (9-1)
Where α1 is the acceleration of the wheel-leg portion, v1=[vx,l, vz,l, vx,r, vz,r], vx,l is the velocity of the left wheel-leg portion in the x-direction, vzl is the velocity of the left wheel-leg portion in the z-direction, vx,r is the velocity of the right wheel-leg portion in the x-direction, vz,r is the velocity of the right wheel-leg portion in the z-direction, q is a joint position of each joint of the robot, {dot over (q)} is a joint velocity of each joint of the robot, {umlaut over (q)} is a joint acceleration of each joint of the robot, and Jc is the Jacobi matrix of the velocities v1 of the left wheel-leg portion and the right wheel-leg portion in the x-direction and z-direction of the local coordinate system relative to the generalized joint motion velocity {dot over (q)}.
In addition, an acceleration bias of the contact point of the generalized joint acceleration {umlaut over (q)}=0 may be obtained as follows:
Jc{dot over (q)}=ƒα(q, {dot over (q)}, 0, Contact) Equation (9-2)
Where ƒα represents an acceleration function, Contact represents a parameter quantity related to the contact process, and the definitions of the remaining parameters are as described above.
Using a similar approach, a closed-chain constraint equation of the parallel leg portions in a generalized open-chain coordinate system is:
α2={dot over (v)}2=Jλ{umlaut over (q)}+Jλ{umlaut over (q)}=0 Equation (9-3)
Where α2 is the acceleration of the parallel leg portions, v2 is the velocity of the parallel leg portions, Jλ is a Jacobi matrix of the velocity v2 of the parallel leg portions in the generalized open-chain coordinate system relative to the generalized joint motion velocity {dot over (q)}, {dot over (q)} is the joint velocity of each joint of the robot, and {umlaut over (q)} is the joint acceleration of each joint of the robot.
The acceleration bias may be calculated using the following equation, where Close represents a parameter quantity associated with the closed-chain constraint of the parallel leg portions, and the definitions of the remaining parameters are as described above:
{dot over (J)}λ{dot over (q)}=ƒ60 (q, {dot over (q)}, 0, Close) Equation (9-4)
From the above, the dynamic equation and the contact constraint equations of no external interference are obtained:
M{umlaut over (q)}+C+G=STτ+JcTFc+JλTFλ Equation (9-5)
S=0 Equation (9-6)
Jc{umlaut over (q)}+Jc{dot over (q)}=0 Equation (9-7)
Jλ{umlaut over (q)}+Jλ{dot over (q)}=0 Equation (9-8)
Where M,C,G,S,Jc,J80 ,{dot over (J)}c{dot over (q)},{dot over (J)}λ{dot over (q)} are known quantities. The mass matrix M can be quickly calculated based on the joint position q and using the composite rigid body algorithm (CRBA); the centrifugal force and Coriolis force offset C can be quickly calculated based on the joint position q and the joint velocity {dot over (q)} and using the recursive Newton-Euler algorithm (RNEA); and the gravity offset G can be calculated based on the joint position q and using the RNEA. The selection matrix S is configured to distinguish active joints and undriven joints, which is expressed as S=diag(α1, α2, . . . , αn), where ai=1 represents an undriven joint.
In addition, {umlaut over (q)}, τ, Fc, F80 are variables, where {umlaut over (q)} is the joint acceleration, τ is a torque item corresponding to the joint, and Fc is a generalized force of the contact point in the local coordinate system. Fc=[ƒc,x,l, ƒc,z,l, ƒc,x,r,ƒc,z.r]∈R4, where ƒc,x,l is the generalized force of the left wheel-leg portion of the robot in the x-direction, ƒc,z,l is generalized force of the left wheel-leg portion of the robot in the z-direction, ƒc,x,r is the generalized force of the right wheel-leg portion of the robot in the x-direction, and ƒc,z,r is the generalized force of the right wheel-leg portion of the robot in the z-direction. F80 is a closed-chain force of the front leg portion acting on the back leg portion, F80 =[ƒλ,x,l, ƒλ,z,l,ƒλ,x,r,ƒλ,z,r]∈R4, where ƒλ,x,l is a force that the front leg portion in the two parallel leg portions of the left wheel-leg portion acting on the back leg portion in the x-direction, and ƒλ,z,l is a force that the front leg portion in the two parallel leg portions of the left wheel-leg portion acting on the back leg portion in the z-direction, ƒλ,x,r is a force that the front leg portion in the two parallel leg portions of the right wheel-leg portion acting on the back leg portion in the x-direction, and ƒλ,z,r is a force that the front leg portion in the two parallel leg portions of the right wheel-leg portion acting on the back leg portion in the z-direction.
The foregoing equation constraints may be obtained using the complete dynamics approaches. In addition, according to the friction cone constraint, the contact force Fc in the local system (a tangent direction of the friction surface) may be described by:
ƒc,x,l ∈[−μƒc,z,l, μƒc,z,l], ƒc,z,l≥0 Equation (9-9)
ƒc,x,r∈[−μƒc,z,r, μƒc,x,r], ƒc,z,r≥0 Equation (9-10)
Where ƒc,x,l is the generalized force of the left wheel-leg portion of the robot in the x-direction, μ is the friction factor in the current surrounding environment, ƒc,z,l is the generalized force of the left wheel-leg portion of the robot in the z-direction, ƒc,x,r is the generalized force of the right wheel-leg portion of the robot in the x-direction, ƒc,z,r is the generalized force of the right wheel-leg portion of the robot in the z-direction.
In addition, the friction cone constraint matrix may be obtained as follows:
Where Jƒ,l is a friction constraint matrix corresponding to a left wheel contact point of the robot, Jƒ,r is a friction constraint matrix corresponding to a right wheel contact point of the robot, and μ is the friction factor in the current surrounding environment.
Therefore, a joint equality constraint sub-function, a joint inequality constraint sub-function, and a joint threshold constraint sub-function of the joint control constraint function are obtained.
The joint equality constraint sub-function includes:
Where {umlaut over (q)}t+1 is the joint acceleration of the robot at the target time, {dot over (q)}t is the current joint velocity of the robot, Fc,t+1 is the generalized force of the contact point of the robot at the target time in the local coordinate system, Fλ,t+1 is an action force between the two parallel leg portions at the target time, τt+1 is the joint torque of the robot at the target time, Jc,t and Jλ,t are Jacobian matrices that respectively correspond to the generalized force Fc of the contact point of the robot and the action force Fλ between the two parallel leg portions at the current time in the local coordinate system; Ct, Gt, Mt are parameter quantities generated based on current joint motion information of the robot; S is a parameter quantity determined based on the joint configuration of the robot, I is a unit matrix, whose dimension is determined according to the number of degrees of freedom of motion of the robot, t is the current time of the motion of the robot, and t+1 is the target time of the motion of the robot.
The joint inequality constraint sub-function includes:
Where Jƒ,l is the friction constraint matrix corresponding to the left wheel contact point of the robot, and Jƒ,r is the friction constraint matrix corresponding to the right wheel contact point of the robot. The friction cone constraint matrix may be expressed as:
The joint threshold constraint sub-function includes:
τt+1∈[τmin, τmax] Equation (9-15)
In the foregoing equality and inequality constraints, there is an association between the variables {umlaut over (q)}t+1, Fc,t+1, Fλ,t+1, τt+1. When the input torque is known, that is, τt+1 is known, and there is no inequality constraint, the least-squares solution of {umlaut over (q)}t+1, Fc,t+1, Fλ,t+1 can be obtained.
It can be seen that, although
belongs to a high-dimensional space, there are a one-to-one mapping relationship with the joint torque subspace whose dimension is k (k is much smaller than the dimension of the high-dimensional space). That is, due to the equality and inequality constraints,
actually belongs to a low-dimensional boundary manifold in the high-dimensional space that satisfies the equality constraint. The value of τ of the corresponding torque subspace can be obtained by appropriately selecting the acceleration of the subspace or the force Fcτ.
In addition, through the Jacobian matrix, the linear mapping relationship between an acceleration in an operating space and an acceleration in a generalized joint space can be defined, so as to obtain the acceleration in the operating space having consistent degree of freedom with the low-dimensional manifold. That is, the corresponding joint torque input that meets the dynamic constraints can be obtained, thereby realizing the control of the operating space in the low-dimensional manifold (new control requirements of the robot do not break the equation and inequality constraints).
In addition, the selection of the operating space ensures that the Jacobian matrix Jtask of the final total task meets the rank(Jtask)≥k(k is the dimension of the joint space). If rank(Jtask)<k, it indicates that there is an uncontrolled subspace, which causes the dynamic system to diverge. If rank (Jtask)>k, it indicates that there may be a task requirement that breaks the constraints. If rank(Jtask)=k, it indicates, for example, that a final criterion can be obtained.
Based on the above, when satisfying the foregoing dynamic and the friction constraint, the corresponding relationship between the operating space (in which the robot motion control is performed) of the robot and the joint motion space (in which each joint of the robot performs corresponding joint motion) of the robot can be determined. Therefore, in the operating space of the robot, the wheel-leg portion target motion state can be converted to the joint motion space of the robot according to the corresponding relationship. Similarly, the target motion acceleration of the robot can be represented by the joint acceleration of the robot in the joint motion space.
In the following, the process of obtaining the target joint acceleration of the robot will be described in combination with the joint equality constraint sub-function, the joint inequality constraint sub-function and the joint threshold constraint sub-function.
First, after obtaining the target motion acceleration of the robot, for example, based on the dynamic equation and the contact constraint equation, an estimated value of the target motion acceleration of the robot is determined, which may be expressed as follows:
{circumflex over (α)}t+1=Jt,i{umlaut over (q)}t+1+{dot over (J)}t,i{dot over (q)}t Equation (9-17)
Where {circumflex over (α)}t+1 is the estimated value of the target motion acceleration of the robot, Jt,i is a Jacobian matrix corresponding to each joint of the robot, {umlaut over (q)}t+1 is the joint acceleration of the robot at the target time, and {dot over (q)}t is the current joint velocity of the robot.
Based on the estimated value {circumflex over (α)}t+1 of the target motion acceleration of the robot and the target motion acceleration αt+1 of the robot, an error function of the robot may be further obtained. The error function ƒw may be expressed as follows:
ƒw=αt+1−{circumflex over (α)}t+1=αt+1−(Jt,i{umlaut over (q)}t+1+{dot over (J)}t,i{dot over (q)}t) Equation (9-18)
Then, for example, the error function and the joint control constraint function can be solved simultaneously. The joint control constraint function includes Equations (9-8) and (9-10). The variable parameters {umlaut over (q)}t+1, Fc,t+1, Fλ,t+1, τt+1 are adjusted, and the definition of each parameter is as described above. The parameters Fc,t+1, Fλ,t+1 and τt+1 are associated with the parameter {umlaut over (q)}t+1. When the joint control constraint function is satisfied and the error function reaches a minimum value by adjusting the parameters {umlaut over (q)}t+1, Fc,t+1, Fλ,t+1, and τt+1, the joint acceleration is determined as the target joint acceleration. In this way, the actual motion parameters of the robot can be regressed toward the target motion parameters.
By solving the error function and the joint control constraint function at the same time, according to the association relationship between the robot motion information and the joint motion information, the target motion acceleration obtained by the robot in the operating space is simply replaced to the joint space through the Jacobi matrix (since the joint space is generally defined as an unbounded space, and the operating space is a bounded space which is constrained by the actual dynamic equation and the own structure of the robot, such a simple replacement results in that the target joint acceleration in the mapped joint space meets the control requirement, but obviously deviates from or violates the motion principle of the normal motion of the robot and the physical constraint of the robot). Moreover, according to the constraint relationship between the robot motion information and the joint motion information provided by the joint control constraint function, it is ensured that the joint space acceleration obtained by replacing the target motion acceleration of the robot to the joint space still meets the physical constraint and the threshold condition defined by the dynamic model and the contact constraint equation of the robot. This is conducive to generation of the target joint acceleration with high reliability and precision, and avoids ineffective control.
Based on the above, in the present disclosure, by setting the joint equality constraint sub-function, the joint inequality constraint sub-function, and the joint threshold constraint sub-function for the robot, it can be better realized that the equality constraint relationship between the robot motion information and the joint motion information, the inequality constraint relationship between the robot motion information and the joint motion information, and the limit position or the limit pose of each joint of the robot during the motion of the robot, which improves precision and reliability of the generated target joint acceleration, thereby realizing flexible robot control.
In some embodiments, a robot is provided. The robot includes: a wheel-leg portion. The wheel-leg portion includes a left wheel-leg portion and a right wheel-leg portion. The left wheel-leg portion and the right wheel-leg portion each includes at least one joint. The robot further includes a controller. The controller is arranged on the robot, and is configured to perform the foregoing robot control method and has the foregoing functions.
The controller includes, for example, a processing apparatus. The processing apparatus may include a microprocessor, a digital signal processor (“DSP”), an application specific integrated circuit (“ASIC”), a field programmable gate array, a state machine, or other processing component for processing electrical signals received from a sensor line. Such processing component may include a programmable electronic device, such as a programmable logic controller (“PLC”), a programmable interrupt controller (“PIC”), a programmable logic device (“PLD”), a programmable read-only memory (“PROM”), an electronic programmable read-only memory, and the like.
In addition, in some embodiments, the robot may further include, for example, a base portion connected to the wheel-leg portion, an additional component (such as a tail component) arranged on the base portion, a bus, a memory, a sensor assembly, a communication module, an input/output apparatus, and the like. The robot may contain different components, additional components, or fewer components in various embodiments.
The bus may be a circuit that interconnects the components of the robot and transfers communication information (such as control messages or data) among the components.
The sensor component may be configured to sense the physical world, which includes a camera, an infrared sensor, an ultrasonic sensor, and the like. In addition, the sensor assembly may further include an apparatus for measuring a current operation and motion state of the robot, such as a Hall sensor, a laser position sensor, or a strain force sensor.
The communication module may, for example, be connected to a network via a wired or wireless connection, which facilitates communication with the physical world (such as a server). The communication module may be wireless and include a wireless interface, such as an IEEE 802.11, Bluetooth, a wireless local area network (“WLAN”) transceiver, or a radio interface for accessing a cellular telephone network (such as a transceiver/antenna for accessing a code division multiple access (CDMA), a global system for mobile communications (GSM), a universal mobile telecommunications system (UMTS), or other mobile communication network). In another embodiment, the communication module may be wired and include an interface such as Ethernet, USB, or IEEE 1394.
The term module (and other similar terms such as unit, submodule, etc.) may refer to a software module, a hardware module, or a combination thereof. A software module (e.g., computer program) may be developed using a computer programming language. A hardware module may be implemented using processing circuitry and/or memory. Each module can be implemented using one or more processors (or processors and memory). Likewise, a processor (or processors and memory) can be used to implement one or more modules. Moreover, each module can be part of an overall module that includes the functionalities of the module. A module is configured to perform functions and achieve goals such as those described in this disclosure, and may work together with other related modules, programs, and components to achieve those functions and goals.
The input/output apparatus may transmit, for example, commands or data inputted from a user or any other external device to one or more other components of the robot, or may output commands or data received from one or more other components of the robot to the user or other external device.
A plurality of robots may form a robot system, to cooperatively complete a task. The plurality of robots are communicatively connected to the server, and receive cooperative robot instructions from the server.
In some embodiments, a robot control system is provided. The robot includes a wheel-leg portion and a base portion connected to the wheel-leg portion. The wheel-leg portion includes at least one joint. The system includes: a motion instruction receiving module, configured to receive a motion instruction; and a control module, configured to control a torque of the at least one joint according to the motion instruction, to allow the robot to perform the somersault motion. In a takeoff phase of the somersault motion, a center of mass of the wheel-leg portion is lower than a center of mass of the base portion; in a flight phase of the somersault motion, there is a time at which the center of mass of the wheel-leg portion is higher than the center of mass of the base portion; and in a landing phase of the somersault motion, the center of mass of the wheel-leg portion is lower than the center of mass of the base portion.
In some embodiments, a wheel-legged robot is provided. The wheel-legged robot includes a processor and a memory. The memory stores at least one instruction, at least one program, a code set, or an instruction set. The at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the foregoing method.
In some embodiments, a non-transitory computer-readable storage medium is provided. The storage medium stores at least one instruction, at least one program, a code set or an instruction set. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the foregoing method.
By using the method and apparatus for controlling a robot to perform a somersault motion, the robot, and the non-transitory computer-readable storage medium provided by the present disclosure, the somersault motion control of the robot is better realized, which allows the robot to stably and smoothly complete the somersault motion, thereby avoiding obstacles.
The program portion in the technology can be considered as a “product” or “article” in the form of executable codes and/or related data, which is realized with participation of a non-transitory computer-readable medium. A tangible and permanent storage medium may include an internal memory or a memory used by any computer, processor, or similar device or related module, for example, various types of semiconductor memories, tape drives, disk drives, or similar devices that are able to provide storage functions for software.
All or a part of software may communicate through a network, such as the Internet or other communication network. Such communication can load software from one computer device or processor to another one. Therefore, another medium capable of transmitting software elements may be used as a physical connection between local devices, such as light waves, radio waves, electromagnetic waves, and the like, and transmission is realized through a cable, ab optical cable, air, and the like. A physical medium for carrying waves, such as a cable, a wireless connection, or an optical cable, can be considered as a medium for carrying software. Herein, unless the tangible “storage” medium is restricted, any other term representing a computer or machine “readable medium” refer to a medium involved in the execution of any instruction by the processor.
The present disclosure uses terms to describe the embodiments of the present disclosure. For example, the terms “first/second embodiment”, “one embodiment”, and/or “some embodiments” refers to a feature, structure or characteristic associated with at least one embodiment of the present disclosure. The description “an embodiment” or “one embodiment” or “an alternative embodiment” may refer to the same, or a different embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present disclosure may be appropriately combined.
Some embodiments of the present disclosure may be entirely executed by hardware, may be entirely executed by software (including firmware, resident software, microcode, and the like), or may be executed by a combination of hardware and software. The foregoing hardware or software may be referred to as “data block”, “module”, “engine”, “unit”, “component” or “system”. In addition, some embodiments of the present disclosure may be embodied as computer products located in one or more non-transitory computer-readable mediums, the product including a computer-readable program code.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present disclosure belongs.
The above is description of the present disclosure, and is not to be considered as a limitation to the present disclosure. Although several example embodiments of the present disclosure are described, a person skilled in the art may easily understand that, many changes can be made to the described embodiments without departing from of the scope of the present disclosure. The above is a description of the present disclosure, and is not limited to the disclosed embodiments.
Number | Date | Country | Kind |
---|---|---|---|
202110601860.0 | May 2021 | CN | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2022/093228 | May 2022 | US |
Child | 18309263 | US |