The present invention belongs to the technical field of identification of robot pouring, and it particularly relates to an optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization and a system thereof.
The statements in this section merely provide background information related to the present invention and are not necessarily prior art.
The pouring skill of robots is a very widely used manipulation skill, whether it is home service or laboratory manipulation, there are many direct application scenarios. Because of the diversity of manipulating objects (e.g. liquid, particle, or powder) of the pouring manipulation, complex dynamic processes have been incorporated into the manipulating tasks of the pouring manipulation, which brings great challenge to robot manipulation skill learning. How to learn accurate and widely applicable pouring manipulation skills has become an important topic in the field of robot manipulation skills learning.
The existing research on robot pouring manipulation skill learning mainly focuses on the control and learning of the pouring action of fixed-type mechanical arms, which is often given a fixed pouring region for the robot, but it is difficult to realize the autonomous selection and optimization of the pouring region for the robot, which makes it difficult for the robot to complete the whole process of pouring task autonomously.
In order to solve at least one technical problem mentioned in the background above, the present invention provides an optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization and a system thereof, which can realize the identification and the optimization of the identification of the pouring region of a mobile robot, can be widely adapted to different pouring scenarios, and can be easily extended to the process of learning the pouring manipulation skill of a fixed-type mechanical arm, thereby providing support for the learning and realization of accurate and applicable extensive pouring manipulation skills of the robot.
In order to achieve the above object, the present invention adopts the following technical solutions.
A first aspect of the present invention provides an optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization, comprising the following steps:
A second aspect of the present invention provides an optimized system for identifying robot pouring regions based on hierarchical processing and connectivity maximization, comprising:
A third aspect of the invention provides a non-transitory computer-readable storage medium.
The non-transitory computer-readable storage medium having a computer program stored thereon, when the computer program is executed by a processor, implementing steps of the optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization according to the first aspect.
A fourth aspect of the invention provides computer equipment.
The computer equipment, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executing the program, implementing steps of the optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization according to the first aspect.
Compared with the prior art, the present invention has the advantages that:
Additional aspects of the present invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the present invention.
The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary examples of the present invention and descriptions thereof are used to explain the present invention, and do not constitute an improper limitation of the present invention.
The present invention will now be further described with reference to the accompanying drawings and examples.
It should be pointed out that the following detailed descriptions are all illustrative and are intended to provide further descriptions of the present invention. Unless otherwise specified, all technical and scientific terms used in the present invention have the same meanings as those usually understood by a person of ordinary skill in the art to which the present invention belongs.
It should be noted that the terms used herein are merely used for describing specific implementations, and are not intended to limit exemplary implementations of the present invention. As used herein, the singular form is also intended to include the plural form unless the context clearly dictates otherwise. In addition, it should further be understood that, the terms “comprise” and/or “include” used in this specification indicate that there are features, steps, operations, devices, components, and/or combinations thereof.
In order to enable a mobile robot to master an optimized skill of autonomous identification of a pouring region and realize autonomous completion of a complete pouring task flow, the present invention provides an optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization, to realize the autonomous identification of the pouring region by the mobile robot and optimization of the identification.
According to the proposed method of the present invention, a system for a mobile robot and a pouring task scenario as shown in
The system comprises a mobile-chassis module (this module comprises an omni-directional wheel motion-control subsystem, a radar-positioning subsystem and other subsystems, and is used for realizing a motion control and an obstacle avoidance function of the mobile robot), a mechanical-arm module (this module comprises a mechanical-arm sub-module and a clamping-claw module used for holding a container, and is used for realizing clamping of a source container and realization of camera actions and pouring actions), a vision module (this module comprises an RGB-D camera, a camera bracket and the like, and is used for identifying a source container, a target container and a working environment); further, the pouring task scenario comprises a source container (a container used for pouring substances, an initial state of the container is that the container contains substances to be poured, and an opening of the container is an axisymmetric figure), a target container (a container used for receiving the substances) and a matched working environment.
The goal of the robot pour manipulation skill is to be able to accurately pour substances from source containers into target containers with broad adaptability. The accurate pouring requires that the robot minimize a spillage of the substances throughout the pouring manipulation, while the broad adaptability requires that the robot be able to adapt to a variety of source containers, target containers, and pouring scenarios.
In order to realize the mobile robot to accurately complete the pouring manipulation with broad adaptability, the present invention proposes the optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization, of which a core point is to adopt a hierarchical processing for the optimization of the identification process of the pouring region according to the working characteristics of mobile robot, and further proposes the model of the connectable domain of the source container that can predict the fluid flow region in the source container, and ultimately achieve autonomous intelligent identification of the optimal pouring region by maximizing the connectivity.
As shown in
The present stage of the rough identification is to perform, according to working characteristics of a mobile robot, an identification and a positioning of a target container through a vision module when a distance from a target region is relatively far, and generate information collection position of the target container required for a fine identification according to the positioning, comprising the following steps:
Wherein, the step 2 includes the following steps:
Wherein, the step 3 includes the following steps:
Wherein, hcamera refers to the distance that the camera needs to keep from the object to be photographed when taking pictures to obtain information, and this distance needs to integrate a reachable range of the mechanical arm and the camera shooting parameters. For example, a distance test range of a RealSense camera is 0.1-10 m, so it is best for the camera to keep the distance from the object to be photographed at a distance of more than 0.1 m, cannot be tightly attached.
After obtaining the information collection position Pcamera in the rough identification stage, planning a motion trajectory of the mobile chassis by using the RRT (rapidly-exploring random tree) algorithm, and controlling the mobile chassis to move to a vicinity of a target position according to the motion trajectory, and then generating, by using the inverse kinematics method, joint parameters of the mechanical arm according to the information collection position Pcamera generated in the rough identification stage, and moving the vision module of the mechanical arm to the information collection position.
In the present stage of the fine identification, firstly obtaining, by the mobile robot, the information of the target container and the source container and generating corresponding connectable domain, and then identify and optimize the robot pouring region by using the method of connectivity maximization.
Wherein, a specific process is as follows:
Wherein, the step 2 includes the following steps:
Wherein, hreceiver can be defined as infinity or according to the following formula:
wherein, hcontainer is a parameter of the model of the connectable domain of the source container; hreceiver is upward projection length of a plane of the opening of the target container.
Wherein, the step 4 includes the following steps:
The formula for the connectable domain of the source container is as follows:
Advantages and rationality of using this method to set up the connectable domain are as follows:
When the fluid flows out from an opening, it is a complex calculation process to predict the trajectory and target region of the fluid using accurate fluid mechanics principles, and the generalization ability of the results of fluid mechanics calculation is poor due to the different properties of different fluids. However, the simplified model of the triangular prism with parameterized (α, ll, l, h) can well cover the flow region of the fluid, and has a wide range of applicability, which can facilitate the identification and optimization of the pouring region. In addition,
Wherein, the step 5 includes the following steps:
calculate a maximum value of the intersection region of the target container and the source container, expressed as follows:
The purpose of calculating the maximum value is to search for the position and direction of the maximum intersection of the connectable domain of the source container and the target container in the Planereceiver, and further obtain the position of the pouring point m on the source container.
Further optimization can be achieved by simplifying by using the following computational methods, specifically:
the calculation formula of the weight is as follows:
The present embodiment provides an optimized system for identifying robot pouring regions based on hierarchical processing and connectivity maximization, comprising:
a rough-identification module, being configured to perform a preliminary location of a target container based on environmental information image to obtain a spatial region of the target container; and being configured to generate a trajectory plan and a path plan of a mobile chassis of a mobile robot according to the spatial region of the target container; and
a fine-identification module, being configured to perform a fine identification by controlling a mechanical arm of the mobile robot to move to an information collection position according to the trajectory plan and the path plan, to obtain a pouring region; wherein, a process of the fine identification specifically comprises:
acquiring image information of the target container and a source container;
generating corresponding connectable domain based on the image information of the target container and the source container; and
searching, by using a method of connectivity maximization, a pouring point of the source container which makes an intersection of the connectable domains of the source container and the target container maximum in a searching plane, and a pouring direction, further obtaining positions of pouring points on the source container, and then obtaining the pouring region according to a combination of the positions of the pouring points.
The present embodiment provides a non-transitory computer-readable storage medium having a computer program stored thereon, when the computer program is executed by a processor, implementing steps of the optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization as described in Embodiment 1.
The present embodiment provides computer equipment, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executing the program, implementing steps of the optimized method for identifying robot pouring regions based on hierarchical processing and connectivity maximization as described in Embodiment 1.
Those skilled in the art should understand that the examples of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of hardware examples, software examples, or examples combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk memory, optical memory, etc.) containing computer usable program codes.
The present invention is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to the examples of the present invention. It should be understood that each of the processes and/or boxes in the flowchart and/or block diagram, and the combination of the processes and/or boxes in the flowchart and/or block diagram, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, a specialized computer, an embedded processor, or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes of the flowchart and/or one box or multiple boxes of the block diagram.
These computer program instructions may also be stored in a computer-readable memory capable of directing the computer or other programmable data processing apparatus to operate in a particular manner such that the instructions stored in such the computer-readable memory produce an article of manufacture comprising an instruction device that implements the function specified in one process or a plurality of processes of the flowchart and/or one box or a plurality of boxes of the block diagram.
These computer program instructions may also be loaded onto a computer or other programmable data processing device to enable a series of operational steps to be performed on the computer or other programmable device to generate a computer implemented process, so that instructions executed on a computer or other programmable device provide steps for implementing functions specified in one process or a plurality of processes of the flowchart and/or in one box or a plurality of boxes of the block diagram.
Those skilled in the art can understand that the realization of all or part of the processes in the methods of the above examples can be accomplished by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it may comprise the processes of the examples of the above methods. The storage medium may be a disk, optical disc, Read-only memory (ROM), or random-access memory (RAM).
The foregoing descriptions are merely preferred embodiments of the present invention but are not intended to limit the present invention. A person skilled in art may make various alterations and variations to the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2023108548085 | Jul 2023 | CN | national |