INFORMATION PROCESSING DEVICE AND INFORMATION PROCESSING METHOD

Information

  • Patent Application
  • 20230297068
  • Publication Number
    20230297068
  • Date Filed
    July 20, 2021
    2 years ago
  • Date Published
    September 21, 2023
    8 months ago
Abstract
The present invention easily generates training data needed for generating a training model for identifying a position for retrieving a bulk-loaded work piece. An information processing device, according to the present invention, for processing information for retrieving a work piece using a hand, said device comprising: a reception unit that receives retrieval conditions including information about the hand or the work piece; a pre-processing unit that at least derives the position of the center of gravity of the work piece on the basis of a 3D CAD model of the work piece; and a first processing unit that, on the basis of the derived position of the center of gravity of the work piece, derives sectional features of the 3D CAD model of the work piece according to the retrieval conditions.
Description
Claims
  • 1. An information processing device for processing information for picking up a workpiece by means of a hand, comprising: a receiving unit configured to receive a pick-up condition including information on the hand or the workpiece;a preprocessing unit configured to derive at least a position of a center of gravity of the workpiece based on a 3D CAD model of the workpiece; anda first processing unit configured to derive a local feature of the 3D CAD model of the workpiece according to the pick-up condition based on the derived position of the center of gravity of the workpiece.
  • 2. The information processing device according to claim 1, wherein the receiving unit receives the pick-up condition including at least one of information on a shape and a size of a portion of the hand contacting the workpiece, information on a movable range of the hand, distribution information on a material, or a density, or a friction coefficient of the workpiece, or a part of pick-up availability information, andthe first processing unit derives the local feature according to the pick-up condition received by the receiving unit.
  • 3. The information processing device according to claim 1, further comprising: a first pick-up candidate calculation unit configured to automatically calculate at least one candidate of a pick-up position of the workpiece based on the derived local feature.
  • 4. The information processing device according to claim 3, wherein the first pick-up candidate calculation unit automatically calculates a candidate of a pick-up posture of the workpiece based on the derived local feature.
  • 5. The information processing device according to claim 3, wherein the first pick-up candidate calculation unit corrects, by using an interference checking function or a collision calculation function of the preprocessing unit, a pick-up position candidate and/or the pick-up posture candidate calculated by the first pick-up candidate calculation unit.
  • 6. The information processing device according to claim 3, further comprising: a second pick-up candidate calculation unit, wherein the preprocessing unit randomly generates at least an overlapping state of a plurality of workpieces by using the 3D CAD model of the workpiece, andthe second pick-up candidate calculation unit automatically generates, based at least on a pick-up position candidate calculated by the first pick-up candidate calculation unit, at least a pick-up position of the plurality of workpieces in the overlapping state.
  • 7. The information processing device according to claim 6, wherein the second pick-up candidate calculation unit corrects, by using an interference checking function or a collision calculation function of the preprocessing unit, at least a pick-up position of the plurality of workpieces generated by the second pick-up candidate calculation unit.
  • 8. The information processing device according to claim 6, further comprising: a first training data generation unit configured to generate training data based on a two-dimensional projection image projected from the overlapping state of the plurality of workpieces generated by the preprocessing unit and information including at least a pick-up position of the plurality of workpieces generated by the second pick-up candidate calculation unit.
  • 9. The information processing device according to claim 3, further comprising: an information acquisition unit configured to acquire a plurality of images of a region where the workpiece is present; anda second processing unit configured to perform matching processing between a feature extracted by image processing for each of the plurality of images and the derived local feature of the 3D CAD model of the workpiece.
  • 10. The information processing device according to claim 9, further comprising: a third pick-up candidate calculation unit, wherein the third pick-up candidate calculation unit automatically generates, based on a processed result obtained by the second processing unit and at least a pick-up position candidate calculated by the first pick-up candidate calculation unit, at least a pick-up position of the workpiece on the images acquired by the information acquisition unit.
  • 11. The information processing device according to claim 10, wherein the preprocessing unit generates an overlapping state of a plurality of workpieces corresponding to the images based on the processed result obtained by the second processing unit, andthe third pick-up candidate calculation unit corrects, by using an interference checking function or a collision calculation function of the preprocessing unit, at least a pick-up position of the plurality of workpieces generated by the third pick-up candidate calculation unit.
  • 12. The information processing device according to claim 10, further comprising: a second training data generation unit configured to generate training data based on the images acquired by the image acquisition unit and information including at least a candidate for the pick-up position generated by the third pick-up candidate calculation unit.
  • 13. The information processing device according to claim 3, further comprising: an information acquisition unit configured to acquire plural pieces of three-dimensional point cloud data on a region where the workpiece is present; anda third processing unit configured to perform matching processing between each of the plural pieces of three-dimensional point cloud data and the 3D CAD model of the workpiece.
  • 14. The information processing device according to claim 13, further comprising: a fourth pick-up candidate calculation unit,wherein the fourth pick-up candidate calculation unit automatically generates, based on a processed result obtained by the third processing unit and at least a pick-up position candidate calculated by the first pick-up candidate calculation unit, at least a pick-up position of the workpiece on the three-dimensional point cloud data acquired by the information acquisition unit.
  • 15. The information processing device according to claim 14, wherein the fourth pick-up candidate calculation unit corrects, based on the three-dimensional point cloud data, at least a pick-up position of a plurality of workpieces generated by the fourth pick-up candidate calculation unit by using an interference checking function or a collision calculation function of the preprocessing unit.
  • 16. The information processing device according to claim 14, further comprising: a third training data generation unit configured to generate training data based on the three-dimensional point cloud data acquired by the information acquisition unit and information including at least a candidate for the pick-up position generated by the fourth pick-up candidate calculation unit.
  • 17. An information processing method for implementation by a computer for processing information for picking up a workpiece by means of a hand, comprising: a receiving step of receiving a pick-up condition including information on the hand or the workpiece;a preprocessing step of deriving at least a position of a center of gravity of the workpiece based on a 3D CAD model of the workpiece; anda first processing step of deriving a local feature of the 3D CAD model of the workpiece according to the pick-up condition based on the derived position of the center of gravity of the workpiece.
Priority Claims (1)
Number Date Country Kind
2020-126620 Jul 2020 JP national
PCT Information
Filing Document Filing Date Country Kind
PCT/JP2021/027151 7/20/2021 WO