The present application claims priority to Japanese Patent Applications number 2022-178042, filed on Nov. 7, 2022 contents of which are incorporated herein by reference in their entirety.
The present disclosure relates to a foolproof device and a storage medium.
When measuring a workpiece (object) with a measuring device in a manufacturing process, the workpiece is delivered to a predetermined position of the measuring device by a robot arm and is measured by a probe or the like. The workpiece is fixed to a base part by a clamp in advance, and a robot arm carries the base part to deliver the workpiece (see Japanese Unexamined Patent Application Publication No. 2019-100904).
Conventionally, an operator visually checks a state of a workpiece and a state of a fixing jig that fixes the workpiece during the process. Therefore, the operator may overlook the state of the workpiece or the fixing jig even when it deviates from a desired state, in which case the workpiece cannot be appropriately measured or machined.
The present disclosure focuses on this point, and an object thereof is to enable an operator or the like to easily grasp whether or not an object is appropriately located in a desired state.
A first aspect of the present disclosure provides a foolproof device provided to a manufacturing process, including an imaging part that captures an object on which a plurality of identifiable marks are provided, an image processing part that obtains state data including a coordinate position of each mark from at least one captured image captured by the imaging part, a storage that stores reference data obtained by the image processing part, the reference data including a reference position of each mark, and a comparison processing part that compares the reference data stored in the storage with the current state data obtained by the image processing part, and outputs a result of the comparison regarding at least some of the plurality of marks.
A second aspect of the present disclosure provides a storage medium storing a program for causing a processor to execute the steps of causing an imaging part to capture an object on which a plurality of identifiable marks are provided, obtaining state data including a coordinate position of each mark from at least one captured image captured by the imaging part, and comparing reference data including a reference position of each mark stored in a storage with the current state data obtained and outputting a result of the comparison regarding at least some of the plurality of marks.
Hereinafter, the present disclosure will be described through exemplary embodiments of the present disclosure, but the following exemplary embodiments do not limit the disclosure according to the claims, and not all of the combinations of features described in the exemplary embodiments are necessarily essential to the solution means of the disclosure.
A configuration of a foolproof system according to the present embodiment will be described with reference to
The measuring device 10 is a coordinate measuring device that measures coordinates of the workpiece 100. By measuring the coordinates of the workpiece 100, dimensions and geometries of the workpiece 100 can be measured. The measuring device 10 includes a placement surface 11, a moving mechanism 13, and a detection part 15.
The placement surface 11 is a top surface of a surface plate, on which the workpiece 100 to be measured is placed. The moving mechanism 13 is a mechanism for moving the detection part 15, and includes a column 13a, a beam 13b, and a spindle 13c. The column 13a is erected on the placement surface 11, and supports the beam 13b. The beam 13b is a beam-shaped member orthogonal to the column 13a, and is movable with respect to the column 13a. The spindle 13c is a prismatic member and is movably connected to the beam 13b.
The detection part 15 is provided at the tip of the spindle 13c and detects three-dimensional coordinates of the workpiece 100. The detection part 15 here includes a contact probe that contacts a surface of the workpiece 100, but is not limited thereto. For example, the detection part 15 may be a non-contact probe that detects a distance by radiating a laser beam onto the surface of the workpiece 100.
A fixing plate 17 is fixed to the placement surface 11. The fixing plate 17 is provided with a plurality of support shafts 18a and 18b protruding from a top surface of the fixing plate 17. The support shafts 18a and 18b can support the base plate 110. Therefore, the workpiece 100 fixed to the base plate 110 is placed at a predetermined position on the placement surface 11 by being supported by the support shafts 18a and 18b.
The stocker 20 is a stand that holds the workpiece 100 to be measured by the measuring device 10 in a stand-by state. On a top surface 21 of the stocker 20, a plurality of workpieces 100 are arranged at predetermined intervals in the longitudinal direction of the stocker 20 (the depth direction of the sheet of
The robot arm 25 is disposed between the measuring device 10 and the stocker 20, and has a function of carrying the workpiece 100 between the placement surface 11 of the measuring device 10 and the stocker 20. The robot arm 25 is an articulated robot, which can, for example, lift the base plate 110 from below with a tip 26 thereof to move the workpiece 100. Specifically, the robot arm 25 moves the workpiece 100 such that the base plate 110 of the workpiece 100 is placed on the support shafts 18a and 18b. The robot arm 25 delivers one workpiece 100 set on the stocker 20 onto the placement surface 11 to place the workpiece 100 at the predetermined position on the placement surface 11. Further, the robot arm 25 delivers the workpiece 100, after the measurement by the measuring device 10 is completed, back to the original position where the workpiece 100 was set on the stocker 20.
The imaging device 30 captures the object placed on the placement surface 11 (here, the workpiece 100 fixed to the base plate 110 by the clamp 120) together with the base plate 110. The imaging device 30 is provided to, for example, the moving mechanism 13 of the measuring device 10. The imaging device 30 captures the placement state of the workpiece 100 fixed to the base plate 110 on the placement surface 11 before the measuring device 10 measures the coordinates of the workpiece 100. It should be noted that, in
The control device 40 controls the operation of the foolproof system S. In the present embodiment, the control device 40 operates the robot arm 25 to move the workpiece 100 between the placement surface 11 and the stocker 20. Further, the control device 40 causes the movement mechanism 13 of the measuring device 10 to move the detection part 15 to measure the three-dimensional coordinates of the workpiece 100.
The details will be described later, but the control device 40 has the placement state of the workpiece 100 supported by the base plate 110 on the placement surface 11 captured, and causes a reporting part to report. Thus, the operator or the like can easily grasp whether or not the workpiece 100 is appropriately placed at the predetermined position on the placement surface 11.
The storage 42 includes a Read Only Memory (ROM) storing a Basic Input Output System (BIOS) and the like of the computer and a Random Access Memory (RAM) serving as a work area. As the storage 42 thereof, a mass storage device such as a Hard Disk Drive (HDD) or Solid State Drive (SSD) can be used that stores an Operating System (OS), an application program, and various types of information referred to when executing said application program.
The controller 44 is a processor such as a Central Processing Unit (CPU) or a Graphics Processing Unit (GPU). The controller 44 functions as a measurement control part 442, a delivery control part 443, an imaging control part 444, an image processing part 445, and a comparison processing part 446 by executing the program stored in the storage 42.
The measurement control part 442 controls measurement of the workpiece 100 by the measuring device 10. Specifically, the measurement control part 442 causes the moving mechanism 13 of the measuring device 10 to move the detection part 15 to measure the three-dimensional coordinates of the workpiece 100 on the placement surface 11.
The delivery control part 443 controls delivery of the workpiece 100 by the robot arm 25. For example, when an operator selects the workpiece 100 to be measured from among the workpieces 100 on the stocker 20, the delivery control part 443 causes said workpiece 100 to be moved onto the placement surface 11. Further, when the measurement of the three-dimensional coordinates of the workpiece 100 is completed, the delivery control part 443 returns the workpiece 100 to its original position on the stocker 20.
The imaging control part 444 causes the imaging device 30 to capture the workpiece 100 placed on the placement surface 11 to generate a captured image. The imaging control part 444 causes the imaging device 30 to capture the workpiece 100 when one workpiece 100 among the plurality of workpieces 100 set at the standby position on the stocker 20 is carried and placed on the placement surface 11 of the measuring device 10 by the robot arm 25. The imaging control part 444 outputs the generated captured image to the image processing part 445.
The imaging control part 444 causes not only the workpiece 100, but also the base plate 110 and the clamp 120, to be captured. That is, in the present embodiment, the object to be captured by the imaging device 30 also includes the base plate 110 and the clamp 120. When the object is placed on the placement surface 11, the imaging control part 444 causes at least one of the imaging devices 30 to capture a plurality of mutually identifiable marks at a plurality of positions on the object to generate the captured image. Specifically, the imaging control part 444 causes the imaging device 30 to capture a plurality of first marks provided on the base plate 110 and a plurality of second marks provided on the lever 124 which is a movable portion of the clamp 120.
The first mark and the second mark are marks that enable detection of the three-dimensional coordinates of a portion where the marks are affixed. The first mark and the second mark are marks that enable the detection of the three-dimensional coordinates with the centers of the marks as the origins. Specifically, each of the first mark and the second mark is a mark that can construct a three-dimensional coordinate system in which XYZ axes are defined along the orientation of the mark while using the center of the mark as the origin with the single mark body by applying a dedicated image processing algorithm. When using the first mark and the second mark that enable the detection of the three-dimensional coordinates, a determination process described below can be used to determine whether or not the position of the workpiece 100 fixed to the base plate 110 or the state of fixation by the clamp 120 is out of the predetermined position. It should be noted that the first mark and the second mark are the same type of marks here, but the present disclosure is not limited thereto, and at least one of the size, shape, or type of the first mark and the second mark may be different from each other.
It should be noted that the two second marks M4 and M5 are provided in
Before the workpiece 100 is placed on the placement surface 11, the imaging control part 444 causes the imaging device 30 to capture a plurality of reference marks provided to the fixing plate 17 to generate the captured image. Like the first marks M1 to M3 and the second marks M4 and M5, the reference mark is a mark enabling the detection of the three-dimensional coordinates with the center of the mark as the origin. Specifically, the reference mark is a mark making it possible to construct the three-dimensional coordinate system that defines the XYZ axes along the orientation of the mark while using the center of the mark as the origin with the single mark body by applying the dedicated image processing algorithm. The reference mark is a mark used for setting a reference coordinate system (X-axis, Y-axis, and Z-axis) when determining the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5. The types of reference marks N1 to N4 are the same as the types of the first marks M1 to M3 and the second marks M4 and M5 here, but the present disclosure is not limited thereto, and a reference mark of which at least one of size, shape, and type is different from that of the first marks M1 to M3 and the second marks M4 and M5 may be used.
The image processing part 445 processes the captured image generated by the imaging device 30. The image processing part 445 sets the reference coordinate system from the captured image obtained by capturing the four reference marks N1 to N4. For example, the image processing part 445 identifies the positions of the four reference marks N1 to N4, and sets the reference coordinate system (X-axis, Y-axis, and Z-axis) with a center C (
The image processing part 445 stores information on the set reference coordinate system in the storage 42. By storing the information on the reference coordinate system in the storage 42 in this way, the image processing part 445 does not need to set the reference coordinate system again. It should be noted that the present disclosure is not limited to the above, and the image processing part 445 may set the reference coordinate system every time the measuring device 10 starts the measurement.
Further, the image processing part 445 obtains state data including the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 from at least one captured image including the first marks M1 to M3 and the second marks M4 and M5. Here, the image processing part 445 obtains the state data including the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 in the reference coordinate system set on the basis of the reference marks N1 to N4. For example, the image processing part 445 obtains the X-coordinate, the Y-coordinate, and the Z-coordinate of the center position of each of the first marks M1 to M3 and the second marks M4 and M5, in the reference coordinate system.
The image processing part 445 may obtain, as the state data, an angle formed by the second marks M4 and M5 provided on the lever 124, which is the movable portion, with a predetermined direction. Specifically, the image processing part 445 obtains an angle formed by a virtual line connecting the center of the second mark M4 and the center of the second mark M5 with respect to the X-axis direction of the reference coordinate system. In addition, the image processing part 445 may obtain, as the state data, a distance between the first marks M1 to M3 (specifically, a distance between the first mark M1 and the first mark M2, and a distance between the first mark M2 and the first mark M3) or a distance between the second mark M4 and the second mark M5.
It should be noted that when the robot arm 25 places the workpiece 100 on the placement surface 11, the workpiece 100 is not always placed on the placement surface 11 in the manner shown in
If the workpiece 100 is placed in the manner shown in
The comparison processing part 446 compares the state data of the current first marks M1 to M3 and second marks M4 and M5 captured by the imaging device 30 with the reference data of the first marks M1 to M3 and the second marks M4 and M5 obtained in advance. The state data of the first marks M1 to M3 and the second marks M4 and M5 is data obtained from the captured image by the image processing part 445. On the other hand, the reference data includes the reference positions of the first marks M1 to M3 and the second marks M4 and M5 when the workpiece 100 is located at the predetermined position on the placement surface 11. The reference position means, for example, a coordinate position of each mark when the workpiece 100 is placed at the predetermined position as shown in
The comparison processing part 446 outputs the result of a comparison of the state data of the first marks M1 to M3 and the second marks M4 and M5 with the reference data. For example, the comparison processing part 446 outputs the result of the comparison to the reporting part 60 that reports the result of the comparison. A display part 62 and a lighting part 64 are provided as the reporting part 60.
The comparison processing part 446 determines whether or not the degree of deviation of the coordinate position indicated by the state data of each mark from the reference position indicated by the reference data exceeds a predetermined value, and causes the display part 62 to display the result of the determination. For example, if the current workpiece 100 being captured by the imaging device 30 is placed normally on the placement surface 11, the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 (coordinate positions of the X-axis, Y-axis, and Z-axis) are located almost at the same positions as the reference positions (coordinate position of each mark when the workpiece 100 is placed in position as shown in
On the other hand, as shown in
Further, the comparison processing part 446 may compare an angle that the current second marks M4 and M5 form with respect to the X-axis direction of the reference coordinate system (hereinafter also referred to as the current angle) to a reference angle of the second marks M4 and M5 obtained in advance (an angle that the second marks M4 and M5 form with respect to the X-axis direction when the workpiece 100 is placed in place as shown in
It should be noted that, in the above description, the current angle and the reference angle are angles formed by the virtual line connecting the second marks M4 and M5 with respect to the X-axis direction of the reference coordinate system. For example, the X-axis direction may be the X-axis direction of the coordinate system constructed by the first marks M1 to M3.
The coordinate display area 63b is an area for displaying the coordinates of the first marks M1 to M3 and the second marks M4 and M5. For example, the three-dimensional coordinate position of the first mark M1 is denoted by X1, Y1, and Z1, and the three-dimensional coordinate position of the second mark M4 is denoted by X4, Y4, and Z4. Further, the comparison processing part 446 changes the display mode of the coordinate display area 63b depending on whether or not the degree of deviation of the positions of the first marks M1 to M3 and the second marks M4 and M5 from the reference positions is equal to or less than the predetermined value. Here, the comparison processing part 446 displays characters in an area 63c in the coordinate display area 63b in green if the degree of deviation is equal to or less than the predetermined value (if the workpiece 100 is placed normally as shown in
It should be noted that the angle formed by the virtual line connecting the second marks M4 and M5 with respect to the X-axis direction may be displayed in the coordinate display area 63b. Thus, the operator can check whether the lever 124 with the second marks M4 and M5 is in the fixing position (position shown in
The comparison processing part 446 causes a first report indicating that the workpiece 100 is located at the predetermined position on the placement surface 11 in a predetermined manner or a second report indicating that the workpiece 100 is not located in the predetermined manner to be reported. Specifically, the comparison processing part 446 causes the lighting part 64 to light up in a manner indicating the first report or to light up in a manner indicating the second report, when the workpiece 100 is returned to the stocker 20 after measurement.
The first lighting part 64a lights up if the workpiece 100 is located at the predetermined position in the predetermined manner, for example as shown in
It should be noted that, in the above, it was assumed that the lighting part 64 includes the first lighting part 64a and the second lighting part 64b, but the present disclosure is not limited thereto, and the comparison processing part 446 may make the first report and the second report with a single lighting part. For example, the comparison processing part 446 makes the lighting color for reporting the first report different from the lighting color for reporting the second report.
The flowchart in
Next, the delivery control part 443 of the control device 40 controls the robot arm 25 to move the workpiece 100 whose set button 65 is pressed down, from the stocker 20 to the predetermined position on the placement surface 11 (step S104). Specifically, the robot arm 25 moves the base plate 110 to which the workpiece 100 is fixed by the clamp 120 onto the placement surface 11.
Next, the imaging control part 444 causes the imaging device 30 to capture the first marks M1 to M3 and the second marks M4 and M5 when the workpiece 100 fixed to the base plate 110 is placed on the placement surface 11 (step S106). That is, the imaging device 30 captures the first marks M1 to M3 provided on the base plate 110 and the second marks M4 and M5 provided on the clamp 120 to generate the captured image.
Next, the image processing part 445 obtains the state data including the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 from the generated captured image (step S108). For example, the image processing part 445 obtains the three-dimensional coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 in the reference coordinate system. The reference coordinate system is coordinate axes set on the basis of the reference marks N1 to N4 captured by the imaging device 30 in advance, which is stored in the storage 42.
Next, the comparison processing part 446 compares the obtained coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 with the reference positions of the first marks M1 to M3 and the second marks M4 and M5 stored in the storage 42 (step S110). For example, the comparison processing part 446 obtains the degree of deviation of the coordinate positions of the first marks M1 to M3 and the second marks M4 and M5 relative to the reference positions.
Next, the comparison processing part 446 causes the reporting part 60 to report the result of the comparison made in step S110 (step S112). For example, the display part 62, which is the reporting part 60, displays whether or not the positions of the first marks M1 to M3 and the second marks M4 and M5 are appropriate. Specifically, the display 62 differs between the display color of the screen when the workpiece 100 is placed normally and the display color of the screen when the workpiece 100 is not placed normally. The operator can easily understand whether or not the workpiece 100 is placed normally by looking at the screen displayed on the display part 62.
Next, the measurement control part 442 controls the measuring device 10 to measure the workpiece 100 placed on the placement surface 11 (step S114). Specifically, the measurement control part 442 causes the coordinates of the workpiece 100 to be measured while bringing the surface of the workpiece 100 into contact with the detection part 15 of the measurement device 10 when the workpiece 100 is placed normally on the placement surface 11. It should be noted that the measurement control part 442 does not allow the coordinates of the workpiece 100 to be measured if the workpiece 100 is not placed normally on the placement surface 11.
Next, the delivery control part 443 controls the robot arm 25 to return the workpiece 100 placed on the placement surface 11 to the stocker 20 (step S116). Specifically, the robot arm 25 returns the workpiece 100 to a position where it had been before the workpiece 100 was delivered in step S104. After the workpiece 100 returns to the stocker 20, the comparison processing part 446 causes the lighting part 64 to light up. For example, if the workpiece 100 is placed normally on the placement surface 11, the first lighting part 64a performs the first lighting, and if the workpiece 100 is not placed normally on the placement surface 11, the second lighting part 64b performs the second lighting. Thus, the operator can easily check whether the workpiece 100 has been measured appropriately by looking at the first lighting or the second lighting.
The foolproof device 1 of the above embodiment causes an imaging device 30 to capture an object (the workpiece 100 fixed to the base plate 110 by the clamp 120) on which a plurality of identifiable first marks M1 to M3 and second marks M4 and M5 are provided, and obtains the state data including the coordinate position of each mark from the captured image captured by the imaging device 30. Then, the foolproof device 1 compares the current state data of each mark obtained with the reference data including the reference position of each mark stored in the storage 42, and outputs the result of the comparison concerning the first marks M1 to M3 and the second marks M4 and M5 to the reporting part 60.
Thus, the operator and the like can easily grasp whether the workpiece 100 has been appropriately placed and measured at the predetermined position on the placement surface 11 by checking the result of the comparison outputted to the reporting part 60.
The present disclosure is explained on the basis of the exemplary embodiments. The technical scope of the present disclosure is not limited to the scope explained in the above embodiments and it is possible to make various changes and modifications within the scope of the disclosure. For example, all or part of the apparatus can be configured with any unit which is functionally or physically dispersed or integrated. Further, new exemplary embodiments generated by arbitrary combinations of them are included in the exemplary embodiments of the present disclosure. Further, effects of the new exemplary embodiments brought by the combinations also have the effects of the original exemplary embodiments.
Number | Date | Country | Kind |
---|---|---|---|
2022-178042 | Nov 2022 | JP | national |