The invention in question, in a broader sense, is a part of the profile bending field and, in a more narrow sense, is a part of the automated profile bending process, where 3D cameras are applied to the profile bending machine with three and four rollers. The application of the 3D cameras enables the detection of the profile during the bending process, thus providing controlled management, regulation of control as well as correction of the bending process in real time. The application of the 3D cameras establishes a feedback loop between the computer which controls the bending process and the profile which is being bent on the machine, with the end goal to produce desired output, that is, profile bent to the predetermined angle, radius or diameter, at the end of the bending process.
According to the international patent classification the IPC marks of the patent are: B29 C 5308; G05B 19/19.
Technical problem, solved with the current invention, is how to detect the profile during the bending process on the bending machine with three and four rollers using the 3D cameras, thus achieving a feedback loop between the computer controlling the process and the profile bent on the machine. The 3D cameras provide a three-dimensional view of the bending process where each point of interest on the machine and on the profile is defined dimensionally and in space. The 3D cameras define the position of the profile in all three axes as well as the position of all points and objects of interest set in the area around machine. The application of the 3D cameras establishes a feedback loop which provides real time information to the computer regarding the profile being bent on the machine, that information being a current measured state which is being compared with the anticipated, that is, predetermined state. The application of the 3D cameras to the bending machine with three and four rollers provides controlled management, regulation of control as well as correction of the bending process, where, upon the initial 15° angle is bent, the initiated bending process is corrected if it is not being executed as anticipated, with the aim of achieving predetermined angle, radius or diameter of the bent profile when the controlled bending process is completed.
Bending machine for aluminum and pvc profiles, patent number RS 964U, does not utilize 3D cameras since it does not have microprocessor controlling system which is necessary in order to implement the 3D cameras. With this machine the profile bending process is done semi-automatically where the operator controls the bending process manually using buttons only. This type of machine control does not provide a feedback loop which can lead to a mistake by the operator when determining the desired radius or diameter of the arch as well as a mistake when positioning the profile during the bending.
Bending procedure shown in the patent WO 2009/101649 A2, where the method for checking and control a roller bending machine for continuously bending an elongated work piece at variable curvature radii and machine so controlled are presented, uses an encoder for measuring the movement of the profile on the machine. This method also employs a contactless device for measuring the distance in one point, used to send information to the computer regarding the distance between the sensor itself and the predefined spot on the elongated profile. The computer utilizes this information in order to calculate the radius of the bent part based on the measurements of the mentioned length in several passes and comparison of the calculated radius of the arch with the desired radius of the arch in the mentioned bent part. Unlike the invention in question where the feedback loop includes 3D cameras, within the abovementioned method the feedback loop includes a contactless device for measuring the length in one point. The contactless device for measuring the length in one point, used in the abovementioned method, differs from the invention in question since it does not have same options nor can provide same feedback to the computer as can be provided using the 3D cameras. First and foremost, the contactless device for measuring the length in one point measures the distance between the sensor and fixed predefined point on the profile, whereas the 3D cameras provide a three-dimensional view of the bending process to the computer in real time. Based on this information, the initiated process is being corrected if the bending is not being executed according the predefined plan with the aim of achieving previously determined angle, radius or diameter of the bent profile when the bending process is completed. Unlike the devices used in the abovementioned method, the 3D cameras applied to the machine with three rollers are able to define the position of the profile in all three axes as well as the position of all the points, that is, objects of interest in the area around the machine. What the 3D cameras connected with the computer can provide, in contrast to the devices in the abovementioned method, is the detection of outer and inner lines of the profile, determination of the current angle formed between the left and right side of the arch as well as detection of the position of the middle point of the arch. Unlike the devices in the abovementioned method, the 3D cameras connected with the computer can determine the beginning and the end of the bending process so that the straight parts of the arch are parallel at the end of the bending process, if that was requested. Furthermore the 3D cameras can determine if the arch is bent to the predetermined angle, radius or diameter, which is the aim of the invention in question. It should be emphasized that the contactless device for measuring the length in one point can provide only the measurement of the distance between the sensor and the point on the profile and with this it is not possible to calculate the current angle formed between the left and right side of arch during the bending process and therefore it is not possible to predict the angle, that is, the parallel position of the straight parts of the arch.
The improvement of the mentioned patent is shown in the patent document EP 2 248 611 A1 describing a bending machine for continuously bending an elongated work piece at predetermined radii using a 2D laser sensor. The 2D laser sensor can be described as an advanced version of the contactless device for measuring the length in one point, with the distinction that the 2D laser sensor performs measurement in several different points (usually 8 points) between the profile and the mentioned device. Similar to the patent document WO 2009/101649 A2, the 2D laser sensor is applied to this machine in order to detect the distance between the points on the profile and the sensor, and that information is being processed by the computer and converted into the radius of the arch, this being the aim of the mentioned machine. Purpose of the length meter or encoder, as mentioned, is to measure the length of the elongated profile, that is, the position of the profile during the bending. Unlike the devices used on the abovementioned machine, application of the 3D cameras in the invention in question provides a three-dimensional view of the bending process to the computer, where each point of interest on the profile and on the machine is defined dimensionally and in space. The 3D cameras applied to the bending machine with three rollers, contrary to the devices used on the abovementioned machine, are able to define the position of the profile in all three axes as well as the position of all the points and objects of interest in the area around the machine. For this purpose the 3D cameras with high lateral resolution are used, providing over 300000 measured points. Measuring the points of interest around the machine the distance between the 3D cameras and the profile being bent on the machine is dimensionally defined. The possibility to measure the points of interest in the area around the machine provides the information required by the computer in order to determine the position of the profile during the bending and current angle formed between the left and right side of the arch. Unlike the patent WO 2009/101649 A2 and EP 2 248 611 A1, the 3D cameras can provide the detection of the outer and inner lines of the profile, determine the current angle formed between left and right side of the arch, detect the middle point of the arch and predict the parallel position of the straight parts of the arch if that is required. Unlike the devices used on the aforementioned machines, the feedback loop formed between the 3D cameras and the computer can determine the beginning and the end of the bending process in such way to keep the straight parts of the arch parallel, if that is requested, while achieving predetermined angle, radius or diameter, this being the aim of the invention in question.
The application of the laser device for detecting the middle point of the arch to the bending machine, presented in the patent document RS 53431, introduces the manner of application of the laser device to the bending machine with three rollers. The application of the laser device during the profile bending process only provides the detection of the middle point of the arch, that is, the marked spot on the middle point of the arch part. The laser device used in the patent document RS 53431 and the 3D cameras used on the bending machine with three or four rollers have no similarities in the way they operate or in the measured values therefore the possibilities of each device are different. The invention in question provides a feedback loop for the afore-mentioned information used by the computer in order to manage, control and correct the bending process in real time, whereas the laser device is used exclusively for detection of the middle point of the arch, that is, the marked spot on the middle of the arch part during the bending process.
The essence of the invention in question is the application of the 3D cameras to the profile bending machine with three and four rollers for detection of the profile during the bending process, thus implementing the feedback loop formed between the computer, a system which controls the bending process, and the profile, an output being bent on the machine. Based on the information received through the feedback loop the computer is able to manage the process, to control it and correct it if the bending procedure is not being executed according to the predetermined plan. The profile detected utilizing the 3D cameras represents the measured state which is being compared by the computer with the anticipated, predetermined state and based on this comparison the computer adjusts initiated bending process. Information gained via the 3D cameras are forwarded to the computer, thus providing controlled management, regulation of control as well as correction of the bending process in real time. The application of the 3D cameras provides a three-dimensional view of the bending process where each point of interest on the machine is defined dimensionally and in space. With the 3D cameras it is possible to define the position of the profile in all three axes as well as to define the position of all points and objects of interest in the area around the machine. The application of the 3D cameras in a feedback loop with the computer provides the prediction of the bending process in order to get the straight parts of the arch parallel, if that is required, and bent to the predetermined angle, radius or diameter when the bending process is completed, this being the aim of the invention in question. The innovation of the invention in comparison to the existing state of the art is the application of the 3D cameras to the bending machine with three and four rollers, where the detection of the profile in all three axes establishes the feedback loop used by the computer for controlling the bending process in real time in order to get the desired output at the end of the bending process, that is, the profile bent to the predetermined angle, radius or diameter. The existing machines, processes and methods neither utilize nor apply the 3D cameras during the profile bending process.
The invention in question is presented in details in the following figures:
3D cameras (1) and (2) represent sensors which provide a three-dimensional view of the area around the machine (3) covered by their field of view. Unlike regular 2D cameras which assign colour to each pixel, or thermal cameras which assign temperature to each pixel, the 3D cameras (1) and (2) assign to each pixel the distance between the camera and the object seen by that pixel. In other words, 3D cameras (1) and (2) can be utilized for reliable detection of the size and shape of the objects in their field of view as well as for the detection of the distance of the objects from the camera. The 3D cameras (1) and (2) have lateral resolution, that is, the number of pixels in the matrix (similar to the regular cameras), as well as depth resolution, that is, the ability of the camera to determine the distance between the camera and the object for each pixel in the matrix. Up to now, several technologies using 3D cameras have been published, the most reliable being the Time-Of-Flight method, used for detecting the distance between the camera and the object by sending the modulated optical signal and measuring the time needed for the signal to reflect off the object and return back to the sensor. The second method utilizes triangulation, that is, a geometrical method which includes the usage of a collimated light source shifted aside from the 2D camera. The 2D camera detects the position of the optical signal in space and determines the distance of the object from the camera based on the detected position. The third method includes illumination of the scene using spatially encoded optical scheme which is being detected by a regular 2D camera, detecting the “deviation” of the encoded optical scheme and based on this detection the distance between the object and the camera is indirectly calculated. The fourth method of realization of 3D cameras implies the utilization of two regular 2D cameras shifted in space, where complicated computer algorithms are able to determine the distance of the objects in the field of view of the cameras based on the displacement of the pixels between the left and the right camera and the shadow (this method is usually referred to as the stereo vision). All of the abovementioned methods can be utilized for realization of the 3D cameras (1) and (2) on the profile bending machine with three and four rollers, wherein the detailed description of the methods surpasses the framework of the patent. The 3D cameras (1) and (2), realized according to one of the abovementioned architectures, are set on the holders (5) and (6) firmly fixed to the bending machine (3) with three or four rollers. The distance of the 3D cameras (1) and (2) from the profile (4) depends on the field of view and the desired length of the profile (4) that has to be detected. Typically, for cameras with 60° horizontal field of view and 40° vertical field of view the 3D cameras (1) and (2) are set vertically to the machine (3), 1.8 up to 2 m above the machine (3) and from there they monitor the profile (4) bending process, thus implementing the regulation of the control, that is the possibility to correct the bending process based on the feedback loop formed between the computer (7) and the profile (4) bent on the machine (3). The 3D cameras (1) and (2) can also be set horizontally or at a certain angle to the machine (3) with the aim of increasing the field of view, that is, enabling the detection of long profiles, when compared to the detection provided using a vertical construction. With 3D cameras with wide field of view the usage of only one 3D camera is also possible which would decrease the complexity of the system. The computer (7) is connected to the PLC device (28) using an electronic connection and its purpose is to control the engines which propel the rollers (8), (9), (10) and (25). Maximum length of the profile (4) detected utilizing the 3D cameras (1) and (2) aligned in this manner is around 4 m, not excluding the possibility of adding additional 3D cameras if deemed necessary. The 3D cameras (1) and (2) can be set vertically and/or horizontally to the machine (3), depending on the position of the machine (3). The control and correction of the bending process can also be achieved using only one or more 3D cameras where it is necessary to consider the field of view of the camera and the maximum length of the profile which has to be detected. The 3D cameras (1) and (2) set above the machine (3) utilize the principle of optical encoding explained in the patent US20100118123 A1 and, in addition, both TOF based cameras and cameras based on triangulation or stereo vision can be used with equal success. Therefore, the invention in question does not exclude the possibility of utilizing other types of 3D cameras which are not based on the principle of optical encoding. With the application of the 3D cameras (1) and (2) to the machine (3) the regulation of control of the automated bending process is achieved, wherein the computer (7) receives a three-dimensional view of the complete area observed by the 3D cameras (1) and (2) and the computer (7) distinguishes the information regarding the area where the profile (4) is positioned. It is possible to distinguish this information utilizing the 3D cameras (1) and (2) assuming that the distance between the profile (4) and 3D cameras (1) and (2) is known. Further processing of this information calculates the bending of the profile (4) in real time. The 3D cameras (1) and (2) provide a three-dimensional view to the computer (7) and using this data it is possible to receive and determine all necessary distances between the 3D cameras (1) and (2) and points of interest observed on the machine (3) and the profile (4). With the 3D cameras (1) and (2) it is possible to measure the position of the observed objects, that is, points in all three axes, thus defining the distance of each point of interest around the machine (3) dimensionally and in space. The application of the 3D cameras (1) and (2) enables a feedback loop for a significant amount of information needed by the computer (7) in order to control and, later on, correct the bending process, if the bending procedure of the profile (4) is not performed according to the predetermined plan. By measuring the points of interest in the area around the machine (3), the 3D cameras (1) and (2) detect the profile (4) during the bending process as a current measured state which is compared by the computer (7) with the desired state. Afterwards, the computer (7) determines needed correction using conventional laws of control (such as proportional-integral-derivative—PID regulation). The computer (7) corrects the bending process (303) in order to achieve predetermined output at the end of the bending process, that is, the profile (4) bent to the predetermined angle, radius or diameter. The predetermined parameters, angle, radius or diameter are input via terminal (13). One of the aims of the application of the 3D cameras (1) and (2) is the possibility of the computer (7) to predict the parallel position of the straight parts of the arch, simultaneously achieving predetermined angle, radius or diameter at the end of the bending process. The parallel position of the straight parts is achieved by the computer (7) correcting the initiated bending process upon bending initial 15°, using an implemented law of control, setting the value of dx (20) to the value necessary in order to get one half of the total predetermined angle required at the end of the bending process on the middle of the X zone (14). The same method of adjusting the value of the dx (20) is used to achieve the parallel position of the straight parts of the arch, adjusting the radius at the middle point of the X zone (14) to the half value of the total predetermined radius, required at the end of the bending process. Utilizing the 3D cameras (1) and (2), which represent the feedback loop within the bending process, the computer (7) determines the current position of the profile (4) along the X axis during the bending process, based on the distance shift between the profile (4) and the rollers (8), (9), (10) and (25) and fixed points on the machine (3). Utilizing the 3D cameras (1) and (2) the computer (7) calculates the angle formed between the straight parts on the left and right side of the arch, based on the detection of the position of the points (18) and (19) which are the staring bending points of the profile (4). Utilizing the 3D cameras (1) and (2) the computer (7) determines what kind of material is bent on the machine (3), based on the comparison of the angle achieved between the straight parts of the arch upon bending initial 15° and the predetermined angle of the arch. Using this information the computer (7) determines the corrective parameter of elasticity defined by the type of the material being bent on the machine (3). Utilizing the 3D cameras (1) and (2) the computer (7) calculates the elongation of the profile (4) during the bending process, based on the difference between the calculated length of the arch part (12) and current measured length of the arch part (12) defined by the points (18) and (19) on the profile (4). Utilizing the 3D cameras (1) and (2) the computer (7) determines the position of the rollers (8), (9), (10) and (25) rotating on the machine (3) based on the detection of the rotation and straightforward movement of the auxiliary rollers (15), (16), (17) and (26) set on the top edges of the rollers (8), (9), (10) and (25). Utilizing the 3D cameras (1) and (2) the computer (7) determines the point (24) which represents the middle point of the profile (4), based on the detection of the points (22) and (23) set on each end of the profile (4). Utilizing the 3D cameras (1) and (2) the profile (4) is being automatically positioned to the point (24), defined as the middle point of the profile (4) by the computer (7), at the beginning of the process. Utilizing the 3D cameras (1) and (2) the computer (7) defines the point (24), also representing the middle point of the arch, based on detecting the position of the points (18) and (19) set on both ends of the arch part (12) being the starting points of the bending process for the profile (4). The application of the 3D cameras (1) and (2) for detecting the profile (4) enables the computer (7) to calculate the radius of the arch during the bending process, based on the angle and the position of the points (18) and (19) set on the ends of the arch part (12). Utilizing the 3D cameras (1) and (2) the computer (7) calculates the amount of slipping of the profile (4) compared to the encoder (11), based on the difference between the distance travelled by the profile (4) measured by the 3D cameras (1) and (2) and the distance travelled by the profile (4) measured by the encoder (11). By comparing these two values it is possible to calculate if and for what amount did the profile (4) slip compared to the encoder (11). The application of the 3D cameras (1) and (2) enables the computer (7) to determine the amount of slipping of the profile (4) during the bending process compared to the rollers (8), (9), (10) and (25), based on the difference of the distance travelled by the profile (4) measured with the 3D cameras (1) and (2) and the distance travelled by the auxiliary rollers (15), (16), (17) and (26) together with the rollers (8), (9), (10) and (25) during the bending process. In this manner, utilizing the feedback loop, the movement of the profile (4) through the machine (3) is determined and corrected if the profile (4) slipped during the process compared to the rollers (8), (9), (10) and (25). Utilizing the 3D cameras (1) and (2) the computer (7) gains information regarding the obstacles (27) in the area around the rollers (8), (9), (10) and (25) thus providing security measures for the bending process and the operator managing the machine (3). In this manner the bending process can be temporarily stopped, every time when hand of the operator or object which is not an integral part of the machine (3) or the process is detected in the critical zone around the rollers (8), (9), (10) and (25), on the same height as the rollers. Here it is important to underline that only the utilization of the 3D cameras can provide unequivocal information if the detected obstacle (27) is on the height of interest, that is, if the detected person or object represents a safety issue for the operator and/or profile (4) bending process. Utilizing the 3D cameras (1) and (2), the computer (7) receives information regarding the obstacles (27) around the profile (4) which are on the same height or higher than the profile (4). If the 3D cameras (1) and (2) detect the obstacle (27) or object within the critical distance from the profile (4), the machine (3) temporarily halts the bending process, presuming that the profile (4) can collide with the unknown object, leading to a detection error of the profile (4) length and position, thus potentially endangering the profile (4) bending process and creating a safety risk for the surrounding area. Utilizing the 3D cameras (1) and (2) the computer (7) calculates the width and height of the arch or chord and height for the circular section or segment of the circle. Width and height of the arch are calculated by the computer (7) based on the information regarding the achieved angle of the arch, radius of the arch and position of the points (18) and (19). Utilizing the 3D cameras (1) and (2) the computer (7) detects different radii within one arch, based on the information regarding the achieved angle of the arch and position of the points on the arch part (12) where one radius ends and another begins. Utilizing the 3D cameras (1) and (2) the computer (7) detects current length of the arch part (12) during the bending process, based on the detection of the points (18) and (19) on the profile (4). Points (18) and (19) represent starting bending points of the profile (4), that is, the point where straight part of the profile (4) ends and the arch part begins. Utilizing the 3D cameras (1) and (2) the computer (7) determines the initial position of the profile (4) before the bending process starts, based on the detection of the angle alteration between the straight parts of the profile (4). The moment when the angle between the straights parts of the profile (4) alters represents a starting point of the profile (4) bending. As soon as the profile (4) is bent for 2°, the roller (10) is moved back for the same distance that caused the alteration of the angle, thus determining the zero, that is, the initial position of the profile (4). Utilizing the 3D cameras (1) and (2) the computer (7) ends the bending process when the predetermined angle, radius or diameter of the arch is achieved, based on the comparison of the current detected angle, radius or diameter of the arch with the predetermined angle or radius of the arch performed by the computer (7). Utilizing the 3D cameras (1) and (2) the computer (7) determines the total length of the profile (4) before the bending process is initiated, based on the detection of the end points (22) and (23) on the profile (4). Utilizing the 3D cameras (1) and (2) and with the assistance of the computer (7) the encoder (11), that is, the device for measuring the length of the profile (4), is calibrated if it is already being used on the machine for any reason. The calibration of the encoder (11) is performed by moving the profile (4) from one end to the other and comparing the movement of the profile (4) detected by the 3D cameras (1) and (2) with the movement of the profile (4) measured by the encoder (11) using the computer (7) and, based on this comparison, the computer (7) defines the relation, that is, the correctional parameter between these two devices. The application of the 3D cameras (1) and (2) eliminates the need for the encoder (11) utilization which is used only for measuring the length of the profile (4) during the bending process. Immediately upon activating the machine (3), the 3D cameras (1) and (2) are calibrated in order for the computer (7) to determine their exact position, location and the angle between them, the machine (3) and the profile (4). When the calibration of the 3D cameras (1) and (2) is completed, the profile (4) is set between the rollers (8), (9), (10) and (25). The 3D cameras (1) and (2) form a feedback loop during the bending process where the computer (7) calculates the rotating speed of the rollers (8), (9), (10) and (25), based on the detection of the distance travelled by the auxiliary rollers (15), (16), (17) and (26) set on the edges of the rollers (8), (9), (10) and (25). Utilizing 3D cameras (1) and (2) the computer (7) calculates the width of a profile being bent on the machine (3), based on detection of the distance between the points on the outer and inner edges of the profile (4). Utilizing the 3D cameras (1) and (2) the computer (7) defines the shape of a profile being bent on the machine (3), based on the three-dimensional view detecting the shape and outlines of the profile (4) on its ends. Based on the abovementioned data received utilizing the 3D cameras (1) and (2) the computer (7) is able to predict and correct initiated profile (4) bending process upon bending initial 15°, if the bending process is not developing according to the predetermined plan, with the aim of obtaining the profile (4) bent to the predetermined angle, radius or diameter as the end result of the bending process. The 3D cameras (1) and (2) control the bending process according to the parameters input via terminal (13) prior to the bending process. When the parameters are given the automated bending process is initiated according to the defined iterative regime meaning that the profile (4) has to go through the bending rollers (8), (9), (10) and (25) for a predefined number of times, where the rollers (10) and (25) gradually move towards the profile (4) for a dy (21) step, thus, together with the remaining two rollers (10) and (25), leading to a gradual bending of the profile (4). If, upon bending initial 15°, the bending process is not developing according the predetermined plan the computer (7) corrects the bending process through conventional laws of control (such as proportional-integral-derivative—PID regulation) using the current value of the 15° angle between the left and the right side of the arch in order to correct the value of the dx (20), which represents the distance for which the movement of the profile (4) within the arch part (12) is shortened each time when the profile (4) moves from left to right and vice versa. The computer (7) calculates and corrects the dx (20) so that the absolute half of the predetermined, that is, expected angle of the arch is reached on the middle point of the X zone (14). In the same manner the correction of the dx (20) value can be calculated by the computer (7) based on the detection of the radius of the arch at the beginning of the bending process. X zone (14) is set symmetrically on both ends of the arch part (12). Inside X zone (14) the roller (10) executes the movement for the dy (21) value towards the profile (4), symmetrically on the left and right side of the profile (4). The length of the X zone (14) ranges from 150 up to 200 mm. The length of the X zone (14) depends on the type of the material and width of the profile (4) bent on the machine (3). The application of the 3D cameras (1) and (2) on the bending machine (3) with three and four rollers (8), (9), (10) and (25) realizes the aim of the invention in question, the aim being the automated control of the process from the beginning to the end, with the profile (4) bent to the predetermined angle, radius or diameter.
Number | Date | Country | Kind |
---|---|---|---|
P - 2014/0682 | Dec 2014 | RS | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2015/051368 | 2/24/2015 | WO | 00 |