This application claims priority of No. 109115016 filed in Taiwan R.O.C. on May 6, 2020 under 35 USC 119, the entire content of which is hereby incorporated by reference.
The invention relates to a racket stringing system, and more particularly to a fully automatic racket stringing system for pre-positioning coordinates of racket string holes and using a robot arm to finish stringing and tying operations.
Various existing types of racket stringing methods are artificial. On the market, the racket stringing machine is used to only assist the racket stringing technician to perform racket stringing, and does not possess the fully automatic stringing ability. However, the stability of the racket depends on the skill of the racket stringing technician, and the stringing operation of one racket cannot be finished until more than a half hour of time has elapsed. So, the racket production or the racket string replacement cannot have the increased throughput or the replacement speed.
An objective of the invention is to provide a fully automatic racket stringing system capable of inspecting whether the racket is abnormal.
An objective of the invention is to provide a fully automatic racket stringing system capable of detecting relative coordinates between racket string holes and a robot arm.
An objective of the invention is to provide a fully automatic racket stringing system capable of using the robot arm to cut off a racket string.
An objective of the invention is to provide a fully automatic racket stringing system capable of using the robot arm to pull a racket string with a required tension.
An objective of the invention is to provide a fully automatic racket stringing system capable of using the robot arm to twine or tie the racket string.
The invention provides a fully automatic racket stringing system including: two lens modules respectively capturing, at different two angles, a racket string hole on a racket at a first predetermined position, wherein the lens modules determine a first relative coordinate of the racket string hole according to the angles and a triangulation; and a control unit controlling a robot arm to grip the racket from an initial position, and to move the racket and place the racket at the first predetermined position; wherein the control unit controls the robot arm to move to a second predetermined position to grip a first end of a racket string, wherein after the first end of the racket string extends a predetermined length, the robot arm performs cutting off; wherein the control unit controls the robot arm to grip the first end or a second end of the racket string to pass through the racket string hole according to the first relative coordinate, or the control unit controls the robot arm to grip the first end or the second end of the racket string to tie in the racket string hole according to the first relative coordinate.
In one embodiment of the invention, after the control unit controls the robot arm to grip the racket, the robot arm moves the racket to a position in front of the lens modules, and an image of the racket is captured by the lens modules and compared with an abnormal racket database pre-stored in the control unit, wherein if the control unit judges as abnormal, then the robot arm moves the racket back to the initial position or moves the racket to the second predetermined position.
In one embodiment of the invention, the fully automatic racket stringing system includes: a racket string supplying unit, wherein the racket string is wound around the racket string supplying unit to make the first end of the racket string be located at the second predetermined position; and a racket string fixing unit for fixing the second end of the racket string after being cut off at a third predetermined position.
In one embodiment of the invention, when the second end of the racket string is fixed to the third predetermined position, the control unit controls the robot arm to grip the first end according to a second relative coordinate, and the control unit controls the robot arm according to the first relative coordinate to make the first end pass through the racket string hole.
In a first step, the control unit is initialized.
The power is turned on, and programs installed in the control unit are executed to enable the image capturing device to set the pounds (tension), to set the numbers of longitudinal and transverse holes for stringing, and to set to inspect and detect whether a time interval for a to-be-strung racket frame is present. The programs installed in the control unit include the program for inspecting the integrity of the racket, the program for detecting string head coordinates, the program for picking the string head, the program for detecting coordinates of racket string holes, the program for longitudinal stringing, the program for traverse stringing, the tying program (including the program for gripping the racket string), the program for cutting, the stringing process monitoring program, the program for abnormal alarm, the program for abnormal processing, and the database, such as the empty racket frame and various abnormal racket states, for program execution.
In addition, the stringing process monitoring program utilizes the lens modules 10a and 10b to fully monitor whether the robot arm has malfunction or not due to the accident, such as the string head falling or foreign object entering the working place. If yes, the current condition is recovered, and the processes are re-executed. Alternatively, if the force majeure, such as the machine failure or the broken racket, is present, then the alarm signal (audio or red light flashing signal) is outputted, and the stringing operation is stopped. The accident and the abnormal phenomenon or state are stored in the database of the control unit 11.
In a second step, it is detected whether a to-be-strung racket is present or not.
The control unit 11 adopts the lens modules 10a and 10b to detect whether the to-be-strung racket is present on a racket frame or not, wherein the lens modules 10a and 10b are fixed to the specific position, such as the racket frame W, as shown in
In a third step, the robot arm picks up the racket.
The robot arm 12 grips the racket and places the racket right ahead the lens module 10a or 10b to facilitate the subsequent inspection process. In one embodiment, because the racket frame and the lens modules 10a and 10b are fixed at the specified positions, the robot arm 12 can accurately and correctly perform this process with or without the lens modules 10a and 10b.
In a fourth step, the racket is inspected.
The objective of this step is to judge the integrity of the racket, and judge whether the stringing operation can be performed, wherein the integrity of the racket and the abnormality are pre-stored in the database of the computer. Basically, the surface of the racket having sharp lines, the incomplete circle of the racket string hole, or the skew phenomenon pertains to the abnormality. The control unit 11 controls the robot arm 12 to place the racket in front of the image capturing device, the robot arm 12 can rotate 180 degrees, 360 degrees or any other angle, and the lens module 10a or 10b is used to perform the comparison with the abnormal racket database stored in the control unit 11 to judge whether the racket has been strung or not (i.e., whether the abnormal condition is present). If the racket string is still present on the racket or the abnormality is judged, then the racket is moved back to the racket frame.
In one embodiment, the abnormality of the racket further includes the unbalanced racket, the crack, the broken racket, the skew and the like. The appearance of the racket can be inspected using the lens module 10a or 10b to detect whether it is horizontal. If the racket is placed horizontally, then the lens module 10a or 10b is moved in the X-axis horizontal direction. If the racket is normal, then the racket should have the constant Y-axis value. In another embodiment, the lens module 10a or 10b detects that the racket has the suspicious crack, the racket can be directly returned or the robot arm 12 may be further used to slightly touch the racket frame for confirmation (the robot arm similarly acts as a probe). A positive inspection method may also be used to input the characteristics of the normal racket, and any racket, which does not satisfy the normal characteristics, is judged as abnormal.
In a fifth step, the racket is placed at a predetermined position.
In a sixth step, the stringing is prepared.
When the control unit 11 starts up the string head recognition program, the control unit 11 controls the robot arm 12 to move to the second predetermined position to grip the first end P of the racket string. In this embodiment, the second predetermined position is set as the position of the racket string supplying unit 13. That is, the robot arm 12 moves to the racket string supplying unit 13 to grip the string head of the racket string. After the first end P of the racket string extends a predetermined length, the robot arm 12 performs cut off to obtain the racket string with the predetermined length.
At present, the racket stringing methods include a one-string method and a two-string method. The one-string method needs to cut off the racket string with a length of ten meters. In the two-string method, the longitudinal racket string generally needs to be 5.5 meters to be cut off, the length of the longitudinal string to be cut off is about 8.5 times of the total length required by the longitudinal string; and the traverse string generally needs 4.5 meters to be cut off, and the length of the traverse string to be cut off is about 6.5 times of the total length required by the traverse string. In one embodiment, the lens module 10a or 10b captures the first end and a second relative coordinate of the first end is calculated, and the position of the second end is calculated according to the predetermined length. Alternatively, a measurement ruler is used, and when the robot arm 12 grips and fixes the first end using the racket string fixing unit 14, and pulls the racket string by the predetermined length, the lens module 10a or 10b assists in confirming that the predetermined length is correct. Then, the robot arm 12 performs cut off, and finally the string head of the second end is gripped using another racket string fixing unit 14.
Please note that the longitudinal string is defined to be parallel to the racket handle 21, and the traverse string is defined to be perpendicular to the racket handle 21 in this embodiment.
There will be more possible stringing methods according to the fully automatic racket stringing system 100 because the three-string method, the four-string method or the multi-string method may also be implemented. In order to prevent the too-long string from falling in the stringing process, a hub may be provided to hold and protect the safety of the string, and to maintain the quality of the string while preventing the racket string from being V-shaped folded to affect the stringing quality. In addition, there may be two or more than two robot arms 12 to speed up the stringing operation.
In a seventh step, the position of the racket string hole is detected.
For example, if the coordinate of the lens module 10a is at the original (0,0,0), then the lens module 10b is set to be distant from the original in the X-axis direction by 6 units. That is, the lens module 10b is at the coordinate (6,0,0), the lens module 10a obtains the coordinate (U0=2) of the projection plane of the racket string hole O, and the lens module 10b obtains the coordinate (U1=4) of the projection plane of the racket string hole O. When the distance (b=6) is present between the lens module 10a and the lens module 10b, the focal length distance from the lens modules 10a and 10b to the projection plane is represented by f=2. So, the distance between the two projection planes is represented by d=U1−U0=2, and the first relative coordinate of the racket string hole O relative to the lens module 10a is represented by:
Z(depth)=f×b/(b−d)=2×6/4=3
X=U0×Z/f=2×3/2=3
Y=y0×Z/f=0×3/2=0 (the heights are the same in this example and equal to 0).
In this case, the first relative coordinate of the racket string hole O is (3,0,3).
The objective of this step is to obtain the XYZ coordinate position of the racket string hole through multiple ways, such as the lens module, an infrared device, an acoustic wave detection device, a touch probe device or the like, and to obtain the XYZ (three-dimensional) coordinate position of the racket string hole.
In one embodiment, the structured-light active depth sensing technology is adopted to emit a specific pattern onto an object, a camera module receives pattern light coding from the surface of the object surface, the received results are compared with the original emitted pattern, and the three-dimensional (3D) coordinate of the object is calculated according to the triangulation principle. Upon the stringing application, the specific pattern is emitted onto the racket frame, the image recognition software is used to confirm the circular hole, the lens module receives the specific pattern light coding from the racket string hole, and the triangulation principle calculates the XYZ (three-dimensional) coordinate of the racket string hole.
In another embodiment, the time of flight (TOF) active depth sensing technology is utilized to calculate the distance to the racket string hole according to the time of flight of the infrared (IR), and thus to obtain the 3D depth of field. The basic components include an IR transmitter, an IR receiver, a RGB camera module and photosensitive members or a sensing array. Upon the stringing application, the TOF 3D camera is used to align with the racket frame, and the image recognition software is utilized to determine the circular hole. Applying the TOF 3D camera to align with the center of the racket string hole, the lens module displays the XYZ coordinate value of the center of the circular hole through the configuration software.
The lens module 10a or 10b in front of the racket performs image capturing, and the captured image is returned to the control unit 11. The control unit 11 analyzes the received image to obtain the position information of the racket string hole of the racket frame. The racket string hole can be determined by comparing the database of the racket string hole model, pre-stored in the control unit, with the image returned from the image capturing device, or utilizing the computer circle-recognition software program, or comparing the pre-stored circular hole data of the racket, such as the possible diameters, radii, dimensional ranges of the circular holes. It is also possible to determine the circular hole on the racket by utilizing the circular hole recognition software of the market-available image recognition software, such as Talkwalker, Proprietary image recognition technology, Google ReverseImage Search, Google API Cloud Vision, Amazon Rekognition, Clarifai, LogoGrab, IBM Image Detection, Imagga'Cloudsight, EyeEm and the like. After the racket string hole has been determined, the control unit 11 utilizes the lens modules to capture two images to constitute the 3D image, and then the precise 3D (X, Y, Z) coordinate of the center of the racket string hole can be obtained.
The lens module recognizes the racket string hole to obtain the XYZ coordinate by one, two or multiple cameras, 3d cameras, ToF cameras, and different sensing detectors may be combined to achieve this goal. For example, the camera and the laser collocate with each other, the camera and the acoustic wave collocate with each other, the camera and the probe collocate with each other, or multiple sensing detectors collocate with each other.
In an eighth step, the stringing operation is performed.
Similarly, the second end of the racket string (i.e., the other string head) may also be operated at the same time as mentioned hereinabove, wherein the robot arm 12 starts from the upright middle portion of the racket frame, and sequentially extends toward two sides to string due to the balanced consideration of the tension, so that the longitudinal stringing process is performed. In the stringing process, when the two ends of the racket string are not on the robot arm 12, the two ends of the racket string are always placed on the racket string fixing unit 14.
The robot arm 12 can directly pull the string to the required pounds according to the string-pulling pounds (e.g., 26 pounds) in the initial setting parameters. In another embodiment, a tension string puller is used to pull the racket string to reach the required pounds. After the robot arm 12 or the tension puller has pulled the racket string to the predetermined position, the racket string fixing unit 14 automatically fixes the racket string satisfying the tension strength. In one embodiment, the racket holder T may be satisfied by a simple type robot arm, which is movable in any direction to clamp the racket string, so that the robot arm 12 can perform the stringing for the next racket string hole, and sequentially finish the longitudinal stringing.
In a ninth step, tying is performed after the longitudinal stringing is finished.
In a tenth step, the traverse stringing starts, and the string is cut after tying.
The traverse stringing needs not to start from the racket string hole in the middle region of the racket. That is, the stringing can start from the racket string hole in the top region of the racket, or the racket string hole in the bottom region of the racket. When the traverse string passes through the longitudinal string, the lens module 10a or 10b needs to be used to confirm whether the traverse string and the longitudinal string form the alternate stringing (i.e., the traverse string passes by and above the longitudinal string at a first time, and passes by and below the next longitudinal string, and so on until the racket string holes on the racket frame are strung). The operation method is the same as the tying and cutting of the longitudinal stringing after the stringing is finished, and detailed descriptions thereof will be omitted here.
In summary, the invention utilizes the fully automatic racket stringing system to achieve the full automatic process without the artificial stringing, can increase the stability and consistency of the racket, and thus can increase the throughput of the racket. In addition, when the racket has the broken racket string in the used process, the replacement of the racket string on the racket also has the huge market business opportunity. The invention can be used when the new racket is being manufactured and when the racket string of the old racket needs to be replaced.
Number | Date | Country | Kind |
---|---|---|---|
109115016 | May 2020 | TW | national |
Number | Name | Date | Kind |
---|---|---|---|
20120072021 | Walser | Mar 2012 | A1 |
20170080298 | Yadav | Mar 2017 | A1 |
20190175994 | Williams | Jun 2019 | A1 |
20200173777 | Pivac | Jun 2020 | A1 |
20200318946 | Wolke | Oct 2020 | A1 |
Number | Date | Country |
---|---|---|
2740046 | Apr 1997 | FR |
20190026508 | Sep 2017 | KR |
202009039 | Mar 2020 | TW |
WO-2018109713 | Jun 2018 | WO |
Number | Date | Country | |
---|---|---|---|
20210346770 A1 | Nov 2021 | US |