Patent Application
20230419502
The invention relates to a computer-implemented method for evaluating sensor information of a tool, in particular of a tool suitable for soil cultivation.
In the course of increasing automation, the monitoring of mechanically stressed components, such as tools for soil cultivation, is frequently coupled to optical systems. In agricultural engineering, the monitoring of wear-intensive tools, for example for soil cultivation, is frequently not yet sufficiently achieved. The prior art is the visual monitoring and assessment of wear parts by the machine operator. Sensor systems, e.g., optical systems, are also increasingly used for monitoring and valuation. In addition to mere monitoring, the valuation of the current condition of the monitored tool is also of crucial importance. The valuation with respect to the degree of wear frequently takes place by means of wear marks as a mechanical embodiment at critical locations of the respective tools or simply by means of operating hours counters. In the prior art, there are also solutions which operate by means of photo-optical comparisons, with the exception of agricultural engineering. Here, no systems that monitor the tools for soil cultivation photo-optically have been known so far.
U.S. Pat. No. 6,479,960 B2 discloses a machine tool in which, even with a low cutting load and/or low strength of a tool, it can be established automatically whether the tool is defective or not. Furthermore, the miniaturization of such a machine tool is described with the purpose of achieving a cost saving. According to the primary aspect, the machine tool comprises a photographing unit, which photographs an image of the tool, and a determination unit, which determines whether or not the tool is defective based on the images obtained from the photographing unit. In this case, a defective tool is detected without contact on the basis of an image comparison.
DE 10 2008 045 470 A1 describes a method for ascertaining the wear condition of a milling tool, in particular a bit, a bit holder and/or a bit holder changing system. For this purpose, the position of at least one point of the bit and/or of the bit holder is ascertained by means of a measuring method. The measurement result or a calculation of the measurement result is compared in a switching unit to at least one reference value stored in a storage unit.
AU 2014262221 B2 discloses a method and tool for monitoring the condition, the maintenance condition and the performance of wear parts that are used in soil cultivation devices. The process and the tool enable the operator to optimize the performance of the soil cultivation device. During use, the tool has a clear positional relationship to the wear parts and is used together with a blade or a shield on the soil cultivation device. The entire monitoring system comprises an excavator bucket with walls defining an enclosure portion for collecting soil materials, a digging edge, at least one wear part fastened to the digging edge, at least one electronic sensor fastened to one of the walls, and a programmable logic device. The logic device receives information from the at least one electronic sensor and determines the conditions of the presence of the bucket, the maintenance condition or the degree of wear, the filling and performance of the bucket and/or of the at least one wear part.
The photo-optical methods mentioned are solely dependent on photographs of the machines/parts or tools to be monitored. In moving machines/parts or tools, these photographs are often subject to large disturbing influences due to their movement. These disturbing influences are amplified by additional image information, e.g., by an uneven background. The use of operating hours as a measure of wear is a static variable which does not in any way take account of the actual condition of the tool to be monitored.
The use of wear marks always requires an additional work step in the production of tools or the working machines to be monitored.
The object of the invention is therefore to overcome the obvious disadvantages of the prior art, to customize the monitoring and valuation of tool conditions, and to make them independent of disturbing influences.
The object is achieved by the features of the independent claims. Preferred embodiments are the subject matter of the dependent claims in each case.
To this end, according to the invention, a computer-implemented method for optically sensing, for detecting and quantifying relevant conditions and/or their changes on at least one target object has the following steps:
For example, but not exclusively, digital image information is converted into the frequency space by means of a fast Fourier transform. The portions of the thus calculated frequency data set that describe the color changes and/or contrast changes with a high temporal fluctuation are removed.
According to the invention, the background and the target object are thus distinguished by means of a higher rate of change of the image information. Here, the extent of the change in image information over a particular time period in relation to the duration of this time period is understood as the rate of change of the image information, and the rate of change of the image information is thus a measure of how quickly image information changes. As a result of the relation to the time period, the unit of measure contains a time unit in the denominator, and a unit of the image information, e.g., a byte, is in the numerator.
In the following, the target object is the object that is subjected to opto-sensory monitoring. In general, tools for soil cultivation are understood here as a non-exhaustive example.
In the following, “relevant conditions” are understood to mean the conditions of the target object that are considered to be relevant in an application-specific manner. Thus, for example, but not exclusively, the degree of soiling can be classified as relevant if the possibility for opto-sensory sensing is thereby impaired too much. Loss, destruction, deformation, displacement, soiling and/or wear thus also fall into the category of the relevant conditions. It is also conceivable that no change to the target object is classified as relevant.
Image segmentation is understood to mean a partial area of digital image processing. In this case, the generation of regions connected in terms of content by combination, in pixels or voxels, corresponding to a freely selected criterion is referred to as segmentation.
In embodiments of the invention, the position of the target object and/or of the section of the target object relative to the edges of the image does not change on average over time. Thus, it is easier for the algorithm to carry out image segmentation and to identify the target object or the section of the target object.
In embodiments of the invention, the determination of the position of the target object relative to the edges of the image is made more difficult by a vibration movement. By adapting the sampling rate of the camera to higher harmonics of the vibration and/or changed sampling, a condition of relative constancy of the distances of the target object from the image edges is produced. Frequently, software adaptations in the algorithm that controls the camera controller or the sampling rate thereof are sufficient. This is advantageous since no changes to the embodiment of the actual sensor system have to be carried out in this way.
In embodiments of the invention, the optical sensor system is supplemented by a stroboscopic light source. In this case, the frequency of the light flashes is selected in such a way that the illuminated target object appears to be relatively constant with respect to the edges of the image or with the drift movement distinguishable from the movement of the background. This is advantageous since objects guided periodically past the optical sensor system can thus also be made accessible to the method.
In embodiments of the invention, a plurality of image sequences is recorded according to the invention. These image sequences are divided into different sequences. After the subdivision into sequences, at least one sequence of the image sequence is subjected to a method for averaging image information in order to improve the image quality of the sequences. The methods for averaging image sequences are, for example, but not exclusively, a sliding weighted average (mi=ni*x+ni-1*(1−x)) or Gaussian filter to {ni, . . . , ni-x}, and the weights or parameters are in this case dependent on the image frequency in order to compensate for errors in the sampling rate. If more than one averaging is used in parallel in the case of differently broad frequency bands of the sampling rate, this is the basis for the band-pass filtering which already represents the central segmentation.
This is advantageous since a further reduction of the systematic error source of the random movements of the target object, e.g., unwanted vibrations caused by shaking or by coupling in resonant motor frequencies, is brought about in this way. This increases the efficiency of the entire method in a simple manner since the interesting object properties are precisely not in the frequency spectrum and the amplitudes of the machine vibrations and movements and thus identify themselves very easily.
In embodiments of the invention, the comparison object contains the measurement data of the geometric object information for comparison with the target object from a normal reference.
In embodiments of the invention, the normal reference comprises a model adaptation to possible condition classes. Thus, for example, a target object, or tool, in operation is checked with respect to its degree of wear. If a user finds the latter to be suitable despite significant signs of wear, the model to be referenced and the associated model data are adapted to this condition.
This is advantageous since a locally valid reference can be created in this way even in the event of data loss during operation. The method is thus enabled to calibrate itself independently of calibration standards and to check against that calibration.
In embodiments of the invention, self-referenced model data are used to achieve the best possible condition with correction algorithms and to in this way create a calibration standard autonomously. This is advantageous since, in the case of a tool change, individual adaptation to the changed system can thus be performed.
In embodiments of the invention, the comparison object is available as a virtual comparison object in all classifications of the condition. Thus, for example, but not exclusively, a database is created in which all error messages that previously occurred are stored with the associated sensor data and virtual data. By comparing the data within a fault class, it is thus advantageously possible to provide a detailed model of the respective fault class for comparison or as a comparison object. Self-learning and self-improving these comparison objects is also advantageously made possible in this way.
In embodiments of the invention, the geometric object information of the comparison object is available from model data. In this case, for example, but not exclusively, at least one true-to-scale model of the target object to be monitored is produced as a real embodiment. On the basis of such models, possible different fault classes are represented and investigated with regard to the resulting dimensions or are used, for example, but not exclusively, by means of a direct image comparison of model and target object.
In order to perform the computer-implemented method, data processing units are used which are connected locally at the place of use and/or via remote transmission to the necessary sensor systems for data recording. Furthermore, computer-readable storage media in which a computer program product suitable for executing a computer-implemented method are used to, likewise, but not exclusively, store the comparison data of the individual fault classes.
Output values of the computer-implemented method can serve as input parameters of a regulating and/or control unit.
Thus, for example, but not exclusively, an exemplary test setup is monitored by the method. The tangible equivalent of the system is located in an environment which enables sensory monitoring only to a limited extent. If output values for particular fault classes are now obtained from the model test, they can be transmitted to the regulation or control, for example by hand, from the model test to the control of the real system.
In order to realize the invention, it is also expedient to combine the above-described embodiments and the features of the claims.
In one exemplary embodiment, the condition of the individual tools of an agricultural device for soil cultivation (here a spring tine cultivator) on a support frame (1) is assessed according to the method according to the invention. For this purpose, the optical sensor (4) is mounted on the support frame (1). The sensor (4) is, as it were, connected to a valuation unit, the computer (5), in such a way that the sensor data can be transmitted according to the invention. A tool module (2), which carries the individual tools (3), is, as it were, mounted on the support frame (1). In one embodiment of the invention, however, the support frame (1) can also contain only a plurality of individual tools (3) that are directly connected to the support frame (1) without a tool module (2). The number of optical sensors (4) and of individual tools (3) is at least one. Thus, different numbers of sensors are possible for different requirements from the measurement task.
With the aid of the sensor (4), at least one tool (2), which forms the target object, is sensed. At the same time, the background (6) is likewise sensed in the sensor section.
In this case, the individual tool and/or the entire tool module satisfies the requirements and does not require any actions.
If a wear limit value is reached or exceeded, a status message is output and, at the same time, a measured value is ascertained, which provides, to the user or a control, information about the remaining working time until an action is necessary, for example. A tool break, e.g., also represents a wear condition, which, however, occurs suddenly and not in a continuously progressing manner. This condition is thus a special case of condition 2.
If an overload of the tool subsequently occurs, a lateral displacement or dislocation of the tool can occur, which in turn has a negative effect on the work result. An immediate action can be derived therefrom if a permissible limit value has been exceeded. A status message with possibly a measured value is output to the operator or the control.
Overloading the tool can also cause a permanent deformation in the tool, which can be negative for the desired work result. Therefrom, the system generates a status message indicating whether the shape of the tool is within predefined limits.
If soiling of the tool occurs as a result of harvesting residues or the like, characteristic geometric shapes can no longer be detected. In this case, it is not possible to determine measured values. Here, the system must provide a status message about the soiling in order to initiate countermeasures.
With the sensor system according to the invention, a wide variety of shapes of tools can be sensed and analyzed.
All these conditions can be taken into account as control parameters in the control and/or displayed to an operator and/or stored in a machine-readable form.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2020 128 759.3 | Nov 2020 | DE | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2021/080268 | 11/1/2021 | WO |
