The present invention relates to a weed control vehicle, and to a method of controlling weeds with a vehicle, as well as to a computer program element and a computer readable medium.
The general background of this invention is weed control. Certain industrial areas and areas around railway tracks need to have the vegetation controlled. For railways, such control improves visibility from the perspective of people on the train such as the driver and improves visibility from the perspective of people working on the tracks. Such control can lead to improved safety. Additionally, vegetation can disrupt or damage tracks and associated signaling and communication lines. Control of the vegetation is then required to mitigate this. Vegetation control, also called weed control, can be very time and resource consuming, especially if carried out manually. The environment where weeds are to be controlled can pose difficulties, having changing ground levels, banks and embankments.
It would be advantageous to have improved weed control technology.
It should be noted that the following described aspects and examples of the invention apply also for the weed control vehicle, the method of controlling weeds with a vehicle, and for the computer program element and the computer readable medium.
According to some embodiments, a weed control vehicle may be provided, comprising:
at least one boom;
at least one weed control unit;
at least one actuator;
at least one sensor; and
a processing unit.
The at least one boom is movably attached to the vehicle. The at least one weed control unit is attached to the at least one boom. The at least one actuator is configured to move the at least one boom under the control of the processing unit. The at least one sensor is configured to acquire sensor data relating to at least one location of an environment. The at least one sensor is configured to provide the sensor data to the processing unit. The processing unit is configured to determine a distance sensing result for each location of the at least one location. The processing unit is configured to control the at least one actuator to move the at least one boom on the basis of the distance sensing result for each location of the at least one location.
In this way, a distance between weed control units and the ground can be maintained at a required distance (or over a required range of distances) in order that weed control units can operate in an optimum manner to control weeds.
In an example, the processing unit is configured to move the at least one boom vertically on the basis of the distance sensing result for each location of the at least one location.
In an example, the processing unit is configured to determine at least one vertical distance between the at least one boom and the ground.
In an example, the processing unit is configured to move a boom in a direction comprising an upward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or below a low vertical threshold value.
In this way, when a boom carrying weed control units comes too close to the ground it is moved away from the ground in order that the correct distance or range of distances between the weed control units and the ground is maintained.
In an example, the processing unit is configured to move a boom in a direction comprising a downward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or greater than a high vertical threshold value.
In this way, when a boom carrying weed control units moves too far away from the ground it is moved toward the ground in order that the correct distance or range of distances between the weed control units and the ground is maintained.
In an example, the high vertical threshold is a distance magnitude that is greater than a distance magnitude of the low vertical threshold.
In this way, the boom is not constantly being moved and/or hunting does not occur, and the boom is only moved when necessary. This leads to less energy being used, and the system parts do not wear out as quickly because the actuators are only activated when necessary.
In an example, the processing unit is configured to move the at least one boom horizontally on the basis of the distance sensing result for each location of the at least one location.
In this manner, as the vehicle goes through narrow regions or wider regions the booms can extend laterally in order to control weeds over the ground, and the booms do not become snagged on outlying terrain features and areas that should be controlled for weeds are not missed.
In an example, the processing unit is configured to determine at least one horizontal distance between at least one end boom of the at least one boom and an area surrounding the vehicle.
In an example, the processing unit is configured to move a boom of the at least one end boom in a direction comprising an inward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or below a low horizontal threshold value.
In an example, the processing unit is configured to move a boom of the at least one end boom in a direction comprising an outward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or greater than a high horizontal threshold value unless the boom is already in a fully extended state.
In an example, the high horizontal threshold is a distance magnitude that is greater than a distance magnitude of the low horizontal threshold.
In this way, the boom is not constantly being moved and/or hunting does not occur, and the boom is only moved when necessary. This leads to less energy being used, and the system parts do not wear out as quickly because the actuators are only activated when necessary.
In an example, the at least one sensor comprises one or more of: a lidar sensor, a parallax laser rangefinder sensor; a stereo vision sensor; an IR reflectance sensor; a time of flight sensor; an ultrasonic sensor; a radar sensor.
In an example, with respect to a forward movement direction of the vehicle, the at least one sensor is positioned forward of the at least one boom.
In this way, the terrain ahead of the boom can be interrogated and lag in the system can be accounted for where the boom height can better account for the terrain features.
According to some embodiments, a method of controlling weeds with a vehicle may be provided, comprising:
a) acquiring sensor data relating to at least one location of an environment using at least one sensor of a vehicle;
b) providing the sensor data to a processing unit of the vehicle;
c) determining by the processing unit a distance sensing result for each location of the at least one location; and
d) controlling by the processing unit at least one actuator to move at least one boom of the vehicle, wherein at least one weed control unit is attached to the at least one boom, and wherein the processing unit controls the at least one actuator to move the at least one boom on the basis of the distance sensing result for each location of the at least one location.
According to some embodiments, a computer program element may be provided for controlling parts of the vehicle, which when executed by a processor is configured to carry out the method described herein.
Advantageously, the benefits provided by any of the above embodiments equally apply to all of the other embodiments and vice versa.
Exemplary embodiments will be described in the following with reference to the following drawings:
In an example, the at least one weed control unit comprises at least one electrode based weed control unit. In an example, the at least one weed control unit comprises at least one chemical spray unit.
According to an example, the processing unit is configured to move the at least one boom vertically on the basis of the distance sensing result for each location of the at least one location.
According to an example, the processing unit is configured to determine at least one vertical distance between the at least one boom and the ground.
According to an example, the processing unit is configured to move a boom (of the at least one boom) in a direction comprising an upward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or below a low vertical threshold value.
According to an example, the processing unit is configured to move a boom in a direction comprising a downward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or greater than a high vertical threshold value.
According to an example, the high vertical threshold is a distance magnitude that is greater than a distance magnitude of the low vertical threshold.
According to an example, the processing unit is configured to move the at least one boom horizontally on the basis of the distance sensing result for each location of the at least one location.
According to an example, the processing unit is configured to determine at least one horizontal distance between at least one end boom of the at least one boom and an area surrounding the vehicle.
According to an example, the processing unit is configured to move a boom of the at least one end boom in a direction comprising an inward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or below a low horizontal threshold value.
According to an example, the processing unit is configured to move a boom of the at least one end boom in a direction comprising an outward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or greater than a high horizontal threshold value unless the boom is already in a fully extended state.
According to an example, the high horizontal threshold is a distance magnitude that is greater than a distance magnitude of the low horizontal threshold.
In an example, the processing unit is configured to move the at least one boom in a direction perpendicular to at least one long axis of the at least one boom on the basis of the distance sensing result for each location of the at least one location.
In an example, the processing unit is configured to determine at least one distance between the at least one boom and the ground that is perpendicular to the at least one long axis of the at least one boom.
In an example, the processing unit is configured to move a boom in a direction comprising a component perpendicular to a long axis of the boom when a distance of the at least one distance associated with the boom has a magnitude that is equal to or below a low threshold value.
In this way, when a boom carrying weed control units comes too close to the ground it is moved away from the ground in order that the correct distance or range of distances between the weed control units and the ground is maintained, even when the ground is not horizontally orientated.
In an example, the processing unit is configured to move a boom in a direction comprising a component perpendicular to a long axis of the boom when a distance of the at least one distance associated with the boom has a magnitude that is equal to or greater than a high threshold value.
In this way, when a boom carrying weed control units moves too far away from the ground it is moved toward the ground in order that the correct distance or range of distances between the weed control units and the ground is maintained, even when the ground is not horizontally orientated.
In an example, the high threshold is a distance magnitude that is greater than a distance magnitude of the low threshold.
According to an example, the at least one sensor comprises one or more of: a lidar sensor, a parallax laser rangefinder sensor; a stereo vision sensor; an IR reflectance sensor; a time of flight sensor; an ultrasonic sensor; a radar sensor.
According to an example, with respect to a forward movement direction of the vehicle, the at least one sensor is positioned forward of the at least one boom.
in an acquiring step 210, also referred to as step a), acquiring sensor data relating to at least one location of an environment using at least one sensor of a vehicle;
in a providing step 220, also referred to as step b), providing the sensor data to a processing unit of the vehicle;
in a determining step 230, also referred to as step c), determining by the processing unit a distance sensing result for each location of the at least one location; and
in a controlling step 240, also referred to as step d), controlling by the processing unit at least one actuator to move at least one boom of the vehicle, wherein at least one weed control unit is attached to the at least one boom, and wherein the processing unit controls the at least one actuator to move the at least one boom on the basis of the distance sensing result for each location of the at least one location.
In an example, the at least one weed control unit comprises at least one electrode based weed control unit. In an example, the at least one weed control unit comprises at least one chemical spray unit.
In an example, step d) comprises moving the at least one boom vertically on the basis of the distance sensing result for each location of the at least one location.
In an example, step c) comprises determining at least one vertical distance between the at least one boom and the ground.
In an example, step d) comprises moving a boom in a direction having an upward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or below a low vertical threshold value.
In an example, step d) comprises moving a boom in a direction having a downward vertical component when a distance of the at least one distance associated with the boom has a magnitude that is equal to or greater than a high vertical threshold value.
In an example, the high vertical threshold is a distance magnitude that is greater than a distance magnitude of the low vertical threshold.
In an example, step d) comprises moving the at least one boom horizontally on the basis of the distance sensing result for each location of the at least one location.
In an example, step c) comprises determining at least one horizontal distance between at least one end boom of the at least one boom and an area surrounding the vehicle.
In an example, step d) comprises moving a boom of the at least one end boom in a direction comprising an inward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or below a low horizontal threshold value.
In an example, step d) comprises moving a boom of the at least one end boom in a direction comprising an outward horizontal component when a distance of the at least one horizontal distance associated with the boom has a magnitude that is equal to or greater than a high horizontal threshold value unless the boom is already in a fully extended state.
In an example, the high horizontal threshold is a distance magnitude that is greater than a distance magnitude of the low horizontal threshold.
In an example, the at least one sensor comprises one or more of: a lidar sensor, a parallax laser rangefinder sensor; a stereo vision sensor; an IR reflectance sensor; a time of flight sensor; an ultrasonic sensor; a radar sensor.
In an example, with respect to a forward movement direction of the vehicle, the at least one sensor is positioned forward of the at least one boom.
The weed control vehicle and method of controlling weeds with a vehicle are now explained in more detail with reference to
Continuing with
As discussed above,
In
As discussed above, the GPS coordinates of weeds can be provided to the weed control train that then uses its own GPS unit to activate weeds where required. However, the weed control train of
Regarding the image processing to determine if weeds are present, the processing unit analyses an image to determine the areas within the image where vegetation is to be found. Vegetation can be detected based on the shape of features within acquired images, where for example edge detection software is used to delineate the outer perimeter of objects and the outer perimeter of features within the outer perimeter of the object itself. A database of vegetation imagery can be used in helping determine if a feature in imagery relates to vegetation or not, using for example a trained machine learning algorithm such as an artificial neural network or decision tree analysis. The camera can acquire multi-spectral imagery, with imagery having information relating to the color within images, and this can be used alone, or in combination with feature detection to determine where in an image vegetation is to be found.
With respect to the machine learning analyzer, images of specific weeds are acquired, with information also relating to the size of weeds being used. Information relating to a geographical location in the world, where such a weed is to be found and information relating to a time of year when that weed is to be found, including when in flower etc. can be tagged with the imagery. The names of the weeds can also be tagged with the imagery of the weeds. The machine learning analyzer, which can be based on an artificial neural network or a decision tree analyzer, is then trained on this ground truth acquired imagery. In this way, when a new image of vegetation is presented to the analyzer, where such an image can have an associated time stamp such as time of year and a geographical location such as Germany or South Africa tagged to it, the analyzer determines the specific type of weed that is in the image through a comparison of imagery of a weed found in the new image with imagery of different weeds it has been trained on, where the size of weeds, and where and when they grow can also be taken into account. The specific location of that weed type on the ground within the environment, and its size, can therefore be determined.
The processor has access to a database containing different weed types, and the optimum mode of the electrode based weed control technology to be used in controlling that weed type, which has been compiled from experimentally determined data.
Because the weed control train is itself determining from acquired imagery the location and types of weed, the exact geographical location of the weed is then not then required to be determined. Rather, on the basis of a relative spacing between the cameras and the electrode based weed control units mounted on the booms, along with knowledge of the forward motion of the weed control train (its speed), once a weed is located and identified at a later time the electrode based weed control units can be activated at that location. This is similar to how the distance information of the booms from the ground is used, in order to move the booms to take into account changes in the ground terrain below and to the sides of the train. Thus for example, if the total processing time and priming electrode based weed control units for activation takes 0.2 s, 0.4 s, or 0.8 s for a train travelling at 25 m/s, the cameras must be spaced forward of the electrode based weed control units by 5 m, 10 m or 20 m for this train velocity. A reduction in train velocity enables the separation to be reduced. In addition, the cameras that are acquiring the imagery can have very short exposure times in order that image smear due to movement of the train during the exposure time is minimized. This can be by various means, including the use of cameras with short exposure times or short pulsed illumination via for example lasers or LEDs in combination with filters for example. However, the train can use a GPS system and/or inertial navigation system and/or image analysis to determine an exact geographical location of weeds, and booms with the electrode based weed control units can have associated location determining means, such as a GPS system and/or inertial navigation system and/or image based system that can be used to provide the exact position of the units. Thus, a front carriage of a train can have the cameras that acquire imagery from which weeds can be identified and located along with GPS data, then a rear carriage of a train that could be many tens or hundreds of meters behind the front carriage can have the booms with the weed control units mounted on them. Then, the electrode based weed control units can be activated at the correct positions again using GPS data, even if the train becomes shorter or longer due to going up or down hill.
The above detailed examples have been discussed with respect to a railway, however a weed control train, a truck or lorry or Unimog can have electrode based weed control units mounted on/within it that can use sensors to enable the weed control units to be positioned optimally with respect to the ground and use sensors in order to activate the weed control units where required on the basis of image processing.
A specific example of how an image is processed, and determined to be suitable for image processing in order that a type of weed can be determined is now described:
In some embodiments, a computer program or computer program element configured to execute the method steps of the method according to one of the preceding embodiments may be provided on an appropriate system.
The computer program element might therefore be stored on a computer unit, which might also be part of an embodiment. This computing unit may be configured to perform or induce performing of the steps of the method described above. Moreover, it may be configured to operate the components of the above described apparatus and/or system. The computing unit can be configured to operate automatically and/or to execute the orders of a user. A computer program may be loaded into a working memory of a data processor. The data processor may thus be equipped to carry out the method according to one of the preceding embodiments.
Some embodiments of the invention cover both, a computer program that right from the beginning uses the invention and computer program that by means of an update turns an existing program into a program that uses invention.
Further on, the computer program element might be able to provide all necessary steps to fulfill the procedure of an exemplary embodiment of the method as described above.
According to some embodiments of the present invention, a computer readable medium, such as a CD-ROM, USB stick or the like, is presented wherein the computer readable medium has a computer program element stored on it which computer program element is described by the preceding section.
A computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
However, the computer program may also be presented over a network like the World Wide Web and can be downloaded into the working memory of a data processor from such a network. According to some embodiments of the present invention, a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.
It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, a person skilled in the art will gather from the above and the following description that, unless otherwise notified, in addition to any combination of features belonging to one type of subject matter also any combination between features relating to different subject matters is considered to be disclosed with this application. However, all features can be combined providing synergetic effects that are more than the simple summation of the features.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
18166793.2 | Apr 2018 | EP | regional |
This application is a national stage application under 35 U.S.C. § 371 of International Application No. PCT/EP2019/057977, filed internationally on Mar. 29, 2019, which claims the benefit of European Application No. 18166793.2, filed Apr. 11, 2018.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/057977 | 3/29/2019 | WO | 00 |