Not applicable.
Embodiments of the present disclosure relate generally to s stems and methods for determining an operational path for an agricultural machine in a working environment.
It is known to perform path planning for agricultural operations in a working environment, such as a field or the like. This is often performed manually by the operator of machines working in the environment in an attempt to optimize the relevant agricultural operation in terms of efficiency and cost. More recently, systems are provided which may suggest operational paths to an operator based on the operational task, location of crop, field slope etc. however no complete solution has been provided which accounts for in-field variables such as obstacles and the like.
It would be advantageous to provide a system (and associated method) which overcomes or at least partly mitigates one or more problems associated with the prior art systems.
In an aspect of the invention there is provided a control system for planning an agricultural operation in a working environment, the control system comprising one or more controllers and being configured to: determine a boundary for the working environment; determine one or more characteristics of at least one obstacle within the working environment; determine an operational path for an agricultural machine in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s); and generate and output a control signal for controlling one or more operational components associated with the agricultural machine in dependence on the determined operational path.
Advantageously, the present invention provides a system which accounts for obstacles within the working environment when planning an operational path through that environment. This may enable the system to efficiently handle such obstacles and prevent or reduce any overlap in passes by the machine, increasing the efficiency of the agricultural operation as a whole.
The one or more controllers may collectively comprise an input (e.g. an electronic input) for receiving one or more input signals. The one or more input signals may comprise data indicative of the boundary of the working environment, and/or the one or more characteristics of the obstacle(s). The one or more controllers may collectively comprise one or more processors (e.g. electronic processors) operable to execute computer readable instructions for controlling operational of the control system, for example, to determine the boundary and/or the one or more characteristics, and/or the operational path. The one or more processors may be operable to generate one or more control signals for controlling operation of the one or more operational components. The one or more controllers may collectively comprise an output (e.g. an electronic output) for outputting the one or more control signals.
In embodiments the control system may be configured to determine a base model for the operational path in dependence on the boundary only. This may consider the shape and size of the overall environment and determine therefrom one or more aspects of the operational path, such as a general heading for the machine within the working environment. The control system may be configured to determine one or more adjustments to the base model in dependence on the one or more obstacle characteristics. This may include determining one or more adjustments in dependence on the operational path according to the base model being intercepted by one or more obstacles.
In embodiments, the control system may be configured to determine one or more adjustments by dividing the operational path (according to the base model) at the location of the obstacle into a pre-obstacle section and a post-obstacle section. The one or more adjustments may comprise determining an obstacle operational path between the pre-obstacle section and post-obstacle sections of the operational path. The obstacle operational path may include a route which bypasses the obstacle, or a route which encompasses the obstacle, for example.
The control system may be configured to classify the at least one obstacle. The control system may be configured to classify the at least one obstacle in dependence on one or more of: the size of the obstacle(s); the shape of the obstacle(s); and a relative dimension with respect to direction of travel of the agricultural machine according to the base model for the operational path.
In embodiments, the control system is configured to determine a size of the at least one obstacle in a direction substantially perpendicular a travel direction for the machine operating in accordance with the base model for the operational path. In such embodiments, the control system may additionally be configured to determine an adjusted operational path for the machine which bypasses the obstacle in dependence on the determined size being less than a threshold parameter. Additionally or alternatively, the control system may be configured to determine an additional headland path about the obstacle in dependence on the determined size being greater than a threshold parameter. The threshold parameter may be dependent on the width of the agricultural machine, or the width of a component suitably coupled to the machine, e.g. a header or the like. The threshold parameter may be dependent on a turning radius of the machine.
The control system may be configured to define a boundary box about the or each obstacle. The boundary box may define one or more regions of the working environment not to be traversed by the agricultural machine. The boundary box(es) may generally follow an outline or edge of the obstacle(s) and in embodiments may be offset therefrom. The offset may be determined in dependence on a turning radius of the agricultural machine.
The one or more characteristics of the obstacle(s) comprises a distance between obstacle and the boundary. The control system may be configured to compare the distance between the obstacle(s) and the boundary with a threshold distance, which may be dependent on a working width of the agricultural machine, for example. The working width may relate to a width of a header operatively coupled to the machine, for example. The control system may be configured to define a new boundary which encompasses the obstacle in dependence on the distance between obstacle and boundary being less than the threshold distance, and/or where obstacle crosses the boundary. Additionally or alternatively, the control system may be configured to define an obstacle headland path about the obstacle which is truncated so as to reduce overlap between the obstacle headland path and a headland path associated with the boundary, in dependence on the distance between obstacle and boundary being greater than the threshold distance but less than double the threshold distance. The obstacle headland path may comprise an inner obstacle headland path and an outer obstacle headland path. The control system may be configured to truncate the outer obstacle headland path at the location of any intercept between the outer headland path and a headland path associated with the boundary.
The one or more characteristics of a first obstacle may comprise a distance between the first obstacle and one or more further obstacles within the working environment. The control system may be configured to compare the distance between the first obstacle and the one or more further obstacles with a threshold distance. The threshold distance may be dependent on a working width of the agricultural machine, such as a width of a header of (or operatively coupled to) the machine. In some embodiments, the control system may be configured, in dependence on the distance between the first obstacle and the one or more further obstacles being less than the threshold distance, to merge the first obstacle and the further obstacle(s). The control system may be configured to determine the operational path in dependence on one or more characteristics of the merged obstacle. Additionally or alternatively, the control system may be configured, in dependence on the distance between the first obstacle and the further obstacle(s) being greater than the threshold distance but less than double the threshold distance, to define a first obstacle headland path about the first obstacle and/or a further obstacle headland path about the further obstacle(s) which is truncated so as to reduce overlap between the first obstacle headland path and the further obstacle headland path.
In embodiments, the control system may be configured to retrieve obstacle data indicative of the one or more characteristic(s) of the obstacle from a database comprising mapped information of the working environment. Additionally or alternatively, the control system may be configured to receive obstacle data from a sensing system associated with the machine and/or or more additional machines operating within the working environment. The control system may be configured to determine the one or more characteristics of the at least one obstacle in dependence of the retrieved and/or received data.
The control system may be configured to present the determined operational path to an operator of the agricultural machine. The determined operational path may be presented on a display screen associated with the machine. Additionally or alternatively, the determined operational path may be presented on a remote device, such as a phone or tablet, for example.
The one or more operational components associated with the agricultural machine may comprise a steering system of the agricultural machine. The one or more operational components may comprise a propulsion system of the agricultural machine. In this way, the control system may be configured for automating motion of the machine along the determined operational path through control of the steering and/or propulsion systems.
Another aspect of the invention provides a guidance system for an agricultural machine, the guidance system comprising and/or being controllable by a control system as described hereinabove.
In another aspect of the invention there is provided an agricultural machine comprising the control system and/or the guidance system of any preceding aspect.
The agricultural machine may comprise a tractor or a harvesting machine. The agricultural machine may comprise a combine harvester or a forage harvester, for example.
In a further aspect of the invention there is provided a method of planning an agricultural operation in a working environment, comprising: determining a boundary for the working environment; determining one or more characteristics of at least one obstacle within the working environment; determining an operational path for an agricultural machine in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s); and controlling one or more operational components associated with the agricultural machine in dependence on the determined operational path.
The method may comprise performing any one or more of the functionalities of the control system described hereinabove.
A further aspect of the invention provides computer software comprising computer readable instructions which, when executed by one or more electronic processors, causes performance of a method in accordance with any aspect described herein.
A yet further aspect of the invention provides a computer readable medium having the computer software of the preceding aspect of the invention stored thereon.
Within the scope of this application it should be understood that the various aspects, embodiments, examples and alternatives set out herein, and individual features thereof may be taken independently or in any possible and compatible combination. Where features are described with reference to a single aspect or embodiment, it should be understood that such features are applicable to all aspects and embodiments unless otherwise stated or where such features are incompatible.
One or more embodiments of the invention/disclosure will now be described, by way of example only, with reference to the accompanying drawings, in which:
The present invention, in general, relates to systems and methods for planning an agricultural operation in a working environment. As discussed herein, both a boundary for the working environment and one or more characteristics of at least one obstacle within the working environment are determined. An operational path for an agricultural machine is determined in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s). One or more operational components associated with the agricultural machine are then controlled in dependence on the determined operational path.
As discussed herein, a control system 1 is configured for controlling one or more operational components 32, 35 associated with an agricultural machine 50, such as a combine harvester or tractor or the like. In the illustrated embodiment, the controllable operational components include a guidance system 35 of a harvester 50 for controlling motion of the harvester along a determined operational path, determined in the manner discussed herein, and a user interface 32 associated with the combine harvester 50, e,& provided as a display terminal of the harvester 50 or indeed a handheld terminal, to provide an indication of the determined operational path for the harvester 50,
The processor 4 is operable to receive via input 6 which, in the illustrated embodiment, takes the form of input signals 5 received from a remote server 29, data indicative of a boundary for a working environment for the harvester 59 and data indicative of one or more characteristics of obstacle(s) within that environment. For instance, the server 29 can have stored therein mapped data of the environment which may, for example, be updated periodically through use of sensing systems on machines operating within that environment. In a variant, the harvester 50 may include one or more sensing systems and the control system 1 may include an electronic input configured to receive sensor data from said systems.
Utilising the data from the server 29, the processor 4 is configured to analyse the data and determine therefrom an operational path for the harvester 50 in dependence on the boundary and the one or more characteristics of obstacle(s) within the environment. The one or more characteristics include a size and/or shape of the obstacle, e.g. with reference to a driving direction of the machine and/or with respect to a working width of the machine.
As described above, the controller 2 includes an electronic output 8 configured to output control signals 9 generated by the processor 4 for controlling operation of the harvester 50. Specifically, processor 4 is operable to generate, and the controller 2 operable to then output via output 8, control signals 9 to a guidance system 35 of the harvester 50 for controlling motion of the harvester 50, e.g. through control over a steering system and/or a propulsion system of the harvester 50, for controlling motion of the harvester 50 along the determined operational path. As will be appreciated, the controller 2 may output the control signals 9 to a local processing unit, e.g. a control unit of the guidance system 35 for controlling operation thereof.
Output 10 is operably coupled to a user interface 32 associated with the harvester 50. As will be appreciated and is discussed herein, the user interface 32 may form part of a portable device, such as a phone or tablet computer, and/or may form part of a display screen within an operator cab of the harvester 50. Here, the control system 1 is operable to control operation of the user interface 32, e.g. through output of control signals 11 in order to display data to an operator of the harvester 50 relating to the operation of the control system 1. Specifically, the control system 1 is operable to control the user interface 32 to display to the operator an indicator of determined operational path, e.g. for the operator to use to then control motion of the harvester 50 along that path, or indeed to monitor automated operation thereof.
In an initial step 101, inputs are provided relating to the boundary of the working environment and obstacle data indicative of the boundary of obstacle(s) within the environment I1, data relating to the working width of the harvester 50 I2, here comprising the width of a header 52 operatively coupled to the harvester 50, and data relating to a driving direction for the harvester 50 in the field. This may be predetermined, or may be determined, e.g. by the control system 1 based on the shape of the environment, for example.
At step 102, data relating to the one or more characteristics of each obstacle within the environment is assessed to determine the number of obstacles to be analyzed in determination of the operational path.
At step 104, the data for each of the obstacles is analysed to determine therefrom whether any of the obstacles are “point” obstacles. That is, any obstacles which can effectively be treated as a point object in the environment, and may include trees, electricity poles and the like. For those obstacles which satisfy this condition a further check is made to determine whether the point obstacles are close to the field boundary (step 106). Here, a check is made to see whether any point obstacles are within 0.5 m of the field boundary, however the skilled person would appreciate that this threshold distance may be different in different scenarios, and relates primarily to the working width of the machine operating in the environment. Where point obstacles are determined to lie proximate to the field boundary they are effectively merged with the existing boundary to form a new boundary for the working environment. This is illustrated figuratively in
The method then progresses to step 110 where a further check is performed to consider how close adjacent obstacles are to one another, irrespective of any classification of obstacle type. In the illustrated embodiment, this comprises checking the distance between each of the obstacles against a threshold distance equal to the working width of the harvester 50. As discussed above, this is dependent on the width of the header 52. For those which are less than or equal to the working width of the harvester 50, these obstacles are merged to form a single obstacle (for consideration by the control system 1). This is illustrated figuratively in
Turning back to
As a next step, a check is made for any obstacles which cross the boundary of the working environment (step 114). For those which cross the boundary of the working environment, they are merged into the boundary. This is illustrated figuratively in
At step 116 a list of all obstacles is obtained following the various merge processes. For instance, those which have been merged into the boundary are no longer considered as obstacles but rather now define the boundary. Obstacles which have been merged with one another are considered single obstacles, etc. At step 118 each of the remaining point obstacles are replaced (from the point of view of the control system 1) with circles of radius 1 m. Again, the skilled person will appreciate that this is simply shown as an example. This circle defines a region around the point obstacle(s) where the machine cannot traverse and prevents waylines being generated for the operational path which pass through or close to said point obstacles at risk of a collision.
At step 120 the width of the remaining obstacles is determined with respect to the driving direction of the harvester 50. This is compared with a predetermined threshold value. Where this width is greater than the predetermined threshold value, the obstacle is classified as an “island” obstacle and handled in the manner discussed hereinbelow (step 128, discussed below). For those which are less than or equal to the predetermined threshold value a further check is performed (step 122) relating to the obstacle's length to width ratio, and comparison of that ratio with a further threshold value for further classification of the obstacle. Here, the ratio threshold is set at 1.5, and obstacles where the length-to-width ratio is less than 1.5 are classified as “marker” obstacle's and those which have a length to width greater than 1.5 are classified as “narrow” obstacles. Both marker and narrow obstacles are handled similarly to point obstacles as discussed herein, and below with reference to steps 136 and 138.
This is illustrated figuratively in
Turning back to
Step 128 comprises generating headland “passes” for each of the obstacles classified as “island” obstacles. In practice, this comprises generating obstacle specific headland paths around the island obstacles. This is shown figuratively in
As shown in
At step 130, a base model for the operational path is determined consisting of the generation of waylines for the environment as a whole. As described herein, this may be determined primarily on the overall shape and size of the environment, and may be predetermined from a desired driving direction through the environment. The base model is then adjusted to account for the characteristics of the identified obstacles and the additional headland paths, boundary adjustments etc. discussed above.
For instance, at step 132, a check is made to consider whether the generated waylines for the environment are intercepted by any “island” obstacles (and the obstacle specific headland paths associated with those obstacles, determined in the manner discussed hereinabove). If so, each intercepted wayline is divided (step 134) into a pre-obstacle portion and a post obstacle portion to remove any overlap.
At step 136, a check is made to consider whether the generated waylines for the environment are intercepted by any “narrow” or “marker” obstacles, determined in the manner discussed hereinabove. If so, each intercepted wayline is deviated to an extent such that the harvester 50 may bypass the obstacle(s) (step 138) but without needing to divide the wayline entirely—see
At step 140, the waylines (and any adjustments made thereto) are saved in a location accessible by the control system 1. The saved waylines define an overall operational path for the harvester 50 through the environment as determined with reference to both the boundary of the environment and one or more characteristics of obstacles within the environment.
The method may then extend to generating and outputting control signals for controlling operation of one or more operational components associated with the harvester 50. As discussed herein, this can include controlling operation of a user interface 32 for displaying to an operator the determined operational path. This ma be used by the operator to manually control the movement of the harvester 50 along the determined path, or may be used in a supervisory role monitoring operation of the harvester 50, e.g. where the harvester is being operated by another person and/or automated to some extent. In some variants, the method extends to at least partially automating motion of the harvester 50 along the determined operational path. As discussed herein, this may involve controlling a guidance system for the harvester, a steering system of the harvester and/or a propulsion system of the harvester, as will be appreciated.
All references cited herein are incorporated herein in their entireties. If there is a conflict between definitions herein and in an incorporated reference, the definition herein shall control.
Number | Date | Country | Kind |
---|---|---|---|
2201115.9 | Jan 2022 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2023/050165 | 1/9/2023 | WO |