Patent Application
20230419544
Embodiments of the present disclosure relate generally to agricultural machines and methods for operating such machines. In particular, the machines and methods may be used to detect the operating position of towed implements.
Tillage implements are machines that are typically towed behind tractors to condition soil for improved moisture distribution. Tillage implements include ground-engaging tools such as shanks, tillage points, discs, etc. Planters are typically towed behind tractors, and include ground-engaging tools such as coulters, opening wheels, seed-delivery devices, sensors, closing wheels, etc.
In a typical agricultural tillage or planting operation, monitoring the health and function of the machine while the tools are engaged with the ground can be challenging, but important. Height, drift, lift, and overall health of the implement should be constantly monitored so that adjustments to maximize yield can be made in a timely manner. Typically, implement monitoring is performed by an operator periodically looking to the rear of the tractor at the implement, or by sensors on the implement that communicate with the tractor.
However, in some conditions, it is almost impossible to monitor the health of the machine while tools are engaged with the ground. Soil and crop residue can be thrown, which obscures vision, and dust can create a cloud that further limits visibility. In autonomous agricultural tillage and planter operations, these challenges of supervision while engaged with the ground may limit the effectiveness of sensors designed to assess the health and function of the implement.
In some embodiments, a method includes calibrating a camera to detect a position of an implement relative to a tractor pulling the implement, traversing an agricultural field with the implement engaging soil of the field, capturing at least one image of the implement in the field by a camera carried by the tractor, and generating a first representation of a position of the implement relative to the field, using at least one computing device carried by the tractor. The calibration includes moving at least one of the tractor and the implement to each of a plurality of known positions, in series, relative to one another. At each of the known positions, at least one image of the implement is captured by the camera. Each of the known positions is correlated with the at least one image.
The position of the implement relative to the field may include a property selected from the group consisting of a height, a roll, a pitch, a drift, a lift, and a dirt angle.
The image(s) may be individual images and/or video, and may be selected from the group consisting of visible images, UV images, IR images, thermal images, radar representations, and lidar representations.
The method may optionally include capturing an image of a plurality of targets mounted on the implement, such as targets having contrasting colors. The plurality of targets may each comprise a target selected from the group consisting of a visual graphic, a reflector, a visual target, and a non-visible light target.
In some embodiments, a non-transitory computer-readable storage medium includes instructions that when executed by a computer, cause the computer to calibrate a camera to detect a position of an implement relative to a tractor pulling the implement, direct the camera to capture at least one image of the implement traversing an agricultural field and engaging soil of the field; and generate a first representation of a position of the implement relative to the field based on the at least one captured image of the implement traversing the field. The calibration includes moving at least one of the tractor and the implement to each of a plurality of known positions, in series, relative to one another. At each of the known positions, at least one image of the implement is captured by a camera carried by the tractor, and each of the known positions is correlated with the at least one image.
The first representation may include a property selected from the group consisting of a height, a roll, a pitch, a drift, a lift, and a dirt angle.
The camera may capture video of the implement traversing the agricultural field and engaging soil of the field. The camera may capture at least one image selected from the group consisting of a visible image, a UV image, an IR image, a thermal image, a radar representation, and a lidar representation.
The computer may direct the tractor to move the implement relative to the tractor to change a position of the implement relative to the field.
The computer may generate an alert if the position of the implement relative to the field is outside a preselected range.
In some embodiments, a method includes calibrating a camera to detect a position of an implement relative to a tractor pulling the implement, traversing an agricultural field with the implement engaging soil of the field, capturing at least one image of the tractor in the field by a camera carried by the implement, and generating a first representation of a position of the implement relative to the field, using at least one computing device carried by the tractor. The calibration includes moving at least one of the tractor and the implement to each of a plurality of known positions, in series, relative to one another. At each of the known positions, at least one image of the tractor is captured by the camera. Each of the known positions is correlated with the at least one image.
The position of the implement relative to the field may include a property selected from the group consisting of a height, a roll, a pitch, a drift, a lift, and a dirt angle.
The image(s) may be individual images and/or video, and may be selected from the group consisting of visible images, UV images, IR images, thermal images, radar representations, and lidar representations.
The method may optionally include capturing an image of a plurality of targets mounted on the tractor, such as targets having contrasting colors. The plurality of targets may each comprise a target selected from the group consisting of a visual graphic, a reflector, a visual target, and a non-visible light target.
In some embodiments, a non-transitory computer-readable storage medium includes instructions that when executed by a computer, cause the computer to calibrate a camera carried by the implement to detect a position of a tractor relative to an implement pulled by the tractor, direct the camera to capture at least one image of the tractor traversing an agricultural field, and generate a first representation of a position of the implement relative to the field based on the at least one captured image of the tractor traversing the field. The calibration includes moving at least one of the tractor and the implement to each of a plurality of known positions, in series, relative to one another. At each of the known positions, at least one image of the tractor is captured by the camera, and each of the known positions is correlated with the at least one image.
The first representation may include a property selected from the group consisting of a height, a roll, a pitch, a drift, a lift, and a dirt angle.
The camera may capture video of the tractor traversing the agricultural field. The camera may capture at least one image selected from the group consisting of a visible image, a UV image, an IR image, a thermal image, a radar representation, and a lidar representation.
The computer may direct the tractor to move the implement relative to the tractor to change a position of the implement relative to the field.
The computer may generate an alert if the position of the implement relative to the field is outside a preselected range.
Within the scope of this application it should be understood that the various aspects, embodiments, examples, and alternatives set out herein, and individual features thereof may be taken independently or in any possible and compatible combination. Where features are described with reference to a single aspect or embodiment, it should be understood that such features are applicable to all aspects and embodiments unless otherwise stated or where such features are incompatible.
While the specification concludes with claims particularly pointing out and distinctly claiming what are regarded as embodiments of the present disclosure, various features and advantages may be more readily ascertained from the following description of example embodiments when read in conjunction with the accompanying drawings, in which:
The illustrations presented herein are not actual views of any combine harvester or portion thereof, but are merely idealized representations to describe example embodiments of the present disclosure. Additionally, elements common between figures may retain the same numerical designation.
The following description provides specific details of embodiments. However, a person of ordinary skill in the art will understand that the embodiments of the disclosure may be practiced without employing many such specific details. Indeed, the embodiments of the disclosure may be practiced in conjunction with conventional techniques employed in the industry. In addition, the description provided below does not include all the elements that form a complete structure or assembly. Only those process acts and structures necessary to understand the embodiments of the disclosure are described in detail below. Additional conventional acts and structures may be used. The drawings accompanying the application are for illustrative purposes only, and are thus not drawn to scale.
As used herein, the terms “comprising,” “including,” “containing,” “characterized by,” and grammatical equivalents thereof are inclusive or open-ended terms that do not exclude additional, unrecited elements or method steps, but also include the more restrictive terms “consisting of” and “consisting essentially of” and grammatical equivalents thereof.
As used herein, the term “may” with respect to a material, structure, feature, or method act indicates that such is contemplated for use in implementation of an embodiment of the disclosure, and such term is used in preference to the more restrictive term “is” so as to avoid any implication that other, compatible materials, structures, features, and methods usable in combination therewith should or must be excluded.
As used herein, the term “configured” refers to a size, shape, material composition, and arrangement of one or more of at least one structure and at least one apparatus facilitating operation of one or more of the structure and the apparatus in a predetermined way.
As used herein, the singular forms following “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
As used herein, spatially relative terms, such as “beneath,” “below,” “lower,” “bottom,” “above,” “upper,” “top,” “front,” “rear,” “left,” “right,” and the like, may be used for ease of description to describe one element's or feature's relationship to another element(s) or feature(s) as illustrated in the figures. Unless otherwise specified, the spatially relative terms are intended to encompass different orientations of the materials in addition to the orientation depicted in the figures.
As used herein, the term “substantially” in reference to a given parameter, property, or condition means and includes to a degree that one of ordinary skill in the art would understand that the given parameter, property, or condition is met with a degree of variance, such as within acceptable manufacturing tolerances. By way of example, depending on the particular parameter, property, or condition that is substantially met, the parameter, property, or condition may be at least 90.0% met, at least 95.0% met, at least 99.0% met, or even at least 99.9% met.
As used herein, the term “about” used in reference to a given parameter is inclusive of the stated value and has the meaning dictated by the context (e.g., it includes the degree of error associated with measurement of the given parameter).
As used throughout, ranges are used as shorthand for describing each and every value that is within the range. Any value within the range can be selected as the terminus of the range.
The implement 104 as shown includes a frame 118, a drawbar 120 coupling the frame 118 to the tractor 102, and a toolbar 122. The toolbar 122 carries row units 124 and is optionally supported by wheels 114. It should be understood that other configurations of implements may also be used, such as tillage implements, and that the particular design of the implement may vary from that shown in
The 102 carries a camera 126 configured to capture images of the implement 104 to determine the position of the implement 104 relative to the tractor 102 and the surface of the field in which the implement 104 is operating. Though only one camera 126 is depicted in
The camera 126 may identify the state (e.g., tools operating in-ground, tools not operating, traveling with tools above ground, etc.) of the implement 104 by observing the shape and features of the implement 104. In some embodiments, the implement 104 may optionally include one or more targets 128 to facilitate identification of the implement 104 or of specific points on the implement 104. Targets 128 may include visual graphics, reflectors, visual or non-visible light targets, etc., and may be mounted vertically and/or horizontally on the implement 104 in the field of vision of the camera 126.
Though the camera 126 is shown mounted to the tractor 102 to view the implement 104, the camera 126 may alternatively be mounted to the implement 104, and directed at the tractor 102. In that case, the camera 126 would detect points on the tractor 102 to determine the position of the implement 104 relative to the tractor 102 and relative to the ground.
To use the system 100, the camera 126 may first be calibrated to detect the position of the implement 104.
As used herein, the term “drift” means and includes the deviation of the implement 104 left or right from a centerline, such as a centerline of the tractor 102 pulling the implement 104, or a preselected path of the implement 104. Drift is conceptually depicted by arrows 130 in
As used herein, the term “lift” means and includes the height of the implement 104 as a whole relative to ground or to a datum.
As used herein, the term “roll” means and includes rotation of the implement 104 as a whole around an axis parallel to the path of the tractor 102 or the implement 104.
As used herein, the term “pitch” means and includes rotation of the implement 104 as a whole around a horizontal axis perpendicular to the path of the tractor 102 or the implement 104. For example, the front of the implement 104 can be lower or higher than the rear of the implement 104, depending on the pitch value.
As used herein, the term “dirt angle” means and includes an angle of the implement 104 (as defined by a lower surface of the implement 104) relative to the ground. Dirt angle is related to the pitch, but also varies based on terrain.
The position of the implement 104 can include not only the physical location within the field (i.e., latitude and longitude), but also the drift, lift, roll, pitch, dirt angle, or any other location-based parameter. In some embodiments, the position of the implement 104 may also include to position of particular parts of the implement 104 (e.g., folding wings, etc.).
In block 404, at least one of the tractor 102 and the implement 104 move relative to one another to each of a plurality of known positions, in series. In block 406, at least one image of the implement 104 or the tractor 102 is captured at each of the known positions by the camera 126. The camera 126 can capture, for example, a visible image, a UV image, an IR image, a thermal image, a radar representation, and/or a lidar representation. The image may be a part of a video feed or other similar stream of data. In block 408, each of the known positions is correlated with the at least one image captured at that position. The positions can include, for example, height, roll, pitch, drift, lift, and/or dirt angle. The positions may include the locations of known points on the implement 104 or tractor 102, such as edges of components, or targets of contrasting colors. The calibration (group 420) is typically performed before using the implement 104 by moving the implement 104 to extreme positions (e.g., maximum and minimum height, etc.). In some embodiments, the calibration may be performed again at a later time, such as to correct or verify a prior calibration.
In block 410, the tractor 102 traverses an agricultural field with the implement 104 engaging soil of the field. The camera 126 captures at least one image of the implement 104 or the tractor 102 in the field, in block 412. In block 414, at least one computing device carried by the tractor 102 generates a first representation of a position of the implement 104 relative to the field. In some embodiments, a visible, audible, or tactile alert may be generated to signal to the operator of the tractor 102 the position of the implement 104 (e.g., that the implement 104 is operating outside a preselected range).
At decision block 416, if the tractor 102 continues in the field, the method 400 may repeat blocks 410-414. If the field work is complete, the method 400 ends at 418.
Still other embodiments involve a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) having processor-executable instructions configured to implement one or more of the techniques presented herein. An example computer-readable medium that may be devised is illustrated in
The system 100 and method 400 may be used to monitor and/or control the state of the implement 104, and may be used to improve field operations. Once the system 100 has been calibrated, an operator may set allowable limits for operation of the tractor 102 or implement 104, or may or provide set points for target height, dirt angle, roll, pitch, lift, etc.
The camera 126 may be integrated into the tractor 102 and with the control environment 116 for closed loop machine control or to display machine state on the control environment 116, or on another user interface such as display, tablet, remote monitoring, etc. Furthermore, information from the camera 126 may be used to generate an alert for the operator of the tractor 102 if the position of the implement 104 relative to the field is outside a preselected range.
In addition, the camera 126 may be part of a standalone kit to enable monitoring the state of the implement 104 separate from the user interface of the tractor 102. In such embodiments, the camera 126 may not provide closed loop control, but may still provide information and/or alerts to the operator.
All references cited herein are incorporated herein in their entireties. If there is a conflict between definitions herein and in an incorporated reference, the definition herein shall control.
This application claims the benefit of the filing date of U.S. Provisional Patent Application 63/366,853, “Methods of Locating Agricultural Implements,” filed Jun. 23, 2022, the entire disclosure of which is incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 63366853 | Jun 2022 | US |
