The present disclosure relates to a harvester and more specifically to a harvester having one or more control systems to adjust the operating parameters of the device.
During the harvesting process, the operator of the harvester is required to constantly observe their surroundings and adjust the harvester operating parameters based on those observations. Such adjustments and observations can be difficult and lend themselves to inaccuracies both in the initial observations and the determined adjustments.
In one implementation, a harvester including a frame supported by a drive assembly for movement along a support surface, a head unit coupled to the harvester and configured to selectively harvest crop material, a camera coupled to the frame and configured to generate one or more images of a field of view, and a controller in operable communication with the camera and the head unit, where the controller is configured to determine one or more crop attributes based at least in part on the one or more images produced by the camera.
In another implementation, a method of operating a harvester including providing a harvester with a frame, a head unit coupled to the frame, and an unload assembly having a material output that is movable with respect to the frame. The method further including establishing a first reference frame fixed relative to the frame, mounting a camera to the harvester having a field of view, wherein the camera is configured to output an image representative of the field of view, identifying a reference point within the image, and calculating the location of the reference point relative to the first frame of reference.
In another implementation, a harvester including a frame, a head unit coupled to the frame, an unloading assembly with a material output, where the material output is movable with respect to the frame, a camera having a first field of view, where the camera is configured to output a first image representative of the first field of view, and a controller in operable communication with the camera, where the controller is configured to identify a reference point within the first image, and where the controller is configured to calculate the location of the reference point relative to the frame.
In another implementation, a harvester including a frame, a head unit coupled to the frame, an unloading assembly including, a base fixedly coupled to the frame, a body movable with respect to the base, and a material output formed by the body, and a camera having a first field of view at last partially including the unloading assembly therein, where the camera is configured to output a first image representative of the first field of view, and a controller in operable communication with the camera, where the controller is configured to determine the position of the reference point relative to a two-dimensional reference frame overlaid onto the first image, and where the controller is configured to calculate the orientation of the body relative to the frame based at least in part on the location of the reference point within the two-dimensional reference frame.
Other aspects of the disclosure will become apparent by consideration of the detailed description and accompanying drawings.
Before any embodiments of the disclosure are explained in detail, it is to be understood that the disclosure is not limited in its application to the details of the formation and arrangement of components set forth in the following description or illustrated in the accompanying drawings. The disclosure is capable of supporting other implementations and of being practiced or of being carried out in various ways.
During harvesting operations, multiple sensors must be used to provide feedback to the control system and the operator. Harvesting machine operators are responsible for many machine settings and configurations in order to harvest optimally and safely. Sensors can provide feedback but some specific pieces of information require multiple sensors measuring multiple functions. By including a single, three-dimensional camera many of those sensors can be eliminated thereby providing a simpler and more cost effective way to operate the harvester.
In the illustrated implementation, the frame 14 of the harvester 10 includes a first or forward end 46 generally aligned with the direction of travel A, and a second or rear end 50 opposite the forward end 46. The frame 14 also includes a drive assembly 54 such as a plurality of wheels or a track coupled to the frame 14 and configured to support the frame 14 for travel over the support surface 30. As shown in
Illustrated in
The head unit 22 of the harvester 10 is coupled to the forward end 46 of the frame 14 and is configured to cut and collect crop material 26 positioned in the cutting path 58 (described above). The head unit 22 includes a pair of crop dividers 70, one or more scrolls 74 coupled to the crop dividers 70, knock down rollers 78, a pair of base cutters (not shown), side knives (not shown), and a topper unit 88. The head unit 22 also defines the cutting width 66 defined as the distance between the two crop dividers 70 (see
During use, the head unit 22 is adjustable between an activated configuration, in which the head unit 22 receives an input (e.g., torque) from the power unit and is configured to actively cut and collect the crop material 26 in the cutting path 58 as the harvester 10 travels in the direction of travel A (e.g., the power unit is driving the elements of the head unit 22), and a deactivated configuration, in which the head unit 22 does not receive input from the power unit and is not configured to actively cut and collect the crop material 26 (e.g., the power unit is not driving the elements of the head unit 22). As such, the head unit 22 places a vastly increased load on the power unit when it is in the activated configuration.
Each crop divider 70 of the head unit 22 includes a substantially upright oriented wall configured to separate the crop material 26 positioned within the cutting path 58 (e.g., the items that will be processed by the head unit 22) from the crop material 26 that is positioned outside the cutting path 58 and in the adjacent regions 62a, 62b (e.g., crop material 26 that will not be processed by the head unit 22). During use, the position of the crop dividers 70 may be varied to adjust the cutting width 66 (e.g., the distance between the two crop dividers 70), and/or the cutting height 86 (e.g., the distance between the crop divider 70 and the support surface 30; see
In some implementations, the crop dividers 70 may include “floating” crop dividers where the crop dividers 70 are configured to move freely along the support surface 30 and compensate for changes in the contour thereof. In such implementations, the crop dividers 70 are adjustable between a deployed configuration, in which the crop dividers 70 are actively “floating” along the support surface 30, and a stowed configuration, in which the crop dividers are retracted away from and out of engagement with the support surface 30.
Each scroll 74 of the head unit 22 is rotatably coupled to a corresponding crop divider 70 and includes a substantially cylindrical body 90 with one or more spiral-shaped fins 94 extending therefrom. During use, each scroll 74 rotates relative to the crop dividers 70 and is configured to engage and manipulate the crop material 26 as it comes into contact therewith. In particular, each scroll 74 is generally configured to bias the crop material 26 into a generally upright orientation and, in some instances, direct the crop material 26 inwardly toward the knockdown rollers 78. Each scroll 74 is adjustable between an activated configuration, in which the scroll 74 receives input from the power unit 18 and rotates with respect to the head unit 22, and a deactivated configuration, in which the scroll 74 does not receive an input from the power unit 18 and therefore does not rotate with respect to the head unit 22. In the illustrated implementation, the head unit 22 includes an inner set of scrolls 74a, and an exterior set of scrolls 74b. However, in alternative implementation more or fewer scrolls 74 may be present.
The topper unit 88 of the head unit 22 is coupled to the frame 14 of the harvester 10 and configured to cut the crop material 26 at a preselected cutting height 86 from the support surface 30. More specifically, the topper 88 is configured to remove leafy material 116 from the tops of the stalks 28. As such, the topper 88 is coupled to the harvester 10 such that the cutting height 86 can be adjusted to accommodate crop material 26 having different heights.
Illustrated in
The elevator 108 of the unloading assembly 38 includes an elongated body 128 having a first end 132 pivotably coupled to the base 100, a second end 136 opposite the first end 132 that at least partially defines the material outlet 112, and a bin flap 114 positioned within the material outlet 112 to help direct the crop material 26 being unloaded therefrom. The elevator 108 also includes a conveyor 140 extending the length of the body 128 that is configured to convey crop material 26 from the first end 132, toward the second end 136, and out the material outlet 112.
In the illustrated implementation, the first axis 104 is substantially vertical (i.e., normal to the support surface 30) such that rotation of the elevator 108 about the first axis 104 causes the second end 136 of the elevator 108 to move along a substantially arcuate path in which the second end 136 maintains a constant distance from the support surface 30 (e.g., a constant dump height 144; see
During use, the elevator 108 is continuously rotatable relative to the base 100 about the first axis 104 between a plurality of different unload positions. More specifically, the elevator 108 is rotatable between a first position, in which the elevator 108 forms a first dump angle (not shown) with respect to the frame 14 of approximately 90 degrees (thereby generally positioning the material outlet 112 on the starboard side of the harvester 10, not shown), a second position, in which the elevator 108 forms a second dump angle 148b with respect to the frame 14 of approximately 180 degrees (thereby generally positioning the material outlet 112 near the rear end 50 the harvester 10), and a third position, in which the elevator 108 forms a third dump angle 148c with respect to the frame 14 of approximately 270 degrees (thereby generally positioning the material outlet 112 on the port side of the harvester 10). For the purposes of this application, the dump angle 148 of the elevator 108 includes the angle formed about the first axis 104 between a first ray substantially aligned with the direction of travel A, and a second ray extending along the body 128 of the elevator 108 (see
The unloading assembly 38 also includes a primary extractor 120 configured to unload the leafy material 116 separated from the crop material 26 during processing. In the illustrated implementation, the primary extractor 120 includes a first chute 152 that is rotatable with respect to the base 100 independently of the elevator 108 about the first axis 104, and a primary fan (not shown) to direct the flow of leafy material 116 through the chute 152.
The discharge assembly 38 also includes a secondary extractor 124 coupled to the elevator 108 proximate the second end 136 thereof. The secondary extractor 124 is configured to discharge any remaining leafy material 116 positioned on the conveyor 140 before reaching the material outlet 112. In the illustrated implementation, the secondary extractor 124 includes a second chute 160 that is rotatable with respect to the elevator 108, and a secondary fan (not shown) to direct the flow of leafy material 116 through the chute 160.
Illustrated in
The first control sub-assembly 42a of the harvester 10 includes a processor 168, a memory unit 172 in operable communication with the processor 168, and a mono-camera 176 (e.g., a two-dimensional camera) sending and receiving signals from the processor 168. The processor 168 may also be in operable communication with various elements of the harvester 10 such as the unload assembly 38, the head unit 22, and the processing unit 34. During use, the processor 168 receives signals from the mono-camera 176 and enters that information into one or more control algorithms to calculate the position of one or more elements of the unload assembly 38 within the three-dimensional space of the first reference frame 56.
In particular, the harvester 10 includes a mono-camera 176 coupled to the frame 14 of the harvester 10 that defines a first field of view 180 (see
During the harvesting process, the mono-camera 176 conveys a series of images to the processor 168 where each image includes a two-dimensional representation of the first field of view 180 (see
Although not illustrated, more than one reference point 184 may be used in instances where redundancy, additional data, or more than one item is to be tracked. In such implementations, each reference point 184 may be unique in some way (e.g., having a unique pattern, indicia, color, shape, and the like) to allow the processor 168 to distinguish between each individual reference point.
After identifying the reference point 184 within a particular image, the processor 168 establishes the position or coordinates of the reference point 184 relative to a second, two-dimensional reference frame 188 overlaid onto the images of the first field of view 180. By repeating this process for multiple, subsequent images, the processor 168 is able to track and record the movements of the reference point 184 relative to the second reference frame 188.
With the location of the reference point 184 established relative to the second, two-dimensional reference frame 188, the processor 168 then enters the location data into a position algorithm that, in turn, outputs the three-dimensional location of the reference point 184 relative to the first, three-dimensional reference frame 56 established by the frame 14 of the harvester 10. To do so, the control algorithm takes into account, among other things, the known location and orientation of the camera 176 relative to the base 100 of the discharge assembly 38, the location where the reference point 184 is fixed to the elevator body 128, and the known movement characteristics of the elevator 108 itself. Using this information, the processor 168 is able to establish a function that associates a unique three-dimensional location within the first reference frame 56 for each possible reference point 184 location within the second reference frame 188. Still further, the processor 168 is then able to determine the current operating parameters of the elevator 108 (e.g., the current dump height 144 and dump angle 148) based on the location of the reference point 184 in three-dimensional space. As such, the processor 168 is able to calculate the current dump angle 148 and dump height 144 of the elevator 108 using only a two-dimensional input.
While the above described control sub-assembly 42a is configured to calculate the operating parameters of the elevator 108, the control assembly 42a may also be used to track the location of additional elements of the harvester 10. For example, the control assembly 42a may be used to track the primary extractor 120, the secondary extractor 124, the bin flap 114, and the like. In each instance, additional reference points (not shown) may be coupled to the relevant elements to allow the processor 168 to monitor and track the movement of each element individually. In still other implementations, the processor 168 may use the calculated location of a first item as an input to calculate the location of a second item that is dependent on the first item's location. For example, the processor 168 may use the location of a first reference point 184 coupled to the elevator 108 to calculate the current location of the elevator 108, and then use the elevator's location as an input to further calculate the location and orientation of the secondary extractor 124 using a second reference point (not shown) coupled thereto.
In addition to tracking the location of elements directly mounted to the harvester 10, the processor 168 of the first control assembly 41a may also apply vision based target detection, trained neural networks, texture recognition, and the like to the images produced by the mono-camera 176 to detect the presence or absence of items not directly attached to the harvester 10. For example, the processor 168 may be configured to detect and recognize the presence of a haulout 192 within the first field of view 180. Still further, the processor 168 may also us vision based target detection, trained neural networks, texture recognition, and the like to determine when the haulout 192 is properly positioned alongside the harvester 10 and ready to receive crop material 26 therein. In still other implementations, the processor 168 may be configured to detect when the haulout 192 is empty or full of crop material 26.
In addition to the above described detection capabilities, the control sub-assembly 41a may also use the calculated information to automate portions of unloading and harvesting processes. For example, the processor 168 may be configured to start and stop the unloading process based at least in part on the detection that the haulout 192 is positioned within the first field of view 180. Still further, the processor 168 may start or stop the unloading process based at least in part on whether the haulout 192 is full or empty. Still further, the processor 168 may be configured to rotate the elevator 108 to a predetermined dump angle 148 based at least in part on the presence or absence of a haulout 192 on a particular side of the harvester 10. In still other implementations, the processor 168 may be configured to adjust the operation of the primary and secondary extractors 120, 124.
While the illustrated sub-assembly 42a includes a single camera. It is to be understood that in alternative implementations that more than one camera may be used, each having a unique field of view. In such implementations, the processor 168 may be configured to track the reference point as it moves from the field of view of one camera to the field of view of another camera.
Illustrated in
More specifically, the harvester 10 includes a three-dimensional camera 196 coupled to the frame 14 of the harvester 10 that defines a second field of view 200 (see
The detected “attributes” of the crop material 26 may include, among other things, the lay orientation 204, the lay angle 208, and the stalk height 212 (see
During the harvesting process, the stereo-camera 196 conveys a continuous series of images to the processor 168 where each image includes a three-dimensional representation of the second field of view 180. After receiving the raw data, the processor 168 is configured to apply vision based target detection, trained neural networks, texture recognition, and the like to the images to extract data therefrom. In the illustrated implementation, the processor 168 is configured to first detect the presence or absence of crop material 26 in the cutting path 58, the first flanking area 62a, and the second flanking area 62b. In the areas where crop material 26 is present, the processor 168 is then configured to determine, among other things, the lay orientation 204, the lay angle 208, and the stalk height 212 of the crop material 26 contained therein.
With the general attributes of the crop material 26 detected, the processor 168 than inputs the information into one or more control algorithms to dictate the parameters of the harvesting operation. For example, the processor 168 is configured to adjust the cutting height 86 of the topper 88 based at least in part on the stalk height 212 and/or the lay angle 208 of the crop material 26 positioned within the cutting path 58. Still further, the processor 168 is also configured to turn the topper 88 on and off based at least in part on the presence or absence of crop material in the cutting path 58.
With respect to the elevator 108, the processor 168 is configured to adjust the dump angle 104 of the elevator 108 based at least in part on the absence or presence of crop material 26 in each of the flanking areas 62a, 62b. More specifically, the processor 168 is configured to adjust the dumping angle 148 of the elevator 108 so that the material outlet 112 is positioned on the side of the harvester 10 where no crop material 26 is present.
With respect to the crop dividers 70, the processor 168 is configured to adjust the crop dividers 70 between the deployed and retracted configurations based at least in part on the presence or absence of crop material 26 in the cutting path 58. In some implementations, the processor 168 may only disengage the crop divider 70 adjacent the flanking area 62a, 62b where no crop material 26 is present while maintaining the crop divider 70 positioned adjacent the flaking area 62a, 62b where crop material 26 is present in the engaged configuration. In still further implementations, the processor 168 is configured to disengage the crop dividers 70 if the lay angle 208 of the crop material 26 exceeds a predetermined threshold (e.g., the crop material 26 is sufficiently “upright” to not require crop dividers 70).
Still further, the processor 168 may be configured to adjust the head unit 22 as a whole between the activated and deactivated configurations based at least in part on the presence or absence of crop material 26 in the cutting path 58. While not listed specifically, it is also understood that the processor 168 may adjust or modify the operating parameters of any of the elements of the head unit 22, processing assembly 34, or unloading assembly 38 at least partially based on the detected attributes of the crop material 26 positioned within the second field of view 180 to harvest the crop material 26 in the most efficient manner possible and while minimizing wear on the individual parts of the head unit 22 and fuel consumption by the power unit.
This application is a continuation of U.S. Ser. No. 15/882,907, filed Jan. 29, 2018, the entire content of which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
3398516 | Jonathan | Aug 1968 | A |
3448564 | Chauffe | Jun 1969 | A |
4270337 | Pinto | Jun 1981 | A |
5749783 | Pollklas | May 1998 | A |
5995895 | Watt et al. | Nov 1999 | A |
6389785 | Diekhans | May 2002 | B1 |
8452501 | Lange et al. | May 2013 | B1 |
9226449 | Bischoff | Jan 2016 | B2 |
9320196 | Dybro et al. | Apr 2016 | B2 |
9629308 | Scholer et al. | Apr 2017 | B2 |
9668420 | Anderson et al. | Jun 2017 | B2 |
9723784 | Bremer et al. | Aug 2017 | B2 |
9807933 | Boyd et al. | Nov 2017 | B2 |
9915952 | Dollinger | Mar 2018 | B2 |
10254147 | Vermue | Apr 2019 | B2 |
10318138 | Scholer et al. | Jun 2019 | B2 |
10371561 | Darr | Aug 2019 | B2 |
10966369 | Suleman | Apr 2021 | B2 |
20030004630 | Beck | Jan 2003 | A1 |
20030075145 | Sheidler et al. | Apr 2003 | A1 |
20030187560 | Keller et al. | Oct 2003 | A1 |
20040186597 | Wippersteg et al. | Sep 2004 | A1 |
20050279070 | Pirro et al. | Dec 2005 | A1 |
20060026939 | Kormann | Feb 2006 | A1 |
20070056258 | Behnke | Mar 2007 | A1 |
20080155953 | Cleodolphi | Jul 2008 | A1 |
20090037059 | Huster et al. | Feb 2009 | A1 |
20100036696 | Lang et al. | Feb 2010 | A1 |
20110205084 | Morselli | Aug 2011 | A1 |
20130116894 | Perez-Iturbe et al. | May 2013 | A1 |
20130184944 | Missotten et al. | Jul 2013 | A1 |
20130205733 | Peters et al. | Aug 2013 | A1 |
20130211658 | Bonefas | Aug 2013 | A1 |
20130211675 | Bonefas | Aug 2013 | A1 |
20140083556 | Darr | Mar 2014 | A1 |
20140215984 | Bischoff | Aug 2014 | A1 |
20140224377 | Bonefas | Aug 2014 | A1 |
20140230391 | Hendrickson et al. | Aug 2014 | A1 |
20140236381 | Anderson et al. | Aug 2014 | A1 |
20140338298 | Jung et al. | Nov 2014 | A1 |
20150105984 | Birrell et al. | Apr 2015 | A1 |
20150124054 | Darr et al. | May 2015 | A1 |
20150242799 | Seki et al. | Aug 2015 | A1 |
20150243114 | Tanabe et al. | Aug 2015 | A1 |
20150262351 | Dima | Sep 2015 | A1 |
20150264863 | Muench et al. | Sep 2015 | A1 |
20150305238 | Klausmann et al. | Oct 2015 | A1 |
20150305239 | Jung et al. | Oct 2015 | A1 |
20150362904 | Scrivner et al. | Dec 2015 | A1 |
20160029558 | Dybro et al. | Feb 2016 | A1 |
20160084813 | Anderson et al. | Mar 2016 | A1 |
20160084987 | Dybro et al. | Mar 2016 | A1 |
20160106038 | Boyd et al. | Apr 2016 | A1 |
20160215994 | Mewes et al. | Jul 2016 | A1 |
20160330906 | Acheson et al. | Nov 2016 | A1 |
20170042088 | Nykamp | Feb 2017 | A1 |
20170055446 | Nykamp | Mar 2017 | A1 |
20170089742 | Bruns et al. | Mar 2017 | A1 |
20170118915 | Middelberg et al. | May 2017 | A1 |
20170185086 | Sauder et al. | Jun 2017 | A1 |
20170215330 | Missotten et al. | Aug 2017 | A1 |
20170251600 | Anderson et al. | Sep 2017 | A1 |
20170318743 | Sauder et al. | Nov 2017 | A1 |
20180164471 | Dybro et al. | Jun 2018 | A1 |
20180196441 | Muench et al. | Jul 2018 | A1 |
20180211156 | Guan et al. | Jul 2018 | A1 |
20180271015 | Redden et al. | Sep 2018 | A1 |
20180325014 | Debbaut | Nov 2018 | A1 |
20190021226 | Dima et al. | Jan 2019 | A1 |
20190327892 | Fries et al. | Oct 2019 | A1 |
20200020103 | Sneyders et al. | Jan 2020 | A1 |
20210015040 | Neitemeier et al. | Jan 2021 | A1 |
20220167557 | Reiners et al. | Jun 2022 | A1 |
Number | Date | Country |
---|---|---|
102523831 | Jul 2012 | CN |
107343417 | Nov 2017 | CN |
2654141 | Jun 1978 | DE |
102005000771 | Aug 2006 | DE |
102016118637 | Apr 2018 | DE |
3530099 | Aug 2019 | EP |
3987913 | Apr 2022 | EP |
1985000268 | Jan 1985 | WO |
WO-2013120063 | Aug 2013 | WO |
WO-2013120079 | Aug 2013 | WO |
WO-2013141975 | Sep 2013 | WO |
WO-2013162673 | Oct 2013 | WO |
WO-2013184178 | Dec 2013 | WO |
2014093814 | Jun 2014 | WO |
2022003461 | Jan 2022 | WO |
2022018656 | Jan 2022 | WO |
Entry |
---|
BCC Research, “Brief History of LiDAR, Its Evolution and Market Definition,” <https://blogbccresearch.com/brief-history-of-lidar-evolution-and-market-definition> Mar. 20, 2018. |
Canta et al., “Measuring height of sugarcane plants through LiDAR technology,” Proceedings of the 13th International Conference on Precision Agriculture, 2016, pp. 1-13. |
Inter-American Development Bank, “What is the precision agriculture? Why it is a likely answer to climate change and food security?” <https://www.youtube.com/watch?v=581Kx8wzTMc> Nov. 28, 2017. |
Lee, “Why experts believe cheaper, better lidar is right around the corner,” <https://arstechnica.com/cars/2018/01/driving-around-without-a-driver-lidar-technology-explained/> Jan. 1, 2018. |
Pei, “11 Myths About LiDAR Technology,” <https://www.electronicdesign.com/markets/automotive/article/21807556/11-myths-about-lidar-technology> Feb. 7, 2019. |
Saracco, “LiDAR is Getting Cheaper,” <https://cmte.ieee.org/futuredirections/2019/07/16/lidar-is-getting-cheaper/> Jul. 16, 2019. |
Number | Date | Country | |
---|---|---|---|
20210015042 A1 | Jan 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15882907 | Jan 2018 | US |
Child | 17039997 | US |