The invention relates generally to agriculture.
Patents related to the current invention are summarized here.
R. Lindores, et. al., “Wide-Area Agricultural Monitoring and Predicting”, U.S. Pat. No. 8,731,836 (May 20, 2014) describe a ground based normalized difference vegetative index used to calibrate an aerial agricultural measurement.
There exists in the art of agriculture a need for accurate, precise, and timely intervention to alter crop growing conditions.
The invention comprises an iteratively updated, multivariate/multi-dimensional, and spatially resolved agriculture aid apparatus and method of use thereof.
A more complete understanding of the present invention is derived by referring to the detailed description and claims when considered in connection with the Figures, wherein like reference numbers refer to similar items throughout the Figures.
Elements and steps in the figures are illustrated for simplicity and clarity and have not necessarily been rendered according to any particular sequence. For example, steps that are performed concurrently or in different order are illustrated in the figures to help improve understanding of embodiments of the present invention.
The invention comprises a method and apparatus for managing cropland comprising the steps of: (1) digitally and wirelessly linking a remote sensing platform to a ground based communication system; (2) spatially resolving into a set of locations an m×n ground matrix using both optics and detectors of the remote sensing platform, where m and n comprise positive integers of at least one hundred; (3) using the remote sensing platform, optically measuring for each member of the set of locations: first reflected cropland radiation in a first visible range using the remote sensing platform, second reflected cropland radiation in a second near-infrared range, and emitted radiation in a third infrared range of 2500 to 12,000 nm; (4) generating a crop health data set of the set of locations and the associated first reflected cropland radiation, the second cropland radiation, and the emitted radiation; (5) repeating the steps of spatially resolving and optically measuring to update the crop health data set at least daily during a period of at least one month; (6) analyzing the crop health data set to yield a crop health analysis comprising specific crop management recommendations for each element of the spatially resolved set of locations; and (7) communicating the specific crop management recommendations to a farm treatment system.
Herein, a z-axis is aligned with gravity and an x/y-plane represents cropland. As cropland is often not level, the cropland is optionally represented as a projection of the cropland along the z-axis onto the x/y-plane.
Herein, near infrared light (NIR) light comprises light from 700 to 2500 nm and short wave near infrared light comprises light from 700 to 1100 nm. Infrared light comprises: (1) short wave infrared light (SWIR) light from 1000 to 3000 nm or non-NIR SWIR light from 1100 to 3000 nm; (2) mid-wave infrared (MIR or MWIR) from 3000 to 5000 nm (2000-3333 cm−1 or wave numbers); and (3) long wave infrared, also referred to as thermal infrared (TIR) from 8,000 to 12,000 nm (833-1250 cm−1), which is the fingerprint region to chemists.
As further described, infra, a remote agriculture monitoring system yields simultaneous information on the state of growth, state of health, and/or future needs of spatially resolved sections of an agricultural area through use of remote spectroscopy, history, topology, and/or weather forecasts.
Referring now to
Spatial Resolution
In this section, spatial resolution is addressed. However, the spatial resolution aspects described herein function in conjunction with wavelength resolution and temporal analysis, each further described infra.
Referring now to
Still referring to
Still referring to
Still referring to
In a fourth example, not illustrated, a third central pivot crop circle, as analyzed by the remote agricultural monitoring system 100, requires all of the treatments of the previous two examples: a fertilizer over the entire crop, extra irrigation over an outer perimeter area, and extra irrigation over a southwest region.
Referring again to
More generally, the remote agricultural monitoring system 100 allows for monitoring tens, hundreds, and/or thousands of crop areas, such as central pivot crop circles and/or any geometrically shaped field, yields a quantitative metric for each sub-region, such as an individual central pivot crop circle; and/or yields a set of quantitative metrics, such as need for crop protection, herbicide, pesticide, fertilizer, tilling, crop rotation, and/or irrigation for each spatially resolved sub-element of each sub-region all without requiring a visual inspection by the farmer or any sub-region, much less all sub-elements, of the farm.
The inventor notes that output of the remote agricultural monitoring system 100 is optionally used in an automated control of one or more treatment/management systems of the farm sub-elements.
Wavelength Resolution
In this section, remote spectroscopy measurements as a function of wavelength and/or in sections of the electromagnetic spectrum are described. However, the remote spectroscopy functions together with the spatial resolution, described supra, and the temporal analysis, described infra.
Referring now to
As described supra, the remote sensing platform 110, satellite 116, spatially resolves the agricultural land 120. More particularly, the remote sensing platform 110 uses one or more two-dimensional detector arrays coupled to an optical imaging system to spatially resolve sections of the agricultural land 120. Further, for each spatially resolved section, of the agricultural land 120, responses are independently measured at multiple wavelengths, such as two or more wavelengths in the visible region and two or more wavelengths in the near-infrared region, and two or more wavelengths in the mid-infrared region. Wavelengths of light are separated, resolved, and/or isolated using a set of optical filters, a grating based spectrometer, a movable mirror based spectrometer with a subsequent Fourier transform, and/or a Hadamard based analyzer. Optionally and preferably, two or three spectrometers, analyzers, wavelength separation approaches, and/or two-dimensional detectors are used to cover the range of wavelengths of interest from about 380 nm to about 12,000 nm, where detectors include silicon based, indium gallium arsenide based, and mercury/cadmium/telluride based detector elements. Resulting signals are optionally and preferably fused, such as after a spatial resolution transform into a resulting data cube. The data cube comprises two axes comprising a projection of the agricultural land 120 along the z-axis onto and x/y-plane of the detector and for each m×n detector element a spectrum, S, is recorded, where the spectrum, S, represents signals from the one, two, three, or more spectrometers. Subsequent data cubes are generated as a function of time, as further described infra. The large data cubes are optionally subsequently analyzed using hardware on the satellite 116 and a smaller results data set is transmitted back to the main controller 310 of the base station 130 and/or is transmitted to the end user or equipment thereof directly. A data cube is optionally broken or separated into component parts, matrices, indices, and the like where the combined data of the individual parts is a subset of the original data cube, a transformation of the original data cube, or a representation of the data cube where underlying information of the combined separated parts includes x/y-position information and remote sensing spectroscopy information associated with the x/y-positions. A processed data cube is referred to herein as an information cube. The information cube comprises a transform of the data cube into an n-dimensional space where the n-dimensional space comprises fewer dimensions than individual wavelength regions measured and placed into the data cube. Optionally and preferably, the information cube is supplemented with additional information, such as by fusion, concatenation, and/or a further transform with non-spectral information, such as further described infra.
The data cube is optionally supplement with non-spectral data/information, such as: underground features; water holding capacity of the soil; soil type, such as clay or sand; tilth; soil depth; rock features; heat holding capacity; and/or localized heat holding features, such as roadways, rock walls, and water bodies.
Referring still to
Optionally and preferably, sunlight is used as a source of visible photons. Red and blue 324 wavelengths of sunlight are absorbed by chlorophyll while the green 326 of green crops represents reflected green light.
More particularly, chlorophyll comprises chlorophyll a and chlorophyll b. Generally, chlorophyll a comprises peak absorbances 325 at 420±10 nm and 675±10 nm and chlorophyll b comprises peak absorbances at 470±15 nm and 625±20 nm. However, chlorophyll absorbs broadly in both the blue and red regions of the electromagnetic spectrum. Hence, absorbance is optionally measured at and/or within ±30, 50, 75, or 100 nm from the peak absorbance. Still more particularly, as chlorophyll absorbs red and blue light, reflected light is optionally used to measure chlorophyll, where chlorophyll is used as an indirect indicator of crop health. For instance, reflected and/or diffusely reflected: (1) green light 327, such as from 500 to 600; (2) ultraviolet light, such as from 200 to 400 nm; and/or (3) near-infrared light, such as from 700 to 1000 nm is used to determine a first health parameter of the crops, being related to the green vigor of the plant and the chlorophyll therein. The inventor notes that non-green light from 480 to 500 nm and/or 600 to 620 nm is optionally used to measure crop health as chlorophyll absorbance drops to less than five percent above 480 nm and rises above five percent at 620 nm.
Optionally and preferably, intensities of multiple visible wavelengths are detected allowing non-linear data analysis and/or chemometric analysis to extract more detailed, accurate, and/or precise sample constituent information. Optional data analysis techniques include: hyperspectral imaging using combinations of wavelengths from the visible, near-infrared, and infrared wavelength regions; multivariate approaches, such as use of partial least squares or principal component regression; artificial intelligence, such as a neural network; a calibration data set used to generate a model for subsequent prediction of values from subsequent measurements; multi-modal measurements, such as temperature, wind speed, humidity, topology, precipitation, time of day, and wavelength intensity information; and/or combining intelligent system information, such as historical information with any of the preceding techniques.
Generally, reflected/diffusely reflected visible light allows the sun to function as the source and to use an intensity detector positioned above the crops, such as carried by the satellite 116, as described supra.
Still referring to
Still referring to
Optionally and preferably, the crop and/or soil emits infrared light and the light is monitored directly, such as via an intensity versus position measurement, optionally at 1, 2, 3, 5, 10, 25, 50, 100 or more infrared wavelengths.
Referring now to
More particularly: (1) a first crop area 412 reveals a decrease in diffusely reflected green light in the visible region; (2) a second crop area 414 reveals a change in water absorbance 414 in the near-infrared coupled with a more rapid temperature rise as a function of time of day, normalized by weather parameters, as observed in the infrared; and (3) a third crop area 416 reveals a foliage decrease through reduction in green in the visible region, a change in observed water absorbance in the near-infrared region, and more rapid temperature swings in the infrared region. Resulting actionable results/recommendations are to fertilize 422, water 424, and add pesticide 426 to the first, second, and third crop areas 412, 414, 416, respectively. Notably, an overlapping area 430 optionally receives more than one treatment type. Generally, the first, second, and third crop areas 412, 414, 416 respectively illustrate an analysis with one, two, and three of the visible, near-infrared, and infrared wavelength regions.
Temporal Analysis
In this section, temporal analysis of data from the above described spatial resolution and wavelength resolution is described.
Referring now to
Referring now to
Still referring to
In another example, crop type and crop growth as a function of time are used to further aid development of a recommended treatment for each location as a function of time using multi-wavelength band spectral data. The crop type and crop growth information is optionally provided; however, preferably the crop type and crop growth stage is determined using the remote agricultural monitoring system 100. For instance, the crop is identified as corn or soybean. Further, a post-sprout age of the crop is determined using the remote agricultural monitoring system 100. As treatment requirements for a first crop type, such as corn, differs as a function of time, such as 6 or 12 weeks post-sprout, and as treatment requirements for the first crop type differ from a second crop type, such as soybeans, the recommended treatment 550 provided by the model 540 is optionally and preferably adjusted by a basis set database for the identified crop and identified time period in the crop life.
Generally, the model 540, using calibration data 542, operates on an initial prior measurement 510/one-time measurement and/or a dynamically updated measurement 570 to generate a recommended treatment 550, using a spectral response vector, for one or more positions of the agricultural land 120. The response vector input to the model 540 is optionally and preferably supplemented with one or more of:
In another example, one or more satellites orbit the planet in low, medium, and/or high orbits, where each satellite is designed to enable acquisition of remote sensing information with high spatial resolution and high temporal resolution. Ground spatial resolution of ten meters or less is used to identify features in sub-regions within agricultural fields containing either healthy crops or crops under stress. Temporal resolution comprises satellite revisits over the same geographical region on a daily basis or better to provide information to decision makers, such as farmers, to make important decisions to apply the necessary resources to mitigate problems detected in these regions. Satellites are optionally arranged in a constellation to enable high temporal resolution of daily revisits or better by satellites at the same ground location. The acquired remote-sensing data is optionally processed onboard each satellite to generate data and information products for dissemination to appropriate consumers within less than 6, 12, 24, 36, or 48 hours from the time of data acquisition.
In another example, after the remote agricultural monitoring system 100 gathers information with a satellite 116, such as at a first resolution, optionally a secondary system is used to further map identified trouble areas and/or areas with highly variable treatment recommendations. For instance, if an entire area calls for fertilizer, then a second higher resolution analysis is not necessarily necessary. However, if the satellite 116 results reveal a patchwork of treatment recommendations, such as varying on the order of the resolution of the satellite data, then the secondary system, such as the airplane 112 or a drone, is used to further map, enhance the existing map, and/or remap the identified patchwork area. As the drone altitude is substantially less than the satellite, enhanced spatial resolution is made possible and can be made with some intermittent interferences, such as clouds. The inventor notes that optionally copies of the spectrometers mounted on the satellite 116 are used on the drone resulting in enhanced spatial resolution, due to the lower altitude of the drone. Further, the identical copies or identical sub-element copies of the satellite analyzers greatly reduces complexities of designing, developing, and implementing the data collection hardware and/or greatly reduces complexities of merging a first data cube from the satellite 116 with a second data cube from the drone due to similarities of baselines, noise characteristics, response curves, and/or any spectra altering hardware element of the analyzer.
In still another example, remote sensing is performed at one or more electromagnetic wavelength bands such as the visible, near infrared, mid-infrared, long wavelength infrared, microwave, and/or radio bands. Sensors onboard satellites acquire point measurements and preferably imaging measurements of the planetary surface locations. Different kinds of information are acquired from each of the above-mentioned electromagnetic spectral bands. For example, the visible and near infrared bands allow determination of coverage of the land surface by vegetation or bare soil, mid-infrared wavelength bands allow determination of atmospheric moisture content, long wavelength infrared measurements allow determination of the land surface temperature both of vegetation and soil, and microwave and radio bands allow measurements of the soil moisture content as well as the refractive index of the atmosphere.
In yet another example, specialized communication protocols are used for optimizing the rapid uplink and downlink of information to and from the orbiting satellites from ground transmission/receiving stations. High-speed processing of acquired information onboard the orbiting satellites in a near real time manner is optionally and preferably used to generate derived information products, such as those described above. Further, specialized algorithms for the efficient processing of the acquired information and generating derivative information products are used in conjunction with methods for rapid dissemination of data and derivative information products within 24 hours of remote-sensing acquisition. Thus, large data sets, the raw data cubes, are analyzed to generate actionable results, which are optionally and preferably rapidly transmitted, such as to an end-user, an end-user cell phone/computer, and/or an electromechanical farm implement.
In still another example, information derived from the satellite based remote sensing system is provided to one or more autonomous and/or semi-autonomous agricultural implements and/or systems, such as to a fertilizer, herbicide deployment system, pest reducer, irrigator, crop inspector, and/or harvester, where the information is direct sent to the agricultural implements and/or indirectly sent to the agricultural implements.
Still yet another embodiment includes any combination and/or permutation of any of the elements described herein.
The main controller, a localized communication apparatus, and/or a system for communication of information optionally comprises one or more subsystems stored on a client. The main controller is optionally and preferably linked directly, indirectly, and/or wirelessly to one or more electromechanical devices, such as instrumentation and computing elements. The client is a computing platform configured to act as a client device or other computing device, such as a computer, personal computer, a digital media device, and/or a personal digital assistant. The client comprises a processor that is optionally coupled to one or more internal or external input device, such as a mouse, a keyboard, a display device, a voice recognition system, a motion recognition system, or the like. The processor is also communicatively coupled to an output device, such as a display screen or data link to display or send data and/or processed information, respectively. In one embodiment, the communication apparatus is the processor. In another embodiment, the communication apparatus is a set of instructions stored in memory that is carried out by the processor.
The client includes a computer-readable storage medium, such as memory. The memory includes, but is not limited to, an electronic, optical, magnetic, or another storage or transmission data storage medium capable of coupling to a processor, such as a processor in communication with a touch-sensitive input device linked to computer-readable instructions. Other examples of suitable media include, for example, a flash drive, a CD-ROM, read only memory (ROM), random access memory (RAM), an application-specific integrated circuit (ASIC), a DVD, magnetic disk, an optical disk, and/or a memory chip. The processor executes a set of computer-executable program code instructions stored in the memory. The instructions may comprise code from any computer-programming language, including, for example, C originally of Bell Laboratories, C++, C#, Visual Basic® (Microsoft, Redmond, Wash.), Matlab® (MathWorks, Natick, Mass.), Java® (Oracle Corporation, Redwood City, Calif.), and JavaScript® (Oracle Corporation, Redwood City, Calif.).
Herein, any number, such as 1, 2, 3, 4, 5, is optionally more than the number, less than the number, or within 1, 2, 5, 10, 20, or 50 percent of the number.
Herein, an element and/or object is optionally manually and/or mechanically moved, such as along a guiding element, with a motor, and/or under control of the main controller.
The particular implementations shown and described are illustrative of the invention and its best mode and are not intended to otherwise limit the scope of the present invention in any way. Indeed, for the sake of brevity, conventional manufacturing, connection, preparation, and other functional aspects of the system may not be described in detail. Furthermore, the connecting lines shown in the various figures are intended to represent exemplary functional relationships and/or physical couplings between the various elements. Many alternative or additional functional relationships or physical connections may be present in a practical system.
In the foregoing description, the invention has been described with reference to specific exemplary embodiments; however, it will be appreciated that various modifications and changes may be made without departing from the scope of the present invention as set forth herein. The description and figures are to be regarded in an illustrative manner, rather than a restrictive one and all such modifications are intended to be included within the scope of the present invention. Accordingly, the scope of the invention should be determined by the generic embodiments described herein and their legal equivalents rather than by merely the specific examples described above. For example, the steps recited in any method or process embodiment may be executed in any order and are not limited to the explicit order presented in the specific examples. Additionally, the components and/or elements recited in any apparatus embodiment may be assembled or otherwise operationally configured in a variety of permutations to produce substantially the same result as the present invention and are accordingly not limited to the specific configuration recited in the specific examples.
Benefits, other advantages and solutions to problems have been described above with regard to particular embodiments; however, any benefit, advantage, solution to problems or any element that may cause any particular benefit, advantage or solution to occur or to become more pronounced are not to be construed as critical, required or essential features or components.
As used herein, the terms “comprises”, “comprising”, or any variation thereof, are intended to reference a non-exclusive inclusion, such that a process, method, article, composition or apparatus that comprises a list of elements does not include only those elements recited, but may also include other elements not expressly listed or inherent to such process, method, article, composition or apparatus. Other combinations and/or modifications of the above-described structures, arrangements, applications, proportions, elements, materials or components used in the practice of the present invention, in addition to those not specifically recited, may be varied or otherwise particularly adapted to specific environments, manufacturing specifications, design parameters or other operating requirements without departing from the general principles of the same.
Although the invention has been described herein with reference to certain preferred embodiments, one skilled in the art will readily appreciate that other applications may be substituted for those set forth herein without departing from the spirit and scope of the present invention. Accordingly, the invention should only be limited by the Claims included below.
This application claims benefit of U.S. provisional patent application No. 62/495,712 filed Oct. 13, 2016.
Number | Name | Date | Kind |
---|---|---|---|
4755942 | Gardner | Jul 1988 | A |
Number | Date | Country | |
---|---|---|---|
20180077852 A1 | Mar 2018 | US |
Number | Date | Country | |
---|---|---|---|
62495712 | Sep 2016 | US |