The present disclosure generally relates to agricultural apparatus and methods. More particularly, and without limitation, the present disclosure relates to a mobile platform and methods for determining soil moisture.
Precision agriculture is an increasingly adopted farming practice that aims to administer agronomic inputs (e.g., irrigation, fertilizers, pesticides) when, where, and in the amount needed. To inform such management, networks of ground and remote sensors are used to accurately characterize soil-plant-environment processes. Precision irrigation, specifically, can increase grower revenue and decrease the environmental footprint of agriculture by applying water directly where and when required from the ideal source. Accurate estimates of water available to plant roots throughout the soil profile can be obtained with soil sensors. However, only 12% of growers in the USA use root-zone soil measurements to trigger and budget irrigation events. The growers that utilize these measurements rely on an expensive network of decentralized sensors. These sensors generally measure only a few points across large swathes of land and provide an incomplete picture of irrigation practices. Such lean sampling fails to capture soil spatial variability, which is a key component of plant-water-environment relationships. Knowledge of soil moisture (SM) spatial variability can improve precision irrigation.
Capturing continuous measurements with a robotic system helps remove several current barriers to entry that prevent the wider adoption of soil moisture measurements. Geospatial electromagnetic induction (EMI) measurements of soil apparent electrical conductivity (ECa) are a reliable proxy for SM spatial variability. Barriers to the use of this technology include the cost of carrying out reliable EMI surveys and calibrating the sensor readings to SM estimations. Concurrent in-situ measurements of soil moisture can calibrate field-scale ECa geospatial surveys to accurately map root-zone soil moisture using physically-based stochastic modeling. Then site-specific ECa-to-SM calibrations are elaborated by experts using concurrent SM data from in-situ SM monitoring stations or from soil cores.
However, integrating an EMI soil sensor with a robotic platform presents several challenges. The EMI sensors use a paired emitter to induce a magnetic field in the soil and receiver to measure such field. The soil ECa is derived from these electromagnetic measurements. Though continuous robotic measurements would benefit irrigation models, this configuration introduces the possibility that metal and electronic components of the robot can interfere with the sensor measurement. The placement and orientation of the sensor on the platform is critical since the mere presence of the robot in proximity to the sensor can interfere with the sensor reading. Sensor placement is also constrained by the robot's size, weight, and power (SWaP) requirements to be both portable and effective at traversing uneven terrain.
In typical applications, SM surveys with EM sensors are carried out manually either by walking the sensor in the field, or by driving field vehicles with a trailing sensor (see
Soil apparent electrical conductivity (ECa) is a vital metric in Precision Agriculture and Smart Farming, as it is used for optimal water content management, geological mapping, and yield prediction. Several existing methods seeking to estimate soil electrical conductivity are available, including physical soil sampling, ground sensor installation and monitoring, and the use of sensors that can obtain proximal ECa estimates. However, such methods can be either very laborious and/or too costly for practical use over larger field canopies. Robot-assisted ECa measurements, in contrast, may offer a scalable and cost-effective solution.
In general, soil conductivity is mainly estimated in-situ, using three distinctive methods; moisture meters (hydrometers) installed into the ground, time-domain reflectometers, and measurement of soil electromagnetic induction (EMI). In the first two cases, growers install and use decentralized sensor arrays to gather information from selected points on the field. A main drawback of these approaches is that they provide discrete measurements and hence sparse information over the complete field, which may lead to less efficient agricultural tactics and higher costs while aiming to scale over larger fields. On the other side, ECa is measured geospatially (on-the-go) with Electrical Resistivity methods and EMI sensors. The EMI measurements of soil apparent electrical conductivity can be performed in a continuous manner and proximally, whereby a farm worker walks through the field holding the EMI sensor or a field vehicle that carries the sensor is driven around (
For these and other reasons there is a need for an integrated robotic soil sensor platform that can serve as a reliable and accurate platform for performing continuous ECa measurements as part of a SM survey.
Consistent with the disclosed embodiments, an apparatus includes a mobile platform, a sensor physically coupled to the mobile platform, and a control system mounted on the chassis and communicatively coupled to the sensor. The mobile platform includes a chassis; the mobile platform to traverse an agricultural field. The sensor is physically coupled to the mobile platform. The sensor, in operation, makes one or more soil apparent electrical conductivity measurements in the agricultural field. In some embodiments, the mobile platform has an optimal chassis to sensor distance that is optimum for avoiding electrical interference between the sensor and the chassis. The sensor is positioned at an operational distance from the chassis that is less than the optimal chassis to sensor distance. In some embodiments, the control system provides geo-referencing and autonomous logging of the one or more soil apparent electrical conductivity measurements. In some embodiments, the mobile platform includes an adjustable platform to hold the sensor. In some embodiments, the sensor is physically coupled to the mobile platform using carbon-fiber rods. In some embodiments, the mobile platform has a direction of travel, the sensor is oriented substantially perpendicular to the direction of travel. In some embodiments, the apparatus includes a ground clearance distance that defines an operational distance between the sensor and the agricultural field of between about forty-five and fifty-five millimeters. In some embodiments, the mobile platform includes wheels to contact the agricultural field. In some embodiments, the sensor is tuned such that the one or more soil apparent electrical conductivity measurements have high-accuracy to a soil depth of about 0.7 meters. In some embodiments, the agricultural field includes terrain deviations and the mobile platform includes an approach angle α and a departure angle β selected to enable the mobile platform to traverse the agricultural field and make useful measurements. In some embodiments, the agricultural field includes micro-irrigated orchard systems. In some embodiments, the terrain deviations are about twenty-five millimeters or less.
Consistent with the disclosed embodiments, a method for identifying a substantially optimal position for positioning a sensor on a mobile platform is disclosed. The method includes identifying a first distance from the mobile platform to allow for reduced electromagnetic interference from the mobile platform. The method also includes identifying a second distance from the ground to allow for reduced vibration and fluctuating measurements in a non-uniform terrain, the substantially optimal position for locating the sensor being a location defined by the first distance and the second distance that enables obtaining a plurality of apparent electrical conductivity measurements that have standard deviations that closely match standard deviations of manually obtained measurements. In some embodiments, identifying a first distance from the mobile platform to allow for reduced electromagnetic interference from the robot includes identifying a distance of about sixty centimeters. In some embodiments, identifying a second distance from the ground to allow for reduced vibration and fluctuating measurements in a non-uniform terrain comprises selecting a height of about six centimeters.
Consistent with the disclosed embodiments, a method is disclosed. The method includes navigating an agricultural field with a mobile platform. The method includes generating a real-time position and orientation for the mobile platform. The method includes performing one or more soil apparent electrical conductivity measurements of the agricultural field from a sensor physically coupled to the mobile platform. The method includes synchronizing the one or more soil apparent electrical conductivity measurements with the real-time position. The method includes geospatial mapping and autonomously logging the one or more soil apparent electrical conductivity measurements. The method includes processing the one or more soil apparent electrical conductivity measurements to generate one or more soil moisture values.
In some embodiments, navigating the agricultural field with the mobile platform includes traversing a root zone under tree canopies of an olive grove. In some embodiments, navigating the agricultural field with the mobile platform comprises navigating a muddy agricultural field. In some embodiments, the method further includes delivering high-linearity scores in real survey scenarios at a citrus grove under different irrigation levels by scoring more than about 90% in Pearson correlation coefficient in both plot measurements and estimated apparent electrical conductivity maps generated by kriging interpolation. In some embodiments, the method further includes utilizing a simulation software package that provides estimation of terrain traversability in relation to identifying substantially optimal sensor placement. In some embodiments, navigating the agricultural field with the mobile platform includes generating platform control commands from a waypoint-based trajectory planner. In some embodiments, navigating the agricultural field with the mobile platform comprises navigating along one or more drip lines in the agricultural field. In some embodiments, the method further comprising scheduling irrigation for the agricultural field based on the soil moisture values. In some embodiments, processing the one or more soil apparent electrical conductivity measurements to generate the one or more soil moisture values includes including a correction factor in the processing to account for the mobile platform influencing the one or more soil apparent electrical conductivity measurements. In some embodiments, the method further includes displaying the soil moisture value in real time. In some embodiments, the method further includes determining the maximum practical sensor mounting distance dh and angles α and β that allow the robot to traverse uneven terrain with deviations of plus or minus about 25 millimeters from level after mounting the sensor on the mobile robot without tipping, stalling, or colliding the sensor into the ground.
Reference will now be made in detail to exemplary embodiments, discussed with regards to the accompanying drawings. In some instances, the same reference numbers will be used throughout the drawings and the following description to refer to the same or like parts. Unless otherwise defined, technical and/or scientific terms have the meaning commonly understood by one of ordinary skill in the art. The disclosed embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosed embodiments. It is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the disclosed embodiments. For example, unless otherwise indicated, method steps disclosed in the figures can be rearranged, combined, or divided without departing from the envisioned embodiments. Similarly, additional steps may be added or steps may be removed without departing from the envisioned embodiments. Thus, the materials, methods, and examples are illustrative only and are not intended to be necessarily limiting.
Disclosed is a ground mobile robot equipped with a customized and adjustable platform to hold an Electromagnetic Induction (EMI) sensor to perform semi-autonomous and on-demand ECa measurements under various field conditions. The platform is designed to be easily re-configurable in terms of sensor placement; results from testing for traversability and robot-to-sensor interference across multiple case studies help establish appropriate tradeoffs for sensor placement. Further, a developed simulation software package enables rapid and accessible estimation of terrain traversability in relation to desired EMI sensor placement. Extensive experimental evaluation across different fields demonstrate that the obtained robot-assisted ECa measurements are of high linearity compared with the ground truth (data collected manually by a handheld EMI sensor) by scoring more than 90% in Pearson correlation coefficient in both plot measurements and estimated soil apparent electrical conductivity maps generated by kriging interpolation. The robotic solution supports autonomous behavior development in the field since it utilizes the Robot Operating System (ROS) navigation stack along with the Real-Time Kinematic (RTK) GNSS positioning data and features various ranging sensors.
Key Features of Integrated Robotic Soil Sensor Platform
Apparent soil electrical conductivity (ECa) measures the bulk conductivity of the soil and the resulting measurement is a complex interaction of salinity, water content, and soil composition. Though the interactions may be complex, soil moisture can be reliably inferred from ECa measurements when ground-truth data are used. During operation, the EMI sensor generates a primary electric field that induces eddy currents into moist soil. These currents generate a secondary magnetic field that is then measured by the sensor's receiver.
In some embodiments, a CMD-Tiny (GF Instruments) conductivity sensor, which is a small-form sensor, is integrated with the ROSbot platform. The sensor has diameter 42.5 mm and length 500 mm and weighs 424 g (i.e., only 4% of ROSbot's total payload capacity of 10 kg). The sensor is paired with a data logger that also provides power to the former.
The ROSbot 2.0 Pro (Husarion Robotics) is adopted as the mobile platform to deploy in the field. This compact and light-weight robot contains the necessary integrated hardware to enable stable maneuverability, remote control, and autonomous navigation. As shown in
The platform's software architecture is built upon ROS to enable automatic geospatial mapping of ECa measurements and soil moisture content in micro-irrigated orchard systems. The software consists of navigation and ECa modules that are interpreted as several ROS nodes. The navigation module utilizes an external GNSS receiver and ROSbot's odometry information fused from motor encoders and IMU to compute the robot's real-time pose (i.e. position and orientation) with an Extended Kalman Filter. Robot control commands are generated from either manual inputs or a waypoint-based trajectory planner. In field testing teleoperation was used; in some embodiments, autonomous navigation in the field can be enabled by integrating measurements from the onboard LiDAR and RGB-D camera activated for online obstacle avoidance. The ECa module extracts SM information from the EMI sensor and synchronizes the data with spatial coordinates from the navigation module. Geospatial SM data are displayed in real time and simultaneously logged into local CSV files for post-processing with ArcMap 10.8 (ESRI, Redlands, CA).
Development and testing of the integrated robotic soil sensor platform was conducted over four experimental stages.
Objective: Identify a mapping between sensor and main robot chassis distance and EMI interference, and determine viable sensor placement configurations minimizing the latter.
Setup: The robot was placed at different locations of interest, and at different times and days to establish a rich basis, and several discrete ECa measurements were taken at fixed distance intervals from the robot, dh=25, 30, 36, 41, 46, 51, 56, 61 cm, and at two orientations, θ=0°, 90°. Control measurements without the robot present were also taken at all sampled locations. The test environments included grass, bare-soil, and tree roots found at the Agricultural Experimental Station of the University of California, Riverside, and at the USDA-ARS U.S. Salinity Laboratory, also in Riverside, California. Table I (Conductivity Measurements (mS/m) at Varying Distances dh (cm) Over Various Test Configurations) lists all test cases, and
Results: Testing reveals that the (ideal) horizontal distance dh for the sensor would need to be at least 457 mm away from the main robot chassis in order to not to have a statistically significant influence on the EMI sensor measurements. At closer distances, the robot affects the sensor measurements, but it does not saturate the sensor. Table I (Conductivity Measurements (mS/m) at Varying Distances dh (cm) Over Various Test Configurations) contains the soil conductivity measurements at different test configurations. The column marked with denotes the control measurement at that location where the robot was not present.
With reference to Table I (Conductivity Measurements (mS/m) at Varying Distances dh (cm) Over Various Test Configurations), measurements were taken to determine the effect of the sensor angle θ. Data suggest that the ideal orientation of the sensor would be 90°, that is the sensor should be mounted sideways and parallel to the direction of motion of the robot. However, this configuration would make the robotic platform unstable; hence, we elected to proceed with the horizontal sensor orientation (i.e., the sensor is mounted perpendicular to the direction of motion).
Mounting the sensor at the ideal distance from the robot would significantly impact its mobility, hence the sensor is mounted at a closer distance (as described below) and identify a correction offset (as we described below) to account for the small, yet noticeable effect of the robot on the sensor's measurements. While the ideal placement would eliminate sensor bias, current best practices often mount the ECa sensors with metal brackets to farm equipment, which introduces a measurement bias. Though further refinement of the robotic system could reduce bias, our platform conforms to standard practices.
Finally, in the field, the measured values did not noticeably change within the resolution of the measurements when the sensor was placed on top of a short spacer (6.35 mm) or a taller one (80 mm). To provide a large margin for the departure angle (as we described below), dv=50 mm was used, which will provide sufficient ground clearance without obstructing the LiDAR's field of view.
Objective: Determine the maximum practical sensor mounting distance dh and angles α and β that allow the robot to traverse uneven terrain with deviations of plus or minus 25 mm from level after mounting the sensor without tipping, stalling, or colliding the sensor into the ground.
Setup: After completing the integration of the sensor and its data logger (mounted at the back and front of the robot; see
The sensor was mounted using a combination of carbon fiber rods and custom 3D printed brackets. The assembly using carbon fiber rods is an appropriate means to suspend the sensor behind the robotic platform since the rods have high strength-to-weight ratio, and are rigid and non-metallic. The lightweight nature of carbon fiber aids the design goal of maximum portability. Rigidity is beneficial because it minimizes the likelihood that the cantilever sensor arm will vibrate or flex while the robot is traversing obstacles. Finally, metal support rods were not an option since they would affect the conductivity measurements. Use of metal fasteners was minimized to reduce interference with the sensor, though they could not be completely avoided for the sensor mounting.
Results: While the ideal integration configuration would have no interference between the robotic platform and the sensor, the sensor placement is constrained by the need to have approach (α) and departure (β) angles that allow the robot to traverse a field with deviations of plus or minus 25 mm from level terrain. As such, the ideal distance dh determine below is not possible to achieve. Instead, the maximum distance that prevented tipping while still allowing the vehicle to traverse the desired terrain was empirically determined at dh=235 mm.
Following the tests discussed in this and the previous section, and with reference to
Objective 1: Quantify the impact the mounting distance dh=235 mm has on the ECa measurements.
Objective 2: Determine if the introduced measurement bias is linear or nonlinear.
Setup: A row of olive trees was selected as a comparison region between roboticized- and manually-collected data. First, the robot with integrated sensor was driven down the row multiple times to collect ECa measurements along with GNSS coordinates. Then, the same measurements were collected by a human carrying the sensor. These paired measurements can be compared to determine if there are any transients from the robot during operation that could impact the EMI measurement. These tests also served to validate the robot's ability to traverse the field terrain, though these observations were qualitative not quantitative.
Results: Since the mechanical constraints impacted the sensor placement, the goal here is to determine if the presence of the robot introduced a constant linear offset into the ECa Measurements.
Objective: Generate ECa maps at a selected study site and compare the roboticized and manually-collected measurement data.
Setup: In the extensive field test conducted, the study site was a 50 m×30 m drip-irrigated olive orchard located within the Agricultural Experimental Station of the University of California in Riverside (33° 58′24.5″N 117° 19′10.3″W). Soils ([0, 0.7] m depth range) at the site were sandy loam, with sand content ranging between 54.6% and 65.9%. On Mar. 12, 2021, two ECa surveys were carried out at the study site to compare hand-held measurements with these acquired with our proposed integrated robotic soil sensor platform. In addition to the ECa measurements, GNSS position was recorded to compare the results. The robot also recorded its pose (position and orientation), although these measurements were not available during the manual hand-held process. The hand-held survey collected 461 ECa measurements, whereas the ROSbot survey collected 6901. Collected data were sampled at the same frequency, but the robot was moving slower than the human counterpart, thus leading to the increased number of samples via the roboticized approach.
Following commonly used data filtering procedures, the ECa data were normalized with a natural logarithm transformation. Then, also in line with the standard of practice, any values outside the range of plus or minus 2.5 standard deviation around the average values were removed because deemed as outliers. The hand-held ECa dataset had 2 outliers, whereas the ROSbot dataset had 137. The increased number of outliers in roboticized measurements is linked to the fact that those measurements were substantially more compared to manually-collected ones. The average of the hand-held ECa dataset was 19.0 mS/m. The average ECa value measured with the ROSbot was 53.5 mS/m. The difference (34.5 mS/m) was removed from all ECa measurements in the ROSbot dataset, to compare the variability and spatial distribution of the two datasets. In ArcMap 10.8 (ESRI, Redlands, CA), the ECa for the two datasets were spatially interpolated using simple kriging with exponential semi variogram to generate maps with 0.5 m×0.5 m resolution. These spatial maps are displayed in
Results: The ECa map obtained from the hand-held survey had mean=18.78 mS/m, standard deviation=2.31 mS/m, minimum=12.94 mS/m, and maximum=26.48 mS/m. The ECa map derived from the ROSbot survey had mean=19.94 mS/m, standard deviation=1.85 mS/m, minimum=15.35 mS/m, and maximum=26.72 mS/m (Table III). The two maps revealed similar ECa spatial patterns, with the highest ECa values observed at the SE and SW portions of the study site, and the lowest ECa measured in the N and the center of the site. At the pixel-by-pixel level, the maps had a Pearson correlation coefficient=0.65. This indicates that there are some inconsistencies between the maps, possibly associated with: non-constant influence of the ROSbot on the sensor measurements, different sensor distance to soil and tilt across the two surveys, and higher detail (and variance) captured in the ROSbot survey than in the hand-held one. Observed geolocation inaccuracies are because of the employed low-resolution GPS that also introduces inconsistencies.
While the robot collected data at a slower rate than manual operation, this actually provides more accurate measurements. Current commercial practices can suffer from sensor biases and inconsistent practices. A fleet of robots could provide more consistent data and broader coverage of field regions (such as near tree roots, under dense canopies) where a human could not regularly access.
Key Findings: The robot prototype demonstrates the feasibility of conducting ECa surveys using an EMI sensor mounted on a small, portable robotic platform. The ECa geospatial measurements provide real-time spatial information that can be used to infer soil water status. Precision irrigation (i.e. for distinct zones in a field) or traditional irrigation (i.e. the whole field is managed uniformly) can be scheduled based on soil water status spatial information derived from the proposed platform. The size of the platform is particularly advantageous because it brings the ECa sensor closer to the sample regions of interest such as irrigation drip-lines and tree roots where current handheld, human operated surveys cannot access. This integration approach highlights some of the design trade-offs with respect to the sensor position relative to the robotic platform, and quantifies how the robot might bias the sensor readings. The system is capable of gathering the data necessary to create spatial maps and accurate spatio-temporal soil moisture information, which is key to increasing the environmental and economic sustainability of irrigation management in precision and traditional agricultural systems.
A ROSbot 2.0 pro wheeled mobile robot was used to investigate the effect the robot body and carried sensors have on EMI sensor readings. Through a series of experiments an appropriate configuration was determined for mounting the sensor on the robot so as to minimize interference without compromising the robot's mobility and operational envelope. A software stack via the Robot Operating System (ROS) was developed to enable autonomous logging of geo-referenced ECa measurements. The platform was evaluated in spatial mapping of a 50 m×30 m drip-irrigated olive orchard, and compared against a spatial map created via manually-taken measurements with the handheld sensor. Results demonstrated the efficacy and reliability of the proposed method, thus confirming the viability of the use of small-factor mobile robots in spatio-temporal SM mapping. Accurate spatio-temporal soil moisture information is key to increasing environmental and economic sustainability of precision irrigation.
In summary, the mobile platform's small and engineered form factor allows it to gain access to and traverse the root zone under tree canopies for commercial orchards. The mobile platform utilizes carbon-fiber rods to hold and position the sensor without introducing a measurement bias. The platform is optimized for size, weight, and power (SWaP). The mobile platform is particularly suited for making soil measurements for orchard specialty crops (almonds, citrus, and other trees) in contrast to systems designed and optimized for row crops. Using a ground based mobile platform instead of an aerial “drone” allows for denser spatial resolution, which is useful when generating the soil moisture maps. Thus, less interpolation and more accurate soil moisture values are obtained with the platform of the present disclosure.
Agricultural geophysics employs non-invasive sensing techniques to characterize soil spatial variability and provide valuable insights into soil-plant-management relationships. Specifically, geospatial information on soil characteristics can indicate crucial metric used to describe the soil characteristics and water content of an area. As such, it has been used widely across applications such as in agriculture, water management, geological mapping, and engineering surveys. Information about bulk density, minerals content, pH, soil temperature, and more, can be evaluated by measuring the ECa of the field and generating a profile of the surveyed land. Thus, approximating the ECa spatial variability of a field can provide a broader understanding of the water flow through the ground, pinpoint any spots with irregular soil patterns, and finally indicate the necessity of supplying additive plant nutrients or different irrigation approaches.
This disclosure describes a mid-sized ground mobile robot solution that is able to conduct semi-autonomous and on-demand continuous EMI ECa measurements under various and larger field environments, and obtain a field-scale ECa map. The disclosure includes a solution is based on the Clearpath Jackal UGV, which is equipped with a customized and adjustable platform which can carry the EMI instrument GF CMD-Tiny. The robot supports teleoperation via Bluetooth, it can directly navigate through sending desired waypoints and can execute trajectories as it utilizes its onboard GPS and RTK positioning data along with local and global planners to reach desired goals. The design, hardware and software system integration and testing of this platform have been fully presented and evaluated in both simulated and real field-scale scenarios, including over bare fields and in muddy terrains. The proposed robot platform demonstrates high efficiency in terms of portability, traversability as well as data collection since the robot is found capable of collecting data with high linearity compared to handheld (no-robot) cases.
The following disclosure discusses key components (off-the-shelf as well as fabricated in-house) and the overall system design, and offer key system integration information. The disclosure further includes a thorough study of the tradeoffs regarding EMI sensor placement on the mobile robot that involves tools and processes we develop for both experimental testing and testing in simulation. Details and key findings from an initial testing phase validate the preliminary efficacy of the overall system are also disclosed. Full system evaluation and testing results across multiple trials in two distinctive fields are also presented.
Electromagnetic induction can help measure the soil apparent electrical conductivity of a field. The main operating principle is based on the evaluation of the induced magnetic field from the ground as transmitted by an electromagnetic conductivity meter. Specifically, the EMI transmitter emits a harmonic signal toward the ground and generates a magnetic field. Since the receiver is placed with the same dipole orientation as the transmitter, it captures the secondary (induced) magnetic field which relates to the ground conductivity, namely out-of-phase measured in mS/m and the in-phase that is a relative metric to the primary magnetic field and measures the magnetic susceptibility of the area.
In this disclosure a CMD-Tiny meter from GF Instruments, which features a compact and lightweight build, was used. This instrument has a control unit module that is used for configuring and logging the EMI measurements and the CMD probe that is the main magnetic sensing module. The latter component has a cylindrical shape with 50 cm length and 4.25 cm of diameter, and the total setup weighs 425 g (
The Clearpath Robotics Jackal robot platform, which is a UGV designed for use in outdoor and rugged all-terrain environments, was used in these experiments. The Jackal has been used in agricultural robotics research, autonomous exploration, as well as social-aware navigation. The robot's dimensions are 50.8×43.2×25.4 cm with a payload area of 43×32.25 cm for mounting various (OEM and custom) onboard modules. Its available payload capacity reaches 20 kg. The robot features an onboard NVIDIA Jetson AGX Xavier computer that is responsible for all onboard computation. On the sensors and actuators side, the robot is equipped with a GNSS receiver, an IMU module, and motorized wheel encoders (besides the custom payloads (described below) developed in this work, or additional sensors like stereo cameras and LiDAR that are routinely deployed on the robot for autonomous navigation). Additionally, the Jackal is a ROS-compatible robot, as it uses the ROS navigation stack and the ROS environment for its main functionality. The total operating time of this robot can reach up to 4 hrs depending on the use and type of the operating environment. Importantly, the required operating time on the field can vary depending on field size and type, and the desired field mapping resolution. For instance, the surveys conducted herein took place over a total period of 1.5 hrs (3 surveys each lasting for 0.5 hrs), in a 30×15 m field, and with the robot moving with a stable linear speed of 1 m/s. Under these settings, the total battery consumption never exceeded 40% during our experiments in each case, for performing the total ECa mapping of the field. The operational time of the Jackal can be expanded by the use of a secondary/additional battery. If an increased amount of surveying time and operation in even larger fields are desired, an alternative commercial wheeled robot can be employed instead (e.g., the Clearpath Robotics Husky, and Warthog UGV, or the Amiga from Farm-ng); the described method can directly apply to such robots as well.
High-in-accuracy Global Navigation Satellite Systems (GNSS) are used (along with field sensors) in precision agriculture to generate, extract, and obtain field observations with spatial information. In many cases, Real-Time Kinematic (RTK) positioning is applied to provide cm-level accuracy on the captured data by using real-time corrections through an established and calibrated base station.
The Holybro H-RTK F9P GNSS series is used as the high-in-accuracy positioning module for our field experiments, which integrates a differential high-precision multi-band GNSS positioning system. By selecting specific points on the field, the RTK base station is calibrated to obtain its position at cm-level and telemetry is used to establish communication with the robot's onboard autopilot hardware.
On the navigation side, the robot's captured positions are described in the World Geodetic System 1984 (WGS-84). Additionally, the Jackal uses an extended Kalman Filter, which fuses information from the onboard IMU and the wheel encoders to provide the state estimation of the robot (odometry). In this work, the Jackal is required to be able to follow a predefined GNSS-tagged trajectory, and the navsat transform node from the ROS navigation stack is used to meet this requirement. Through this approach, initially all the requested geotagged targets are transformed to the Universal Transverse Mercator (UTM) coordinate system. Given this information and through the positioning data of the robot's odometry, a static transformation is generated to describe both the UTM coordinates of the robot and the targets' position into the local robot's frame. In this way, the requested trajectory can be georeferenced and transformed into Jackal's local frame and thus the robot can follow it. It is worth mentioning that, in case the robot gets into a position where there is limited satellite visibility (i.e. GPS-denied environments), it continues geotagging the captured measurements based on pose belief estimation via fusion of the onboard IMU and wheel encoders odometry data. This method is autonomous-ready in the sense that it can directly be integrated with waypoint navigation determined readily by onboard sensors where task allocation and motion planning for (newly-perceived) obstacle avoidance can happen online. Also, mapped modalities from the flora and the fauna during the survey, can even enhance and provide a multi-modal belief about the field conditions.
Additionally, on the traversing side, the focus is on open-world navigation without the existence of obstructive objects in the path that may cause the robot to get out of track to bypass them. The robot can get over small tree branches or crops as a farm worker would do, but the ground should be relatively uncluttered for the ECa inspection as in a typical survey scenario. Also, as Jackal is an IP62 rugged robot, it has a capable high torque 4×4 drivetrain allowing it to navigate through muddy and uneven parts similar to a common ATV. In the described experiments, the system was tested in both dry and muddy environments to demonstrate our system's efficacy. The robot supports a 20 cm wheel diameter (up to 30 cm) and a variety of tire models, such as square (plastic) spike sets, which can make it even more versatile for challenging terrain types that require higher traction.
In this disclosure, the CMD-Tiny meter is attached on the Jackal robot. The design of the sensor platform and the definition of its adjustable parameters. The prototype renderings are depicted in
In particular, the EMI measurements can be distorted by the presence of other magnetic fields caused by the robot, as well as by random oscillations caused by the robot's movement. Thus, one solution would be to place the sensor as far as possible from the robot (i.e. large value for parameter db) and as close to the ground as possible (i.e. small value for parameter dh). However, as distance db increases (
The optimal sensor placement in terms of the robot body is determined by two factors: 1) electromagnetic interference from the robot chassis and its onboard electronics, and 2) robot terrain traversability. The optimal solutions to each of these factors on their own are in fact opposing each other. Indeed, to minimize electromagnetic interference, the sensor should be placed as far from the robot as possible. On the contrary, the longer the extension of the sensor holding platform from the robot's center of mass, the worse it becomes to overcome obstacles without risking to collide the sensor with the ground (
The first step to be examined concerns the robot's electromagnetic interference in the soil conductivity measurements. Specifically, the robot is equipped with a high-torque 4×4 motored drivetrain and various onboard sensors such as a 3D LiDAR and the GNSS receiver. Given this setup, the robot generates electromagnetic fields that may interfere with the electromagnetic field generated by the GF CMD-Tiny sensor as well as the secondary current read by the sensor, and thus cause distorted measurements.
Experimental Procedure: To examine and mitigate the robot's interference on the EMI measurements, three independent field experiments were conducted under different robot-sensor configurations in which the sensor was placed at predefined positions away from the robot's body to monitor the level of saturation. The fields that were selected for this purpose included a bare field, an olive tree grove, and an orange tree grove, which are located at the USDA-ARS U.S. Salinity Laboratory at the University of California, Riverside (33 58′21.936″ N, −117 19′13.5732″ E). In each field experiment, five distinct field points were selected to measure the soil conductivity at. To get a broad spectrum of values for better understanding of the robot's electromagnetic interference, sampling points were either irrigated recently or non-irrigated. At the beginning of each experiment, handheld measurements were performed with the CMD-Tiny sensor, with no presence of any device that may generate additional electromagnetic fields. These measurements serve as the baseline. With these as reference, the UGV with the CMD-Tiny sensor were placed in different configurations and the data collection process was repeated, each time increasing their relative distance within the range of [10, 100] cm at a step of 10 cm. Soil conductivity data collected from these field tests are shown on Table I (Soil Conductivity Measurements in Evaluating Robt Electromagnetic Interverence) below.
indicates data missing or illegible when filed
Column “∞” represents the handheld measurements where there is no appearance of external electromagnetic interference; the reported values are used as reference measurements. The columns starting from 10 cm until 100 cm represent the soil conductivity measurements that were made at the corresponding relative distances of the robot and the sensor's probe, at the same locations as in the handheld case. Mean and one-standard deviation values from the five trials in each of 33 distinctive cases shown on Table I are also provided.
Key Findings: Results of this first experimental benchmark reveal that the optimal placement of the EMI sensor has a lower threshold of db=40 cm away from the UGV body chassis. Specifically, numerical values reported in Table I show that the saturation is notable in the measurements when the sensor is less than 40 cm away from the robot's body. Shorter distances ({10, 20, 30} cm) exhibit both significantly higher mean value but also more variability (i.e. higher one-standard deviation) across all three fields. Especially the db=10 cm case exhibits excessive interference and clear evidence of saturation (the bare field depicts this most clearly). In contrast, larger db values exhibit smaller interference as it can be readily verified by the reported means and one-standard deviations that converge to the baseline values. In addition, it can be observed that after some threshold distance, means and one-standard deviations do not vary significantly. In this work, this upper threshold is selected at db=70 cm.
Another interesting and unexpected observation concerns the cross-field variability. The olive and citrus orchards that are regularly irrigated yield similar values across all tests, whereas the bare field (not irrigated) has lower ECa values (as expected). However, the measured values appear to converge faster (i.e. in shorter distances) in the irrigated fields compared to the bare field. We can associate this finding with the fact that in irrigated fields the reported ECa values are a function of both actual soil electrical conductivity and electromagnetic interference from the robot, and the former dominates more rapidly as the probe distance increases. In contrast, in the bare field the actual ECa level attains much lower values, hence readings are more susceptible to electromagnetic interference and larger distances appear to be required to dampen down the interference's effect. This finding can be a useful tool to correlate soil salinity over the same field before and after planting, and while growing.
The selection of the lower and upper thresholds for d can be justified by inspecting measurement linearity compared to the baseline (
Keeping the sensor at a certain distance and farther from the robot's body frame leads to a decrease of the included noise in the conductivity measurements because of electromagnetic interference and increases the linearity of the given readings with respect to the reference (handheld) measurements is validated. As such, we select the fixed distances of db∈{40, 50, 60, 70} cm to further evaluate the robot's traversability capacity and thus help select the optimal one. Note that the case of 10 cm has significant interference and widely varied values (at cases even negative as shown in Table I) and is henceforth not shown in these graphs to improve visual clarity of the figure.
With the set of candidate sensor-to-body distance values being identified (db∈{40, 50, 60, 70} cm), the next step is to examine the robot's ability to move over various uneven terrain fields while carrying the probe without the probe colliding with the ground as the robot negotiates dips and bumps. In general, each platform configuration may have a distinct effect on the robot's traversability capacity, sensor stability, and thus sensor readings. In an effort to make this process scalable and generalizable, a realistic simulation environment and test robot traversability and probe oscillations for different sensor placement configurations over varied sets of emulated terrains is developed.
Experimental Procedure: While employing the Gazebo Robotics simulator three key steps were considered: 1) generation of 3D model maps based on aerial imagery, 2) generation of the robot and sensor models, and 3) set up of the simulated experiments and measured variables. The first step allows for the generation of a realistic emulated environment based on real imagery data. The photogrammetric software Agisoft Metashape was used to create a 3D world model based on aerial imagery data that were captured just south of the Center for Environmental Research & Technology (CERT) at the University of California, Riverside (33 59′59.563267″ N, −117 20′5.769141″ E). By using 97 aerial photos obtained from different positions above the CERT field, photo alignment and stitching was applied through the Agisoft Metashape libraries and generated a colored pointcloud of 25904 points. In addition, by enhancing the sparse pointcloud with more correspondences from the stitching process, a dense pointcloud was generated containing ≃9 million points, the latter was then transformed into a 3D mesh model by applying point interpolation.
A Gazebo model for the Clearpath Robotics Jackal robot employed herein is already publically available. A custom Gazebo model was developed for the GF CMD-Tiny sensor and integrated into the main robot model.
To evaluate the rigidity and robustness of the designed platform three independent simulated experiments inside the emulated field in the Gazebo world for the selected platform configurations (parameters db and dh) were conducted. In these experiments, the Jackal was commanded to follow specific trajectories of different in difficulty terrain types, namely a straight path in a slightly planar area, a straight path in a more rocky area, and a complex path with mixed type terrain (
Key Findings: Results of this second experimental benchmark are contained in Table II (Measured sensor oscillations during simulated surveys in the Gazebo environment) below.
− dh
indicates data missing or illegible when filed
First, note that the increase of the sensor distance relative to the robot body makes the robot less stable and in turn leads to increased probe oscillations when traversing uneven terrain. However, it turns out that the cases of dh={50, 60} cm lead to very similar platform oscillations in terms of reported variance, which in fact are close to the shortest case of 40 cm and more steady compared to the longest 70 cm case. In more detail, and with reference to Table II, the increase of the distance in the probe placement results in increased mean and variance of position deviations while moving, for both tested sensor height off the ground. Mounting the sensor closer to the robot's body and by keeping a shorter robot-sensor footprint, the robot is more stable in either smoother or more rough terrain types. For the dh=6 cm case, placing the sensor at db={50, 60} cm achieves similar results by keeping ≃1 cm of difference in standard deviation of the 70 cm case. Also, even though 40 cm is the less shaky solution overall, the cases of db={50, 60} cm have less than ≃0.5 cm difference in standard deviation. Additionally, by comparing across experiments, the 50 cm case appears to score less than 10−4 m2 of variance. These observations are consistent also in the case of dh=11 cm, by having the smallest sensor displacement when db=40 cm and with the cases of db={50, 60} cm performing equivalently. Based on these observations, the cases of setting db={50, 60} cm may offer the best trade-off in terms of noise and steadiness compared with the shorter 40 cm case, in which the probe is placed close to the robot's chassis and is affected more by the electromagnetic interference as shown in Section III.
A second observation from these results concerns the sensor's height off the ground, dh. Inspection of the results for different sensor height values dh in Table II, we notice a similar oscillating behavior, whereby a shorter height (i.e. dh=6 cm) might be preferred to reduce variations from the ground. This becomes even more critical considering that, during real surveys, it is hard for a farm worker that uses the handheld sensor to keep the sensor consistently at a stable height off the ground while walking. For these reasons dh=6 cm is used.
The last set of calibration tests for optimal sensor placement included validation of the preliminary feasibility of the robot-sensor setup to measure ECa continuously. Based on the aforementioned results, these validation experiments for the two boundary cases of probe distance (i.e. db={40, 70} cm), at a constant height of dh=6 cm were studied. This approach provided a better understanding of the effects of placing the sensor closer or further away from the robot on continuous ECa measurements.
Experimental Procedure: The validation experiments took place in the same field that was emulated for the aforementioned simulation testing. Without loss of generality, two distinct cases: 1) a straight-line trajectory with db=70 cm and dh=6 cm, and 2) a U-shaped trajectory with db=40 cm and dh=6 cm were considered. In each case we conducted three independent trials. The starting and end positions as well as intermediate waypoints were the same for each set of trials. The physical setup, experimental field, and the two types of trajectories are depicted in
Key Findings: Obtained results visualized based on aggregated soil conductivity plots and the corresponding ECa maps for the cases of db=70 cm (straight line trajectory) and db=40 cm (U-shaped trajectory) are depicted in
In all, these preliminary feasibility testing validates THAT trustworthy continuous ECa measurements can be performed with the developed robotic setup even at the two boundary configurations. Results verify the system's high linearity with respect to manually-collected (handheld) data, and that the constant additive offset on the overall ECa measurements caused by the robot's electromagnetic interference does not significantly affect the linearity of obtained measurements in the end. Putting everything together, the conclusion is that the configuration {db=60 cm, dh=6 cm} can serve as an appropriate tradeoff that combines lower robot-to-sensor signal interference and higher maneuverability, and it is thus selected as the optimal configuration to conduct field-scale experiments. These are discussed next.
In some embodiments, the configuration {db=60 cm, dh=6 cm} can serve as the substantially optimal one.
The analysis helped determine a substantially optimal sensor setup ({db=60 cm, dh=6 cm}) for the robot that balances between electromagnetic interference caused by the robot including the robot's electronic components and robot traversability capacity of uneven terrain. The analysis also helped validate the preliminary feasibility of collecting continuous soil ECa measurements over small bare-field areas, with obtained results being trustworthy and consistent to manually-collected baselines. Next, robot-assisted continuous soil ECa measurements over larger fields is described
Experimental Procedure: Continuous soil ECa measurements were performed in two distinctive fields, an olive tree grove (not irrigated recently with respect to data collections) and a citrus tree grove (irrigated prior to data collections). The arid canopy of olive trees is located close to the USDA-ARS U.S. Salinity Laboratory at the University of California, Riverside (UCR) (33 58′21.936″ N, −117 19′13.5732″ E), whereas the freshly irrigated citrus orchard is located within the UCR Agricultural Experimental Station fields (AES; 33 57′52.0272″ N, −117 20′13.7184″ E). It is worth noting that the latter case in fact contained various soil conditions (highly irrigated/wet parts and arid parts), and hence helped evaluate 1) the proposed robot's performance in the same survey as terrain conditions vary, and 2) if the robot-assisted soil conductivity curves and soil ECa maps match those corresponding to manual data collections. Experimental setups and snapshots of the two fields are depicted in
Key Findings: Results from field-scale experiments for olive and citrus tree groves are shown in
For the case of the olive tree grove (arid field) raw measurement plots (
Similar observations can be readily made for the case of the citrus tree grove. Note that the citrus tree grove was recently irrigated prior to data collection, hence there was more terrain variability; this ranged from muddy soil to normally irrigated areas and more dry parts of the field areas. From a robot operation standpoint, the robot system demonstrates robust behavior even in this diverse and more demanding survey case, and it is noteworthy that the robot's traversability in the irrigated turf was efficient even when navigating over mud. Raw data graphs (
The disclosure described embodiments of a robotized system to perform precise and continuous soil apparent electrical conductivity (ECa) measurement surveys. The methods and apparatus described includes a ground mobile robot equipped with a customized and adjustable platform to hold an Electromagnetic Induction (EMI) sensor. The substantially optimal placement of the EMI sensor is determined by satisfying two competing objectives; the minimization of static electromagnetic interference in measurements and the facilitation of robot traversability in the field. Extensive experimental evaluation across static calibration tests and over different types of fields concludes to the optimal EMI configuration setup to be used for large-field testing. Throughout a series of real field experiments, it is demonstrated that that the obtained robot-assisted soil conductivity measurements present high linearity compared to the ground truth (data collected manually by a handheld EMI sensor) by scoring more than 90% in Pearson correlation coefficient in both plot measurements and estimated ECa maps generated by kriging interpolation. The proposed platform can deliver high-linearity scores in real survey scenarios, at an olive and citrus grove under different irrigation levels, and serve as a robust tool for large-scale ECa mapping in the field, with the potential development of a fully-autonomous behavior. Further embodiments can include integration within a task and motion framework for informative proximal sampling, as well as integration with physical sampling means to perform multiple tasks simultaneously.
In some embodiments, the mobile platform 110 has an optimal chassis to sensor distance 130 that is optimum for avoiding electrical interference between the sensor 120 and the chassis 115. In operation the sensor 120 is positioned at an operational distance from the chassis that is less than the optimal chassis to sensor distance 130. The control system 125 provides geo-referencing and autonomous logging of the one or more soil apparent electrical conductivity measurements.
The mobile platform 110 includes an adjustable platform 135 to hold the sensor 120. In some embodiments, the sensor 120 is physically coupled to the mobile platform 110 by non-conductive rods, such as carbon-fiber rods 140. In some embodiments, the mobile platform 110 has a direction of travel 145 and the sensor 120 is oriented substantially perpendicular to the direction of travel 145.
The apparatus 100 includes a ground clearance distance 150 that defines an operational distance between the sensor 120 and the agricultural field 118. In some embodiments, the ground clearance distance 150 is between about forty-five and fifty-five millimeters. In some embodiments, the ground clearance distance 150 is between thirty-five and sixty-five millimeters. In some embodiments, the ground clearance distance 150 is between twenty-five and seventy-five millimeters. The mobile platform 110 includes wheels 155 to contact the agricultural field 118. In some embodiments, the sensor 120 is tuned such that the one or more soil apparent electrical conductivity measurements have high-accuracy to a soil depth of about 0.7 meters. High-accuracy, as used herein, means the measurements that are within 5% of the equivalent manual measurement.
In some applications, the agricultural field 118 includes terrain deviations and in some embodiments, the mobile platform 110 includes an approach angle α 160 and a departure angle β 165 selected to enable the mobile platform 110 to traverse the agricultural field 118 and make useful measurements. In some applications, the agricultural field 118 includes micro-irrigated orchard systems and the terrain deviations are about twenty-five millimeters or less.
In some embodiments, navigating the agricultural field with the mobile platform includes traversing a root zone under tree canopies of an olive grove. In some embodiments, navigating the agricultural field with the mobile platform includes navigating a muddy agricultural field. In some embodiments, the method further includes delivering high-linearity scores in real survey scenarios at a citrus grove under different irrigation levels by scoring more than about 90% in Pearson correlation coefficient in both plot measurements and estimated apparent electrical conductivity maps generated by kriging interpolation. In some embodiments, the method further includes utilizing a simulation software package that provides estimation of terrain traversability in relation to identifying substantially optimal sensor placement. In some embodiments, navigating the agricultural field with the mobile platform includes generating platform control commands from a waypoint-based trajectory planner. In some embodiments, navigating the agricultural field with the mobile platform includes navigating along one or more drip lines in the agricultural field. In some embodiments, the method further includes scheduling irrigation for the agricultural field based on the soil moisture values. In some embodiments, processing the one or more soil apparent electrical conductivity measurements to generate the one or more soil moisture values comprises including a correction factor in the processing to account for the mobile platform influencing the one or more soil apparent electrical conductivity measurements. In some embodiments, the method further includes displaying the soil moisture value in real time. In some embodiments, the method further includes determining the maximum practical sensor mounting distance dh and angles α and β that allow the robot to traverse uneven terrain with deviations of plus or minus about 25 millimeters from level after mounting the sensor on the mobile robot without tipping, stalling, or colliding the sensor into the ground.
All publications, patents, and patent documents are incorporated by reference herein, as though individually incorporated by reference. Reference throughout this specification to “an embodiment,” “some embodiments,” or “one embodiment.” means that a particular feature, structure, material, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, the appearances of the phrases such as “in some embodiments,” “in one embodiment,” or “in an embodiment,” in various places throughout this specification are not necessarily referring to the same embodiment of the present disclosure. Furthermore, the particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments. Reference numbers are
Although explanatory embodiments have been shown and described, it would be appreciated by those skilled in the art that the above embodiments cannot be construed to limit the present disclosure, and changes, alternatives, and modifications can be made in the embodiments without departing from spirit, principles and scope of the present disclosure.
This application claims priority to U.S. Provisional Application No. 63/346,676, filed on May 27, 2022. The entire content of the application referenced above is hereby incorporated by reference herein.
This invention was made with government support under 2021-67022-33453 awarded by National Institute of Food and Agriculture, USDA. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
63346676 | May 2022 | US |