The invention is concerned with a device, and/or system and/or method for remote monitoring and/or activity. A disclosed device can operate remotely and autonomously to inspect an area to accumulate data and/or perform an activity in an area. The device can be configured to move within an area between points, and at each point perform the inspection and/or action. A system can incorporate such a device. A method can utilise such a device or a system incorporating such device, to provide enhances data.
It is known for a tractor to spray an entire field. This is costly and limited to infrequent usage.
It is known for a UAV (unmanned aerial vehicle) to scan a field and provide a data-map, this is low in data or image quality and provided too late to be actionable e.g. for tractor spraying.
It is known for an area to be checked by quad bike and plucking. This is very inefficient and laborious.
It is known for crop dusting—aerial application. This is expensive and inaccurate.
It is an aim of the invention to provide an improvement.
There is provided a device which moves between a plurality of fixed locations in area in order to monitor the locations and/or perform an action at the locations.
The device may be a robot or a drone.
The device preferably moves between each location by launching or taking-off from one location, flying to another location, and then landing at that location.
A module may be provided to control the device during launching or take-off. The device may be provided with a spring loaded leg which is actuated for launch or take-off. In such case the spring leg may be orientated to ensure when it is deployed after landing, it is deployed to contact the ground opposite the direction of launch or take-off, so it is a trailing leg on launch of take-off. The device may be provided with a compressed gas mechanism which can be actuated for launch or take-off. The device may be configured as a drone for this launch or take-off, and be controlled as a drone for launch or take-off. One, some or all of these mechanisms may be utilised for launch or take-off.
A module may be provided to control the device during flying, to navigate it from one location to the next. The device may be configured as a drone for this flying, and be controlled as a drone.
A module may be provided to control the device during landing. The device may be configured as a drone for this landing, and controlled as a drone for landing. The device may be provided with legs for stability when landed. The device may be provided with three legs for stability of landing. The legs may be adjustable in order to adjust the device on landing. The device may have an anchor leg for stability on landing, in addition or instead of other legs. Any legs may be provided with platforms to present sinking into the ground.
The device may be provided with a rotatable arm. When landed, and in a stable position, the legs may be adjusted to ensure that the rotatable arm can rotate to cover a 360° rotation substantially parallel to the ground. The legs may be adjusted to ensure such rotation, if the device cannot be landed to provide such rotation. There may be two rotatable arms, extending radially from a central body, with each arm covering a rotation of 180°, ±90° from its normal position.
The device may be provided with a number of rotors to enable it to operate as a drone, preferably providing four rotors located at 90° with respect to each other, at radially displaced locations from a central body.
Preferably the rotatable arm or arms rotate in a plane parallel to the plane of the rotors.
The device may be provided with one or more solar panels, and/or one or more rechargeable batteries.
The device may be controlled to move along a pathway between multiple locations within an area. At each location the device may perform a monitoring operation followed by deploying an action responsive to the monitoring.
The device may be controlled to move along the pathway in dependence on points within the area having been determined, and the pathway connecting all the points.
The device may be controlled to move along a pathway in dependence on the points within the pathway having been determined by analysis of image data from satellite observation. The satellite data thus may dictate the movements of the device within the area. At each point an action may be deployed.
At each point an image may be captured to enhance the image data. An enhanced imaging map of the area is therefore established. At each point an image may be captured and an action may be deployed. The device may be associated with one or more interface devices.
The interface devices may be provided with modules, which modules may be affixed to the device. The device may be controlled to move along a pathway between points in the area, and in addition the pathway includes one or more interface devices. At an interface device one or more module may be attached to the device and/or removed from the device.
The interface devices may be recharging stations. The device may be controlled to move along a pathway between points in the area, and in addition the pathway includes one or more interface devices. At an interface device a rechargeable battery of the device may be removed and replaced with a charged rechargeable battery. The interface device may recharge any removed rechargeable battery.
The autonomous remote device may comprise a module for determining the location of the device.
The autonomous remote device may be configured to move between a plurality of locations.
The autonomous remote device may comprising a module for determining locations within the area for the device to move between,
The autonomous remote device may further be configured for use in an agricultural environment, and/or a rural location, and/or remote location.
The autonomous remote device may further be configured to be used for repeated observation within the area to create a phenotypic model for the area, for prediction or for analysis.
The autonomous remote device may further comprise a set of legs which arrest the flight instead of motors.
The autonomous remote device may further comprise a set of legs which can extend and absorb shocks
The autonomous remote device may further comprise a set of legs which can minimise damage to crops.
Arm may be foldable. Arm may be telescopic.
The deployment arm may have devices moving up and down wiping weeds or doing actions or sensing.
The deployment arm may have a camera or cameras inside. The deployment arm may have a camera or cameras attached thereto.
The autonomous remote device may further comprising a weed wiper which has a delta/linkage arm for wiping using a sponge and pump.
The mechanism for launching the device may include a leg which during navigation and landing is retracted.
The autonomous remote device may further comprise a non-slip protrusion on a leg which includes multiple feet which may be changed for better distribution of force in varying soils or terrains and minimisation of crop damage.
The autonomous remote device may be adjusted in a direction for optimal take-off and contact with terrain.
The autonomous device may further be provided with a jumping mechanism.
The autonomous device may further be configured to determine the missing links in the phenotyping model
The autonomous device may further be configured to collate observations to create a phenotyping model or plant trait model.
The autonomous device may further be configured to initiate actions based on phenotyping model and repeated visits
The autonomous device may further be configured to provide predictions or analysis using phenotyping model
There may be provided a system for controlling an autonomous remote device for monitoring an area, comprising: a module for tracking locations within an area and for tracking the location of the device within that area; a mechanism for determining a pathway for the device between multiple static locations within the area, such that if the device is located at each static location, the whole area will be monitored; a mechanism for moving the device between the multiple static locations along the pathway; and a mechanism for deploying monitoring at each static location.
The system may be configured to receive imaging data of the area from a satellite, and the monitoring performed at each static location is to enhance the imaging data from the satellite.
There may be provided a system for controlling an autonomous remote device, comprising: a module for tracking locations within an area and for controlling the location of the device within that area; a module for determining a pathway for the device between multiple static locations within the area; a module for receiving data based on satellite images of the area; a module for controlling the movement of the device between the multiple static locations along the pathway in dependence on the satellite images of the area; and a module for controlling an action at each static location.
The action may be to capture an image, and thereby enhance the imaging data provided by the satellite images. The action may be to deploy a robotic action.
There may be provided a system for controlling an autonomous remote device, comprising: a module for tracking locations within an area and for positioning the device within that area; a module for determining a pathway for the device between multiple static locations within the area; and a module for moving the device between the multiple static locations along the pathway.
The system may further comprise one or more interface units associated with the area, wherein the module for determining pathway for the device further incorporates the positions of the one or more interface units. The one or more interface units may be stations at which modular attachments to the device can be adjusted. The one or more interfaces may be stations at which a rechargeable battery of the device can be replaced and recharged. The one or more interfaces may be stations at which a chemical refill operation id conducted. Chemical refill may be cartridges or capsules. Any other exchange of fluids or solids which are not chemicals, like additional wipes or materials, may take place.
The system may be configured to receive imaging data of the area from a satellite, and the monitoring performed at each static location is to enhance the imaging data from the satellite.
There is provided a system for controlling an autonomous remote device for monitoring an area, comprising: a mechanism for receiving a satellite image of an area; a mechanism for analysing the satellite image; a mechanism for identifying a discrepancy in the analysed image; a mechanism for deploying a monitoring device to the area of the analysed image; a mechanism within the monitoring device for determining a pathway for inspection in dependence on the satellite image.
There is provided a system for monitoring an area utilising a monitoring device movable between locations within the area, wherein the device uses a rechargeable power source, a pathway for the movable device including at least one location at which a recharging interface for the rechargeable energy source is provided.
There is provided a system for monitoring an area utilising a monitoring device movable between locations within the area, wherein the device uses modular components, a pathway for the movable device including at least one location at which a modular component can be either removed, added, or replaced.
There is provided a system for monitoring an area utilising a plurality of monitoring devices movable between locations within the area, wherein each device is provided with a means for communication such that each device follows a pathway between location points within the area, such that each location is only included within the pathway of one device.
Each device may be termed a hopper. A hopper can be used in swarm configuration. A swarm can consist of hopper machines and tractors or any other device, such that the hopper can be configured to inform the operations of other devices like tractors.
The system can generally be configured to receive and/or enhance a UAV data sets, a satellite data set or ground data set.
There is provided a device for monitoring and/or engaging to action comprising: a mechanism for moving the device between locations; a mechanism for monitoring and/or engaging to action which is enabled when the device is stationary at a location.
The device may be for monitoring, wherein at each location the device is configured to deploy a sensing means to sense data at the location. The sensing means may be a camera. The data may be images of the location.
The device may be configured to transmit the sensed data to a further entity.
The device may be for engaging to action, wherein at each location the device is configured to carry out an action. The action may be at least one of: spray a chemical; apply a weed wipe; collect a sample.
The device may be configured to receive instructions for the action from a further entity.
The device may further comprise a module for receiving an identification of an area for the device to be deployed in, and for determining a route along a path between waypoints for the device to move within the area.
A system may comprise the further entity and the device, wherein the further entity is configured to receive satellite data and control the device in dependence on the satellite data, and receive sensed data from the device and enhance the satellite data with the sensed data from the device.
A system may comprise the further entity or the device, wherein the further entity is configured to receive earth observation data and control the device in dependence on the earth observation data, and receive sensed data from the device and enhance the earth observation data with the sensed data from the device.
A system comprising the further entity and the device, and further comprise at least one interface device, the entity comprising a module for receiving an identification of an area for the device to be deployed in, and for determining a route along a path between waypoints for the device to move within the area, the path including at least one waypoint at which a module is located.
In any described system, there may be provided the ability to tell tractors where to go.
The device may be provided with a battery, and the module comprises an interface for providing a replacement battery.
The module may comprise an interface for removing or adding a sensing or action module to the device.
There is provided a method for utilising a device for monitoring and/or engaging to action comprising: moving the device between locations; enabling monitoring and/or engaging to action when the device is stationary at a location.
When providing monitoring, the method may further comprise deploying a sensing means at each location to sense data at the location. The sensing means may be a camera. The data may be images of the location.
The method may further comprise transmitting sensed data from the device to a further entity.
The method, when providing engagement for action, may further comprise carrying out an action at each location. The action may be at least one of: spray a chemical; apply a weed wipe; collect a sample.
The method may further comprise receiving at the device instructions for the action from a further entity.
The method may further comprise receiving an identification of an area for the device to be deployed in, and determining a route along a path between waypoints for the device to move within the area.
A method for a system may comprise the further entity, and further comprise receiving satellite data at the entity and controlling the device in dependence on the satellite data, and receiving sensed data at the device and enhancing the satellite data with the sensed data from the device.
A method for a system may comprise the further entity and further comprise receiving earth observation data at the entity and controlling the device in dependence on the earth observation data, and receiving sensed data at the device and enhancing the earth observation data with the sensed data from the device.
A method for a system may comprise the further entity of, wherein the entity further comprises at least one module for receiving an identification of an area for the device to be deployed in, and determines a route along a path between waypoints for the device to move within the area, the path including at least one waypoint at which a module is located.
The method may further comprise providing the device with a battery, and providing the module with an interface for providing a replacement battery.
The method may further provide the module with an interface for removing or adding a sensing or action module to the device.
There is provided a device comprising: a flight mechanism for flying the device to a location; and a landing mechanism for landing the device at the location, wherein the flight mechanism is configured to terminate on a landing phase, the landing mechanism being configured to land the device without any assistance from the flight mechanism.
The flight mechanism may be a powered mechanism, and the power is terminated on landing.
The landing mechanism may be a mechanical mechanism which is not powered.
The landing mechanism may comprise a plurality of legs adapted to absorb the force of landing, wherein landing comprises disengaging the flight mechanism and dropping the device to the ground. The plurality of legs may form a cage for landing.
More additional legs may be provided than are needed for standing of the device.
The landing mechanism may include a leg which is orientated in the direction of flight during the flight, such that on landing the leg engages with the ground to prevent motion in the direction of flight.
The device may further comprise a mechanism for self-righting the device on landing. The self-righting mechanism may be provided by one or more legs being of an adjustable length. The self-righting mechanism may be provided by one or more legs being fixed to a rotatable part of the device housing.
The device may further comprise a module for determining the location of the device on landing, and comparing it to the intended location on landing, and for adjusting the landing position of the device based on that comparison. The device may be provided with a jumping mechanism, which is actuated in order to adjust the position of the device.
There is provided a method for controlling movement of a device, comprising: in a flight phase flying the device toward a second location; and in a landing phase landing the device at a second location after the flight phase, wherein the flight mechanism is configured to terminate on a landing phase, the landing mechanism being configured to land the device without any assistance from the flight mechanism.
The flight mechanism may comprise providing a powered mechanism, wherein the powered mechanism is turned off on landing.
The landing mechanism may comprise providing a mechanical mechanism, wherein the mechanical mechanism is not powered. Providing the landing mechanism may comprise providing a plurality of legs adapted to absorb the force of landing, wherein landing comprises disengaging the flight mechanism and dropping the device to the ground. The plurality of legs may be provided as a cage for landing.
Additional legs than are needed for standing of the device may be provided.
The method may further provide as part of the landing mechanism a leg which is orientated in the direction of flight during the flight, such that on landing the leg is provided to engage with the ground to prevent motion in the direction of flight.
The method may further provide a mechanism for self-righting the device on landing. The method may further provide the self-righting mechanism as one or more legs being of an adjustable length.
The method may further comprise providing the self-righting mechanism by one or more legs being fixed to a rotatable part of the device housing.
The method may further comprise determining the location of the device on landing, and comparing it to the intended location on landing, and adjusting the landing position of the device based on that comparison. The method may further comprise actuating a jumping mechanism to adjust the position of the device.
There is disclosed a launch mechanism for a device comprising: an actuatable element for launching the device from a first location on the ground into the air.
The launch mechanism may comprise a resilient element which is disposed against the ground at the first location, in order to provide a take-off force for launch.
The resilience of the resilient element may be adjustable.
The launch mechanism may comprise a damper element for distributing the take-off force associated with the resilient element over time.
The actuatable element may be movable between a first position in which it is retracted toward a housing of the device, and a second position in which it is positioned for launch of the device. In the second position the actuatable element may extend between a first end connected to the housing, and a second end contacting the ground. In the first position the second end does not contact the ground.
The device may further comprise a rotatable housing to which the actuatable element is fixed, wherein the actuatable element is rotated by rotating the housing. The actuatable element may be disposed such that it contacts the ground at a location which is away from the direction of launch.
The actuatable element may be provided with a non-slip means at one end thereof.
The may further comprise a plurality of legs, which support the device when positioned on the ground, wherein the actuatable element is positioned in order to provide the take-off force for launch whilst the device is supported on the ground by one or more of the plurality of legs.
The actuatable element may be a leg.
There is disclosed a method for launching a device, comprising: controlling an actuatable element at a first location on the ground at which the device is positioned, to launch the device into the air.
The launch phase may utilise a resilient element as the actuatable element, and the method comprises disposing the actuatable element against the ground at the first location, in order to provide a take-off force for launch.
The resilience of the resilient element is adjustable.
The method may further comprise providing a damping force for distributing the take-off force associated with the resilient element over time.
The method may further comprise moving the actuatable element between a first position in which it is retracted toward a housing of the device, and a second position in which it is positioned for launch of the device. In the second position the actuatable element may extend between a first end connected to the housing, and a second end contacting the ground. In the first position the second end may not contact the ground.
The method may further comprise rotating the actuatable element around a housing of the device.
The method may further comprise disposing the actuatable element such that it contacts the ground at a location which is away from the direction of launch.
The method may further comprise providing the actuatable element with a non-slip means at one end thereof.
The method may further comprise providing the device with a plurality of legs, which support the device when positioned on the ground, wherein the actuatable element is positioned in order to provide the take-off force for launch whilst the device is supported on the ground by one or more of the plurality of legs.
The actuatable element may be a leg.
There is disclosed a device comprising: a launch mechanism, comprising an actuatable element for launching the device from a first location on the ground into the air; a flight mechanism for flying the device in the air after launch toward a second location; and a landing mechanism for landing the device at a second location after the flight.
The launch mechanism may comprise a resilient element which is disposed against the ground at the first location, in order to provide a take-off force for launch. The resilience of the resilient element may be adjustable. The launch mechanism may comprise a damper element for distributing the take-off force associated with the resilient element over time.
The actuatable element may be movable between a first position in which it is retracted toward a housing of the device, and a second position in which it is positioned for launch of the device. In the second position the actuatable element may extend between a first end connected to the housing, and a second end contacting the ground. In the first position the second end may not contact the ground.
The device may further comprise a rotatable housing to which the actuatable element is fixed, wherein the actuatable element is rotated by rotating the housing. The actuatable element may be disposed such that it contacts the ground at a location which is away from the direction of launch.
The actuatable element may be provided with a non-slip means at one end thereof.
The device may further comprise a plurality of legs, which support the device when positioned on the ground, wherein the actuatable element is positioned in order to provide the take-off force for launch whilst the device is supported on the ground by one or more of the plurality of legs.
The actuatable element may be a leg.
The flight mechanism may comprise one or more propellers. The flight mechanism may be engaged after launch. The device flight mechanism may be disengaged prior to landing.
The landing mechanism may comprise a plurality of legs adapted to absorb the force of landing, wherein landing comprises disengaging the flight mechanism and dropping the device to the ground.
There is described a method for controlling movement of a device, comprising: in a launch phase, controlling an actuatable element at a first location on the ground at which the device is positioned, to launch the device into the air; in a flight phase, after the launch phase, flying the device toward a second location; and in a landing phase, landing the device at a second location after the flight phase.
The launch phase may utilise a resilient element as the actuatable element, and the method comprises disposing the actuatable element against the ground at the first location, in order to provide a take-off force for launch. The resilience of the resilient element may be adjustable.
The method may further comprise providing a damping force for distributing the take-off force associated with the resilient element over time.
The method may further comprise moving the actuatable element between a first position in which it is retracted toward a housing of the device, and a second position in which it is positioned for launch of the device.
In the second position the actuatable element may extend between a first end connected to the housing, and a second end contacting the ground. In the first position the second end may not contact the ground.
The method may further comprise rotating the actuatable element around a housing of the device.
The method may further comprise disposing the actuatable element such that it contacts the ground at a location which is away from the direction of launch.
The method may further comprise providing the actuatable element with a non-slip means at one end thereof.
The method may further comprise providing the device with a plurality of legs, which support the device when positioned on the ground, wherein the actuatable element is positioned in order to provide the take-off force for launch whilst the device is supported on the ground by one or more of the plurality of legs.
The actuatable element may be a leg. The flight mechanism may comprise one or more propellers. The method may comprise engaging the flight mechanism after launch. The method may further comprise disengaging the flight mechanisms prior to landing.
The method may further comprise providing a mechanism to absorb the force of landing, wherein landing comprises disengaging the flight mechanism and dropping the device to the ground.
The invention is described by way of example with reference to the accompanying drawings, in which:
There is now described various examples and arrangements.
There is described: a device; launch, flight, and landing of a device; control of a device, and implementations of a device.
In the following, the device is described with reference to the inclusion of particular apparatus and the performance of particular functions. The device is not limited to including all such apparatus, nor being able to perform all such functionality. The device may include some or all of the described apparatus, and perform some or all of the described functions. Some or all means one or more.
In the following, the device is described with reference to a particular implementation, of monitoring a field for weeds, and deploying treatment to remove the weeds. The monitoring for weeds is an example of an inspection (or investigation) performed by the device, and the removal of the weeds is an example of an action performed by the device responsive to this inspection.
The described device, and the described system associated with the described device, can be used in other implementations, and is not limited to weed inspection and/or removal.
In embodiments the device may be utilised for inspection interfacing with a system, such as a system which utilises space data, or more particularly earth observation (EO) data. Scanning (or inspection) performed by the device may preferably be combined with space data, to enhance the space data.
In embodiments the device may be used for action with a system, such as a system which utilises space data, which system provides imaging information for controlling the device. The device may implement such action without itself carrying out inspection or scanning, and simply utilising space scanning. The device may additionally implement its own scanning/inspection to enhance the space data.
An example implementation of a device is illustrated in
With reference to
The device may be referred to as a robot, a drone or a hopper.
The housing or main body 2 comprises the electronics necessary for the operation of the device 1. An exemplary schematic of the control circuitry of such electronics is shown in
Referring to
In general the housing or main body 2 is preferably provided with means to enable it to: (i) be stably positioned on the ground; (ii) allow any peripheral devices associated with the device, such as a camera or a spray arm, to be suitably deployed when stably positioned on the ground; and (iii) move between stable locations.
In the embodiment illustrated in
In this embodiment, the stalk 4 is attached directly underneath the housing or main body 2, and may be formed integral to the housing or main body 2. The stalk 4 extends in a stable position, with the device 2 on the ground, from the housing or main body portion 2 to the ground, and may extend partially into the ground surface to provide an ‘anchor’. The stalk 4 may be designed to support the majority of the weight of the housing or main body 2. The stalk 4 may thus provide a primary ‘leg’ for the device when the device is stationary and positioned on the ground.
A stalk is illustrated in this embodiment, but is not essential. Other embodiments, as shown in later figures, do not utilise a stalk.
Where provided, a single leg such as stalk 4 provides a sufficiently stable base for the housing or main body 2 when it is positioned on the ground, provided the stalk extends into the ground sufficiently to provide a stable anchor. However a characteristic of the device—as discussed below—is that it can launch or take-off or jump from one stationary location to another stationary location. As such, a firm anchor point for the stalk may be undesirable, as this will inhibit the take-off or jumping action, or at least require additional energy to be associated with the take-off or jumping action.
The three tripod legs 6a to 6c are provided to allow stable positioning without requiring the stalk 4 to significantly extend into the ground (and in embodiments, may be provided without the stalk). The three tripod legs 6a to 6c may attach at one end to the stalk 4, and at the other end be positioned on the ground to stably position the housing. This is shown in
The tripod legs 6(a) to 6(d) may be of an adjustable length, and may extend from the stalk at adjustable angles, to enable them to provide stability to the physical support of the stalk on the ground. The adjustability (length and angle) of the tripod legs enables them to provide this stability on uneven ground. Thus the tripod legs may be telescopic, and may extend to orientate the device 1 in an operational orientation.
This is illustrated in
Motors may be provided to telescopically adjust the length of the tripod legs. The legs may be adjusted telescopically by a motor, or the telescopic operation may not be actuated by a motor.
The tripod legs 6a to 6c may be controlled by the control circuitry 30 of the device 1 such that they are retracted to be flush with the stalk when the device moves (i.e. they are pulled in), and such that they are deployed to provide stability when the device is stationary. They may be deployed prior to a stationary position being finalised in order to stabilise the device 1. As will be discussed below, the tripod legs 6a to 6c may be controlled in order to assist in the take-off or hopping operation of the device 1.
The motor control and management module 60 may control the extension of each of the legs 6a to 6c individually, and may control the angle of extension of each of the legs 6a to 6c individually.
It will be understood that the implementation of the device 1 with the stalk 4 and/or the tripod legs 6a to 6c is exemplary, and other means may be provided to meet the objectives of providing stability on the ground, coupled with ready take-off and landing of the device 1.
An alternative is shown
A further modification to the arrangement of
A further alternative arrangement utilising four legs but without a stalk is shown in
The legs may be provided with a platform-type arrangements at the end with which they contact the ground, to prevent them sinking into the soil. It will be generally understood that a device may be provided with a leg arrangement which is suitable for meeting the described criteria, namely for the device to: (i) be stably positioned on the ground; (ii) allow any peripheral devices associated with the device, such as a camera or a spray arm, to be suitably deployed when stably positioned on the ground; and (iii) move between stable locations.
The exemplary device 1 of
In an alternative, the device may be provided with compressed gas or CO2 canisters to assist in the take-off or hop launch. This may be instead of or in addition to the spring loaded jumping mechanism, with or without propeller assistance, and with the propellers then used to control the movement of the device 1 once airborne.
The device of
The leg 29 can be deployed by releasing it from the connection point 27, and deploying it towards the ground so that one end of the leg is connected to the housing 2, and the other end of the leg makes contact with the ground. The movement of the leg 29 can be controlled by a motor, and the connection point 27 can be electrically controlled to secure/release the leg.
The leg 29 is used to assist in take-off of the device, and may be used to give an additional thrust for take-off. This may be achieved, for example, by deploying the leg 29 so its end engages with the ground and creates a resilient or spring type engagement, which is then used in the take-off operation to assist in take-off.
The leg 29 is deployed such that it is trailing to the take-off direction, to assist in launching the device in the direction of take-off. The housing 2 therefore may be rotatable, or there may be provided a portion of the housing, possibly below the housing, so that as the device lands, the leg 29 can be rotated so that it is in the correct orientation for deployment.
The leg is preferably not used for stability, and purely provides assistance for the take-off operation. Stability legs are therefore preferably provided additional to this leg 29.
If the stability legs, such as legs 6a to 6c, are motor controlled, then once the leg 29 is deployed for take-off, one or two of the stability legs 6a to 6c can be withdrawn (telescopically) prior to the take-off operation.
The device may be provided with a resilient means to assist in take-off, the resilience of which is adjustable, preferably dynamically adjustable under the control of the control circuitry 30. The resilience may be dynamically adjustable such that control circuitry can take into account, for example, wind speed and wind direction, as well as the distance of the location to which the device is to be moved.
The resilient means may for example be a wound spring, which is controlled differently by the control circuitry 30 to provide different strength jumps.
The resilient means is preferably a leg such as leg 29 in
The distal end of the leg which engages with the ground on deployment may be provided with a self-righting mechanism. This mechanism may be a self-righting foot mechanism such as a wheel or a skid. If the leg is a jumping leg which may be wound, as it is wound the self-righting mechanism ensures the foot maintains the correct contact orientation with the soil.
With reference to
A leg 108 extends at an angle from a device (not shown) towards the ground 100. The end of the leg 102 in contact with the ground is provided with a wheel 104 and a planar portion 106 for engagement with the ground. As shown in
A winding mechanism employed in the device causes the leg to contract, or move in the direction of the arrow 108, such that in order to maintain the contact with the ground the leg also moves in the direction of the arrow 110. The leg moves along the ground (facilitated by the wheel 104), then reaches a point at which the planar portion 106 engages with the ground 100, to secure the leg, and hence the device to which it is attached. This is shown in
With reference to
A leg 108 extends at an angle from a device (not shown) towards the ground 100. The end of the leg 102 in contact with the ground is provided with a wheel 104 and a planar portion 106 for engagement with the ground. As shown in
A winding mechanism employed in the device causes the leg to contract, or move in the direction of the arrow 108, such that in order to maintain the contact with the ground the leg also moves in the direction of the arrow 110. The leg moves along the ground (facilitated by the wheel 104), then reaches a point at which the skid portion 114 of the planar portion 106 engages with the ground 100, to secure the leg, and hence the device to which it is attached. This is shown in
With reference to
The leg 102 is shown attached to a body 18 of a device, and two rotor arms 128 extending to two respective rotors 120 is shown. The device is associated with legs 116 which extend to the ground 100, to allow the device 118 to be positioned on the ground.
The leg 102 is a launch leg, and may extend from a position in which it is generally horizontal to the ground to a position in which it engages with the ground, as denoted by arrow 124 of
In addition, as shown by the plan view of
With reference to
As shown in
As shown in
As shown in
With reference to
With reference to
The device hops or jumps between stationary positions on the ground. The device thus has two general modes of operation. In one mode of operation the device is operational to travel between a start and an end point, being stationary at both the start and end points. In a second mode of operation the device is configured to operate when stationary to perform an operation to support remote monitoring and/or remote action. There is additionally a third mode of operation of the device, in which it may be configured when stationary to dock and/or interface with a control system, as will be described below.
The first mode of operation is travel between an end and a start point. In the travel mode of operation the device must: (i) take off (or hop or launch); (ii) fly; and (iii) land.
The take-off part of the first mode of operation itself has three phases, which are illustrated with reference to
As shown in
As shown in
As shown in
The launch mechanism is preferably used to get the device airborne. In addition to getting the device airborne, the device is preferably launched in the direction of the next destination point, with the speed and angle of the launch being appropriately controlled. This launch may take into account wind speed and direction. The launch preferably gets the device airborne and traveling in the correct direction quickly. The launch preferably gets the device airborne and travelling stably in the correct direction. The launch preferably gets the device airborne in such a manner that its flight is less susceptible to wind, dust or crop (for example) hitting the propellers. This may involve launching the device to a higher altitude than would otherwise be required, for example.
Where a leg is used to launch the device by jumping, the leg is preferably located behind the centre of gravity of the device, in the direction of the jump. That is the leg is located on the side of the centre of gravity which is opposite to or away from the direction of jump.
Preferably the device has 3/4 stability legs, and one extra leg to provide the launch/jump.
The body of the device, or housing, may be rotatable, so as the housing can be rotated to re-orientate the jumping leg (which may be affixed to the housing).
The body/housing may be rotated with the jumping leg retracted/raised. The jumping leg thus does not get in the way as the body/housing is rotated.
The device may include an active or passive impulse damper which, as a resilient mechanism associated with launch is released, spreads the acceleration of the jump over a longer period of time. This ensures that a leg (or other mechanism) being used for the launch does not push into or penetrate the ground, or slip, which would cause energy loss.
After the launch, the propellers take over to take the device to its destination point. Thus, after this take-off or launch operation, the propellers of the device are used in order to navigate the device 1 to the next location. The device 1 thus operates as a drone during this period of movement.
The next location is known to the device 1 from a pathway for operation, as discussed below, and the processor 32 is configured to control the motors associated with the propellers using the motor control and management module 60 to navigate the device 1 to the next location.
The device operates in a free-flight mode between the launch location and the landing location.
The propellers guide the device to the landing spot, and after navigating to the next location, the processor 32 is configured to control the motors associated with the propellers using the motor control and management module 60 to land the device 1. In an appropriately equipped device, the device 1 lands on the stalk 4 and the tripod legs 6a to 6c are appropriately deployed as discussed above.
In general, the objective of the landing phase is to bring the device to touch down on a landing spot without falling over. Preferably during landing the device has zero forward velocity, and this is optimally achieved by switching off the propellers in the air. The order in which the propellers is turned off may be controlled to take into account prevailing wind conditions, and to allow for wind drift. The harder the device hits the ground, the less power has to be used to slow the device down before landing. Legs provided on the device act as shock absorbers when the device is then landed.
On landing, the device may make a comparison between the location in which it has landed, and the intended location for landing. The device legs may be actuated to move the device along the ground, in order to position the device at the intended location, if it has not landed at the intended location. This actuation of the legs is to readjust the position of the device, and the legs do not provide for continuous walking of the device.
The device may be adapted to follow a path within the area, moving from point to point, and flying or hopping between points. The points, and path between points, may be present, and the controller within the housing may control the device to move between the points.
The distance between hops—or positions at which the device launches and lands—will vary in dependence on the mission and implementation, but may for example be in the range of 2 m to 10 m. The device may thus be required to travel 2 m to 10 m.
The exemplary device 1 of
The rotatable arm 12,14 is configured to rotate about the device 1, and in practice rotates about the housing/stalk integral unit. The rotatable arm 12,14 may rotate 360° about the device 1, and the spray nozzle 22 mounted at the end of the rotatable arm may be controlled so it can be orientated upwards and downwards. The rotatable arm 12,14 for the spray mechanism may be telescopic.
The rotatable arm 12,14 and the spray nozzle may be controlled by the spray nozzle control and management module 14 of the control circuitry 30 of the device 1.
With reference to
As shown in
Because there are two arms, in order to give full 360° coverage for rotation, each arm only needs to rotate 180°. There could instead be provided just one arm which rotates through 360°, but the provision of the two arms requires each to rotate only through 180°. The rotation of each arm around 180° is indicated in
As can be seen comparing
As seen in the detailed view of
The spray arms may move in a radial direction from the housing 2, as denoted by dashed arrows 104 and 106. The hinge or pivot points 12c, 14c may be fixed to the respective rotatable arms 12, 14, and the spray arms may then move as the rotatable arms 12,14 are telescopically adjusted. Alternatively the spray arms 12a, 14a may be configured to move along the rotatable arms 12,14, so that the hinge or pivot points 12c, 14c move along the rotatable arms.
The spray arm may deploy any appropriate spray according to an implementation.
Although two spray arms are illustrated, any number of spray arms may be deployed, for example four spray arms. In general one or more spray arms may be deployed.
Although the illustrated arrangement shows the spray arms as being rod-type structures which are deployed by dropping them down through 90°, they are not limited to such an arrangement. They may, for example, be formed of concertina type structures, so that they can be opened to expand towards the ground, and closed to contract towards the support arm. The arms thus, in such a concertina-type configuration, can be understood as operating similar to a car-jack.
In the foregoing it is described that the arms 12a, 14a are spray arms equipped with spray nozzles 14a, 14b. In practice, the arms 12a, 14a may serve other purposes, and nozzles may not be provided. For example the arms 12a, 14a may be provided with weed wipes or sponges at points 12b, 14b for applying a weed killing chemical by application rather than spray. The device is thus not limited to the provision of a spray. A weed wipe may be a sponge with a tube going into it (along the ‘spray’ arm).
Weed wipes of sponge deployment can be advantageous in reducing the amount of liquid needing to be carried by the device. As little as a hundredth to a twentieth of the liquid may be needed in comparison to the liquid needed for spraying.
As noted one or more spray arms may be deployed, and therefore one or more arms associated with a weed wipe or sponge may similarly be deployed.
Where a weed spray or a weed wipe is provided, a reservoir of weed fluid may be provided in the device.
The exemplary device 1 of
The rotatable element 8 and the camera 10 may be controlled by the camera control and management module 62 of the control circuitry 30 of the device 1.
Alternatively the cameras may be deployed on arms similar to those on which the weed spray devices are provided. Thus independent arms may be provided with a rail system along which cameras may move, in order to carry out sensing. The cameras may be provided in situ with the weed killer nozzles. Such an arrangement of a camera on a rail being deployed along the rail may apply to devices other than the specific device shown and described.
A spray nozzle or a camera may be provided on a telescopic arm, and may move up and down the telescopic arm. The arm supporting the spray nozzle and/or camera and/or any other device may be line with or attached to a rotor arm.
The exemplary device 1 of
The solar panels 14a to 14d are controlled by the energy control and management module 58 of the control circuitry 30 of the device 1.
It will be understood that the configuration of solar panels as shown is exemplary, and any suitable deployment of solar panels on the device, or other mechanism to capture solar energy for use on the device 1, may be utilised.
The device of
The use of the device is not restricted to the use of solar energy. Rechargeable batteries may be used in addition to, or instead of, solar energy. The provision of power to the device is discussed further hereinbelow. Thus in some embodiments the device may have no solar panels.
Where a rechargeable battery is utilised, with current technologies a device 1 may operate for around 4 hours. A used battery may be dropped out and replaced with a fully charged one, to give 8 hours of operation. Each battery is recharged when another battery is in use. An 8 hour operation may be sufficient operation in a 24 hour period, and therefore each device may be provided with two rechargeable batteries, which are used for 4 hours each and recharged within the remainder of a 24 hour period. Of course use and recharge of batteries will be dependent on available battery technology, and desired operational time in a 24 hour period.
Where batteries are used, a network infrastructure may also be used (as described further hereinbelow) which facilitates battery replacement and recharge.
In general, the energy control and management module 58 of the control circuitry 30 of the device 1 is used to control the provision of energy or power to the device 1.
The exemplary device 1 of
The propellers 18a to 18d are controlled by the motor control and management module 60 of the control circuitry 30 of the device 1.
It will be understood that the power is delivered to the propellers to assist the device to take off, to fly/move the device, and to assist the device to land. This will be described further hereinbelow.
In embodiments, the take-off of the device, or the main energy for the take-off of the device, is provided by alternative means as discussed. The propellers are then used for flight of the device and/or landing of the device.
The device 1 may be a modular device, being able to connect to different modules to perform different functions. The modular functionality may be provided by an apparatus module or a software module.
A device may be able to navigate to a point within a location to attach a modular device. A hardware module may be fitted by an operator, or the device may be equipped to dock with a modular connection device as appropriate, in order to automatically acquire and fit the appropriate module. For example, a device 1 can attach a modular apparatus such as:
For example, a ground penetrating radar module may be deployed at the end of the ‘spray arm’, in place of the spray nozzle (12b, 14b of
A device 1 may be able to download different software to allow different functionality to be carried out. Should the device memory be limited, this software may be downloaded to overwrite other modular software, with each modular software being associated with a specific functionality. The device may be configured to download a software module wirelessly, over WiFi or a mobile phone network, or may be configured to dock with a module to download the software module.
For example, a device 1 can download modular software such as:
As appropriate, an additional module may be added to the set of modules 66 of the control circuit 30 to provide control for the hardware or software module.
Device modularity may allow different cameras, utilising different camera technology, to be used.
Device modularity may allow devices such as a UV (ultraviolet) light to be carried by the device 1, or the device 1 could carry a torch or lamp, or other illumination means. This may be carried in conjunction with the camera being carried, or may be an integral part of the camera being carried. The ability to carry an illumination means allows the device to operate at night time, allowing night time working. The device may therefore be operational throughout a 24 hour period, and continuously through such period, subject to suitable battery deployment, or a suitable battery recharge infrastructure.
When used for weed killing, the device is not limited to spraying or deployment of weed wipes or similar, the device may be fitted with a modular unit to allow snipping, drilling or pulling of weeds for example.
The modular connection device may support the exchange of rechargeable batteries. A rechargeable battery may be removed or attached/inserted at a modular connection device. A rechargeable battery may be connected to the device using a magnetic mechanism.
A single modular connection device may provide all modular operation functionality, or modular operation functionality, or modular connection devices may be specific to a particular function, such as a recharging function.
A further discussion of the operation of the device to allow such modularity to be supported is described below.
A device as described, which as noted above may also be described as a robot or drone, may be utilised to service an area, such as a field. The device of
An apparatus such as device 1 is preferably deployed to monitor and/or take action in a geographical area 80 as denoted in
Reference numeral 82 denotes a spot within the area 80 within which the device may be located. Also shown in
As will be apparent from the above discussion, the concentric circle having circumference 84 may have a variable radius, coinciding with the telescopic operation of the associated arm. The concentric circle 86 may have a radius which is coincident with the maximum radius of the rotatable arm associated with the circumference 84.
A transceiver 88 may be provided adjacent to the area 80 to communicate with the device at location 82, and generally communicate with the device 1 at any location within the area 80. Alternatively several such transceivers 88 may be deployed such that the device 1 is in communication for all positions in the field, if all locations cannot be covered by one such device. The transceiver 88 may be provided for WiFi communication with the device, so that the device does not have to be equipped to communicate via a mobile phone network.
The device 88 may be connected to other similar devices such as device 88 which may provide communication to devices such as device 1 in other areas, and all such device 88 may be connected to a central controller. The central controller may receive all images captured by the device, and may transmit instructions to the device.
Preferably the device 1 works autonomously within the area 80 in accordance with transmitted or predetermined instructions.
In one example implementation the device may, when located in a position, use the fitted camera 10 to scan the area around the device. The captured images can be processed by the image processing module 52. The processing may process whether any weeds are identified in the image scan. If weeds are identified, then the nozzle 22 is deployed using the arms 12,14 to spray the weeds.
Following the deployment of the spray to the weeds in such a situation the device 1 moves onto another location, with the intention that the device 1 moves or hops between locations in the area 80 to allow the area to be fully scanned and treated.
Turning to
With reference to
The device 1 thus autonomously hops between locations, and at each location carries out scanning and actioning as appropriate, in order to fully scan and action in the area 80.
The path as denoted by the arrows 90 may be predetermined, and may be pre-calculated by the processor 32 in order to determine the pathway for the device within the area 80. The processor 32 of the control circuitry 30 may utilise the pathway planning module 54 in order to determine the pathway through the area 8 as denoted in
An area for the device to operate in may be identified, and then the path comprising a plurality of waypoints computed.
As discussed above, an area may be provided with docking stations, or interface points, to allow a device to travel or hop to, in order to change the modular peripherals of the device, or potentially to download modular software, or to exchange rechargeable batteries. Such interface points may be included in the path computation. For example an energy management system may include waypoints of interface points for accessing or recharging batteries.
As shown in
The interface devices 98a to 98c may provide points at which a device 1 can change its modular connections, for example to equip with a different camera. The interface devices 98a to 98c may also provide locations at which a device 1 can replace its battery, and at which used batteries may be placed on charge. The interface devices 98a to 98c may also be provided to enable additional testing of samples. For example a device may bring a sample (for example of a weed) to a sensor located at interfaces 98a to 98c, in order to test that sample. The interfaces 98a to 98c may also provide a location at which a chemical reservoir of the device, such as a reservoir of weed killer.
Additional devices (or robots) may be provide in order to service the devices 1. These additional devices may transport chemicals, modules or batteries to the devices 1 in the field.
A device 1 as described may be utilised in conjunction with space data.
As denoted in
The transceiver station 88, or a control centre associated with the transceiver station 88, is configured to scan those images provided by the satellite to look for particular signs. For example, the images may be scanned to look for images of areas of ground of ‘poor health’. The areas 80a to 80f may denote the areas the images relate to.
In response to an analysis of the images, it is determined areas which need to be inspected and/or sprayed. Whilst the space data may identify an area which has been identified as having bad health, or requiring some form of investigation, the space data may not allow any indication of the reason for bad health.
Based on the space data, a controller may use the transceiver 88 to transmit instructions to one or more of a plurality of devices 1, as denoted by reference numeral 1a to 1c. Device 1a, for example, is deployed to inspect area 80a.
The device can then inspect that area in accordance with the previously described technique, hopping around the area to fully inspect it.
The device may be configured to just inspect that area, and may be able to identify the specifics of a problem that caused the space data to identify that area, and then the camera on the device can be used to identify, e.g. a fungus problem, a weed problem, a soil moisture problem, a pest problem etc.
The device may be configured, based on the space data, to inspect only a sub-part of the area with which it is associated. Returning to
The camera of the device can be used to take images, and relay these back to a control point. If the camera of the device identifies a weed, then it may automatically deploy the spray to the weeds without needing to wait for the camera images to be relayed for processing.
The device may use the images captured by its camera to alert a farmer of the specifics of a problem, and then the farmer can address the problem, or instruct the device to address the problem, e.g. by deploying a weed spray.
The device may use the images captured by its camera to relay this information back to an associated transceiver station 88, and/or a central control point, which transceiver or central control point can enhance or build on the provided satellite maps based on the locally captured images. Thus enhanced mapping is provided, which provides enhanced maps that may be utilised by other devices, robots or tractors.
When utilised with a satellite system, the device may not perform any scanning/inspection, utilising an on-board camera. The device may simply be controlled to perform an action based on the provided space data, and the images associated with the provided space data. The movement of the device can be controlled via GPS coordinates or such like, and the device moved to locations where the space data indicates action is needed. The combining of locally captured images, to enhance the space data, may however be advantageous.
The device may not perform any action, such as spraying, and may simply capture images for enhancing the space data.
The system may also provide a similar function of calibrating satellite data by using other similar ground sensing platforms, besides the device, for use in other environments such as water monitoring.
In particular, the device may be modified to enable it to perform water monitoring, so that it can enter and exit water to monitor such. Alternatively, the device may form part of a system which includes other devices which are configured to perform water monitoring, so the data monitored by both devices can be integrated.
A use of water monitoring may be to identify the presence and/or quantity of specific chemicals, such as chemicals associated with crop/soil treatment in an area. Based on the monitoring, it may be possible to identify the area (or farm) associated with the chemicals. This information may be integrated with satellite observation data associated with the water.
The system may also couple analyses through other platforms with the analysis having been done by the device, combining satellite data with ground sensing in a variety of environments, to understand how effects of one environment can lead to another.
A device may be used to fly around an area in order to capture images of the area, either instead of utilising space data from a satellite, or in addition to using space data from a satellite. Referring, for example, to
Ground tracking data may be used to calibrate satellite data. The device may provide local data, e.g. good data, to enhance the space data.
Earth observation (EO) is the gathering of information about the physical, chemical and biological systems of the planet via-remote-sensing technologies, supplemented by Earth-surveying techniques, which encompasses the collection, analysis and presentation of data. This collected data includes space data.
Earth observation data may inform the device, as described above with respect to space data.
A closed loop system may be provided in which the earth observation data is provide to control the device, and then the device is operated to enhance that earth observation data by, for example, utilising different sensors to accumulate data within an area.
In the above description it is set out that a device may be deployed within an area to monitor, inspect, or otherwise take action. In practice multiple devices may be deployed in a single area, with the devices communicating with each other either directly or through a central point such as a transceiver 88, to cooperate to cover an area.
A number of devices may be deployed in a given area—for example 20/30 devices may be deployed in a field. A Wi-Fi hotspot may be provided for all the devices to communicate with, rather than each device being configured with a communications device to communicate with a cellular phone network. This reduces costs associated with such communication.
A device may be configured to navigate towards hotspots, and include one or more locations within its preconfigured path within which communication with the hotpot will be possible. The pathway determined by each device may ensure that the start and end point of the pathway is within a Wi-Fi hotspot, but without requirements for the intervening points to be covered by Wi-Fi hotspot coverage.
Where multiple devices are deployed within the area, one of the multiple devices may be the master device for working that area, determine the pathways for all devices, and provide the pathway instructions/route to each individual device, including determine its own route.
An area within which a device may operate may be established with an energy infrastructure. This may particularly be utilised where the device utilises a rechargeable or replaceable battery source for at least part of its energy supply.
For example, the perimeter of the area may be provided with recharging points, with the devices being equipped with rechargeable power sources. The devices may be programmed to move between stationary positions in a path, and to move to a power source at points that they will need to be recharged.
The control processing circuitry within a device may be configured to determine a path within an area, based on knowledge of the locations of charging points within that area.
With reference to
The device may be part of an overall system for machine learning, which system is connected to a network to provide on-line access. The device may provide feedback into the system that, for example, an area of ground identified by satellite data as a yellow patch is weeds.
An intermediary system may create waypoints and send them to the device.
A device can be used to accumulate data, e.g. enhancing satellite data and earth observation data. The data accumulated by the device may be exported from the system of which the device is a part. A well-tuned set of data, or map, may be created and exported.
It will also be understood from the foregoing that there may be provided an infrastructure which not only allows for charging/recharging, but also allows for modular elements to be removed, affixed, and replace. These modular adjustments may be applied at the same points as provide the charging/recharging using the same devices, or at different points using different devices.
The described technique provides a system in which repeated visits by a device, such as robot device of the type described to a sector or filed may provide observations to build in-trait models.
In-field variations of these traits may be analysed and understood to show how close or how likely a phenotyping model is to be accurate.
The described technique may provide predictions of yield based on using both in-field measurements and phenotyping models.
There is thus described an arrangement providing a solar re-charging, jumping drone, which finds and kills weeds, collects data and interacts.
There is thus described an arrangement providing computer vision to locate weeds, and precisely target with a drone arm.
There is thus described an arrangement providing calibration of satellite data to assist, and for example apply fertiliser, detect diseases and fungus, and analyse soil.
There is thus described an arrangement providing self-managed operation of multiple devices, working all day in swarms.
There is thus described an arrangement providing a device having an arm control.
The technique as described allows multiple uses, finds all weeds efficiently, and significantly reduces chemical costs.
Next generation of the device may be tractor mounted, organic friendly, and use data aggregation.
The device and system may be further enhanced.
Live feedback of ground-data such as weather may be used to optimise the pathway, based on long-range hopping and well as live earth observation data.
Wind conditions may be taken into account in determining the pathway, to determine waypoints and trajectory at least partly in dependence thereon.
Obstacle avoidance may be utilised to ensure a continuous hopping trajectory.
Artificial intelligence may be utilised to build up knowledge for use in defining pathways.
The captured image data may be used to recalibrate weed targeting. Live feedback may be used to readjust or recalibrate.
The creation of a map may be used to create a map larger than the area which the device operates over. The area which the device operates over may be of interest in mapping/assessing neighbouring areas.
The invention has been described with reference to various examples and embodiments, but is not limited to specifics given. Various examples and embodiments described may be combined, and various examples and embodiments as described may be implemented without specific details as presented.
Number | Date | Country | Kind |
---|---|---|---|
1717137.2 | Oct 2017 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2018/078622 | 10/18/2018 | WO | 00 |