This application relates to a robotic work tool and in particular to a system and a method for providing an improved navigation for robotic work tools, such as lawnmowers, in such a system.
Automated or robotic work tools such as robotic lawnmowers are becoming increasingly more popular and so is also the demand for advanced functions of the robotic work tools. To satisfy such demands, precise navigation is required, for example for navigating safely in an area without exceeding a border of the operational area, navigating specific patterns, navigating around specific buildings (or other structures) or natural features (including flower beds and so on). Such precise navigation is usually dependent on satellite navigation, for example GNSS (Global Navigation Satellite System), GPS (Global Positioning System) or beacon supplemented satellite navigation such as RTK (Real Time Kinematic). Other beacon-based navigation technologies are for example use of UWB (Ultra WideBand) beacons. Such systems have in common that they rely on that the robotic work tool receives one or more signals from satellites or beacons (acting as reference stations) and that those signals are received reliably.
As such signals need be received reliably for an accurate navigation, the robotic work tool may suffer in areas where reliable signal reception is not possible or available, such as in satellite shadows.
The prior art shows many proposals for a solution to this problem, which has been around for many, many years dating back to 2008, and is thus a long-standing problem. All such solutions rely on a deduced reckoning possibly in combination with SLAM (Simultaneous Localization And Mapping) technologies.
However such solutions all suffer from problems relating to an estimated location/direction determined based on relative measurements. Furthermore, the use of SLAM is relatively costly requiring vast computing resources and several sensors (including accelerometers and visual systems) to function.
Thus, there is a need for an improved manner of navigating robotic work tools.
The inventors have further realized that since satellites are not always stationary, such shadowed areas may move and a mapping of shadowed area may not be sufficient as the shadow area may be in different locations. Solutions relying on absolute positions of known shadowed area, may thus not be sufficient, as the shadowed areas may vary or occur in new places.
It is therefore an object of the teachings of this application to overcome or at least reduce those problems by providing a robotic work tool arranged to operate in an operational area, the robotic work tool comprising a memory configured to store a location of at least one object, a distance sensor, a navigation sensor being based on signal-reception and a controller, wherein the controller is configured to: determine a location of the robotic work tool utilizing the navigation sensor; determine that a shadowed area is encountered, wherein navigation utilizing the navigation sensor is not reliable; and in response thereto navigate utilizing the distance sensor based on detecting at least one object and a distance to the at least one object utilizing the distance sensor, the stored at least one object and the location of the robotic work tool.
In some embodiments the controller is further configured to determine that the shadowed area is encountered by determining that the robotic work tool has entered the shadowed area.
In some embodiments the controller is further configured to determine that the shadowed area is sufficiently mapped and in response thereto enter the shadowed area.
In some embodiments the controller is further configured to determine that the shadowed area is sufficiently mapped by determining that there are stored objects that will be visible to the robotic work tool along a planned path of the robotic work tool.
In some embodiments the controller is further configured to determine that determining that the robotic work tool has entered the shadowed area and in response thereto exit the shadowed area.
In some embodiments the controller is further configured to determine that the shadowed area is insufficiently mapped and in response thereto map the shadowed area by: detecting at least one object at a first position; change to a second position; and detecting at least one second object at the second position.
In some embodiments the controller is further configured to change to the second position by moving to the second position.
In some embodiments the controller is further configured to change to the second position by zigzagging.
In some embodiments the controller is further configured to change to the second position by rotating.
In some embodiments the controller is further configured to change to the second position by circumnavigating an object or the shadowed area
In some embodiments the controller is further configured to proactively map a future shadowed area by: detecting at least one object at a first position; change to a second position; and detecting at least one second object at the second position, regardless detection of a shadowed area.
In some embodiments the distance sensor is a radar sensor.
In some embodiments the controller is further configured to detect an object utilizing the distance sensor by: receiving a radar point cloud; determining a location of the radar point cloud; and record the object at the determined location.
In some embodiments the controller is further configured to determine that the object is not moving prior to recording the determined location.
In some embodiments the controller is further configured to determine an extension of the radar point cloud, determine an assumed shadow based on the extension of the radar point cloud and map an area of the assumed shadow.
In some embodiments the controller is further configured to perform a visual classification of the object and determine the assumed shadow also based on the visual classification.
In some embodiments the map is stored in a remote memory connected to the robotic work tool directly or indirectly.
It is also an object of the teachings of this application to overcome the problems by providing a method for use in a robotic work tool arranged to operate in an operational area, the robotic work tool comprising a memory configured to store a location of at least one object, a distance sensor, a navigation sensor being based on signal-reception and a controller, the method comprising: determining a location of the robotic work tool utilizing the navigation sensor; determining that a shadowed area is encountered, wherein navigation utilizing the navigation sensor is not reliable; and in response thereto navigating utilizing the distance sensor based on detecting at least one object and a distance to the at least one object utilizing the distance sensor, the stored at least one object and the location of the robotic work tool.
In some embodiments the robotic work tool is a robotic lawnmower.
Further embodiments and aspects are as in the attached patent claims and as discussed in the detailed description.
It should be noted that object is detected in the present application even before any problems with the satellite reception is detected or encountered. It is thus not a simple navigation based on the radar as an alternative sensor, but a predicted navigation where it is ensured that objects are available for navigation in an area where satellite signals are not reliably received. The teachings herein thus provide to proactively ensure that navigation is enabled in shadowed areas.
Other features and advantages of the disclosed embodiments will appear from the following detailed disclosure, from the attached dependent claims as well as from the drawings. Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to “a/an/the [element, device, component, means, step, etc.]” are to be interpreted openly as referring to at least one instance of the element, device, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated.
The invention will be described in further detail under reference to the accompanying drawings in which:
The disclosed embodiments will now be described more fully hereinafter with reference to the accompanying drawings, in which certain embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Like reference numbers refer to like elements throughout.
It should be noted that even though the description given herein will be focused on robotic lawnmowers, the teachings herein may also be applied to, robotic ball collectors, robotic mine sweepers, robotic farming equipment, or other robotic work tools.
It should be noted that robotic lawnmower may be of different sizes, where the size ranges from merely a few decimetres for small garden robots, to even more than 1 meter for large robots arranged to service for example airfields.
It should be noted that even though the description herein is focused on the example of a robotic lawnmower, the teachings may equally be applied to other types of robotic work tools, such as robotic watering tools, robotic golfball collectors, and robotic mulchers to mention a few examples.
It should also be noted that the robotic work tool is a self-propelled robotic work tool, capable of autonomous navigation within a work area, where the robotic work tool propels itself across or around the work area in a pattern (random or predetermined).
It should be noted that wheels 130 driven by electric motors is only one example of a propulsion system and other variants are possible such as caterpillar tracks.
The robotic lawnmower 100 also comprises a controller 110 and a computer readable storage medium or memory 120. The controller 110 may be implemented using instructions that enable hardware functionality, for example, by using executable computer program instructions in a general-purpose or special-purpose processor that may be stored on the memory 120 to be executed by such a processor. The controller 110 is configured to read instructions from the memory 120 and execute these instructions to control the operation of the robotic lawnmower 100 including, but not being limited to, the propulsion and navigation of the robotic lawnmower.
The controller 110 in combination with the electric motor 155 and the wheels 130 forms the base of a navigation system (possibly comprising further components) for the robotic lawnmower, enabling it to be self-propelled as discussed under
The robotic lawnmower 100 is further arranged with a wireless communication interface 115 for communicating with other devices, such as a server, a personal computer, a smartphone, the charging station, and/or other robotic work tools. Examples of such wireless communication devices are Bluetooth®, WiFi® (IEEE802.11b), Global System Mobile (GSM) and LTE (Long Term Evolution), to name a few. The robotic lawnmower 100 may be arranged to communicate with a user equipment 200 as discussed in relation to
The robotic lawnmower 100 also comprises a grass cutting device 160, such as a rotating blade 160 driven by a cutter motor 165. The grass cutting device being an example of a work tool 160 for a robotic work tool 100.
The robotic lawnmower 100 may further comprise at least one navigation sensor, such as a beacon navigation sensor and/or a satellite navigation sensor 185. The optical navigation sensor may be a camera-based sensor and/or a laser-based sensor. The beacon navigation sensor may be a Radio Frequency receiver, such as an Ultra Wide Band (UWB) receiver or sensor, configured to receive signals from a Radio Frequency beacon, such as a UWB beacon. Alternatively or additionally, the beacon navigation sensor may be an optical receiver configured to receive signals from an optical beacon. The satellite navigation sensor may be a GPS (Global Positioning System) device (or other Global Navigation Satellite System (GNSS) device) or a RTK device. For the purpose of the teachings herein, the navigation device is considered to provide a reliable reception if a sufficient number of signals are received at a signal quality level enabling an accurate determination of a location. In some embodiments, such accurate determination is possible if the determination is made with an error margin under 0.5 m, under 0.3 m, under 0.2 m or in any range 0-0.5 m. As is known such accurate determination is possible when the signal quality of the received signals exceeds a threshold value.
As the robotic work tool operates utilizing or relying on satellite (or other signal) navigation, that is, when utilizing or relying on the navigation sensor 185 (also referred to as a signal reception-based navigation sensor), the robotic work tool is considered to operate in a signal reception-based also referred to as a GPS mode for embodiments where the navigation sensor comprises a GPS, GNSS, RTK or similar sensor.
In embodiments, where the robotic lawnmower 100 is arranged with a navigation sensor 185, the magnetic sensors 170 as will be discussed below are optional. In embodiments relying (at least partially) on a navigation sensor, the work area may be specified as a virtual work area in a map application stored in the memory 120 of the robotic lawnmower 100. The virtual work area may be defined by a virtual boundary. Even in embodiments where the map is stored remotely, at least parts of the map may be stored locally in the memory during operation. Alternatively any comparisons made with the map remotely may be seen as being made by the controller in configuration with the memory as tit is caused by the controller and performed on data stored in the memory, such as an indicator of the map and the location of the robotic work tool, which both are at least temporarily stored in the memory.
The robotic lawnmower 100 may also or alternatively comprise deduced reckoning sensors 180. The deduced reckoning sensors may be odometers, accelerometer or other deduced reckoning sensors. In some embodiments, the deduced reckoning sensors are comprised in the propulsion device, wherein a deduced reckoning navigation may be provided by knowing the current supplied to a motor and the time the current is supplied, which will give an indication of the speed and thereby distance for the corresponding wheel.
For enabling the robotic lawnmower 100 to navigate with reference to a boundary wire emitting a magnetic field caused by a control signal transmitted through the boundary wire, the robotic lawnmower 100 is, in some embodiments, further configured to have at least one magnetic field sensor 170 arranged to detect the magnetic field and for detecting the boundary wire and/or for receiving (and possibly also sending) information to/from a signal generator (will be discussed with reference to
As mentioned above, in some embodiments, the robotic lawnmower 100 is in some embodiments arranged to operate according to a map application representing one or more work areas (and possibly the surroundings of the work area(s)) stored in the memory 120 of the robotic lawnmower 100. The map application may be generated or supplemented as the robotic lawnmower 100 operates or otherwise moves around in the operational area 205. In some embodiments, the map application includes one or more start regions and one or more goal regions for each work area. In some embodiments, the map application also includes one or more transport areas.
As discussed in the above, the map application is in some embodiments stored in the memory 120 of the robotic working tool(s) 100. In some embodiments the map application is stored in the server (referenced 240 in
The robotic working tool 100 may also comprise additional sensors 190 for enabling operation of the robotic working tool 100, such as visual sensors (for example a camera), ranging sensors for enabling SLAM-based navigation (Simultaneous Localization and Mapping), moisture sensors, collision sensors, wheel load sensors to mention a few sensors. In particular, in some embodiments, the robotic work tool 100 comprises at least one visual sensor for receiving visual indications that may be interpreted to correspond to movement information.
The robotic work tool 100 also comprises one or more radar sensors 195 enabling the robotic work tool to detect an object and to determine a distance (and a direction or a distance in a direction) to the object by emitting and receiving reflected radar signals.
It should be noted that the robotic work tool 100 may—in alternative or additional embodiments, be arranged with other distance sensors, the radar sensor being an example of a distance sensor. Other examples include ultra sound distance sensors, LIDARs, time-of-flight sensors, and/or stereo cameras. The robotic work tool is also enabled to differentiate between a stationary object and a moving object based on the reception of the radar signals based on a Doppler effect affecting the received radar signals or not. More details on this will be discussed further below. It should be noted that radar sensors provide a more or less exact distance and direction to an object without any scaling, such as when utilizing visual determination of distance and direction. The functioning of a radar can vary greatly between different models, but is considered to be known to a skilled person, even if the usage of radar as discussed herein is not previously known.
The robotic work tool according to the teachings herein is thus enabled to navigate utilizing the radar sensor(s) 195. In some embodiments, the robotic work tool is thus enabled to determine distances and directions to objects and determine its location with regards to these objects, and possibly also its absolute position based on the location of these object(s), possibly as stored in the map application.
As the robotic work tool operates utilizing or relying on radar navigation, that is, when utilizing or relying on the navigation sensor 185 (also referred to as a signal reception-based navigation sensor), the robotic work tool is considered to operate in a radar mode.
The robotic work tool system 200 further comprises a station 210 possibly at a station location. A station location may alternatively or additionally indicate a service station, a parking area, a charging station or a safe area where the robotic work tool may remain for a time period between or during operation session.
As with
The one or more robotic working tools 100 of the robotic work tool system 200 are arranged to operate in an operational area 205, which in this example comprises a first work area 205A and a second work area 205B connected by a transport area TA. However, it should be noted that an operational area may comprise a single work area or one or more work areas, possibly arranged adjacent for easy transition between the work areas, or connected by one or more transport paths or areas, also referred to as corridors. In the following work areas and operational areas will be referred to interchangeably, unless specifically indicated.
The operational area 205 is in this application exemplified as a garden, but can also be other operational areas as would be understood, such as an airfield. As discussed above, the garden may contain a number of obstacles, for example a number of trees, stones, slopes and houses or other structures.
In some embodiments the robotic work tool is arranged or configured to traverse and operate in operational areas or work areas that are not essentially flat, but contain terrain that is of varying altitude, such as undulating, comprising hills or slopes or such. The ground of such terrain is not flat and it is not straightforward how to determine an angle between a sensor mounted on the robotic work tool and the ground. The robotic work tool is also or alternatively arranged or configured to traverse and operate in a work area that contains obstacles that are not easily discerned from the ground. Examples of such are grass or moss-covered rocks, roots or other obstacles that are close to ground and of a similar colour or texture as the ground. The robotic work tool is also or alternatively arranged or configured to traverse and operate in a work area that contains obstacles that are overhanging, i.e. obstacles that may not be detectable from the ground up, such as low hanging branches of trees or bushes. Such a garden is thus not simply a flat lawn to be mowed or similar, but a work area of unpredictable structure and characteristics. The operational area 205 exemplified with referenced to
As shown in
The robotic working tool system 200 may alternatively or additionally comprise or be arranged to be connected to a server 240, such as a cloud service, a cloud server application or a dedicated server 240. The connection to the server 240 may be direct from the robotic working tool 100, direct from a user equipment 250, indirect from the robotic working tool 100 via the service station 210, and/or indirect from the robotic working tool 100 via the user equipment 250.
As a skilled person would understand that a server, a cloud server or a cloud service may be implemented in a number of ways utilizing one or more controllers 240A and one or more memories 240B that may be grouped in the same server or over a plurality of servers.
In the below several embodiments of how the robotic work tool may be adapted will be disclosed. It should be noted that all embodiments may be combined in any combination providing a combined adaptation of the robotic work tool.
The inventors have realized that as radar sensors provide highly accurate if not perfect distances and directions as opposed to the estimations provided by both SLAM and deduced reckoning, radar can beneficially be used for robotic work tools to improve navigation in areas where satellite (or other navigation signals) reception is not possible or available, i.e. in (GPS) shadows.
In
The robotic work tool is thus configured to determine a location of at least one object utilizing the radar sensor and the navigation sensor, when operating in the signal reception mode.
The position of the object is stored, possibly in the map application, or otherwise recorded. A planned path of the robotic work tool 100 is indicated by a dotted arrow referenced P.
In some embodiments the robotic work tool is configured to determine that a shadow area is (possibly) being encountered or about to be entered, and in response thereto determine whether the shadowed area is mapped, i.e. if there are previously recorded objects in the shadowed area, or at least in the planned path of the robotic work tool 100.
In some such embodiments the robotic work tool is configured to determine that the shadowed area is encountered by determining that a current signal reception is below a threshold, i.e. to determine that (satellite) signal reception is no longer reliably received. In other words, that the robotic work tool has entered a shadowed area. In such embodiments the robotic work tool is configured to exit the shadowed area, by reversing out along the same path used to enter the shadowed area. The robotic work tool is thus also configured to store paths taken. Possibly storing only the last navigation actions taken for example during a time period of up to 1, 2 or 5 minutes. Possibly storing all navigation actions taken in a work session. Possibly storing only the last navigation actions taken for example during a travelled distance of up to 1, 2 or 5 meters. These possibilities may or may not be combined. A navigation action relating to a speed, a direction a turn and/or a time period for such an action.
In some such embodiments the robotic work tool is configured to determine that the shadowed area is encountered by determining that a current signal reception is falling. This may be determined based on comparing a received signal quality with a previously received signal. Alternatively this may be determined by monitoring or determining a derivate of the signal reception.
If it is determined that the shadowed area is encountered (possibly having been entered and exited), and if it is determined that the shadowed area is not sufficiently mapped, the robotic work tool detects objects in the shadowed area utilizing the radar sensor so that the shadowed area becomes sufficiently mapped.
In some embodiments, the determination whether the shadowed area is sufficiently mapped is made by determining that there are recorded objects that will be detectable by the robotic work tool as the robotic work tool traverses a planned path.
In some embodiments, the determination whether the shadowed area is sufficiently mapped is made by determining that there are recorded objects that will be detectable by the robotic work tool as the robotic work tool traverses an assumed shadowed area.
In some embodiments the robotic work tool 100 maps the shadowed area by detecting further objects in the shadowed area, or along a planned path.
In some such embodiments, and as shown in
In the example of
The second position is, in some embodiments assumed by rotating (at least a portion of a circle) the radar sensor 195 and/or the robotic work tool 100 and thereby the radar sensor 195.
The second position is, in some embodiments assumed by moving to a second position.
The second position is, in some embodiments assumed by zigzagging the robotic work tool while moving.
The second position is, in some embodiments assumed by the robotic work tool circumnavigating at least partially, the shadowed area, as shown in in
In some such alternative or additional embodiments, and as shown in
This enables the robotic work tool to have a reference while navigating in GPS/RTK mode to enable for ensuring sufficient mapping in an assumed shadowed area, for future use, even if the assumed shadowed area does not correspond to a real shadowed area, partially or at all.
As the robotic work tool determines that the shadowed area is sufficiently mapped, the robotic work tool switches to the radar mode and enters the shadowed area. The switch may be made proactively before entering the shadowed area, ie. before losing reception. The switch may be made proactively after entering the shadowed area, ie. when losing reception. The switch may also be made while still using the navigation sensor 185.
In some embodiments, the robotic work tool is configured to automatically assume a shadowed area around any newly detected object and move to a second position (in any manner as discussed above) to ensure that any further or second object obscured by the newly detected object is also detected.
In case the robotic work tool determines that a currently navigated shadowed area is not sufficiently mapped, the robotic work tool may exit the shadowed area (possibly along the same path as used when entering the shadowed area) and remap the area, based on the robotic work tool's newly gained knowledge on where the shadowed area is no longer sufficiently mapped.
In some embodiments, as an alternative to exiting the shadowed area the robotic work tool may instead continue to map the shadow area based on its current position known from previously mapped object in the shadow area.
The inventor has realized that there will always be object to base navigation on in a shadowed area. If there are no objects, then there will also not be any shadow. The teachings herein thus provide for a highly reliable and accurate manner of navigating a robotic work tool usable in all areas.
A robotic work tool may thus in some embodiments be configured to perform the method according to
A robotic work tool may thus in some embodiments be configured to perform the method according to
As discussed in relation to
It should be understood that as the robotic work tool is itself moving, all point clouds will be received as having a speed vector, however, objects that are actually moving will be received as a point cloud having a speed vector with a different speed than the stationary ones. As a skilled person would understand, the scalar value of the speed vector (i.e the speed) depends on the speed relative the robotic work tool, and can be determined and taken into account. In some such embodiments, the speed of the robotic work tool is also determine and subtracted from the received speed for an object.
In some embodiments, the robotic work tool is also configured to not only determine an extension of the detected object, but also to classify the object by supplemental visual detection of the object. In embodiments where the robotic work tool is arranged with a camera or other imaging device, the robotic work tool may capture an image of the detected object and classify the object based on the image. The classification of an object may be associated with an assumed shadow. For example, a roof (such as a car port), will for sure be associated with an assumed shadow extending under the roof. A single tree may not be associated with a shadow, unless the tree is very large, but a group of trees may be associated with an assumed shadow encompassing the tress.
It should be noted that even if the object(s) has been discussed as being in the operational area, any object in or next to, i.e an object in the surrounding, may be detected and used for navigation. Also, a shadow may very well be caused by an object outside the operational area, wherefore not only objects in the operational area are detected.
A robotic work tool may thus in some embodiments be configured to perform the method according to
Number | Date | Country | Kind |
---|---|---|---|
2151275-1 | Oct 2021 | SE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/SE2022/050658 | 6/30/2022 | WO |