Method for obstacle detection and recognition for intelligent snow sweeping robot

Abstract
A method for obstacle detection and recognition for an intelligent snow sweeping robot is disclosed, comprising: 1) disposing ultrasonic sensors at a front end of the snow sweeping robot to detect distance information from an obstacle ahead; and disposing radar sensors at the front and rear of the snow sweeping robot to detect whether a creature suddenly approaches; 2) processing signals detected by each of the ultrasonic sensors and radar sensors, and calculating a forward distance of the snow sweeping robot; and 3) determining a snow cover extent of a working road, detecting a change of the distance from the obstacles, and recognizing the obstacles for conditions of an ultrasonic ranging variation ratio and a variation of the forward distance of the snow sweeping robot, a change of the signal detected by radar sensors, and a descriptive statistic of the snow cover extent within a specific time period.
Description
CROSS REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit and priority to Chinese Patent Application No. 202011363678.8 filed on Nov. 27, 2020, which is herein incorporated by reference in its entirety.


TECHNICAL FIELD

The present disclosure relates to the field of intelligent robot technology, and in particular, to a method for obstacle detection and recognition for intelligent robots.


BACKGROUND ART

In winter in northern China, snow on roads often troubles our transportation. In particular, snow covering specific bends, intersections, and ramps often leads to traffic accidents, and brings many inconveniences to our production, life, and travel. Nowadays, snow removal on urban roads becomes a challenging task for municipal departments. Snow is mainly removed by using conventional snowplows or manually removed. Such methods are inefficient and labor-intensive. Therefore, it is necessary to research on intelligent snow sweeping robots.


Most of existing snow sweeping devices are operated either manually or by remote control. Such devices are less intelligent and highly dependent on a human, and people are susceptible to frostbite, fall, or accidental injury by the devices during the operation. Therefore, designing an intelligent snow sweeping robot that can eliminate and avoid unsafe factors in the environment and take specific measures to protect an operator and others has become the key to research. Accordingly, there is a need for a method that enables snow sweeping robots to actively detect and recognize obstacles during unattended operation to account for the above safety concerns.


Existing obstacle avoidance strategies for snow sweeping robots include adoption of three-dimensional laser radars that perceive environments, and combination of binocular cameras and ultrasonic sensors, among others. However, these methods suffer from technical problems such as high hardware costs and poor real-time performance of algorithms.


SUMMARY

In view of this, an object of the present disclosure is to provide a method for obstacle detection and recognition for an intelligent snow sweeping robot to solve technical problems of actively detecting and recognizing obstacles by the snow sweeping robot during operation.


The method for obstacle detection and recognition for an intelligent snow sweeping robot according to the present disclosure includes the following steps:


(1) disposing an ultrasonic sensor on each of a left side, middle, and a right side of a front end of the snow sweeping robot to detect a distance between the snow sweeping robot and an obstacle ahead by the ultrasonic sensor; and disposing a radar sensor at the front and the rear of the snow sweeping robot respectively to detect whether a creature suddenly approaches when the snow sweeping robot operates by the radar sensor;


(2) processing signals detected by each of the ultrasonic sensors and each of the radar sensors, and calculating a forward distance of the snow sweeping robot, the processing specifically comprising:


a. processing ranging data acquired by each of the ultrasonic sensors, the processing specifically comprising:


performing recursive weighted average filtering on distance data acquired by each of the ultrasonic sensors within a time period Δt, expressed as follows for a kth time period Δt:







d
k

=








i
=
1

n



ρ
ki



d
ki


n





wherein dk represents a kth ultrasonic ranging result, dki represents a distance value obtained during ith detection within the kth time period Δt, ρki represents a weight value during the ith detection, and n represents a number of detected distance values whose reciprocal value is derived;


b. processing the signals detected by each of the radar sensors, the processing specifically comprising:


processing signal data acquired by each of the radar sensors within the kth time period Δt, expressed as follows:







m
k

=

{




1
,

Signals


from


a


same


radar


sensor


are


received


twice


in


succession







0
,

Signals


from


a


same


radar


sensor


are


not


received


twice


in



succession
.











wherein mk represents a result obtained after the signal data acquired by each of the radar sensors within the kth time period Δt is processed; and


c. calculating the forward distance of the snow sweeping robot, the calculating specifically comprising:


preforming amplitude-limiting filtering on a forward velocity of the snow sweeping robot within the kth time period Δt, expressed as follows:







v
j

=

{





v
j

,







"\[LeftBracketingBar]"



v
j

-

v

j
-
1





"\[RightBracketingBar]"




v
res








v

j
-
1


,







"\[LeftBracketingBar]"



v
j

-

v

j
-
1





"\[RightBracketingBar]"


>

v
res













S
k

=







j
=
1

n



v
j


t





wherein νj represents a forward velocity of the snow sweeping robot converted from encoder data that detects a wheel velocity of the snow sweeping robot and is read for the jth time, νj−1 represents a forward velocity of the snow sweeping robot converted from encoder data that detects the wheel velocity of the snow sweeping robot and is read for the (j−1)th time, νres represents a maximum allowable deviation value between the two velocities, Sk represents a forward distance of the snow sweeping robot within the kth time period Δt, n represents a number of times the encoder data of the snow sweeping robot is read within the time period Δt, and t represents a short time period; and


(3) detecting and recognizing of obstacles, the detecting and recognizing specifically comprising:


assuming that dflag represents a standard safe distance, νflag represents a standard forward velocity of the snow sweeping robot, and νdiffer represents a threshold of a forward velocity deviation of the snow sweeping robot;


defining a descriptive statistic of a snow cover extent as follows:






x
=

α
v





wherein α represents a scale factor, and ν represents a forward velocity of the snow sweeping robot, and in other words, the snow cover extent is inversely proportional to the forward velocity of the snow sweeping robot;


defining a kth ultrasonic ranging variation as follows:








y
k

=




"\[LeftBracketingBar]"



d
k

-

d

k
-
1





"\[RightBracketingBar]"



Δ

t



,

k
=
2

,
3
,

4








defining a kth ultrasonic ranging variation radio as follows:









β
k

=


y
k


y

k
-
1




,

k
=
2

,
3
,

4










defining a kth variation ratio of the forward distance of the snow sweeping robot as follows:








ξ
k

=


S
k


S

k
-
1




,

k
=
2

,
3
,

4








assuming that obstacle determining conditions are as follows:






{






Z
k

=


β
k


ξ
k









m
k

=

1


or


0





.





In a first situation, when any of the ultrasonic sensors has a detection distance d>dflag and |ν−νflag|≤νdiffer, it is presumed that S1≈S2≈ . . . ≈Sk and the snow cover extent x is approximately constant, that is, the snow sweeping robot operates at a constant velocity in a section with a uniform snow cover extent, and the obstacle determining conditions are degenerated as follows:






{





Z
k

=



β
k


ξ
k




β
k









m
k

=

1


or


0













if

0.95



Z
k




1
.
0


5


,

{







m
k

=
1

,

static


creature


obstacle









m
k

=
0

,

static


general


obstacle





;










if



Z
k





0
.
9


5


,

{







m
k

=
1

,

remote


creature


obstacle









m
k

=
0

,

remote


general


obstacle





;
or










if



Z
k





1
.
0


5


,

{







m
k

=
1

,

near


creature


obstacle









m
k

=
0

,

near


general


obstacle





.






In a second situation, when any of the ultrasonic sensors has a detection distance d>dflag and ν−νflagdiffer, it is presumed that Sk+1>Sk at a moment k+1, and Sk and yk at a moment k are the same as those at a previous moment k−1 at which the snow sweeping robot operates at a constant velocity, and in this case, x increases, it is presumed that the snow sweeping robot enters a section with a small snow cover extent, and the obstacle determining conditions are as follows:






{





Z

k
+
1


=


β

k
+
1



ξ

k
+
1










m

k
+
1


=

1


or


0












Z

k
+
1


=



β

k
+
1



ξ

k
+
1



=




y

k
+
1


/

y
k




s

k
+
1


/

s
k



=



y

k
+
1



S

k
+
1






S
k


y
k









focusing on a first fraction yk+1/Sk+1 because of a second fraction Sk/yk≈1 on the right-hand side of the equation, in this case, Sk+1 increases, and the obstacle determining conditions are as follows:






{





Z

k
+
1





y

k
+
1



S

k
+
1










m

k
+
1


=

1


or


0













if

0.95



Z

k
+
1





1
.
0


5


,

{







m

k
+
1


=
1

,

static


creature


obstacle









m

k
+
1


=
0

,

static


general


obstacle





;










if



Z

k
+
1






0
.
9


5


,

{







m

k
+
1


=
1

,

remote


creature


obstacle









m

k
+
1


=
0

,

remote


general


obstacle





;
or










if



Z

k
+
1






1
.
0


5


,

{







m

k
+
1


=
1

,

near


creature


obstacle









m

k
+
1


=
0

,

near


general


obstacle





.






In a third situation, when any of the ultrasonic sensors has a detection distance d>dflag and ν−νflagdiffer, it is presumed that S2k+1<S2k at a moment 2k+1, and S2k and y2k at a moment 2k are the same as those at a previous moment 2k−1 at which the snow sweeping robot works at a constant velocity; and in this case, x decreases, it is presumed that the snow sweeping robot enters a section with a large snow cover extent, and the obstacle determining conditions are as follows:






{





Z


2

k

+
1


=


β


2

k

+
1



ξ


2

k

+
1










m


2

k

+
1


=

1


or


0












Z


2

k

+
1


=



β


2

k

+
1



ξ


2

k

+
1



=




y


2

k

+
1


/

y

2

k





s


2

k

+
1


/

s

2

k




=



y


2

k

+
1



S


2

k

+
1






S

2

k



y

2

k










Focusing on a first fraction y2k+1/S2k+1 because of a second fraction S2k/y2k≈1 on the right-hand side of the equation, in this case, S2k+1 decreases, and the obstacle determining conditions are as follows:






{





Z


2

k

+
1





y


2

k

+
1



S


2

k

+
1










m


2

k

+
1


=

1


or


0













if

0.95



Z


2

k

+
1





1
.
0


5


,

{







m


2

k

+
1


=
1

,

static


creature


obstacle









m


2

k

+
1


=
0

,

static


general


obstacle





;










if



Z


2

k

+
1






0
.
9


5


,

{







m


2

k

+
1


=
1

,

remote


creature


obstacle









m


2

k

+
1


=
0

,

remote


general


obstacle





;
or










if



Z


2

k

+
1






1
.
0


5


,

{







m


2

k

+
1


=
1

,

near


creature


obstacle









m


2

k

+
1


=
0

,

near


general


obstacle





.






According to the present disclosure, the following beneficial effects are obtained. The method for obstacle detection and recognition for an intelligent snow sweeping robot provided in the present disclosure can determine a snow cover extent of a working road, quickly and effectively detect obstacles, and identify them as general obstacles or creature obstacles when the snow sweeping robot autonomously operates. False detection can be prevented by multi-sensor fusion analysis which has good anti-interference performance. According to the present disclosure, a determining threshold and the number of measurements can be flexibly set through the field testing to meet an accuracy and a sensitivity of the obstacle detection and recognition under different snow cover extents and achieve a good adaptability.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a distribution diagram of sensors of a snow sweeping robot.



FIG. 2 is a flow chart of a method for obstacle detection and recognition for an intelligent snow sweeping robot.





DETAILED DESCRIPTION OF THE EMBODIMENTS

The present disclosure is described in further detail below with reference to the accompanying drawings and embodiments.


A method for obstacle detection and recognition for an intelligent snow sweeping robot according to the embodiments includes the following steps:


(1) Disposing an ultrasonic sensor 1 on each of a left side, the middle, and a right side of a front end of the snow sweeping robot to detect distance between the snow sweeping robot and an obstacle ahead by the ultrasonic sensor; and disposing a radar sensor 2 at the front and the rear of the snow sweeping robot respectively to detect whether a creature suddenly approaches when the snow sweeping robot operates by the radar sensor.


(2) Processing signals detected by each of the ultrasonic sensors and each of the radar sensors, and calculating a forward distance of the snow sweeping robot, which includes the steps as follows.


a. Processing ranging data acquired by each of the ultrasonic sensors.


Performing recursive weighted average filtering on distance data acquired by each of the ultrasonic sensors within a time period Δt, expressed as follows for a kth time period Δt:







d
k

=








i
=
1

n



ρ
ki



d
ki


n





where dk represents a kth ultrasonic ranging result, dki represents a distance value obtained during ith detection within the kth time period Δt, ρki represents a weight value during the ith detection, and n represents a number of detected distance values whose reciprocal value is derived.


b. Processing the signals detected by each of the radar sensors.


Processing signal data acquired by each of the radar sensors within the kth time period Δt.







m
k

=

{




1
,

Signals


from


a


same


radar


sensor


are


received


twice


in



succession
.








0
,

Signals


from


a


same


radar


sensor


are


not


received


twice


in



succession
.











where mk represents a result obtained after the signal data acquired by each of the radar sensors within the kth time period Δt is processed.


c. Calculating the forward distance of the snow sweeping robot.


Performing amplitude-limiting filtering on a forward velocity of the snow sweeping robot within the kth time period Δt.







v
j

=

{





v
j

,







"\[LeftBracketingBar]"



v
j

-

v

j
-
1





"\[RightBracketingBar]"




v
res








v

j
-
1


,







"\[LeftBracketingBar]"



v
j

-

v

j
-
1





"\[RightBracketingBar]"


>

v
res













S
k

=







j
=
1

n



v
j


t





where νj represents a forward velocity of the snow sweeping robot converted from encoder data that detects a wheel velocity of the snow sweeping robot and is read for the jth time, νj−1 represents a forward velocity of the snow sweeping robot converted from encoder data that detects the wheel velocity of the snow sweeping robot and is read for the (j−1)th time, νres represents a maximum allowable deviation between the two velocities, Sk represents a forward distance of the snow sweeping robot within the kth time period Δt, n represents a number of times the encoder data of the snow sweeping robot is read within the time period Δt, and t represents a short time period.


(3) Detecting and recognizing the obstacle.


Assuming that dflag represents a standard safe distance, νflag represents a standard forward velocity of the snow sweeping robot, and νdiffer represents a threshold of a forward velocity difference of the snow sweeping robot.


Defining a descriptive statistic of a snow cover extent as follows:






x
=

α
v





where α represents a scale factor, and ν represents a forward velocity of the snow sweeping robot. In other words, the snow cover extent is inversely proportional to the forward velocity of the snow sweeping robot.


Defining a kth ultrasonic ranging variation as follows:








y
k

=




"\[LeftBracketingBar]"



d
k

-

d

k
-
1





"\[RightBracketingBar]"



Δ

t



,

k
=
2

,
3
,

4








Defining a kth ultrasonic ranging variation radio as follows:








β
k

=


y
k


y

k
-
1




,

k
=
2

,
3
,

4








Defining a kth variation ratio of the forward distance of the snow sweeping robot as follows:








ξ
k

=


S
k


S

k
-
1




,

k
=
2

,
3
,

4








Assuming that obstacle determining conditions are as follows:






{






Z
k

=


β
k


ξ
k









m
k

=

1


or


0





.





In a first situation, when any of the ultrasonic sensors has a detection distance d>dflag and |ν−νflag≤νdiffer, it is presumed that S1≈S2≈ . . . ≈Sk and the snow cover extent x is approximately constant, that is, the snow sweeping robot operates at a constant velocity in a section with a uniform snow cover extent. The obstacle determining conditions are degenerated as follows:






{





Z
k

=



β
k


ξ
k




β
k









m
k

=

1


or


0













if

0.95



Z
k




1
.
0


5


,

{







m
k

=
1

,

static


creature


obstacle









m
k

=
0

,

static


general


obstacle





;










if



Z
k





0
.
9


5


,

{







m
k

=
1

,

remote


creature


obstacle









m
k

=
0

,

remote


general


obstacle





;
or










if



Z
k





1
.
0


5


,

{







m
k

=
1

,

near


creature


obstacle









m
k

=
0

,

near


general


obstacle





.






In a second situation, when any of the ultrasonic sensors has a detection distance d>dflag and ν−νflagdiffer, it is presumed that Sk+1>Sk at a moment k+1, and Sk and yk at a moment k are the same as those at a previous moment k−1 at which the snow sweeping robot operates at a constant velocity. In this case, x increases, and it is presumed that the snow sweeping robot enters a section with a small snow cover extent. The obstacle determining conditions are as follows:






{





Z

k
+
1


=


β

k
+
1



ξ

k
+
1










m
k

=

1


or


0












Z

k
+
1


=



β

k
+
1



ξ

k
+
1



=




y

k
+
1


/

y
k




s

k
+
1


/

s
k



=



y

k
+
1



S

k
+
1







S
k


y
k


.








Focusing on a first fraction yk+1/Sk+1 because a second fraction change Sk/yk≈1 on the right-hand side of the equation. In this case, Sk+1 increases. The obstacle determining conditions are as follows:






{





Z

k
+
1





y

k
+
1



S

k
+
1










m

k
+
1


=

1


or


0













if

0.95



Z

k
+
1





1
.
0


5


,

{







m

k
+
1


=
1

,

static


creature


obstacle









m

k
+
1


=
0

,

static


general


obstacle





;










if



Z

k
+
1






0
.
9


5


,

{







m

k
+
1


=
1

,

remote


creature


obstacle









m

k
+
1


=
0

,

remote


general


obstacle





;
or










if



Z

k
+
1






1
.
0


5


,

{







m

k
+
1


=
1

,

near


creature


obstacle









m

k
+
1


=
0

,

near


general


obstacle





.






In a third situation, when any of the ultrasonic sensors has a detection distance d>dflag and ν−νflagdiffer, it is presumed that S2k+1<S2k at a moment 2k+1, and S2k and y2k at a moment 2k are the same as those at a previous moment 2k−1 at which the snow sweeping robot works at a constant velocity. In this case, x decreases, and it is presumed that the snow sweeping robot enters a section with a large snow cover extent. The obstacle determining conditions are as follows:






{





Z


2

k

+
1


=


β


2

k

+
1



ξ


2

k

+
1










m


2

k

+
1


=

1


or


0












Z


2

k

+
1


=



β


2

k

+
1



ξ


2

k

+
1



=




y


2

k

+
1


/

y

2

k





s


2

k

+
1


/

s

2

k




=



y


2

k

+
1



S


2

k

+
1







S

2

k



y

2

k



.








Mainly focusing on a first fraction y2k+1/S2k+1 because a second fraction change S2k/y2k≈1 on the right-hand side of the equation. In this case, S2k+1 decreases. The obstacle determining conditions are as follows:






{





Z


2

k

+
1





y


2

k

+
1



S


2

k

+
1










m


2

k

+
1


=

1


or


0













if

0.95



Z


2

k

+
1





1
.
0


5


,

{







m


2

k

+
1


=
1

,

static


creature


obstacle









m


2

k

+
1


=
0

,

static


general


obstacle





;










if



Z


2

k

+
1






0
.
9


5


,

{







m


2

k

+
1


=
1

,

remote


creature


obstacle









m


2

k

+
1


=
0

,

remote


general


obstacle





;
or










if



Z


2

k

+
1






1
.
0


5


,

{







m


2

k

+
1


=
1

,

near


creature


obstacle









m


2

k

+
1


=
0

,

near


general


obstacle





.






In conclusion, the intelligent snow sweeping robot can quickly and effectively detect and recognize obstacles in the three different situations according to the determining conditions in each of the situations.


The method for obstacle detection and recognition for an intelligent snow sweeping robot in the embodiments can determine a snow cover extent of a working road, quickly and effectively detect obstacles, and recognize the obstacles as general obstacles or creature obstacles when the snow sweeping robot autonomously operates. False detection can be prevented by multi-sensor fusion analysis which has good anti-interference. According to the present disclosure, a determining threshold and the number of measurements can be set through the field testing to meet an accuracy and a sensitivity of obstacle detection and recognition under different snow cover extents and achieve a good adaptability.


Finally, it should be noted that the above embodiment is only intended to explain, rather than to limit, the technical solution of the present disclosure. Although the present disclosure is described in detail with reference to the preferred embodiment, those ordinarily skilled in the art should understand that modifications or equivalent substitutions made to the technical solutions of the present disclosure without departing from a spirit and scope of the technical solution of the present disclosure should be included within the scope of the claims of the present disclosure.

Claims
  • 1. A method for obstacle detection and recognition for an intelligent snow sweeping robot, comprising the following steps: (1) disposing a first, second, and third ultrasonic sensor on a left side, middle, and a right side of a front end of the snow sweeping robot, respectively, to detect a distance between the snow sweeping robot and an obstacle ahead by the first, second, and third ultrasonic sensors; and sweeping robot operates at a constant velocity; and in this case, x increases, the snow sweeping robot enters a section with a small snow cover extent, and the obstacle determining conditions are as follows:
Priority Claims (1)
Number Date Country Kind
202011363678.8 Nov 2020 CN national
US Referenced Citations (1)
Number Name Date Kind
20230014948 Guan Jan 2023 A1
Foreign Referenced Citations (2)
Number Date Country
108852182 Nov 2018 CN
WO 2019104733 Jun 2019 WO
Related Publications (1)
Number Date Country
20220171395 A1 Jun 2022 US