The present invention claims priority under 35 U.S.C. 119(a-d) to CN 201810026713.3, filed Jan. 11, 2018.
The present invention relates to a UAV autonomous swarm formation rotation control method based on a simulated migratory bird evolutionary snowdrift game, belonging to a technical field of UAV control.
Unmanned Aerial Vehicle (UAV) is a powered aircraft that does not carry an operator, uses aerodynamics to provide lift, can fly autonomously or remotely, can be used once and can be recycled, and carries deadly or non-fatal payloads. It has the basic attributes of “unmanned platform and manned system,” and has broad application prospects in military and civilian fields.
The increased onboard capacity of the UAV has changed the mission execution mode thereof. In the conventional mission execution mode, UAVs typically perform long-range missions by refueling in the air. In the changed mission execution mode, the UAVs will perform long-distance tasks in the form of swarms, which are delivered and recycled by the host. Since the host cannot reach the mission area under normal circumstances for avoiding loss, the UAV swarm needs to have strong endurance. The formation of the UAV swarm enables the wing UAV in the swarm to effectively utilize the wake of the leader to reduce drag, save fuel, and extend range. However, the leading UAV of the swarm cannot use the wake of any UAV, so its range is not extended. Therefore, the UAV swarm formation does not extend the overall range of the UAV swarm. Only through UAV swarm formation rotation, which means the UAVs of the swarm take turns to act as the leading UAV, can the overall range of the UAV swarm be effectively extended. That is to say, the design of a reasonable and effective UAV autonomous swarm formation rotation control method is vital. The present invention aims to improve the formation control level of the UAV autonomous swarm by designing a UAV autonomous swarm formation rotation control method, so that the UAVs can perform the long-distance task with a lower fuel configuration.
Conventionally, the common method of UAV swarm rotation is mainly cyclical method, namely when a certain UAV in the swarm consumes the prescribed fuel as a leading UAV, UAVs in the swarm moves in a clockwise or counterclockwise direction to act as a leading UAV the swarm in turn. Although this method is simple and easy, it has drawbacks as follows. Firstly, when a UAV in the UAV swarm fails, the method cannot continue to execute, so the robustness is poor. Secondly, the method is not applicable to unconventional swarm formation except V formation and echelon formation. Besides, when the UAV fuel distribution in the UAV swarm is uneven, the method is not reasonable and the adaptability is insufficient. Aiming at the lack of autonomous abilities of the conventional UAV swarm formation rotation method in terms of robustness and adaptability, the present invention simulates migratory behavior of migratory birds, and designs a distributed UAV autonomous swarm formation rotation control method based on an evolutionary snowdrift game.
In order to save energy and increase chances of survival, migratory birds usually migrate in a tight linear formation, and there are positional rotation cooperative behaviors. Regardless of their internal kinship, the migratory birds in the swarm have roughly the same leading and following time, which means all individuals have the opportunity to fly in the wakes of other individuals, and are willing to sacrifice their own interests to become the general leader. This rotation of migratory birds is consistent with the payoff structure of the snowdrift game. When two individuals meet, each individual has two choices: leading (cooperation) or following (defection). If both choose to cooperate, they will both get the benefits, but at the same time bear the cost. If both choose to defect, the gain is zero. If one individual cooperates and the other defects, the defector gains more payoff than the cooperator. There is a similarity in the payoff structure between the UAV swarm formation rotation problem and the migratory bird general leader rotation problem. In addition, the UAV has limited intelligence and the environment is complex, so the individual cannot immediately obtain the current best strategy, which is in line with consideration of the limitations of individual intelligence in the evolutionary game. Individuals in the evolutionary game follow the simple rules to update the strategy and finally reach the evolutionarily stable strategy. In summary, the present invention proposes a UAV autonomous swarm formation rotation control method based on a simulated migratory bird evolutionary snowdrift game to overcome the deficiency of robustness and adaptability of the conventional UAV swarm formation rotation control method, which effectively improves the formation control level of the UAV autonomous swarm.
The present invention provides a UAV autonomous swarm formation rotation control method based on a simulated migratory bird evolutionary snowdrift game. An object of the present invention is to provide a distributed UAV autonomous swarm formation rotation control method, so as to improve robustness and adaptability of the UAV in autonomous swarm formation rotation, thus effectively improving long-range mission execution capability of the UAV.
Accordingly, in order to accomplish the above objects, the present invention provides a UAV autonomous swarm formation rotation control method based on a simulated migratory bird evolutionary snowdrift game as shown in
Step 1: initializing:
randomly generating initial states of N UAVs, comprising a position Pi, a horizontal speed Vi, and a heading angle ψi, wherein i is a UAV index, Pi=(Xi, Yi), Xi and Yi are respectively the horizontal coordinate and the vertical coordinate of the UAV i in the ground coordinate system; setting the index of the leader of each UAV to Nleadi=0, setting current simulation time to t=0, setting a simulation counter to n=1, setting a rotation counter to Count=1, and setting a game counter to ni=0; wherein only when no UAV j satisfies Xj≥Xi and Yj≥Yi, the flight mode identifier Flagleadi(n) of UAV i is 1, the strategy S″(n) of UAV i is 1, and the reverse strategy Srj(n) of UAV i is 0; otherwise, the flight mode identifier Flagleadi(n) is 0, the strategy Si(n) is 0, and the reverse strategy Sri(n) is 1;
Step 2: determining flight mode based on a migratory bird evolutionary snowdrift game:
wherein if the simulation counter n>1 and the Count is less than a maximum limit Countmax of the rotation counter, then the rotation counter is increased by one, and the strategy, the reverse strategy and the flight mode identifier remain unchanged, which are Count=Count+1, Si(n)=Si(n−1), Sri(n)=Sri(n−1), Flagleadi(n)=Flagleadi(n−1), and a Step 3 is executed;
wherein if Count=Countmax, then the rotation counter is set to one, the neighbor strategy set Sn of UAV i is cleared, and the game counter is increased by one, which are Count=1, Sni=Ø, n1=nn+1; only when no UAV j satisfies Xj≥Xi and Yj≥Yi, the strategy Sd(n) is 0, the reverse strategy Sri(n) is 1, the memory strategy Smd(n1) of UAV i is 0, and the flight mode identifier Flagleadi(n) is 0, then a Step 4 is executed; otherwise, a swarm consisting of the N UAVs is treated as a migratory bird flock, wherein a UAV i is a migratory bird i, the leader Nleadj of the UAV i is the leader Nleadj of the migratory bird i, the strategy Si (n) and the reverse strategy Sri (n) of the UAV i are respectively the strategy Si(n) and the reverse strategy Sri(n) of the migratory bird i in an evolutionary snowdrift game;
wherein if there is a migratory bird j satisfies Nleadj=i, the strategy of the migratory bird j is stored in a neighbor strategy set of the migratory bird i, which is Sj (n) ∈Sni, if the migratory bird i has a leader, which is Nleadi≠0, the strategy of the migratory bird Nleadi is stored in the neighbor strategy set of the migratory bird i, which is SNi
wherein r1 is a benefit coefficient of a non-cooperator encountering cooperators, r2 is a cost coefficient of a cooperator encountering cooperators; virtual snowdrift game payoff Bri of the migratory bird i is calculated according to the reverse strategy Sri(n) and the neighbor strategy Sni of the migratory bird i:
calculating the memory strategy Smi(n1) of the migratory bird i according to the real snowdrift game payoff Bi and the virtual snowdrift game payoff Bri of the migratory bird i:
generating a selection probability pg of snowdrift game strategies based on the memory strategy Smi of the migratory bird i:
wherein Lm is the memory length of the snowdrift game; a random number rand is randomly generated, and the strategy Si(n) and the reverse strategy Sri(n) of the migratory bird i are generated according to the selection probability pg of the snowdrift game strategies of the migratory bird i:
updating the flight mode identifier Flagleadi(n) of the UAV i based on the strategy Si(n) of the migratory bird i:
Step 3: determining the leader and its position relative to corresponding wing UAV:
wherein if the flight mode identifier Flagleadi(n) is 0, the UAV i is in a wing UAV mode, which selects a nearest front UAV as the leader; if there are more than one options, the UAV i selects a UAV with a smallest index as the leader; which means only when Xj>Xi and there is no UAV j′ satisfies Xj′>Xi and a Rij′<Rij, or satisfies Xj′>Xi, Rij′=Rij and j′<j, there is Nleadi=j, wherein Rij=√{square root over ((Xi−Xj)2+(Yi−Yj)2)} is the distance between the UAV i and the UAV j; if there is no front UAV, the UAV i in the wing UAV mode selects a nearest UAV as the leader; if there are more than one options, the UAV i selects the UAV with the smallest index as the leader; which means only when there is no UAV j′ satisfies Xj′>Xi and there is no UAVj″ satisfies Rij″<Rij, or satisfies Rij″=Rij and j″<j, there is Nleadi=j, according to current positions of the UAV i and the corresponding leader Nleadi, an expected forward position
wherein xexp and yexp are respectively the expected forward distance and the expected lateral distance, YNi
Step 4: finning UAV model:
wherein if the flight mode identifier Flagleadi(n) is 1, the UAV i is in a leading UAV mode; the UAV state at next simulation time is obtained according to a leading UAV model:
wherein {dot over (X)}i, {dot over (Y)}i, {dot over (V)}i and {dot over (ψ)}i are respectively first-order differentials of the horizontal coordinate, the vertical coordinate, the speed, and the heading angle of the UAV i in the ground coordinate system; τV and τψ are respectively time constants of a Mach-hold autopilot and a heading-hold autopilot; the Mach-hold autopilot control input VL
wherein XNi
and the heading-hold autopilot control input of the wing UAV is
(kx
Step 5: determining whether to end simulation:
wherein the simulation time is t=t+ts, and is is a sampling time; if t is greater than a maximum simulation time Tmax, the simulation ends; then a UAV swarm flight trajectory, UAV swarm formations at each rotation time, a UAV swarm horizontal speed curve and a UAV swarm heading angle curve are drawn; otherwise, the simulation returns to the Step 2.
The present invention provides a UAV autonomous swarm formation rotation control method based on a simulated migratory bird evolutionary snowdrift game. The method is a distributed control method based on the evolutionary snowdrift game, which simulates migration of migratory birds. The main advantages are mainly reflected in two aspects: first, the method simulates local interaction of migratory birds, so as to generate a UAV swarm formation rotation strategy based only on recent history information of the UAVs and neighbors within a small range, which reduces onboard computing and communication load; second, the method inherits environmental adaptability characteristics of the migratory birds during migration, wherein operation process does not depend on UAV swarm formation and overall fuel configuration, which can cope with sudden failures, and has strong adaptability as well as robustness, thus effectively improving UAV autonomous swarm formation capability.
Referring to
Step 1: initializing:
randomly generating initial states of 5 UAVs, comprising positions P1 to P5 of (12.5926 m, 7.1515 m), (13.1907 m, 3.2101 m), (1.4969 m, −3.1140 m), (3.0873 m, 3.5804 m) and (0.5687 m, −5.9005 m) , a horizontal speed Vi of 42 m/s and a heading angle ψi of 0, wherein i=1,2, . . . , 5; setting the index of the leader of each UAV to Nleadi=0, setting current simulation time to t=0, setting a simulation counter to n=1, setting a rotation counter to Count=1, and setting a game counter to n1=0, wherein i=1,2, . . . , 5, in the embodiment, only when no UAV j satisfies Xj≥X2=13.1907 m and Yj≥Y2=3.2101 m, the flight mode identifier Flaglead2(n) is 1, the strategy S2(n) is 1, and the reverse strategy Sr2(n) is 0; otherwise, the flight mode identifiers Flagleadi(n) of the UAVs 1 and 3-5 are 0, the strategy Si(n) is 0, and the reverse strategy Sri(n) is 1, wherein i=1,3,4,5;
Step 2: determining flight mode based on a migratory bird evolutionary to snowdrift game:
wherein if the simulation counter n>1 and the Count is less than a maximum limit Countsmax=300 of the rotation counter, then the rotation counter is increased by one, and the strategy, the reverse strategy and the flight mode identifier remain unchanged, which are Count=Count+1, Si(n)=Si(n−1), Sri(n)=Sri(n−1), Flagleadi(n)=Flagleadi(n−1), and a Step 3 is executed; w/herein i=1,2, . . . , 5; if Count=300, then the rotation counter is set to one, the neighbor strategy set Sni of UAV i is cleared, and the game counter is increased by one, which are Count=1, Sni=Ø, n1=n1+1; only when no UAV j satisfies Xj≥Xiand Yj≥Yi, the strategy Si(n) is 0, the reverse strategy Sid(n) is 1, the memory strategy Smi(n1) of UAV i is 0, and the flight mode identifier Flagleadi(n) is 0, then a Step 4 is executed; otherwise, a swarm consisting of the N UAVs is treated as a migratory bird flock, wherein a UAV i is a migratory bird i, the leader of the Nleadj of the UAV i is the leader Nleadj of the migratory bird i, the strategy Ss(n) and the reverse strategy Srj(n) of the UAV i are respectively the strategy Sd(n) and the reverse strategy Sri(n) of the migratory bird i in an evolutionary snowdrift game; wherein if there is a migratory bird j satisfies Nleadj=i, the strategy of the migratory bird j is stored in a neighbor strategy set of the migratory bird i, which is Sj(n) ∈Sni, if the migratory bird i has a leader, which is Nleadj16 0, the strategy of the migratory bird Nleadi is stored in the neighbor strategy set of the migratory bird i, which is SNi
Step 3: determining the leader and its position relative to corresponding wing UAV:
wherein if the flight mode identifier Flagleadi(n) is 0, the UAV i is in a wing UAV mode, which selects a nearest front UAV as the leader; if there are more than one options, the UAV i selects a UAV with a smallest index as the leader; which means only when Xj>Xi and there is no UAV j′ satisfies Xj′>Xi and Rij′<Rij, or satisfies Xj′>Xi, Rij′=Rij and j′<j, there is Nleadi=j, wherein Rij=√{square root over ((Xi−Xj)2+(Yi−Yj)2)} is the distance between the UAV i and the UAV j; if there is no front UAV, the UAV i in the wing UAV mode selects a nearest UAV as the leader; if there are more than one options the UAV i selects the UAV with the smallest index as the leader; which means only when there is no UAV j′ satisfies Xj′>Xi and there is no UAV j″ satisfies Rij″<Rij, or satisfies and Rij″=Rij and j″<j, there is Nleadi=j, according to current positions of the UAV i and the corresponding lead Nleadi, an expected forward position
Step 4: finning UAV model:
wherein if the flight mode identifier Flagleadi(n) is 1, the UAV i is in a leading UAV mode; the UAV state at a next simulation time is obtained with an equation (10) according to a leading UAV model; wherein τr=10 s and τψ=1.5 s are respectively time constants of a Mach-hold autopilot and a heading-hold autopilot: Vexp=42 m/s and ψexp=0 are respectively the expected horizontal speed and the expected heading angle of the leading UAV; if the flight mode identifier Flagleadi(n) is 0, the UAV state at next simulation time is obtained with an equation (11) according to a wing UAV model; wherein (kx
Step 5: determining whether to end simulation:
wherein the simulation time is t=t+ts, and ts=0.01 s is a sampling time; if t is greater than a maximum simulation time Tmax=12 s , the simulation ends; then simulation results are drawn; otherwise, the simulation returns to the Step 2.
Number | Date | Country | Kind |
---|---|---|---|
201810026713.3 | Jan 2018 | CN | national |