This is a U.S. national stage application of PCT Application No. PCT/CN2023/077586 under 35 U.S.C. 371, filed Feb. 22, 2023 in Chinese, claiming priority of Chinese Application No. 202210994286.4, filed Aug. 17, 2022, all of which are hereby incorporated by reference.
The present invention belongs to the technical field of load balancing on edge computing network, in particular to a fair task offloading and migration method for edge service networks.
In recent years, with the increasing popularity of edge computing technology, the user computing load offloading and migration technology has developed rapidly. However, server resources and link resources in the edge environment are often scarce, resulting in servers in the edge environment may not be able to support all current service types; due to the limited variety of services deployed on the server, some user tasks require migration through the current server to be executed on other servers. In response to the mobility of users and the diversity of server requests in edge network environments, and the limited computing resources of edge servers in the region, it is worth researching how to reasonably allocate different computing resources and network bandwidth resources to different users based on fair execution of these user computing offloading loads, in order to ensure that the service experience of all users reaches a fair state.
Each user has personalized needs, such as bandwidth sensitive tasks (such as live streaming services, video on demand services, etc.), and computing sensitive tasks (such as AI algorithm calculation tasks, virtual reality graphics rendering tasks, etc.); the existing research on service algorithms of edge computing networks for real-time task response needs mostly focuses on the overall efficiency of tasks, from the perspective of network bandwidth and server resource utilization, it is relatively rare to consider Pareto solutions for the utility needs of multiple different user individuals. Due to the marginal effect of the user utility function, allocating different types and quantities of resources to users may not necessarily achieve the highest overall utility for a single user; in addition, in an edge network environment with limited overall resources, there are resource allocation conflicts among multiple users, which makes it difficult to fully meet the personalized needs of users and achieve Pareto optimization solutions. In the edge network environment shown in
Reference [Yao Zewei, Lin Jiawen, Hu Junqin, et al. PSO-GA Based Approach to Multi-edge Load Balancing [J]. Computer Science, 2021, 48(S02):8] proposed a method for balancing edge environment load, with the goal of minimizing the maximum response time of user tasks, using heuristic algorithms to make decisions on user tasks, so that multiple user tasks are assigned to different servers for execution. Reference [Liang Bing, Ji Wen. Multiuser computation offloading for edge-cloud collaboration using submodular optimization[J]. Journal on Communications, 2020, 41 (10): 12] proposed the problem of maximizing the user's utility function, which simply adds and sums the user's utility, with the goal of maximizing the efficiency of all tasks and scheduling user tasks for execution. The above two strategies cannot guarantee that all users' tasks are executed fairly, and may result in sacrificing the quality of service of certain individual users for improving overall performance, resulting in excessive execution time of certain user tasks or a decrease in user's utility function.
In response to the marginal effect of resources demand for users and the nonlinear conflict of resources allocation, the present invention provides a fair task offloading and migration method for edge service networks under network operation, which can greatly improve the overall utility requirements of all users and achieve Pareto optimality for all users in edge network environments with limited resources.
A fair task offloading and migration method for edge service networks, comprising the following steps:
Furthermore, for any user task request in step (2), the following three types of migration paths are enumerated:
Furthermore, an expression of the fair utility evaluation function is as follows:
Each edge server can perform several services, and each user can only perform one service.
Furthermore, the specific process of optimizing and solving the fair utility evaluation function in step (4) is as follows:
Furthermore, the information of the edges comprises the bandwidth occupied by each user task request on the transmission links between the mobile users and the edge servers, as well as the actual bandwidth upper limit of the transmission links; the information of the nodes comprises the amount of computing resources required for user task requests and the actual maximum computing power of the edge servers.
Furthermore, the task feasible migration path subgraph corresponds one-to-one with the user task requests, which is composed of all user task migration paths corresponding to the request, the user task migration path represents a specific migration path used by the user task request to perform offloading.
Furthermore, the parameters θuser i of the user decision model are optimized and solved through a reward function;
Furthermore, the parameters of the user shared neural network layer are iterated through the following formula until the utility function of all user task requests reaches Pareto optimality;
Furthermore, the weight value αi is obtained by solving the following loss function by using the Frank Wolfe algorithm;
Furthermore, in step 4.6, for the selected probabilities of all migration paths requested by any user task, the highest of the first K selected probabilities is averaged as the priority for offloading the user task request, the migration path corresponding to the highest selected probability is taken as the offloading migration path by the user task request, with K being a natural number greater than 1.
The present invention takes the Pareto optimality of the utility function of all user tasks executed by the edge system as the optimization objective, this approach not only takes into account the constraints of edge network resources, but also ensures the maximization of the utility function of all user tasks in the system, it proposes a new quantitative measurement index for improving the task utility quality under multi-user competition. In addition, the present invention uses the graph neural network and reinforcement learning algorithm to solve the final optimization goal, this algorithm has high execution efficiency and returns accurate approximate results, which is particularly suitable for the scene of edge network system under multi-user complex tasks, so that when multi-user tasks compete for network resources, the edge computing network system can efficiently obtain the Pareto optimal result of multi-user utility function, greatly improving the service quality and user experience of edge network environments.
In order to provide a more specific description of the present invention, the following will provide a detailed explanation of the technical solution of the present invention in conjunction with the accompanying drawings and specific implementation methods.
A fair task offloading and migration method for edge service networks of the present invention, comprising the following steps:
As shown in
(4) optimizing and solving the fair utility evaluation function, the migration path for each user task request can be determined, the specific implementation is as follows:
We define the server computing load as: Σi∈jworkloadi,j+(workloadjin−workloadjout), where j represents the set of users connected by server j, workloadi,j represents the amount of tasks unloaded by user i to server j, workloadjin represents the amount of tasks transferred by other servers to server j, and workloadjout represents the amount of tasks transferred by server j to other servers.
Task offloading refers to the ability of users to send tasks to designated edge servers for execution within the service scope of the edge server; task migration refers to the migration of user task to an edge server other than themselves after offloading the destination server and transferring the task from one edge server to another; through the above task offloading and task migration, computing tasks of the users can ultimately reach a certain server for task execution.
The above task transmission path search algorithm is as follows: firstly, i represents the user index, m represents the server index, defined Sm as the set of adjacent servers within one hop of server m, defined Oic as the set of servers that cover service scope of user i, and the set of server indexes that can execute user i's tasks is Oie, then Oic-e=Oic\Oie represents servers that is directly connected to the user, but cannot execute the tasks submitted by user i. Using Oice=Oic∩Oie represents servers that is directly connected to the user i, and the servers are capable of performing tasks offloaded by user i.
Adding the direct link between the server and the user in Oice to the set Eidirect, traversing the server index of Oic-e, and recording as z, defining a set E1migration=z×Sz∩Oie; traversing the server index of Oice, and recording as j, defining a set E2migration=j×Sj∩Oie.
The first part of the migration link set (the paths composed of user nodes and the first server nodes that cannot perform tasks, as well as a server node with task services) is E1migration the second part of the migration link set (the paths composed of user nodes and server nodes that can perform services). From the above steps, the migration path set that user i can perform task transmission is: Eidirect∪E1migration∪E2migration.
Decomposing the feasible connection graph of each user (i.e.
The following is a detailed description of two types of embedding encoding information for the edge server network system, including embedding encoding information for each element node in the user feasible migration subgraph and embedding encoding information for each element node in the edge network global graph.
Embedding encoding information for feasible migration subgraphs for user i:
The set of all links in the feasible migration subgraph for user i is , the set of servers is φ, and the feature vectors of user nodes in the migration path are ui; the feature vector feal=[ol1, ol2, . . . , ol|
For global edge network embedding encoding information:
The feature vector of the link l is feal=[ol1, ol2, . . . , ol||], oln, n∈ represents the bandwidth resources occupied by the user n on the link l. The feature vector of the server c is feac=[pc1, pc2, . . . , pc||], pcn(n∈) represents the computational resources occupied by user n on the server c. Using the graph neural network f( ) to calculate the embedding encoding information [
Embedding encoding information after CNN network aggregation:
The input of the CNN network is the [
Using Ri=[ei1, ei2, . . . , eis, . . . , ei|
esi=[
As shown in
We aim to maximize fairness for all users, and in the design of the present invention, the system uses the fair utility function value generated by the decision as the evaluation criterion; after the system makes a decision, if all users' fair utility can increase, the system reward function value is (Ui(t+1)−Ui(t))*η, which η is a constant, otherwise, the reward function value for the user is 0. The system is modeled by maximizing the reward function value as a reward in the reinforcement learning model.
The specific description of the system reward function is:
The goal of the reinforcement learning algorithm of the present invention is to maximize the reward function. The system uses the policy gradient method to train the offloading and transfer decisions of user tasks, and defines the parameters in the user decision model neural network as θuser i. So policy represents the probability that the system will take action at during the state st, with a value of πθuser i(st, at), where action refers to the server selection and migration path selection for the system to offload user tasks. In the operation of the system, each user decision model adopts a formula to update the neural network parameters θuser i of the decision model:
α represents a customized learning rate parameter, and bt represents a benchmark value bt=Σt′∈trt′ defined to reduce the average user reward generated by the decision.
The above reinforcement learning algorithm ensures the maximum fair utility function value for all users, but cannot guarantee that the utility of each user is the fairest state; in order to obtain Pareto optimality for all users, the present invention proposes a Pareto fairness algorithm for calculating neural network parameters. As shown in
The set of migration paths for user feasible task transmission is defined as Ei=Eidirect∪E1migration∪E1migration, where the elements of the output vector of the neural network system shown in
The present invention designs an optimal sorting function tpk(X)=X/k, which returns the average value of the largest first k components in the input vector, defining the user who prioritizes the task migration path in each iteration of the system as i*=argmaxi{V1, V2, . . . , Vn}, V=[tpk(Z1), tpk(Z2), tpk(Z3), . . . , tpk(ZN)]. Once the user is selected, the system assigns the optimal task migration path to them, using the largest component k=argmaxk{Zik} in each user's decision vector as the final selected task migration path index for each user, selecting the k-th migration path in the set Ei of migration paths for user i's task transmission.
Under the constraint conditions Σiε
According to the neural network algorithm framework shown in
The above description of the embodiments is for the convenience of ordinary technical personnel in the art to understand and apply the present invention. Those familiar with the art can clearly make various modifications to the above embodiments and apply the general principles explained here to other embodiments without the need for creative labor. Therefore, the present invention is not limited to the aforementioned embodiments. According to the disclosure of the present invention, the improvements and modifications made by those skilled in the art should be within the scope of protection of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
202210994286.4 | Aug 2022 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2023/077586 | 2/22/2023 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2024/036909 | 2/22/2024 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20200401938 | Etkin et al. | Dec 2020 | A1 |
Number | Date | Country |
---|---|---|
109362087 | Feb 2019 | CN |
110062026 | Jul 2019 | CN |
111148174 | May 2020 | CN |
Number | Date | Country | |
---|---|---|---|
20240264883 A1 | Aug 2024 | US |