The present disclosure generally relates to methodology and apparatus for complementary sequences, orthogonal frequency-division multiple (OFDM) access, over-the-air computation (OAC), power amplifier non-linearity, and/or wireless federated learning subject matter.
Multi-user interference is often considered an undesired situation as it can degrade the performance of communications. In contrast, the same underlying phenomenon, i.e., the signal superposition property of wireless multiple-access channels, can be very useful in the computation of special mathematical functions, i.e., the family of nomographic functions such as mean, norm, polynomial function, maximum, and majority vote (MV) [1]. The gain obtained with over-the-air computation (OAC) is that the resource usage can be reduced to a one-time cost, which otherwise scales with the number of nodes [2]. Hence, OAC can benefit applications when a large number of nodes participate in computation over a bandwidth-limited wireless channel.
OAC was first analyzed by Bobak and Gastpar [3] and applied to communication problems under interference channels and wireless sensor networks to improve spectrum utilization [4]. Recently, it has gained momentum for computation-oriented applications over wireless networks such as wireless federated learning or wireless control systems. For example, the authors in [5]-[8] implement federated learning (FL) [9] over a wireless network, where OAC is used for aggregating gradients or model parameters of neural networks. In [10], difference equations are proposed to be computed with OAC. In [11], dynamic plants are considered along with OAC. In [12], OAC is utilized to achieve mean consensus for vehicle platooning. In [13], multi-slot coherent OAC is investigated for an unmanned aerial vehicle (UAV) network, where the UAV s compute the arithmetic mean of ground sensor readings with OAC. Similarly, in [14], UAV trajectories are optimized based on the locations of the sensors.
However, a major difficulty for OAC is computing functions in fading channels, or, stated more particularly, computing functions in time-varying fading channels under power amplifier non-linearity.
To overcome fading channels, a large number of studies adopt pre-equalization techniques where the parameters are distorted with the reciprocals of the channel coefficients before the transmission so that the transmitted signals superpose coherently at the receiver [7], [8], [15]. Although this approach has its merit, it requires precise sample-level time synchronization as coherent signal superposition is sensitive to phase synchronization errors. Another issue is that OAC waveforms can have a high peak-to-average-power ratio and cause spectral growth, i.e., interference to adjacent channels in the RF spectrum.
Also, in [16], it is shown that non-stationary channel conditions particularly in a UAV network can severely degrade the coherent signal superposition. To relax this bottleneck, another approach is to use non-coherent techniques at the expense of sacrificing more resources. For instance, in [6] and [17], orthogonal resources are allocated and energy accumulation on the resources are used for OAC. In [18], random sequences are proposed to be utilized for OAC and the energy of the superposed sequences is calculated at the expense of interference components.
A major challenge with non-coherent OAC is that the reliability cannot be improved directly by increasing the signal power due to the lack of pre-equalization. Hence, non-coherent OAC requires more investigations for reducing computation errors.
The presently disclosed methodologies and corresponding and/or associated systems, including in some instances computer systems, generally relates to over-the-air computation (OAC) methodologies. More particularly, presently disclosed subject matter relates to non-coherent over-the-air computation (OAC) methodologies to calculate the majority vote (MV) reliably in fading channel.
In some instances, presently disclosed embodiments relate to methodology and apparatus for complementary sequences, orthogonal frequency-division multiple (OFDM) access, over-the-air computation (OAC), power amplifier non-linearity, and wireless federated learning subject matter.
The presently disclosed subject matter in some instances relies on modulating the amplitude of the elements of complementary sequences (CSs) based on the sign of the parameters to be aggregated. For presently disclosed embodiments not using channel state information at the nodes, they are compatible with time-varying channels.
For some particular embodiments, we show the efficacy of the presently disclosed subject matter for use in a scenario where an unmanned aerial vehicle (UAV) is guided by distributed sensors based on the MV computed with the disclosed methodology subject matter. For example, some embodiments may relate to majority vote computation with complementary sequences for distributed UAV guidance.
For some instances, we show that the disclosed subject matter improves the computation error rate with a longer sequence length in fading channel while maintaining the peak-to-mean-envelope power ratio of the transmitted orthogonal frequency division multiplexing signals to be less than or equal to 3 dB.
In some presently disclosed embodiments for addressing the difficulty that OAC is computing functions in time-varying fading channels under power amplifier non-linearity, the presently discloses non-coherent OAC methodology is based on complementary sequences (CSs). The disclosed approach improves the robustness of computation against fading channels while limiting the dynamic range of transmitted signals to mitigate the distortion, like clipping, due to hardware non-linearity. Since the disclosed approach does not rely on the availability of channel state information (CSI) at the transmitter and receiver, it also provides robustness against time-varying channels.
The market size for applications for the presently disclosed subject matter is relatively large as it is related to commercial wireless, control, and AI technologies. It could be useful, for example, for distributed control systems, massive numbers of robots, artificial intelligence technologies over wireless or sensor networks, 5G and beyond, 6G wireless standardization, and IEEE 802.11 Wi-Fi.
Potential competitive advantages of embodiments of presently disclosed subject matter may be several, including, for example, (1) reliable computation via bandwidth expansion without using the channel state information at the nodes, (2) low peak-to-mean-envelope-power ratio (maximum is 3 dB) to improve power efficiency (i.e., improved battery life or link distance), and (3) improved latency by computing via signal superposition.
Other example aspects of the present disclosure are directed to systems, apparatus, tangible, non-transitory computer-readable media, user interfaces, memory devices, and electronic devices for over-the-air computation (OAC) technology. To implement such systems, and methodology and technology herewith, one or more processors may be provided, programmed to perform the steps and functions as called for by the presently disclosed subject matter, as will be understood by those of ordinary skill in the art.
One exemplary embodiment disclosed herewith relates to an over-the-air computation (OAC) system for computation-oriented federated applications over wireless networks having a plurality of nodes. Such exemplary system preferably comprises one or more processors; and one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations. Such operations preferably comprise: transmitting local update vectors as votes from each respective of the plurality of nodes via a wireless multiple access channel, receiving the superposed local updates at at least one of the plurality of nodes, and determining the majority vote (MV) for each element of the update vector at the at least one node by non-coherent over-the-air computation (OAC) methodology to calculate the majority vote (MV) reliably in fading channels.
It is to be understood that the presently disclosed subject matter equally relates to associated and/or corresponding methodologies.
Another exemplary embodiment of presently disclosed subject matter relates to over-the-air computation (OAC) methodology for use on computation-oriented federated applications over wireless networks having a plurality of nodes. Such exemplary methodology preferably comprises providing one or more processors; and providing one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations. Such operations preferably comprise: transmitting local update vectors as votes from each respective of the plurality of nodes via a wireless multiple access channel, receiving the superposed local updates at at least one of the plurality of nodes, and determining the majority vote (MV) for each element of the update vector at the at least one node by non-coherent over-the-air computation (OAC) methodology to calculate the majority vote (MV) reliably in fading channels.
Additional objects and advantages of the presently disclosed subject matter are set forth in, or will be apparent to, those of ordinary skill in the art from the detailed description herein. Also, it should be further appreciated that modifications and variations to the specifically illustrated, referred and discussed features, elements, and steps hereof may be practiced in various embodiments, uses, and practices of the presently disclosed subject matter without departing from the spirit and scope of the subject matter. Variations may include, but are not limited to, substitution of equivalent means, features, or steps for those illustrated, referenced, or discussed, and the functional, operational, or positional reversal of various parts, features, steps, or the like.
Still further, it is to be understood that different embodiments, as well as different presently preferred embodiments, of the presently disclosed subject matter may include various combinations or configurations of presently disclosed features, steps, or elements, or their equivalents (including combinations of features, parts, or steps or configurations thereof not expressly shown in the figures or stated in the detailed description of such figures). Additional embodiments of the presently disclosed subject matter, not necessarily expressed in the summarized section, may include and incorporate various combinations of aspects of features, components, or steps referenced in the summarized objects above, and/or other features, components, or steps as otherwise discussed in this application. Those of ordinary skill in the art will better appreciate the features and aspects of such embodiments, and others, upon review of the remainder of the specification, and will appreciate that the presently disclosed subject matter applies equally to corresponding methodologies as associated with practice of any of the present exemplary devices, and vice versa.
These and other features, aspects and advantages of various embodiments will become better understood with reference to the following description and appended claims. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the related principles.
A full and enabling disclosure of the present subject matter, including the best mode thereof to one of ordinary skill in the art, is set forth more particularly in the remainder of the specification, including reference to the accompanying figures in which:
Repeat use of reference characters in the present specification and drawings is intended to represent the same or analogous features, elements, or steps of the presently disclosed subject matter.
Reference will now be made in detail to various embodiments of the disclosed subject matter, one or more examples of which are set forth below. Each embodiment is provided by way of explanation of the subject matter, not limitation thereof. In fact, it will be apparent to those skilled in the art that various modifications and variations may be made in the present disclosure without departing from the scope or spirit of the subject matter. For instance, features illustrated or described as part of one embodiment, may be used in another embodiment to yield a still further embodiment.
In general, the presently disclosed subject matter relates to methodology and apparatus for such as complementary sequences, orthogonal frequency-division multiple (OFDM) access, over-the-air computation (OAC), power amplifier non-linearity, and/or wireless federated learning subject matter.
In the present disclosure, we focus on computing MV which can be made compatible with digital modulation due to its discrete nature, and finds applications such as distributed training [6]-[8] and distributed localization [17]. We presently disclose a new noncoherent OAC methodology based on complementary sequences (CSs) [19] to improve the robustness of computation against fading channels while limiting the dynamic range of transmitted signals to mitigate the distortion, like clipping, due to hardware non-linearity. Since the disclosed approach does not rely on the availability of channel state information (CSI) at the transmitter and receiver, it also provides robustness against time-varying channels.
As opposed to earlier studies in [13], [14], [16], we demonstrate the applicability of the disclosed method to a scenario where, for example, a UAV is guided by distributed sensors based on MV computation.
Consider a scenario where a UAV flies from one point of interest (pi,1, pi,2, pi,3) to another point of interest (pt,1, pt,2, pt,3) in an indoor environment. Suppose that the UAV cannot localize its location in the room. However, it can receive feedback from K distributed sensors deployed in the room about the velocity of the UAV on x-, y-, and z-axis for every Tupdate seconds. Based on the feedback from the sensors, the UAV updates its position at round for the x-axis, y-axis, and z-axis, denoted by and respectively, as
where is the velocity at the round for nth coordinate, ulimit>0 is the maximum velocity of the UAV, μ>0 is the step size, is the velocity-update strategy given by
where =+ is the estimated position of the UAV for the nth coordinate at the kth sensor, is a zero-mean Gaussian variable with the variance σsensor2, ωn is the ideal MV function expressed as ωn=sign (Σk=1Kvk,n), for vk,n=sign (−pt,n) for n∈{1, 2, 3} and {circumflex over (ω)}n denotes the MV obtained with the presently disclosed OAC methodology.
Let a=(ai)i=0L−1™(a0, a1, . . . , aL−1) be a sequence of length L for ai∈ and aL−1≠0. We associate the sequence a with the polynomial A(z)=aL−1zL
If ρa(k)+ρb(k)=0 holds for k≠0, the sequences a and b are referred to as CSs. It can be shown the peak-to-mean envelope power ratio (PMEPR) of an orthogonal frequency division multiplexing (OFDM) symbol constructed based on a CS is less than or equal to 3 dB [20].
Let f(x) be a map from 2m={x≙(x1, x2, . . . , xm)|∀xj∈2} to as f:2m→, i.e., a pseudo-Boolean function. CSs can be obtained via pseudo-Boolean functions as follows:
Theorem 1 ([19]). Let π=(πn)n=1m be a permutation of {1, 2, . . . , m}. For any H, m∈+, an, a′∈, and cn, c′∈H for n∈{1, 2, . . . , m}, let
where yπ
is a CS of length L=2m, where i(x)Σj=1mxj2m-j, i.e., a decimal representation of the binary number constructed using all elements in the sequence x.
Theorem 1 shows that the functions that determine the amplitude and the phase of the elements of the CS t(i.e., fi(x) and fi(x)) and Reed-Muller (RM) codes have similar structures. The function fi(x) is in the form of the cosets of the first-order RM code within the second-order RM code [20]. Notice that the mapping between {(y1, . . . , ym)} and {(x1, . . . , xm)} is bijective and results in a Gray code when the elements of the set {(x1, . . . , xm)} is ordered lexicographically [19]. Hence, the function fr(x) is also similar to the first-order RM code, except that the operations occur in .
We assume that the sensors and the UAV are equipped with a single antenna. Let tk=(tk,0, . . . , tk,L−1) be a CS of length L transmitted from the kth sensor over an OFDM symbol by mapping its elements to a set of contiguous subcarriers. Assuming that all sensors access the wireless channel simultaneously and the cyclic prefix (CP) duration is larger than the sum of maximum time-synchronization error and maximum-excess delay of the channel, we can express the polynomial representation of the received sequence r=(r0, . . . , rL−1) at the UAV after the signal superposition as
where hk,i˜CN(0, 1) is the Rayleigh fading channel coefficient between the UAV and the kth sensor for the ith element of the sequence unless otherwise stated, Pk is the average transmit power, and wi˜CN(0, σnoise2) is the additive white Gaussian noise (AWGN). We assume that the average received signal powers of the sensors at the UAV are aligned with a power control mechanism. Without loss of generality, we set Pk, ∀k, to 1 Watt and calculate the signal-to-noise ratio (SNR) of a sensor at the UAV receiver as SNR=1/σnoise2.
Suppose that the fading coefficient hk,i is not available at the kth sensor or the UAV due to the synchronization impairments, reciprocity calibration errors, or mobility. Under this constraint, for n∈{1, . . . , m}, the main objective of the UAV is to compute the MV ωn, ∀n by exploiting the signal superposition property of the multiple-access channel (MAC), where vk,n∈{−1, 0, 1} is the kth sensor's vote for the nth MV computation and ωn∈{−1, 1} is the nth MV. It is worth emphasizing that the kth sensor does not participate in the MV computation for vk,n=0. Since we consider a single UAV in this disclosure, we set vk,n=0 for n∈{3, 4, . . . , m}. Note that, in the literature, it is shown that such absentee votes can be useful for distributed training for addressing heterogeneous data distribution [6].
Our main goal is to obtain a methodology that computes the MV s with a low computation error rate (CER) while maintaining the PMEPR of the transmitted signals as low as possible, where we define the CER as the probability of incorrect detection of the nth MV as Pr ({circumflex over (ω)}n≠ωn). Although the CSs generated with Theorem 1 can address the PMEPR challenge by keeping it at most 3 dB, it is not trivial to use them for the MV computation. Therefore, the question that we address is how can we use Theorem 1 to develop a reliable OAC methodology for computing MV without using the CSI at the sensors and the UAV?
The disclosed methodology modulates the amplitude of the elements of the CS via fr(x) as a function of the votes vk≙(vk,1, . . . , vk,m) at the kth sensor. To this end, based on Theorem 1, let us denote the functions used at kth sensor as fr,k (x) and fi,k (x), and their parameters as {a′k, ak,1, . . . , ak,m} and {c′k, ck,1, . . . , ck,m}, respectively. To synthesize the transmitted sequence tk of length L=2m, we use a fixed permutation π and map vk,n to ak,n as
where α>0 is a scaling parameter. To ensure that the squared -norm of the CS tk is 2m, i.e., ∥tk∥22=2m, we choose a′k as
To derive (8), notice that ak,n scales 2m−1 elements of the CS by ea
With (7) and (8), if vk,n≠0 for α→∞, one half of elements (i.e., the ones for yπ
Example 1. Let π=(3, 2, 1), H=2, m=3, cn=c′=0, ∀n. Hence, the indices of the scaled elements are controlled by y1=x1, y2=(x1+x2)2, and y3=(x2+x3)2 when (x1, x2, x3) is listed in lexicographic order, i.e., (0, 0, 0), (0, 0, 1), . . . , (1, 1, 1).
For the disclosed methodology, the values for c′k, ck,1, . . . , ck,m are chosen randomly from the set H for the randomization of tk across the sensors. This choice is also in line with the cases where phase synchronization cannot be maintained in the network.
Based on (6), the received sequence at the UAV after signal superposition can be expressed as
To compute the nth MV, the UAV calculates two metrics given by
It then detects the nth MV by comparing the values of En+and En−as
We discuss how (10) allow the UAV to detect the correct MV in the average sense in the following subsection.
Let K+n, K−n, and K0n be the number of sensors with positive, negative, and zero votes for nth MV computation, respectively.
Lemma 1. [En+] and [En−] can be calculated as
respectively, where the expectation is over the distribution of channel and noise.
To prove Lemma 1, we first need the following proposition:
Proposition 1. The following identities hold:
Proof of Proposition 1. The first identity is because e2a
Proof of Lemma 1. By using Proposition 1, we can calculate [En+] and [En−] as
Without any concern about the norm of the transmitted sequence tk with (8), we can choose an arbitrarily large value for α. We can then use the following corollary:
Since limα→∞[En+−En−]=2m−1(Kn+−Kn−) holds, we can infer that the detector in (10) detects the correct MV in average for α→∞. In other words, although the disclosed methodology makes errors instantaneously, in average, the error is centered around the correct MV.
The disclosed methodology computes m MVs over 2m complex-valued resources. Hence, the number of functions computed per channel use (in real dimension) can be expressed as =m/2m+1. Hence, for a larger m, the computation rate reduces, but the CER improves significantly as demonstrated in Section IV.
In this section, we first analyze the performance of the methodology for an arbitrary application. Subsequently, we then apply it to the scenario discussed in Section II.
Stated another way,
In
In
In
In particular,
We assume Tupdate=10 ms, μ=2, ulimit=3 m/s, σsensor 2=2, and SNR=10 dB. We provide the trajectory of the UAV in time and space for the aforementioned waypoint flight control scenario. We consider two cases. In the first case (
As can be seen from
The position of the UAV in time and space for multiple points of interest is given in
In at least one exemplary aspect of some embodiments of this disclosure, we modulate the amplitude of the CS based on Theorem 1 to develop a new non-coherent OAC methodology for MV computation. We show that the disclosed methodology reduces the computation error rate via bandwidth expansion in both flat-fading and frequency-selective fading channel conditions while maintaining the PMEPR of the transmitted signals to be less than or equal to 3 dB. We demonstrate the applicability of the disclosed OAC methodology to an indoor distributed flight control scenario and show that the disclosed methodology performs similar to the case where MV without OAC with larger length of sequences. In the future work, we provide the theoretical computation error and convergence analyses for distributed UAV guidance.
This written description uses examples to disclose the presently disclosed subject matter, including the best mode, and also to enable any person skilled in the art to practice the presently disclosed subject matter, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the presently disclosed subject matter is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they include structural and/or step elements that do not differ from the literal language of the claims, or if they include equivalent structural and/or elements with insubstantial differences from the literal languages of the claims. In any event, while certain embodiments of the disclosed subject matter have been described using specific terms, such description is for illustrative purposes only, and it is to be understood that changes and variations may be made without departing from the spirit or scope of the subject matter. Also, for purposes of the present disclosure, the terms “a” or “an” entity or object refers to one or more of such entity or object. Accordingly, the terms “a”, “an”, “one or more,” and “at least one” can be used interchangeably herein.
The present application claims the benefit of priority of U.S. Provisional Patent Application No. 63/503,243, filed May 19, 2023, and the benefit of priority of U.S. Provisional Patent Application No. 63/560,258, filed Mar. 1, 2024, both of which are titled Wireless Majority Vote Computation With Complementary Sequences For Distributed Guidance, and both of which are fully incorporated herein by reference and for all purposes.
Number | Date | Country | |
---|---|---|---|
63560258 | Mar 2024 | US | |
63503243 | May 2023 | US |