The present disclosure relates to a transmission apparatus, a transmission method, a control circuit, and a storage medium for multiplexing and transmitting signals.
There has been a communication system in which a transmission apparatus multiplexes and transmits signals that have undergone spread processing using a spreading sequence, and a reception apparatus despreads the received signals to obtain the original signal. This technique is used in, for example, transmission apparatuses installed in a satellite that transmits a positioning signal and the like.
For satellite communication systems, downsizing and lower power consumption of satellites are important challenges. To solve the challenges, it is effective to multiplex a plurality of signals, amplify the resultant multiplex signal by a common amplifier, and transmit the amplified signal from an antenna. Amplifier efficiency increases with increase in signal level of an input signal, and becomes a maximum when the amplifier reaches or significantly approaches saturation. However, at an operating point near the saturation point, the saturation of the amplifier causes clipping of a signal waveform, and greatly degrades linearity. Therefore, in order to use the amplifier to amplify a multiplex signal into which two or more signals have been multiplexed, it is required to keep the peak-to-average power ratio (PAPR) of a transmission signal of the multiplex signal low.
As the digitalization of satellite-mounted systems proceeds, it can be considered that a signal generation unit that has been configured with an analog circuit so far is configured with a digital circuit. In this case, possible scenarios include a scenario to change signal specification in the process of actual operation. To this end, multiplexing circuits for multiplexing signals are required to have high versatility such that the circuits can be adapted to these scenarios. For example, when the transmission power ratio or the modulation scheme itself of signals to be multiplexed is changed after the satellite is launched, operating parameters of the multiplexing circuit need to be reset according to the changed transmission power ratio or modulation scheme of the signals to be multiplexed.
Non Patent Literature 1, ‘M. Kim, W. Lee, D. H. Cho, “A Novel PAPR Reduction Scheme for OFDM System Based on Deep Learning”, IEEE COMMUNICATIONS LETTERS, VOL. 22, NO. 3, pp. 510-513, March 2018’ relates to an Orthogonal Frequency Division Multiplexing (OFDM) modulation scheme, which describes a method of evaluating and determining operating parameters of a multiplexing circuit that multiplexes subcarrier signals, using machine learning. According to the above Non Patent Literature 1, the multiplexing circuit is configured with a neural network (NN). Then, by performing learning of the NN so as to minimize the sum of the PAPR and the bit error ratio (BER) that are evaluation functions, OFDM signals having low PAPR characteristics and good BER characteristics can be obtained in various transmission paths. The technique described in the above Non Patent Literature 1 is applied to OFDM modulation, but is also applicable to any systems for multiplexing a plurality of signals.
The above conventional technique, which can keep the PAPR of multiplexed signals low, thus allows amplification near the saturation point where the amplifier maximum efficiency can be obtained. In addition, since the multiplexing circuit is configured with the NN, it is possible to adapt to a scenario to change signal specification by learning the NN again with a multiplexing condition, for example, the signal power ratio or the modulation scheme changed. However, since the multiplexing circuit is configured with the NN, a problem arises in that the amount of calculation such as integration increases with higher density of the NN or with a larger number of layers of which the NN is composed. As a measure against this problem, there is a method called pruning in which the amount of calculation is reduced by disconnecting networks having lower importance of networks that have been subjected to learning once. However, it is difficult to determine which is a connection of a network having lower importance, that is, which network is to be disconnected so as to enable a reduction in performance degradation due to the pruning to be minimized.
The present disclosure has been made in view of the above circumstances, and an object thereof is to provide a transmission apparatus capable of minimizing performance degradation in a case where the amount of calculation of a neural network used for signal multiplexing is reduced by pruning.
In order to solve the above problems and achieve the object, the present disclosure provides a transmission apparatus, comprising: a multiplex signal generator to generate a multiplex signal based on multiplexed data into which two or more pieces of data are multiplexed; and a multiplexing processor to generate the multiplexed data by multiplexing the pieces of data using a neural network whose parameters have been adjusted based on constraint conditions defined by an amplitude of the multiplex signal and a phase difference among the two or more pieces of data included in the multiplex signal, wherein the neural network has undergone pruning based on updates of parameters and a multiplex signal generated based on the multiplexed data generated using the parameters updated.
Hereinafter, a transmission apparatus, a transmission method, a control circuit, and a storage medium according to embodiments of the present disclosure will be described in detail with reference to the drawings.
As illustrated in
The input signal processing unit 1 adjusts each of the symbol rates of two or more pieces of spread data inputted from the outside to the least common multiple of the symbol rates of the spread data, and outputs the data obtained by the adjustment to the multiplexing processing unit 2.
The multiplexing processing unit 2 is configured with a neural network (hereinafter, referred to as the NN). The multiplexing processing unit 2 receives the two or more pieces of spread data whose symbol rates have been adjusted by the input signal processing unit 1 as inputs for the NN, and outputs results outputted according to parameters of the NN to the multiplex signal generation unit 3. That is, the multiplexing processing unit 2 multiplexes a plurality of pieces of spread data whose symbol rates have been adjusted, by using the NN, and generates multiplexed data that is the results of multiplexing the plurality of pieces of spread data.
The multiplex signal generation unit 3 performs mapping processing to map the multiplexing results inputted from the multiplexing processing unit 2 on the in-phase quadrature (IQ) plane to generate a multiplex signal. The multiplex signal generated by the multiplex signal generation unit 3 is transmitted from the transmission apparatus 100 to a reception apparatus (not illustrated). In addition, the multiplex signal is inputted to the evaluation function calculation unit 4 and the parameter monitoring unit 6.
For the multiplex signal inputted from the multiplex signal generation unit 3, the evaluation function calculation unit 4 calculates predetermined evaluation functions, that is, the PAPR and BER characteristics of the multiplex signal, for example, and outputs the result of calculating the evaluation functions to the learning execution unit 5.
The learning execution unit 5 updates the parameters of the NN (hereinafter, sometimes referred to as the NN parameters) of the multiplexing processing unit 2, based on the result of the calculation of the evaluation functions obtained from the evaluation function calculation unit 4.
The parameter monitoring unit 6 monitors updates of the NN parameters made by the learning execution unit 5 and a multiplex signal generated by the multiplex signal generation unit 3, and determines how the multiplex signal generated by the multiplex signal generation unit 3 changes, that is, the effects of updating of the NN parameters on the multiplex signal, when the learning execution unit 5 updates the NN parameters of the multiplexing processing unit 2. Specifically, the parameter monitoring unit 6 determines which of the frequency, phase, and amplitude of the multiplex signal each NN parameter relates to, on the basis of monitoring results.
The pruning unit 7 performs pruning processing on the NN of the multiplexing processing unit 2. Specifically, the pruning unit 7 determines which network of the NN is to be preferentially left at the time of the pruning processing on the NN of the multiplexing processing unit 2, based on the relationships between the NN parameters and the frequency, phase, and amplitude of the multiplex signal, determined by the parameter monitoring unit 6, and performs the pruning processing to disconnect a network or networks thereof determined to be unnecessary.
The present embodiment provides description on the assumption that two or more pieces of spread data generated outside are inputted to the transmission apparatus 100. However, another configuration may be adopted in which processing to spread each of two or more pieces of data to generate two or more pieces of spread data is performed inside the transmitting apparatus 100. In addition, a configuration may be adopted in which processing for the input signal processing unit 1 to adjust the symbol rates is performed outside the transmission apparatus 100. That is, the configuration results in the input signal processing unit 1 being omitted, while the spread data pieces whose symbol rates have been adjusted are inputted to the transmission apparatus 100.
Next, hardware for implementing the transmission apparatus 100 will be described. The transmission apparatus 100 can be implemented by hardware having a configuration illustrated in
An input unit 101 is an electric circuit that receives input signals to the transmission apparatus 100, that is, a plurality of pieces of spread data from the outside. An output unit 103 is an electric circuit that outputs a multiplex signal generated by the transmission apparatus 100 to the outside.
Symbol rate adjustment processing performed by the input signal processing unit 1 may be performed by the input unit 101. That is, the input unit 101 may implement the input signal processing unit 1.
When the principal parts of the transmission apparatus 100 are implemented by the memory 104 and the processor 105, the processor 105 executes a program describing processing for the processor to operate as the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, the evaluation function calculation unit 4, the learning execution unit 5, the parameter monitoring unit 6, and the pruning unit 7, thereby implementing these units. The program describing the processing for the processor to operate as the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, the evaluation function calculation unit 4, the learning execution unit 5, the parameter monitoring unit 6, and the pruning unit 7 is stored in advance in the memory 104. The processor 105 reads and executes the program stored in the memory 104, thereby operating as the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, the evaluation function calculation unit 4, the learning execution unit 5, the parameter monitoring unit 6, and the pruning unit 7.
Part of the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, the evaluation function calculation unit 4, the learning execution unit 5, the parameter monitoring unit 6, and the pruning unit 7 may be implemented by the memory 104 and the processor 105, and the rest thereof may be implemented by dedicated hardware similar to the processing circuit 102 illustrated in
The program, which is stored in the memory 104 in advance, is not limited to this manner. The program may be in the form of being provided to a user in a state of being written in a storage medium such as a compact disc (CD)-ROM or a digital versatile disc (DVD)-ROM, and installed in the memory 104 by the user.
Next, the operation of the transmission apparatus 100 will be described. The operation of the transmission apparatus 100 is divided into three steps: a learning step, a pruning step, and an operating step. The operation of each of these three steps will be described below.
<Learning Step>
First, the learning step will be described.
In the learning step, the learning execution unit 5 updates the parameters of the NN of the multiplexing processing unit 2, based on a plurality of pieces of spread data outputted from the input signal processing unit 1 and the result of calculation of the evaluation functions outputted from the evaluation function calculation unit 4. The parameter monitoring unit 6 determines, from the results of the update of the NN parameters and the results of monitoring of a multiplex signal generated by the multiplex signal generation unit 3, which of the frequency, phase, or amplitude of the multiplex signal output each parameter of the NN relates to. This provides the effect that appropriate NN parameters can be learned from the plurality of pieces of spread data inputted to the multiplexing processing unit 2 and the result of the calculation of the evaluation functions obtained by the evaluation function calculation unit 4.
Details of the operation of the learning step will be described with reference to
In the learning step, first, the transmission apparatus 100 acquires two or more pieces of spread data (step S1). Here, by way of example, the description will be continued on the assumption that four signals, i.e., signals A to D having their respective symbol rates as illustrated in
Next, the input signal processing unit 1 adjusts the symbol rates of the acquired spread data (step S2). When the four signals illustrated in
Next, the four signals whose symbol rates have been adjusted by the input signal processing unit 1 are inputted to the multiplexing processing unit 2 to obtain the output of the NN (step S3). The output of the NN is the output of the multiplexing processing unit 2, that is, the results of multiplexing of the four signals whose symbol rates have been adjusted by the input signal processing unit 1.
Here, the NN will be described.
Returning to the description of the learning step, next, the multiplex signal generation unit 3 recognizes two output symbols of the NN of the multiplexing processing unit 2 as a real value and an imaginary value, and maps these values on the IQ plane also called a complex plane to generate a multiplex signal (step S4). At this time, the signal points of the multiplexed spread data outputted by the NN of the multiplexing processing unit 2 may be directly mapped, or the signal points may be mapped on a constant envelope.
Next, the evaluation function calculation unit 4 calculates the evaluation functions based on the multiplex signal generated by the multiplex signal generation unit 3 (step S5). Specifically, the evaluation function calculation unit 4 calculates the evaluation functions based on the constraint conditions imposed on the multiplex signal. The constraint conditions imposed on the multiplex signal are defined by, for example, the amplitude of the multiplex signal and the phase difference among the two or more signals included in the multiplex signal. For example, the evaluation function calculation unit 4 calculates, as an evaluation function, the distance between the signal point indicated by the multiplex signal generated by the multiplex signal generation unit 3 and a signal point indicated by a replica of the multiplex signal. In addition, the evaluation function calculation unit 4 calculates, as an evaluation function, whether the phase difference among the signals included in the multiplex signal generated by the multiplex signal generation unit 3 keeps the phase difference between the signals before being multiplexed, that is, whether the phase difference among the signals after being multiplexed keeps the phase difference among the signals before being multiplexed.
Examples of calculation of the evaluation function will be described with reference to
The evaluation function calculation unit 4 sums the two evaluation functions described above with reference to
Next, the learning execution unit 5 updates the NN of the multiplexing processing unit 2 (step S6). Specifically, the learning execution unit 5 performs a learning operation to update weights in each layer that are the parameters of the NN. In this learning operation, the learning execution unit 5 calculates the evaluation function represented by the equation (1), and based on that calculation, adjusts the weights in each layer of the NN. The learning operation is to solve an optimization problem that minimizes an error, that is, the evaluation function. For a solution to the optimization problem, an error back propagation algorithm is typically used. In an error back propagation algorithm, an error is propagated from the output layer of the NN to adjust the weights in each layer. Specifically, an error back propagation algorithm refers to a method of calculating the amounts of update of the weights in each layer with use of values obtained from the output layer side, and propagating the values that determine the amounts of update of the weights in each layer toward the input layer while calculating the values.
Next, the parameter monitoring unit 6 determines which parameter of the NN is changed to affect which of the frequency, phase, and amplitude of the multiplex signal (step S7). For example, the parameter monitoring unit 6 records a certain number of parameters of the NN in decreasing order from a parameter whose value has the greatest change in one learning process. The parameter monitoring unit 6 may record all the parameters. Thereafter, the parameter monitoring unit 6 calculates the amount of change in center frequency from the frequency spectra of the pre-learning and post-learning multiplex signals. The calculation of the amount of change is of a general means and will not be described here. When the amount of change in center frequency exceeds a predetermined threshold value, the top N % of the parameters of the NN with larger amounts of change are recorded as parameters affecting the frequency. Parameters with a larger amount of change in center frequency are parameters having larger effects on the frequency, and are regarded as parameters of higher importance. The parameter monitoring unit 6 performs similar processing on the phase and amplitude of the multiplex signal as well, and determines which parameter of the NN relates to which of the frequency, phase, or amplitude.
The units in the learning operation block 110 illustrated in
<Pruning Step >
Next, the pruning step will be described.
In the pruning step, the pruning unit 7 determines NN parameters to be pruned according to a predetermined pruning rate, from relationships between the NN parameters of the multiplexing processing unit 2 on the one hand and the frequency, phase, and amplitude of the multiplex signal on the other hand, the relationships having been determined by the parameter monitoring unit 6. Thereafter, the pruning unit 7 performs pruning processing in which the NN parameters determined to be objects to be pruned are set to zeros. This enables NN parameters of higher importance having larger effects on each of the frequency, phase, and amplitude of the multiplex signal to be left preferentially. That is, it is possible to reduce the amount of calculation of the NN while minimizing performance degradation due to the pruning.
Details of the pruning step will be described with reference to
In the pruning step, the pruning unit 7 first determines parameters to be pruned, on the basis of results determined by the parameter monitoring unit 6 in step S7 in the learning step described above, or specifically, results of the determination of the parameters of higher importance that have larger effects on each of the frequency, phase, and amplitude of the multiplex signal (step S9). For example, in the case of the pruning rate being 50%, the bottom 50% of the parameters in importance are determined to be objects to be pruned so as to leave the top 50% of the parameters in descending order of importance for each of the frequency, phase, and amplitude of the multiplex signal.
Next, the pruning unit 7 performs pruning in accordance with the determination results of step S9 (step S10). That is, the pruning unit 7 sets the parameters determined to be objects to be pruned in step S9, to zeros.
<Operating Step >
Next, the operating step will be described.
In the operating step, the multiplexing processing unit 2 performs, on the spread data inputted from the input signal processing unit 1, multiplex processing using the NN optimized in the learning step and the pruning step described above. The multiplex signal generation unit 3 maps multiplexing results inputted from the multiplexing processing unit 2 on the IQ plane, and outputs the results as a multiplex signal to the outside of the transmission apparatus 100. Consequently, the multiplex signal outputted by the transmission apparatus 100 is a signal that achieves both low PAPR characteristics and good correlation characteristics at the time of despreading at a receiver.
Details of the operating step will be described with reference to
In the operating step, first, the input signal processing unit 1 acquires two or more pieces of spread data (step S1a), and adjusts the symbol rates of the acquired spread data pieces (step S2a). Next, the multiplexing processing unit 2 inputs each piece of the spread data whose symbol rates have been adjusted by the input signal processing unit 1 to the NN to obtain the output of the NN (step S3a). Next, the multiplex signal generation unit 3 maps the output of the NN of the multiplexing processing unit 2 on the IQ plane to generate a multiplex signal (step S4a). Steps S1a to S4a refer to the same processing as that of steps S1 to S4 in the above-described learning step, and thus details thereof will be omitted.
As described above, the transmission apparatus 100 according to the present embodiment learns the NN used for the signal multiplexing processing, based on the constraint condition on a multiplex signal to be generated and the evaluation functions having been set, and further determines which of the frequency, phase, or amplitude the parameter of the NN relates to and determines the importance of each parameter, and performs the pruning processing to leave parameters of higher importance. This enables performance degradation to be restrained when the amount of calculation of the NN is reduced by the pruning. That is, it is possible to generate a multiplex signal while minimizing performance degradation of the NN due to the pruning.
The transmission apparatus 100 according to the first embodiment learns the neural network of the multiplexing processing unit 2 inside the apparatus, and after the learning, generates a multiplex signal using the learned neural network and outputs it. However, there is a possibility that computer resources of equipment in which the transmission apparatus 100 is to be incorporated are under significantly tight conditions, and learning cannot be performed onboard. In the circumstances, the present embodiment gives description for a configuration in which learning is performed in another piece of equipment, with use of computer resources of that piece of equipment, and the parameters of the neural network are updated using parameters that have been learned in that piece of equipment.
The transmission apparatus 100a according to the present embodiment includes the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, a multiplexing condition transmitting unit 8, and a learning result setting unit or circuit 10. The input signal processing unit 1, the multiplexing processing unit 2, and the multiplex signal generation unit 3 of the transmission apparatus 100a are components that perform the same processing as the input signal processing unit 1, the multiplexing processing unit 2, and the multiplex signal generation unit 3 of the transmission apparatus 100 according to the first embodiment, and thus details of the processing will not be described.
The learning apparatus 200 includes an input signal processing unit 21, a multiplexing processing unit or processor 22, a multiplex signal generation unit or generator 23, an evaluation function calculation unit or calculator 24, a learning execution unit or circuit 25, a parameter monitoring unit or monitor 26, a pruning unit or circuit 27, and a learning result transmitting unit 28. The input signal processing unit 21, the multiplexing processing unit 22, the multiplex signal generation unit 23, the evaluation function calculation unit 24, the learning execution unit 25, the parameter monitoring unit 26, and the pruning unit 27 of the learning apparatus 200 are components that perform substantially the same processing as the input signal processing unit 1, the multiplexing processing unit 2, the multiplex signal generation unit 3, the evaluation function calculation unit 4, the learning execution unit 5, the parameter monitoring unit 6, and the pruning unit 7 of the transmission apparatus 100 according to the first embodiment, and thus details of that processing will not be described.
The following describes differences from the first embodiment.
The multiplexing condition transmitting unit 8 of the transmission apparatus 100a reads a constraint condition on each signal to be multiplexed from the input signal processing unit 1, and transmits the constraint conditions to the input signal processing unit 21 of the learning apparatus 200. A means by which the multiplexing condition transmitting unit 8 transmits the constraint conditions has a typical configuration and is substantially the same as a conventional one, and thus a detailed description thereof will be omitted.
The learning result transmitting unit 28 of the learning apparatus 200 reads parameters of the learned NN from the multiplexing processing unit 22 and transmits the parameters to the learning result setting unit 10 of the transmission apparatus 100a. The parameters of the NN transmitted at this time are parameters of the NN that has been subjected to the pruning processing. It is noted that a means by which the learning result transmitting unit 28 transmits the parameters of the NN has a typical configuration and is substantially the same as a conventional one, and thus a detailed description thereof will be omitted.
The learning result setting unit 10 of the transmission apparatus 100a receives parameters of the learned NN from the learning result transmitting unit 28 of the learning apparatus 200, and writes the received parameters into the NN of the multiplexing processing unit 2.
Next, the operation of the transmission apparatus 100a will be described. In the present embodiment, even in the case where the computer resources of the transmission apparatus 100a have been exhausted and learning cannot be performed onboard, computer resources of the learning apparatus 200 that is another piece of equipment are used to learn the parameters of the NN suitable for the signal multiplexing processing, and further the pruning processing is performed, thereby to optimize the NN used by the multiplexing processing unit 2.
Details of the operation of the transmission apparatus 100a will be divisionally described for each of sections categorized by a learning step, a pruning step, and an operating step as in the first embodiment. However, some operation common to the first embodiment will be omitted in description.
<Learning Step >
Steps S1 and S2 of the flowchart illustrated in
After the input signal processing unit 1 adjusts the symbol rates of the spread data in step S2, the multiplexing condition transmitting unit 8 acquires constraint conditions on the signals to be multiplexed from the input signal processing unit 1 and transmits the constraint conditions to the input signal processing unit 21 of the learning apparatus 200 (step S11). An example of the constraint conditions to be transmitted by the multiplexing condition transmitting unit 8 is the transmission power ratio and the phase of each signal to be multiplexed by the multiplexing processing unit 2, which are illustrated in
The learning apparatus 200 performs steps S3a to S8a using the constraint conditions received in step S11 to thereby perform learning of the NN, that is, update of the NN parameters.
<Pruning Step >
Steps S9a to S10a of the flowchart illustrated in
After steps S9a and S10a are performed in the learning apparatus 200, the learning result transmitting unit 28 transmits the parameters of the NN to the transmission apparatus 100a (step S12). A procedure of the learning result transmitting unit 28 transmitting the NN parameters is substantially the same as a procedure of the multiplexing condition transmitting unit 8 of the transmission apparatus 100a transmitting the constraint conditions on the signals, and thus will not be described.
Upon receiving the NN parameters transmitted by the learning result transmitting unit 28 of the learning apparatus 200, the learning result setting unit 10 of the transmission apparatus 100a updates the parameters of the NN constituting the multiplexing processing unit 2, in accordance with the received NN parameters (step S13). This processing can completely match the NN parameters of the multiplexing processing unit 22 of the learning apparatus 200 with the NN parameters of the multiplexing processing unit 2 of the transmission apparatus 100a, and both of the former parameters and the latter parameters can provide a possibility to generate the same multiplex signal.
<Operating Step >
An operation in the operating step in which the transmission apparatus 100a generates a multiplex signal using the learned NN is the same as that in the first embodiment, and thus its description will be omitted.
As described above, the transmission apparatus 100a according to the second embodiment transmits constraint conditions on signals to be multiplexed to the learning apparatus 200 situated externally, and the learning apparatus 200 performs learning based on the received constraint conditions and updates the parameters of the NN that are used to multiplex the signals. Further, the learning apparatus 200 performs pruning and transmits obtained learning results, specifically, the parameters of the NN to the transmission apparatus 100a. The transmission apparatus 100a updates the parameters of the NN of the multiplexing processing unit 2 on the basis of the learning results in the learning apparatus 200. By doing so, even if the computer resources of the transmission apparatus 100a have been exhausted, and learning cannot be performed onboard, the parameters of the NN of the multiplexing processing unit 2 can be updated, and the effects similar to those of the transmission apparatus 100 according to the first embodiment can be achieved.
In the configuration illustrated in
The transmission apparatus according to the present disclosure achieves an advantageous effect that it can restrain performance degradation caused when the amount of calculation of the neural network used for signal multiplexing is reduced by the pruning operation.
The configurations described in the above embodiments illustrate just examples and can be combined with other publicly known techniques. Besides, the embodiments can be combined with each other, and each of the configurations can be partly omitted and/or modified without departing from the scope of the present disclosure.
This application is a continuation application of International Application PCT/JP2020/047201, filed on Dec. 17, 2020, and designating the U.S., the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/047201 | Dec 2020 | US |
Child | 18300801 | US |