Embodiments of the subject matter disclosed herein generally relate to a system and method for channel estimation in a communication system, and more particularly, to using machine learning for frequency-selective channel estimation of multiple-input multiple-output (MIMO) system.
In the continuous quest to be more integrated and internet connected so that all devices are able to communicate with each other, it is the goal of the telecommunication community to deliver higher connection speed, ultra-low latency, more reliability, massive network capacity, increased availability, and a more uniform experience to the users. Millimeter wave (mmWave) communication has emerged as a key technology to fulfill this goal, i.e., the beyond fifth-generation (B5G) network requirements. The mmWave band offers an abundant frequency spectrum (30-300 GHz) at the cost of low penetration depth and high propagation losses. Fortunately, its short-wavelength mitigates these drawbacks by allowing the deployment of large antenna arrays into small form factor transceivers, paving the way for multiple-input multiple-output (MIMO) systems with high directivity gains.
In order to achieve the above noted goals, there is a need to accurately provide channel estimation. Channel estimation refers to a procedure of determining/learning all possible paths (channels) between the transmitter and the receiver as some of the channels are more impacted than others by the ambient medium, i.e., buildings, moving vehicles, trees, etc., and thus, these channels needs to have their parameters adjusted. In addition, the channel estimation is required to happen continuously as the transmitter, receiver or both may change their spatial positions during the data exchange. The most appropriate structure for implementing the above noted goals is the hybrid MIMO system. The hybrid MIMO configuration has been introduced to operate at mmWave frequencies because an all-digital architecture, with a dedicated radio frequency (RF) chain for each antenna element, results in an expensive system architecture and high-power consumption at these frequencies. In these hybrid architectures, phase-only analog beamformers are employed to steer the beams using steering vectors of quantized angles. The down-converted signal is then processed by low-dimensional baseband beamformers, each of which is dedicated to a single RF chain. The number of RF chains is significantly reduced with this combination of (1) high-dimensional phase-only analog and (2) low-dimensional baseband digital beamformers.
Moreover, an optimal configuration of the digital/analog precoders and combiners requires instantaneous channel state information (CSI) to achieve spatial diversity and multiplexing gain. However, acquiring mmWave CSI is challenging with a hybrid architecture due to the following reasons: 1) there is no direct access to the different antenna elements in the array since the channel is seen through the analog combining network, which forms a compression stage for the received signal when the number of RF chains is much smaller than the number of antennas, 2) the large channel bandwidth yields high noise power and low received signal-to-noise-ratio (SNR) before beamforming, and 3) the large size of channel matrices increases the complexity and overheads associated with traditional precoding and channel estimation algorithms. Therefore, a low complexity channel estimation for mmWave MIMO systems with hybrid architecture is necessary.
Channel estimation techniques typically leverage the sparse nature of mmWave MIMO channels by formulating the estimation as a sparse recovery problem and apply compressive sensing (CS) methods to solve it. Compressive sensing is a general framework for estimation of sparse vectors from linear measurements, see, for example, M. F. Duarte and Y. C. Eldar, “Structured compressed sensing: From theory to applications,” IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4053-4085, September 2011. The estimated supports of the sparse vectors using CS help identify the indices of Angle-of-Arrival (AoA) and Angle-of-Departure (AoD) pairs for each path in the mmWave channel, while the amplitudes of the nonzero coefficients in the sparse vectors represent the channel gains for each path. Therefore, these supports and amplitudes are the components to be estimated to obtain accurate CSI. Moreover, it has been shown that pilot training overhead can be reduced with compressive estimation, unlike the conventional approaches such as those based on least squares (LS) estimation.
Several channel estimation methods based on CS tools that explore the mmWave channel sparsity have been investigated in the literature. In one application, a distributed grid matching pursuit (DGMP) channel estimation scheme detects and iteratively updates the dominant entries of the line-of-sight (LoS) channel path. In another application, an orthogonal matching pursuit (OMP) channel estimation scheme is used for detecting multiple channel paths support entries. Likewise, a simultaneous weighted orthogonal matching pursuit (SW-OMP) channel estimation scheme based on a weighted OMP method is developed in yet another application for frequency selective mmWave systems. A sparse reconstruction problem was formulated in one application to estimate the channel independently for every subcarrier by exploiting common sparsity in the frequency domain. However, such optimization and CS-based channel estimation schemes detect the support indices of the mmWave channel sequentially and greedily, and hence are not globally optimal, which is one disadvantage of the existing systems.
Alternatively, deep learning (DL) approaches and data driven algorithms have recently received much attention as key enablers for beyond 5G networks. Traditionally, signal processing and numerical optimization techniques have been heavily used to address channel estimation at mmWave bands. However, optimization algorithms often demand considerable computational complexity overhead, which creates a barrier between theoretical design/analysis and real time processing requirements. Hence, the prior data-set observations and deep neural network (DNN) models can be leveraged to learn the non-trivial mapping from compressed received pilots to channels. DNNs can be used to approximate the optimization problems by selecting the suitable set of parameters that minimize the approximation error. The use of DNNs is expected to substantially reduce computational complexity and processing overhead since it only requires several layers of simple operations such as matrix-vector multiplications. Moreover, several successful DL applications have been demonstrated in wireless communications problems such as channel estimation [1]-[10], analog beam selection [11], [12], and hybrid beamforming [11], [13]-[17]. Besides, DL-based techniques, when compared with other conventional optimization methods, have been shown [2], [15], [16], [18] to be more computationally efficient in searching for beamformers and more tolerant to imperfect channel inputs. In [3], a learned denoising-based approximate message passing (LDAMP) network is presented to estimate the mmWave communication system with lens antenna array, where the noise term is detected and removed to estimate the channel.
Prior work on channel estimation for hybrid mmWave MIMO architecture [3]-[10], [13]-[15] consider the narrow-band flat fading channel model for tractability, while the practical mmWave channels exhibit the wideband frequency-selective fading due to the very large bandwidth, short coherence time and different delays of multipath. MmWave environments such as indoor and vehicular communications are highly variable with short coherence time, which requires channel estimation algorithms that are robust to the rapidly changing channel characteristics.
Thus, there is a need for a new method and system for channel estimation in a hybrid, mmWave MIMO system that overcomes the above noted problems.
According to an embodiment, there is a machine learning based method for channel estimation for a multiple-input multiple-output, MIMO, system, the method including receiving a measured signal y[k] at a receiver of the system, finding subcarriers k of the measured signal y[k], estimating, with a convolutional neural network, CNN, channel amplitudes ĝ[k] of the measured signal y[k], reconstructing a channel Ĥ[k], between the receiver and a transmitter of the system, based on the channel amplitudes ĝ[k] and a low resolution whiten measurement matrix w, and adjusting a parameter of the system based on the reconstructed channel Ĥ[k][k]. The channel amplitudes ĝ[k] are simultaneously estimated by the CNN.
According to another embodiment, there is a transceiver performing a machine learning channel estimation for a multiple-input multiple-output, MIMO, system, the transceiver including an interface configured to receive a measured signal y[k] at a receiver of the system and a processor connected to the interface and configured to, find subcarriers k of the measured signal y[k], estimate, with a convolutional neural network, CNN, channel amplitudes ĝ[k] of the measured signal y[k], reconstruct a channel Ĥ[k][k], between the receiver and a transmitter of the system, based on the channel amplitudes ĝ[k] and a low resolution whiten measurement matrix w, and adjust a parameter of the system based on the reconstructed channel Ĥ[k][k]. The channel amplitudes ĝ[k] are simultaneously estimated by the CNN.
According to still another embodiment, there is a refined machine learning based method for channel estimation for a multiple-input multiple-output, MIMO, system, the method including receiving a measured signal y[k] at a receiver of the system, finding subcarriers k of the measured signal y[k], estimating, with a convolutional neural network, CNN, channel amplitudes ĝ[k] of the measured signal y[k], reconstructing and refining a channel Ĥ[k][k] between the receiver and a transmitter of the system based on the channel amplitudes ĝ[k] and a high resolution whiten measurement matrix wr, and adjusting a parameter of the system based on the reconstructed channel Ĥ[k][k]. The channel amplitudes ĝ[k] are simultaneously estimated by the CNN.
According to yet another embodiment, there is a transceiver performing a machine learning channel estimation for a multiple-input multiple-output, MIMO, system, the transceiver including an interface configured to receive a measured signal y[k] at a receiver of the system and a processor connected to the interface and configured to, find subcarriers k of the measured signal y[k], estimate, with a convolutional neural network, CNN, channel amplitudes ĝ[k] of the measured signal y[k], reconstruct and refine a channel Ĥ[k][k] between the receiver and a transmitter of the system based on the channel amplitudes ĝ[k] and a high resolution whiten measurement matrix, wr, and adjust a parameter of the system based on the reconstructed channel Ĥ[k][k]. The channel amplitudes ĝ[k] are simultaneously estimated by the CNN.
For a more complete understanding of the present invention, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
The following description of the embodiments refers to the accompanying drawings. The same reference numbers in different drawings identify the same or similar elements. The following detailed description does not limit the invention. Instead, the scope of the invention is defined by the appended claims. The following embodiments are discussed, for simplicity, with regard to a frequency-selective wideband mmWave system that uses DL compressing sensing based algorithm for channel estimation.
Reference throughout the specification to “one embodiment” or “an embodiment” means that a particular feature, structure or characteristic described in connection with an embodiment is included in at least one embodiment of the subject matter disclosed. Thus, the appearance of the phrases “in one embodiment” or “in an embodiment” in various places throughout the specification is not necessarily referring to the same embodiment. Further, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first object or step could be termed a second object or step, and, similarly, a second object or step could be termed a first object or step, without departing from the scope of the present disclosure. The first object or step, and the second object or step, are both, objects or steps, respectively, but they are not to be considered the same object or step.
The terminology used in the description herein is for the purpose of describing particular embodiments and is not intended to be limiting. As used in this description and the appended claims, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Further, as used herein, the term “if” may be construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context.
According to an embodiment, a frequency-selective wideband mmWave MIMO system is configured to use one of two novel machine learning (ML), for example, deep learning (DL), compressive sensing (CS) based algorithms for channel estimation. The proposed algorithms learn critical apriori information from training data to provide highly accurate channel estimates with low training overhead. In the first approach, a DL-CS based algorithm simultaneously estimates the channel supports in the frequency domain, which are then used for channel reconstruction. The second approach exploits the estimated supports to apply a low-complexity, multi-resolution, fine-tuning method to further enhance the estimation performance. Simulation results discussed later demonstrate that the proposed DL-based schemes significantly outperform conventional orthogonal matching pursuit (OMP) techniques in terms of the normalized mean-squared error (NMSE), computational complexity, and spectral efficiency, particularly in the low signal-to-noise ratio regime. When compared to OMP approaches that achieve an NMSE gap of 4 to 10 dB with respect to the Cramer Rao Lower Bound (CRLB), the proposed algorithms reduce the CRLB gap to only 1 to 1.5 dB, while significantly reducing the complexity by two orders of magnitude.
As the two algorithms are mathematically laborious, the notations used for describing them are first introduced. Bold upper case, bold lower case, and lower-case letters correspond to matrices, vectors, and scalars, respectively. Scalar norms, vector L2 norms, and Frobenius norms, are denoted by |⋅|, ∥⋅∥2, and ∥⋅∥F, respectively. The symbol X is used to denote a set. IX denotes a X×X identity matrix. [⋅](⋅)T, (⋅), and (⋅)* stand for expected value, transpose, complex conjugate, and Hermitian. X† stands for the Moore-Penrose pseudo-inverse of X. [x]i represents ith element of a vector x. The (i,j)th entry of a matrix X is denoted by [X]i,j. In addition, [X]:,j and [X]:,Ω denote the jth column vector of matrix X and the sub-matrix consisting of the columns of matrix X with indices in the set Ω. The {a}mod b means a modulo b.
(μ, C) refers to a circularly-symmetric complex Gaussian distribution with mean μ and covariance matrix C. The operations vec(X), vec2mat(x, sz), sub2ind(sz, [r, c]), and ind2sub(sz, i) correspond to transforming a matrix into a vector, transforming a vector into a matrix for a defined size (sz), transforming the row r and column c subscripts of a matrix into their corresponding linear index, and transforming the linear index i into its corresponding row and column subscripts for a matrix of a defined size (sz), respectively. X⊗Y is the Kronecker product of X and Y. The most used model-related notation is listed in Table I in
The system model for the frequency selective mmwave MIMO system is described next, followed by the novel two machine (e.g., deep) learning-based compressive sensing channel estimation schemes in the frequency domain. Note that the embodiments discussed herein can apply to any MIMO system, not only a mmWave MIMO system. A complexity analysis in terms of convergence and computational analysis are then presented followed by case studies with numerical results.
The system and channel models of frequency-selective hybrid mmWave transceivers are schematically illustrated in
N
N
The channel model is now discussed. A frequency-selective MIMO channel 212-i is considered between the transmitter 209 and the receiver 207. Note that each of the base station 208 and the UE 206 includes a transmitter 209 and a receiver 207 (and thus, each of the UE and the base station includes a transceiver 206/208), but
where ρL represents the path loss between the transmitter and the receiver; L corresponds to the number of paths; TS denotes the sampling period; prc(τ) is a filter that includes the effects of pulse-shaping and other lowpass filtering evaluated at T; αl∈ is the complex gain of the lth path; τl∈
is the delay of the lth path; ϕl∈ [0,2π] and θl∈[0,2π] are the AoA and AoD of the lth path, respectively; and aR(ϕl)∈
N
N
The channel can be expressed more compactly in the following form:
Hd=ARΔdAT*, (3)
where Δd∈L×L is diagonal with non-zero complex diagonal entries, and AR ∈
N
N
where Δ[k]∈L×L is diagonal with non-zero complex diagonal entries such that
The Extended Virtual Channel Model is next discussed. It is further possible to approximate the channel Hd using the extended virtual channel model as
Hd≈ÃRΔdvÃT*, (5)
where Δdv∈G
and
respectively, and then:
ÃT=[aT({tilde over (θ)}1) . . . aT({tilde over (θ)}Gt)], (6)
ÃR=[aR({tilde over (ϕ)}1) . . . aR({tilde over (ϕ)}Gr)]. (7)
Because there are only a few scattering clusters in mmWave channels, the sparse assumption for Δdv∈G
where
is a Gr×Gt complex sparse matrix containing the channel gains of the virtual channel.
The Signal Reception is now introduced. Considering that the receiver (RX) applies a hybrid combiner W[k]=WRFWBB[k]∈N
y[k]=WBB*[k]WRF*H[k]FRFFBB[k]s[k]+WBB[k]WRF*n[k], (9)
where n[k]˜(0,σ2I) corresponds to the circularly symmetric complex Gaussian distributed additive noise vector. The received signal model in equation (9) corresponds to the data transmission phase. As explained later, during the channel acquisition phase, frequency-flat training precoders and combiners will be considered to reduce its complexity.
During the training phase, the transmitter 209 and the receiver 207 use a training precoder Ftr(m)∈N
N
where P is the total transmitted power and Ns=Lt. The transmitted symbol s(m)[k] is decomposed as s(m)[k]=q(m)t(m)[k], with q(m)∈L
y(m)[k]=Wtr(m)*H[k]Ftr(m)q(m)t(m)[k]+nc(m)[k], (10)
where H[k][k]∈N
L
Furthermore, the channel coherence time is assumed to be larger than the frame duration and that the same channel can be considered for several consecutive frames.
The Measurement Matrix is now discussed. In order to apply sparse reconstruction with a single subcarrier-independent measurement matrix, first the effect of the scalar t(m)[k] is removed by multiplying the received signal by t(m)[k]−1. Using the following property vec {AXC}=(CT⊗A)vec{X}, the vectorized received signal is given by:
vec{y(m)[k]}=(q(m)TFtr(m)T⊗Wtr(m)*)vec{H[k]}+nc(m)[k]. (11)
The vectorized channel matrix can be expressed as
vec{H[k]}=(
Furthermore, the measurement matrix Φ(m)∈(L
Φ(m)=(q(m)TFtr(m)T⊗Wtr(m)*), (13)
and the dictionary Ψ∈N
Φ=(
Then, the vectorized received pilot signal Lr×1 at the mth training symbol can be written as:
vec{y(m)[k]}=Φ(m)Φv[k]+nc(m)[k], (15)
where hv[k]=vec{Δv[k]}∈G
Hence, the vector hv[k] can be estimated by solving the sparse reconstruction problem, i.e.,
min∥hv[k]∥1 subject to ∥y[k]−ΦΨhv[k]∥22<∈, (17)
where ∈ represents a tunable parameter defining the maximum error between the reconstructed channel and the received signal. In realistic scenarios, the sparsity (number of channel paths) is usually unknown, therefore the choice of ∈ is relevant to solve equation (17) and estimate the sparsity level. The choice of this parameter is explained later.
It is noted that the matrices in equation (8) exhibit the same sparse structure for all k, since the AoA and AoD do not change with frequency in the transmission bandwidth. This is an interesting property that can be leveraged when solving the compressed channel estimation problem defined by equation (17). Moreover, the supports of the virtual channel matrices Δdv are denoted as 0,
1, . . . ,
N
k=0, . . . , K−1, the supports of hv[k] are defined as
where the union of the supports of the time-domain virtual channel matrices is due to the additive nature of the Fourier transform. Therefore, as shown in equation (18), as the union is independent of the subcarrier k, Δ[k] has the same supports for all k.
Next, the correlation matrix is discussed. To estimate multi-path components of the channel, i.e., AoAs/AoDs and channel gains, it is first needed to compute the atom, which is defined as the vector that produces the largest sum-correlation with the received signals in the measurement matrix. The sum-correlation is especially considered as the support of the different sparse vectors is the same over the K subcarriers. The correlation vector c[k]∈G
c[k]=*y[k], (19)
where ∈
ML
=ΦΨ represents the equivalent measurement matrix which is the same for ∀k and y[k]∈
ML
It is noted that if there exists a correlation between noise components, the atom estimated from the projection in equation (19) might not be the correct one. In order to compensate for this error in estimation, this embodiment considers the noise covariance matrix when performing the correlation step. In particular, the embodiment considers two arbitrary (hybrid) combiners Wtr(m)N
(0, σ2IL
{nc(i)[k]nc(j)*[k]}=Wtr(i)*σ2δ[i−j]Wtr(j). It is possible to further write the noise covariance matrix of y[k] as a block diagonal matrix Cw∈
ML
Cw=blkdiag{Wtr(1)*Wtr(1), . . . ,Wtr(M)*Wtr(M)}. (21)
Moreover, a Cholesky factorization can be used to factorize matrix Cw into Cw=Dw*Dw, where Dw∈ML
c[k]=w*yw[k], (21)
where w∈
ML
w=Dw−*
. The MLr×1 whitened received signal yw[k] is given by [k]=Dw−*y[k]. The matrix Dw−1∈
ML
Next, the deep learning and compressive-sensing based Channel Estimation (DL-CS-CE) methods are now discussed. To solve the CS channel estimation problem formulated above (e.g., equation (21)), two DL-based algorithms are introduced. Both methods leverage the common support between the channel matrices for every subcarrier and provide different complexity-performance trade-offs. The former simultaneously estimate the supports using an offline-trained DnCNN (note that other machine learning systems may be used instead of the DnCNN, for example, a convolutional neural network, CNN, or any neural network, NN, system; also the system may not be a denoise convolutional system; the DnCNN system is chosen herein as an example only) and then reconstructs the channel. On the other hand, the latter applies further finetuning to accurately estimate the AoAs and AoDs with higher resolution dictionary matrices while keeping the computational complexity low.
First, the offline training and the online deployment of the DnCNN is discussed. Before detailing the two novel methods, some insights are provided into the considered DnCNN architecture as well as its offline training and online deployment. Starting with the DnCNN architecture,
Cα[k]=vec 2 mat(|c[k]|, [Gr,Gt]), ∀k, (22)
as input and produces residual noise as an output, rather than the estimated channel amplitudes, where a Gr×Gt matrix of channel amplitudes is defined as:
G[k]=|Δv[k]|∈G
The DnCNN aims to learn a mapping function (Cα[k])=G[k] to predict the latent clean image G[k] from the noisy observation Cα[k]. This embodiment adopts the residual learning formulation to train a residual mapping
(Cα[k])≈V where V is the residual noise, and then G[k]=Cα[k]−
(Cα[k]). Instead of learning a mapping directly from a noisy image 420 to a denoised image 424, learning the residual noise 422 and subtracting it from the noisy image is beneficial. Furthermore, the averaged mean squared error between the desired residual image 422 and estimated ones from the noisy input 420 is adopted as the loss function to learn the trainable parameters Θ of the DnCNN. This loss function is given by
where (Cα[k]i, G[k]i)i=1N represents N noisy-clean training patch pairs. This method is also known as residual learning and renders the DnCNN to remove the highly structured natural image rather than the unstructured noise. Consequently, residual learning improves both the training times and accuracy of a network. In this way, combining batch normalization and residual learning techniques can accelerate the training speed and improve the denoising performance. Besides, batch normalization has been shown to offer some merits for residual learning, such as alleviating the internal covariate shift problem.
The offline training of the DnCNN network is now discussed with regard to
After the offline training step, the online deployment of the DnCNN follows, as illustrated in
The first DL-CS-CE method is now discussed. The state-of-the-art sparse channel estimation schemes depend on greedy algorithms to sequentially detect the supports, which naturally yield suboptimal solutions. The inventors have noted this limitation of the existing algorithms and have introduced a neural network to simultaneously estimate all supports rather than sequentially. The algorithmic implementation of the proposed DL-CS-CE method is schematically illustrated in
More specifically, in step 700 (see
Step 708, i.e., the selection of the strongest subcarriers, is represented in lines 8-11 of the algorithm shown in ∈K containing the Kp strongest subcarriers which are expected to exhibit the strongest channel response, as explained above.
Next, an amplitude estimation is performed at lines 13 and 14 of the method. First, the system (i.e., the receiver or transmitter or both) computes the correlation vector c[k] according to equation (21) and then creates the DnCNN input Cα[k] by transforming the correlation vectors c[k] into a matrix form according to equation (22). In line 15, the offline trained DnCNN 400 is used as the kernel of the channel amplitude estimation to obtain the DnCNN output Ĝ[k] of size Gr×Gt, which is the estimate of G[k] given by equation (23). It is worth noting that the system only uses a subset of the correlation matrices Cα[k]∀k∈
as an input to the DnCNN 400. In line 16, the output channel amplitude estimation matrix Ĝ[k] is vectorized into the following GtGr×1 vector form
{circumflex over (g)}[k]=vec({circumflex over (G)}[k]), ∀k∈, (25)
where the indices of the maximum amplitudes of ĝ[k] will be exploited for support detection.
Step 710 (corresponding to step 616 in as the supports are the same for all k. Then, the INDEXSORTDESCEND function sorts the sum vector in descending order and returns a corresponding index set
, |
|=GrGt. Thereafter, the “while” loop between lines 22 and 28 follows the steps below until the termination condition is satisfied.
Line 23 updates the detected support set by adding the ith element of ordered index set
. Then, line 24 projects the input signal yW[k]∀k onto the subspace given by the detected support
using Weighted Least-Squares (WLS) ([
w],
)†, which is followed by the residual update and MSE computation in lines 25 and 26, respectively. It is also worth noting that ([
w]:,
)† corresponds to a WLS estimator, with the corresponding weights given by the inverse noise covariance matrix. Lastly, line 27 increments the loop index i for the next iteration. The final value of i=|
| provides one desired parameter: {circumflex over (L)}, which is the estimate of the sufficient number of paths that guarantees MSE >∈, i.e., L. Thereby, this parameter is closely tied with the choice of ∈, which is discussed later. It is noted that the “while” loop is terminated by the MSE >∈ condition almost all the time as GtGr>>{circumflex over (L)}, as shown in Table II in
Because the support of the sparse channel vectors is already estimated by , the measurement matrix can now be defined as [
]:,
∈
ML
]:,
=[ΦΨ]:,
. Hence, the received signal model for the kth subcarrier can be rewritten as
y[k]=[]:,
{tilde over (ξ)}[k]+{tilde over (n)}c[k], (26)
where ñc[k]∈ML
{circumflex over (L)}×1 is the vector containing the channel gains to be estimated after sparse recovery. If the support estimation is accurate enough, ñc[k] will be approximately similar to the post-combining noise vector nc[k], as discussed in [19]. Note that the indices obtained by the trained DnCNN 400 may sometime be different from the actual channel support. In this case, the detected support
may also be different from the actual support. Likewise, the channel gains to be estimated {tilde over (ξ)}[k], can also be different from actual vector, ξ[k]=vec{diag{Δ[k]}}.
The mathematical model in equation (26) is usually considered as the General Linear Model (GLM), where the solution of {tilde over (ξ)}[k] for real parameters is provided in S. M. Kay, Fundamentals of statistical signal processing. Prentice Hall. For the case with complex valued parameters, the solution is given by:
{tilde over ({circumflex over (ξ)})}[k]=([]:,
*Cw−1[
]:,
)−1[
]:,
*Cw−1y[k], (27)
which can be further reduced to
{tilde over ({circumflex over (ξ)})}[k]=([w]:
)†yw[k]. (28)
Therefore, {tilde over ({circumflex over (ξ)})}[k] is considered as the Minimum Variance Unbiased (MVU) estimator for the complex parameter vector {tilde over ({circumflex over (ξ)})}[k], k=0, . . . , K−1. Hence, it is unbiased and attains the Cramér-Rao Lower Bound (CRLB) if the support is correctly estimated. This is considered as Cramer-Rao Lower Bound of a Genie-aided estimation problem, in which the estimator knows the location of the nonzero taps i.e., , as if a Genie has aided the estimator with the location of the taps. Once all the supports are detected, line 29 computes the sparse channel vector ĥv[k] where its non-zero elements are obtained according to
[ĥv[k]]=([
w]:
)†yw[k]. (29)
Finally, the algorithm at line 32 reconstructs the channel based on equation (12) as follows:
vec{Ĥ[k]}=({tilde over (Ā)}T⊗ÃR)vec{{circumflex over (Δ)}v[k]}, (30)
such that vec{{circumflex over (Δ)}v}[k]=ĥv[k].
This first method discussed with regard to
The discussed DL-CS-based channel estimation (DL-CS-CE) method exploits the information on the support coming from every subcarrier in the MIMO-OFDM system. It is executed in two steps: channel amplitude estimation through deep learning and channel reconstruction. The DnCNN is trained using real mmWave channel realizations obtained from Raymobtime. The correlation between the received signal vectors and the measurement matrix is fed into the trained DnCNN to predict the channel amplitudes. Using the obtained channel amplitudes, the indices of dominant entries of the channel are obtained, based on which the channel can be reconstructed. Unlike the existing work [19] that sequentially estimates the dominant channel entries, the present method simultaneously estimates the dominant entries (see line 15 in
The second channel estimation method is now discussed. The sparsity of hv[k] can be impaired by channel power leakage caused by the limited resolution of the chosen dictionary matrices. Although the DL-CS-CE method of
Using the superscript r for referring to the refining phase, the following higher resolution refining dictionary matrices ÃRr and ÃTr are considered with grid sizes Grr and Gtr, respectively. In one application, the dictionary matrices for the method of
The steps 900 to 908 and 912 of the current method illustrated in (i) is first transformed into column and row indices of a Gr×Gt matrix representing the indices (iAoAd, iAoDd) of the detected AoAs and AoDs in the original lower resolution dictionary matrices ÃR and ÃT, respectively. In line 24, a multi-resolution fine-tuning method REFINE is applied to enhance the resolution of the detected AoAs and AoDs. The refining procedure REFINE includes two steps, as shown between lines 36 and 39 of Algorithm 2 in
The first step starts with line 36 which refines the angle components with the highest number of antennas. For instance, consider that Nr>Nt. By increasing the resolution of {circumflex over (ϕ)}l to Gr Gr>>Gr, the maximum projection along the refined receiving array steering matrix ÃRr, while the corresponding AoD {circumflex over (θ)}l is fixed, can be expressed as
where wd is an MLr×GrrGt matrix such that
wd=Φw({tilde over (Ã)}T⊗ÃRr), and [Γwd]:,Ω
where wr is an MLr×GrrGtr matrix such that
wr=Φw(ÃTr⊗ÃRr), and [
wr]T,Ω
ΩA,r={0:GrrGtr−1}mod Grr+iAoAr. (33)
Here, iAoAr is the index of the refined AoA obtained from equation (31).
The second step, which starts at line 38, proceeds to repeat the same step by substituting all angles with their corresponding refined angles, after removing the angle uncertainty caused by the detection phase. The maximum projection along the refined received array is given by:
where ΩD,r={iAoDr:iAoDr·Grr}, and iAoDr correspond to the index obtained from the previous step in equation (32). Similarly, in line 39, iAoDr*is obtained using equation (32) but by substituting iAoAr in equation (33) with the obtained iAoA*(the result from equation (34)). Next, line 40 transforms the row and column indices [iAoAr* iAoDr*] into a linear index j*. The refining procedure lastly updates the refined support estimation set by admitting index j* into
.
The method shown in ]:
{circumflex over (ξ)}[k]. For instance, the noise variance is assumed to be known at the receiver in which the receiver can accurately estimate the noise variance before the training stage takes place. Hence, the received signal y[k] can be approximately modeled as y[k]≈{circumflex over (x)}rec[k]+ñc[k], since {circumflex over (x)}rec[k] is an estimate of the mean of y[k].
The estimation of the noise variance can be formulated as a Maximum-Likelihood estimation problem:
{circumflex over (σ)}2ML=arg mσ(y, {circumflex over (x)}rec, σ2), (35)
where yvec{y[0], . . . , y[K−1]}represents the complete received signal, {circumflex over (x)}rec
vec{{circumflex over (x)}rec [0], . . . , {circumflex over (x)}rec [K−1]} is the complete reconstructed signal, and
(y,{circumflex over (x)}rec,σ2) denotes the log likelihood function of y. This log likelihood function is given by
The ML estimator of the noise variance is then obtained by taking the partial derivative with respect to σ2 where ∂(y,{circumflex over (x)}rec,σ2)/∂σ2=0. Hence,
ML is given by
where the MLr×1 vector r[k]yw[k]−Dw−*{circumflex over (x)}rec is the residual. One can note that the residual r[k] can also be expressed as r[k]=(IML
ML
w]:,
†[
W]:,
.
Therefore, for a sufficient number of iterations, {circumflex over (L)} sufficient paths are expected to be detected as those L paths correspond to the dominant {circumflex over (L)} entries of Σk∈|hv[k]|. Moreover, the detection process is achieved when the estimated noise variance becomes equal to the true noise variance of the received signal by setting ∈ to σ2 in equation (17).
Next, the convergence of the two methods illustrated in
∥r(n+1)[k]∥22<∥r(n)[k]∥22, k=0, . . . ,K−1. (38)
Based on the residual computation for SW-OMP in [19], the residual for a given iteration n is expressed as
r(n)[k]=(IML
where P(n)∈ML
[
w]:,
w]:,
w]:,
w]:,
∥P(n+1)yw[k]∥22>∥P(n)yw[k]∥22. (40)
Following the notation used in Algorithm 1, the term inside the l2-norm on the left side of equation (40) can be expressed as
P(n+1)yw[k]=[[w]:,
w]:,{circumflex over (p)}
w]:,
w]:,{circumflex over (p)}
where {circumflex over (p)}(n+1)* is the estimate for the support index found during the n+1th iteration, such that {circumflex over (p)}(n+1)*∉(n).
By using the formula for the inverse of a 2×2 block matrix, the projection matrix P(n+1) can be recursively written as a function of P(n) as
with ΔP(n+1)∈ML
which satisfies the triangle equality. Moreover, ΔP(n+1) is idempotent and thus, using linear algebraic manipulations, it can be shown that ΔP(n+1)=(ΔP(n+1))2 Hence, the eigenvalues of ΔP(n+1) are either 0 or 1, thereby, ∥P(n+1)yw[k]∥22>∥P(n)yw[k]∥22. Since the condition in equation (40) is satisfied, the proposed algorithms are therefore guaranteed to converge to a local optimum. Moreover, the average number of sufficient iterations |={circumflex over (L)} for a range of SNR values (not shown) indicate that the proposed support detection method using the trained DnCNN needs few iterations to converge.
The refined DL-CS-CE method exploits the spatially common sparsity within the system bandwidth and a channel reconstruction with a low complexity multi-resolution finetuning approach is developed that further improves NMSE performance by enhancing the accuracy of the estimated AoAs/AoDs. The channel reconstruction is performed by consuming a very small amount of pilot training frames, which significantly reduces the training overhead and computational complexity.
The computational analysis or computational complexity for Algorithm 1 and Algorithm 2 is now discussed. For comparison purposes, the overall computational complexity of SW-OMP [19] was used as a benchmark. Because some steps can be performed before running the channel estimation algorithms, the inventors will distinguish between online and offline operations. For instance, the matrices w=Dw−*
, Cw, Dw,
wd, and
wr can be computed offline before the explicit channel estimation. Besides, the computational complexity of the proposed DnCNN arises from both online deployment and offline training. Although the online complexity is easier to compute, the offline training complexity is still an open issue due to a more involved implementation of the backpropagation process during training. Therefore, only the complexity of the online deployment was considered, which is based on simple matrix-vector multiplications.
For a deep neural network with LC convolutional layers, the total time complexity is given by:
where Dx(l), Dy(l) and Dz(l) are the convolutional kernel dimensions, bx(l) and by(l) are the dimensions of the lth convolutional layer output, and cCL(l) is the number of filters in the lth layer. It is noted that DL enjoys the advantages of graphics processing units (GPUs) and parallel processing, and hence, the overall time complexity is dominated by the analytical operations performed in the proposed algorithms.
Moreover, it was observed that the overall computational complexity of the DL-CS-CE method is lower than SW-OMP, especially for small grid sizes (for instance, when Gt and Gr are twice the size of the transmit and receive antennas). Moreover, when the refined algorithm is applied with the new refining higher resolution Gtr and Grr, the computational complexity is still less than that of SW-OMP applied with the same higher resolution grid sizes applied (Gtr and Grr).
Next, the inventors evaluated the performance of the proposed algorithms and compared empirical results with benchmark frequency-domain channel estimation algorithms, including the SW-OMP. The results are obtained through extensive Monte Carlo simulations to evaluate the average normalized mean squared error (NMSE), and the ergodic rate as a function of SNR and the number of training frames M. The simulations are performed based on realistic channel realizations from Raymobtime channel datasets.
The main parameters used for system configuration are as follows. The phase-shifters used in both the transmitter and the receiver are assumed to have NQ quantization bits, so that the entries of the training vectors ftr(m), wtr(m)), m=1, 2, . . . , M are drawn from the set
The number of quantization bits is set to NQ=2. The bandlimiting filter Prc(t) is assumed to be a raised-cosine filter with a roll-off factor of 0.8.
The DnCNN adopted in the above discussed embodiments has LC=3 convolutional layers. The first convolutional layer uses CCL1=64 different 3×3×1 filters, as schematically illustrated in (⋅,⋅) represents the uniform distribution.
First, a comparison of the normalized mean squared errors (NMSE) is performed for the channel estimate Ĥ[k][k], which is expressed for a given realization as
The NMSE is considered the baseline metric to compute the proposed algorithms' performance and will be averaged over many channel realizations. The normalized CRLB (NCRLB), from which the supports are perfectly estimated, is also provided to compare each algorithm's average performance with the lowest achievable NMSE. The average NMSE is compared versus the SNR obtained for the different channel estimation algorithms in
The results in
In (K(GrrGtr)MLrL)=
(6.7×109), while the complexity order of the refined DLCS-CE method is
(KpGrrMLrL)=
(1.3×107). Moreover,
Next, a comparison is performed in
Next, the spectral effective comparison is computed by assuming fully-digital precoding and combining. In this way, using estimates for the Ns dominant left and right singular vectors of the channel estimate gives K parallel effective channels Heff [k]=[Û[k]]:,1:N
with λn(Heff [k]), n=1, . . . , Ns the eigenvalues of each effective channel Heff [k].
Finally, the inventors performed a time complexity analysis and the results, shown in Table IV in
The above-discussed procedures and methods may be implemented in a computing device as illustrated in
Server 1701 may also include one or more data storage devices, including hard drives 1712, CD-ROM drives 1714 and other hardware capable of reading and/or storing information, such as DVD, etc. In one embodiment, software for carrying out the above-discussed steps may be stored and distributed on a CD-ROM or DVD 1716, a USB storage device 1718 or other form of media capable of portably storing information. These storage media may be inserted into, and read by, devices such as CD-ROM drive 1714, disk drive 1712, etc. Server 1701 may be coupled to a display 1720, which may be any type of known display or presentation screen, such as LCD, plasma display, cathode ray tube (CRT), etc. A user input interface 1722 is provided, including one or more user interface mechanisms such as a mouse, keyboard, microphone, touchpad, touch screen, voice-recognition system, etc.
Server 1701 may be coupled to other devices, such as other smart devices, detectors, etc. The server may be part of a larger network configuration as in a global area network (GAN) such as the Internet 1728, which allows ultimate connection to various landline and/or mobile computing devices.
The disclosed embodiments provide two methods for deep learning based frequency-selective channel estimation for hybrid mmWave MIMO systems. It should be understood that this description is not intended to limit the invention. On the contrary, the embodiments are intended to cover alternatives, modifications and equivalents, which are included in the spirit and scope of the invention as defined by the appended claims. Further, in the detailed description of the embodiments, numerous specific details are set forth in order to provide a comprehensive understanding of the claimed invention. However, one skilled in the art would understand that various embodiments may be practiced without such specific details.
Although the features and elements of the present embodiments are described in the embodiments in particular combinations, each feature or element can be used alone without the other features and elements of the embodiments or in various combinations with or without other features and elements disclosed herein.
This written description uses examples of the subject matter disclosed to enable any person skilled in the art to practice the same, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the subject matter is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims.
The entire content of all the publications listed herein is incorporated by reference in this patent application.
This application claims priority to U.S. Provisional Patent Application No. 63/311,247, filed on Feb. 17, 2022, entitled “CHANNEL ESTIMATION FOR FREQUENCY SELECTIVE mmWAVE MIMO SYSTEMS,” the disclosure of which is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
20120201320 | Koike-Akino | Aug 2012 | A1 |
20140098704 | Wang | Apr 2014 | A1 |
20190222406 | Wang | Jul 2019 | A1 |
20220140850 | Luo | May 2022 | A1 |
Entry |
---|
Alkhateeb, A., et al., “Deep Learning Coordinated Beamforming for Highly-Mobile Millimeter Wave Systems,” IEEE Access, Jul. 25, 2018 (published Jun. 25, 2018), vol. 6, pp. 37 328-37 348. |
Baveli, E., et al., “Massive Mimo Channel Estimation with an Untrained Deep Neural Network,” IEEE Transations on Wireless Communications, Mar. 2020 (published Jan. 3, 2020) , vol. 19, No. 3, pp. 2079-2090, arXiv:1908.00144v1 [eess.SP] Jul. 31, 2019. |
Chun, C.-J., et al., “Deep Learning-Based Channel Estimation for Massive MIMO Systems,” IEEE Wireless Communications Letters, Aug. 2019, vol. 8, No. 4, pp. 1228-1231. |
Demire, Ö.T., et al., “Channel Estimation in Massive MIMO Under Hardware Non-Linearities: Bayesian Methods Versus Deep Learning,” IEEE Open Journal of the Communications Society, Jan. 16, 2020 (publication Dec. 16, 2019), vol. 1, pp. 109-124. |
Dong, P., et al., “Deep CNN-Based Channel Estimation for mmWave Massive MIMO Systems,” IEEE Journal of Selected Topics in Signal Processing. Jul. 1, 2019, vol. 13, No. 5, pp. 989-1000, arXiv:1904.06761v2 [cs.IT] Apr. 23, 2021. |
Dörner, S., et al., “Deep Learning-Based Communication Over the Air,” IEEE Journal of Selected Topics Signal Processing, Dec. 15, 2017, vol. 12, No. 1, pp. 132-143, arXiv:1707.03384v1 [stat.ML] Jul. 11, 2017. |
Elbir, A.M., “CNN-based Precoder and Combiner Design in mmWave MIMO Systems,” IEEE Communication Letters, May 9, 2019, vol. 23, No. 7, pp. 1240-1243. |
Elbir, A.M., et al., “Joint Antenna Selection and Hybrid Beamformer Design using Unquantized and Quantized Deep Learning Networks,” IEEE Transaction Wireless on Communications, Dec. 5, 2019, vol. 19, No. 3, pp. 1677-1688, arXiv:1905.03107v2 [eess.SP] Nov. 23, 2019. |
Elbir, A.M., et al., “Online and Offline Deep Learning Strategies for Channel Estimation and Hybrid Beamforming in Multi-Carrier mm-Wave Massive MIMO Systems,” Digital Communications and Networks, Jul. 20, 2022, pp. 1-15, arXiv:1912.10036v3 [eess.SP] Jun. 29, 2020. |
He, H., et al., “Deep Learning-Based Channel Estimation for Beamspace mmWave Massive MIMO Systems,” IEEE Wireless Communications Letters, Oct. 2018, vol. 7, No. 5, pp. 852-855. |
Hodge, J.A., et al., “Multi-Discriminator Distributed Generative Model for Multi-Layer RF Metasurface Discovery,” 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Ottawa, ON, Canada, Nov. 11-14, 2019, pp. 1-5. |
Huang, H., et al., “Deep-Learning-based Millimeter-Wave Massive MIMO for Hybrid Precoding,” IEEE Transactions Vehicular Technology, Mar. 2019 (published Jan. 18, 2019), vol. 68, No. 3, pp. 3027-3032, arXiv:1901.06537v1 [jeess.SP] Jan. 19, 2019. |
Jin, Y., et al., “Channel Estimation for Cell-Free mmWave Massive MIMO Through Deep Learning,” IEEE Transactions on Vehicular Technology, Oct. 2019, vol. 68, No. 10, pp. 10325-10329. |
Long, Y., et al., “Data-driven Based Analog Beam Selection for Hybrid Beamforming under Mm-Wave Channels,” IEEE Journal of Selected Topics in Signal Processing, Mar. 22, 2018, vol. 12, No. 2, pp. 340-352. |
Ma, W., et al., “Sparse Channel Estimation and Hybrid Precoding Using Deep Learning for Millimeter Wave Massive MIMO,” IEEE Transactions on Communications, May 2020 (published Feb. 17, 2020), vol. 68, No. 5, pp. 2838-2849. |
Rodríguez-Fernández, J., et al., “Frequency-domain Compressive Channel Estimation for Frequency-selective Hybrid mmWave MIMO Systems,” IEEE Transactions on Wireless Communications, May 2018 (published Mar. 2, 2018), vol. 17, No. 5, pp. 2946-2960; arXiv:1704.08572v1 [cs.IT] Apr. 27, 2017. |
Soltani, M., et al., “Deep Learning-Based Channel Estimation,” IEEE Communications Letters, Apr. 2019 (published Feb. 12, 2019), vol. 23, No. 4, pp. 652-655, arXiv:1810.05893v2 [cs.IT] Jan. 16, 2019. |
Wei, X., et al., “Deep Learning for Beamspace Channel Estimation in Millimeter-Wave Massive MIMO Systems,” IEEE Transactions on Communications, Jan. 2021 (published Sep. 28, 2020) , vol. 69, No. 1, pp. 182-193, arXiv:1910.12455v3 [eess.SP] Oct. 23, 2020. |
Ye, H., et al., “Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems,” IEEE Wireless Communications Letters, Feb. 2018 (published Sep. 28, 2017), vol. 7, No. 1, pp. 114-117. |
Zhang, K., et al., “Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising,” IEEE Transactions on Image Processing, Jul. 2017 (published Feb. 1, 2017), vol. 26, No. 7, pp. 3142-3155, arXiv:1608.03981v1 [cs.CV] Aug. 13, 2016. |
Number | Date | Country | |
---|---|---|---|
20230300006 A1 | Sep 2023 | US |
Number | Date | Country | |
---|---|---|---|
63311247 | Feb 2022 | US |