The present invention relates to an equalization technique useful for transmitting symbols of high-order constellations that are subject to corruption by inter-symbol interference and other data correlated noise (collectively, “ISI”). ISI refers to a variety of phenomena in data processing systems in which a data signal interferes with itself at a destination. The present invention also relates to the use of reliable symbols to determine values of source symbols that are corrupted by ISI. The present invention finds particular application in systems where source symbols are members of high-order constellations. Previously, such systems have required the use of training symbols for operation in the presence of real-world ISI phenomenon.
ISI phenomena may be modeled mathematically. In the case where the data signal D is populated by a number of data symbols dn, captured signals xn at the destination 120 may be represented as:
xn=a0·dn+f(dn−K
where a0 represents a gain factor associated with the channel 130, f(dn−K
where a−k
ISI is seen as a serious impediment to the use of high-order constellations for data processing systems. A “constellation” is a set of unique values (constellation points) that may represent data symbols. Higher order constellations define a greater number of constellation points than lower order constellations. For example, symbols from a binary constellation, one having only two constellation points, can represent only a single digital bit per symbol. By contrast, symbols from an eight-point constellation, a sixteen-point constellation or a 256-point constellation can represent three, four or eight digital bits per symbol. At a common symbol rate, these higher order constellations can yield higher data throughput than lower order constellations.
Unfortunately, blind equalization (equalization without either an initial training sequence, or ‘refresher’ training sequences) is very hard to achieve with higher order constellations. The detrimental effects of ISI increase with increasing constellation order due to a greater contribution from the
term of Equation 2.
The inventors' co-pending patent application entitled, “Reliable Symbols as a Means of Improving the Performance of Information Transmission Systems,” filed Apr. 18, 2001 having Ser. No. 09/836,281, discloses several techniques for blind estimation of ISI in transmission systems using high-order constellations. The invention described herein and the work presented in the inventors' co-pending foreign applications are believed to be the first practical blind equalization techniques suitable for high-order constellation data systems. The inventors believe that the disclosures herein and the methods described in the co-pending patent applications enable an increased number of reliable symbols to be obtained from captured samples and that this increases the rate and effectiveness of equalization.
Embodiments of the present invention provide fast equalization techniques for systems using high-order constellations where symbols have been corrupted by ISI. The technique allows ISI estimation to begin immediately upon receipt of captured samples. ISI estimation is weighted according to a reliability factor of each captured sample.
The equalizer 200 shown in
ISI Estimation Using Reliability Weighting
Having estimated decoded symbols {circumflex over (d)}n from the captured samples xn, the ISI estimator 220 may revise ISI coefficient estimates. To simplify the nomenclature herein, consider a case where the buffers 240, 230 respectively store a predetermined number L of samples xn and decoded symbols dn (n=1 to L).
In an embodiment, the ISI estimator 220 may employ a least squares estimation to update the ISI coefficients according to:
{â}=(HTWH)−1HTWΔ (3)
where: {â} is a vector of estimated normalized ISI coefficients Δ is a vector that contains elements Δn=zn−{circumflex over (d)}n, representing the difference between the received samples xn and the related decisions {circumflex over (d)}n, H is an L×K matrix containing surrounding symbol estimates, and W is an L×L diagonal weight matrix having weights wn,n that are derived from a reliability factor of an associated captured sample xn (wi,j≡0 for all i≠j). The weight may increase or remain constant with decreasing reliability factor.
In an embodiment, the H matrix may be populated by symbol estimates obtained from the symbol decoder. It may be constructed as an L×K matrix in which each of the L rows contains symbol estimates surrounding the estimated symbol to which the row refers. For example, an ith row may relate to a symbol estimate {circumflex over (d)}1. In a simple embodiment, where ISI is known to occur from symbols on only one side of the decoded symbol {circumflex over (d)}i, the ith row may contain the symbol estimates Hi={{circumflex over (d)}1−K,di−(K−1), . . . ,{circumflex over (d)}i−1}. In the more general case, where ISI may occur from symbols on both sides of the decoded symbol {circumflex over (d)}i, the ith row (Hi) may contain the symbol estimates Hi={{circumflex over (d)}i−K
During ISI estimation, different samples xn may be assigned relative weights based upon associated reliability factors R(xn) of the samples. In a first embodiment, a weight wn,n may be assigned according to a binary weighting scheme. If the reliability factor of a sample is equal to or less than a predetermined threshold, the weight wn,n may be assigned a first value, otherwise the weight may be a second value. For example:
In this embodiment, a sample xn contributes to ISI estimation if and only if it is a reliable symbol.
Alternatively, all samples may contribute to ISI estimation, weighted according to their reliability factors. For example:
In this embodiment, even those samples xn that do not meet the criterion for reliability may contribute to the ISI estimation. However, the contribution of samples with very high reliability factors will be much lower than samples with very low reliability factors. In other words, reliable symbols have greater contribution to ISI estimation than samples that are non-reliable.
In another embodiment, all samples may be permitted to contribute to the ISI estimate but reliable symbols may be given a very large weight in comparison to non-reliable samples. For example:
where f is a ceiling factor that prevents
from exceeding 1 for all non-reliable samples. In this embodiment, any sample that meets the criterion for reliability may be assigned a predetermined weighting value (“1” in the example of Equation 6). All reliable symbols would be equally weighted in the ISI estimation. Any sample that fails the criterion for reliability may be assigned a weight that is proportional to its calculated reliability.
Calculation of the Reliability Factor R(xn)
The inventors' prior application describes several alternative techniques for calculating the reliability factor R of a sample xn. They include:
where K1, K2 represent the numbers of samples adjacent to sample xn that may contribute to ISI corruption. The values ci are constants representing any priori knowledge of the ISI effect that may be available. Generally, if nothing is known about the ISI, then the ci's may all be set equal to 1. In other situations, additional information as to the nature of the channel 130 may be known and the ci's may be given values reflecting this information.
Where samples on only one side of a sample xn contribute to the ISI effect, the reliability factor of the sample xn may be calculated according to:
where K=K2 in Equation (2). In respect to the forgoing reliability factors (Equations (7) and (8)) the xn's may be real for one-dimensional signal structures or complex for two-dimensional signal structures.
For systems using two-dimensional constellations, such as QAM constellations, the reliability factor may be determined using:
where x1
Alternately, the reliability factor R may be calculated from values, {circumflex over (d)}n, of the decoded symbols at the output from the symbol decoder 210. In this embodiment, the evaluation of Equations 7 to 9 may be carried out as follows:
respectively. In Equation 12, the parameters {circumflex over (d)} 1
The predetermined threshold d1im may be determined based on the applications for which the identification method is to be used. In one embodiment, the threshold may be set to the value d1im=(K1+K2)·dmin where dmin is half the distance between two constellation points that are closest together. This threshold is appropriate for the case where
Experiments have shown, however, that operation can be maintained using the same threshold when
The threshold d1im also may vary over time. If the predetermined threshold is increased, then an increased number of samples will be accepted as reliable symbols though, of course, all of these symbols will not be of the same reliability. Similarly, by decreasing the threshold d1im, the number of samples that are designated as reliable symbols will decrease. These symbols will be those symbols with lower reliability factors. During operation of a reliable symbol detection method, the threshold d1im may be varied to maintain a rate of detected reliable symbols at a desired value. For example, if a rate of detected symbols falls below a first rate threshold, the d1im value may be increased. Or, if the rate of detected symbols exceeds a second rate threshold, the d1im value may be decreased.
In a case where captured samples xn may suffer a carrier phase rotation with respect to the source symbols dn, the threshold d1im may be set according to half the width of an annular constellation ring in which the captured sample xn is observed. Further details of the constellation rings are available in the inventors' earlier-filed patent applications and are incorporated herein by reference.
Framing
The foregoing discussion has described ISI estimation from a predetermined number L of samples xn and {circumflex over (d)}n. This predetermined number L implies the use of frames. While the adaptation process described above may be performed on a frame-by-frame basis, additional benefits may be obtained with more sophisticated use of these frames.
A second embodiment, shown in
A third embodiment, shown in
In another embodiment, adaptation may occur on a sample-by-sample basis. In this case, “frames” may have an overlap of L−1 samples.
Identification of reliable symbols may occur according to any of the techniques described in the inventors' prior application. For example, if the reliability factor R(xn) is less than or equal to a limit value d1im, the sample xn may be a reliable symbol. In the equalizer 200, reliability factors may be calculated according to any of the techniques of Equations 7–12 and, in appropriate embodiments, of Equations 14–16 below.
Alternative Equalizer Structures Based on Reliable Symbols
Returning to
Although the foregoing embodiments have described the equalizer 200 as employing a purely blind equalization process, the present invention does not preclude use of training symbols. Training symbols may be a transmitted to provide at the destination 120 a number of received samples that can be used as alternatives to reliable symbols. Following receipt of the training symbol samples, the equalizer 200 may process other samples xn in a blind fashion as described in the foregoing embodiments. This embodiment represents an improvement over other equalizers for high-order constellations because, even though training symbols would be used in the present invention, the training symbols would be of reduced number as compared with known systems. Such a short training sequence may not be of sufficient length to allow complete equalization of the channel but may allow ISI adaptation to begin. In such an embodiment, if successive groups of training symbols are used the period between groups of training symbols may be long compared to the dynamics of the channel and the present invention would continue to equalize the channel during the period between training samples.
According to this embodiment, the selector may be connected both to an original input 670 of the captured samples xn and to the buffer 640. The selector 650 may be controlled by a CONVERGENCE signal output from the ISI estimator 620. When the CONVERGENCE signal indicates that the ISI estimation has not converged, the selector 650 may pass samples xn from the input 670 to the symbol decoder 610. When the ISI signal indicates that the ISI estimation has converged, the selector 650 may pass samples xn from buffer 640 to the symbol decoder 610.
The gate 660 may be coupled to an output of the symbol decoder 610 and also may be controlled by the state of the CONVERGENCE signal. When ISI estimation has not yet converged, the gate 660 may be rendered non-transmissive and may block decoded symbols {circumflex over (d)}n from being output from the equalizer 600. When the ISI estimation does converge and the symbol decoder 610 decodes captured samples xn from the buffer 640, the gate 660 may become transmissive and the equalizer 600 may output the decoded symbols {circumflex over (d)}n.
This embodiment may be advantageous for use in applications where ISI is not expected to fluctuate wildly over the course of several frames. If, for example, it takes 20 frames for an ISI estimation to converge and if it is expected that the estimated ISI coefficients govern the first frame of captured samples, then all 20 frames may be decoded using the ISI estimate, once the estimate has converged. In this case, these 20 frames may be retrieved from the buffer 640 and decoded. The decoded symbols that are obtained from the converged ISI estimate are likely to be more accurate than the decoded symbols that were generated by the symbol decoder 610 prior to convergence. Of course, after the 20 exemplary frames are decoded, the selector 650 may switch back to the input 670 and permit the symbol decoder 610 to decode newly received samples xn.
The Symbol Decoder
The Subtractive Equalizer
Several embodiments of symbol decoders 210, 610 may be employed for use in the equalizers of
where coefficients â1 represent a current ISI estimate and {circumflex over (d)}n−1 represent previously decoded symbols. Initially, for the first frame, the ISI estimate may be set arbitrarily, such as âi=0 for all i. Also, the {circumflex over (d)}n−i that antedates the first captured sample may be set arbitrarily, such as {circumflex over (d)}n−i≡1. The hard decision unit 690 may generate decoded symbols {circumflex over (d)}n from respective re-scattered samples yn. For example, the hard decision unit 690 may generate a decoded symbol {circumflex over (d)}n as the constellation point closest to the re-scattered sample yn.
In an embodiment where the symbol decoder 610 includes a subtractive equalizer 680 and a hard decision unit 690, ISI estimation may be performed using the re-scattered samples yn rather than the estimated symbols {circumflex over (d)}n. ISI coefficients may be estimated according to the techniques disclosed in Equation 3 but, in this embodiment, the vector Δ may represent differences between the received samples xn and the re-scattered samples yn (Δn={xn−yn}) and the matrix H may contain surrounding re-scattered samples. In this embodiment, re-scattered samples yn from the subtractive equalizer 680 may be input to the ISI estimator 620 instead of the estimated symbols {circumflex over (d)}n (shown in phantom in
In this embodiment, the H matrix may be populated by re-scattered samples obtained from the subtractive equalizer. Each row of the matrix may contain re-scattered samples surrounding the sample to which the row refers. For example, an ith row may relate to a symbol estimate yj. In a simple embodiment, where ISI is known to occur from symbols on only one side of the rescattered sample yi, the ith row may contain the rescattered samples Hi={yi−K,yi−(K−1), . . . ,yi−1}. In the more general case, where ISI may occur from symbols on both sides of the rescattered sample yi, the ith row may contain the rescattered samples Hi={yi−K
In such an embodiment, the reliability factor R also may be calculated from values of the rescattered samples yn. The evaluation of Equations 7 to 9 may be carried out as follows:
respectively. In Equation 16, the parameters y1
In an embodiment the subtractive equalizer 680 may be used for a feedback filter in a decision feedback equalizer (DFE).
Symbol Detection Using Maximum Likelihood
In other embodiments, a symbol decoder 210 (
The maximum likelihood estimate of the transmitted signals {dn} conditioned on the observations {xn} may be given by maximizing the likelihood of the observations. This is simply the conditional probability of the captured sample xn conditioned on knowing the past transmitted signals {hnk} and the ISI coefficients {ai}:
{circumflex over (d)}nML={hnk:maxPr(xn|ai)iε[−K1,K2],i≠0; hnkεD)} (18)
Finding the maximum likelihood estimate of the present transmitted signal dn depends upon knowledge of both the past transmitted signals and the ISI coefficients {an}. The probability density function of xn given {dn} and {ai} is simply the probability density function of the noise ωn evaluated at:
Then, the probability density function of Equation 19 can be expressed in terms of a series of further conditioned probability functions, which leads to:
where
denotes the whole set of summation of the function, f(.), each summation running over the whole set of possible constellation points, and Dn+K
The compound probability rule states that Pr(A,B)=Pr(A|B)Pr(B), which after some straightforward manipulation provides the following for Equation 20:
where, Pr(a) is a probability density function (pdf) associated with the ISI coefficients, and Pr(Dn+K
Assuming additive white Gaussian noise of zero mean and variance σ2, then the standard probability density formula for Gaussian noise may be applied:
Finally, for the re-scattered received signal:
where the decision to the received symbol is carried through:
{circumflex over (d)}n={hnk:maxPr(xn|hnkεD)}. (24)
Equation 23, called the “average likelihood” estimation of a hypothesis symbol hk at time n, serves as a basis for decoding symbols. In essence, Equation 23 takes captured signal samples xn and removes the effects of ISI through re-scattering, accomplished through the second term of the exponential
At a destination, for each sample xn, Equation 23 may be performed for every point hnk in the governing constellation. A decoded symbol {circumflex over (d)}n may be estimated as the point hnk having the largest probability of occurrence.
The evaluation of Equation 23 is believed to provide near optimal symbol detection when the ISI coefficients and the transmitted data are unknown. However, it is very difficult to implement in a real-time computing device. Accordingly, other embodiments of the present invention are approximations of the evaluation of Equation 23 that are computationally less complex. These embodiments are discussed below.
Symbol Decoding Using Trellis Based Detection
In another embodiment of the symbol decoder 210, when decoding a sample xn, probability estimations generated from the surrounding symbol samples xn−1 to xn−N may be used. Thus, probabilities for all possible transmitted symbols, Pr(xn−i|hn−iεD),∀iε[−K1,K2],i≠0, may be stored for the surrounding symbols. Where ISI coefficients are known to be real, these probabilities represent √{square root over (M)}K
More conveniently, the calculation may be evaluated for the logarithm of the probabilities (and later converted back to a probability form),
Either of these results may be used with a trellis decoder to obtain the likelihood-based estimate for {circumflex over (d)}n according to Equation 23.
Symbol Decoding Using ISI Coefficient Statistics
Statistical distributions of the ISI coefficients may yield further computational simplifications according to an embodiment of the symbol decoder 210. Unless otherwise known, in this embodiment, the ISI coefficients may be considered to be uniform over their specified ranges {a−K
Since the constant
is independent of hnk, it may be omitted from calculation.
Symbol Decoding Using Past Decisions
In the embodiments discussed previously, Pr(Dn+K
Again, the constant
is independent of hnk and may be omitted from calculation.
Eliminating ISI Ranges in Symbol Decoding
Another embodiment of the symbol decoder 210 simplifies the evaluation of Equation 23 by using the estimate of the ISI coefficients, âi. In this embodiment, symbol estimation may occur according to maximum likelihood estimation of:
Because of the minus sign in the argument of Equation 29, the estimation may become a minimum likelihood analysis:
{circumflex over (d)}n={hnk:min η(xn|hnkεD)}. (30)
It can be observed that this is in fact the subtractive equalizer discussed in Paragraphs 41–44
Using ‘Reliable Symbols’ for Estimation
According to an embodiment, identification of a reliable symbol may be made based upon re-scattered symbols yn rather than the captured samples xn. During operation of the equalizer 200, after an arbitrary number of iterations, the equalizer 200 may produce a set of ISI coefficient estimates, âi, each with an associated error, ãi, such that,
âi=ai+ãi. (31)
The partially equalized signal may be written as:
Substituting into Equation 2 yields.
which by examining Equation (28) and defining the error of the estimated symbol as {circumflex over (d)}i=di+{tilde over (d)}i, Equation (30) becomes,
This is a generalization of Equation 2, where the ISI estimates are completely unknown, so that ŷn=y′n and ãi=−ai.
From Equation 34, the residual ISI on the partially equalized symbol point, yn, becomes the inner product of the surrounding data symbols with the ISI error coefficients, ãi, and an additional inner product of the decision errors and the ISI coefficients. Since the ISI error coefficients are smaller then the ISI coefficients, surrounding symbols with higher energy will contribute less to the ISI than they would under the structure of Equation 2. Thus, the probability of identifying a sample as a reliable symbol increases, even though the energies of surrounding symbols can be large. As the quality of the estimate increases, the inner product
will remain acceptably low even for surrounding symbols of relatively high energy.
The demodulator 710 may capture a signal from a channel and from which, captured samples xn may be generated. The channel may be an electric, magnetic, optical or acoustic propagation medium. Demodulators 710 for capturing such signals are well known. The captured samples typically have no detectable correspondence to points of the governing constellation. They may take any number of values between the constellation points (e.g. 6.3, 6.5, −3.1). Captured sample data may be stored in a buffer 722 in the memory 720.
The memory system 720 may be logically organized to perform storage functions for the receiver 700 to operate as an equalizer. A first area 722 of the memory may store captured samples xn for further processing. This area 722 may constitute the frame buffers 240, 640 described with reference to
As dictated by the instructions, processor 730 operation may be divided logically into functional units including a reliable symbol detector 732, a symbol decoder 736 and an ISI estimator 734. The processor 730 may be a general-purpose processor, a digital signal processor or a collection, of processing elements. Alternatively, the functional units 732–736 may be discrete processing circuits of an application specific circuit or other hardware system.
Several embodiments of the present invention are specifically illustrated and described herein. However, it will be appreciated that modifications and variations of the present invention are covered by the above teachings and within the purview of the appended claims without departing from the spirit and intended scope of the invention.
Number | Date | Country | Kind |
---|---|---|---|
9926167.4 | Nov 1999 | GB | national |
0016938.3 | Jul 2000 | GB | national |
00/02634 | Jul 2000 | WO | international |
00/02648 | Jul 2000 | WO | international |
This application is a continuation-in-part of the following applications: U.S. patent application Ser. No. 09/836,281, filed Apr. 18, 2001, WIPO 00/02634, filed Jul. 10, 2000 (which benefits from the priority of UK application 16938.3, also filed Jul. 10, 2000), and WIPO 00/02648, filed Jul. 10, 2000 (which benefits from the priority of UK application 9926167.4, filed Nov. 4, 1999), the disclosures of which is incorporated herein by reference. Certain claims may benefit from the priority of these applications.
Number | Name | Date | Kind |
---|---|---|---|
4227152 | Godard et al. | Oct 1980 | A |
4847797 | Picchi et al. | Jul 1989 | A |
5214675 | Mueller et al. | May 1993 | A |
5229767 | Winter et al. | Jul 1993 | A |
5444712 | Betts et al. | Aug 1995 | A |
5533048 | Dolan | Jul 1996 | A |
5533050 | Isard et al. | Jul 1996 | A |
5541964 | Cohen et al. | Jul 1996 | A |
5550924 | Helf et al. | Aug 1996 | A |
5553102 | Jasper et al. | Sep 1996 | A |
5694423 | Larsson et al. | Dec 1997 | A |
5742642 | Fertner | Apr 1998 | A |
5793807 | Werner et al. | Aug 1998 | A |
5809074 | Werner et al. | Sep 1998 | A |
5818876 | Love | Oct 1998 | A |
5825832 | Benedetto | Oct 1998 | A |
5835731 | Werner et al. | Nov 1998 | A |
5867539 | Koslov | Feb 1999 | A |
5887035 | Molnar | Mar 1999 | A |
5901185 | Hassan | May 1999 | A |
5940440 | Werner et al. | Aug 1999 | A |
6075816 | Werner et al. | Jun 2000 | A |
6115433 | de Lantremange | Sep 2000 | A |
6259743 | Garth | Jul 2001 | B1 |
6272171 | Okunev et al. | Aug 2001 | B1 |
6275990 | Dapper et al. | Aug 2001 | B1 |
6278730 | Tsui et al. | Aug 2001 | B1 |
6304593 | Alouini et al. | Oct 2001 | B1 |
6304594 | Salinger | Oct 2001 | B1 |
6310909 | Jones | Oct 2001 | B1 |
6347125 | Dent | Feb 2002 | B1 |
6421394 | Tanrikulu | Jul 2002 | B1 |
6426972 | Endres et al. | Jul 2002 | B1 |
6438174 | Isaksson et al. | Aug 2002 | B1 |
6456669 | Sakoda | Sep 2002 | B1 |
6477215 | Temerinac | Nov 2002 | B1 |
6487244 | Betts | Nov 2002 | B1 |
6490270 | Krishnamoorthy et al. | Dec 2002 | B1 |
6549584 | Gatherer et al. | Apr 2003 | B1 |
6556634 | Dent | Apr 2003 | B1 |
6560272 | Komatsu | May 2003 | B1 |
6567475 | Dent et al. | May 2003 | B1 |
6577683 | Waldron et al. | Jun 2003 | B1 |
6581179 | Hassan | Jun 2003 | B1 |
6603752 | Saifuddin et al. | Aug 2003 | B1 |
6618451 | Gonikberg | Sep 2003 | B1 |
6661837 | Abdelilah et al. | Dec 2003 | B1 |
6665308 | Rakib et al. | Dec 2003 | B1 |
6704324 | Holmquist | Mar 2004 | B1 |
6717934 | Kaasila et al. | Apr 2004 | B1 |
6804267 | Long et al. | Oct 2004 | B1 |
6842495 | Jaffe et al. | Jan 2005 | B1 |
20040042566 | Eidson et al. | Mar 2004 | A1 |
20040179578 | Ben Rached et al. | Sep 2004 | A1 |
Number | Date | Country |
---|---|---|
0 625 829 | Nov 1984 | EP |
0 845 891 | Jun 1998 | EP |
1 024 631 | Aug 2000 | EP |
WO 9923795 | May 1999 | WO |
Number | Date | Country | |
---|---|---|---|
20030016769 A9 | Jan 2003 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09836281 | Apr 2001 | US |
Child | 09899843 | US |