Turbo code decoder with controlled probability estimate feedback

Information

  • Patent Grant
  • 6223319
  • Patent Number
    6,223,319
  • Date Filed
    Thursday, August 20, 1998
    25 years ago
  • Date Issued
    Tuesday, April 24, 2001
    23 years ago
Abstract
A feedback control for a turbo decoder controls the feedback between component decoders by modifying updated a priori probabilities calculated by one component decoder and used as inputs to another component decoder during the decoding process, resulting in a significant performance advantage. A feedback control switch selects either previously estimated a posteriori probabilities, modifications of these values, or neutral values as a priori probabilities utilized by the next component decoder.
Description




BACKGROUND OF THE INVENTION




The present invention relates generally to error-correction coding and, more particularly, to parallel concatenated convolutional coding, i.e., turbo coding.




A new class of forward error control codes, referred to as turbo codes, offers significant coding gain for power limited communication channels. Turbo codes are generated by using two recursive systematic encoders operating on different orderings of the same information bits. A subset of the code bits of each encoder is transmitted to maintain bandwidth efficiency. Turbo decoding involves an iterative algorithm in which probability estimates of the information bits that are derived for one of the codes are fed back to a probability estimator for the other code. Each iteration of processing generally increases the reliability of the probability estimates. This process continues, alternately decoding the two code words until the probability estimates can be used to make reliable decisions.




The maximum a posteriori (MAP) type algorithm introduced by Bahl, Cocke, Jelinek, and Raviv in “Optimal Decoding of Linear Codes for Minimizing Symbol Error Rate”,


IEEE Transactions on Information Theory,


March 1974, pp. 284-287, is particularly useful as a component decoder in decoding parallel concatenated convolutional codes, i.e., turbo codes. The MAP algorithm is used in the turbo decoder to generate a posteriori probability estimates of the systematic bits in the code word. These probability estimates are used as a priori symbol probabilities for the second MAP decoder. Three fundamental terms in the MAP algorithm are: forward and backward state probability functions (the alpha and beta functions, respectively) and the a posteriori transition probabilities (the sigma function).




Various probability estimates comprise inputs at several points in a MAP decoding algorithm. It is desirable to modify or restrict these probability inputs in a MAP decoding algorithm in order to improve decoding performance, such as, for example, decrease the probability of error in the decoded bits.




SUMMARY OF THE INVENTION




A feedback control for a turbo decoder controls the feedback between component decoders of the turbo decoder by updated a priori probabilities calculated by one component decoder and used as inputs to another component decoder during the decoding process, resulting in a performance advantage. A feedback control switch selects either previously estimated a posteriori probabilities, modifications of these values, or neutral values as a priori probabilities utilized by the next component decoder. In one embodiment, unmodified, or standard, a posteriori probabilities from a prior decoding iteration of a component code word are inputted as a priori information is used in the alpha and beta calculations for all decoding iterations, but neutral values are switched in for all sigma calculations except for the final iteration for which the feedback control switch reverts back to full a priori information.











BRIEF DESCRIPTION OF THE DRAWINGS





FIG. 1

is a block diagram of a simple communications system comprising a Markov source, a memoryless channel and decoder;





FIG. 2

is a block diagram of a turbo decoder in accordance with preferred embodiments of the present invention;





FIG. 3

is a block diagram of the bit probability estimator of

FIG. 2

;





FIG. 4

graphically illustrates a soft limiter with a dead zone at x=½; and





FIG. 5

is a flow chart illustrating modification of a priori probabilities as a function of iteration index in accordance with preferred embodiments of the present invention.











DETAILED DESCRIPTION OF THE INVENTION




Summary of the MAP Decoding Algorithm




The maximum a posteriori (MAP) algorithm for decoding linear codes was published by Bahl, Cocke, Jelinek, and Raviv, as cited hereinabove. Basically, this algorithm calculates the a posteriori probability of each state in a trellis corresponding to a received code word conditioned on the entire received code word. A variation of this algorithm calculates the a posteriori probability of each state transition in a trellis corresponding to a received code word conditioned on the received channel information. Since this variation is of particular interest when decoding recursive systematic convolutional codes, which are typically utilized in turbo coding, the description of the invention will be built around this form of the algorithm. However, the invention also applies to the version of the MAP algorithm that calculates a posteriori state probabilities in a straightforward manner.




Consider the simple communication system block diagram of

FIG. 1

for the purpose of describing the MAP algorithm. The source


10


is a discrete-time, finite-state Markov process, shown as comprising a source


11


, an encoder


12


, and a mapping device


13


. As shown, the source's output at time t is X


t


and the corresponding channel


14


output is Y


t


, which is provided as the input to a decoder


16


. The following definitions are also needed to describe the MAP algorithm. Let




M=the number of distinct states of the Markov source;




m=the index of the Markov source's states {0,1, . . . , M−1};




S


t


=state of the Markov source at time t;




S


t




u


=S


t


, S


t+1


, . . . S


u


, the state sequence of the Markov source from time t to time u;




X


t




u


=X


t


, X


t+1


, . . . X


u


, the output sequence of the Markov source from time t to time u;




Y


t




u


=Y


t


, Y


t+1


, . . . Y


u


, the output sequence of the channel from time t to time u, and




L=the length of the source's output sequence.




Furthermore, it is assumed that the Markov source's initial state S


O


=0 and its final state S


L


=0.




The channel is noisy and memoryless so that a sequence of the source's output symbols X


t




u


is transformed into a sequence of channel outputs Y


t




u


according to the following channel transition probabilities.








Pr{Y




t




u




|X




t




u




}=Pr{Y




t




|X




t




}Pr{Y




t+1




|X




t+1




} . . . Pr{Y




u




|X




u


}  (1)






The decoder examines the received channel output sequence and estimates the a posteriori probabilities of the Markov source's states or state transitions. The state a posteriori probabilities Pr{S


t


=m|Y


1




L


} can be written as








Pr{S




t




=m|Y




1




L




}=Pr{S




t




=m; Y




1




L




}|Pr{Y




1




L


}  (2)






using the definition of conditional probability. Our notation is as follows: Pr{A|B} means the conditional probability of event A given event B, and Pr{A;B} means the joint probability of events A and B. Similarly, the source's state transition a posteriori probabilities can be written as








Pr{S




t−1




=m′; S




t




=m|Y




1




L




}=Pr{S




t−1




=m′; S




t




=m; Y




1




L




}|Pr{Y




1




L


}.  (3)






It turns out that it is easier to derive an algorithm to calculate the joint probabilities on the right-hand sides of equations (2) and (3). The desired conditional probabilities can then be obtained by simply dividing these joint probabilities by the constant Pr{Y


1




L


}. To clarify the derivation, Bahl et al. defined the following probability functions.






α


t


(


m


)=


Pr{S




t




=m; Y




1




t


}  (4)








β


t


(


m


)=


Pr{Y




t+1




L




|S




t




=m}


  (5)








γ


t


(


m′,m


)=


Pr{S




t




=m; Y




t




|S




t−1




=m′}


  (6)






It can be shown that








Pr{S




t




=m; Y




1




L




}=α




t


(


m





t


(


m


) and  (7)










Pr{S




t−1




=m′; S




t




=m; Y




1




L


}=α


t−1


(


m


′)γ


t


(


m′,m





t


(


m


)  (8)






so all that remains is to calculate the values of α


t


(m) γ


t


(m′,m) and β


t


(m) for all values of m and t. It can be shown that for t=1,2, . . . , L, α


t


(m) can be calculated recursively as follows.











α
t



(
m
)


=





m


=
0


M
-
1










α

t
-
1




(

m


)





γ
t



(


m


,




m

)








(
9
)













For t=0, the boundary conditions are α


0


(


0


)=1 and α


0


(m)=0 for all m≠0. Similarly, β


t


(m) can be calculated recursively for t=1,2, . . . , L−1.











β
t



(
m
)


=





m


=
0


M
-
1










β

t
+
1




(

m


)





γ

t
+
1




(

m
,





m



)








(
10
)













For t=L, the boundary conditions are β


L


(


0


)=1 and β


L


(m)=0 for all m≠0. In the calculation of γ


t


, this quantity may be expanded as











γ
t



(

m
,





m



)


=



X



Pr


{


S
t

=


m
|

S

t
-
1



=

m




}


Pr


{



X
t

=


X
|

S
t


=
m


;






S

t
-
1


=

m




}


Pr


{


Y
t

|
X

}







(
11
)













For the cases of interest to us, the source's mapping of state transitions to output symbols is deterministic; i.e. there is only one possible output symbol X for each state transition, so that Pr{X


t


|S


t


=m; S


t−1


=m′}=1 and γ


t


(m′,m) can be written as






γ


t


(


m′,m


)=


Pr{S




t




=m|S




t−1




=m′}Pr{Y




t




|X}.


  (12)






The calculation of Pr{S


t−1


=m′; S


t


=m; Y


1




L


} using the algorithm of Bahl et al. can be summarized as follows.




1. α


0


(


0


)=1 and α


0


(m)=0 for all m≠0. β


L


(


0


)=1 and β


L


(m)=0 for all m≠0.




2. As soon as Y


t


is received, the decoder computes γ


t


(m′,m) using equation (12) and α


t


(m) using equation (9). The calculated values of α


t


(m) are stored for all t and m. The calculated values of γ


t


(m′,m) are stored for all t and all transitions (m′,m) or calculated as needed.




3. After the complete sequence of channel outputs Y


1




L


is received, the decoder recursively computes β


t


(m) using equation (10). When all of the β


t


(m) have been computed, they can be multiplied by the appropriate α


t−1


(m′) and γ


t


(m′,m) to obtain Pr{S


t−1


=m′; S


t


=m; Y


1




L


} as in equation (8).




When decoding trellis codes, the Markov source of

FIG. 1

can be modeled as comprising a source of information bits, an encoder for the error correcting trellis code, and a mapping device that converts the encoder's output into symbols X


t


, which are transmitted over the channel.




The term Pr{S


t


=m|S


t−1


=m′}, the encoder's conditional state probability, in equation (12) is calculated as










Pr


{


S
t

=


m
|

S

t
-
1



=

m




}


=




i
=



(

t
-
1

)


k

+
1


tk







Pr


{


d
i

=


a
i



(


m


,




m

)



}







(
13
)













for an (n,k,v) code where Pr{d


i


=a


i


(m′, m)} is the a priori probability that d


i


=a


i


(m′,m) and a


i


(m′,m) is the i


th


bit of the sequence a(m′,m) of k bits that drives the encoder from state m′ to state m. This equation holds when the code's trellis does not have parallel branches. (If the code's trellis does have parallel branches, then Pr{S


t


=m|S


t−1


=m′} is calculated as the sum of products of bit a priori probabilities in which the sum is over all of the sequences of source bits a(m′,m) that drive the encoder from state m′ to state m.)




In the decoder, we are interested in event likelihood ratios; specifically, we are interested in Pr{d


τ


=1|Y


1




L


}/Pr{d


τ


=0|Y


1




L


}, where Pr{d


τ


=i|Y


1




L


} represents the a posteriori probability that data bit d


τ


from the source is equal to iε {0,1}. Here,













Pr


{


d
τ

=

0
|

Y
1
L



}


=









(


m


,




m

)




A
t



(
τ
)










Pr


{



S

t
-
1


=

m



;






S
t

=

m
|

Y
1
L




}









=










(


m


,




m

)




A
t



(
τ
)






Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}




Pr


{

Y
1
L

}










(
14
)













In the equation above A


t


(τ) is the set of all state transitions (m′,m) in the encoder which terminate at time t due to an information bit d


τ


=0. Recall that in general there are k source bits encoded into each n-bit encoder output symbol so that d


τ


for indices τ=(t−1)k+1, (t−1)k+2, . . . , tk are associated with the state transition S


t−1


to S


t


. Also,













Pr


{


d
τ

=

1
|

Y
1
L



}


=









(


m


,




m

)




B
t



(
τ
)






Pr


{



S

t
-
1


=

m



;






S
t

=

m
|

Y
1
L




}









=










(


m


,




m

)




B
t



(
τ
)






Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}




Pr


{

Y
1
L

}










(
15
)













In the equation above B


t


(τ) is the set of all state transitions (m′,m) in the encoder which terminate at trellis level t due to an information bit d


τ


=1. Since we are working with the likelihood ratio Pr{d


τ


=1|Y


1




L


}/Pr{d


τ


=0|Y


1




L


}, it is not necessary to calculate Pr{S


t−1


=m′; S


t


=m|Y


1




L


}; we may use Pr{S


t−1


=m′; S


t


=m; Y


1




L


} directly since Pr{Y


1




L


} is common to the numerator and denominator. Therefore, the desired likelihood ratio from the decoder is













λ


(

d
τ

)


=


Pr


{


d
τ

=

1
|

Y
1
L



}



Pr


{


d
τ

=

0
|

Y
1
L



}









=







(


m


,




m

)




B
t



(
τ
)






Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}








(


m


,




m

)




A
t



(
τ
)






Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}




.








(
16
)













Since the joint probability Pr{S


t−1


=m′; S


t


=m; Y


1




L


} is used often herein, the following notation from Bahl et al. is introduced for brevity.











σ
t



(


m


,




m

)


=


Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}


=



α

t
-
1




(

m


)





γ
t



(


m


,




m

)





β
t



(
m
)








(
17
)













When the encoder's input symbols are binary, i.e. k=1, equations (13) through (16) can be simplified since τ=t in this case. The simplified equations are presented below.








Pr{S




t




=m|S




t−1




=m′}=P{d




t




=a


(


m′,m


)}, where  (18)






a(m′,m)=the bit value that drives the encoder from state m′ to state m.
















Pr


{


d
t

=

1
|

Y
1
L



}


=









(


m


,




m

)



A
t









Pr


{



S

t
-
1


=

m



;






S
t

=

m
|

Y
1
L




}









=










(


m


,




m

)



A
t





Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}




Pr


{

Y
1
L

}










=










(


m


,
m

)



A
t






σ
t



(


m


,
m

)




Pr


{

Y
1
L

}




,








where






(
19
)













A


t


=the set of all state transitions (m′,m) which terminate at level t in the encoder due to an information bit d


t


=0.
















Pr


{


d
t

=

1
|

Y
1
L



}


=









(


m


,




m

)



A
t









Pr


{



S

t
-
1


=

m



;






S
t

=

m
|

Y
1
L




}









=










(


m


,




m

)



A
t





Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}




Pr


{

Y
1
L

}










=










(


m


,
m

)



A
t






σ
t



(


m


,
m

)




Pr


{

Y
1
L

}




,








where






(
20
)













B


t


=the set of all state transitions (m′,m) which terminate at trellis level t in the encoder due to an information bit d


t


=1.













λ


(

d
t

)


=


Pr


{


d
t

=

1
|

Y
1
L



}



Pr


{


d
t

=

0
|

Y
1
L



}









=






(


m


,




m

)



B
t





Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}








(


m


,




m

)



A
t





Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}










=







(


m


,




m

)



B
t






σ
t



(


m


,




m

)








(


m


,




m

)



A
t






σ
t



(


m


,




m

)




.








(
21
)













Description of the Log-MAP Decoder




The MAP decoder algorithm presented earlier requires a large number of multiplications. For some implementations wherein a large number of multiplications may be impractical, e.g., integrated circuit implementations, a logarithmic version of the MAP algorithm has been derived that eliminates all multiplication operations. The log-MAP algorithm primarily uses additions, table look-ups, and some simple logic functions. In an integrated circuit implementation of a decoder for trellis codes, the replacement of multiplications with additions enables large savings in gate count (die area) and significant increases in decoding speed. The following is a summary of the basic log-MAP algorithm.




Equations (7) through (10) become











ln





Pr


{



S
t

=
m

;





Y
1
L


}


=


ln







α
t



(
m
)



+

ln







β
t



(
m
)





,




(
22
)










ln





Pr


{



S

t
-
1


=

m



;






S
t

=
m

;





Y
1
L


}


=





ln







σ
t



(


m


,




m

)









=






ln







α

t
-
1




(

m


)



+

ln







γ
t



(


m


,




m

)











=





ln







β
t



(

m


)




,







(
23
)








ln







α
t



(
m
)



=

ln










m


=
0


M
-
1








exp


(


ln







α

t
-
1




(

m


)



+

ln







γ
t



(


m


,




m

)




)





,





and





(
24
)







ln







β
t



(
m
)



=

ln










m


=
0


M
-
1









exp


(


ln







β

t
+
1




(

m


)



+

ln







γ

t
+
1




(

m
,





m



)




)


.







(
25
)













Equations (24) and (25) are derived from equations (9) and (10), respectively, by applying the identity








a·b


=exp(


ln[a·b


])=exp(


ln a+ln b


)






to the product terms. For example, equation (24) is derived as follows:










ln







α
t



(
m
)



=

ln










m


=
0


M
-
1






α

t
-
1




(

m


)









γ
t



(


m


,




m

)











=

ln










m


=
0


M
-
1








exp


(

ln


[



α

t
-
1




(

m


)









γ
t



(


m


,




m

)



]


)










=

ln










m


=
0


M
-
1









exp


(


ln







α

t
-
1




(

m


)



+

ln







γ
t



(


m


,




m

)




)


.
















The boundary conditions are now ln α


0


(


0


)=0 and ln α


0


(m)=−∞ for all m≠0. Similarly, ln β


L


(


0


)=0 and ln β


L


(m)=−∞ for all m≠0. In a practical implementation, a large negative number is substituted for −∞.




The sum of exponential terms can be computed by applying the following identity.








ln


[exp(


a


)+exp(


b


)]=max(


a,b


)+


ln[


1+exp(−|


a−b|


)]  (26)






Computational complexity can be significantly reduced by storing a table of values for the function ln[1+exp(−|a−b|)] and applying equation (26). Experimentation has shown that 8 or 16 values of this function provide sufficient resolution to prevent performance degradation.




Equation (12) becomes








ln γ




t


(


m′,m


)=


ln Pr{S




t




=m|S




t−1




=m′}+ln Pr{Y




t




|X}.


  (27)






Preferred Embodiments of the Invention




Turbo codes involve a parallel concatenation of two or more systematic codes. Decoding turbo codes is an iterative operation such that the work in decoding one component code is used as a priori information for decoding another component code. Iterations proceed a finite number of times with the passing of information between decoders comprising feedback in the decoding process. In accordance with preferred embodiments of the present invention, this feedback is controlled to improve decoder performance, e.g., by decreasing the probability of error in the decoded bits.




As set forth hereinabove, some of the fundamental terms in a MAP decoding algorithm are forward and backward state probabilities, commonly known as the alpha and beta functions, and a posteriori state transition probabilities, commonly known as the sigma functions. Calculations of these probabilities (i.e., the alpha, beta and sigma functions) require symbol transition probabilities, i.e., the gamma functions. From Bahl, Cocke, Jelinek, and Raviv in “Optimal Decoding of Linear Codes for Minimizing Symbol Error Rate”, cited hereinabove,











γ
t



(


m


,




m

)


=




X

t









P
t



(

m
|

m



)





q
t



(


X
|

m



,




m

)




R


(


Y
t

|

X
t


)








(
28
)













where t is the symbol index and










R


(


Y
t

|

X
t


)


=




j
=
1

J







R


(


Y
tj

|

X
tj


)







(
29
)













where J is the number of bits comprising an encoder output symbol , X


tj


is the j


th


bit of symbol X


t


and Y


tj


is the j


th


channel output for received symbol Y


t


, assuming binary signaling.




In a recursive systematic code, a single transition (m′, m) determines a specific channel symbol X


t


so that the summation in equation (28) is eliminated and the function q


t


(X


t


|m′,m) is identically equal to one. Also, for a (2, 1) code, the channel transition probabilities are computed as the product of two one-dimensional transition probabilities for the information and parity bits; that is,








R


(


X




t




|Y




t


)=


R


(


Y




ti




|Xt




ti


)


R


(


Y




tp




|X




tp


).  (30)






Furthermore, in turbo decoding, the conditional state probabilities are determined by the a priori bit probabilities as follows:








P




t


(


m|m


′)=


AP




t


(


0


) if


X




ti




|m,m′=


0  (31)










P




t


(


m|m


′)=


AP




t


(


1


) if


X




ti




|m,m′=


1  (32)






so that






γ


t


(


m′,m


)=


AP


(


0


)


R


(


Y




i


|


0


)


R


(


Y




p




|X




p


) if


X




ti




|m,m′=


0  (33)






and






γ


t


(


m′,m


)=


AP


(


1


)


R


(


Y




i


|


1


)


R


(


Y




p




|X




p


) if


X




ti




|m,m′=


1  (34).






The time index has been omitted in equations (27) and (28) for brevity.




The output of a MAP component decoder is an a posteriori probability estimate of the systematic symbols, denoted herein as APP


t


(


0


) and APP


t


(


1


). These a posteriori estimates are used as the a priori probabilities AP


t


(


0


) and AP


t


(


1


) for decoding another component code. The probability estimates are initialized to AP(


0


)=AP(


1


)=0.5, or the equivalent neutral value if working with the logarithm based algorithm, after which the component decoders use the output APP's of the other component decoders as input AP's.




The gamma values from equation (28) are used in three calculations in the MAP algorithm, i.e., in the recursions that generate the alpha and beta state probabilities, and in the sigma calculations. The input AP's are modified in these calculations in order to control feedback and improve performance in accordance with preferred embodiments of the present invention.




For a linear MAP algorithm, the AP values initially provided to the first decoder are AP


t


(


0


)=AP


t


(


1


)=0.5. The input to the next component decoder, and all subsequent MAP component decoders, comprises the latest available APP


t


's from the other decoders as input AP


t


's. This is illustrated in

FIG. 2

wherein blocks


20


and


22


represent bit probability estimators for the first and second component decoders, respectively. Associated turbo decoder interleavers and deinterleavers are represented by the numerals


24


and


26


, respectively. The input AP's are only used to calculate the gamma values required in the alpha and beta recursions. In a preferred embodiment of this invention, the gamma values, which are utilized in the sigma calculations, are calculated using AP


t


(


0


)=AP


t


(


1


)=0.5 for all t. In general, feedback control switches within the bit probability estimator select either the previously estimated AP value, a modification of the previously estimated AP value (blocks


28


), or the neutral value (blocks


28


).





FIG. 3

is a more detailed illustration of bit probability estimator


20


of FIG.


2


. As shown, bit probability estimator


20


comprises an alpha probability calculator


15


, a beta probability calculator


17


, a sigma calculator


19


, and an AP estimate calculator


21


for calculating the respective terms in accordance with the equations set forth hereinabove. In addition,

FIG. 3

clearly illustrates how feedback control switches


27


in accordance with preferred embodiments of the present invention choose between the AP estimate from bit probability estimator


20


(

FIG. 2

) or the modified AP estimate from block


28


. The AP estimates used in the alpha and beta probability calculators are selected independently by feedback control


29


from the AP estimates utilized in the sigma calculator, as shown in FIG.


3


.




In one preferred embodiment, full a priori information is used for all alpha and beta calculations, and neutral a priori values are switched in for all sigma calculations, except for the final iteration for which the feedback control switch is switched back to full a priori information.




Feedback is reduced most significantly when neutral values are inserted. A compromise between full feedback and the neutral value is provided by a modified AP value. A simple modified estimate calculation useful in the linear MAP algorithm is as follows:










AP
mod

=



AP
+
0.5

2

.





(
35
)













Another modified a priori probability estimate useful in either the linear MAP algorithm or the log-MAP algorithm is calculated as a function of the decoding iteration count, as illustrated in the flow chart of FIG.


5


. The variables for this procedure are set forth as follows: i represents the iteration count; N


i


represents the number of decoding iterations to be used; and i


s


represents the starting iteration index for using a function of a posteriori bit probabilities as a priori bit (or state transition) probabilities. Then, for iteration indices i


s


, i


s


+1, . . . , N


i


, AP


mod


=ƒ(AP,i). An exemplary type of modified a priori probability calculation is represented graphically in

FIG. 4

as a modified soft limiter function ƒ. In particular, the soft limiter function ƒ has been modified to allow a dead zone in the vicinity of AP=0.5 when b, a parameter of the function ƒ, is not equal to 0.5. In accordance with preferred embodiments of the present invention, parameters a, b and c of the function ƒ are functions of the iteration index in order to allow more (or, alternatively, less) feedback between component decoders as decoding proceeds.




The flow chart of

FIG. 5

illustrates how the parameters, and hence the function ƒ, change with iteration index. Specifically, the process illustrated in

FIG. 5

represents one preferred embodiment of the Modified AP Estimate block


28


of FIG.


2


. The parameter update and a priori estimate modification process are summarized in the description that follows.




In decision block


30


, a test is made to determine whether it is the first iteration, i.e., whether i=1. If so, the variables i


s


N


i


, a(i


s


), a(N


i


), b(i


s


), b(N


i


), c(i


s


), and c(N


i


) are initialized in block


32


. In block


34


, a decision is made as to whether the starting iteration index (for function parameter updates) is less than the number of decoding iterations. If so, then Δa, Δb, and Δc are calculated in block


36


as follows:










Δ





a

=



a


(

N
i

)


-

a


(

i
s

)





N
i

-

i
s







(
36
)







Δ





b

=



b


(

N
i

)


-

b


(

i
s

)





N
i

-

i
s







(
37
)







Δ





c

=



c


(

N
i

)


-

c


(

i
s

)





N
i

-

i
s







(
38
)













If i>i


s


, as determined in block


38


, then the parameters a, b and c are updated in block


40


before the modified a priori probabilities are calculated in block


42


. If i=i


s


, as determined in block


44


, then the process bypasses block


40


and proceeds directly to block


42


. If i<i


s


, then AP


t


(j) is set equal to ½ or another neutral value, which is suitable for the application of interest, in block


46


for all t and all j.




In one preferred embodiment, full a priori information is used for all alpha and beta calculations, and modified a priori probability values, calculated as a function of the iteration count, are switched in for all sigma calculations, except for the final iteration for which the feedback control switch is switched back to full a priori information.




Other alternative embodiments include utilization of weighted averages of the a priori estimates obtained from previous decoding iterations, thus allowing partial a priori information in the sigma calculations.




While the preferred embodiments of the present invention have been shown and described herein, it will be obvious that such embodiments are provided by way of example only. Numerous variations, changes and substitutions will occur to those of skill in the art without departing from the invention herein. Accordingly, it is intended that the invention be limited only by the spirit and scope of the appended claims.



Claims
  • 1. A method for decoding turbo codes, comprising:iteratively calculating forward and backward state probabilities and a posteriori state transition probabilities for component code words of turbo codes according to a MAP decoding process; feeding back the a posteriori state transition probabilities as a priori state transition probabilities for use in decoding other component code words comprising the turbo code words, the initial a priori state transition probability comprising a predetermined value, each subsequent a priori state transition probability being based on previous a posteriori probability estimates.
  • 2. The method of claim 1 wherein the subsequent a priori state transition probability estimates comprise either the latest available a posteriori probability estimates, modified a posteriori probability estimates, or neutral values, or a combination thereof.
  • 3. The method of claim 1, further comprising the step of utilizing an iteration index and providing modified a posteriori estimates as a function of the iteration index.
  • 4. The method of claim 1 wherein the modified a posteriori probability estimates (APmod) are calculated from the a posteriori estimates (AP) as follows: APmod=AP+0.52.
  • 5. The method of claim 1 wherein the modified a posteriori probability estimates are calculated using a modified soft limiter function.
  • 6. The method of claim 1 wherein the MAP decoding process comprises a logarithmic MAP decoding process.
  • 7. The method of claim 1, comprising utilizing the a posteriori state transition probabilities as the a priori state transition probabilities for the previous decoding iteration for all forward and backward state probability calculations, and switching in neutral values for calculating modified symbol transition probabilities, which are used in all a posteriori transition probability calculations, except for the final iteration wherein the method comprises switching back in the a posteriori state transition probability from the previous decoding iteration as the a priori information for all terms comprising the final a posteriori transition probability calculation.
  • 8. The method of claim 1 wherein the forward and backward state probabilities and the a posteriori state transition probabilities for the component code words are independently controlled.
  • 9. A decoder for decoding turbo codes, comprising:a state transition probability calculator for iteratively calculating forward and backward state probabilities and a posteriori state transition probabilities for component code words of turbo codes according to a MAP decoding process; a feedback control for feeding back the a posteriori state transition probabilities as a priori state transition probabilities for use in decoding other component code words comprising the turbo code words, the initial a priori state transition probability comprising a predetermined value, each subsequent a priori state transition probability being based on previous a posteriori probability estimates.
  • 10. The decoder of claim 9 wherein the feedback control provides subsequent a priori state transition probability estimates as either the latest available a posteriori probability estimates, modified a posteriori probability estimates, or neutral values, or a combination thereof.
  • 11. The decoder of claim 9, further comprising an iteration index counter, the feedback control providing modified a posteriori estimates as a function of an iteration index.
  • 12. The decoder of claim 9 wherein the state transition probability calculator calculates the modified a posteriori probability estimates (APmod) from the a posteriori estimates (AP) as follows: APmod=AP+0.52.
  • 13. The decoder of claim 9 wherein the state transition probability calculator further comprises a modified soft limiter for calculating the modified a posteriori probability estimates.
  • 14. The decoder of claim 9 wherein the MAP decoding process comprises a logarithmic MAP decoding process.
  • 15. The decoder of claim 9 wherein the state transition probability calculator utilizes the a posteriori state transition probabilities as the a priori state transition probabilities calculated in the previous decoding iteration for all forward and backward state probability calculations, and further comprises switch means for switching in neutral values for calculating modified symbol transition probabilities, which are used in all a posteriori transition probability calculations, except for the final iteration wherein the switch means switches back in the a posteriori state transition probability from the previous decoding iteration as the a priori information for all terms comprising the final a posteriori transition probability calculation.
  • 16. The decoder of claim 9 wherein the forward and backward state probabilities and the a posteriori state transition probabilities for the component code words are independently controlled.
  • 17. A method for decoding turbo codes, comprising:iteratively calculating forward and backward state probabilities and a posteriori state transition probabilities for component code words of turbo codes according to a MAP decoding process; feeding back the a posteriori state transition probabilities as a priori state transition probabilities for use in decoding other component code words comprising the turbo code words, including providing a predetermined value as the initial a priori state transition probability, and including selecting as subsequent a priori state transition probability estimates either the latest available a posteriori probability estimates, modified a posteriori probability estimates, or neutral values, or combinations thereof; independently controlling the forward and backward state probabilities and the a posteriori state transition probabilities for the component code words of the turbo codes.
US Referenced Citations (7)
Number Name Date Kind
5406570 Berrou et al. Apr 1995
5446747 Berrou Aug 1995
5465321 Smyth Nov 1995
5721745 Hladik et al. Feb 1998
5721746 Hladik et al. Feb 1998
5734962 Hladik et al. Mar 1998
5893058 Kosaka Apr 1999
Non-Patent Literature Citations (3)
Entry
“Illuminating the Structure of Code and Decoder of Parallel Concatenated Recursive Systematic (Turbo) Codes,” Patrick Robertson, IEEE, 1994, pp. 1298-1303.
“Optimal Decoding of Linear Codes for Minimizing Symbol Error Rate,” LR Bahl, J Cocke, F. Jelinek; J. Raviv, IEEE Transactions on Information Theory, Mar. 1974, pp. 284-287.
“Near Shannon Limit Error-Correcting Coding and Deconding: Turbo-Codes (1),” Claude Berrou, Alain Glavieux; Punya Thitimajshima, IEEE, 1993, pp. 1064-1070.