Patent Grant
8245119
The present invention relates to the field of information encoding/decoding, and more particularly to systems and methods for addressing the so-called “dirty paper” coding problem.
The notation “[n]” is used repeatedly in this specification and is to be interpreted as a reference to the nth document in the list of references appearing at the end of this specification.
Communicating over side-information channels constitutes a powerful paradigm that is built upon the framework of channel coding with side information (CCSI), where the channel state is known only to the encoder as side information. CCSI has recently generated a lot of interest due to its application to data-hiding, precoding for interference channels, coding for MIMO broadcast channels, and transmitter cooperation in ad hoc networks. However, although the capacity results obtained by Gelfand and Pinsker [8] and by Costa in the special case of the so-called problem of “writing on dirty paper” [5] have been known for more than 20 years, practical approaches to CCSI did not appear until 1999.
The general framework of CCSI, described by Gelfand and Pinsker [8], is shown in
Y=X+S+Z (1)
where Z is the noise in the channel. Based on the selected message m and the state of the channel S, the encoder sends codeword X which satisfies the power constraint E[w(X,S)]≦PX, with w(•,•) being the cost measure. The achieved transmission rate is then R=log2M.
The capacity is given by [8] as
where U is an auxiliary random variable such that two Markov chains Y→(X,S)→U and Y→(U,S)→X hold, and E[w(X,S)]≦PX.
CCSI in general suffers capacity loss when compared to channel coding with side information available at both the encoder and the decoder. However, when Z is i.i.d. Gaussian random variable with variance PZ, we have the famous dirty-paper coding problem [5] without capacity loss, i.e.,
Costa's proof [5], which shows the existence of capacity-achieving random binning schemes, is non-constructive. Thus, it does not provide any indication about practical code construction. Zamir et al. [23] suggested an algebraic binning scheme based on nested lattice codes and showed that the scheme approaches the capacity in (3) as the dimensionality of the employed lattices approaches infinity. However, nested lattice coding requires a joint source-channel code design, typically with the same dimensional coarse lattice source code and fine lattice channel code, which are difficult to implement in high dimensions.
The first practical dirty-paper code was developed by Chen and Women under the name of quantization index modulation [2]. Eggers et al. [6] proposed a scalar Costa scheme for information embedding. Yu et al. [22] employed trellis-coded quantization (TCQ) [10] as the source code and trellis-coded modulation (TCM) [16] as the channel code. These dirty-paper coding schemes perform several dB away from the capacity. Another implementation using turbo-coded trellis-based construction was designed by Chou et al. [3]. However, the employed TCQ source code is significantly weakened due to its coupling with turbo code, resulting in dimensional mismatch [18] between the source code and the channel code. Indeed, at a transmission rate of 1.0 bit per sample (b/s), the design of [3] performs 2.02 dB away from the capacity.
The designs above do not perform well at low rate where the dirty-paper code design is more challenging due to magnification of the granular loss of the source code (see [18]). Recent works by Erez and ten Brink [7] and by Bennatan et al. [1] target at the low rate regime. However, the code designs in [7][1] still show a 1.3 dB gap from the capacity-achieving signal-to-noise ratio (SNR) at 0.25 b/s.
In one set of embodiments, a method for encoding data may involve: performing channel coding on a set of message bits using an irregular repeat accumulate (IRA) encoder in order to generate parity bits; expanding the parity bits to obtain a stream of parity words; operating on the stream of parity words to obtain a stream of modified parity words, where said operating includes adding one or more binary control streams to corresponding bit positions of the stream of parity words, where the one or more binary control streams are outputs of a trellis coded quantization in response to an input vector b; performing pulse amplitude modulation based on the stream of modified parity words to obtain a modulated signal u; subtracting a scaled and dithered version of a channel state signal from the modulated signal u to obtain a difference signal X; where the input vector b has been selected so that the difference signal X satisfies a power constraint.
In another set of embodiments, a method for recovering message bits from a received signal may involve: (a) performing a trellis decoding operation on a scaled and dithered version of a received signal using first feedback information to determine first feedforward information, wherein the trellis decoding operation is over a joint trellis corresponding at least to an accumulator portion of an IRA encoder and a trellis coded quantization; (b) subtracting the first feedback information from the first feedforward information to obtain second feedforward information; (c) performing check node decoding on the second feedforward information and second feedback information to generate third feedforward information, where the check node decoding corresponds to check nodes of the IRA encoder; (d) subtracting the second feedback information from the third feedforward information to obtain fourth feedforward information; (e) performing variable node decoding on a permuted version of the fourth feedforward information to obtain third feedback information, where the variable node decoding corresponds to variable nodes of the IRA encoder; (f) subtracting the permuted version of the fourth feedforward information from the third feedback information to obtain fourth feedback information, where the second feedback information is a permuted version of the fourth feedback information; (g) performing check node decoding on the second feedback information to determine the first feedback information, where the check node decoding corresponds to the check nodes of the IRA encoder; (h) repeating (a) through (g) a number of times until a termination condition is achieved; and (i) generating an estimate for the message bits from the third feedback information.
In yet another set of embodiments, a method for encoding data may involve: performing channel coding on a set of message bits using an irregular repeat accumulate (IRA) encoder in order to generate parity bits; expanding the parity bits to obtain a stream of parity words; operating on the stream of parity words to obtain a stream of modified parity words, where said operating includes adding one or more binary control streams to corresponding bit positions of the stream of parity words, where the one or more first binary control streams are outputs of a first trellis coded quantization in response to an input vector bP; performing a first pulse amplitude modulation based on the stream of modified parity words to obtain a modulated signal up; expanding the message bits to obtain a stream of expanded words; operating on the stream of expanded words to obtain a stream of modified expanded words, where said operating includes adding one or more additional binary control streams to corresponding bit positions of the stream of expanded words, where the one or more additional binary control streams are outputs of a second trellis coded quantization in response to an input vector bS; performing a second pulse amplitude modulation based on the stream of modified expanded parity words to obtain a modulated signal uS; generating a signal u from the modulated signal up and the modulated signal uS; subtracting a scaled and dithered version of a channel state signal from the signal u to obtain a difference signal X; where the input vectors bP and bS have been selected so that the difference signal X satisfies a power constraint.
In yet another set of embodiments, a method for recovering message bits from a received signal may involve: (a) performing a first trellis decoding operation on a parity portion of a scaled and dithered version of a received signal using first feedback information to determine first feedforward information, wherein the first trellis decoding operation is over a joint trellis corresponding at least to an accumulator portion of an IRA encoder and a first trellis coded quantization; (b) subtracting the first feedback information from the first feedforward information to obtain second feedforward information; (c) performing check node decoding on the second feedforward information and second feedback information to generate third feedforward information, where the check node decoding corresponds to check nodes of the IRA encoder; (d) subtracting the second feedback information from the third feedforward information to obtain fourth feedforward information; (e) performing variable node decoding on a permuted version of the fourth feedforward information to obtain third feedback information and fourth feedback information, where the variable node decoding corresponds to variable nodes of the IRA encoder; (f) subtracting the permuted version of the fourth feedforward information from the fourth feedback information to obtain fifth feedback information, where the second feedback information is a permuted version of the fifth feedback information; (g) performing check node decoding on the second feedback information to determine the first feedback information, where the check node decoding corresponds to the check nodes of the IRA encoder; (h) performing a second trellis decoding operation on a systematic portion of a scaled and dithered version of the received signal using the third feedback information to determine fifth feedforward information, wherein the second trellis decoding operation is over a joint trellis corresponding at least to a second trellis coded quantization; (i) subtracting the third feedback information from the fifth feedforward information to obtain sixth feedforward information, wherein said performing variable node decoding uses the sixth feedforward information; (j) repeating (a) through (i) a number of times until a termination condition is achieved; and (k) generating an estimate for the message bits from the fourth feedback information.
A combined source-channel coding approach to CCSI (e.g., dirty-paper coding) is presented herein. In one set of embodiments, in addition to channel coding, strong source coding is employed to satisfy the power constraint due to the presence of encoder side information. To synergistically combine a strong source code and a strong channel code together, we follow a simple design philosophy of picking a strong source code first and then focusing on designing near-capacity channel codes. Specifically, we present practical code designs using TCQ, in conjunction with both non-systematic and systematic irregular repeat-accumulate (IRA) codes. (For more information on TCQ, please refer to [10]. For more information on IRA codes, please refer to [9]).
We endeavor to achieve as much granular gain as possible from TCQ. The aim of IRA coding then is to approach the capacity of the equivalent modulo lattice channel induced by TCQ.
We tackle the problem of designing efficient IRA codes for the TCQ-induced (modulo lattice) channel, whose memory increases with that of TCQ. The performance of TCQ is not compromised and the end results are CCSI codes (e.g., dirty-paper codes) with better performance at lower complexity. For example, at 0.25 b/s, one of our code designs (with 1024-state TCQ) performs only 0.83 dB away from the capacity. We are thus approaching the limit of dirty-paper coding.
We design IRA codes for the TCQ-induced channel using advanced tools such as EXIT charts. For more information on EXIT charts, please refer to [15]. (EXIT is an acronym for extrinsic information transfer.)
The following detailed description makes reference to the accompanying drawings, which are now briefly described.
While the invention is described herein by way of example for several embodiments and illustrative drawings, those skilled in the art will recognize that the invention is not limited to the embodiments or drawings described. It should be understood, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the present invention as defined by the appended claims. The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this specification, the word “may” is used in a permissive sense (i.e., in the sense of “having the potential to”), rather than in the mandatory sense (i.e., in the sense of “must”). Furthermore, the phrase “A includes B” is used to mean “A includes B, but is not limited to B”.
In one set of embodiments, a method MNE for encoding data may involve the following actions/operations as illustrated in
At 110, the processor receives message bits (e.g., in the form of a K-bit word, where K is a positive integer) from an information source. The type of information provided by the information source is not limited. Typical examples of types of information that may be provided include audio, image, video, text, physical measurements, stock market data, covert intelligence data, etc.
At 115, the processor performs channel coding on the message bits using an irregular repeat accumulate (IRA) encoder in order to generate parity bits. In one embodiment, the IRA encoder may have the structure illustrated in
At 116, the processor serializes the parity bits generated by the IRA encoder in order to generate a serial stream q.
At 117, the processor expands each bit qi of the stream q to generate an A-bit word, where A is an integer greater than one. (For example, in one embodiment, A equals 4.) If the bit qi equals one, the generated word has all ones. If the bit qi equals zero, the generated word has all zeros. Thus, the stream q is converted into a stream of words. The stream of words is denoted Q. The stream Q can be viewed as having A single-bit substreams which are denoted Q1, Q2, . . . , QA. The substream Qj is composed of the jth bit of each word in the stream Q.
At 120, the processor scales a signal S to obtain a scaled signal. The signal S represents information about the state of the channel, and thus, may be referred to herein as the channel state signal. (It is assumed that the signal S and a noise signal Z are added to the signal X as part of the channel. See
where PX is the power limit on the signal X, PZ is the variance of the noise signal Z, and SNR is PX/PZ.
At 125, the processor adds a dither signal D to the scaled signal in order to generate an intermediate signal. In particular, the processor adds values of the dither signal to values of the scaled signal, respectively, in order to generate values of the intermediate signal. The values of the dither signal may be random values. In some embodiments, the dither values may be uniformly distributed over the Voronoi region of the quantizer. In one embodiment, the dither values may be generated (or computed) as described in the section below entitled “CCSI using TCQ and IRA codes”. The mean of the dither values may be zero.
At 130, the processor operates on the words of the stream Q to obtain a stream G of modified words. This operation 130 may include adding binary control streams C1, C2, . . . , CL respectively to L of the A substreams of the stream Q. (L is a positive integer less than or equal to A. For example, in the embodiment of
At 135, the processor performs pulse amplitude modulation (PAM) based on the stream G of modified words to obtain a modulated signal u having a finite number of amplitude states. (The PAM may be 2A-state PAM. For example, in one embodiment, A equals 4.) PAM and methods for performing PAM are well known in the art of signal processing. In alternative embodiments, other types of modulation may be used.
At 140, the processor subtracts the intermediate signal from the modulated signal u to obtain a difference signal X. In particular, the processor may subtract the values of the intermediate signal from values of the signal u, respectively, to obtain values of the difference signal X.
In some embodiments, the difference signal X may be transmitted over a channel to a decoder system.
In some embodiments, the difference signal X may be used to modulate an RF carrier in order to generate an RF output signal. The RF output signal may be transmitted over the channel.
In some embodiments, the difference signal X may be added to the channel state signal S to obtain a resultant signal R. The resultant signal R may be transmitted to one or more destinations over one or more channels. Alternatively, the resultant signal may be stored in a memory medium for later retrieval. For example, the resultant signal may be stored in the memory of a server computer, and thus, made available to users of a computer network.
The input vector b, used to generate the control streams, will have been selected so that the difference signal X satisfies a power constraint. In some embodiments, the input vector b is selected so that the power associated with the difference signal X is minimized (or approximately minimized). The processor may perform an optimization (e.g., an optimization based on the Viterbi algorithm) to determine the input vector b.
In one set of embodiments, the processing operations of the method MNE described above and illustrated in
The IRA encoder 210 is configured to perform channel coding on a K-bit input message word m in order to generate an N-bit parity word p. N and K are positive integers. N is larger than K. (For example, in one embodiment, K=60,000 and N=240,000.)
The parallel-to-serial converter 212 may have N input lines (i.e., one input line for each of the N bit positions of the word p) and a single output line. The conversion unit 212 is configured to convert the N-bit parity word into a serial stream q of bits and to output the serial stream q onto the single output line. The parallel-to-serial converter may include a multiplexer and associated control logic.
The scaling unit 215 is configured to scale the channel state signal S to obtain a scaled signal. The scaled signal is denoted αS, where α is the scaling factor. The scaling unit 215 may be implemented using a multiplier circuit. One input of the multiplier circuit may be supplied with the values of the scaled signal. The second input of the multiplier circuit may be supplied with the scale factor α. The scale factor α may be programmable.
The adder 220 is configured to add the dither signal D to the scaled signal αS to generate the intermediate signal. The intermediate signal is denoted by the expression αS+D.
The bit expansion unit 225 is configured to expand the parity stream q into the stream Q of A-bit words. Note the bit expansion unit 225 may be implemented simply as a branching system of conductive paths, e.g., as suggested in
The bit modification unit 225 is configured to add the control streams C1, C2, . . . , CL respectively to the L substreams of the stream Q. The additions may be performed in a “mod 2” fashion, e.g., using XOR gates.
The trellis coded quantization (TCQ) unit 230 is configured to generate the control streams C1, C2, . . . , CL in response to the input vector b.
The modulation unit 235 is configured to perform the pulse amplitude modulation based on stream G in order to generate the modulated signal u. Alternative embodiments of the modulation unit 235 may implement other kinds of modulation.
The subtraction unit 240 is configured to subtract the intermediate signal from the modulated signal u to obtain the difference signal X.
In some embodiments, the encoder system SNE may include a transmitter or interface for transmitting the difference signal over a channel to a decoder system.
In some embodiments, the encoder system SNE may include circuitry configured to modulate an RF carrier using the difference signal X (as the modulating signal) in order to generate an RF output signal. The RF output signal may be transmitted over the channel.
In some embodiments, the encoder system SNE may include circuitry configured to add the difference signal X and the channel state signal S to obtain a resultant signal R. The resultant signal R may be transmitted to one or more destinations over one or more channels. Alternatively, the resultant signal may be stored in a memory medium for later retrieval. For example, the resultant signal may be stored in a memory medium associated with a server computer, and thus, made available to users of a computer network.
The input vector b, used to generate the control streams, will have been selected so that the difference signal X satisfies a power constraint. In some embodiments, the input vector b is selected so that the power associated with the difference signal X is minimized (or approximately minimized). The encoder system SNE may also include an optimization unit configured to perform an optimization (e.g., an optimization based on the Viterbi algorithm) to determine the input vector b.
In one set of embodiments, a method MND for recovering message bits from an input signal Y received from a channel may involve the following actions/operations as illustrated in
At 310, the processor receives a signal from the channel and operates on the received signal to recover values of the input signal Y. The input signal Y may be related to the signal X generated by the encoder system as shown in
At 315, the processor scales the values of the input signal Y to generate scaled values. The process of scaling may involve multiplying each of the input signal values by the scale factor α. The scale factor α may be the same as the scale factor used by the encoder system.
At 320, the processor adds dither values to the scaled values, respectively, in order to generate intermediate values. These dither values may be the same as the dither values used by the encoder system.
At 325, the processor performs a decoding operation (e.g., a BCJR-based decoding operation) on the intermediate values using feedback information IA,ACC in order to determine feedforward information Ijoint. The decoding operation may be performed over a joint trellis corresponding to the trellis-coded quantization (TCQ), the accumulator portion (ACC) of the IRA encoder, and the bit modification unit (BMU) used by the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ, ACC and BMU. The information Ijoint may be LLR information over the joint trellis. Please refer to the section below entitled “TCQ Plus Non-Systematic IRA Code Design” for more description of the decoding operation.
At 327, the processor subtracts the feedback information IA,ACC from the information Ijoint to obtain the feedforward information IE,ACC.
At 330, the processor performs check node decoding (CND) on the feedforward information IE,ACC and feedback information IA,CND to generate feedforward information ICND1. The check node decoding corresponds to the check nodes of the IRA encoder of the encoder system.
At 335, the processor subtracts the feedback information IA,CND from the information ICND1 to obtain feedforward information IE,CND.
At 337, the processor permutes the feedforward information IE,CND to obtain permuted information IA,VND. The permutation that is applied to the feedforward information IE,CND may be the inverse of the permutation used by the IRA encoder of the encoder system.
At 340, the processor performs variable node decoding (VND) on the permuted information IA,VND to obtain information IOUT. The variable node decoding corresponds to variable nodes of the IRA encoder of the encoder system.
At 345, the processor subtracts the permuted information IA,VND from the output information IOUT to obtain feedback information IE,VND.
At 350, the processor permutes the feedback information IE,VND to determine the feedback information IA,CND.
At 355, the processor performs check node decoding (CND) on the feedback information IA,CND to determine the feedback information IA,ACC. The check node decoding corresponds to the check nodes of the IRA encoder of the encoder system.
The processor repeats operations 325 through 355 until a termination condition is achieved, as indicated at 342. For example, the processor may repeat until a predetermined number of repetitions are completed. As another example, the processor may repeat until the information IOUT (or the information IE,VND) stabilizes. In one embodiment, the processor repeats until the size of ΔIOUT (or the size of ΔIE,VND) remains small for a number of iterations. (The notation “ΔIOUT” denotes the change in IOUT relative to the previous iteration.) A wide variety of termination conditions are contemplated.
At 360, the processor determines estimates for the message bits from the output information IOUT, e.g., by hard-limiting the values of the output information IOUT to binary values.
The decoding operation 325, the check node decoding operation 330, the variable node decoding operation 340 and the check node decoding operation 355 are soft-input soft-output (SISO) decoding operations. Thus, the information received and generated by these decoding operations is soft information, e.g., sets of log-likelihood ratios (LLRs).
In one set of embodiments, the processing operations of the method MND described above and illustrated in
The scaling unit 405 is configured to receive the values of the input signal Y and to scale the input signal values by the scale factor α in order to obtain scaled values. The scaling unit 405 may be implemented using a multiplier (or a network of adders and multipliers).
The adder 407 is configured to add the dither values respectively to the scaled values to generate the intermediate values. One input of the adder 407 may be supplied with the scaled values from the scaling unit 405. The other input of the adder 407 may be supplied with the dither values. In
The decoder unit 410 is configured to perform the decoding operation (e.g., a BCJR-based decoding operation) on the intermediate values using the feedback information IA,ACC in order to determine the feedforward information Ijoint. The decoding operation may be performed over a joint trellis corresponding to the trellis-coded quantization (TCQ), the accumulator portion (ACC) of the IRA encoder, and the bit modification unit (BMU) used by the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ, ACC and BMU. The information Ijoint may be LLR information over the joint trellis. (LLR is an acronym for log likelihood ratio.) The encoder structure information may be programmable. Thus, the encoder structure information may be changed if and when necessary (e.g., by a host computer).
In one alternative embodiment, the decoder unit 410 is optimized assuming particular structures for TCQ, ACC and BMU. In this case, the encoder structure information may be designed into the circuitry of the decoder 410.
The subtraction unit 415 is configured to subtract the feedback information IA,ACC from the feedforward information Ijoint to obtain the feedforward information IE,ACC.
The check node decoder 420 is configured to perform check node decoding on the feedforward information IE,ACC and the feedback information IA,CND to generate the feedforward information ICND1.
The subtraction unit 425 is configured to subtract the feedback information IA,CND from the feedforward information ICND1 to obtain the feedforward information IE,CND.
The permutation unit 430 is configured to permute the feedforward information IE,CND to obtain the permuted information IA,VND. The permutation that is applied by the permutation unit 430 may be the inverse of the permutation Π used by the IRA encoder of the encoder system.
The variable node decoder 435 is configured to perform the variable node decoding on the permuted information IA,VND to obtain the information IOUT.
The subtraction unit 440 is configured to subtract the permuted information IA,VND from the information IOUT to obtain the feedback information IE,VND.
The permutation unit 445 is configured to permute the feedback information IE,VND to determine the feedback information IA,CND. The permutation applied by the permutation unit 445 may be the same as the permutation Π used by the IRA encoder of the encoder system.
The check node decoder 450 is configured to perform check node decoding on the feedback information IA,CND to determine the feedback information IA,ACC.
The decoder system may also include a control unit 455 that controls iterations of the operations 325 through 355 by the units 410 through 450. The control unit may continue the iterations until a termination condition is achieved. Any of various termination conditions may be used, e.g., as discussed above.
In one embodiment, the decoder system SND operates in a pipelined fashion.
After the termination condition has been achieved, the estimation unit 460 is configured to determine estimates for the original message bits (that were generated by the information source) from the information IOUT.
In one set of embodiments, a method MSE for encoding data may involve the following actions/operations as illustrated in
At 510, the processor receives message bits (e.g., in the form of a K-bit word, where K is a positive integer) from an information source.
At 515, the processor performs channel coding on the message bits using an irregular repeat accumulate (IRA) encoder in order to generate parity bits. Please refer to the section below entitled “TCQ Plus Systematic IRA Code Design” for information on how to design at least one embodiment of the IRA encoder.
At 516, the processor serializes the parity bits generated by the IRA encoder in order to generate a serial stream qP.
At 517, the processor expands each bit of the stream qP to generate a corresponding A-bit word as described above, where A is an integer greater than one. (For example, in one embodiment, A=4.) The stream of words is denoted QP.
At 520, the processor scales the channel state signal S by the scale factor α to obtain the scaled signal αS.
At 525, the processor adds the dither signal D to the scaled signal αS in order to generate the intermediate signal (denoted αS+D).
At 530, the processor operates on the words of the stream QP to obtain a stream GP of modified words. This operation may include adding binary control streams CP1, CP2, . . . , CPL respectively to L of the A substreams of the stream QP. (L is a positive integer. For example, in the embodiment of
At 535, the processor performs pulse amplitude modulation (PAM) on the stream GP of modified words to obtain a modulated signal up having a finite number of amplitude states. (The PAM may be 2A-state PAM. For example, in one embodiment, A equals 4.) In alternative embodiments, other types of modulation may be used.
At 537, the processor serializes the message bits to obtain a serial stream qP.
At 540, the processor expands each of the message bits to generate a corresponding A-bit word. (For example, in one embodiment, A=4.) The stream of words is denoted QS.
At 545, the processor operates on the words of the stream QS to obtain a stream GS of modified words. This operation may include adding binary control streams CS1, CS2, . . . , CSL respectively to L of the A substreams of the stream QS. (In the embodiment of
At 547, the processor performs pulse amplitude modulation based on the stream GS of modified words to obtain a modulated signal uS having a finite number of states. (The PAM may be 2A-state PAM. For example, in one embodiment, A equals 4.) In alternative embodiments, other types of modulation may be used.
At 550, the processor generates a signal u by concatenating the samples of the modulated signal uS with the samples of the modulated signal up.
At 555, the processor subtracts the intermediate signal (αS+D) from the signal u to obtain a difference signal X.
In some embodiments, the difference signal X may be transmitted over a channel to a decoder system.
In some embodiments, the difference signal X may be used to modulate an RF carrier in order to generate an RF output signal. The RF output signal may be transmitted over the channel.
In some embodiments, the difference signal X may be added to the channel state signal S to obtain a resultant signal R. The resultant signal R may be transmitted to one or more destinations over one or more channels. Alternatively, the resultant signal may be stored in a memory medium for later retrieval. For example, the resultant signal may be stored in the memory of a server computer, and thus, made available to users of a computer network.
The input vectors bP and bS, used to generate the control streams, will have been selected so that the difference signal X satisfies a power constraint. In some embodiments, the input vector b is selected so that the power associated with the difference signal X is minimized (or approximately minimized). The processor may perform an optimization (or optimizations) based on the Viterbi algorithm to determine the input vectors bP and bS.
In one set of embodiments, the processing operations of the method MSE described above and illustrated in
The parity portion 610 may include an IRA encoder 615, a parallel-to-serial converter 617, a bit expansion unit 620, a bit modification unit 622, a trellis coded quantization unit 625 and a modulation unit 630. The systematic portion 640 may include a parallel-to-serial converter 645, a bit expansion unit 647, a bit modification unit 650, a trellis coded quantization unit 655 and a modulation unit 660.
The elements of encoder system SSE may be partitioned among one or more hardware devices (e.g., integrated circuits) in any of various ways. In some embodiments, the encoder system SSE is implemented as a single integrated circuit, e.g., as a DSP chip. In one embodiment, the encoder system SSE is implemented using the TI TMS320C6X DSP chip.
The IRA encoder 615 is configured to perform channel coding on the K-bit input message word m in order to generate the N-bit parity word p. N and K are positive integers. N is larger than K. (For example, in one embodiment, K=60,000 and N=180,000.)
The parallel-to-serial converter 617 may have N input lines (i.e., one input line for each of the N bit positions of the word p) and a single output line. The converter 617 may be configured to convert the N-bit parity word p into a serial stream qP of bits and output the serial stream qP onto the single output line.
The bit expansion unit 620 is configured to expand the parity stream qP into the stream QP of A-bit words. Note the bit expansion unit 225 may be implemented simply as a branching system of conductive paths, e.g., as suggested in
The bit modification unit 622 (BMU1) is configured to add the control streams CP1, CP2, . . . , CPL respectively to the L substreams of the stream QP to obtain the stream GP of modified words. The additions may be performed in a “mod 2” fashion, e.g., using XOR gates.
The TCQ unit 625 is configured to generate the control streams CP1, CP2, . . . , CPL in response to the input vector bP.
The modulation unit 630 is configured to perform pulse amplitude modulation based on the stream GP in order to generate the modulated signal up. Alternative embodiments of the modulation unit 235 may implement other kinds of modulation.
The parallel-to-serial converter 645 may have K input lines (i.e., one input line for each of the K bit positions of the input message word m) and a single output line. The converter 645 is configured to convert the K-bit input message word m into a serial stream qS of bits and output the serial stream qS onto the single output line.
The bit expansion unit 647 is configured to expand the parity stream qS into the stream QS of A-bit words. The bit expansion unit 647 may be implemented simply as a branching system of conductive paths, e.g., as suggested in
The bit modification unit 650 (BMU2) is configured to add control streams CS1, CS2, . . . , CSL respectively to L substreams of the stream QS to obtain the stream GS of modified words.
The TCQ unit 655 is configured to generate the control streams CS1, CS2, . . . , CSL in response to the input vector bS. In one embodiment, the TCQ unit 655 is designed according to the method described in the section below entitled “TCQ Plus Systematic IRA Code Design”.
The modulation unit 660 is configured to perform pulse amplitude modulation based on the stream GS in order to generate the modulated signal uS. Alternative embodiments of the modulation unit 235 may implement other kinds of modulation.
The scaling unit 680 is configured to scale the channel state signal S to obtain the scaled signal αS. The scale factor α may be programmable.
The adder 685 is configured to add the dither signal D to the scaled signal αS to generate the intermediate signal αS+D. The values of the dither signal may be programmable.
The switch unit 670 is configured to generate the signal u by combining (e.g., concatenating) the values of the modulated signal uS and the values of the modulated signal uP.
The subtraction unit 675 is configured to subtract the intermediate signal αS+D from the signal u to obtain the difference signal X.
In some embodiments, the encoder system SSE may include a transmitter or interface for transmitting the difference signal X over a channel to a decoder system.
In some embodiments, the encoder system SSE may include circuitry configured to modulate an RF (radio frequency) carrier using the difference signal X as the modulating signal in order to generate an RF output signal. The RF output signal may be transmitted over the channel.
In some embodiments, the encoder system SSE may include circuitry configured to add the difference signal X and the channel state signal S to obtain a resultant signal R. The resultant signal R may be transmitted to one or more destinations over one or more channels. Alternatively, the resultant signal may be stored in a memory medium for later retrieval. For example, the resultant signal may be stored in a memory medium associated with a server computer, and thus, made available to users of a computer network.
The input vectors bP and bS, used to generate the control streams, will have been selected so that the difference signal X satisfies a power constraint. In some embodiments, the input vector b is selected so that the power associated with the difference signal X is minimized (or approximately minimized). The encoder system may also include an optimization unit configure to perform an optimization (e.g., an optimization based on the Viterbi algorithm) to determine the input vectors bP and bS.
In one set of embodiments, a method MSD for recovering message bits from an input signal Y may involve the following actions/operations as illustrated in
At 710, the processor receives values of the input signal Y. The input signal Y may be related to the signal X generated by an encoder system as shown in
At 712, the processor scales the values of input signal Y to generate scaled values. The process of scaling may involve multiplying each of the input signal values by the scale factor α. The scale factor α may be the same as the scale factor used by the encoder system.
At 715, the processor adds dither values respectively to the scaled values to generate intermediate values Y′. These dither values may be the same as the dither values used by the encoder system.
At 720, the processor performs a decoding operation (e.g., a BCJR-based decoding operation) on a parity portion Y′P of the intermediate values Y′ using feedback information IA,ACC to determine feedforward information Ijoint. The decoding operation may be performed over a joint trellis corresponding to the first trellis-coded quantization (TCQ1), the accumulator portion (ACC) of the IRA encoder, and the bit modification unit (BMU1) used by the parity portion of the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ1, ACC and BMU1. The information Ijoint may be LLR information over the joint trellis.
At 723, the processor subtracts the feedback information IA,ACC from the information Ijoint to obtain feedforward information IE,ACC.
At 725, the processor performs check node decoding on the feedforward information IE,ACC and feedback information IA,CND to generate feedforward information ICND1. The check node decoding corresponds to the check nodes of the IRA encoder of the encoder system.
At 727, the processor subtracts the feedback information IA,CND from the information ICND1 to obtain the feedforward information IE,CND.
At 730, the processor permutes the feedforward information IE,CND to obtain permuted information IA,VND. The permutation that is applied to the feedforward information IE,CND may be the inverse of the permutation used by the IRA encoder of the encoder system.
At 732, the processor performs a decoding operation (e.g., a BCJR-based decoding operation) on a systematic portion Y′S of the intermediate values Y′ using feedback information IA,TCQ2 provided by the decoder 825 to determine feedforward information I2. The decoding operation may be performed over a trellis corresponding to the second trellis-coded quantization (TCQ2) and the bit modification unit (BMU2) used by the systematic portion of the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ2 and BMU2. The information I2 may be LLR information over the trellis.
At 735, the processor subtracts the feedback information IA,TCQ2 from the information I2 to determine feedforward information IE,TCQ2.
At 737, the processor performs variable node decoding on the permuted information IA,VND and the feedback information IE,TCQ2 to obtain feedback information IV and information IA,TCQ2. The variable node decoding corresponds to the variable nodes of the IRA encoder of the encoder system.
At 740, the processor subtracts the permuted information IA,VND from the information IV to obtain feedback information IE,VND.
At 742, the processor permutes the feedback information IE,VND to determine the feedback information IA,CND. The permutation matrix used here may be the same permutation matrix used by the IRA encoder of the encoder system.
At 745, the processor performs check node decoding on the feedback information IA,CND to determine the feedback information IA,ACC. The check node decoding corresponds to the check nodes of the IRA encoder of the encoder system.
The processor repeats operations 720 through 745 until a termination condition is achieved. For example, the processor may repeat until a predetermined number of repetitions are completed. As another example, the processor may repeat until the information IV (or the information IE,VND) stabilizes. In one embodiment, the processor repeats until the size of ΔIV (or the size of ΔIE,VND) remains small for a number of iterations. A wide variety of termination conditions are contemplated.
The test to determine if the termination condition is achieved may be performed after operation 737, e.g., as indicated at 738. If the termination condition is not achieved, the processor may continue with operation 740. If the termination condition is achieved, the processor may perform operation 755.
At 755, the processor determines an estimate for the message bits from the information IV, e.g., by performing hardlimiting on the information IV.
In some embodiments, the iterative decoding operations 720 and 732, the check node decoding operations 725 and 745, and the variable node decoding operation 737 are soft-input soft-output (SISO) decoding operations. Thus, the information received and the information generated by these decoding operations may be soft information, e.g., sets of log-likelihood ratios (LLRs).
In one set of embodiments, the processing operations of the method MSD described above and illustrated in
The scaling unit 805 is configured to receive the values of the input signal Y from the channel and to scale the input signal values by the scale factor α in order to generate scaled values.
The adder 807 is configured to add the dither values D respectively to the scaled values to obtain intermediate values Y′. The dither values may be programmable.
The distribution unit 810 is configured to distribute a parity portion of the intermediate values to the decode unit 812 and a systematic portion of the intermediate values to the decode unit 835.
The decoder unit 812 is configured to perform the decoding operation (e.g., a BCJR-based decoding operation) on a parity portion Y′P of the intermediate values Y′ using the feedback information IA,ACC to determine the feedforward information Ijoint. The decoding operation may be performed over a joint trellis corresponding to the first trellis-coded quantization (TCQ1), the accumulator portion (ACC) of the IRA encoder, and the bit modification unit (BMU1) used by the parity portion of the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ1, ACC and BMU1. The information Ijoint may be LLR information over the joint trellis.
The encoder structure information may be programmable. Thus, the encoder structure information may be changed if and when necessary (e.g., by a host computer).
In one alternative embodiment, the decoder unit 812 is optimized assuming particular structures for TCQ1, ACC and BMU1. In this case, the encoder structure information may be designed into the circuitry of the decoder 812.
The subtraction unit 815 is configured to subtract the feedback information IA,ACC from the information Ijoint to obtain the feedforward information IE,ACC.
The first check node decoder 817 is configured to perform the check node decoding on the feedforward information IE,ACC and the feedback information IA,CND to generate the feedforward information ICND1.
The subtraction unit 820 is configured to subtract the feedback information IA,CND from the information ICND1 to obtain the feedforward information IE,CND.
The permutation unit 822 is configured to permute the feedforward information IE,CND to obtain the permuted information IA,VND. The permutation that is applied by the permutation unit 822 may be the inverse of the permutation Π used by the IRA encoder of the encoder system.
The decode unit 835 is configured to perform a decoding operation (e.g., a BCJR-based decoding operation) on the systematic portion Y′S of the intermediate values Y′ using the feedback information IA,TCQ2 to determine feedforward information I2. The decoding operation may be performed over a trellis corresponding to the second trellis-coded quantization (TCQ2) and the bit modification unit (BMU2) used by the systematic portion of the encoder system. The decoding operation may rely on encoder structure information that represents the structure of each of TCQ2 and BMU2.
In one alternative embodiment, the decoder unit 835 is optimized assuming particular structures for TCQ2 and BMU2. In this case, the encoder structure information may be designed into the circuitry of the decoder 835.
The subtraction unit 836 is configured to subtract the feedback information IA,TCQ2 from the feedforward information I2 to obtain the feedforward information IE,TCQ2.
The variable node decoder 825 is configured to perform the variable node decoding using the permuted information IA,VND and the feedforward information IE,TCQ2 to obtain the feedback information IV and information IA,TCQ2.
The subtraction unit 827 is configured to subtract the information IA,VND from the information IV to obtain the feedback information IE,VND.
The permutation unit 830 is configured to permute the feedback information IE,VND to determine the feedback information IA,CND. The permutation applied by the permutation unit 830 may be the same as the permutation Π used by the IRA encoder of the encoder system.
The second check node decoder 832 is configured to perform check node decoding on the feedback information IA,CND to determine the feedback information IA,ACC.
The decoder system may also include a control unit (not shown) that controls each iteration of the operations 720 through 745 by the units 805 through 832. The control unit may continue the iterations until a termination condition is achieved. Any of various termination conditions may be used, e.g., as discussed above.
In one embodiment, the decoder system operates in a pipelined fashion.
The estimation unit 837 is configured to determine estimates for the original message bits (that were generated by the information source) from the information IV, after the termination condition has been achieved.
In one set of embodiments, a method for encoding data may involve: performing IRA-based channel coding on a set of message bits in order to generate a stream of expanded parity words; and performing source coding on the stream of expanded parity words to generate a modulated signal, where said performing source coding includes modifying the expanded parity words using output from a trellis coded quantization; where the modulated signal is usable, in conjunction with a channel state signal, to generate an output signal X.
The output from the trellis-coded quantization is generated in response to an input vector b supplied to the trellis-coded quantization. The input vector b will have been selected so that the output signal X satisfies a power constraint. The action of performing source coding may also include performing pulse amplitude modulation based on the modified expanded parity words to obtain the modulated signal. The output signal X may be generated by subtracting a scaled and dithered version of the channel state signal from the modulated signal.
The output signal may be transmitted over a channel to one or more destinations. Any of various types of channel are contemplated.
Alternatively, the output signal may be stored in a memory medium, e.g., in a memory medium associated with a computer system. The stored output signal may be made available to one or more information consumers.
In another set of embodiments, a method for recovering message bits from an input signal may involve: inner decoding an input signal in order to generate first feedforward information, where the inner decoding includes (a) performing trellis decoding on the input signal over a joint trellis corresponding at least to an accumulator portion of an irregular repeat accumulate (IRA) encoder and a trellis coded quantization and (b) performing first check node decoding on data including a modified version of output from the trellis decoding, where the first feedforward information is a modified version of output from the first check node decoding; and outer decoding a permuted version of the first feedforward information in order to generate first feedback information, where said outer decoding includes performing variable node decoding, corresponding to variable nodes of the IRA encoder, on the permuted version of the first feedforward information, where the first feedback information is a modified version of output from the variable node decoding; where the output of the variable node decoding is usable to determine an estimate for the message bits.
The input signal is a scaled and dithered version of a received signal. The action of inner decoding may also include performing second check node decoding on a permuted version of the first feedback information. The trellis decoding may use the output from the second check node decoding. An estimate for the message bits may be determined from the output of the variable node decoding.
The estimate for the message bits may be stored in a memory medium, e.g., in a memory medium associated with a computer system. One or more information consumers may access the estimate from the memory medium.
In yet another set of embodiments, a method for encoding data may involve: performing IRA-based channel coding on message bits in order to generate a stream of expanded parity words; performing first source coding on the stream of expanded parity words to generate a first modulated signal, where said performing first source coding includes modifying the expanded parity words using output from a first trellis coded quantization; expanding the message bits to obtain expanded message words; performing second source coding on the stream of expanded message words to generate a second modulated signal, where said performing second source coding includes modifying the expanded message words using output from a second trellis coded quantization; and generating a signal u from the first modulated signal and the second modulated signal, where the signal u is usable, in conjunction with a channel state signal, to generate an output signal X.
The output from the first trellis-coded quantization is generated in response to an input vector bP supplied to the first trellis-coded quantization. The output from the second trellis-coded quantization is generated in response to an input vector bS supplied to the second trellis-coded quantization. The input vectors bP and bS will have been selected so that the output signal X satisfies a power constraint.
The action of performing the first source coding may also include performing pulse amplitude modulation based on the modified expanded parity words to obtain the first modulated signal. The action of performing the second source coding may also include performing pulse amplitude modulation based on the modified expanded message words to obtain the second modulated signal.
The output signal X may be generated by subtracting a scaled and dithered version of the channel state signal from the signal u.
The output signal X may be transmitted over a channel to one or more destinations. Any of various types of channel are contemplated.
Alternatively, the output signal X may be stored in a memory medium, e.g., in a memory medium associated with a computer system. The stored output signal may be made available to one or more information consumers.
In yet another set of embodiments, a method for recovering message bits from an input signal may involve: performing first decoding operations on a parity portion of the input signal in order to generate first feedforward information, where said performing first decoding operations includes (a) performing a first trellis decoding on the parity portion over a joint trellis corresponding at least to an accumulator portion of an irregular repeat accumulate (IRA) encoder and a first trellis coded quantization and (b) performing first check node decoding on data including a modified version of output from the first trellis decoding, where the first feedforward information is a modified version of output from the first check node decoding; performing second decoding operations on a systematic portion of the input signal and a permuted version of the first feedforward information in order to generate first feedback information and second feedback information, where said performing second decoding operations includes (c) performing a second trellis decoding on the systematic portion over a trellis corresponding to a second trellis coded quantization and (d) performing variable node decoding on the permuted version of the first feedforward information and a modified version of output from the second trellis decoding, where the first feedback information and the second feedback information are outputs of the variable node decoding; where the second feedback information is usable to determine an estimate for the message bits. The second trellis decoding may use the first feedback information.
The input signal is a scaled and dithered version of a received signal. The action of performing the second decoding operations may also include subtracting the permuted version of the first feedforward information from the second feedback information to obtain third feedback information. The action of performing the first decoding operations may also include performing second check node decoding on a permuted version of the third feedback information, where the first trellis decoding uses output from the second check node decoding.
The estimate for the message bits may be determined from the second feedback information, e.g., by hard-limiting the second feedback information.
In some embodiments, a computer-readable memory medium may be configured to store program instructions, where the program instructions are executable to implement any of the method embodiments described herein (or, any combination of the method embodiments described herein, or, any subset of the method embodiments described herein). A memory medium is a medium configured for the storage of information. Examples of memory media include various kinds of magnetic media (e.g., magnetic tape, magnetic disk, magnetic strips, and magnetic film); various kinds of optical media (e.g., CD-ROM); various kinds of semiconductor RAM and ROM; various media based on the storage of electrical charge and/or other physical quantities; etc.
In some embodiments, a computer system may be configured to include a processor and memory medium. The memory medium may be configured to store program instructions. The processor may be configured to read and execute the program instructions. The program instructions may be executable to implement any of the various method embodiments described herein (or, any combination of the method embodiments described herein, or, any subset of the method embodiments described herein). The computer system may be realized in any of various forms. For example, the computer system may be a personal computer (in any of its various forms), a workstation, a computer on a card, a server computer, a client computer, a computer system in a sensor device, etc.
In one application scenario, the encoder system and method embodiments described herein may be used to impress desired information (e.g., message information) on an image in a manner that is not apparent to viewers of the image. In this case, the channel state information S is the original image, and the message bits define the information (e.g., a digital watermark) that is to be impressed on the image. The encoder system/method may perform the addition of the signal X to the original image S to form a modified image XM. The modified image XM may be stored or transmitted or made available to a set of intended recipients. Potential adversaries may attempt to corrupt the impressed information by adding noise Z to the modified image XM. The corresponding decoder system/method may recover the original impressed information from the noise-corrupted image, i.e., the signal XM+Z.
In another application scenario, the encoder system and method embodiments described herein may be used in the context of multiple transmitters and multiple receivers. For example, transmitters TA and TB may be interested in transmitting respective messages mA and mB to receivers RA and RB respectively. If the transmitters TA and TB are set up to perform the transmissions to their respective target receivers RA and RB at the same time, transmitter TA can anticipate that it's transmitted signal XA will be subjected to an additive modification due to the signal XB to be transmitted by transmitter TB. From the point of view of transmitter TA, the additive modification is channel state information SA. Transmitter TB can similarly anticipate the additive modification of it's transmitted signal XB. To compensate for these additive modifications, the transmitters TA and TB may exchange their messages mA and mB through an extra “side” channel prior to transmitting to their respective target receivers RA and RB. Transmitter TA can then compute the signal XB, estimate the channel state information SA from the computed signal XB, and then generate the signal XA using the message mA and channel state information SA according to any of the encoder system/method embodiments described herein.
In yet another application scenario, the encoder system and method embodiments described herein may be used to perform intersymbol interference (ISI) cancellation.
Consider a Gaussian ISI channel modeled by Y=X+S+S′+N, where S and S′ are the causal and anti-causal part of the ISI, respectively, and N is the noise. (ISI channels are ubiquitous in communications. For example, telephone channels can often be modeled as ISI channels.) A transmitter may be configured according to any of the system/method embodiments described herein to perform precoding in order to cancel (or compensate for) the ISI in a channel. The causal part S of the ISI is assumed to be known at the transmitter.
The following section describes additional embodiments of systems and method for encoding information and decoding information.
CCSI Using TCQ and IRA Codes
In one set of embodiments, codes are designed based on an algebraic message-based binning interpretation of dirty-paper coding in terms of source-channel coding. From an information-theoretical perspective, there are granular gain and boundary gain in source coding, and packing/coding gain and shaping gain in channel coding. Dirty-paper coding is primarily a channel coding problem (for transmitting messages). Thus, one should consider the packing gain and the shaping gain. In addition, the presence of side information at the encoder system necessitates source coding to satisfy the power constraint. With source coding, the constellation is replicated (e.g., infinitely replicated) so that one can quantize the side information to satisfy the power constraint. Thus source coding in dirty-paper coding is not conventional in the sense that there is granular gain but no boundary gain. We recognize the equivalence between the shaping gain in channel coding and the granular gain in source coding for dirty-paper coding. Then we attempt to achieve the shaping gain via source coding and the packing gain via channel coding. In practice, the former may be done with quantizers (e.g., TCQ-based quantizers) having almost spherical Voronoi cells in a high-dimensional Euclidean space, and the latter with near-capacity channel codes (e.g., IRA codes).
Treating TCQ as a form of lattice VQ, we seamlessly combine TCQ with both non-systematic and systematic IRA codes in a source-channel coding setup without sacrificing the performance of either component. That is: both the TCQ and IRA code components still work their best when combined together in our dirty-paper code constructions. Because of this, the practical performance loss ΔSNR (in dB) in our designs is the sum of the packing loss ΔSNRp due to IRA codes and the modulo loss ΔSNRm due to TCQ, i.e.,
ΔSNR=ΔSNRp+ΔSNRm. (14)
After using the generator polynomial presented in [16] to implement TCQ of different numbers of states and subsequently measuring the equivalent g(Λ), we compute ΔSNRm from (3) with C*=0.25 b/s. Assuming that ΔSNRp=0.34 dB, Table I, shown in
Simulations show that the performance of our designs matches the predicted ones in Table I (see
Furthermore, our code designs with 256-state TCQ perform better than the code design in [1] with 512-state TCQ.
We view TCQ as an efficient means of implementing an equivalent high-dimensional lattice quantizer Λ and use scalar notation in the sequel. We use the dither D that is uniformly distributed in a cubic lattice cell. Although dithering plays an important role theoretically, we observe little of its impact on the code performance.
Encoding: The side information S is first linearly scaled by α, and then αS+D is quantized to u by a coset of the TCQ selected by the message m so that the obtained quantization error X=u−αS−D satisfies the power constraint E[X2]≦PX. X is transmitted over the side-information channel.
Decoding: The decoder receives Y=X+S+Z and finds the codeword û closest to Y′=αY+D=u+N′, where N′=(1−α)(−X)+αZ is the equivalent channel noise. Note that the “mod A” operation is implicitly implemented in TCQ because its quantization error is bounded. Finally the index of the bin containing û is identified as the decoded message.
In one set of embodiments, our code designs aim to use the strongest possible TCQ to achieve most of the 1.53 dB granular gain so that the distribution of X (and the dither D) approaches Gaussian, while employing IRA codes to approach the capacity. Next we describe embodiments of our code designs with both non-systematic and systematic IRA codes.
A. TCQ Plus Non-Systematic IRA Code Design
We first present embodiments of our dirty-paper code designs based on 256-, 512-, and 1024-state TCQs (with 1.33, 1.36, and 1.38 dB granular gain, respectively) and non-systematic IRA codes. The encoder is shown in
For the CND profile, we introduce bi-regularity to the non-systematic IRA code; that is, a part of the check nodes are of degree 1, which helps move the CND EXIT chart up from the origin. (For more information regarding the use of bi-regularity, please see [7].) Let a1 be the percentage of edges associated with degree-1 check nodes. For various values of a1 and the other check node degree, we examine the CND&ACC&TCQ EXIT charts and select the best CND profiles as:
The variable node decoding (VND) EXIT chart starts from the origin, so there is a small vertical opening between the starting points of the CND and VND EXIT charts for practical IRA code design.
The decoder, schematically shown in
Based on the VND EXIT charts with different variable node degrees (e.g., dashed curves in
To achieve the rate of 0.25 b/s, we set K/N=1/4 with:
The resulting VND profiles are:
B. Simulation Results for the TCQ Plus Non-systematic IRA Code Design
With 256-state TCQ and the corresponding IRA code, after simulating 50 blocks of transmission, we obtain a bit error rate (BER) of 1.50×10−5 when SNR=−2.844 dB, which is 0.984 dB away from SNR* for C*=0.25 b/s. This performance is slightly better than the predicted 0.99 dB gap shown in Table I (see
With 512-state TCQ and the corresponding IRA code, after simulating 100 blocks of transmission, we obtain a BER of 1.56×10−5 when SNR=−2.9258 dB, which is 0.90 dB away from SNR* at 0.25 b/s, matching the predicted performance in Table I (see FIG. 10). The maximal number of decoding iterations is set to be 150 and the actual number to achieve convergence is between 50 and 115.
With 1024-state TCQ and the corresponding IRA code, after simulating 100 blocks of transmission with our design based on the 1024-state TCQ, we obtain a BER of 4.76×10−5 when SNR=−2.993 dB, which is 0.83 dB away from the capacity in (3) at 0.25 b/s. This performance also matches the predicted 0.49+0.34=0.83 dB gap in Table I (see
C. TCQ Plus Systematic IRA Code Design
We now examine embodiments of a dirty-paper code design based on TCQ and systematic IRA codes. We use a systematic IRA code to move the starting point of the VND EXIT chart to the right of the origin. This way, the horizontal opening between the starting points of the CND and VND EXIT charts will allow practical IRA code design. However, we discover that whereas the right shift of the VND EXIT chart from using systematic IRA codes is relatively large for pure channel coding problems, this shift is very small in dirty-paper coding (see the solid curves of
One embodiment of an encoder with two TCQs for rate K/(K+N) b/s is shown in
We consider two setups: one employs 256-state TCQ1 and TCQ2 (with an individual/overall granular gain of 1.33 dB); another uses a 512-state TCQ1 (with 1.36 dB granular gain) and a 1024-state TCQ2 (with 1.38 dB granular gain) for an overall granular gain of 1.3662 dB in source coding. In each setup, we compare the CND&ACC&TCQ1 EXIT charts and select the CND profiles as:
The decoder system is schematically shown in
Due to the presence of the BCJR decoder corresponding to the “systematic part”, we evaluate the VND&TCQ2 EXIT charts via simulations, in which we set K/N=1/3 so that the rate K/(K+N)=0.25 b/s with:
We design the VND profile by matching the EXIT chart of the CND&ACC&TCQ1 part. The resulting VND profiles are:
D. Simulation Results for the TCQ Plus Systematic IRA Code Design
For the setup with 256-state TCQ1 and TCQ2, we simulate 50 blocks of transmission at 0.25 b/s (as in the case with non-systematic IRA codes and 256-state TCQ), and obtain a BER of 2.08×10−5 at the 0.984 dB gap from SNR*. The maximal number of decoding simulations is again 150 and the actual number to achieve convergence is between 50 and 115.
In the setup with 512-state TCQ1 and a 1024-state TCQ2, 20 blocks of transmission are simulated at 0.25 b/s. We obtain a BER of 5.0×10−5 when SNR=−2.945 dB, which is 0.883 dB away from SNR* at 0.25 b/s. The maximal number of decoding iterations is set to be 150 and the actual number to achieve convergence is between 40 and 100.
E. Several Embodiments
As noted above, our code designs may use BCJR decoding. Each BCJR decoding iteration includes a number of loop operations.
In one embodiment of our design, based on the non-systematic IRA code and 256-state TCQ, K=60,000, N=240,000 bits, the number of input bits is 1(TCQ)+1(ACC)=2. The BCJR decoder thus executes 2(8+1)×22×240,000=512×4×240,000 loop operations per iteration. Note that in
In another embodiment of our design, based on the systematic IRA code and 256-state TCQs, K=60,000 and N=180,000, the number of input bits is 1(TCQ2)+1(systematic bit)=2 for the “systematic part” and 1(TCQ1)+1(ACC)=2 for the “parity part”. In the “systematic part”, the total number of loop operations is:
28×22×60,000=256×4×60,000.
In the “parity part”, the number is
2(8+1)×22×180,000=512×4×180,000.
The combined number of loop operations is thus 512×4×210,000 per iteration, which is ⅞ of the complexity of our design based on the non-systematic IRA code.
Finally, the total number of loop operations in our code designs using 512-state TCQ and the non-systematic IRA code (with K=30,000 and N=120,000) and using 512-state TCQ, 1024-state TCQ2 and the systematic IRA code (with K=30,000 and N=90,000) is the same at 512×4×240,000 per BCJR decoding iteration.
We have addressed the problem of near-capacity dirty-paper code designs based on TCQ and IRA codes. The source-channel coding approach we take enables us to seamlessly combine TCQ and IRA codes in a dirty-paper code and to see a separate modulo loss due to source coding and the packing loss due to channel coding.
The code designs presented herein are applicable in a number of fields, including (but not limited to): dirty-paper coding to image data-hiding, coding for MIMO broadcast channels, and transmitter cooperation in wireless ad hoc networks.
This application is a continuation of U.S. patent application Ser. No. 11/684,427, filed Mar. 9, 2007, entitled “SOURCE-CHANNEL APPROACH TO CHANNEL CODING WITH SIDE INFORMATION,” which claims the benefit of U.S. Provisional Application No. 60/782,416, filed on Mar. 15, 2006, entitled “NEAR-CAPACITY DIRTY-PAPER CODE DESIGN: A SOURCE-CHANNEL CODING APPROACH,” the content of which are incorporated by reference herein in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5499254 | Ikekawa et al. | Mar 1996 | A |
| 6778602 | Agazzi et al. | Aug 2004 | B2 |
| 6810502 | Eidson et al. | Oct 2004 | B2 |
| 7305029 | Agazzi et al. | Dec 2007 | B2 |
| 7310768 | Eidson et al. | Dec 2007 | B2 |
| 7414549 | Yang et al. | Aug 2008 | B1 |
| 7746758 | Stolpman | Jun 2010 | B2 |
| Number | Date | Country | |
|---|---|---|---|
| 20110311003 A1 | Dec 2011 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60782416 | Mar 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11684427 | Mar 2007 | US |
| Child | 13220574 | US |
