This application claims priority to and the benefit of Korea Patent Application No. 10-2004-25345 filed on Apr. 13, 2004 in the Korean Intellectual Property Office, the entire content of which is incorporated herein by reference.
(a) Field of the Invention
The present invention relates to a decoding apparatus for LDPC (Low-Density Parity-Check) codes using sequential decoding, and a method thereof. More specifically, the present invention relates to a decoding apparatus for LDPC codes and a method thereof that decode LDPC codes when receiving data encoded with LDPC codes on a channel having consecutive output values.
(b) Description of the Related Art
LDPC codes are linear block codes invented by Gallager in 1962, and are defined as a sparse parity-check matrix in which most of the elements are zero.
The LDPC code was almost forgotten since the expense of its implementation was too high at that time. It was recently rediscovered, in 1995, and was improved as an irregular LDPC code by generalization in 1998.
A probabilistic decoding algorithm for the LDPC codes was also invented at the time of Gallager's first discovery of the LDPC codes. The performance of the LDPC codes decoded by the algorithm is remarkably high, and was more improved by expansion of a codeword from binary codes to nonbinary codes.
Like turbo codes, the LDPC codes have a bit error rate (BER) close to the Shannon channel capacity limit. Irregular LDPC codes known to have a highest performance only need 0.13 more dB from the Shannon channel capacity to get a bit error rate (BER) of 10−6 when its code length is about one million (106) bits in the additive white Gaussian noise (AWGN) channel environment. For that reason, the irregular LDPC codes are suitable for applications that require a high-quality transmission environment having an extremely low bit error rate (BER).
Message-passing decoding algorithms are used for decoding the LDPC codes. The most representative message-passing decoding algorithm is the sum-product algorithm. The sum-product algorithm uses summations and multiplications as basic operations of decoders, and its performance is determined by the construction method of check nodes and variable nodes of the LDPC codes.
Korean Patent Application No. 2001-50423 (filed on Aug. 21, 2001) by the applicant of the present invention discloses an invention under the title of “Apparatus for Adaptively Determining Maximum Number of Decoding Iterations for LDPC Decoder Using Signal-to-Noise Ratio Estimation, Method thereof, LDPC Decoding Apparatus Including the Apparatus, and Method thereof”.
More specifically, the apparatus for adaptively determining the maximum number of decoding iterations for an LDPC decoder according to the cited invention estimates a signal-to-noise ratio corresponding to a received LDPC encoded signal, and adaptively determines the maximum number of decoding iterations corresponding to the estimated signal-to-noise ratio based on a memory storing maximum numbers of decoding iterations corresponding to various signal-to-noise ratios.
According to the cited invention, the signal-to-noise ratio corresponding to the received signal is estimated to adaptively determine the maximum number of decoding iterations that satisfies a required performance. This reduces the average number of decoding iterations and hence a delay of the signal, but disadvantageously increases the number of calculations.
Korean Patent Application No. 2002-34987 (filed on Jun. 21, 2002) describes an invention under the title of “Decoding Method of Error Correction Codes Using Approximation Function”.
More specifically, the decoding method of error correction codes using an approximation function according to the cited invention is directed to a method for decoding error correction codes using an approximation function so as to simplify the decoding operation when using the approximation function for a decoding process of error correction codes in a digital data receiver. The decoding method includes: selecting a function containing no negative values and that is symmetrical about a function axis; dividing a variable interval into at least three intervals, and selecting a linear function approximating the function by the respective intervals; performing an operation on two input message values to determine the variable interval for the two values; operating the linear function corresponding to the interval to determine two function values; and determining the difference between the two function values. The cited invention simplifies the decoding function to reduce the number of calculations and is also applicable to other types of codes. The method is, however, simply reducing the number of calculations by simplification of the calculations using a function for reducing the number of decoding operations.
Korean Patent Application No. 2003-44955 (filed on Jul. 3, 2003) discloses an invention under the title of “Method and System for Decoding LDPC Codes”.
More specifically, the cited invention provides a method for transmitting a message using LDPC codes. According to the cited invention, an input message is encoded to generate LDPC codes according to a parity-check matrix constructed to restrain a sub-matrix of the parity-check matrix. Here, the LDPC codes are transmitted on a wireless communication system (e.g., a satellite network), and a receiver on the wireless communication system iteratively decodes the received LDPC codes according to a signal constellation related to the LDPC codes. The receiver decodes the LDPC codes at least twice, and then iteratively regenerates a signal array bit matrix. The cited invention generates codes restraining a sub-matrix of the parity-check matrix of LDPC codes to facilitate encoding of the codes and uses a signal constellation for decoding the codes.
However, the decoding apparatus using the conventional message-passing decoding algorithm also generates update information for the respective variable nodes and collectively reflects the update information in the calculations to update a message for each node, so there is a demand for a larger size of memory that is necessary for message storage of a message-passing decoder and the convergence rate of the message-passing decoder is retarded.
It is an advantage of the present invention to provide a decoding apparatus for LDPC codes using sequential decoding, and a method thereof that can improve the decoding convergence rate of a sum-product algorithm in is a message-passing decoding algorithm for decoding LDPC codes.
It is another advantage of the present invention to provide a decoding apparatus for LDPC codes using sequential decoding and a method thereof that divide check nodes into several subsets to guarantee a high decoding performance even when the LDPC codes are decoded with a small number of decoding iterations.
It is still another advantage of the present invention to provide a decoding apparatus for LDPC codes using sequential decoding and a method thereof that can reduce the size of a memory necessary for message storage of a message-passing decoder.
It is further another advantage of the present invention to provide a decoding apparatus for LDPC codes using sequential decoding and a method thereof that can improve the convergence rate of a message-passing decoder to realize a high-speed decoding apparatus.
In one aspect of the present invention, there is provided a decoding method for LDPC codes using sequential decoding that includes: (a) dividing nodes into check nodes for a parity-check message and variable nodes for a bit message according to a parity-check matrix; (b) dividing the check nodes into a predetermined number of subsets; (c) sequentially decoding the LDPC codeword of each subset for all the check nodes; (d) generating an output message for verifying validity of the decoding result; and (e) iteratively performing the steps (b), (c), and (d) by a predetermined number of iterations.
The decoding method further includes: interrupting the decoding operation when the output message of the step (d) satisfies a defined decoding check equation.
The number of decoding iterations is reduced according to an increase in the convergence rate when the validity of the LDPC codeword is determined from the output message of the step (d). The number of decoding iterations is fixed at a value smaller than the maximum number of decoding iterations during the iterative decoding process.
Each of the subsets of the check nodes is decoded with a different priority. The subset for highest-order variable nodes connected to the check nodes is decoded with a highest priority.
The step (b) includes: dividing the check nodes into subsets, each having a different number of elements.
The number of the subsets is an integer other than a divisor of the number of the check nodes.
The step (e) includes: changing the decoding order of the subsets used in a previous decoding operation when the number of decoding iterations is increased. Here, the decoding order used in the previous decoding operation is reversed, or a new decoding priority to the subsets is determined.
The decoding priority to the subsets of the check nodes is differentiated according to the number of decoding iterations.
In another aspect of the present invention, there is provided a decoding apparatus for LDPC codes using sequential decoding that includes: a codeword regenerator for regenerating the LDPC codes received through a channel into a codeword for decoding; a message-passing decoder for sequentially decoding the LDPC codeword of each subset for all check nodes, the check nodes being divided into a predetermined subsets; and an information-restoring section for determining whether there is an error in the decoded codeword, and extracting and transmitting information when there is no error in the codeword.
The message-passing decoder exchanges messages through defined edges between check nodes for a parity-check message and variable nodes for a bit message according to a parity-check matrix to update a node message.
The number of subsets is equal to or greater than a maximum order of the variable nodes. Each of all the edges connected to a specific one of the variable nodes is included in a different subset.
The message-passing decoder includes: a parity-check matrix memory for storing a parity-check matrix; an input buffer memory for storing an input message; a variable node message updater for receiving an input from the input buffer memory and a check node output memory and processing an output message of the variable nodes according to the stored parity-check matrix; a variable node output memory for storing a result of the variable node message updater; a check node processor for receiving data stored in the variable node output memory to process the output message of the check nodes, and transmitting the processed output message to the variable node message updater; a check node output memory for storing a processing result of the output message of the check nodes; an output buffer memory for transmitting the decoding result to the information-restoring section so as to verify validity of the decoding result, after completion of the decoding operation for all the subsets; and a decoding operation controller for determining all kinds of operations related to the decoding operation.
The data of the variable node output memory are message-updated as often as the number of the subsets are.
After the completion of the decoding operation on one subset, the connection state of nodes and edges in the variable node message updater and the check node processor is loaded from the decoding operation controller to reset nodes and edges for a next subset.
The decoding operation of the message-passing decoder is iteratively performed with a predetermined number of decoding iterations.
The present invention is for improving the decoding convergence rate of a sum-product algorithm among the message-passing decoding algorithms for decoding LDPC codes. The check nodes for a decoder of LDPC code are divided into several subsets and sequentially decoded with a different decoding priority assigned to each of the subsets. Here, the subsets of the check nodes are constructed by a defined construction method, and each subset of check nodes functions as one independent message-passing decoder.
The present invention assigns a different decoding priority to each of the subsets of the check nodes, so the update information calculated for a highest-priority subset is reflected on the message updating of the next subset. This method improves a decoding performance due to the update result of the upper-priority subset of check nodes relative to the conventional message-passing decoding algorithm but has the same calculation complexity because it differs from the conventional message-passing decoding algorithm only in the decoding priority of each subset. In addition, the message-passing decoding using the method of the present invention reduces the size of a memory necessary for message storage of a message-passing decoder and improves the convergence rate of the message-passing decoder to guarantee a high speed of the implemented decoder.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate an embodiment of the invention, and, together with the description, serve to explain the principles of the invention:
a, 5b, and 5c show a one-cycle iteration decoding process of a (2,4) regular LDPC code having a length of 4 according to an embodiment of the present invention;
a to 7d show a one-cycle iteration decoding process of LDPC codes using sequential decoding when check nodes are divided into subsets according to an embodiment of the present invention;
In the following detailed description, only the preferred embodiment of the invention has been shown and described, simply by way of illustration of the best mode contemplated by the inventor(s) of carrying out the invention. As will be realized, the invention is capable of modification in various obvious respects, all without departing from the invention. Accordingly, the drawings and description are to be regarded as illustrative in nature, and not restrictive. To clarify the present invention, parts which are not described in the specification are omitted, and parts for which similar descriptions are provided have the same reference numerals.
Hereinafter, a decoding apparatus for LDPC codes using sequential decoding and a method thereof according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
The embodiment of the present invention is directed to a construction method of a message-passing decoding algorithm for decoding data encoded with LDPC codes as received on a channel having consecutive output values in which check nodes in the decoder are divided into several subsets, each being decoded with a predetermined priority, and a decoding apparatus having a function thereof.
The decoding apparatus for LDPC codes using sequential decoding and the method thereof can be applied to decoding of block codes encoded with LDPC codes.
Referring to
In decoding the LDPC codes, a Tanner graph 200 is defined from the sparse parity-check matrix 100, and a message-passing algorithm is applied to the graph.
The Tanner graph 200 comprises nodes 210 and 220, and branches 230. The nodes 210 and 220 are divided into parity-check nodes 210 for a parity-check message, and bit nodes 220 for a bit message. The number of the parity-check nodes 210 is equal to the length of the column in the parity-check matrix 100, and the number of the bit nodes 220 is equal to the length of the row in the parity-check matrix 100. The nodes 210 and 220 represent the rows and columns of the matrix, respectively. The branches 230 denote nonzero elements in the parity-check matrix 100.
The leftmost branch of
There are two kinds of LDPC codes according to whether the order of the nodes 210 and 220 is regular or not. The LDPC code with the regular order of the nodes 210 and 220 is called “regular LDPC code”, while the LDPC code with the irregular order of the nodes 210 and 220 is called “irregular LDPC code”.
The above defined parity-check matrix 100 and the Tanner graph 200 concerned are used for encoding and decoding.
Referring to
When an information word having a length of k is fed into the encoder 310, the encoding section 311 receives a parity-check matrix of
The codeword selector 313 is a component for generating codes to be actually transmitted from the encoding section 311 through a channel 320. The operation of the codeword selector 312 includes puncturing, padding, or the like.
The codeword passing through the channel 320 is transmitted to the decoder 330 and regenerated into a decoding codeword having a length of n by the codeword regenerator 331. The decoding section 332 decodes the regenerated codeword by a message-passing decoding. The information-restoring section 333 determines whether the decoded codeword has an error, and extracts actual information when there is no error in the codeword.
In the message-passing decoder 400, a log likelihood ratio (LLR) is calculated from the signal passing through the channel 220 of
In the message-passing decoder 400, N variable nodes 410 and M check nodes 420 exchange messages 440 and 450 through a defined edge 430 to update the node message.
During an initialization, the output message of the variable node 410 is defined as the following Equation 1.
L(qij)=L(xj) [Equation 1]
In the Equation 1, L(qij) is the output message of the variable node 410, and L(xj) is the input message of the variable node 410 transmitted from the channel. Namely, the output message of the variable node 410 is the same as the input message of the variable node 410 transmitted from the channel during the initialization.
The output message 450 of the check node 420 is calculated according to the following Equation 2.
Here, L(rij) 450 is the output message of the i-th check node 420 fed into the j-th variable node 410; R(i) is an index set of the variable nodes connected to the check nodes i 420; and R(i)/j is an index set of the variable nodes connected to the check nodes i 420 other than j.
The output message of each variable node 410 after the initialization is given by the following Equation 3.
Here, C(j) is an index set of check nodes 420 connected to the variable nodes j 410; and C(j)/i is an index set of the check nodes 420 connected to the variable nodes j 410 other than i. The message passed to the information-restoring section 333 after processing each variable node 410 and each check node 420 is calculated according to the following Equation 4.
Here, L(Qi) is an updated vector of LLR for each bit of the i-th partial codeword. The respective components in the vector are operated with one another, for the function and the calculation of the vectors according to the Equation 4. The information-restoring section 333 that is a data decoder arranges the output vector messages L(Qi) of the decoding section 332 in sequence to generate a message. Then, the codeword is decided from the generated message according to the following Equation 5.
a, 5b, and 5c show a one-cycle iteration decoding process of a (2,4) regular LDPC code having a length of 4 according to an embodiment of the present invention. The message-passing decoder 400 of
Hereinafter, an apparatus and method for decoding LDPC codes according to an embodiment of the present invention will be described.
Referring to
The check nodes 620 are divided into subsets 630 having l elements by a defined method. So, the number p of the subsets of the check nodes 620 is p=m/l.
The subset construction method that the number of elements of the subsets 630 is not constant shows a similar decoding performance to the subset construction method in which the number of elements is constant. But, the method that the subsets 630 have a different number of elements can have higher performance according to the connection state of the edges connecting the nodes 610 and 620 in the LDPC codes. For example, the performance is all the same in many cases when the number of the subsets 630 optionally determined is constant for irregular LDPC codes constructed to have an irregular number of variable nodes 610 connected to the check nodes 620. Namely, the decoding performance is almost the same when the total number p of the subsets 630 is constant even though each subset 630 has a different number of elements.
The number of the subsets 630 is determined by the characteristic of the codes generated. Generally, it is advantageous in the aspect of coding that the number p of the subsets 630 is equal to or greater than the maximum order in the variable nodes 610. When the number of the subsets 630 is less than the maximum order, it becomes problematic in the aspect of decoding order or decoding independence because there is a case in which one variable check 610 is connected to two check nodes 620 in the subset 630.
The addition of a condition that all the edges connected to a specific variable node 610 are included in different subsets 630 may enhance the decoding performance.
a to 7d show a one-cycle iteration decoding process of LDPC codes using sequential decoding when check nodes are divided into subsets according to an embodiment of the present invention, for a (2,4) regular LDPC code having a length of 4 when the number p of the subsets is 2. Namely,
For p=2, the number of subsets 730 and 740 is 2, and the groups 730 and 740 of l (=4) variable nodes 710 are the subsets 730 for one check node 720.
Hence, there are p(=2) subsets in this embodiment of the present invention, and each of the subsets 730 and 740 is considered as one sub-code, which functions as a unit decoder. This is similar to the structure of a decoder for Turbo codes that comprises at least two unit decoders each transmitting independent extrinsic information to another decoder using an interleaver.
The decoding operations of the Equations 1 to 4 are performed in the respective subsets 730 and 740. In the operation of the Equation 2 according to the embodiment of the present invention, the inputs for the check nodes 720 are divided into a variable node message updated by the subsets 730 of the previous check nodes and a non-updated variable node message.
The operation of the check nodes 720 can be expressed as the following Equation 6.
Here, R0(i) and R1(i) are an index set of the variable nodes 710 connected to the check nodes i 720; R0(i)/j is an index set of non-updated variable nodes 710 connected to the check nodes i 720 other than j; and R1(i)/j is an index set of variable nodes 710 connected to the check nodes i 720 other than j and already updated by the previous subsets 730.
The operation for the variable nodes 710 and the subsequent operations are the same as described in the Equations 3, 4, and 5.
Referring to
First, the input buffer memory 810 stores an input message of the decoder 800. The variable node message updater 820 receives an input from the input buffer memory 810 and the check node output memory 850 and performs the operation of the Equation 1 or 3, i.e., processes the output message of the variable nodes after the initialization according to the Equation 1 or 3.
The variable node output memory 830 stores the processing result. The check node processor 840 receives the stored data and performs the operation of the Equation 2, i.e., processes the output message of the check nodes according to the Equation 2.
Subsequently, the check node output memory 850 stores the processing result of the output message of the check nodes. The stored data are updated by the variable check message updater 820 and then stored in the variable node output memory 830 again.
The data of the variable node output memory 830 are message-updated as often as the number of the subsets. After the completion of the decoding operation on one subset, the connection state of nodes and edges in the variable node memory updater 820 and the check node processor 840 is loaded from the decoding operation controller 870 to reset nodes and edges for the next subset.
After the completion of the iterative operation for all the subsets, the decoding result is transmitted to the information-restoring section 333 through the output buffer memory 860 to verify its validity.
This process is iterated a predetermined number of iteration times. The decoding operation controller 870 determines all kinds of operations related to the decoding operation.
In the decoding method for LDPC codes according to an embodiment of the present invention, the check nodes are divided into several subsets during the decoding process, and the subsets are decoded according to their priority with several decoders. Here, the convergence rate for a bit error rate is variable according to the determination method of the subsets. The higher convergence rate means higher enhancement of the code performance with a smaller number of decoding iterations. Compared with the general LDPC decoding method, this decoding method only changes the order of operations of the decoder without increasing the complexity.
The embodiment of the present invention can decode a codeword with a smaller number of decoding iterations in most of the cases of iterative decoding of LDPC codes. Relative to the conventional method, the method of the present invention has much enhanced performance in the situation that the number of decoding iterations is small. In addition, the method of determining the codeword upon interruption of the decoding in the middle of the decoding process while the parity-check equation of the Equation 6 is satisfied may reduce the time taken for the decoding and show a higher performance for the same complexity as compared with the conventional method.
In the embodiment of the present invention, the number of the subsets is a divisor of the total number of check nodes, and the respective subsets are all the same in the number of elements. The value p is 1, 3, or 4, where the decoding method for p=1 is the same as the conventional message-passing algorithm. In the figure, I means the number of decoding iterations.
Referring to
When p is greater than 2, the decoding performance is higher even with a small number of decoding iterations (in curves 910 and 920). But, the decoding performance approaching the maximum performance of the codes is not so enhanced with a large number of decoding iterations.
Referring to
While this invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
As described above, the present invention assigns a priority to each subset of the check nodes for decoding in the conventional decoding method of LDPC codes to provide a higher decoding performance with a small number of decoding iterations and almost the same complexity. In addition, the present invention hastens the decision of the decoding success/failure in the decoder and hence guarantees high speed decoding by the reduction of the decoding time.
Number | Date | Country | Kind |
---|---|---|---|
10-2004-0025345 | Apr 2004 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
6938196 | Richardson et al. | Aug 2005 | B2 |
7281192 | Shen et al. | Oct 2007 | B2 |
20030023917 | Richardson et al. | Jan 2003 | A1 |
20030033575 | Richardson et al. | Feb 2003 | A1 |
20050154957 | Jacobsen | Jul 2005 | A1 |
Number | Date | Country |
---|---|---|
2003-016720 | Mar 2003 | KR |
1020030095144 | Dec 2003 | KR |
10-2004-0000060 | Jan 2004 | KR |
10-2004-0004162 | Jan 2004 | KR |
1020040014723 | Feb 2004 | KR |
Number | Date | Country | |
---|---|---|---|
20050229087 A1 | Oct 2005 | US |