The present disclosure relates to decoding technologies, and in particular, to a solution to implementing speech decoding in a speech decoder.
In a speech transmission system, the Algebraic Code Excited Linear Prediction (ACELP) is commonly applied to speech coders. The code stream generated by an ACELP-based speech encoder is measured in speech frames.
The parameters of the speech frames generated by the ACELP-based speech coder generally include: spectrum parameter, adaptive codebook parameter, algebraic codebook parameter, pitch lag (also known as Long Time Prediction (LTP) lag), adaptive codebook gain, and algebraic codebook gain. The pitch lag parameter is configured to specify a basic period of a speech signal. Generally, the pitch lag at different time always falls within a certain range.
After the data receiving end receives data frames sent from the data transmitting end, the decoder at the receiving end needs to recover erroneous parameter in the erroneous frame if it is determined that an error or loss occurs (namely, an erroneous frame appears). That is, a new parameter is determined as a corresponding parameter of the frame to reduce deterioration of quality of the decoded speech.
In the prior art, when an erroneous frame appears, three solutions specific to the pitch lag parameter are available, as described below.
When a frame error occurs (namely, an erroneous frame appears), the speech decoder uses the pitch lag parameter of the previous frame as the p itch lag parameter of the current erroneous frame repeatedly, namely:
where,
τ(m) is the pitch lag parameter of the current frame;
τ(m−1) is the pitch lag parameter of the previous frame; and
DELAY=τ(m)−τmin is the pitch lag parameter after coding, and τmin is the lower limit of the pitch lag parameter.
It is evident that in the foregoing solution, if FER_FLAG (m)=TRUE (namely, an erroneous frame appears), the pitch lag parameter of the previous frame is used as a pitch lag parameter of the current erroneous frame. Otherwise, the pitch lag parameter of the current frame is determined directly.
In this solution, if frame errors occur continuously, the pitch lag parameters of multiple continuous frames are the same. Consequently, the periodicity is excessive, the decoded speech involves sharp noise, and the effect of the decoded speech is deteriorated.
When a frame error occurs, the speech decoder uses 1 plus an integer part of the pitch lag parameter of the previous frame as the pitch lag parameter of the erroneous frame, and restricts the value of the pitch lag parameter within a specific range, namely:
if lagint(n)<PIT_MAX, lagint(n)=lagint(n−1)+1
else lagint(n)=PIT_MAX
lagfrac(n)=0
where,
lagint(n) is the integer part of the pitch lag parameter of the current frame;
lagint(n−1) is the integer part of the pitch lag parameter of the previous frame;
PIT_MAX is the upper limit of the value of the integer part of the pitch lag; and
lagfrac(n) is the fractional part of the pitch lag parameter of the current frame. The minimum precision of certain speech codec is a fraction such as ⅓.
It is evident that in this solution, when an erroneous frame appears, (lagint(n−1)+1) serves as a lagint(n), and determines whether the lagint(n) of the current frame is less than PIT_MAX. If such is the case, the lagint(n) remains unchanged; otherwise, the lagint(n) of the current frame is adjusted to PIT_MAX.
In this solution, excessive periodicity is avoided, and sharp noise of the decoded speech is overcome. However, if erroneous frames appear continuously at the data receiving end, a great accumulated error exists between the pitch lag parameter determined for the current frame and the actual pitch lag parameter, thus reducing the decoding accuracy drastically.
When a frame error occurs, the signals are classified first. The classification flag is Qlag. If Qlag=1, a sound signal is a steady signal (the signal is much periodical). If Qlag=0, the sound signal is an unsteady signal (the signal is little periodical). Then different solutions to determining pitch lag parameters are applied according to different classification flags, specifically:
where,
T is the pitch lag parameter of the current frame;
Treceived is the pitch lag parameter of the previously received normal frame;
Tmax=max(Tbuffer) represents the maximum pitch lag parameter in the latest normal frame history buffer;
Tmax-1 re presents the secondarily maximum pitch lag parameter in the latest normal frame history buffer Tbuffer;
Tmax-2 re presents the thirdly maximum pitch lag parameter in the latest normal frame history buffer Tbuffer; and
RND(x) is a random number whose range is
In the process of implementing the present disclosure, the inventor finds at least the following defects in the prior art: In the foregoing solution, if continuous erroneous frames appear and Qlag=1, multiple continuous frames adopt the pitch lag parameter of the previously received normal frame, thus leading to excessive periodicity. Moreover, classification of the signals makes the whole calculation process more complex.
A method and apparatus for decoding speech in a speech decoder are provided in various embodiments of the present disclosure to overcome excessive periodicity in the decoding process and ensure the decoding accuracy.
A decoding method provided in an embodiment of the present disclosure includes: receiving data frames from an encoder; and if any erroneous frame appears, calculating and determining the pitch lag parameter of the erroneous frame, decoding the data frames according to the determined pitch lag parameter of the erroneous frame, and obtaining the decoded data.
The process of determining the pitch lag parameter of the erroneous frame includes: determining the number of continuous erroneous frames and the pitch lag parameter of the previous frame; and adjusting the pitch lag parameter of the previous frame according to the number of the continuous erroneous frames and the preset adjustment policy, and calculating and determining the pitch lag parameter of the current erroneous frame, where the preset adjustment policy is: adjusting the determined pitch lag parameter of the current erroneous frame fluctuates within a preset value range according to the number of continuous erroneous frames.
A decoding apparatus provided in an embodiment of the present disclosure includes a pitch lag parameter calculating unit, configured to calculate and determine the pitch lag parameter of the current erroneous frame, and provide the determined pitch lag parameter for the decoding entity for the purpose of decoding operation.
The pitch lag parameter calculating unit includes: a parameter obtaining unit, configured to obtain and determine the number of continuous erroneous frames and the pitch lag parameter of the previous frame; and a pitch lag parameter determining unit, configured to: adjust the pitch lag parameter of the previous frame according to the number of the continuous erroneous frames determined by the parameter obtaining unit and the preset adjustment policy, and calculate and determine the pitch lag parameter of the current erroneous frame, where the preset adjustment policy is adjusting the determined pitch lag parameter of the current erroneous frame fluctuates within a preset value range according to the number of the continuous erroneous frames.
The technical solution under the present disclosure reveals: at the decoding end, if continuous erroneous frames appear, the pitch lag parameters of the continuous erroneous frames fluctuate around the pitch lag parameter of the previous frame rather than increase monotonously, thus reducing accumulated errors and improving decoding accuracy. Moreover, excessive periodicity is avoided, and the decoding effect is improved.
The embodiments of the present disclosure replace the pitch lag parameter in the erroneous frame in the case of frame error, thus reducing quality deterioration of decoded speech. Moreover, if continuous erroneous frames appear and the corresponding pitch lag parameters need to be replaced, the substitute value is set to a value which fluctuates around the pitch lag parameter of the previous frame. Therefore, the substitute value may be higher or lower than the pitch lag parameter value of the previous frame, thus reducing an accumulated error of the pitch lag parameter and avoiding excessive periodicity.
The embodiments are applicable to a process of replacing the pitch lag parameter with hidden frame error in an ACELP-based speech decoder or to other similar application scenarios.
The decoding method provided in an embodiment of the present disclosure is firstly described below. In this embodiment, the decoder at the data receiving end needs to receive data frames sent from the decoder, calculates and determines the pitch lag parameter of the erroneous frame if an erroneous frame is determined. Afterwards, the decoder performs decoding according to the determined pitch lag parameter of the erroneous frame in order to obtain decoded data.
In this embodiment, the process of determining the pitch lag parameter of the erroneous frame includes the following steps:
(1) Determining the number of continuous erroneous frames and the pitch lag parameter of the previous frame.
The pitch lag parameter of the previous frame may be the pitch lag parameter of a good frame which precedes the current erroneous frame, or the pitch lag parameter of a normal frame which precedes the current erroneous frame, or the pitch lag parameter of any other set frame which precedes the current erroneous frame.
(2) Adjusting the pitch lag parameter of the previous frame according to the number of continuous erroneous frames and a preset adjustment policy, and calculating and determining the pitch lag parameter of the current erroneous frame.
The preset adjustment policy is adjusting the determined pitch lag parameter of the current erroneous frame fluctuates within a preset value range according to the number of the continuous erroneous frames.
Specifically, the preset adjustment policy may be as follows:
A function for calculating the pitch lag parameter is preset, where the function uses the number of continuous erroneous frames as a variable, and the function value fluctuates within a set value range along with the change of the number of the continuous erroneous frames. The function may use only the number of the continuous erroneous frames as a variable, and the calculation result of the function needs to be further operated (such as summation) with the pitch lag parameter of the previous frame to determine the pitch lag parameter of the current erroneous frame. The function may also use the number of the continuous erroneous frames and the pitch lag parameter of the previous frame as variables, and the calculation result of the function is the pitch lag parameter of the current erroneous frame.
In this case, the process of calculating and determining the pitch lag parameter of the current erroneous frame may be: calculating and determining the pitch lag parameter of the current erroneous frame according to the currently statistical number of continuous erroneous frames, the function for calculating the pitch lag parameter, and the pitch lag parameter of the previous frame.
Alternatively, the preset adjustment policy may be as follows:
A group of adjustment parameter values are preset, and the adjustment parameter values correspond to the values obtained after modulo operation of the number of continuous erroneous frames, and fluctuate within a preset value range.
In this case, the process of calculating and determining the pitch lag parameter of the current erroneous frame may be: performing modulo operation for the currently statistical number of continuous erroneous frames, using the value obtained after the modulo operation to determine the corresponding adjustment parameter value, and using the sum of the corresponding adjustment parameter value and the pitch lag parameter of the previous frame as the pitch lag parameter of the current erroneous frame.
In the embodiments of the present disclosure, in order to prevent the calculated pitch lag parameter of the current erroneous frame from deviating the actual value seriously, the calculated pitch lag parameter of the current erroneous frame is adjusted to the preset value range in a set mode if the calculated pitch lag parameter of the current erroneous frame exceeds a preset value rang.
To make the method embodiments of the present disclosure clearer, the specific application of the embodiments is detailed below by reference to accompanying drawings.
In the application process of this embodiment, the solution for replacing and updating the pitch lag parameter of the current erroneous frame is shown in
Step 201: Statistics on the number of continuous erroneous frames is made. Suppose that a variable bfi_count is used to record the number of the continuous erroneous frames, the bfi_count is cleared when a good frame appears.
Step 202: The pitch lag parameter of the frame prior to the current frame is recorded, and the variable old_T0 is used to record the integer part of the pitch lag parameter of the previous frame.
Step 203: When a erroneous frame (if any frame is lost), a preset function is used to adjust the integer part of the pitch lag parameter of the previous frame, and the adjusted value is used as the integer part of the pitch lag parameter of the current erroneous frame.
The preset function may be: T0=old_T0+ƒ(bƒi_count).
In the foregoing function, T0 is the integer part of the pitch lag parameter of the current frame, old_T0 is the integer part of the pitch lag parameter of the previous frame, ƒ(bƒi_count) is an adjustment function about the number of continuous erroneous frames, and fluctuates within a preset value range with the change of the number of continuous erroneous frames.
For example, the function about the number of continuous erroneous frames may be:
Evidently, this function prevents accumulated error of the pitch lag parameter in the case that frames are lost continuously.
The ƒ(bƒi_count) may also fluctuate around 0 with the change of the bƒi_count. That is, the ƒ(bƒi_count) n either increases monotonously or decreases monotonously. This prevents the accumulated error from increasing with the number of continuously lost frames.
Step 204: After the pitch lag parameter T0 of the current erroneous frame is obtained in step 203, whether the T0 value falls within the preset value range is determined. If the T0 value does not fall within the preset value range, step 205 is performed; otherwise, step 206 is performed.
Step 205: The T0 is adjusted to the preset value range in the set mode, and then the T0 value is output to act as the pitch lag parameter of the current erroneous frame.
For example, the preset value range is from the pitch lag upper limit “PIT_MAX” to the pitch lag lower limit “PIT_MIN”. In this case, the corresponding judgment and processing process may be:
If T0>PIT_MAX, letting T0 be PIT_MAX; if T0<PIT_MIN, letting T0 be PIT_MIN.
In the foregoing processing process, the fractional part of the pitch lag of the current frame may be cleared, namely, T0_frac=0, where T0_frac is the fractional part of the pitch lag of the current frame; or the T0_frac is set to be the same as the fractional part of the pitch lag parameter of the previous frame, or to be another preset value.
Step 206: The T0 directly is output to act as the pitch lag parameter of the current erroneous frame.
In the processing process in
Step 301: The encoded frames sent from the encoder are received.
Step 302: It is determined whether any erroneous frame appears. If any erroneous frame appears, step 304 is performed; otherwise, step 303 is performed.
Step 303: When a good frame appears, the number of continuous erroneous frames is cleared, and step 306 is performed.
Step 304: The number of continuous erroneous frames is updated, the value of the current erroneous frame is counted into the number of continuous erroneous frames, and step 305 is performed.
Step 305: The pitch lag parameter of the current erroneous frames is calculated, and step 306 is performed, where the specific calculation method is illustrated in
Step 306: The pitch lag parameter of the current frame is stored for calculating the pitch lag parameter of the erroneous frame later. In the case that the first frame is damaged and the pitch lag parameter of previous frame is not stored, the corresponding processing process is impossible. To prevent such a case, an initial value of the pitch lag parameter may be set.
Another decoding apparatus is provided in an embodiment of the present disclosure. As shown in
The pitch lag parameter calculating unit may include the following units:
(1) A Pitch Lag Parameter Saving Unit
The pitch lag parameter saving unit is configured to store the pitch lag parameter of previously received frames and provide the pitch lag parameter to a parameter obtaining unit. Specifically, the pitch lag parameter saving unit stores the pitch lag parameter of a preset frame, for example, the pitch lag parameter of the previous frame, or the pitch lag parameter of the previous normal frame.
(2) A Continuous Erroneous Frame Number Recording Unit
The continuous erroneous frame number recording unit is configured to store the number of the continuous erroneous frames that appear received data frames, and provide the number to the parameter obtaining unit.
(3) A Parameter Obtaining Unit
The parameter obtaining unit is configured to obtain and determine the number of continuous erroneous frames and the pitch lag parameter of the previous frame, where the obtained pitch lag parameter of the previous frame may be a pitch lag parameter of the frame prior to the current erroneous frame or a pitch lag parameter of other preset frame previously received.
(4) A Pitch Lag Parameter Determining Unit
The pitch lag parameter determining unit is configured to adjust the pitch lag parameter of the previous frame according to the number of continuous erroneous frames determined by the parameter obtaining unit and the preset adjustment policy, and calculate and determine the pitch lag parameter of the current erroneous frame. The preset adjustment policy is: with the change of the number of continuous erroneous frames, the determined pitch lag parameter of the current erroneous frame fluctuates within a preset value range, namely, with the increase of the continuous erroneous frames, the pitch lag parameter of the current erroneous frame sometimes increases and sometimes decreases, but always falls within the set range.
(5) A Pitch Lag Parameter Adjusting Unit
The pitch lag parameter adjusting unit is configured to adjust the pitch lag parameter of the calculated current erroneous frame to a preset value range after determining that the calculated pitch lag parameter of the current erroneous frame exceeds the preset value range, thus preventing great deviation between the determined pitch lag parameter of the current erroneous frame and the actual value.
In the embodiment of this apparatus, the pitch lag parameter determining unit may be implemented in the following two modes.
As shown in
The function calling unit is configured to call a preset pitch lag parameter calculating function which uses the number of continuous erroneous frames as a variable. The value of the function fluctuates within the preset value range along with the change of the number of the continuous erroneous frames. The function may use only the number of the continuous erroneous frames as a variable and the calculation result of the function needs to be further operated (such as summation) with the pitch lag parameter of the previous frame to determine the pitch lag parameter of the current erroneous frame. The function may also use the number of the continuous erroneous frames and the pitch lag parameter of the previous frame as variables and the calculation result of the function is the pitch lag parameter of the current erroneous frame.
The first pitch lag parameter calculating unit is configured to calculate and determine the pitch lag parameter of the current erroneous frame according to the currently statistical number of continuous erroneous frames, the function called by the function calling unit for calculating the pitch lag parameter, and the pitch lag parameter of the previous frame.
As shown in
The modulo operation unit is configured to perform modulo operation for the currently statistical number of continuous erroneous frames in a preset operation mode to obtain a modulo operation result.
The adjustment parameter calculating unit is configured to search for the corresponding adjustment parameter value among a preset group of adjustment parameter values according to the modulo operation result, where: the preset group of adjustment parameter values correspond to the modulo operation results of the number of continuous erroneous frames respectively, and the adjustment parameter value fluctuates within a set value range, for example, fluctuates around the value 0, or fluctuates between −1 and +1.
The second pitch lag parameter calculating unit is configured to calculate the sum of the adjustment parameter and the pitch lag parameter of the previous frame, and use the sum as the pitch lag parameter of the current erroneous frame.
In summary, in the process of applying the embodiments of the present disclosure, if frames are lost continuously and the pitch lag parameter of the corresponding frames needs to be replaced, the corresponding substitute value may be set to a value which fluctuates around the pitch lag parameter of the previous frame (such as the previous normal frame). Compared with the algorithm which increases monotonously in the prior art, the technical solution under the present disclosure reduces the accumulated error and improves the decoding accuracy. Moreover, in the foregoing embodiments, the substituted pitch lag parameter is a fluctuant value, for example, the fluctuation amplitude may be at least a sample point. Therefore, the embodiments of the present disclosure prevent excessive periodicity and avoid sharp noise of the decoded speech effectively.
It is understandable to those skilled in the art that the embodiments of the present disclosure may be implemented through software in addition to a universal hardware platform or through hardware only. In most cases, however, software in addition to a universal hardware platform is preferred. Therefore, the technical solution under the present disclosure or contributions to the prior art may be embodied by a software product. The software product is stored in a storage medium and incorporates several instructions which instruct a computer device (for example, PC, server, or network device) to execute the method provided in each embodiment of the present disclosure. Although the disclosure is described through some exemplary embodiments, the disclosure is not limited to such embodiments. It is apparent that those skilled in the art can make various modifications and variations to the disclosure without departing from the spirit and scope of the disclosure.
The disclosure is intended to cover the modifications and variations provided that they fall in the scope of protection defined by the following claims or their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2007 1 0001186 | Jan 2007 | CN | national |
This application is a continuation of PCT/CN2008/070142, entitled “A Method and Device for Accomplishing Speech Decoding in a Speech Decoder”, and filed on Jan. 18, 2008, which claims the priority benefit of Chinese Patent Application No. 200710001186.2, filed on Jan. 19, 2007. The contents of the above identified applications are incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5699485 | Shoham | Dec 1997 | A |
5862518 | Nomura et al. | Jan 1999 | A |
6055497 | Hallkvist et al. | Apr 2000 | A |
6584438 | Manjunath et al. | Jun 2003 | B1 |
6594626 | Suzuki et al. | Jul 2003 | B2 |
6636829 | Benyassine et al. | Oct 2003 | B1 |
6810377 | Ho et al. | Oct 2004 | B1 |
6968309 | Makinen et al. | Nov 2005 | B1 |
7788091 | Goudar et al. | Aug 2010 | B2 |
7869990 | Gao | Jan 2011 | B2 |
20030078769 | Chen | Apr 2003 | A1 |
Number | Date | Country |
---|---|---|
1134581 | Oct 1996 | CN |
1168751 | Dec 1997 | CN |
1272200 | Nov 2000 | CN |
1359513 | Jul 2002 | CN |
1432175 | Jul 2003 | CN |
1489762 | Apr 2004 | CN |
1535461 | Oct 2004 | CN |
101226744 | Apr 2011 | CN |
0747882 | Dec 1996 | EP |
0237475 | May 2002 | WO |
WO 0235520 | May 2002 | WO |
WO 0237475 | May 2002 | WO |
Number | Date | Country | |
---|---|---|---|
20090204396 A1 | Aug 2009 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2008/070142 | Jan 2008 | US |
Child | 12426379 | US |