The present invention relates to an apparatus for processing an audio signal and method thereof. Although the present invention is suitable for a wide scope of applications, it is particularly suitable for encoding or decoding an audio signal.
Generally, in case that an audio signal, and more particularly, the audio signal has strong characteristics of a speech signal, linear predictive coding (LPC) is performed on the audio signal. A linear predictive coefficient generated by linear predictive coding is transmitted to a decoder. Subsequently, the decoder reconstructs the audio signal by performing linear predictive synthesis on the corresponding coefficient.
Generally, a sampling rate is differently applied in accordance with a band of an audio signal. For instance, however, in order to encode an audio signal corresponding to a narrow band, it may cause a problem that a core having a low sampling rate is required. In order to encode an audio signal corresponding to a wide band, it may cause a problem that a core having a high sampling rate is separately required. Thus, the different cores differ from each other in the number of bits per frame and a bit rate.
Meanwhile, in case that a single sampling rate is applied irrespective of a narrow band signal or a wide band signal, since an order of a linear-predictive coefficient (or, the number of linear-predictive coefficients) is fixed, it may cause a problem that a case of a relative narrow band signal wastes bits unnecessarily.
Accordingly, the present invention is directed to an apparatus for processing an audio signal and method thereof that substantially obviate one or more of the problems due to limitations and disadvantages of the related art. An object of the present invention is to provide an apparatus for processing an audio signal and method thereof, by which the same sampling rate can be applied irrespective of a bandwidth of the audio signal.
Another object of the present invention is to provide an apparatus for processing an audio signal and method thereof, by which an order of a linear-predictive coefficient can be adaptively changed in accordance with a bandwidth of an inputted audio signal.
Another object of the present invention is to provide an apparatus for processing an audio signal and method thereof, by which an order of a linear-predictive coefficient can be adaptively changed in accordance with a coding mode of an inputted audio signal.
A further object of the present invention is to provide an apparatus for processing an audio signal and method thereof, by which a 2nd set of a 2nd order (or, a 1st set of a 1st order for quantizing a 2nd order) can be used for quantizing the 1st set of the 1st order using recurring properties of linear-predictive coefficients in quantizing linear-predictive coefficients (e.g., a coefficient of the 1st set of the 1st order, a coefficient of the 2nd set of the 2nd order) of different orders.
Accordingly, the present invention provides the following effects and/or features.
First of all, the present invention applies the same sampling rate irrespective of a bandwidth of an inputted audio signal, thereby implementing an encoder and a decoder in a simple manner.
Secondly, the present invention extracts a linear-predictive coefficient of a relatively low order for a narrow band signal despite applying the same sampling rate irrespectively of a bandwidth, thereby saving bits having relatively low efficiency.
Thirdly, the present invention assigns bits saved in linear prediction to a coding of a linear predictive residual signal additionally, thereby maximizing bit efficiency.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a method of processing an audio signal according to the present invention may include the steps of determining bandwidth information indicating that a current frame corresponds to which one among a plurality of bands including a 1st band and a 2nd band by performing a spectrum analysis on the current frame of the audio signal, determining order information corresponding to the current frame based on the bandwidth information, generating a 1st set linear-predictive transform coefficient of a 1st order by performing a linear-predictive analysis on the current frame, generating a 1st set index by vector-quantizing the 1st set linear-predictive transform coefficient, generating a 2nd set linear-predictive transform coefficient of a 2nd order in accordance with the order information by performing the linear-predictive analysis on the current frame, and if the 2nd set linear-predictive transform coefficient is generated, performing a vector-quantization on a 2nd set difference using the 1st set index and the 2nd set linear-predictive transform coefficient.
According to the present invention, a plurality of the bands further may include a 3rd band and the method may further include the steps of generating a 3rd set linear-predictive transform coefficient of a 3rd order in accordance with the order information by performing the linear-predictive analysis on the current frame and performing quantization on a 3rd set difference corresponding to a difference between an order-adjusted 2nd set linear-predictive transform coefficient and the 3rd set linear-predictive transform coefficient.
According to the present invention, if the bandwidth information indicates the 1st band, the order information may be determined as a previously determined 1st order. If the bandwidth information indicates the 2nd band, the order information may be determined as a previously determined 2nd order.
According to the present invention, the first order may be smaller than the 2nd order.
According to the present invention, the method may further include the step of generating coding mode information indicating one of a plurality of modes including a 1st mode and a 2nd mode for the current frame, wherein the order information may be further determined based on the coding mode information.
According to the present invention, the order information determining step may include the steps of generating coding mode information indicating one of a plurality of modes including a 1st mode and a 2nd mode for the current frame, determining a temporary order based on the bandwidth information, determining a correction order in accordance with the coding mode information, and determining the order information based on the temporary order and the correction order.
To further achieve these and other advantages and in accordance with the purpose of the present invention, an apparatus for of processing an audio signal according to another embodiment of the present invention may include a bandwidth determining unit configured to determine bandwidth information indicating that a current frame corresponds to which one among a plurality of bands including a 1st band and a 2nd band by performing a spectrum analysis on the current frame of the audio signal, an order determining unit configured to determine order information corresponding to the current frame based on the bandwidth information, a linear-predictive coefficient generating/transforming unit configured to generate a 1st set linear-predictive transform coefficient of a 1st order by performing a linear-predictive analysis on the current frame, the linear-predictive coefficient generating/transforming unit configured to generate a 2nd set linear-predictive transform coefficient of a 2nd order in accordance with the order information, a 1st quantizing unit configured to generate a 1st set index by vector-quantizing the 1st set linear-predictive transform coefficient, and a 2nd quantizing unit, if the 2nd set linear-predictive transform coefficient is generated, performing a vector-quantization on a 2nd set difference using the 1st set index and the 2nd set linear-predictive transform coefficient.
According to the present invention, a plurality of the bands may further include a 3rd band, the linear-predictive coefficient generating/transforming unit may further generate a 3rd set linear-predictive transform coefficient of a 3rd order in accordance with the order information by performing the linear-predictive analysis on the current frame, and the apparatus may further include a 3rd quantizing unit configured to perform quantization on a 3rd set difference corresponding to a difference between an order-adjusted 2nd set linear-predictive transform coefficient and the 3rd set linear-predictive transform coefficient.
According to the present invention, if the bandwidth information indicates the 1st band, the order information may be determined as a previously determined 1st order. If the bandwidth information indicates the 2nd band, the order information may be determined as a previously determined 2nd order.
According to the present invention, the first order may be smaller than the 2nd order.
According to the present invention, the order determining unit may further include a mode determining unit configured to generate coding mode information indicating one of a plurality of modes including a 1st mode and a 2nd mode for the current frame and the order information may be further determined based on the coding mode information.
According to the present invention, the order determining unit may include a mode determining unit configured to generate coding mode information indicating one of a plurality of modes including a 1st mode and a 2nd mode for the current frame and an order generating unit configured to determine a temporary order based on the bandwidth information, the order generating unit configured to determine a correction order in accordance with the coding mode information, the order generating unit configured to determine the order information based on the temporary order and the correction order.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. First of all, terminologies or words used in this specification and claims are not construed as limited to the general or dictionary meanings and should be construed as the meanings and concepts matching the technical idea of the present invention based on the principle that an inventor is able to appropriately define the concepts of the terminologies to describe the inventor's invention in best way. The embodiment disclosed in this disclosure and configurations shown in the accompanying drawings are just one preferred embodiment and do not represent all technical idea of the present invention. Therefore, it is understood that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents at the timing point of filing this application.
According to the present invention, terminologies in this specification can be construed as the following meanings and terminologies failing to be disclosed in this specification may be construed as the concepts matching the technical idea of the present invention. Specifically, ‘coding’ can be construed as ‘encoding’ or ‘decoding’ selectively and ‘information’ in this disclosure is the terminology that generally includes values, parameters, coefficients, elements and the like and its meaning can be construed as different occasionally, by which the present invention is non-limited.
In this disclosure, in a broad sense, an audio signal is conceptionally discriminated from a video signal and indicates any kind of signal that can be auditorily identified in case of playback. In a narrow sense, the audio signal means a signal having none or small quantity of speech characteristics. Audio signal of the present invention should be construed in a broad sense. And, the audio signal of the present invention can be understood as a narrow-sensed audio signal in case of being used in a manner of being discriminated from a speech signal.
Moreover, coding may indicate encoding only but may be conceptionally usable as including both encoding and decoding.
Operations of the encoder 100 are schematically described as follows. First of all, in accordance with order information on a current frame, which is determined by the order determining unit 120, the linear prediction analyzing unit 130 generates a linear-predictive coefficient of a determined order. The respective components of the encoder 100 are described as follows.
First of all, the sampling unit 110 generates a digital signal by applying a predetermined sampling rate to an inputted audio signal. In doing so, the predetermined sampling rate may include 12.8 kHz, by which the present invention may be non-limited.
The order determining unit 120 determines order information of a current frame using an audio signal (and a sampled digital signal). In this case, the order information indicates the number of linear-predictive coefficients or an order of the linear-predictive coefficient. The order information may be determined in accordance with: 1) bandwidth information; 2) coding mode; and 3) bandwidth information and coding mode, which shall be described in detail with reference to
The linear prediction analyzing unit 130 performs LPC (linear Prediction Coding) analysis on a current frame of an audio signal, thereby generating linear-predictive coefficients based on the order information generated by the order determining unit 120. The linear prediction analyzing unit 130 performs transform and quantization on the linear-predictive coefficients, thereby generating a quantized linear-predictive transform coefficient (index). According to the present invention, since total 4 embodiments of the linear prediction analyzing unit 130 are provided, the 1st embodiment 130A, the 2nd embodiment 130A′, the 3rd embodiment 130B and the 4th embodiment 130C will be described with reference to
The linear prediction synthesizing unit 140 generates a linear prediction synthesis signal using the quantized linear-predictive transform coefficient. In doing so, the order information may be usable for interpolation and a detailed configuration of the linear prediction synthesizing unit 140 will be described with reference to
The adder 150 generates a linear prediction residual signal by subtracting the linear prediction synthesis signal from the audio signal. In particular, the adder may include a filter, by which the present invention may be non-limited.
The bit assigning unit 160 delivers control information for controlling bit assignment for the coding of the linear prediction residual to the residual coding unit 170 based on the order information. For instance, if an order is relatively low, the bit assigning unit 160 generates control information for increasing the bit number for coding of the linear prediction residual. For another instance, if an order is relatively high, the bit assigning unit 160 generates control information for decreasing the bit number for the linear prediction residual coding.
The residual coding unit 170 codes the linear prediction residual based on the control information generated by the bit assigning unit 160. The residual coding unit 170 may include a long-term prediction (LTP) unit (not shown in the drawing) configured to obtain a pitch gain and a pitch delay through a pitch search, and a codebook search unit (not shown in the drawing) configured to obtain a codebook index and a codebook gain by performing a codebook search on a pitch residual component that is a residual of the long-term prediction. For instance, in case that control information on a bit number increase is received, a bit assignment may be raised for at least one of a pitch gain, a pitch delay, a codebook index, a codebook gain and the like. For another instance, in case that control information on a bit number decrease is received, a bit assignment may be lowered for at least one of the above parameters.
Alternatively, the residual coding unit 170 may include a sinusoidal wave modeling unit (not shown in the drawing) and a frequency transform unit (not shown in the drawing) instead of the long-term prediction unit and the codebook search unit. In case that control information on a bit number increase is received, the sinusoidal wave modeling unit (not shown in the drawing) may be able to raise a bit number assignment to an amplitude phase frequency parameter. The frequency transform unit (not shown in the drawing) may operate by TCX or MDCH scheme. In case that control information on a bit number increase is received, the frequency transform unit may be able to increase the bit number assignment to frequency coefficient or normalization gain.
The multiplexer 180 generates at least one bitstream by multiplexing the quantized linear-predictive transform coefficient, the parameters (e.g., the pitch delay, etc.) corresponding to the outputs of the residual coding unit, and the like together. Meanwhile, the bandwidth information and/or coding mode information determined by the order determining unit 120 may be included in the bitstream. In particular, the bandwidth information may be included in a separate bitstream (e.g., a bitstream having a codec type and a bit rate included therein) instead of being included in the bitstream having the linear-predictive transform coefficient included therein.
In the following description, the configuration of the order determining unit 120 is explained in detail with reference to
The bandwidth detecting unit 122 performs a spectrum analysis on an inputted audio signal (and a sampled signal) to detect that the inputted signal corresponds to which one of a plurality of bands including a 1st band, a 2nd band and a 3rd band (optional) and then generates bandwidth information indicating a result of the detection. In doing so, FFT (fast Fourier transform) may be available for the spectrum analysis, by which the present invention may be non-limited.
In particular, the 1st band may correspond to a narrow band (NB), the 2nd band may correspond to a wide band (WB), and the 3rd band may correspond to a super wide band (SWB). In more particular, the narrow band may correspond to 0˜4 kHz, the wide band may correspond to 0˜8 kHz, and the super wide band may correspond over 8 kHz or higher.
In case that the 1st band corresponds to 0˜4 kHz, since bandwidth information is band-limited, it may be able to determine whether a sampled audio signal corresponds to the 1st band or the 2nd band or higher in a manner of checking a spectrum between 4 kHz and 6.4 kHz for the sampled audio signal. If the 2nd band or higher is determined, it may be able to determine the 2nd band or the 3rd band by checking a spectrum of an input signal of codec.
The bandwidth information determined by the bandwidth detecting unit 122 may be delivered to the order generating unit 126 or may be included in the bitstream in a manner of being delivered to the multiplexer 180 shown in
The mode determining unit 124 determines one coding mode suitable for the property of a current frame among a plurality of coding modes including a 1st mode and a 2nd mode, generates coding mode information indicating the determined coding mode, and then delivers the generated coding mode information to the order generating unit 126. A plurality of the coding modes may include total 4 coding modes. For instance, a plurality of the coding modes may include an un-voice coding mode suitable for a case of a strong un-voice property, a transition coding (TC) mode suitable for a case of a presence of a transition between a voiced sound and a voiceless sound, a voice coding (VC) mode suitable for a case of a strong voice property, a generic coding (GC) mode suitable for a general case and the like. And, the present invention may be non-limited by the number and/or properties of specific coding modes.
The coding mode information determined by the mode determining unit 124 may be delivered to the order generating unit 126 or may be included in the bitstream in a manner of being delivered to the multiplexer 180 shown in
The order generating unit 126 determines an order (or number) (e.g., a 1st order, a 2nd order, (and, a 3rd order)) of a linear-predictive coefficient of a current frame using 1) bandwidth information or 2) coding mode information, or 3) bandwidth information and coding mode information and then generates order information.
1) In case of making a determination using the bandwidth information, if a 1st band and 1 2nd band (and a 3rd band) exist and the 1st band is narrower than the 2nd band (or the 3rd band), a low order (e.g., a 1st order) is determined for the case of the 1st band. And, a high order (e.g., a 2nd order) (or a highest order (e.g., a 3rd order)) may be determined for the case of the 2nd band (or the 3rd band). For instance, if the 1st band, the 2nd band and the 3rd band are the narrow band, the wide band and the super wide band, respectively, the order for the case of the 1st band, the order for the case of the 2nd band and the order for the case of the 3rd band may be determined as 10, 16 and 20, respectively. Yet, the order of the present invention may be non-limited by a specific value. This is because linear-predictive coding can be more efficiently performed in a manner that an order should be increased in proportion to a bandwidth. On the contrary, in case of the narrow band, the same order of the super wide band or the wide band is not applied. Instead, by applying a lower order, an inter-band difference of quality can be reduced and efficiency of bit assignment can be raised.
2) In case of generating order information using coding mode information, orders may be raised in order of an un-voice coding mode, a transition coding mode, a generic coding mode and a voice coding mode. Since the voice property is weak in the un-voice coding mode, a voice model based linear-predictive coding scheme is not efficient. Hence a relatively low order (e.g., the 1st order) is determined. In case of the voice mode, since the voice property is strong, the linear-predictive coding scheme is efficient. Hence, a relatively high order (e.g., the 2nd order) is determined.
Meanwhile, when order information is generated using coding mode information, if various orders are determined for the same band, a low order and a high order shall be represented as N1th order and N2th order. The N1th order and N2th order shall be explained in the description of the 4th embodiment 130C of the linear-predictive analyzing unit with reference to
3) Meanwhile, when order information is determined using both bandwidth information and coding mode information, an order determined in advance according to the bandwidth information is set to a temporary order Ntemp (e.g., 1st temporary order, 2nd temporary order, 3rd temporary order, etc.) and may be then determined by the following formula.
Un-voice coding mode:
Order(Na)=Temporary order(Ntemp)+1st correction order(Nm1)
Transition coding mode:
Order(Nb)=Temporary order(Ntemp)+2nd correction order(Nm2)
Generic coding mode:
Order(Nc)=Temporary order(Ntemp)+3rd correction order(Nm3)
Voice coding mode:
Order(Nd)=Temporary order(Ntemp)+4th correction order(Nm4), [Formula 1]
For instance, Nm1, Nm2, Nm3 and Nm4 may be set to −4, −2, 0 and +2, respectively, by which the present invention may be non-limited.
The above-determined order information may be delivered to the linear prediction analyzing unit 130 (and the linear prediction synthesizing unit 140) and the multiplexer 180, as shown in
In the following description, the 1st to 4th embodiments of the linear prediction analyzing unit 130 shown in
Referring to
When a 1st set linear-predictive coefficient LPC1 corresponding to a 1st order N1 and a 2nd set linear-predictive coefficient LPC2 corresponding to a 2nd order N2 exist, if the 1st order is smaller than the 2nd order, as mentioned in the foregoing description, the 1st embodiment is the embodiment with reference to a 1st set. In particular, if the 1st set is generated, 1st set coefficients are quantized only. If the 2nd set is generated as well, the 2nd set is quantized using the 1st set.
The linear-predictive coefficient generating unit 132A generates a linear-predictive coefficient of an order corresponding to order information by performing a linear-predictive analysis on an audio signal. In particular, if the order information indicates the 1st order N1, the linear-predictive coefficient generating unit 132A generates the 1st set linear-predictive coefficient LPC1 of the 1st order N1 only. If the order information indicates the 2nd order N2, the linear-predictive coefficient generating unit 132A generates both of the 1st set linear-predictive coefficient LPC1 of the 1st order N1 and the 2nd set linear-predictive coefficient LPC2 of the 2nd order N2. In this case, the 1st order/number is the number smaller than the 2nd order/number. For instance, if the 1st order and the 2nd order are set to 10 and 16, respectively, 10 linear-predictive coefficients become the 1st set LPC1 and 16 linear-predictive coefficients become the 2nd set LPC2. In this case, the 1st set LPC1 is characterized in that its linear-predictive coefficients are almost similar to the values of 1st to 10th coefficients among the 16 linear-predictive coefficients of the 2nd set LPC2. Based on such characteristic, the 1st set is usable to quantize the 2nd set.
A detailed configuration of the linear-predictive coefficient generating unit 132A is described with reference to
Referring to
The window processing unit 132A-2 applies a window for frame processing to an audio signal received from the sampling unit 110.
The autocorrelation function calculating unit 132A-4 calculates an autocorrelation function of the window-processed signal for a linear-predictive analysis.
Meanwhile, a basic idea of a linear prediction coding model is to approximate a linear combination of the past p voice signals at a given timing point n, which can be represented as the following formula.
S(n)≈α1S(n−1)+α2S(n−2)+ . . . +αpS(n−p) [Formula 2]
In Formula 2, the αi indicates a linear-predictive coefficient, the n indicates a frame index, and the p indicates a linear-predictive order.
As a method of finding a solution (αp) of linear-predictive coding, there may be an autocorrelation method or a covariance method. In particular, an autocorrelation function relates to a general method of finding the solution using a recursive loop in an audio coding system and is more efficient than a direct calculation.
The autocorrelation function calculating unit 132A-4 calculates an autocorrelation function R(k).
The linear-predictive algorithm 132A-6 generates a linear-predictive coefficient corresponding to order information using the autocorrelation function R(k). This may correspond to a process for finding a solution of the following formula. In doing so, Levinson-Durbin algorithm may apply thereto.
In Formula 3, αk and R[ ] indicate a linear-predictive coefficient and an autocorrelation function, respectively.
In order to find solutions of the p equations, the following (P+1) equations are generated using a minimum mean-squared prediction error equation.
In Formula 4,
indicates a minimum mean-squared prediction error equation.
In order to find solutions of the (P+1) equations through the recursive loop, as mentioned in the foregoing description, Levinson-Durbin algorithm is used as follows.
The linear-predictive algorithm 132A-6 generates linear-predictive coefficients through the above-mentioned process. As mentioned in the foregoing description, the linear-predictive algorithm 132A-6 generates the 1st set linear-predictive coefficient LPC1 in case of the 1st order N1 or both of the 1st set linear-predictive coefficient LPC1 and the 2nd set linear-predictive coefficient LPC2 of the 2nd order in case of the 2nd order N2. In particular, the 1st set LPC1 is generated irrespective of an order. And, whether to generate the 2nd set LPC2 of the 2nd order is adaptively determined in accordance with the order information (i.e., the 1st order or the 2nd order).
Alternatively, the switching for whether to generate the 2nd set may be performed not by the linear-predictive coefficient generating unit 132A but by the linear-predictive coefficient transform unit 134A shown in
In the following description, since the switching is explained as performed by the linear-predictive coefficient generating unit 132A for convenience, it may be achieved by the linear-predictive coefficient transform unit 134A. This may identically apply to the linear prediction analyzing units according to the 2nd to 4th embodiments and its details shall be omitted from the following description.
In the above description, the detailed configuration of the linear-predictive coefficient generating unit 132A is explained. In the following description, the rest of the components of the linear prediction analyzing unit 130A are explained with reference to
The linear-predictive coefficient generating unit 132A generates a 1st set linear-predictive transform coefficient ISP1 of the 1st order N1 by transforming the 1st set linear-predictive coefficient LPC1 generated by the linear-predictive coefficient generating unit 132A. If the 2nd set linear-predictive coefficient LPC2 is generated, the linear-predictive coefficient transform unit 134A generates a 2nd set linear-predictive transform coefficient ISP2 by transforming the 2nd set as well.
Since the formerly obtained linear-predictive coefficient has a large dynamic range, it may need to be quantized with a smaller number of bits. Since the linear-predictive coefficient is vulnerable to quantization error, it may need to be transformed into a linear-predictive transform coefficient strong against the quantization error. In this case, the linear-predictive transform coefficient may include one of LSP (Line Spectral Pairs), ISP (Immittance Spectral Pairs), LSF (Line Spectrum Frequency) and ISF (Immittance Spectral Frequency), by which the present invention may be non-limited. In this case, the ISF may be represented as the following formula.
In Formula 6, the αi indicates a linear-predictive coefficient, the fi indicates a frequency range of [0.6400 Hz] of ISF, and the ‘fs=12800’ indicates a sampling frequency.
The 1st quantizing unit 135 generates a 1st set quantized linear-predictive transform coefficient (hereinafter named a 1st index) Q1 by quantizing the 1st set linear-predictive transform coefficient ISP1 and then outputs the 1st index Q1 to the multiplexer 180. Meanwhile, if the order information includes the 2nd order, the 1st index Q1 is delivered to the order adjusting unit 136A. If an order of a current frame is a 1st order, the corresponding process may end in a manner of quantizing a 1st set of the 1st order. Yet, if an order of a current frame is a 2nd order, the 1st should be used for quantization of a 2nd set.
The order adjusting unit 136A generates a 1st set linear-predictive transform coefficient ISP1
Referring to
The dequantizing unit 136A.1-1 generates a 1st set linear-predictive transform coefficient IISP1 by dequantizing the 1st set index Q1. The inverse transform unit 126A.1-2 generates a 1st set linear-predictive coefficient ILPC1 by inverse-transforming the linear-predictive transform coefficient IISP1. Thus, the dequantization and the inverse transform are performed to modify an order in a linear-predictive coefficient domain (i.e., time domain). Meanwhile, there may be an embodiment for modifying an order in a linear-predictive transform coefficient domain (i.e., frequency domain). In this case, the inverse transform unit and the transform unit are excluded and the order modifying unit operates in frequency domain only. Although the operation in time domain is described only in this specification, it is a matter of course that the operation in frequency domain is available as well.
The order modifying unit 136A.1-3 estimates a 1st set linear-predictive coefficient ILPC1
The transform unit 136A.1-4 generates an order-adjusted linear-predictive transform coefficient ISP1
Thus, the order adjusting unit 136.A1 according to one embodiment of the present invention relates to a method of adjusting an order by an estimation process using algorithm. On the other hand, an order adjusting unit 136.A2 according to another embodiment mentioned in the following description relates to a method of randomly changing an order only.
Referring to
Thus, referring now to
The linear-predictive coefficient transform unit 134A′ transforms the linear-predictive coefficient delivered from the linear-predictive coefficient generating unit 132A′. In particular, since the 1st set coefficient is delivered only in case of the 1st order, the linear-predictive coefficient transform unit 134A′ generates the 1st set transform coefficient ISP1. In case of the 2nd order, the linear-predictive coefficient transform unit 134A′ generates the 1st set transform coefficient ISP1 and the 2nd set transform coefficient ISP2. In case of the 3rd order, the linear-predictive coefficient transform unit 134A′ generates the 1st set transform coefficient ISP1, the 2nd set transform coefficient ISP2 and the 3rd set transform coefficient ISP3.
Subsequently, a 1st quantizing unit 135, an order adjusting unit 136A, a 1st adder 137 and a 2nd quantizing unit 138′ perform the same operations of the former 1st quantizing unit 135, adder 137 and order adjusting unit 136A shown in
This order adjusting unit 136A′ is almost identical to the former order adjusting unit 136A but differs from the former order adjusting unit 136A in changing the 2nd order into the 3rd order instead of changing the 1st order into the 2nd order. Moreover, the latter order adjusting unit 136A′ differs from the former order adjusting unit 136A in dequantizing the 2nd set difference value, adding the order-adjusted 1st set coefficient ISP1mo thereto, and then performs an order adjustment on the corresponding result.
The 2nd adder 137′ generates a 3rd set difference d3 by subtracting the order-adjusted 2nd set linear-predictive transform coefficient ISP2
In the following description, the 3rd embodiment 130B of the linear prediction analyzing unit 130 shown in
First of all, a 3rd embodiment 130B of the linear prediction analyzing unit 130 includes a linear-predictive coefficient generating unit 132B, a linear-predictive coefficient transform unit 134B, a 1st quantizing unit 135, an order adjusting unit 136B and a 2nd quantizing unit 137.
The linear-predictive coefficient generating unit 123B generates a linear-predictive coefficient of an order corresponding to order information by performing a linear-predictive analysis on an audio signal. Since a 1st order is a reference unlike the 1st embodiment, if the order information includes a 2nd order N2, a 2nd set linear-predictive coefficient LPC2 of the 2nd order N2 is generated only. If the order information includes the 1st order N1, both of the 1st set linear-predictive coefficient LPC1 of the 1st order N1 and the 2nd set linear-predictive coefficient LPC2 of the 2nd order N2 are generated. Like the 1st embodiment 132A, the 1st order/number is the number smaller than the 2nd order/number. For instance, if the 1st order and the 2nd order are set to 10 and 16, respectively, 10 linear-predictive coefficients become the 1st set LPC1 and 16 linear-predictive coefficients become the 2nd set LPC2. In this case, the 10 coefficients of the 1st set LPC1 are characterized in being almost similar to the values of 1st to 10th coefficients among the 16 linear-predictive coefficients of the 2nd set LPC2. Based on such characteristic, the 2nd set is usable to quantize the 1st set.
Referring now to
As mentioned in the foregoing description of the 1st embodiment, the linear-predictive coefficient generating unit 132B generates both of the 1st set linear-predictive coefficient LPC1 and the 2nd set linear-predictive coefficient LPC2 irrespective of the order information and the linear-predictive coefficient transform unit 134 may be able to transform the coefficients in accordance with the order information selectively [not shown in the drawing]. In particular, in case of the 2nd order, the linear-predictive coefficient transform unit 134B transforms the 2nd set coefficient only. In case of the 1st order, the linear-predictive coefficient transform unit 134B transforms both of the 1st set coefficient and the 2nd set coefficient.
Meanwhile, the 1st quantizing unit 135 generates a 2nd set quantized linear-predictive transform coefficient (i.e., a 2nd set index) Q2 by vector-quantizing the 2nd set transform coefficient ISP2.
The order adjusting unit 136B generates an order-adjusted 2nd set transform coefficient ISP2
The dequantizing unit 136B.1 generates a dequantized 2nd set linear-predictive transform coefficient IISP2 by dequantizing the 2nd set quantized linear-predictive transform coefficient (i.e., 2nd set index Q2). An inverse transform unit 136B.1-2 generates a 2nd set linear-predictive coefficient ILPC2 by inverse-transforming the 2nd set linear-predictive transform coefficient IISP2. An order modifying unit 136B.1-3 generates an order adjusted 2nd set linear-predictive coefficient LPC2
Meanwhile,
The dequantizing unit 136B.2-1 generates a dequantized 2nd set linear-predictive transform coefficient IISP2 by dequantizing the 2nd set quantized linear-predictive transform coefficient (i.e., 2nd set index Q2). A partitioning unit 136B.2-1 generates a 2nd set linear-predictive transform coefficient ISP2_mo order-adjusted into the 1st order by partitioning a 2nd linear-predictive transform coefficient of the 2nd order into the 1st order of the low order and the rest and then taking the 1st order only.
Thus, the order adjusting unit 136B adjusts the 2nd order into the 1st order. Referring now to
Thus, according to the 3rd embodiment shown in
The 4th embodiment shown in
The dequantizing unit 142 generates a linear-predictive transform coefficient by receiving a quantized linear-predictive transform coefficient (index) from the linear prediction analyzing unit 130 and then dequantizing the received coefficient.
From the linear prediction analyzing unit 130A according to the 1st embodiment, the dequantizing unit 142 receives a 1st set index (in case of a 1st order) or receives a 1st set index and a 2nd set index (in case of a 2nd order). In case of the 1st order, the 1st set index is dequantized. In case of the 2nd order, the 1st set index and the 2nd set index are respectively dequantized and then added together.
From the linear prediction analyzing unit 130A′ according to the 2nd embodiment, the case of the 1st order or the 2nd order is identical to that of the 1st embodiment. In case of a 3rd order, the dequantizing unit 142 receives the 1st to 3rd indexes all, dequantizes each of the received indexes, and then adds them together.
From the linear prediction analyzing unit 130B according to the 3rd embodiment, the dequantizing unit 142 receives both of the 1st set index and the 2nd set index (in case of a 1st order) or receives the 2nd set index only (in case of a 2nd order). In case of the 1st order, the 1st set index and the 2nd set index are dequantized and then added together.
From the linear prediction analyzing unit 130C according to the 4th embodiment, the dequantizing unit 142 receives N1th set (in case of N1th order) or receives both N1th set and N2th set (in case of N2th order). Likewise, the N1th set and the N2th set are respectively dequantized and then added together.
Meanwhile, the order modifying unit 143 receives linear-predictive transform coefficients of previous frame and/or next frame and then selects at least one frame as a target to interpolate. Subsequently, based on the order information, the order modifying unit 143 estimates an order of the coefficients of the frame, which corresponds to the target, as an order (e.g., 1st order, 2nd order, 3rd order, etc.) of a linear-predictive transform coefficient of a current frame. For this process, an algorithm (e.g., a modified Levinson-Durbin algorithm, a lattice structured recursive method, etc.) for the order adjusting unit 136A/136B to adjust a low order into a high order (or to adjust a high order into a low order) may be usable.
If the interpolated target frame corresponds to a previous frame (e.g., previous and/or next order-different frame instead of a subframe within a current frame), the interpolating unit 144 interpolates a linear-predictive transform coefficient of the current frame, which is an output of the dequantizing unit 142) using the linear-predictive transform coefficient of the previous and/or next frame order-modified by the order modifying unit 143.
The inverse transform unit 146 generates a linear-predictive coefficient of a current frame by inverse transforming the interpolated linear-predictive transform coefficient of the current frame. For instance, the inverse transform unit 146 generates a linear-predictive coefficient of a 1st set in case of a 1st order. For another instance, the inverse transform unit 146 generates a linear-predictive coefficient of a 2nd set in case of a 2nd order. For another instance, the inverse transform unit 146 generates a linear-predictive coefficient of a 3rd set in case of a 3rd order.
The synthesizing unit 148 generates a linear-predictive synthesized signal by performing a linear-predictive synthesis based on a linear-predictive coefficient. It is a matter of course that the synthesizing unit 148 can be integrated into a single filter together with the adder 150 shown in
In the above description, the encoder of the audio signal processing apparatus according to the embodiment of the present invention is explained with reference to
The demultiplexer 210 extracts: 1) bandwidth information; 2) coding mode information; or 3) bandwidth information and coding mode information from at least one bitstream and then delivers the extracted information(s) to the order obtaining unit 215.
The order obtaining unit 215 determines order information by referring to a table based on: 1) the extracted bandwidth information; 2) the extracted coding mode information; or 3) the extracted bandwidth information and the extracted coding mode information. This determining process may be identical to that of the order generating unit 126 shown in
One example of the table is shown in Table 1 in the following, by which the present invention may be non-limited.
Thus, the order information obtained by the order obtaining unit 215 is delivered to the multiplexer 210 and the linear prediction synthesizing unit 220.
The multiplexer 210 parses the linear-predictive transform coefficient quantized by a difference indicated by order information of a current frame from the bitstream and then delivers the coefficient to the linear prediction synthesizing unit 220.
The linear prediction synthesizing unit 220 generates a linear-predictive synthesized signal based on the order information and the quantized linear-predictive transform coefficient. In particular, the linear prediction synthesizing unit 220 generates a dequantized linear-predictive coefficient by dequantizing/inverse-transforming the quantized linear-predictive transform coefficient based on the order information. Subsequently, the linear prediction synthesizing unit generates the linear-predictive synthesized signal by performing linear-predictive synthesis. This process may correspond to the former process for calculating the right side in Formula 2.
Meanwhile, the residual decoding unit 230 predicts a linear-predictive residual signal using parameters (e.g., pitch gain, pitch delay, codebook gain, codebook index, etc.) for the linear-predictive residual signal. In particular, the residual decoding unit 230 predicts a pitch residual component using the codebook index and the codebook gain and then performs a long-term synthesis using the pitch gain and the pitch delay, thereby generating a long-term synthesized signal. And, the residual decoding unit 230 is able to generate the linear-predictive residual signal by adding the long-term synthesized signal and the pitch residual component together. The adder 240 then generates an audio signal for the current frame by adding the linear-predictive synthesized signal and the linear-predictive residual signal together.
The audio signal processing apparatus according to the present invention is available for various products to use. Theses products can be mainly grouped into a stand alone group and a portable group. A TV, a monitor, a settop box and the like can be included in the stand alone group. And, a PMP, a mobile phone, a navigation system and the like can be included in the portable group.
A user authenticating unit 520 receives an input of user information and then performs user authentication. The user authenticating unit 520 can include at least one of a fingerprint recognizing unit, an iris recognizing unit, a face recognizing unit and a voice recognizing unit. The fingerprint recognizing unit, the iris recognizing unit, the face recognizing unit and the voice recognizing unit receive fingerprint information, iris information, face contour information and voice information and then convert them into user informations, respectively. Whether each of the user informations matches pre-registered user data is determined to perform the user authentication.
An input unit 530 is an input device enabling a user to input various kinds of commands and can include at least one of a keypad unit 530A, a touchpad unit 530B, a remote controller unit 530C and a microphone unit 530D, by which the present invention is non-limited. In particular, the microphone unit 530D is an input device configured to receive a voice or audio signal. In this case, each of the keypad unit 530A, the touchpad unit 530B and the remote controller unit 530C is able to receive an input of a command for an outgoing call, an input of a command for activating the microphone unit 430D, and/or the like. In case of receiving the command for the outgoing call via the keypad unit 530B or the like, the controller 550 may control the mobile communication unit 510E to make a request for a call to a communication network of the same.
A signal coding unit 540 performs encoding or decoding on an audio signal and/or a video signal, which is received via microphone unit 530D or the wire/wireless communication unit 510, and then outputs an audio signal in time domain. The signal coding unit 540 includes an audio signal processing apparatus 545. As mentioned in the foregoing description, the audio signal processing apparatus 545 corresponds to the above-described embodiment (i.e., the encoder 100 and/or the decoder 200) of the present invention. Thus, the audio signal processing apparatus 545 and the signal coding unit including the same can be implemented by at least one or more processors.
A control unit 550 receives input signals from input devices and controls all processes of the signal decoding unit 540 and an output unit 560. In particular, the output unit 560 is an element configured to output an output signal generated by the signal decoding unit 540 and the like and can include a speaker unit 560A and a display unit 560B. If the output signal is an audio signal, it is outputted to a speaker. If the output signal is a video signal, it is outputted via a display.
The signal coding unit 760 performs encoding or decoding on an audio signal and/or a video signal received via the mobile communication unit 710, the data communication unit 720 and/or the microphone unit 530D and outputs an audio signal in time domain via the mobile communication unit 710, the data communication unit 720 and/or the speaker 770. The signal coding unit 760 may include an audio signal processing apparatus 765. As mentioned in the foregoing description, the audio signal processing apparatus 765 corresponds to the above-described embodiment (i.e., the encoder 100 and/or the decoder 200) of the present invention. Thus, the audio signal processing apparatus 765 and the signal coding unit including the same may be implemented by at least one or more processors.
An audio signal processing method according to the present invention can be implemented into a computer-executable program and can be stored in a computer-readable recording medium. And, multimedia data having a data structure of the present invention can be stored in the computer-readable recording medium. The computer-readable media include all kinds of recording devices in which data readable by a computer system are stored. The computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy discs, optical data storage devices, and the like for example and also include carrier-wave type implementations (e.g., transmission via Internet). And, a bitstream generated by the above mentioned encoding method can be stored in the computer-readable recording medium or can be transmitted via wire/wireless communication network.
While the present invention has been described and illustrated herein with reference to the preferred embodiments thereof, it will be apparent to those skilled in the art that various modifications and variations can be made therein without departing from the spirit and scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.
Accordingly, the present invention is applicable to encoding and decoding an audio signal.
This application is a U.S. National Phase Application under 35 U.S.C. §371 of International Application PCT/KR2011/001989, filed on Mar. 23, 2011, which claims the benefit of U.S. Provisional Application No. 61/316,390, filed on Mar. 23, 2010, and U.S. Provisional Application No. 61/451,564, filed on Mar. 10, 2011, the entire contents of which are hereby incorporated by reference in their entireties.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/KR2011/001989 | 3/23/2011 | WO | 00 | 12/20/2012 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2011/118977 | 9/29/2011 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
4379949 | Chen et al. | Apr 1983 | A |
5142581 | Tokuda et al. | Aug 1992 | A |
5283814 | Iwahashi et al. | Feb 1994 | A |
5463716 | Taguchi | Oct 1995 | A |
5642465 | Scott et al. | Jun 1997 | A |
5699484 | Davis | Dec 1997 | A |
5933803 | Ojala | Aug 1999 | A |
6202045 | Ojala et al. | Mar 2001 | B1 |
6574593 | Gao et al. | Jun 2003 | B1 |
6810381 | Sasaki et al. | Oct 2004 | B1 |
8249860 | Sato et al. | Aug 2012 | B2 |
20020143527 | Gao et al. | Oct 2002 | A1 |
20040024594 | Lee et al. | Feb 2004 | A1 |
20060149538 | Lee et al. | Jul 2006 | A1 |
20070005351 | Sathyendra et al. | Jan 2007 | A1 |
20090138272 | Kim et al. | May 2009 | A1 |
20100106492 | Sato et al. | Apr 2010 | A1 |
20110313761 | Zhang et al. | Dec 2011 | A1 |
Number | Date | Country |
---|---|---|
101180676 | May 2008 | CN |
101548317 | Sep 2009 | CN |
101615395 | Dec 2009 | CN |
2 101 320 | Sep 2009 | EP |
2 385 522 | Nov 2011 | EP |
01-238229 | Sep 1989 | JP |
2001-306098 | Nov 2001 | JP |
10-0138115 | Jun 1998 | KR |
10-0348137 | Nov 2002 | KR |
Entry |
---|
Vos, Koen, Soeren Jensen, and Karsten Soerensen. “Silk speech codec.” IETF Standards Track Internet-Draft (2009). |
Zhang, Fan, et al. “Adaptive prediction order scheme for AMR-WB+.” Communications and Information Technologies (ISCIT), 2010 International Symposium on. IEEE, 2010. |
Jelinek, Milan, et al. “Itu-t G. EV-VBR baseline codec.” Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on. IEEE, 2008. |
Ehara, Hiroyuki, et al. “Predictive VQ for bandwidth scalable LSP quantization.” Acoustics, Speech, and Signal Processing, 2005. Proceedings.(ICASSP'05). IEEE International Conference on. vol. 1. IEEE, 2005. |
Nomura, Toshiyuki, et al. “A bitrate and bandwidth scalable CELP coder.” Acoustics, Speech and Signal Processing, 1998. Proceedings of the 1998 IEEE International Conference on. vol. 1. IEEE, 1998. |
Bhaskar, B.R.U., “Adaptive predictive coding with transform domain quantization using block size adaptation and high-resolution spectral modeling,” Applications of Signal Processing to Audio and Acoustics, 1993. Final Program and Paper Summaries., 1993 IEEE Workshop on , vol., No., pp. 31,34, Oct. 17-20, 1993. |
McElroy, D., B. Murray, and A. D. Fagan. “Wideband speech coding in 7.2 kbit/s.” Acoustics, Speech, and Signal Processing, 1993. ICASSP-93., 1993 IEEE International Conference on. vol. 2. IEEE, 1993. |
Ehara, Hiroyuki, Toshiyuki Morii, and Koji Yoshida. “Predictive vector quantization of wideband LSF using narrowband LSF for bandwidth scalable coders.” Speech communication 49.6 (2007): 490-500. |
Chinese Office Action dated Jul. 18, 2013 for Application No. 2011-80015619, with English Translation, 13 pages. |
International Search report dated Oct. 21, 2011 for Application No. PCT/KR2011/001989, with English Translation, 4 pages. |
H.W. Kim et al., The Trend of G.729.1 Wideband Multi-codec Technology, ETRI, Electronics and Telecommunications Trends, Dec. 2006, vol. 2 No. 6, pp. 77-85, See “structure I.G.729.1” of p. 80. |
Tony S. Velma et al., “A 6Kbps to 85Kbps Scalable Audio Coder”, ICASSP 2000 IEEE International Conference, IEEE, 2000, vol. 2, pp. 877-880, See right colunm of p. 877—right column of p. 878, figure 1. |
Number | Date | Country | |
---|---|---|---|
20130096928 A1 | Apr 2013 | US |
Number | Date | Country | |
---|---|---|---|
61316390 | Mar 2010 | US | |
61451564 | Mar 2011 | US |