Patent Application
20060004583
The present invention relates to multi-channel audio processing and, in particular, to multi-channel audio reconstruction using a base channel and parametric side information for reconstructing an output signal having a plurality of channels.
In recent times, the multi-channel audio reproduction technique is becoming more and more important. This may be due to the fact that audio compression/encoding techniques such as the well-known mp3 technique have made it possible to distribute audio records via the Internet or other transmission channels having a limited bandwidth. The mp3 coding technique has become so famous because of the fact that it allows distribution of all the records in a stereo format, i.e., a digital representation of the audio record including a first or left stereo channel and a second or right stereo channel.
Nevertheless, there are basic shortcomings of conventional two-channel sound systems. Therefore, the surround technique has been developed. A recommended multi-channel-surround representation includes, in addition to the two stereo channels L and R, an additional center channel C and two surround channels Ls, Rs. This reference sound format is also referred to as three/two-stereo, which means three front channels and two surround channels. Generally, five transmission channels are required. In a playback environment, at least five speakers at the respective five different places are needed to get an optimum sweet spot in a certain distance from the five well-placed loudspeakers.
Several techniques are known in the art for reducing the amount of data required for transmission of a multi-channel audio signal. Such techniques are called joint stereo techniques. To this end, reference is made to
Normally, the carrier channel will include subband samples, spectral coefficients, time domain samples etc, which provide a comparatively fine representation of the underlying signal, while the parametric data do not include such samples of spectral coefficients but include control parameters for controlling a certain reconstruction algorithm such as weighting by multiplication, time shifting, frequency shifting, phase shifting, . . . The parametric data, therefore, include only a comparatively coarse representation of the signal or the associated channel. Stated in numbers, the amount of data required by a carrier channel will be in the range of 60-70 kbit/s, while the amount of data required by parametric side information for one channel will be in the range of 15-25 kbit/s. An example for parametric data are the well-known scale factors, intensity stereo information or binaural cue parameters as will be described below.
Intensity stereo coding is described in AES preprint 3799, “Intensity Stereo Coding”, J. Herre, K. H. Brandenburg, D. Lederer, February 1994, Amsterdam. Generally, the concept of intensity stereo is based on a main axis transform to be applied to the data of both stereophonic audio channels. If most of the data points are concentrated around the first principle axis, a coding gain can be achieved by rotating both signals by a certain angle prior to coding. This is, however, not always true for real stereophonic production techniques. Therefore, this technique is modified by excluding the second orthogonal component from transmission in the bit stream. Thus, the reconstructed signals for the left and right channels consist of differently weighted or scaled versions of the same transmitted signal. Nevertheless, the reconstructed signals differ in their amplitude but are identical regarding their phase information. The energy-time envelopes of both original audio channels, however, are preserved by means of the selective scaling operation, which typically operates in a frequency selective manner. This conforms to the human perception of sound at high frequencies, where the dominant spatial cues are determined by the energy envelopes.
Additionally, in practical implementations, the transmitted signal, i.e. the carrier channel is generated from the sum signal of the left channel and the right channel instead of rotating both components. Furthermore, this processing, i.e., generating intensity stereo parameters for performing the scaling operation, is performed frequency selective, i.e., independently for each scale factor band, i.e., encoder frequency partition. Preferably, both channels are combined to form a combined or “carrier” channel, and, in addition to the combined channel, the intensity stereo information is determined which depend on the energy of the first channel, the energy of the second channel or the energy of the combined or channel.
The BCC technique is described in AES convention paper 5574, “Binaural cue coding applied to stereo and multi-channel audio compression”, C. Faller, F. Baumgarte, May 2002, Munich. In BCC encoding, a number of audio input channels are converted to a spectral representation using a DFT based transform with overlapping windows. The resulting uniform spectrum is divided into non-overlapping partitions each having an index. Each partition has a bandwidth proportional to the equivalent rectangular bandwidth (ERB). The inter-channel level differences (ICLD) and the inter-channel time differences (ICTD) are estimated for each partition for each frame k. The ICLD and ICTD are quantized and coded resulting in a BCC bit stream. The inter-channel level differences and inter-channel time differences are given for each channel relative to a reference channel. Then, the parameters are calculated in accordance with prescribed formulae, which depend on the certain partitions of the signal to be processed.
At a decoder-side, the decoder receives a mono signal and the BCC bit stream. The mono signal is transformed into the frequency domain and input into a spatial synthesis block, which also receives decoded ICLD and ICTD values. In the spatial synthesis block, the BCC parameters (ICLD and ICTD) values are used to perform a weighting operation of the mono signal in order to synthesize the multi-channel signals, which, after a frequency/time conversion, represent a reconstruction of the original multi-channel audio signal.
In case of BCC, the joint stereo module 60 is operative to output the channel side information such that the parametric channel data are quantized and encoded ICLD or ICTD parameters, wherein one of the original channels is used as the reference channel for coding the channel side information.
Normally, the carrier channel is formed of the sum of the participating original channels.
Naturally, the above techniques only provide a mono representation for a decoder, which can only process the carrier channel, but is not able to process the parametric data for generating one or more approximations of more than one input channel.
The audio coding technique known as binaural cue coding (BCC) is also well described in the United States patent application publications U.S. 2003, 0219130 A1, 2003/0026441 A1 and 2003/0035553 A1. Additional reference is also made to “Binaural Cue Coding. Part II: Schemes and Applications”, C. Faller and F. Baumgarte, IEEE Trans. On Audio and Speech Proc., Vol. 11, No. 6, November 1993. The cited United States patent application publications and the two cited technical publications on the BCC technique authored by Faller and Baumgarte are incorporated herein by reference in their entireties.
In the following, a typical generic BCC scheme for multi-channel audio coding is elaborated in more detail with reference to FIGS. 11 to 13.
In the following, the internal construction of the BCC synthesis block 122 is explained with reference to
The BCC synthesis block 122 further comprises a delay stage 126, a level modification stage 127, a correlation processing stage 128 and an inverse filter bank stage IFB 129. At the output of stage 129, the reconstructed multi-channel audio signal having for example five channels in case of a 5-channel surround system, can be output to a set of loudspeakers 124 as illustrated in
As shown in
The same is true for the multiplication parameters a1, a2, . . . , ai, . . . , aN, which are also calculated by the side information processing block 123 based on the inter-channel level differences as calculated by the BCC analysis block 116.
The ICC parameters calculated by the BCC analysis block 116 are used for controlling the functionality of block 128 such that certain correlations between the delayed and level-manipulated signals are obtained at the outputs of block 128. It is to be noted here that the ordering of the stages 126, 127, 128 may be different from the case shown in
It is to be noted here that, in a frame-wise processing of an audio signal, the BCC analysis is performed frame-wise, i.e. time-varying, and also frequency-wise. This means that, for each spectral band, the BCC parameters are obtained. This means that, in case the audio filter bank 125 decomposes the input signal into for example 32 band pass signals, the BCC analysis block obtains a set of BCC parameters for each of the 32 bands. Naturally the BCC synthesis block 122 from
In the following, reference is made to
ICC parameters can be defined in different ways. Most generally, one could estimate ICC parameters in the encoder between all possible channel pairs as indicated in
Regarding the calculation of, for example, the multiplication parameters a1, aN based on transmitted ICLD parameters, reference is made to AES convention paper 5574 cited above. The ICLD parameters represent an energy distribution in an original multi-channel signal. Without loss of generality, it is shown in
Naturally, there are other methods for calculating the multiplication factors, which do not rely on the 2-stage process but which only need a 1-stage process.
Regarding the delay parameters, it is to be noted that the delay parameters ICTD, which are transmitted from a BCC encoder can be used directly, when the delay parameter d1 for the left front channel is set to zero. No resealing has to be done here, since a delay does not alter the energy of the signal.
Regarding the inter-channel coherence measure ICC transmitted from the BCC encoder to the BCC decoder, it is to be noted here that a coherence manipulation can be done by modifying the multiplication factors a1, . . . , an such as by multiplying the weighting factors of all subbands with random numbers with values between 20log10(−6) and 20log10(6). The pseudo-random sequence is preferably chosen such that the variance is approximately constant for all critical bands, and the average is zero within each critical band. The same sequence is applied to the spectral coefficients for each different frame. Thus, the auditory image width is controlled by modifying the variance of the pseudo-random sequence. A larger variance creates a larger image width. The variance modification can be performed in individual bands that are critical-band wide. This enables the simultaneous existence of multiple objects in an auditory scene, each object having a different image width. A suitable amplitude distribution for the pseudo-random sequence is a uniform distribution on a logarithmic scale as it is outlined in the US patent application publication 2003/0219130 A1. Nevertheless, all BCC synthesis processing is related to a single input channel transmitted as the sum signal from the BCC encoder to the BCC decoder as shown in
A related technique, also known as parametric stereo, is described in J. Breebaart, S. van de Par, A. Kohlrausch, E. Schuijers, “High-Quality Parametric Spatial Audio Coding at Low Bitrates”, AES 116th Convention, Berlin, Preprint 6072, May 2004, and E. Schuijers, J. Breebaart, H. Purnhagen, J. Engdegard, “Low Complexity Parametric Stereo Coding”, AES 116th Convention, Berlin, Preprint 6073, May 2004.
As has been outlined above with respect to
As has been outlined above with respect to
To this end, the encoder-side calculated reconstruction parameters are quantized in accordance with a certain quantization rule. This means that unquantized reconstruction parameters are mapped onto a limited set of quantization levels or quantization indices as it is known in the art and described in detail in C. Faller and F. Baumgarte, “Binaural cue coding applied to audio compression with flexible rendering,” AES 113th Convention, Los Angeles, Preprint 5686, October 2002.
Quantization has the effect that all parameter values, which are smaller than the quantization step size, are quantized to zero. Additionally, by mapping a large set of unquantized values to a small set of quantized values results in data saving per se. These data rate savings are further enhanced by entropy-encoding the quantized reconstruction parameters on the encoder-side. Preferred entropy-encoding methods are Huffman methods based on predefined code tables or based on an actual determination of signal statistics and signal-adaptive construction of codebooks. Alternatively, other entropy-encoding tools can be used such as arithmetic encoding.
Generally, one has the rule that the data rate required for the reconstruction parameters decreases with increasing quantizer step size. Stated in other words, a coarser quantization results in a lower data rate, and a finer quantization results in a higher data rate.
Since parametric signal representations are normally required for low data rate environments, one tries to quantize the reconstruction parameters as coarse as possible to obtain a signal representation having a certain amount of data in the base channel, and also having a reasonable small amount of data for the side information which include the quantized and entropy-encoded reconstruction parameters.
Prior art methods, therefore, derive the reconstruction parameters to be transmitted directly from the multi-channel signal to be encoded. A coarse quantization as discussed above results in reconstruction parameter distortions, which result in large rounding errors, when the quantized reconstruction parameter is inversely quantized in a decoder and used for multi-channel synthesis. Naturally, the rounding error increases with the quantizer step size, i.e., with the selected “quantizer coarseness”. Such rounding errors may result in a quantization level change, i.e., in a change from a first quantization level at a first time instant to a second quantization level at a later time instant, wherein the difference between one quantizer level and another quantizer level is defined by the quite large quantizer step size, which is preferable for a coarse quantization. Unfortunately, such a quantizer level change amounting to the large quantizer step size can be triggered by only a small parameter change, when the unquantized parameter is in the middle between two quantization levels. It is clear that the occurrence of such quantizer index changes in the side information results in the same strong changes in the signal synthesis stage. When—as an example—the interchannel level difference is considered, it becomes clear that a strong change results in a sharp decrease of loudness of a certain loudspeaker signal and an accompanying sharp increase of the loudness of a signal for another loudspeaker. This situation, which is only triggered by a quantization level change and a coarse quantization can be perceived as an immediate relocation of a sound source from a (virtual) first place to a (virtual) second place. Such an immediate relocation from one time instant to another time instant sounds unnatural, i.e., is perceived as a modulation effect, since sound sources of, in particular, tonal signals do not change their location very fast.
Generally, also transmission errors may result in sharp changes of quantizer indices, which immediately result in the sharp changes in the multi-channel output signal, which is even more true for situations, in which a coarse quantizer for data rate reasons has been adopted.
It is the object of the present invention to provide an improved signal synthesis concept allowing a low data rate on the one hand and a good subjective quality on the other hand.
In accordance with the first aspect of the present invention, this object is achieved by a multi-channel synthesizer for generating an output signal from an input signal, the input signal having at least one input channel and a sequence of quantized reconstruction parameters, the quantized reconstruction parameters being quantized in accordance with a quantization rule, and being associated with subsequent time portions of the input channel, the output signal having a number of synthesized output channels, and the number of synthesized output channels being greater than 1 or greater than a number of input channels, comprising: a post processor for determining a post processed reconstruction parameter or a post processed quantity derived from the reconstruction parameter for a time portion of the input signal to be processed, wherein the post processor is operative to determine the post processed reconstruction parameter such that a value of the post processed reconstruction parameter or the post processed quantity is different from a value obtainable using requantization in accordance with the quantization rule; and a multi-channel reconstructor for reconstructing a time portion of the number of synthesized output channels using the time portion of the input channel and the post processed reconstruction parameter or the post processed quantity.
In accordance with a second aspect of the invention, this object is achieved by a method of generating an output signal from an input signal, the input signal having at least one input channel and a sequence of quantized reconstruction parameters, the quantized reconstruction parameters being quantized in accordance with a quantization rule, and being associated with subsequent time portions of the input channel, the output signal having a number of synthesized output channels, and the number of synthesized output channels being greater than 1 or greater than a number of input channels, comprising determining a post processed reconstruction parameter or a post processed quantity derived from the reconstruction parameter for a time portion of the input signal to be processed, such that a value of the post processed reconstruction parameter or the post processed quantity is different from a value obtainable using requantization in accordance with the quantization rule; and reconstructing a time portion of the number of synthesized output channels using the time portion of the input channel and the post processed reconstruction parameter or the post processed quantity.
In accordance with a third aspect of the present invention, this object is achieved by a computer program implementing the above method, when running on a computer.
The present invention is based on the finding that a post processing for quantized reconstruction parameters used in a multi-channel synthesizer is operative to reduce or even eliminate problems associated with coarse quantization on the one hand and quantization level changes on the other hand. While, in prior art systems, a small parameter change in an encoder results in a strong parameter change at the decoder, since a requantization in the synthesizer is only admissible for the limited set of quantized values, the inventive device performs a post processing of reconstruction parameters so that the post processed reconstruction parameter for a time portion to be processed of the input signal is not determined by the encoder-adopted quantization raster, but results in a value of the reconstruction parameter, which is different from a value obtainable by the quantization in accordance with the quantization rule.
While, in a linear quantizer case, the prior art method only allows inversely quantized values being integer multiples of the quantizer step size, the inventive post processing allows inversely quantized values to be non-integer multiples of the quantizer step size. This means that the inventive post processing eliminates the quantizer step size limitation, since also post processed reconstruction parameters lying between two adjacent quantizer levels can be obtained by post processing and used by the inventive multi-channel reconstructor, which makes use of the post processed reconstruction parameter.
This post processing can be performed before or after requantization in a multi-channel synthesizer. When the post processing is performed with the quantized parameters, i.e., with the quantizer indices, an inverse quantizer is needed, which can inversely quantize not only quantizer step multiples, but which can also inversely quantize to inversely quantized values between multiples of the quantizer step size.
In case the post processing is performed using inversely quantized reconstruction parameters, a straight-forward inverse quantizer can be used, and an interpolation/filtering/smoothing is performed with the inversely quantized values.
In case of a non-linear quantization rule, such as a logarithmic quantization rule, a post processing of the quantized reconstruction parameters before requantization is preferred, since the logarithmic quantization is similar to the human ear's perception of sound, which is more accurate for low-level sound and less accurate for high-level sound, i.e., makes a kind of a logarithmic compression.
It is to be noted here that the inventive merits are not only obtained by modifying the reconstruction parameter itself which is included in the bit stream as the quantized parameter. The advantages can also be obtained by deriving a post processed quantity from the reconstruction parameter. This is especially useful, when the reconstruction parameter is a difference parameter and a manipulation such as smoothing is performed on an absolute parameter derived from the difference parameter.
In a preferred embodiment of the present invention, the post processing for the reconstruction parameters is controlled by means of a signal analyser, which analyses the signal portion associated with a reconstruction parameter to find out, which signal characteristic is present. In a preferred embodiment, the inventive post processing is activated only for tonal portions of the signal (with respect to frequency and/or time), while the post processing is deactivated for non-tonal portions, i.e., transient portions of the input signal. This makes sure that the full dynamic of reconstruction parameter changes is transmitted for transient sections of the audio signal, while this is not the case for tonal portions of the signal.
Preferably, the post processor performs a modification in the form of a smoothing of the reconstruction parameters, where this makes sense from a psycho-acoustic point of view, without affecting important spatial detection cues, which are of special importance for non-tonal, i.e., transient signal portions.
The present invention results in a low data rate, since an encoder-side quantization of reconstruction parameters can be a coarse quantization, since the system designer does not have to fear heavy changes in the decoder because of a change from a reconstruction parameter from one inversely quantized level to another inversely quantized level, which change is reduced by the inventive processing by mapping to a value between two requantization levels.
Another advantage of the present invention is that the quality of the system is improved, since audible artefacts caused by a change from one requantization level to the next allowed requantization level are reduced by the inventive post processing, which is operative to map to a value between two allowed requantization levels.
Naturally, the inventive post processing of quantized reconstruction parameters represents a further information loss, in addition to the information loss obtained by parametrization in the encoder and subsequent quantization of the reconstruction parameter. This is, however, not as bad as it sounds, since the inventive post processor preferably uses the actual or preceding quantized reconstruction parameters for determining a post processed reconstruction parameter to be used for reconstruction of the actual time portion of the input signal, i.e., the base channel. It has been shown that this results in an improved subjective quality, since encoder-induced errors can be compensated to a certain degree. Even when encoder-side induced errors are not compensated by the post processing of the reconstruction parameters, strong changes of the spatial perception in the reconstructed multi-channel audio signal are reduced, preferably only for tonal signal portions, so that the subjective listening quality is improved in any case, irrespective of the fact, whether this results in a further information loss or not.
Preferred embodiments of the present invention are subsequently described by referring to the enclosed drawings, in which:
a is another embodiment of the post processor shown in
b is another preferred embodiment of the post processor;
a is another embodiment of the post processor shown in
b is a schematic indication of the parameters to be post processed in accordance with the invention showing that also a quantity derived from the reconstruction parameter can be smoothed;
a is an exemplary time course of quantized reconstruction parameters associated with subsequent input signal portions;
b is a time course of post processed reconstruction parameters, which have been post-processed by the post processor implementing a smoothing (low-pass) function;
In the BCC case described above, the number of input channels will be 1 or generally not more than 2, while the number of output channels will be 5 (left surround, left, center, right, right surround) or 6 (5 surround channels plus 1 sub-woofer channel) or even more in case of 7.1 or 9.1 multi-channel formats.
As shown in
The multi-channel reconstructor 12 is used for reconstructing a time portion of each of the number of synthesis output channels using the time portion to be processed of the input channel and the post processed reconstruction parameter.
In preferred embodiments of the present invention, the quantized reconstruction parameters are quantized BCC parameters such as interchannel level differences, interchannel time differences or interchannel coherence parameters. Naturally, all other reconstruction parameters such as stereo parameters for intensity stereo or parametric stereo can be processed in accordance with the present invention as well.
To summarize, the inventive system has a first input 14a for the quantized and preferably encoded reconstruction parameters associated with subsequent time portions of the input signal. The subsequent time portions of the input signal are input into a second input 14b, which is connected to the multi-channel reconstructor 12 and preferably to an input signal analyser 16, which will be described later. On the output side, the inventive multi-channel synthesizer of
In the following, reference will be made to
In the following, reference is made to
The decoder 22 includes a source decoder 26, which is operative to reconstruct a signal from the received bit stream (originating from the source encoder 24). To this end, the source decoder 26 supplies, at its output, subsequent time portions of the input signal to an up-mixer 12, which performs the same functionality as the multi-channel reconstructor 12 in
It can be seen from
The signal analyser 16 is formed from a tonality determination unit 16a and a subsequent thresholding device 16b. Additionally, the reconstruction parameter post processor 10 from
When, however, the tonality determination means determines that a certain frequency band of a actual time portion of the input signal, i.e., a certain frequency band of an input signal portion to be processed has a tonality lower than the specified threshold, i.e., is transient, the switch is actuated such that the smoothing filter 10a is by-passed.
In the latter case, the signal-adaptive post processing by the smoothing filter 10a makes sure that the reconstruction parameter changes for transient signals pass the post processing stage unmodified and result in fast changes in the reconstructed output signal with respect to the spatial image, which corresponds to real situations with a high degree of probability for transient signals.
It is to be noted here that the
Naturally, one could also detect transient portions and exaggerate the changes in the parameters to values between predefined quantized values or quantization indices so that, for heavily transient signals, the post processing for the reconstruction parameters results in an even more exaggerated change of the spatial image of a multi-channel signal. In this case, a quantization step size of 1 as instructed by subsequent reconstruction parameters for subsequent time portions can be enhanced to for example 1.5, 1.4, 1.3 etc, which results in an even more dramatically changing spatial image of the reconstructed multi-channel signal.
It is to be noted here that a tonal signal characteristic, a transient signal characteristic or other signal characteristics are only examples for signal characteristics, based on which a signal analysis can be performed to control a reconstruction parameter post processor. In response to this control, the reconstruction parameter post processor determines a post processed reconstruction parameter having a value which is different from any values for quantization indices on the one hand or requantization values on the other hand as determined by a predetermined quantization rule.
It is to be noted here that post processing of reconstruction parameters dependent on a signal characteristic, i.e., a signal-adaptive parameter post processing is only optional. A signal-independent post processing also provides advantages for many signals. A certain post processing function could, for example, be selected by the user so that the user gets enhanced changes (in case of an exaggeration function) or damped changes (in case of a smoothing function). Alternatively, a post processing independent of any user selection and independent of signal characteristics can also provide certain advantages with respect to error resilience. It becomes clear that, especially in case of a large quantizer step size, a transmission error in a quantizer index may result in heavily audible artefacts. To this end, one would perform a forward error correction or anything like that, when the signal has to be transmitted over error-prone channels. In accordance with the present invention, the post processing can obviate the need for any bit-inefficient error correction codes, since the post processing of the reconstruction parameters based on reconstruction parameters in the past will result in a detection of erroneous transmitted quantized reconstruction parameters and will result in suitable counter measures against such errors. Additionally, when the post processing function is a smoothing function, quantized reconstruction parameters strongly differing from former or later reconstruction parameters will automatically be manipulated as will be outlined later.
It has to be noted that the enhanced quantizer 10e is different from a normal inverse quantizer since a normal inverse quantizer only maps each quantization input from a limited number of quantization indices into a specified inversely quantized output value. Normal inverse quantizers cannot map non-integer quantizer indices. The enhanced inverse quantizer 10e is therefore implemented to preferably use the same quantization rule such as a linear or logarithmic quantization law, but it can accept non-integer inputs to provide output values which are different from values obtainable by only using integer inputs.
With respect to the present invention, it basically makes no difference, whether the manipulation is performed before requantization (see
b shows an embodiment in which the enhanced inverse quantizer 10e in
Generally, the post processor 10 is implemented as a post processor as indicated in
As has been outlined above, the data manipulation to overcome artefacts due to quantization step sizes in a coarse quantization environment can also be performed on a quantity derived from the reconstruction parameter attached to the base channel in the parametrically encoded multi channel signal. When for example the quantized reconstruction parameter is a difference parameter (ICLD), this parameter can be inversely quantized without any modification. Then an absolute level value for an output channel can be derived and the inventive data manipulation is performed on the absolute value. This procedure also results in the inventive artefact reduction, as long as a data manipulation in the processing path between the quantized reconstruction parameter and the actual reconstruction is performed so that a value of the post processed reconstruction parameter or the post processed quantity is different from a value obtainable using requantization in accordance with the quantization rule, i.e. without manipulation to overcome the “step size limitation”.
Many mapping functions for deriving the eventually manipulated quantity from the quantized reconstruction parameter are devisable and used in the art, wherein these mapping functions include functions for uniquely mapping an input value to an output value in accordance with a mapping rule to obtain a non post processed quantity, which is then post processed to obtain the postprocessed quantity used in the multi channel reconstruction (synthesis) algorithm.
In the following, reference is made to
A possible inverse quantizer function is to map a quantizer level of 0 to an inversely quantized value of 0. A quantizer level of 1 would be mapped to an inversely quantized value of 10. Analogously, a quantizer level of 2 would be mapped to an inversely quantized value of 20 for example. Requantization is, therefore, controlled by an inverse quantizer function indicated by reference number 31. It is to be noted that, for a straightforward inverse quantizer, only the crossing points of line 30 and line 31 are possible. This means that, for a straightforward inverse quantizer having an inverse quantizer rule of
This is different in the enhanced inverse quantizer 10e, since the enhanced inverse quantizer receives, as an input, values between 0 and 1 or 1 and 2 such as value 0.5. The advanced requantization of value 0.5 obtained by the manipulator 10d will result in an inversely quantized output value of 5, i.e., in a post processed reconstruction parameter which has a value which is different from a value obtainable by requantization in accordance with the quantization rule. While the normal quantization rule only allows values of 0 or 10, the inventive inverse quantizer working in accordance with the inverse quantizer function 31 results in a different value, i.e., the value of 5 as indicated in
While the straight-forward inverse quantizer maps integer quantizer levels to quantized levels only, the enhanced inverse quantizer receives non-integer quantizer “levels” to map these values to “inversely quantized values” between the values determined by the inverse quantizer rule.
The present invention is advantageous in that the inventive post processing smoothes fluctuations or smoothes short extreme values. The situation especially arises in a case, in which signal portions from several input channels having a similar energy are super-positioned in a frequency band of a signal, i.e., the base channel or input signal channel. This frequency band is then, per time portion and depending on the instant situation mixed to the respective output channels in a highly fluctuating manner. From the psycho-acoustic point of view, it would, however, be better to smooth these fluctuations, since these fluctuations do not contribute substantially to a detection of a location of a source but affect the subjective listening impression in a negative manner.
In accordance with a preferred embodiment of the present invention, such audible artefacts are reduced or even eliminated without incurring any quality losses at a different place in the system or without requiring a higher resolution/quantization (and, thus, a higher data rate) of the transmitted reconstruction parameters. The present invention reaches this object by performing a signal-adaptive modification (smoothing) of the parameters without substantially influencing important spatial localization detection cues.
The sudden occurring changes in the characteristic of the reconstructed output signal result in audible artefacts in particular for audio signals having a highly constant stationary characteristic. This is the case with tonal signals. Therefore, it is important to provide a “smoother” transition between quantized reconstruction parameters for such signals. This can be obtained for example by smoothing, interpolation, etc.
Additionally, such a parameter value modification can introduce audible distortions for other audio signal types. This is the case for signals, which include fast fluctuations in their characteristic. Such a characteristic can be found in the transient part or attack of a percussive instrument. In this case, the present invention provides for a deactivation of parameter smoothing.
This is obtained by post processing the transmitted quantized reconstruction parameters in a signal-adaptive way.
The adaptivity can be linear or non-linear. When the adaptivity is non-linear, a thresholding procedure as described in
Another criterion for controlling the adaptivity is a determination of the stationarity of a signal characteristic. A certain form for determining the stationarity of a signal characteristic is the evaluation of the signal envelope or, in particular, the tonality of the signal. It is to be noted here that the tonality can be determined for the whole frequency range or, preferably, individually for different frequency bands of an audio signal.
The present invention results in a reduction or even elimination of artefacts, which were, up to now, unavoidable, without incurring an increase of the required data rate for transmitting the parameter values.
As has been outlined above with respect to
It is to be noted here that the inventive post processing can also be used for other concepts of parametric encoding of multi-channel signals such as for parametric stereo MP3/AAC, MP3 surround, and similar methods.
