Patent Application
20200402530
The present invention lies in the field of evaluating speech quality in video or audio signals by generating a score signal representing the quality, especially the speech quality of an audio or video signal.
Classical quality measurement techniques using concepts like signal-to-noise ratio etc. have been replaced with the rise for new technologies for telephone services that introduce new types of distortions, for example Voice-over-IP (VoIP).
The first international standard for the perceptional quality measurement of was PSQM benchmarked by the ITO-T. This method was standardized as ITU-T-recommendation P.861 in 1996. However, the scope of recommendation P.861 was limited to the assessment of telephone-band speech codex only.
A corresponding international standard for the perceptual quality measurement of wide-band audio signals is PEAQ (perceptual evaluation of audio quality). This method, standardized as ITU-R recommendation BS.1387.
A further model has been standardized as perceptual evaluation of speech quality (PESQ) by ITU-T recommendation P.862. Unlike other coding assessment models PESQ is able to predict subjective quality in a very wide range of conditions including coding distortions, errors, noise, filtering, delay and variable delay.
As shown in
The output signal of this system 2, which is typically a degraded signal, can be used for a human/subjective test in order to produce the score LQS.
The input signal (reference signal), together with the output signal (degraded signal) are furthermore supplied to a double ended objective model 6, the output of which is supplied to a further quality mapping unit 7 producing the score LQO.
Furthermore, it is known to use the output of the human/subjective test 5, i.e. the LQS score in order to calibrate the double-ended objective model 6.
Further, the output signal (degraded signal) is fed to a single-ended objective model 8, the output of which is fed to a quality mapping unit 9 producing the score LQO.
As can be seen from
WO9859509 teaches the use of neural networks as neural network estimators. The estimators according to this document receive a reference signal in addition to a recorded speech signal to be analyzed and do produce a LQE score.
The present invention now targets at the improvement of the generation of score signals representing the quality, especially speech quality, of an audio or video signal produced by a system such as for example VoIP.
This object is achieved by means of the features of the independent claims. The dependent claims developed further the central idea of the present invention.
According to an aspect of the invention, an apparatus for generating a score signal representing the quality of an audio or video signal supplied to the apparatus is proposed. The apparatus comprises an input for supplying an audio or video signal preferably containing speech information. The apparatus furthermore comprises a computing unit implementing a newer network. The computing unit is supplied with the audio or video signal and using the newer network produces a score signal representing the quality of an audio or video signal supplied. The score signal representing at least one predefined quality parameter of the audio or video signal. According to the invention, the newer network is set up by being trained with training data of a specific transmission standard and/or coding used for generating the audio or video data.
The signal is preferred maybe a digital audio signal and the score signal may represent the speech quality according to at least one of the following ITU-T speech quality testing methods: PESQ, PAQ or POLQ.
The score signal may represent simultaneously the score signal being the output notes of the newer network, may represent simultaneously the speech quality according to at least two ITU-T speech quality testing methods.
Preferably, the newer network is not supplied with a reference signal, i.e. a non-degraded version of the signal to be analyzed.
The signal may be a speech signal and the score signal may represent the ITU P.800 value LQS (listen quality subjective).
The newer network may be obtained by a sequence of supervised learning steps, the steps comprising:
The audio signal maybe a VoIP signal.
A further aspect of the present invention relates to an apparatus for generating a score signal representing the quality of a speech signal supplied to the apparatus, the apparatus comprising:
A yet further aspect of the invention relates to an apparatus for generating a score signal representing the quality of an audio or video signal to the apparatus the apparatus implements a Siamese network and comprises a:
A yet further aspect of the invention relates to a computer-implemented method for generating a score signal representing the quality of an audio or video signal, comprising steps of:
Yet another aspect of the invention relates to a computer-implemented method for generating a score signal representing the quality of an audio or video signal. The method may comprise the steps of:
Further aspects, features and advantages of the invention will now become evident by means of the following explanation of non-limiting embodiments of the invention, when taken in conjunction with the figures of the enclosed drawings:
The general aspects of the present invention will now be explained with reference to
Note that the system 2 according to the invention may be a system emulating a transmission standard. It may furthermore comprise a fading unit simulating different scenarios (urban, rural, . . . etc.). It may furthermore comprise a video/audio analyzer. The input signal may be an analog or a digital signal.
As can be seen by comparison to
Other measurements can be applied in addition or alternatively to the mentioned ones.
As can be seen from
As can be seen in
The codec may be e.g. one or more of
During the training of the neural network, the output signal (degraded signal) of the system under test is used as an input signal for the neural network 10.
Furthermore, the reference signal (input signal) is also fed to the objective model 6, and an output thereof is used as training data by comparing these objectively produced training data with the output of the neural network 10. In methods known as such these training data can be used for supervised learning of the neural network 10. Preferably, thus, this neural network 10 is training using a specific codec and/or transmission standard (3G, 4G, 5G etc.).
The neural network may be any of known neural network such for example a DNN, CNN or RNN.
The audio signal (which is the output signal/degraded signal) is fed to the input layer 20 of the neural network.
The output layer 21 of the neural network 10 produces a quality score, preferably the LQS quality score, according to one or more ITU measurement methods. Thus, the neuronal network 10 maps the supplied audio signal to one or more quality scores.
Preferably, a plurality of quality score values according to different ITU measurement methods is produced simultaneously, such for example values according to PESQ, PEAQ, and/or POLQA.
The input layer of the neural network 10 is provided with the output signal, degraded signal, which may be a transmitted or stored audio file 25.
This degraded output signal, together with the input signal as reference signal, is also fed to a classical (objective) measurement according to for example ITU standards).
The output score value according to different ITU measurement methods, such as for example the PESQ, PEAQ and POLQA value are then to compared in order to produce a signal for supervised learning of the neural network 10.
In
According to this approach, the input signal (reference signal) is fed to a first neural network 30 producing a first output signal 31.
The degraded signal (transmitted audio signal) is fed to a second neural network 32, producing a second output signal 32.
The first and the second output signal 31, 32, respectively, are fed to a third neural network which produces the PESQ, PEAQ or POLQA values.
