The present invention relates to a technology for eliminating distortion of a signal.
When observation of a signal is performed in an environment where reflections, reverberations, and so on exist, the signal is observed as a convolved version of a clean signal with reflections, reverberations, and so on. Hereafter, the clean signal will be referred to as an “original signal”, and the signal that is observed will be referred to as an “observed signal”. In addition, the distortion convolved on the original signal such as reflections, reverberations, and so on will be referred to as “transfer characteristics”. Accordingly, it is difficult to extract the characteristics inherent in the original signal from the observed signal. Conventionally, various techniques of signal distortion elimination have been devised to resolve this inconvenience. Signal distortion elimination is a processing for eliminating transfer characteristics convolved on an original signal from an observed signal.
A signal distortion elimination processing disclosed in Non-patent literature 1 will now be described as an example of conventional signal distortion elimination methods with reference to
Non-patent literature 1: B. W. Gillespie, H. S. Malvar and D. A. F. Florencio, “Speech dereverberation via maximum-kurtosis subband adaptive filtering,” IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 3701-3704, 2001.
The conventional signal distortion elimination method described above assumes that the characteristics inherent in the original signal contribute significantly to the inter-sample correlation within the respective frames of the observed signal, and that the transfer characteristics contributes significantly to the inter-sample correlation over the frames. Based on this assumption, the above-described conventional method removes the contribution of the characteristics inherent in the original signal from the observed signal by applying the prediction error filters to the frame-wise observed signals obtained by segmenting the entire observed signal into frames.
However, since this assumption is only a rough approximation, the accuracy of the inverse filter is insufficient. In other words, because the prediction error filters calculated from the observed signal are influenced by the transfer characteristics, it is impossible to accurately remove only the characteristics inherent in the original signal. As a result, the accuracy of the inverse filter calculated from the prediction error filter-applied signal is not satisfactory. Accordingly, compared to the original signal, the signal obtained by applying the inverse filter to the observed signal still contains some non-negligible distortion.
In consideration of the above, the objective of the present invention is to obtain a highly accurate restored signal by eliminating distortion attributable to transfer characteristics from an observed signal with calculation of a highly accurate inverse filter.
In order to solve the above problem, a signal distortion elimination apparatus of the present invention comprises: an inverse filter application means that applies a filter (hereinafter referred to as an inverse filter) to an observed signal when a predetermined iteration termination condition is met, followed by outputting the results thereof as a restored signal, and when the iteration termination condition is not met, applies the inverse filter to the observed signal, followed by outputting the results thereof as an ad-hoc signal; a prediction error filter calculation means that segments the ad-hoc signal into frames, and outputs a prediction error filter of each of frames obtained by performing linear prediction analysis on the ad-hoc signal of each frame; an inverse filter calculation means that calculates an inverse filter such that the samples of a concatenation of innovation estimates of the respective frames (hereinafter referred to as an innovation estimate sequence) become mutually independent, where the innovation estimate of a single frame (hereinafter referred to as an innovation estimate) is a signal obtained by applying the prediction error filter of the corresponding frame to the ad-hoc signal of the corresponding frame, followed by outputting the inverse filter; and a control means that iteratively executes the inverse filter application means, the prediction error filter calculation means and the inverse filter calculation means until the iteration termination condition is met.
In the present invention, an inverse filter is calculated such that the samples of the signal (innovation estimate sequence), which is obtained by applying the prediction error filter calculated on the basis of the ad-hoc signal to the ad-hoc signal which is obtained by applying the inverse filter to the observed signal in order to eliminate transfer characteristics, become mutually independent. Subsequently, a restored signal is obtained by applying the inverse filter to the observed signal when a predetermined iteration termination condition is met.
The signal distortion elimination apparatus described above may be arranged so that: the prediction error filter calculation means performs linear prediction analysis on the ad-hoc signal of each frame in order to calculate either a prediction error filter that minimizes the sum of the variances of the respective innovation estimates over all the frames or a prediction error filter that minimizes the sum of the log variances of the respective innovation estimates over all the frames, and outputs a prediction error filter for each frame; and the inverse filter calculation means calculates an inverse filter that maximizes the sum of the normalized kurtosis values of the respective innovation estimates over all the frames as the inverse filter that makes the samples of the above-mentioned innovation estimate sequence become mutually independent, and outputs this inverse filter.
This configuration is intended to calculate the set of prediction error filters and an inverse filter that minimizes the mutual information using an altering variables method, where the mutual information is used as a measure of the independence of the innovation sequence. A detailed description thereof will be presented later.
Alternatively, the signal distortion elimination apparatus described above may be arranged so that: the prediction error filter calculation means performs linear prediction analysis on the ad-hoc signal of each frame in order to calculate either a prediction error filter that minimizes the sum of the variances of the respective innovation estimates over all the frames or a prediction error filter that minimizes the sum of the log variances of the respective innovation estimates over all the frames, and outputs a prediction error filter for each frame; and the inverse filter calculation means calculates, as the inverse filter that makes the samples of the above-mentioned innovation estimate sequence become mutually independent, either an inverse filter that minimizes the sum of the variances of the respective innovation estimates over all the frames or an inverse filter that minimizes the sum of the log variances of the respective innovation estimates over all the frames, and outputs this inverse filter.
This configuration is intended to calculate the set of prediction error filters and an inverse filter that minimizes the mutual information using an altering variables method, where the mutual information is used as a measure of the independence of the innovation sequence. This configuration enables us to calculate a prediction error filter and an inverse filter using the altering variables method without using higher order statistics of the signal.
In the signal distortion elimination apparatus described above, a pre-whitening process may be prepositioned and processing similar to those described above may be performed on a whitened signal obtained through pre-whitening. More specifically, the signal distortion elimination apparatus may be comprised of: a whitening filter calculation means that outputs a whitening filter obtained by performing linear prediction analysis on an observed signal; a whitening filter application means that outputs a whitened signal by applying the whitening filter to the observed signal; an inverse filter application means that applies a filter (hereinafter referred to as an inverse filter) to the whitened signal when a predetermined iteration termination condition is met, followed by outputting the results thereof as a restored signal, and when the iteration termination condition is not met, applies the inverse filter to the whitened signal, followed by outputting the results thereof as an ad-hoc signal; a prediction error filter calculation means that segments the ad-hoc signal into frames, and outputs a prediction error filter of each of frames obtained by performing linear prediction analysis on the ad-hoc signal of each frame; an inverse filter calculation means that calculates an inverse filter such that the samples of a concatenation of innovation estimates of the respective frames (hereinafter referred to as an innovation estimate sequence) become mutually independent, where the innovation estimate of a single frame (hereinafter referred to as an innovation estimate) is a signal obtained by applying the prediction error filter of the corresponding frame to the ad-hoc signal of the corresponding frame, followed by outputting the inverse filter; and a control means that iteratively executes the inverse filter application means, the prediction error filter calculation means and the inverse filter calculation means until the iteration termination condition is met.
In order to solve the above problem, a signal distortion elimination method according to the present invention comprises: an inverse filter application step in which an inverse filter application means applies a filter (hereinafter referred to as an inverse filter) to an observed signal when a predetermined iteration termination condition is met, followed by outputting the results thereof as a restored signal, and when the iteration termination condition is not met, applies the inverse filter to the observed signal, followed by outputting the results thereof as an ad-hoc signal; a prediction error filter calculation step in which a prediction error filter calculation means segments the ad-hoc signal into frames, and outputs a prediction error filter of each of frames obtained by performing linear prediction analysis on the ad-hoc signal of each frame; an inverse filter calculation step in which an inverse filter calculation means calculates an inverse filter such that the samples of a concatenation of innovation estimates of the respective frames (hereinafter referred to as an innovation estimate sequence) become mutually independent, where the innovation estimate of a single frame (hereinafter referred to as an innovation estimate) is a signal obtained by applying the prediction error filter of the corresponding frame to the ad-hoc signal of the corresponding frame, followed by outputting the inverse filter; and a control step in which a control means iteratively executes the inverse filter application steps, the prediction error filter calculation steps and the inverse filter calculation steps until the iteration termination condition is met.
In addition, in the signal distortion elimination method described above, a pre-whitening process may be prepositioned and processing similar to those described above may be performed on a whitened signal obtained through pre-whitening. More specifically, the signal distortion elimination method may be comprised of: a whitening filter calculation step in a which whitening filter calculation means outputs a whitening filter obtained by performing linear prediction analysis on an observed signal; a whitening filter application step in which a whitening filter application means outputs a whitened signal by applying the whitening filter to the observed signal; an inverse filter application step wherein an inverse filter application means applies a filter (hereinafter referred to as an inverse filter) to the whitened signal when a predetermined iteration termination condition is met, followed by outputting the results thereof as a restored signal, and when the iteration termination condition is not met, applies the inverse filter to the whitened signal, followed by outputting the results thereof as an ad-hoc signal; a prediction error filter calculation step in which a prediction error filter calculation means segments the ad-hoc signal into frames, and outputs a prediction error filter of each of frames obtained by performing linear prediction analysis on the ad-hoc signal of each frame; an inverse filter calculation step in which an inverse filter calculation means calculates an inverse filter such that the samples of a concatenation of innovation estimates of the respective frames (hereinafter referred to as an innovation estimate sequence) become mutually independent, where the innovation estimate of a single frame (hereinafter referred to as an innovation estimate) is a signal obtained by applying the prediction error filter of the corresponding frame to the ad-hoc signal of the corresponding frame, followed by outputting the inverse filter; and a control step in which a control means iteratively executes the inverse filter application steps, the prediction error filter calculation steps and the inverse filter calculation steps until the iteration termination condition is met.
It is possible to make a computer operate as a signal distortion elimination apparatus by using a signal distortion elimination program which implements the present invention. In addition, by recording the signal distortion elimination program on a computer-readable recording medium, it is now possible to make another computer to function as a signal distortion elimination apparatus or to distribute the signal distortion elimination program.
In the present invention, the contribution of the characteristics inherent in an original signal contained in an observed signal is reduced not by using a prediction error filter calculated from the observed signal but by using a prediction error filter calculated from an ad-hoc signal (a tentative restored signal) obtained by applying a (tentative) inverse filter to the observed signal. Since a prediction error filter calculated from an ad-hoc signal is insusceptible to transfer characteristics, it is possible to eliminate the characteristics inherent in the original signal in a more accurate manner. Such an inverse filter that makes samples of a signal (innovation estimate sequence), which is obtained by applying prediction error filters calculated with the present invention to an ad-hoc signal, mutually independent is capable of accurately eliminating transfer characteristics. Therefore, by applying such an inverse filter to an observed signal, a highly accurate restored signal from which distortion attributable to transfer characteristics has been reduced is obtained.
Prior to the description of embodiments, principles of the present invention will now be described.
In the following description, a single signal source is assumed unless otherwise noted.
1.1 Signal
Object signals of the present invention widely encompass such signals as human speech, music, biological signals, and electrical signals obtained by measuring a physical quantity of an object with a sensor. It is more desirable that an object signal is an autoregressive (AR) process or well approximately expressed as the autoregressive process. For instance, a speech signal is normally considered as a signal expressed by a piecewise stationary AR process, or an output signal of an AR system representing phonetic characteristics driven by an Independent and Identically Distributed (i.i.d.) signal (refer to Reference literature 1).
The principles of the present invention will now be described using a speech signal as a typical example of such a signal.
(Reference literature 1) L. R. Rabiner, R. W. Schafer, “Digital Processing of Speech Signals,” Bell Laboratories, Incorporated, 1978.
1.2 Modeling of a Speech Signal
First, a speech signal s(t), which will be treated as an original signal, is modeled as a signal satisfying the following three conditions.
[Condition 1] The speech signal s(t) is generated by a piecewise stationary AR process.
From [Condition 1], let us denote the order of the AR process and the frame length considered to be stationary by P and W, respectively. Here, by segmenting the speech signal s(t) into frames, a speech signal si(n) of an ith frame is described as Equation (1) provided below. Equation (2) represents a correspondence relation between a sample of an ith frame speech signal si(n) and a sample of a speech signal s(t) before the segmentation. In other words, the nth sample of the ith frame corresponds to the (i−1)W+nth sample of the speech signal s(t) before the segmentation. In Equations (1) and (2), bi(k) represents a linear prediction coefficient and ei(n) represents an innovation, where 1≦n≦W, 1≦t≦N, and N is the total number of samples. In the following description, unless otherwise noted, parameter n denotes a sample number in a single frame while parameter t denotes a sample number of a signal over all the frames. Hereafter, the total number of frames will be denoted by F.
Similarly, as regards an nth innovation ei(n) of an ith frame, the nth innovation ei(n) of the ith frame is related to an innovation e(t) of the speech signal s(t) before the segmentation. In this case, the nth innovation ei(n) of the ith frame corresponds to the (i−1)W+nth innovation of the innovation e(t) before the segmentation, that is, ei(n)=e((i−1)W+n) holds.
Equation (1) is then z-transformed. By letting Si(Z) denote the z-transform of the left-hand side, Ei(Z) denote the z-transform of the second term on the right-hand side, and Bi(z)=Σk=1Pbi(k)z−k, then the first term on the right-hand side is represented by Bi(Z)Si(Z). Therefore, the z−1 transform of Equation (1) is expressed as (1−Bi(z))Si(Z)=Ei(Z). Here, z−1 corresponds to a 1 tap delay operator in the time domain. Hereafter, time domain signals (tap weights) will be denoted by small letters, while z domain signals (transfer functions) will be denoted by capital letters. 1−Bi(z) must satisfy the minimum phase property, and it is required that all the zeros of 1−Bi(z) should be within a unit circle on a complex plane.
[Condition 2] Innovations ei(1), . . . , ei(W) belonging to the ith frame are independent and identical distributed. The mean and skewness (third order cumulant) of the probability distribution of the innovations ei(1), . . . , ei(W) are 0, while the kurtosis (fourth order cumulant) thereof is positive. In addition, innovations ei(n) and ej(n′), respectively belonging to the ith and jth frames [i≠j], are also mutually independent. However, these innovations do not necessarily belong to an identical distribution.
[Condition 3] The prediction error filter 1−Bi(z) does not have any zeros shared by other frames.
From Equations (1) and (2), the speech signal s(t) is expressed as Equation (3), where [•] denotes a flooring operator.
Thus, [Condition 2] is equivalent to the assumption that innovations process e(t) is a temporally-independent signal, and its statistical properties (or statistics) are stationary within a frame. Moreover, [Condition 3] is equivalent to the assumption that linear prediction coefficients {bi(k)}k=1P does not have a time-invariant pole.
1.3 Modeling of an Observed Signal
Next, an observed signal obtained by observing a speech signal with M microphones will be modeled. M is an integer satisfying M≧1.
A reverberant signal xm(t) observed by the mth (1≦m≦M) microphone is modeled as Equation (4), using tap weights {hm(k); 0≦k≦K; K denotes the length of the impulse response} of the transfer function Hm(z) of a signal transmission path from the sound source to the mth microphone. In the present description, reverberation is taken up as a typical example of transfer characteristics in the case of a speech signal, and the transfer characteristics will be replaced by the reverberation. Note, however, that this does not mean that the transfer characteristics are limited to the reverberation.
The set of signals observed by all the M microphones is represented as Equation (5) where x(t)=[x1(t), . . . , xM(t)]T, and h(k)=[h1(k), . . . , hM(k)]T.
1.4 Principle of Signal Distortion Elimination
A restored signal y(t) after signal distortion elimination is calculated by Equation (6) by using tap weights {gm(k); 1≦m≦M; 0≦k≦L; where L denotes the order of the inverse filter} of a multichannel inverse filter {Gm(z); 1≦m≦M}. In the present invention, gm(k) that is an inverse filter coefficient is estimated only from the observed signals x1(t), . . . , xM(t).
1.5 Basic Principle of the Present Invention
The basic principle of the present invention is characterized primarily by jointly estimating inverse filters {Gm(z); 1≦m≦M} of transfer functions {Hm(z); 1≦m≦M} and prediction error filters {1−Ai(z); 1≦i≦F} that are inverse filters of the AR system filters {1/(1−Bi(z)); 1≦i≦F}.
In order to describe this basic principle, a diagram of the entire system, in which the above-described model mechanism is embedded, is shown in
(Reference literature A) Takuya Yoshioka, Takafumi Hikichi, Masato Miyoshi, Hiroshi G. Okuno: Robust Decomposition of Inverse Filter of Channel and Prediction Error Filter of Speech Signal for Dereverberation, Proceedings of the 14th European Signal Processing Conference (EUSIPCO 2006), CD-ROM Proceedings, Florence, 2006.
However, in reality, the innovation ei(n) (1≦i≦F, 1≦n≦W) cannot be used as an input signal to a signal distortion elimination apparatus. Note that, in the system shown in
The idea of the present invention mentioned above can be distinguished from the conventional method in the following sense. The conventional method obtains an inverse filter as a solution of a problem that can be described as “apply a prediction error filter calculated based on an observed signal to the observed signal, and then calculate an inverse filter that maximizes the normalized kurtosis of the signal obtained by applying the inverse filter to the prediction-error-filtered signal”. In contrast, the present invention obtains an inverse filter as a solution of a problem that can be described as “calculate an inverse filter such that a signal obtained by applying a prediction error filter, which is obtained based on a signal obtained by applying an inverse filter to an observed signal, to the inverse-filtered signal becomes independent among their samples”. With this problem, it should be noted that, since the prediction error filter is calculated based on a signal obtained by applying an inverse filter to an observed signal, not only the inverse filter but also the prediction error filter is jointly calculated.
This problem may be formulated using the framework similar to ICA (Independent Component Analysis). While a description will now be given from the perspective of minimizing mutual information, maximum likelihood estimation-based formulation is also possible. In any case, the difference lies only in the formulation of the problem.
Using mutual information (Kullback-Leibler divergence) as a measure of independence, the problem to be solved is formulated as Equation (7), where g=[g1T, . . . , gMT]T, gm=[gm(0), . . . , gm(L)]T, a=[a1T, . . . , aFT]T, ai=[ai(1), . . . , ai(P)]T, and ai(k) denotes the prediction error filter coefficient. I (U1, . . . , Un) represents mutual information among random variables Ui. In addition, g and a with the symbol ̂ denote optimal solutions to be obtained. Superscript T denotes transposition.
[1] ∥g∥=1 (where ∥•∥ represents the norm operator.)
[2] 1−Ai(z) has all zeros within a unit circle on the complex plane (1≦i≦F).
Mutual information I does not vary even when the amplitude of the innovation estimate sequence di(1), . . . , di(W), . . . , di(1), . . . , di(W), . . . , dF(1), dF(W) is multiplied by a constant. Constraint [1] of Equation (7) is a condition for eliminating this indefiniteness of amplitude. Constraint [2] of Equation (7) is a condition for restricting the prediction error filter to a minimum phase system in accordance with the above-described [Condition 1]. Hereafter, the mutual information I will be referred to as a loss function which takes an innovation estimate sequence as an input and outputs the mutual information among them.
1.6 Derivation of Loss Function
In order to perform optimization of Equation (7), the loss function I (di(1), . . . , dF(W)) must be estimated from a finite-length signal sequence {di(n); 1≦i≦F, 1≦n≦W}. By letting D(U) denote a differential entropy of a (multivariate) random variable U, I (d1(1), . . . , dF(W)) is defined by Equation (8), where d=[dFT, . . . , d1T]T, di=[di(W), . . . , di(1)]T.
By using notations y=[yFT, . . . , y1T]T and yi=[yi(W), . . . , yi(1)]T, d is expressed using y as d=Ay, where the matrix A is expressed as Equations (9) and (10).
Thus, D(d) is expressed as Equation (11).
D(d)=D(y)+log detA (11)
By expressing the covariance matrix of multivariate random variable U as Σ(U), since Σ(d)=E{ddT}=AE{yyT}AT=A(y)AT holds for the second term in the right-hand side of Equation (11), we have Equation (12).
Substituting Equations (11) and (12) into Equation (8) yields Equation (13), where σ(U)2 represents the variance of random variable U.
In Equation (13), J(U) denotes the negentropy of (mutlivariate) random variable U. The negentropy takes a nonnegative value indicating the degree of nongaussianity of U, and takes 0 only when U follows a gaussian distribution. C(U1, . . . , Un) is defined as Equation (14). C(U1, . . . , Un) takes a nonnegative value indicating the degree of correlation among random variables Ui, and takes 0 only when the random variables Ui are uncorrelated.
Here, by using notations s=[sFT, . . . , s1T]T and si=[si(W), . . . , si(1)]T, since J(y)=J(s)=constant (proof omitted), Equation (13) is further simplified to Equation (15).
Therefore, we have to solve the optimization problem of Equation (16).
[1] ∥g∥=1 (where ∥•∥ represents the norm operator.)
[2] 1−Ai(z) has all zeros within a unit circle on the complex plane (1≦i≦F).
1.7 Optimization by Altering Variables Method
With respect to Equation (16), g and a are optimized by employing an altering variables method. In other words, by respectively denoting the estimates of g and a at the rth iteration as ĝ(r) and â(r), the updated estimates ĝ(r+1) and â(r+1) are obtained by executing the optimization of Equation (17) and then the optimization of Equation (18). In the notation of ĝ and â, the symbol ̂ is affixed above g and a, respectively. For instance, if the upper limit of the iteration counts is set to R1, ĝ(R1+1) and â(R1+1) which are obtained at the R1th iteration will be the optimal solutions of Equation (16). The superscript R1 is R1.
[1] g=ĝ(r)
[2] 1−Ai(z) has all zeros within a unit circle on the complex plane (1≦i≦F).
[1] a=â(r+1)
[2] ∥g∥=1
The intention of Equation (17) is to estimate, based on the present estimate of the inverse filter for cancelling the transfer characteristics, a prediction error filter for cancelling the characteristics inherent in the original signal. In the same manner, the intention of Equation (18) is to estimate an inverse filter based on the present estimate of the prediction error filter. By iterating these two types of optimization so that the degree of the mutual independence among the samples of the innovation estimate sequence, di(1), . . . , di(W), . . . , di(1), . . . , di(W), . . . , dF(1), . . . , dF(W), is increased, it is now possible to jointly estimate an inverse filter and a prediction error filter. Therefore, iterations performed here are important for highly accurate inverse filter estimation. However, as can be seen from
1.8 Optimization of a
In the present invention, optimization of Equation (17) will be performed as follows.
First, it should be noted that while C(d1(1), . . . , dF(W)) relates to second order statistics of di(n), J(di(n)) is a value related to higher order statistics of di(n). While second order statistics provide only the amplitude information of a signal, higher order statistics provide the phase information additionally. Therefore, in general, it is possible that optimization including higher order statistics will derive a nonminimum phase system. Therefore, considering the constraint that 1−Ai(z) be a minimum phase system, a is optimized by solving the optimization problem of Equation (19).
[1] g=ĝ(r)
[2] 1−Ai(z) has all zeros within a unit circle on the complex plane (1≦i≦F).
C(d1(1), . . . , dF(W)) is given by Equation (20).
Here, since matrix A is an upper triangular matrix whose diagonal components are all 1 as represented by Equations (9) and (10), we have log det A=0. By Substituting on of the value into Equation (12) yields the relationship expressed as Equation (21).
log detΣ(d)=log detΣ(y)=constant (21)
Thus, Equation (19) is equivalent to the optimization problem of Equation (22). Incidentally, it should be noted that Equation (22) is an expression reflecting the above-described [Condition 2]. Thus, interpreting Equation (22), Equation (22) means “calculate a that minimizes the sum of the log variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames”.
[1] g=ĝ(r)
[2] 1−Ai(z) has all zeros within a unit circle on the complex plane (1≦i≦F).
Solving the optimization problem expressed as Equation (22) is equivalent to performing linear prediction analysis on the ad-hoc signal of each frame, which is obtained by applying the inverse filter given by ĝ(r) to the observed signal. The linear prediction analysis gives minimum phase prediction error filters. Refer to above-described Reference literature 1 for the linear prediction analysis.
Incidentally, according to Equation (22), â(r+1) is calculated as a that minimizes the sum of log variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames. However, this does not mean that the present invention is limited to this method. Although a base of the logarithmic function is not specified in each equation provided above, the accepted practice is to set the base to 10 or the Napier's constant. At any rate, the base is greater than 1. In this case, since the logarithmic function monotonically increases, a that minimizes the sum of variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames is used as â(r+1).
1.9 Optimization of g
In the present invention, optimization of Equation (18) will be performed as follows.
As described above, C(d1(1), . . . , dF(W)) is a measure related to the degree of the correlation of {di(n); (1≦i≦F, 1≦n≦W)}. Since the minimization of C(d1(1), . . . , dF(W)) is performed during the (r+1)th optimization of a, C(di(1), . . . , dF(W)) is negligible compared to Σi=1FΣn=1WJ(di(n)). Accordingly, in optimizing g, the optimization problem of Equation (23) will be solved.
[1] a=â(r+1)
[2] ∥g∥=1
Based on [Condition 2], J(di(n)) is approximated by using Formula (24). Refer to Reference literature 2 for details thereof. For random variable U, κ4(U) denotes the kurtosis (fourth order cumulant) of U. The right-hand side of Formula (24) is referred to as a normalized kurtosis of the ith frame.
(Reference literature 2) A. Hyvarinen, J. Karhunen, E. Oja, “INDEPENDENT COMPONENT ANALYSIS”, John Wiley & Sons, Inc. 2001.
Since the kurtosis of the innovation of a speech signal is positive from [Condition 2], κ4(di(n))/σ(di(n))4 is positive. Therefore, the optimization problem of Equation (23) reduces to the optimization problem of Equation (25). Based on the frame-wise stationarity of speech signals described in [Condition 1], σ(di(n)) and κ4(di(n)) are calculated from the samples of each frame. While 1/W has been affixed in Equation (26), this term is only for the convenience of subsequent calculations and does not affect the calculation of the optimal solution of g by Equation (25). From Equations (25) and (26), ĝ(r+1) is obtained as g that maximizes the sum of the normalized kurtosis values over all the frames. Incidentally, it should be noted that Equations (25) and (26) are expressions reflecting the above-described [Condition 2]. Interpreting Equations (25) and (26), Equations (25) and (26) mean “calculate g that maximizes the sum of the normalized kurtosis values of each frame over all the frames”.
[1] a=â(r+1)
[2] ∥g∥=1
The optimal solution of g for Equation (25) is given as the solution for the equation where the differentiation of Q with respect to g is 0. This solution can be generally calculated according to the update rule expressed as Formula (27). The reason g′ is divided by its norm is to impose the above-described constraint [2]. η(u) denotes a learning rate. u denotes the update count during optimization of g.
In Formula (27), ∇Qg is given by Equations (28) and (29).
In Equation (29), di(n) is given by Equation (30), while vmi(n) is given by Equations (31) and (32). xmi(n) represents a signal of an ith frame observed by the mth microphone.
The conventional signal distortion elimination method described in the background art requires a relatively long observed signal (for instance, approximately 20 seconds). This is generally due to the fact that calculating higher order statistics such as the normalized kurtosis requires a significant amount of samples of an observed signal. However, in reality, such long observed signals are sometimes unavailable. Therefore, the conventional signal distortion elimination method is applicable only to limited situation.
In addition, because the calculation of the higher order statistics is relatively complicated, an apparatus configuration under the conventional signal distortion elimination method is likely to be complicated.
Thus, a principle of signal distortion elimination that is effective even for a shorter observed signal (for instance, of 3 to 5 seconds) and that involves simpler calculation than the conventional method will now be described. This principle uses only second order statistics of a signal, and is derived from the basic principle of the present invention which has been described in § 1.
2.1 Principle of Signal Distortion Elimination Based on Second Order Statistics
Signal distortion elimination based on second order statistics assumes the following two conditions in addition to the three conditions described earlier.
[Condition 4] M≧2. In other words, multiple microphones are used.
[Condition 5] Hm={hm(k)}k=0K does not have any common zeros among different microphones m.
In the optimization problem of Equation (16) provided above, g and a are calculated which minimize a measure comprising of negentropy J that is related to higher order statistics and a measure C indicating the degree of correlation among random variables.
The degree of correlation among random variables, C, is defined by second order statistics. Accordingly, the optimization problem to be solved is formulated by Equation (33).
By using Equation (21), the optimization problem of Equation (33) is transformed to the optimization problem of Equation (34). Incidentally, it should be noted that Equation (34) is an expression reflecting the above-described [Condition 2]. Thus, interpreting Equation (34), Equation (34) means “calculate the set of g and a that minimizes the sum of the log variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames”.
Here, when the above-described [Condition 4] and [Condition 5] hold, a multichannel observed signal can be regarded as an AR process driven by an original signal from a sound source (refer to Reference literature 3). This means that the leading tap of an inverse filter G may be fixed as expression (35), where a microphone corresponding to m=1 is the microphone nearest to the sound source.
(Reference literature 3) K. Aded-Meraim, E. Moulines, and P. Loubaton. Prediction error method for second-order blind identification. IEEE Trans. Signal Processing, Vol. 45, No. 3, pp. 694-705, 1997.
A restored signal y(t), in which the transfer characteristics is eliminated, is obtained by applying the inverse filter G, whose coefficients g are defined by Equations (34) and (35), to the observed signal x(t) according to Equation (6).
2.2 Optimization of a
As to Equation (34), g and a are optimized by employing an altering variables method.
For fixed inverse filter coefficients gm(k), the loss function of Equation (34) is minimized with respect to the prediction error filter coefficients ai(k).
Note here the following two points. The first point is that since g=[g1T, . . . , gMT]T is fixed, the restored signal y(t) that is an output of the inverse filter G is invariable during the optimization of the prediction error filter. The second point is that the ith frame prediction error filter coefficients ai(1), . . . , ai(P) contribute only to di(1), . . . , di(W).
Therefore, the prediction error filter coefficients ai(1), . . . , ai(P) of each frame should be estimated so as to minimize Σn=1W log σ(di(n))2. From [Condition 2], the variance of innovation estimate di(1), . . . , di(W) of the ith frame is stationary within a frame. Thus, the minimization of Σn=1W log σ(di(n))2 is equivalent to the minimization of W*σ((di(n))2, where the symbol * denotes multiplication. The variance σ(di(n))2 is calculated as <di(n)2>n=1W, where <di(n)2>n=1W represents the mean squares of di(n) calculated using the innovation estimate, di(1), . . . , di(W), within a single frame. Therefore, coefficients ai(k) that minimize W*<di(n)2>n=1W or, in other words, that minimize the sum of squared di(n) is estimated. Such coefficients ai(k) are calculated by using linear prediction analysis methodology.
Incidentally, according to the above description, â(r+1) is calculated as a that minimizes the sum of log variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames. However, this does not mean that the present invention is limited to this method. As described earlier, a that minimizes the sum of variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames may be used as â(r+1).
2.3 Optimization of g
For fixed prediction error filter coefficients ai(k), the loss function of Equation (34) is minimized with respect to the inverse filter coefficients gm(k).
A gradient descent method is used for the minimization of the loss function with respect to the inverse filter coefficients gm(k). Using [Condition 2], the optimization problem of Equation (34) is transformed to the optimization problem of Equation (36).
The optimal solution of g for Equation (36) is given as the solution for the equation where the differentiation of Σi=1F log<di(n)2>n=1W with respect to g is 0. This solution is generally calculated according to the update rule expressed as Equation (37), where δ denotes a learning rate and 1≦m≦M, 1≦k≦L. Note that, in Equation (37), because of the conditions of Equation (35), the constraint of ∥g∥=1 is not imposed. Moreover, because of the condition of Equation (35), k takes the value of 1≦k≦L.
By comparing Equation (37) with above-described Equation (29) or Equation (3) provided in the above-described Non-patent literature 1, it is clear that the second term of the right-hand side of Equation (37) is expressed by second order statistics, and the present calculation does not involve the calculation of higher order statistics. Therefore, the present method is also effective in the case of such short observed signals that estimating their high order statistics is difficult. Moreover, the calculation itself is simple.
Incidentally, according to Equation (36), ĝ is calculated as g that minimizes the sum of log variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames. However, this does not mean that the present invention is limited to this method. Although a base of a logarithmic function is not specified in each equation provided above, the accepted practice is to set the base to 10 or the Napier's constant. At any rate, the base is greater than 1. In this case, since the logarithmic function monotonically increases, g that minimizes the sum of variances of innovation estimates di(1), . . . , di(W) of each ith frame over all the frames may be used as ĝ. In this case, the update rule expressed as Equation (37) is no longer applicable, and it is necessary to calculate a solution for the equation where the differentiation of Σi=1F<di(n)2>n=1W with respect to g is 0. The resultant update rule may be formulated using the framework similar to ICA, and will be hereby omitted.
Pre-whitening may be applied to the signal distortion elimination based on the present invention. By pre-whitening observed signals, stabilization of optimization procedures, particularly fast convergence of update rules, may be realized.
Coefficients {fm(k); 0≦k≦X} of a filter (a whitening filter) that whitens an entire observed signal sequence {xm(t); 1≦t≦N} obtained by each microphone are calculated by Xth order linear prediction analysis.
Based on Equation (39), the above-mentioned whitening filter is applied to the observed signal xm(t) obtained by each microphone. wm(t) represents the signal resulted from the whitening of the mth-microphone observed signal xm(t).
In this case, Equations (31) and (38) should be changed to Equation (40), and Equation (32) to Equation (41).
Embodiments of the present invention will now be described with reference to the drawings. However, the embodiments of the present invention are not limited to the respective embodiments described hereafter, and any embodiments implementing the principles described in the respective sections shall suffice.
When implementing the first embodiment of the present invention, signals observed by sensors are processed according to the following procedure. In the present description, for the purpose of specifically describing the embodiments, a speech signal will be used as an example.
Before describing the first embodiment, an overview on obtaining observed signals and the way of segmenting the signals will be provided.
((Observed Signals))
An analog signal (this analog signal is convolved with distortion attributable to transfer characteristics) obtained by a sensor (microphone, for example), not shown in the drawings, is sampled at a sampling rate of, for instance, 8,000 Hz, and converted into a quantized discrete signal. Hereafter, this discrete signal will be referred to as an observed signal. Since components (means) necessary to execute the A/D conversion from an analog signal to an observed signal and so on are all realized by usual practices in known arts, descriptions and illustrations thereof will be omitted.
((Segmentation Processing))
Signal segmentation means, not shown in the drawings, excerpts discrete signals of a predetermined temporal length as one frame signal from the whole discrete signal while shifting the origin at regular time intervals in the direction of the temporal axis. For instance, discrete signals each having 200 sample point length (8,000 Hz×25 ms) are excerpted while shifting the origin every 80 sample points (8,000 Hz×10 ms). The excerpted signals are multiplied by a known window function, such as the Hamming window, Gaussian window, rectangular window. The segmentation by applying a window function is achievable using known usual practices.
An exemplary hardware configuration will be described when signal distortion elimination apparatus (1), which is the first embodiment of the present invention, is realized by using a computer (general-purpose machine).
As exemplified in
Programs for signal distortion elimination and data (observed signals) that are necessary to execute the programs are stored in the external storage device (17) of the signal distortion elimination apparatus (1) (instead of an external storage device, for instance, the programs may be stored in a ROM that is a read-only storage device). Data and the like obtained by executing of these programs are arbitrarily stored in the RAM, the external storage device or the like. Those data are read in from the RAM, the external storage device or the like when another program requires them.
More specifically, the external storage device (17) (or the ROM or the like) of the signal distortion elimination apparatus (1) stores: a program that applies an inverse filter to an observed signal; a program that obtains a prediction error filter from a signal obtained by applying the inverse filter to the observed signal; a program that obtains the inverse filter from the prediction error filter; and data (frame-wise observed signals and so on) that will become necessary to these programs. In addition, a control program for controlling processing based on these programs will also be stored.
In the signal distortion elimination apparatus (1) according to the first embodiment, the respective programs and data necessary to execute the respective programs which are stored in the external storage device (17) (or the ROM or the like) are read into the RAM (15) when required, and then interpreted, executed and processed by the DSP (14). As a result, as long as the DSP (14) realizes predetermined functions (the inverse filter application unit, the prediction error filter calculation unit, the inverse filter calculation unit, the control unit), the signal distortion elimination is achieved.
Next, with reference to
A rough sketch of the processing procedure is: (a) a signal (hereafter referred to as an ad-hoc signal) resulting from applying an inverse filter to an observed signal x(t) is calculated; (b) a prediction error filter is calculated from the ad-hoc signal; (c) the inverse filter is calculated from this prediction error filter; (d) an optimum inverse filter is calculated by iterating the processes of (a), (b) and (c); and (e) a signal resulting from applying the optimized inverse filter to the observed signal is obtained as a restored signal y(t).
(b) corresponds to the above-described optimization of a, (c) corresponds to the above-described optimization of g, and (d) corresponds to Equations (17) and (18). The number of iterations in (d) is set to a predetermined number R1. In other words, 1≦r≦R1. In addition, the number of updates using the update rule for optimizing g in the process of (c) is set to a predetermined number R2. In other words, 1≦u≦R2. For every single iteration of (d), or the series of processes of (a), (b) and (c), R2 updates are performed. While R1 is set at a predetermined number in the present embodiment, the present invention is not limited to this setup. For instance, the iterations may be arranged to be stopped when the absolute value of the difference between the value of Q of Equation (26) with g of rth iteration and that with g of (r+1)th iteration is computed is smaller than (or equal to) a predetermined positive small value ε. In the same manner, while R2 is set at a predetermined number in the present embodiment, the present invention is not limited to this setup. For instance, iterations may be arranged to be stopped when the absolute value of the difference between the value of Q of Equation (26) with g of uth iteration and that with g of (u+1)th iteration is smaller than (or equal to) a predetermined positive small value ε.
(Step S100)
Inverse filter application unit (14) calculates an ad-hoc signal y(t) by applying an inverse filter to an observed signal x(t)=[x1(t), . . . , xm(t), . . . , xM(t)]T according to Equation (42). While the ad-hoc signal y(t) is identical to a restored signal in the a calculational perspective, the term ad-hoc signal will be used in the present description in order to clearly specify that the signal so termed is not the restored signal calculated via R1 processes as described later. Here, t takes all sample numbers, i.e. 1≦t≦N, where N is the total number of samples. For the first embodiment, the number of microphones, M, is 1 or greater.
As a coefficient sequence {gm(k); 0≦k≦L} of the inverse filter, a predetermined initial value will be used for the first iteration of R1 iterations, and the inverse filter ĝ(r+1) calculated by the inverse filter calculation unit (13), to be described later, will be used for the second and subsequent iterations.
(Step S101)
Prediction error filter calculation unit (15) comprises a segmentation processing unit (151) which performs the segmentation processing and a frame prediction error filter calculation unit (152). The frame prediction error filter calculation unit (152) comprises frame prediction error filter calculation unit (152i) for the ith frame which calculates a prediction error filter from the ad-hoc signal of the ith frame, where i is an integer that satisfies 1≦i≦F.
The segmentation processing unit (151) performs the segmentation processing on the ad-hoc signal {y(t); 1≦t≦N} calculated by the inverse filter application unit (14). The segmentation processing is performed by, as shown in Equation (43) for instance, applying a window function that excerpts a frame signal of W point length with every W point shift. {yi(n); 1≦n≦W} represents an ad-hoc signal sequence included in the ith frame.
y
i(n)=y((i−1)W+n) (43)
Then, the prediction error filter calculation unit (152i) for the ith frame performs the Pth order linear prediction analysis on the ad-hoc signal {yi(n); 1≦n≦W} of the ith frame in accordance with Equation (22), and calculates prediction error filter coefficients {ai(k); 1≦k≦P}. Refer to Reference literature 1 described above for details of this computation. a1(1), . . . , a1(P), . . . , ai(1), . . . , ai(P), . . . , aF(1), . . . , aF(P) obtained by this calculation gives â(r+1) in Equation (22).
(Step S102)
An exemplary functional configuration of the inverse filter calculation unit (13) will be described with reference to
The first prediction error filter application unit (1311) segments the signal xm(t) observed by the mth (1≦m≦M) microphone into frames, and for each frame, calculates a prediction error filter-applied signal vmi(n) by applying the ith prediction error filter ai(k) obtained through step S101 to the ith frame signal xmi(n) (refer to Equation (31)). An example of the details of the processing described here will be given in the description of the third embodiment to be provided later.
The second prediction error filter application unit (1312) segments the updated inverse filter-applied signal y(t) into frames, and for each frame, calculates a prediction error filter-applied innovation estimate di(1), . . . , di(W) by applying the ith prediction error filter ai(k) obtained through step S101 to the ith frame signal yi(n) (refer to Equation (30)). The signal obtained through step S100 may be used as an initial value of the updated inverse filter-applied signal y(t). Subsequently, the second prediction error filter application unit (1312) accepts as input the updated inverse filter-applied signal y(t), which is output by the updated inverse filter application unit (133) to be described later. An example of the details of the processing described here will be given in the description of the third embodiment to be provided later.
The gradient vector calculation unit (1313) calculates a gradient vector ∇Qg of the present updated inverse filter g<u> using the signal vmi(n) and the innovation estimate di(n) (refer to Equations (28) and (29)). When calculating Equation (29) using finite samples of vmi(n) and di(n), the expectation value E may be estimated from the samples. An example of the details of the processing described here will be given in the description of the third embodiment to be provided later.
The inverse filter update unit (132) calculates the u+1th updated inverse filter g<u+1> according to Formula (27), by using the present updated inverse filter g<u>, a learning rate η(u) and the gradient vector ∇Qg. In Formula (27), once g<u+1> is calculated, the value of g<u> is newly replaced by that of g<u+1>.
The updated inverse filter application unit (133) calculates the updated inverse filter-applied signal y(t) according to Equation (42), by using g<u+1> obtained by the inverse filter update unit (132), or the new g<u>, and the observed signal x(t). In short, the calculation is performed by replacing gm(k) in Equation (42) by using g obtained by the u+1th update. The updated inverse filter-applied signal y(t) obtained by this calculation will become the input to the second prediction error filter application unit (1312). While the updated inverse filter-applied signal y(t) is identical to the restored signal in the a calculational perspective, the term updated inverse filter-applied signal will be used in the present description in order to clearly specify that the signal so termed is not the restored signal calculated via R1 processes to be described later, but a signal calculated in order to perform the update rule.
g<R2+1> obtained as the result of R2 updates performed under the control of the control unit (600) corresponds to ĝ(r+1) of Equation (25). The superscript R2 is R2. The inverse filter calculation unit (13) outputs ĝ(r+1).
Under the control of the control unit (500), ĝ(R1+1) is obtained by incrementing r by 1 every time the above-described processing series is performed until r reaches R1 or, in other words, by performing R1 iterations of the above-described processing series (step S103). The superscript R1 is R1. This ĝ(R1+1) is considered to be the optimal solution for Equation (16). Accordingly, after obtaining ĝ(R1+1), the inverse filter application unit (14) will be able to obtain the restored signal y(t) by applying the inverse filter ĝ(R1+1) to the observed signal x(t)=[x1(t), . . . , xM(t)]T according to Equation (42) (step S104).
The second embodiment corresponds to a modification of the first embodiment. More specifically, the second embodiment is an embodiment in which the pre-whitening described in §3 is performed. Thus, the portions that differ from the first embodiment will be described with reference to
For the second embodiment, a program that calculates a whitening filter and a program that applies the whitening filter to the observed signal is also stored in the external storage device (17) (or a ROM and the like) of the signal distortion elimination apparatus (1).
In the signal distortion elimination apparatus (1) of the second embodiment, the respective programs and data necessary to execute the respective programs which are stored in the external storage device (17) (or the ROM or the like) are read into the RAM (15) when required, and then interpreted, executed and processed by the DSP (14). As a result, as long as the DSP (14) realizes predetermined functions (the inverse filter application unit, the prediction error filter calculation unit, the inverse filter calculation unit, the whitening filter calculation unit, the whitening filter application unit), the signal distortion elimination is achieved.
(Step S100a)
Whitening filter calculation unit (11) calculates, via the Xth order linear prediction analysis, coefficients {fm(k); 0≦k≦X} of a filter (whitening filter) that whitens the entire observed signal {xm(t); 1≦t≦N} obtained by each microphone. All the calculation involved is the linear prediction analysis. Refer to Reference literature 1 described before. The coefficients of the whitening filter will become inputs to whitening filter application unit (12).
(Step S100b)
In accordance with Equation (39), the whitening filter application unit (12) applies the above-mentioned whitening filter to the signal observed by each microphone and obtains a whitened signal wm(t). As described earlier, since Equation (31) is replaced by Equation (40), the processing performed by the inverse filter calculation unit (13), particularly by the first prediction error filter application unit (1311), in the first embodiment should be modified to calculation based on Equation (40) instead of Equation (31). In addition, the calculation executed by the inverse filter application unit (14) in the first embodiment should be modified to calculation based on Equation (44) instead of Equation (42). After step S100b, steps S100 to S104 of the first embodiment are performed, in which the observed signal in the respective steps of the first embodiment is replaced by the whitened signal obtained through step S100b. To highlight this fact, in
Results of demonstration experiments of the second embodiment conducted by the present inventors will now be described. The following experimental conditions were used: the number of microphones M=4; the order of the whitening filter X=500; the order of the inverse filter L=1000; the number of samples excerpted by the window function (the number of samples per frame) W=200; the order of the prediction error filter P=16; the number of iterations R1=10; and the number of updates of the inverse filter calculation unit R2=20. The initial value of the learning rate (u) was set to 0.05, and if the value of Equation (26) decreased due to Formula (27), the value of η(u) was arranged to be sequentially reduced by half so that the value of Equation (26) would inevitably increase. The initial inverse filter to be input to the inverse filter application unit (14) shown in
The effect of the second embodiment according to the present invention was evaluated by using a D50 value (the ratio of the energy up to the first 50 msec to the total energy of impulse responses) as a measure of signal distortion elimination. Speech of a male speaker and a female speaker was taken from a continuous speech database, and observed signals were synthesized by convolving impulse responses measured in a reverberation room having a reverberation time of 0.5 seconds.
Furthermore, the effect of the second embodiment according to the present invention was evaluated by comparing speech spectrograms.
Moreover, the effect of the second embodiment of the present invention was evaluated using LPC spectral distortion.
From
In addition, comparing
The third embodiment corresponds to a modification of the first embodiment. More specifically, the third embodiment is an embodiment in which the signal distortion elimination based on second order statistics, described in §2, is performed. Thus, the portions that differ from the first embodiment will be described with reference to
The processing of steps S100 and S101 is the same as in the first embodiment.
The processing of step S102a is performed following the processing of step S101.
An exemplary functional configuration of the inverse filter calculation unit (13) according to the third embodiment will be described with reference to
The inverse filter calculation unit (13) comprises: first prediction error filter application unit (1311) that applies prediction error filters to the observed signal; second prediction error filter application unit (1312) that applies prediction error filters to the signal (updated inverse filter-applied signal) obtained by applying an updated inverse filter to the observed signal; gradient vector calculation unit (1313); inverse filter update unit (132); and updated inverse filter application unit (133). In this case, the updated inverse filter corresponds to gm(k) of Equation (37).
The first prediction error filter application unit (1311) segments the signal xm(t) observed by the mth (1≦m≦M) microphone into frames, and for each frame, calculates a prediction error filter-applied signal vmi(n) by applying the ith prediction error filter ai(k) obtained through step S101 to the ith frame signal xmi(n) (refer to Equation (38)). More specifically, segmentation processing unit (402B) segments the input observed signal xm(t) into frames, and outputs the ith frame signal xmi(n) of the observed signal xm(t). Then, prediction error filter application unit (404i) outputs the signal vmi(n) from input signal xmi(n) according to Equation (38). In these procedures, i takes the value of 1≦i≦F.
The second prediction error filter application unit (1312) segments the updated inverse filter-applied signal y(t) into frames, and for each frame, calculates a prediction error filter-applied innovation estimate di(1), . . . , di(W) by applying the ith prediction error filter ai(k) obtained through step S101 to each frame (refer to Equation (30)). The signal obtained through step S100 may be used as an initial value of the updated inverse filter-applied signal y(t). More specifically, except for the case of the first iteration, segmentation processing unit (402A) segments the updated inverse filter-applied signal y(t) output by the updated inverse filter application unit (133) to be described later, and then outputs the ith frame signal yi(n). Then, prediction error filter application unit (403i) outputs the innovation estimate di(1), . . . , di(W) in accordance with Equation (30) from input yi(n), where 1≦i≦F.
The gradient vector calculation unit (1313) calculates a gradient vector of the present updated inverse filter gm(k) using the signal vmi(n) and the innovation estimate di(n) (refer to the second term of the right-hand side of Equation (37)). More specifically, for each frame number i (1≦i≦F), cross-correlation calculation unit (405i) calculates the cross-correlation <di(n)vmi(n−k)>n=1W between the signal vmi(n) and the innovation estimate d(n). In addition, for each frame number i (1≦i≦F), variance calculation unit (406i) calculates the variance <di(n)2>n=1W of the innovation estimate di(1), . . . , di(W). For each frame number i (1≦i≦F), division unit (407i) calculates <di(n)vmi(n−k)>n=1W/<di(n)2>n=1W. Addition unit (407) calculates the sum of the division units (4071) to (407F) over all the frames. The result is the second term of the right-hand side of Equation (37).
The inverse filter update unit (132) calculates the u+1th updated inverse filter gm(k)′ according to Equation (37), using the present updated inverse filter gm(k), a learning rate 6 and the gradient vector. In Equation (37), once gm(k)′ is calculated, the values of gm(k) is newly replaced by that of gm(k)′.
The updated inverse filter application unit (133) calculates the updated inverse filter-applied signal y(t) according to Equation (42), by using gm(k)′ obtained by the inverse filter update unit (132), or the new gm(k), and the observed signal x(t). In other words, the updated inverse filter application unit (133) performs Equation (42) by using g obtained by the (u+1)th update as gm(k) of Equation (42). The updated inverse filter-applied signal y(t) obtained by this calculation will become the input to the second prediction error filter application unit (1312).
The processing of steps S103 and S104 performed following the processing of step S102a are the same as that of the first embodiment. Thus, a description thereof will be omitted.
Results of demonstration experiments of the third embodiment conducted by the present inventors will now be described. The following experimental conditions were used: M=4; L=1000; W=200; P=16; R=6; and R2=50. The initial value of the learning rate δ was set at 0.05, and if where the value of Σi=1F log<di(n)2>n=1W increased, the value of δ was arranged to be sequentially reduced by half so that the value of Σi=1F log<di(n)2>n=1W would inevitably decrease. The initial estimate of the inverse filter was gm(k)=0, 1≦m≦M, 1≦k≦L.
The effect of the third embodiment of the present invention was evaluated using RASTI (refer to Reference literature 5), which indicates speech intelligibility, as a measure for assessing dereverberation performance. Speech of five male speakers and five female speakers was taken from a continuous speech database, and observed signals were synthesized by convolving impulse responses measured in a reverberation room having a reverberation time of 0.5 seconds.
(Reference literature 5) H. Kuttruff. Room acoustics. Elsevier Applied Science, third edition, P.237 1991.
Since the present invention is an elemental art that contributes to the improvement of performances of various signal processing systems, the present invention may be utilized in, for instance, speech recognition systems, television conference systems, hearing aids, musical information processing systems and so on.
Number | Date | Country | Kind |
---|---|---|---|
2006-039326 | Feb 2006 | JP | national |
2006-241364 | Sep 2006 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2007/052874 | 2/16/2007 | WO | 00 | 10/31/2007 |