1. Technical Field
The present disclosure relates to a song accompaniment apparatus and method, and more particularly, to a song accompaniment apparatus and method for eliminating voice signals from a mixture of music and voice signals.
2. Description of the Related Art
Song accompaniment apparatuses having karaoke functions are widely used for singing and/or amusement. A song accompaniment apparatus generally outputs (e.g., plays) a song accompaniment to which a person can sing along. Alternatively, the person can simply enjoy the music without singing along. As used herein, the term “song accompaniment” refers to music without voice accompaniment. In such song accompaniment apparatuses, a memory is generally used to store the song accompaniments which a user selects. Therefore, the number of song accompaniments for a given song accompaniment apparatus may be limited by the storage capacity of the memory. Also, such song accompaniment apparatuses are generally expensive.
Karaoke functions can be easily implemented for compact disc (CD) players, digital video disc (DVD) players, and cassette tape players outputting only song accompaniment. Users can play their own CDs, DVDs, and cassette tapes. Similarly, karaoke functions can also be easily implemented if voice is eliminated from FM audio broadcast outputs (e.g., from a radio) such that only a song accompaniment is output. Users can play their favorite radio stations.
Acoustic signals output from CD players, DVD players, cassette tape players, and FM radio generally contain a mixture of music and voice signals. Technology for eliminating the voice signals from the mixture has not been perfected yet. A general method of eliminating voice signals from the mixture includes transforming the acoustic signals into frequency domains and removing specific bands in which the voice signals are present. The transformation to frequency domains is generally achieved by using a fast Fourier transform (FFT) or subband filtering. A method of removing voice signals from a mixture using such frequency conversion is disclosed in U.S. Pat. No. 5,375,188, filed on Dec. 20, 1994.
However, since some music signal components are included in the same frequency bands as voice signals, in the range of several kHz, some music signals are lost when those frequency bands are removed, thereby decreasing the quality of the output accompaniment. To reduce the loss of music signals from the mixture, an attempt has been made to detect a pitch frequency of the voice signals and remove only a frequency domain of the pitch. However, since it is difficult to detect the pitch of the voice signals due to the influence of the music signals, this approach is not very reliable.
The present invention provides an apparatus for separating voice signals and music signals from a mixture of voice and music signals during a short convergence time by using an independent component analysis method for a two-dimensional forward network. The apparatus estimates a signal mixing process according to a difference in recording positions of sensors.
The present invention provides a method of separating voice signals and music signals from a mixture of voice and music signals during a short convergence time by using an independent component analysis algorithm for a two-dimensional forward network. The method estimates a signal mixing process according to a difference in recording positions of sensors.
According to an aspect of the present invention, there is provided an apparatus for separating music and voice from a mixture comprising an independent component analyzer, a music signal selector, a filter, and a multiplexer.
The independent component analyzer receives a first filtered signal and a second filtered signal comprising of music and voice components, and outputs a current first coefficient, a current second coefficient, a current third coefficient, and a current fourth coefficient, which are determined using an independent component analysis method.
The music signal selector outputs a multiplexer control signal in response to a most significant bit of the second coefficient and a most significant bit of the third coefficient.
The filter which receives an R channel signal and an L channel signal representing audible signals, and outputs a first filtered signal and a second filtered signal.
The multiplexer selectively outputs the first filtered signal or the second filtered signal in response to a logic state of the multiplexer control signal.
The filter may further include a first multiplier which multiplies the R channel signal by the first coefficient and outputs a first product signal; a second multiplier which multiplies the R channel signal by the second coefficient and outputs a first product signal; a third multiplier which multiplies the L channel signal by the third coefficient and outputs a third product signal; a fourth multiplier which multiplies the L channel signal by the fourth coefficient and outputs a fourth product signal; a first adder which adds the first product signal and the third product signal to determine the first filtered signal; and a second adder which adds the second product signal and the fourth product signal to determine the second filtered signal.
The independent component analyzer may calculate the current first coefficient, the current second coefficient, the current third coefficient, and the current fourth coefficient from the following equation,:
Wn=Wn-1+(I−2 tan h(u)uT)Wn-1,
The current first coefficient, the current second coefficient, the current third coefficient, and the current fourth coefficient are respectively Wn11, Wn21, Wn12, and Wn22, the previous first coefficient, the previous second coefficient, the previous third coefficient, and the previous fourth coefficient are respectively Wn-111, Wn-121, Wn-112, and Wn-122, and the first filtered signal and the second filtered signal are respectively u1 and u2.
The R channel signal and the L channel signal may be exchangeable without distinction.
The R channel signal and the L channel signal may be 2-channel stereo digital signals output from an audio system including a CD player, a DVD player, an audio cassette tape player, or an FM audio broadcasting receiver.
According to another aspect of the present invention, there is provided a method of separating music and voice, comprising: (a) receiving at an independent component analyzer a first filtered signal and a second filtered signal comprising of music and voice components and outputting a current first coefficient, a current second coefficient, a current third coefficient, and a current fourth coefficient; (b) generating a multiplexer control signal in response to a most significant bit of the second coefficient and a most significant bit of the third coefficient; (c) receiving an R channel signal and an L channel signal representing audible signals, and outputting the first filtered signal and the second filtered signal; and (d) selectively outputting the first filtered signal or the second filtered signal in response to a logic state of the multiplexer control signal.
The step (c) may further include: (i) generating a first product signal by multiplying the R channel signal by the current first coefficient; (ii) generating a second product signal by multiplying the R channel signal by the current second coefficient; (iii) generating a third product signal by multiplying the L channel signal by the current third coefficient; (iv) generating a fourth product signal by multiplying the L channel signal by the current fourth coefficient; (v) generating the first filtered signal by adding the first product signal and the third product signal; and (vi) generating the second filtered signal by adding the second product signal and the fourth product signal.
The independent component analyzer may calculate the current first coefficient, the current second coefficient, the current third coefficient, and the current fourth coefficient from the following equation:
Wn=Wn-1+(I−2 tan h(u)uT)Wn-1,
wherein Wn is a 2×2 matrix composed of the current first coefficient, the current second coefficient, the current third coefficient, and the current fourth coefficient, Wn-1 is a 2×2 matrix composed of a previous first coefficient, a previous second coefficient, a previous third coefficient, and a previous fourth coefficient, I is a 2×2 unit matrix, u is a 2×1 column matrix composed of the first filtered signal and the second filtered signal, and uT is a row matrix, wherein uT is the transpose of the column matrix u.
The current first coefficient, the current second coefficient, the current third coefficient, and the current fourth coefficient are respectively Wn11, Wn21, Wn12, and Wn22, the previous first coefficient, the previous second coefficient, the previous third coefficient, and the previous fourth coefficient are respectively Wn-111, Wn-121, Wn-112, and Wn-122, and the first filtered signal and the second filtered signal are respectively u1 and u2.
The R channel signal and the L channel signal may be exchangeable without distinction.
The R channel signal and the L channel signal may be 2-channel stereo digital signals output from an audio system including a CD player, a DVD player, an audio cassette tape player, or an FM audio broadcasting receiver.
Preferred embodiments of the invention can be understood in more detail from the following descriptions taken in conjunction with the accompanying drawings in which:
Preferred embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. The invention may, however, be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Referring to
The independent component analyzer 110 receives a first output signal MAS1 and a second output signal MAS2, each of which are composed of a music signal and a voice signal. The independent component analyzer 110 outputs a current coefficient Wn11, a current second coefficient Wn21, a current third coefficient Wn12, and a current fourth coefficient Wn22. The current coefficients are calculated using an independent component analysis method. The subscript n represents a current iteration of the independent component analysis method.
As explained in greater detail below, the independent component method separates a mixed acoustic signal into a separate voice signal and music signal. The independence between the voice signal and music signal is maximized. That is, the voice signal and music signal are restored to their original state prior to being mixed. The mixed acoustic signal may be obtained, for example, from one or more sensors.
The music signal selector 120 outputs a multiplexer control signal, which has a first logic state (e.g., a low logic state) and a second logic state (e.g., a high logic state). The first logic state is output in response to a second logic state of the most significant bit of the second coefficient Wn21. The second logic state is output in response to a second logic state of the most significant bit of the third coefficient Wn12. The most significant bits of the second coefficient Wn21 and the third coefficient Wn12 have signs representing negative values or positive values. When the most significant bits are in a second logic state, the second coefficient Wn21 and the third coefficient Wn12 have negative values. Here, when the second coefficient Wn21 is negative value, the second output signal MAS2 is an estimated music signal. Also, when the third coefficient Wn21 is negative value, the first output signal MAS1 is an estimated music signal.
The filter 130 receives an R channel signal RAS and an L channel signal LAS, each of which represent audible signals. A first multiplier 131 multiplies the R channel signal RAS by the current first coefficient Wn11 and outputs a first multiplication result. A third multiplier 135 multiplies the L channel signal LAS by the current third coefficient Wn12 and outputs a third multiplication result. The first multiplication result and the third multiplication result are added by a first adder 138 to produce the first output signal MAS1.
A second multiplier 133 multiplies the R channel signal RAS by the current second coefficient Wn21 and outputs a second multiplication result. A fourth multiplier 137 multiplies the L channel signal LAS by the current fourth coefficient Wn22 and outputs a fourth multiplication result. The second multiplication result and the fourth multiplication result are added by a second adder 139 to produce the second output signal MAS2.
The R channel signal RAS and the L channel signal LAS may be 2-channel digital signals output from an audio system such as a compact disc (CD) player, a digital video disc (DVD) player, an audio cassette tape player, or an FM receiver. The same output may result if the values of the R channel signal RAS and the L channel signal LAS are exchanged. That is, the R channel signal RAS and the L channel signal LAS may be exchangeable without consequence.
The multiplexer 140 outputs the first output signal MAS1 or the second output signal MAS2 in response to a logic state of the multiplexer control signal. For example, when the second coefficient Wn21 is negative value, the multiplexer control signal has the first logic state and the multiplexer 140 outputs the second output signal MAS2. Also, when the third coefficient Wn12 is negative value, the multiplexer control signal has the second logic state and the multiplexer 140 outputs the first output signal MAS1. Since the first output signal MAS1 or the second output signal MAS2 output from the multiplexer 140 is an estimated music signal without a voice signal (i.e., a song accompaniment), a user can listen to the song accompaniment through a speaker, for example.
Referring to
The independent component analysis method 200 of
Wn=Wn-1+(I−2 tan h(u)uT)Wn-1, (1)
Wn21, is a 2×2 matrix composed of the current four coefficients (i.e., Wn11, Wn21, Wn12, and Wn22), W−1 is a 2×2 matrix composed of previous four coefficients (i.e., Wn-111, Wn-121, Wn-112, and Wn-122), I is a 2×2 unit matrix, u 2×1 column matrix composed of the output signals, and uT is a row matrix, which is the transpose of the column matrix u.
In equation (1), when Wn is represented as a 2×2 matrix having the current four coefficients Wn11, Wn21, Wn12, and Wn22, expression (2) below is established. Similarly, in equation (1), when Wn-1 is represented as a 2×2 matrix having the previous four coefficients Wn-111, Wn-1121, Wn-112, and Wn-122, expression (3) below is established. Since I is a 2×2 unit matrix, expression (4) below is established. Since u is a 2×1 column matrix composed of the two output signals MAS1 and MAS2, equation (5) below is established. Since UT is a row matrix, which is the transpose of the column matrix u, equation (6) below is established. According to expression (2) and equation (5), the current first coefficient Wn11, the current second coefficient Wn21, the current third coefficient Wn12, and the current fourth coefficient Wn22 are elements constituting the matrix Wn. The first output signal MAS1 and the second output signal MAS2 are respectively u1 and u2 constituting the matrix u.
The independent component analyzer 110 of
Next, the independent component analyzer 110 of
The independent component analysis method 200 of
As described above, the apparatus 100 of
The apparatus 100 of
Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the present invention Is not limited to those precise embodiments, and that various other changes and modifications may be affected therein by one of ordinary skill in the related art without departing from the scope or spirit of the invention. All such changes and modifications are intended to be included within the scope of the invention as defined by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2003-0035304 | Jun 2003 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
3204034 | Ballard et al. | Aug 1965 | A |
4587620 | Niimi et al. | May 1986 | A |
5210366 | Sykes, Jr. | May 1993 | A |
5340317 | Freeman | Aug 1994 | A |
5353376 | Oh et al. | Oct 1994 | A |
5377302 | Tsiang | Dec 1994 | A |
5649234 | Klappert et al. | Jul 1997 | A |
5898119 | Tseng et al. | Apr 1999 | A |
5953380 | Ikeda | Sep 1999 | A |
6038535 | Campbell | Mar 2000 | A |
6081784 | Tsutsui | Jun 2000 | A |
6144937 | Ali | Nov 2000 | A |
6248944 | Ito | Jun 2001 | B1 |
6931377 | Seya | Aug 2005 | B1 |
6985858 | Frey et al. | Jan 2006 | B1 |
20010034601 | Chujo et al. | Oct 2001 | A1 |
20020038211 | Rajan | Mar 2002 | A1 |
20020101981 | Sugiyama | Aug 2002 | A1 |
20030097261 | Jeon et al. | May 2003 | A1 |
20040218492 | Sako | Nov 2004 | A1 |
Number | Date | Country |
---|---|---|
0132888 | Dec 1997 | KR |
040565 | Aug 1998 | KR |
Number | Date | Country | |
---|---|---|---|
20050056140 A1 | Mar 2005 | US |