This application claims the benefit of Korean Patent Application No. 10-2007-0021150, filed on May 2, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
1. Field of the Invention
The present general inventive concept relates to a multi-channel speaker system, and more particularly, to a method and an apparatus to reproduce a multi-channel audio signal that performs mixing of a signal of a center channel to left and right channels in a home theater system.
2. Description of the Related Art
Recently, home theater systems have been developed and launched. Home theater systems reproduce video and audio that are recorded in various recording media such as DVDs, HDDs, tapes or the like and output the video reproduced from the recording media onto wide screen televisions.
In addition, home theater systems separate and output audio channels of audio reproduced from recording media, for example, multi-channel audio of 5.1 channel surround sound that is reproduced from DVD through six speakers that are separated and equipped at different locations.
In addition, home theater systems simply perform mixing of audio signals of left and right channels and output the audio signals of the left and right channels as an audio signal of a center channel.
However, in home theater systems, speech cannot sometimes be clearly conveyed to a listener due to the volume of the center channel, locations of speakers, a difference in speaker units or the like.
When two sounds having the same frequency and sound pressure are simultaneously reproduced through two speakers in a conventional stereo system, the two sounds sound like a sound generated from the front center with respect to human ears. Likewise, when a sound image is positioned in the front center of speakers, it is said that ‘a sound image is localized. The localization of the sound image is determined according to level, phase and time differences between each of the left and right speakers and a listener. When the same sounds are heard in different directions after a certain interval, a last sound is masked by a first sound. Accordingly, the listener can hear in a direction of a sound source of the first sound. This phenomenon is known as a “precedence effect,” “Haas effect” or “first front wave law.”
Referring to
Accordingly, when a listener is closer to one speaker than other speakers, a center sound, on which mixing is performed, may be heard from only one speaker, which is closest to a listener, using a conventional mixing manner of a center sound.
The present general inventive concept provides a method and apparatus to reproduce a multi-channel audio signal on which mixing is performed with respect to left and right channels by reflecting a time delay according to a location of a speaker with respect to a signal of a center channel in a home theater system.
The present general inventive concept also provides a multi-channel speaker system in which a method and an apparatus for reproducing multi-channel audio signals.
Additional aspects and utilities of the present general inventive concept will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the general inventive concept.
The foregoing and/or other aspects and utilities of the present general inventive concept may be achieved by providing a method of reproducing a multi-channel audio signal including calculating a delay value of a center channel signal according to location relationships of a listener, a center channel speaker and other channel speakers, regulating a time delay of the center channel signal according to the calculated delay value, and mixing the time-delay regulated center channel signal with other channel signals.
The foregoing and/or other aspects and utilities of the present general inventive concept may also be achieved by providing an apparatus to reproduce a multi-channel audio signal, the apparatus including a delay unit to time-delay a signal of a center channel according to a delay value of the center channel, which is calculated according to location relationships of a listener, a center channel speaker and other channel speakers, a mixing gain unit to regulate a gain of a center channel signal by providing a gain value, which is already set, to the time-delayed center channel signal, and a mixing unit to mix the signal of the center channel, on which the time delay is performed and a gain is regulated, with signals of other channels.
These and/or other aspects and utilities of the present general inventive concept will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present general inventive concept by referring to the figures.
Referring to
At this time, mixing is performed between an audio signal of the center channel C and audio signals of the left channel L and the right channel R. In addition, mixing is performed between the audio signal of the center channel C and audio signals of the left surround channel SL and the right surround channel SR.
Referring to
The decoder 310 separates N channel audio bit streams input from a signal reproducer into audio signals having N channels (e.g. a left channel L, a right channel R, a center channel C, a left surround channel SL and a right surround channel SR).
The controlling unit 320 recognizes locations of the listener and a speaker of each channel, and calculates a delay value of a signal of the center channel C according to location relations of the listener, a center channel speaker and another channel speaker. Since methods of recognizing a location are well known to one of ordinary skill in the art, the embodiments herein are not limited to a specific method. As an example, the locations of the listener and the speaker can be recognized by using a camera or an ultrasonic sensor. The delay value is calculated using a processing method including calculating a signal delay and a signal sound pressure level difference between a center channel speaker and another channel speaker, calculating a distance for which a sound image of a center channel is moved from the center of the two speakers, setting a threshold from a sound pressure level difference between two channel speakers, and converting a distance between a listener and each of two speakers into the delay value within the threshold. At this time, the delay value is a parameter that can localize a signal of a center channel to the location of the center speaker irrespective of a change in the listener's location.
The mixing processing unit 330 regulates a time delay of the center channel signal separated by the decoder 310 according to the delay value calculated by the controlling unit 320, and performs mixing the signal of the center channel with the signals of another channel separated by the decoder 310 by providing a mixing gain value that is already set to the center channel of which a time delay is regulated.
Referring to
A first delay unit 421 reflects a delay value D1 according to the locations of speakers in order to delay the center channel C signal for a predetermined period of time.
A first mixing gain unit 441 provides a fixed gain value C1 to the center channel C signal that is delayed in the first delay unit 421 in order to perform mixing between the center channel C signal and each of the left and right channel L and R signals.
A second delay unit 431 reflects a delay value D2 according to the locations of speakers to delay the center channel C signal that is delayed in the first delay unit 421 for a predetermined period of time.
A second mixing gain unit 442 provides a fixed gain value C2 to the center channel C signal that is delayed in the second delay unit 431 in order to perform mixing between the center channel C signal and each of the left and right surround channel L and R signals.
A first mixing unit 462 performs mixing between the left channel L signal output by the first gain unit 411 and the center channel C signal output by the first mixing gain unit 441.
A second mixing unit 464 performs mixing between the right channel R signal output by the third gain unit 413 and the center channel C signal output by the first mixing gain unit 441.
A third mixing unit 466 performs mixing between the left surround channel L signal output by the fourth gain unit 414 and the center channel C signal output by the second mixing gain unit 442.
A fourth mixing unit 468 performs mixing between the right surround channel R signal output by the fifth gain unit 415 and the center channel C signal output by the second mixing gain unit 442.
Referring to
Pd=15.1(1−e−0.182τd) Equation 1
For example, referring to
Referring to
First, when the listener moves towards the right from a front center position (a location of a center speaker), a sound image of the center speaker is gradually moved, as illustrated in
dR=√{square root over ((H)2+(D/2−dlistener)2)} Equation 2
dC=sqrt[(H)2+(D/2+dlistener)2] Equation 3
A distance difference ddiff is given by Equation 4 using dR and dC.
ddiff=dC−dR Equation 4
In addition, when the distance difference ddiff is converted into a time difference tdiff, the conversion is given be Equation 5. Here, vs is about 340 m/s which is the propagation velocity of a sound wave.
tdiff=ddiff/vs Equation 5
When modeling is performed with respect to the relationship between the time delay and the volume level difference in terms of equations, within a time difference of 60 ms, the relationship is given by Equation 1. A sound pressure level difference PD according to a distance ratio between the listener and each of the left and right speakers is given by Equation 6.
PD=20 log(dR/dC) Equation 6
Accordingly, a total sound pressure level difference Pt is given by Equation 7. Here, PH is a sound pressure level difference according to a level ratio of a signal.
Pt=PH+PD Equation 7
Meanwhile, a sound pressure level difference k between the left and right speakers, which is obtained using linear scale, is given by Equation 8.
k=10Pt/20 Equation 8
Referring to
The two angle θ′s between the two speakers, between which the sound image exists, can be given by Equation 9.
In
θy=180−θ′s−θx Equation 11
θz=180−(180−θy)−θ′d Equation 12
Accordingly, a distance d1, in which the sound image is moved from the center of the two speakers, is given be Equation 13.
A sound image direction θ′d that is calculated in the listener's location according to the sound pressure level difference k of the left and right speakers is given by Equation 14 with respect to the angle θ′s between the two speakers where the sound image exists.
When the sound image is moved a distance d2 according to the sound image direction θ′d with respect to the distance d1, a distance dt, which a center sound image is moved from the center of the two speakers, is given by Equation 15.
dt=d1+d2 Equation 15
If a center channel signal level, on which mixing is performed with respect to another channel signal, is the same or smaller than a signal level that is reproduced by the center channel speaker, the distance difference ddiff given by Equation 4 may be a negative enough value in order to prevent the sound image of the center speaker from moving.
Assuming that a distance difference between the two speakers is within 5 m, according to listening circumstances of a conventional home theater system, when a level of the center channel signal on which mixing is performed is smaller than a signal that is reproduced in the center speaker, the center sound can be prevented from being moved so as to have a time difference of 6 ms or more according to the Haas effect illustrated in
In addition, when the localization of the sound image, which is performed by mixing of the surround channel, the center channel and the front channel, is interpreted in the same manner, a time difference of about 5 ms is required for the surround channel with respect to the front channel. Accordingly, the delay value D2 of the second delay unit 431 illustrated in
Mixing gains C1 and C2 may be determined so that gains of the center channel signal and another channel signal do not differ greatly.
Equations 16 and 17 below are two examples of equations that are used to determine the mixing gains C1 and C2. Here, α is determined as a constant of 1 or less. When α is about 0.7, the volumes of the center channel, on which mixing is performed and the original center channel are similar. In addition, Equation 17 is an example of determining a mixing gain when the mixing gain C2 is 0. β is determined as a constant of 1 or less.
Cout=[1−α]C
Lout=[1−α]L+αC
Rout=[1−α]R+αC
SLout=[1−α]SL+αC
SRout=[1−α]SR+αC Equation 16
Cout=[1−β]C
Lout=[1−β]L+βC
Rout=[1−β]R+βC
SLout=[1−β]SL
SRout=[1−β]SR Equation 17
The embodiment herein can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
According to the embodiments as described above, tone heterogeneity due to a poor location of a center speaker and a difference in speaker units can be overcome, and articulation of a speech can be improved using a new center channel mixing method without reducing a multi-channel effect. In addition, the present general inventive concept is more effective in a common dwelling environment in which volume cannot be freely increased. The volume reproduced using the embodiments herein is the same value as the sum in terms of energy of a sound that arrives to the ears of a listener and a sound that is delayed.
Although a few embodiments of the present general inventive concept have been shown and described, it will be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the general inventive concept, the scope of which is defined in the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10-2007-0021150 | Mar 2007 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
5056149 | Broadie | Oct 1991 | A |
6865430 | Runton et al. | Mar 2005 | B1 |
7218740 | Kowaki | May 2007 | B1 |
7369666 | Tatsuta et al. | May 2008 | B2 |
7443987 | Griesinger | Oct 2008 | B2 |
7813933 | Martin | Oct 2010 | B2 |
20040062401 | Davis | Apr 2004 | A1 |
20060083383 | Crundwell et al. | Apr 2006 | A1 |
20060215853 | Hiruma et al. | Sep 2006 | A1 |
Number | Date | Country |
---|---|---|
2000-341800 | Dec 2000 | JP |
2003-061198 | Feb 2003 | JP |
2004-040577 | Feb 2004 | JP |
2006-313980 | Nov 2006 | JP |
2006-026463 | Mar 2006 | WO |
2006057131 | Jun 2006 | WO |
Entry |
---|
Office action issued in JP 2008-29249 dated Jan. 8, 2013. |
Office Action issued in KR Application No. 10-2007-0021150 dated Mar. 26, 2013. |
CN Office Action issued Apr. 20, 2011 in CN Application No. 200710168006.X. |
Number | Date | Country | |
---|---|---|---|
20080212786 A1 | Sep 2008 | US |