This application is a National Stage application under 35 U.S.C. § 371 of International Application No. PCT/JP2020/012353, having an International Filing Date of Mar. 19, 2020, which claims priority to Japanese Application Serial No. 2019-072042, filed on Apr. 4, 2019. The disclosure of the prior application is considered part of the disclosure of this application, and is incorporated in its entirety into this application.
The present invention relates to a sound image localization device, a sound image localization method, and a program, and more particularly to a sound reproduction technique having a presentment effect of generating a virtual sound source at any position instead of a main body of a speaker.
Recently, in public viewing and at home, a reproduction method has widely used in which a plurality of speakers are arranged. In addition, as video techniques such as 3D video and wide video have spread, measures have been taken to realize a sound reproduction with a higher sense of presence by generation of a virtual sound source at any position instead of a main body of a speaker.
As a sound reproduction technique that creates a virtual speaker using sound reflection, for example, Patent Literature 1 discloses a method of controlling directivity such that the sum of sound radiated from a directivity speaker and sound reflected from a reflector is maximized at any point to realize local reproduction. In addition, for example, Non-Patent Literature 1 discloses a method of reflecting sound on a ceiling due to directivity reproduction of a regular polyhedron speaker to realize upward sound image localization.
As reported from Non-Patent Literature 1, a sound image can be localized upward when a difference between sound reflected from the ceiling and direct sound from the speaker is larger than 5 dB. In order for a plurality of people to perceive that the sound image exists upward, it is necessary to control directivity of the reproduction sound in any form.
However, according to the conventional directivity control, there are problems that many control points need to be used to flexibly change the directivity and a long calculation time is required.
The present invention has been made in view of the problems, and an object thereof is to provide a sound image localization device, a sound image localization method, and a program capable of flexibly controlling directivity with a short calculation time.
As the gist, a sound image localization device according to an aspect of the present invention is a sound image localization device that reflects, on a reflector, a sound signal radiated from a speaker array arranged with a plurality of speakers on a straight line to localize a sound image, the sound image localization device including: an expansion coefficient calculation unit configured to analytically calculate expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity; a filter coefficient generation unit configured to convert the expansion coefficients into filter coefficients corresponding to each of the speakers; and a speaker drive unit configured to generate a speaker drive signal for driving each of the speakers by convolving the filter coefficients in a voice signal.
As the gist, a sound image localization method according to another aspect of the present invention is a sound image localization method to be executed by the sound image localization device that reflects, on a reflector, a sound signal radiated from a speaker array arranged with a plurality of speakers on a straight line to localize a sound image, the sound image localization method including: an expansion coefficient calculation step of analytically calculating expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity; a filter coefficient generation step of generating filter coefficients corresponding to each of the speakers from the expansion coefficients; and a speaker drive step of generating a speaker drive signal for driving each of the speakers by convolving the filter coefficients in a voice signal.
As the gist, a program according to further another aspect of the present invention is a program for causing a computer to function as the sound image localization device.
According to the present invention, it is possible to provide a sound image localization device, a sound image localization method, and a program capable of flexibly controlling directivity with a short calculation time.
Embodiments of the present invention will be described below with reference to the drawings. In the plurality of drawings, the same components are denoted by the same reference numerals, and will not be repeatedly described.
A sound image localization device 100 shown in
As shown in
The expansion coefficient calculation unit 10 analytically calculates an expansion coefficient by performing a spherical harmonic function expansion on a window function representing desired directivity. The desired directivity is given from the outside by a beam width θω (0<θω≤π).
The window function will be described by taking a cosine window (Expression (1)) as an example. An example of another window function includes a rectangular window.
(Spherical Harmonic Function)
Here, a polar coordinate system shown in
Here, Ymn(θ, ϕ) represents a spherical harmonic function, and Amn(ω) represents an expansion coefficient thereof, which can be expressed by the following expression, respectively.
Here, Pmn(•) represents an associated Legendre function, and Expression (4) is called a spherical harmonic function expansion.
When a spherical harmonic function expansion is performed in a state where a desired characteristic d(θ) modeled in Expression (1) is substituted into S(r,θ,ϕ,ω) of Expression (2) and the order m of the spherical harmonic function is set to 0, an expansion coefficient A0n corresponding to the multi-pole sound source can be obtained.
An expansion coefficient for degrees up to n=2 are shown below.
An expansion coefficient can be analytically derived for degrees after n=2 as well.
The filter coefficient generation unit 20 generates a filter coefficient corresponding to each of the speakers forming the speaker array 40 from the expansion coefficient Amn by the following expression (step S2 (
(Directivity Control Technology Using Multi-Pole Sound Source)
A method is known in which desired directivity is developed by a spherical harmonic function and the obtained expansion coefficient A0n is applied to a multi-pole sound source to form directivity (for example, Reference Literature: Yoichi HANEDA et al., “Directivity synthesis using multipole sources based on spherical harmonic function expansion”, The Journal of the Acoustical Society of Japan, 69.11, 2013, 577-588).
The multi-pole sound source is a sound source in which point sound sources having the same amplitude are distributed in anti-phases as positions as close as possible to the origin. For example, when point sound sources are arranged at minute distances d in a z-axis direction, a sound pressure distribution M0n(r,θ,ϕ,ω) of the multi-pole sound source can be expressed by the following expression.
The approximation is z=cos θ established when 1<<kr. A symbol Q represents an intensity of the point sound source. A symbol k represents a wavenumber (k=ω/c). In addition, the multi-pole sound source has directivity very similar to the spherical harmonic function, and the speaker array 40 arranged in the z-axis direction can reproduce directivity similar to the spherical harmonic function when the order m is 0.
In other words, the application to the multi-pole sound source can be expressed by the following expression.
The filter coefficient generation unit 20 generates a filter coefficient w(ω) by multiplying each expansion coefficient Amn by a corresponding weight D0n(ω) of each of the speakers when the spherical harmonic functions are reproduced by the speakers SP1 to SPQ (Expression (11)).
The weight D0n(ω) can be expressed by the following expression when the number of speakers corresponding to the spherical harmonic functions for the degrees up to n=2 is five, for example.
Here, a symbol d represents a distance between the speakers SP1 to SPQ (the above-described minute distance). In addition, a symbol k represents the wavenumber (k=ω/c), and a symbol c represents a speed of light.
The speaker drive unit convolves the filter coefficient w(ω) in the voice signal input from the outside to generate speaker drive signals for driving the speakers SP1 to SPQ, respectively. As is clear from Expression (12), the speaker drive signal for degree n=0 is input only to the speaker SP3 with A0n(¼π)0.5. The speaker drive signal for degree n=1 is input to the speakers SP2 and SP4. The speaker drive signal for degree n=2 is input to the speakers SP2, SP3, and SP4.
When such speaker drive signals are input to the speaker array 40, a sound signal corresponding to the desired directivity can be reproduced.
As described above, the sound image localization device 100 according to the embodiment is a sound image localization device that reflects, on the reflector 50, the sound signal radiated from the speaker array 40 arranged with the plurality of speakers in the straight line to localize the sound image, and includes the expansion coefficient calculation unit 10, the filter coefficient generation unit 20, and the speaker drive unit 30. The expansion coefficient calculation unit 10 performs the spherical harmonic function expansion on the window function indicating the desired directivity to analytically calculate the expansion coefficient. The filter coefficient generation unit 20 generates, from the expansion coefficient Amn, the filter coefficient w(ω) corresponding to each of the speakers SP1 to SPQ. The speaker drive unit 30 convolves the filter coefficient w(ω) in the voice signal to generate the speaker drive signals for driving the speakers SP1 to SPQ, respectively.
Thus, it is possible to provide the sound image localization device 100 that can flexibly control the directivity with a short calculation time.
(Sound Image Localization Method)
A sound image localization method executed by the sound image localization device 100 will be described below.
First, the sound image localization device 100 is set with a beam width representing desired directivity (step S1). The beam width θw (Expression (1)) is input to the expansion coefficient calculation unit 10 from the outside (step S1).
Next, the expansion coefficient calculation unit 10 performs the spherical harmonic function expansion on the window function representing the desired directivity d(θ) to analytically calculate the expansion coefficient Amn (step S2).
Next, the filter coefficient generation unit 20 generates a filter coefficient w(ω) corresponding to each of the speakers SP1 to SPQ forming the speaker array 40 from the expansion coefficient Amn (step S3). The filter coefficient generation unit 20 generates a filter coefficient w(ω) by multiplying each expansion coefficient Amn by a corresponding weight D0n(ω) of each of the speakers SP1 to SPQ when the spherical harmonic functions are reproduced by the speakers SP1 to SPQ (Expression (11)).
The speaker drive unit 30 convolves the filter coefficient w(ω) in the voice signal input from the outside to generate speaker drive signals for driving the speakers SP1 to SPQ, respectively (step S4).
As described above, the sound image localization method according to the embodiment is a sound image localization method to be executed by the sound image localization device 100 that reflects, on the reflector 50, the sound signal radiated from the speaker array 40 arranged with the plurality of speakers SP1 to SPQ on the straight line to localize the sound image. The sound image localization method according to the embodiment includes: expansion coefficient calculation step S2 of analytically calculating expansion coefficients Amn by performing a spherical harmonic function expansion on a window function representing desired directivity; filter coefficient generation step S3 of generating filter coefficients w(ω) corresponding to each of the speakers SP1 to SPQ from the expansion coefficients Amn; and speaker drive step S4 of generating a speaker drive signal for driving each of the speakers SP1 to SPQ by convolving the filter coefficients w(ω) in a voice signal. Thus, it is possible to provide the sound image localization method capable of flexibly controlling the directivity with a short calculation time.
Reference numeral 103 indicates a direct sound, reference numeral 104 indicates a reflected sound, and reference numeral 105 indicates a listening point. According to the sound image localization device 100, the listener located at the listening point 105 can perceive the upward sound image localization without using many control points.
From the directivity control by the least-squares method, a filter coefficient is obtained to minimize the sum of squares of an error between the desired directivity and the directivity observed at the control point. Accordingly, a calculation quantity increases. The directivity control by the least-squares method is well known, and thus will not be described by expressions.
Further, according to the method based on Non-Patent Literature 1, sound is reflected on the ceiling due to directivity reproduction of a regular polyhedron speaker and upward sound image localization is realized. In such a method, the directivity is formed using a normalized matched filter.
The normalized matched filter is obtained by providing a filter that matches the observed sound signal when the sound signal radiated from the speaker is observed at the observation point with the sound signal emitted by the speaker. Therefore, a transfer function to the target observation point is required for all of the speakers, resulting in an increase in calculation quantity.
In the sound image localization method according to the embodiment contrary to the comparative example, the expansion coefficient is analytically calculated by performing the spherical harmonic function expansion on the window function representing the desired directivity, and the filter coefficient corresponding to each of the speakers is generated from the expansion coefficient, thereby the calculation quantity can be reduced. In other words, it is possible to provide the sound image localization method capable of flexibly controlling the directivity with a short calculation time.
The characteristic function units of the sound image localization device 100 according to the embodiment can be realized by the computer including the ROM, the RAM, and the CPU. In such a case, the content of the function to be processed by each of the function units is described by the program. Such a program can be distributed via a recording medium such as a CD-ROM or a transmission medium such as the Internet.
It goes without saying that the present invention includes various embodiments and the like not described herein. Therefore, the technical scope of the present invention is defined only by the matters specifying the invention relating to the reasonable claims from the above description.
Number | Date | Country | Kind |
---|---|---|---|
2019-072042 | Apr 2019 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/012353 | 3/19/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/203358 | 10/8/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20140126753 | Takumai | May 2014 | A1 |
Number | Date | Country |
---|---|---|
2012008156 | Jan 2012 | JP |
2012169895 | Sep 2012 | JP |
Entry |
---|
Sakamoto et al., “Sound Localization of Beamforming-Controlled Reflected Sound from Ceiling in Presence of Direct Sound,” 144th Audio Engineering Society Convention Paper, May 23, 2018, 7 pages. |
Number | Date | Country | |
---|---|---|---|
20220157292 A1 | May 2022 | US |