Spherically steerable vector differential microphone arrays

Abstract

A spherically steerable microphone array structure is provided. The spherically steerable microphone array structure uses pressure and acoustic particle velocity signals obtained from sensors positioned co-planarly on a circular arc. The spherically steerable microphone array structure allows a calculation of all spatial partial derivatives of a sound field up to a given order. The spatial partial derivatives are used to obtain a spherical harmonic decomposition of a recorded sound field. Spherical harmonic decomposition coefficients are used in a spherically direction-invariant acoustic mode beamforming.

Description

CROSS REFERENCE TO THE RELATED APPLICATIONS

This application is the national stage entry of International Application No. PCT/TR2020/050784, filed on Aug. 28, 2020, which is based upon and claims priority to Turkish Patent Application No. 2019/13009 filed on Aug. 28, 2019, the entire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to a co-planar array of acoustic sensors and the associated processing stages which can be used to synthesize a desired directional response that can be steered in any direction on the unit sphere directionally-invariantly.

BACKGROUND

In the prior art, spherically steerable microphone arrays are either i) low-order as in the case of B-format microphones [1], or ii) have singularities in their frequency responses making it impossible to obtain a steered beam at certain frequencies as in open spherical microphone arrays [2], or iii) incorporate a scatterer to mitigate the said singularities as a result of which the microphone array interacts with the sound field being recorded as in rigid spherical microphone arrays [3].

A class of microphone arrays called differential microphone arrays (DMA) can be used to obtain any desired directivity pattern up to given order [4]. DMAs comprise multiple omnidirectional microphones whose signals are delayed and combined to obtain a fixed directivity pattern that satisfies certain constraints such as having a maximum front-back ratio or having maximum directivity [5]. While DMAs are useful in a variety of applications from speech enhancement [6] to spatial audio recording [7], some of their inherent properties limit their use in a wider domain. These are the axial or circular symmetry which limit their use in spherically isotropic sound fields, and noise amplification, specifically at low frequencies [4]. These limitations constrained DMA designs mainly to linear [5], circular [8] and planar [9] configurations. When a linear configuration is used, the resulting beam can be steered only in two directions. For a circular or planar configuration, the beam can be circularly steered. Microphone arrays that can be used in three-dimensional steered beamforming typically require a 3D constellation of microphones. Rigid spherical microphone arrays (RSMAs) that can provide an order-limited spherical harmonic decomposition of the sound field, comprise a number of microphones positioned on a rigid spherical baffle [10, 11]. RSMAs have a well-developed theory and have been used in a variety of tasks including spatial audio recording [12, 13], direction-of-arrival (DOA) estimation [14, 15], and source separation [16,17]. Development of anemometric MEMS particle velocity sensors [18] made it possible to design systems that can provide a measurement of the true acoustic particle velocity. Such sensors can also overcome low-frequency noise amplification issue that is observed in differential measurements of particle velocity that use multiple pressure sensors. Another important advantage of anemometric particle velocity sensors is that they are miniaturized, allowing smaller form-factor instrument designs.

An ideal spherically steerable microphone array should satisfy the following requirements:

• • a. Directivity pattern of the steered beam obtained using the said array should be spherically direction-invariant.
  • b. Directivity pattern of the steered beam obtained using the said array should be substantially the same for a wide range of frequencies.
  • c. The array should have a small form factor to minimize its interaction with the sound field being recorded.

SUMMARY

The present invention is related to a Spherically Steerable Vector Differential Microphone Array that meets the requirements mentioned above, eliminates the outlined disadvantages and brings about some new advantages.

The invention comprises a circular arrangement of pressure and acoustic particle velocity sensors combination of which provides a beam whose shape can be arbitrarily selected and is spherically steerable in three dimensions. The design allows extracting up to the third-order spherical harmonic decomposition of the sound field which can then be used to obtain a spherically direction-invariant steered beam.

BRIEF DESCRIPTION OF THE DRAWINGS

The figures used to better explain Spherically Steerable Vector Differential Microphone Arrays developed with this invention and their descriptions are as follows:

FIG. 1A Geometry used for calculating first- and pure second-order partial directional derivatives.

FIG. 1B Geometry used for calculating mixed-order partial directional derivatives.

FIG. 2 Positions of acoustic vector sensors on the proposed microphone array.

FIG. 3 The block diagram showing the stages of processing to obtain a steered beam.

FIG. 4 The spherical harmonic components up to n=3 obtained using the proposed VDMA structure with a monochromatic plane wave having a frequency of f=1 kHz.

FIG. 5A Maximum directivity beam obtained using VDMA steered in different directions, (θ,ϕ) for a monochromatic plane wave field with f=1 kHz, wherein (θ,ϕ) is (π/2,0).

FIG. 5B Maximum directivity beam obtained using VDMA steered in different directions, (θ,ϕ) for a monochromatic plane wave field with f=1 kHz, wherein (θ,ϕ) is (0,0).

FIG. 5C Maximum directivity beam obtained using VDMA steered in different directions, (θ,ϕ) for a monochromatic plane wave field with f=1 kHz, wherein (θ,ϕ) is (0.25π,0.3π).

FIG. 5D Maximum directivity beam obtained using VDMA steered in different directions, (θ,ϕ) for a monochromatic plane wave field with f=1 kHz, wherein (θ,ϕ) is (3π/ 4,−π/2).

FIG. 6A Maximum directivity beam obtained using VDMA steered in the +x direction for different values of kr for a monochromatic plane wave field, wherein kr=0.125.

FIG. 6B Maximum directivity beam obtained using VDMA steered in the +x direction for different values of kr for a monochromatic plane wave field, wherein kr=0.25.

FIG. 6C Maximum directivity beam obtained using VDMA steered in the +x direction for different values of kr for a monochromatic plane wave field, wherein kr=0.5.

FIG. 6D Maximum directivity beam obtained using VDMA steered in the +x direction for different values of kr for a monochromatic plane wave field, wherein kr=1.

DETAILED DESCRIPTION OF THE EMBODIMENTS

To better explain Spherically Steerable Vector Differential Microphone Arrays developed with this invention, the details are as presented below.

Modal Beamforming in the Spherical Harmonic Domain

Acoustic beamforming refers to the spatial filtering of a sound field using signals from multiple microphones, for example to increase the relative level of a signal in the presence of interferers. For a diffuse sound field, p(t), beamforming aims to obtain:p_b(t)=Γ(θ,ϕ)p(t)   (1)

where 0≤ϕ<2π and 0≤θ≤π are the azimuth and inclination angles, and Γ(θ,ϕ) is a beam pattern which can be specified according to different, application specific criteria.

The beamforming approach used in the proposed array comprises two stages (1) calculation of the spherical harmonic decomposition of the sound field (eigenbeamforming), and (2) modal beamforming which linearly combines the calculated eigenbeams to obtain a desired beam pattern in a given direction.

Eigenbeams are orthonormal beam patterns that can be used for synthesizing other beam patterns using their linear combinations. They can be compactly represented using spherical harmonic functions given as:

$\begin{array}{cc}{Y}_n^m\left(\theta ,\varphi \right)=\sqrt{\frac{\left(2n+1\right)}{4\pi }\frac{\left(n-m\right)!}{\left(n+m\right)!}}{P}_n^m\left(\cos \theta \right)e^{-\mathrm{Im}\varphi }& \left(2\right)\end{array}$

where n and m are the degree and order of the spherical harmonic function, and P_n(·) is the associated Legendre polynomial, respectively. Notice that we are using the symbol I=√{square root over (−1)} to denote the imaginary unit instead of the usual i or j in order to avoid confusion with the quaternion basis elements that are used in the following exposition.

Direction dependent part of Y_n^m(θ,ϕ) is the product of an associated Legendre polynomial and a complex exponential. Let us define this direction-dependent part as γ_n^m(θ,ϕ)=P_n^m(cos θ)e^−Imϕ. We will now show that γ_n^m(θ,ϕ) can be represented as a linear combination of trigonometric monomials.

Associated Legendre polynomials can be expressed in closed form as:

$\begin{array}{cc}{P}_n^m\left(\cos \theta \right)={\sum }_{k=m}^n\left(\begin{array}{c}n\\ k\end{array}\right)\left(\begin{array}{c}\frac{n+k-1}{2}\\ n\end{array}\right)\frac{{\left(-1\right)}^m{2}^{n}k!}{\left(k-m\right)!}{\sin }^m\theta {\cos }^{k-m}\theta & \left(3\right)\end{array}$

which is a polynomial comprising trigonometric monomials of the form sin^m θ cos^k−mθ.

Complex exponential term, e^imϕ=cos mϕ+I sin mϕ can also be expressed as a linear combination of trigonometric monomial terms such that:

$\begin{array}{cc}\cos m\varphi =\sum _{k=0}^{\lfloor m/2\rfloor }{\left(-1\right)}^k\left(\begin{array}{c}m\\ 2k\end{array}\right){\sin }^{2k}\varphi {\cos }^{m-2k}\varphi & \left(4\right)\end{array}$ $\begin{array}{cc}\sin m\varphi =\sum _{k=0}^{\lfloor \left(m-1\right)/2\rfloor }{\left(-1\right)}^k\left(\begin{array}{c}m\\ 2k+1\end{array}\right){\sin }^{2k+1}\varphi {\cos }^{m-2k-1}\varphi & \left(5\right)\end{array}$

In other words, a spherical harmonic function can be represented as a trigonometric polynomial with monomial terms of the form T_n,|m|^(l)(θ,ϕ)=(sin θ cos ϕ)^|m|−l(sin θ sin ϕ)^lcos^n−|m| θ with n≥|m|≥l≥0, such that:Y_n^m(θ,ϕ)=Σ_n,m,l(a_n,m^(l)+Ib_n,m^(l))T_n,m^(l)(θ,ϕ)   (6)

An arbitrary beam pattern Γ(θ,ϕ) can be represented as a linear combination of eigenbeams, a process also known as weight-and-sum beamforming such that:Γ(θ,ϕ)=Σ_n=0^∞Σ_m=−nⁿw_n,mY_n^m(θ,ϕ)   (7)

where w_nm∈C are modal beamforming coefficients. Selecting w_n,m=(−1)^mw_n,−m results in a real-valued, axisymmetric directivity pattern which is of particular interest in many different use cases.

In practical applications (7) is limited to a maximum order of N, typically dictated by the number of elements in a microphone array. Beamformer output given in (1) can then be represented as a combination of multiple eigenbeamformer outputs such as:p_b(t)=Σ_n=0^NΣ_m=−nⁿa_n,mp(t)Y_n^m(θ,ϕ)   (8)

In other words, in order to obtain a desired beam shape in a given direction terms in the form p(t)T_n,|m|^(l)(θ,ϕ) need to be obtained. Such terms can be obtained via spatial derivatives of the particle velocity field.

Spatial Derivatives of Particle Velocity Signals

The analysis of VDMAs is simpler in the quaternion Fourier domain. The following exposition uses the quaternion algebra and quaternion signal processing formalism [19].

A. Particle Velocity as a Pure Quaternion Signal

We define particle velocity as a pure quaternion valued time domain signal such that u(x,t)∈V() where u(x,t)=u_x(x,t)i+u_j(x,t)j+u_z(x,t)k

where i, j and k are the fundamental quaternion units such that i²=j²=k²=ijk=−1.

Particle velocity and pressure fields are related via the preservation of momentum such that:

$\begin{array}{cc}{\rho }_0\frac{\partial u\left(x,t\right)}{\partial t}=-\nabla p\left(x,t\right).& \left(9\right)\end{array}$

Defining the unit pure quaternion v∈V() as an arbitrary transform axis, (9) can be represented in the left-sided quaternion frequency domain as:ρ₀vωU^v(x,ω)=−P_∇^v(x,ω)   (10)

Let us now express the relation between the pressure and particle velocity components of a monochromatic plane wave at an arbitrary point x as:u(x,t)=(ρ₀c)⁻¹μp(x,t)   (11)

where μ∈V() is a pure unit quaternion coincident with the propagation direction of the wave. Without loss of generality, we will assume that measurements of particle velocity, normalized with respect to pressure are available, allowing us to omit the constant scaling term such that u(x,t)=p(x,t)μ.

Particle velocity at point x can be expressed in terms of the particle velocity at the origin such that:U^v(x,ω)=e^v(k,x)U₀^v(ω)   (12)

where

$k=\frac{\omega }{c}\stackrel{\_}{\mu }=\frac{\omega }{c}\left[i_{}\left(\mu \right)j_{}\left(\mu \right)k_{}\left(\mu \right)\right]$ is the wave vector and ·,· represents the inner product of two vectors. Notice that we used μ=[cos ϕ sin θ sin ϕ sin θ cos θ]∈ to represent the unit vector denoting the propagation direction of the wave, slightly abusing quaternion algebraic notation in favor of expositional clarity.

B. First-Order Spatial Derivatives

Let us consider the general case for which pure quaternion-valued particle velocity signals are measured at two different positions x₋₁ and x₁ (see FIG. 1A). The derivative of the particle velocity signals in the direction n_d=x_Δ/∥x_Δ∥=(x₁−x₋₁)/∥x₁−x₋₁∥ can be approximated at the median of these two points, x₀=(x₁+x₋₁)/2, such that:

$\begin{array}{cc}\begin{array}{c}{\frac{\partial u\left(x,t\right)}{\partial n_d}❘}_{x=x_0}\approx \Delta u\left(x_0,t❘x_1,x_{-1}\right)\\ ={x_{\Delta }}^{-1}\left[u\left(x_1,t\right)-u\left(x_{-1},t\right)\right],\end{array}& \left(13\right)\end{array}$

where u(x₁,t) and u(x₂,t) are the pure quaternion-valued acoustic particle velocity signals measured at x₁ and x₋₁, respectively. Transforming the expression using a left-sided QFT to the frequency-domain, we obtain:

$\begin{array}{cc}\begin{array}{c}{\frac{\partial U^v\left(x,\omega \right)}{\partial n_d}❘}_{x=x_0}\approx \Delta U^v\left(x,\omega ❘x_1,x_{-1}\right)\\ =\text{}{x_{\Delta }}^{-1}\left[U^v\left(x_1,\omega \right)-U^v\left(x_{-1},\omega \right)\right]\\ =2{x_{\Delta }}^{-1}{\mathrm{ve}}^{v\langle k,x_{\sigma }\rangle }\sin \langle k,x_{\Delta }\rangle U_0^v\left(\omega \right).\end{array}& \left(14\right)\end{array}$

For low frequencies or when the distance between the measurement points is small such that

$\frac{\omega }{c}x_{\Delta }\ll \frac{\pi }{2},$ the finite difference approximation above can be simplified, such that:ΔU^v(x₀,ω|x₁,x₋₁)≈2c⁻¹μ,n_dU₀^v(ω)   (15)

Notice that spatial differentiation imposes the directional weight, μ,n_d which is a trigonometric trinomial in the general case and degenerates into trigonometric monomials with an appropriate selection of the reference axis, n_d.

Representing (15) in the time domain using a left-sided inverse QFT we obtain:

$\begin{array}{cc}\Delta u\left(x_0,t❘x_1,x_{-1}\right)\approx 2c^{-1}\langle \stackrel{\_}{\mu },n_d\rangle \frac{\partial u\left(x_0,t+\langle k,x_{\sigma }\rangle \right)}{\partial t}& \left(16\right)\end{array}$

Integration in time of the directional derivative of the acoustic particle velocity results in:

$\begin{array}{cc}\begin{array}{c}{u}_{\Delta ,}\left(x_0,t\right)={\int }_{-\infty }^t\Delta u\left(x_0,\tau |x_1,x_{-1}\right)d\tau \\ \approx 2c^{-1}\mu \langle \overline{\mu },n_d\rangle p\left(x_0,t+\langle k,x_{\sigma }\rangle \right)\end{array}& \left(17\right)\end{array}$

Multiplying from the left-hand side with a pure unit quaternion η in a desired direction and obtaining the scalar part results in:

$\begin{array}{cc}S\left[u_{\Delta },\left(x_0,t\right)v\right]=-2c^{-1}\langle \stackrel{\_}{\mu },\stackrel{\_}{\eta }\rangle \langle \stackrel{\_}{\mu },n_d\rangle p\left(x_0,t+\langle k,x_{\sigma }\rangle \right)& \left(18\right)\end{array}$

which includes two directional weight terms that can be specified to obtain the desired second-order directional weight terms. If the measurement points are selected to be symmetric with respect to the origin such that x=x₁=−x₂, then x₀=0 and the time delay in (18) disappears. Selecting the measurement points such that n_d is coincident with the x or the y axes and also selecting η to be coincident with either one of these principal axes all second-degree terms can be obtained. For example, selecting n_d=[1,0,0] (i.e. sensors are aligned with the x-axis) and η=j (i.e. η =[0,1,0]) yields the second-degree trigonometric monomial, T_2,2⁽¹⁾(θ,ϕ)=sin² θ cos ϕ sin ϕ as a directional weight.

C. Second-Order Derivatives

The process used to obtain second-order terms can be extended to third and higher-order trigonometric monomials by an appropriate selection of measurement points. Only the method to obtain the third-degree terms is shown here for conciseness.

1) Pure Second-Order Derivatives:

Let us select three collinear measurement points x₋₁, x₀, and x₁ such that x₁−x₀=x₀−x₋₁, and define two median points x_σ,−1=(x₀+x₋₁)/2 and x_σ,1=(x₀+x₁)/2 (see FIG. 1A). The finite difference approximation to the second-order directional derivative is given in the frequency-domain as:

$\begin{array}{cc}\begin{array}{c}{\Delta }^2{U}^v\left(x_0,\omega |x_{{\sigma }_1},x_{{\sigma }_2}\right)=\frac{\Delta U^v\left(x_{{\sigma }_1},\omega \right)-\Delta U^v\left(x_{\sigma -1},\omega \right)}{x_{{\sigma }_1}-x_{{\sigma }_{-1}}}\\ \approx 4c^{-2}{\omega }^2{e}^{v\langle k,x_0\rangle }{\langle \stackrel{\_}{\mu },n_d\rangle }^2{U}_0\left(\omega \right).\end{array}& \left(19\right)\end{array}$

Representing (19) in the time domain, we obtain:

$\begin{array}{cc}{\Delta }^{2}u\left(x_0,t|x_{{\sigma }_1},x_{{\sigma }_2}\right)\approx 4c^{-2}{\langle \overline{\mu },n_d\rangle }^2\frac{{\partial }^{2}u\left(x_0,t+\langle k,x_0\rangle \right)}{\partial t^2}& \left(20\right)\end{array}$

This expression needs to be integrated twice in time to obtain a third-degree directional term:

$\begin{array}{cc}\begin{array}{c}{u}_{{\Delta }^2},\left(x_{\sigma },t\right)={\int }_{-\infty }^t{\int }_{-\infty }^t{\Delta }^{2}u\left(x_{\sigma },\tau |x_{{\sigma }_1},x_{{\sigma }_2}\right)d\tau \mathrm{dk}\\ \approx 4c^{-2}\mu {\langle \stackrel{\_}{\mu },n_d\rangle }^{2}p\left(x_0,t-\langle k,x_0\rangle \right)\end{array}& \left(21\right)\end{array}$

which can be left-multiplied by a pure unit quaternion η in a desired direction to obtain a directionally weighted, quaternion-valued signal whose scalar part contains a third-degree trigonometric monomial as a directional term, such that:

$\begin{array}{cc}S\left[u_{{\Delta }^2},\left(x_0,t\right)\eta \right]=-4c^{-2}\langle \stackrel{\_}{\mu },\stackrel{\_}{\eta }\rangle {\langle \stackrel{\_}{\mu },n_d\rangle }^{2}p\left(x_0,t-\langle k,x_0\rangle \right)& \left(22\right)\end{array}$

As with the first-order derivatives, all third-degree trigonometric monomials can be obtained this way. For example, selecting n_d=[0,1,0] and η=k (i.e. η=[0,0,1]) yields the third-degree trigonometric monomial T_3,2⁽²⁾(θ,ϕ)=sin² θ cos θ sin² ϕ as a directional weight.

2) Mixed Second-Order Derivatives:

Let us select four particle velocity measurement points, x_1,1, x_−1,1, x_−1,−1, and x_1,−1 on the vertices of a square with a side length of d (see FIG. 1B) and define their mid-point as x₀=¼Σ_q,r∈−1,1x_q,r. Let us also define two orthogonal axes n_d,1=(x_1,1−x_1,−1)/d and n_d,2=(x_1,1−x_−1,1)/d be calculated using different partial derivatives. More specificallyu_Δ2,(x₀,t)=∫_−∞^t∫_−∞^tΔ²u(x₀,τ|x_{94 1},x_σ2)dτdκ  (23)

whereΔ²u(x₀,τ|x_σ1,x_σ2)=d⁻¹[Δu(x_σ1,t|x_1,1,x_1,−1)−Δu(x_σ2, t|x_−1,1,x_−1,−1)]  (24)

The second-order mixed partial derivatives in the two orthogonal directions n_d,₁ and n _d,2 can then be used to obtain third-order terms such that:

$\begin{array}{cc}S\left[u_{{\Delta }^2},\left(x_0,t\right)\eta \right]=-4c^{-2}\langle \stackrel{\_}{\mu },n_{d,1}\rangle \langle \stackrel{\_}{\mu },n_{d,2}\rangle \langle \stackrel{\_}{\mu },\stackrel{\_}{\eta }\rangle p\left(x_0,t-\langle k,x_0\rangle \right)& \left(25\right)\end{array}$

Selecting n_d,1=[1,0,0], n_d,2 =[0,1,0] and η=k yields the third-degree directional term sin² θ cos θ sin ϕ cos ϕ.

IV. Vector Differential Microphone Arrays

The microphone array disclosed herein comprises five triaxial and four uniaxial acoustic particle velocity sensors and one pressure sensor. In the discussion that follows, we will assume that x₀ at which the spatial derivatives are calculated coincides with the problem origin, the array elements are coplanar in the horizontal plane and the reference axes are given and measurement points are labelled as in FIG. 2 which shows the preferred embodiment. This array allows a 3rd-degree spherical harmonic decomposition of a sound field. FIG. 3 shows the block diagram of the processing stages involved.

The quaternion valued time-domain signals are obtained from the sensors comprising the array after sampling and quantization steps as:u(n)=s(n)   (26)

Here, the sensor signal vector is given as s(n)=[p(n),u_e,x(n), . . . ,u_sw,z(n)]^T and the 10×20 quaternion casting matrix is given as:

$\begin{array}{cc}=\left[\begin{array}{ccc}1& 0& 0\\ 0& I_{5\times 5}\otimes \left[i,j,k\right]& 0\\ 0& 0& I_{4\times 4}\otimes k\end{array}\right]& \left(27\right)\end{array}$

where ⊗ represents the Kronecker product. Notice that quaternion casting is not shown in FIG. 3 for purposes of clarity where the acquired signals are already assumed to be quaternion valued. Similarly, while the derivations presented in the following are in the frequency domain, a time-domain implementation is trivial to obtain.

Obtaining the elementwise quaternion Fourier transforms of u(n) results in the the array manifold vector given as:(ω)=[P₀,U₀,U_e,U_w,U_n,U_s,U_ne,U_se,U_nw,U_sw]^T.

Note that the frequency dependence of individual terms are also omitted for clarity.

In order to express the output of the proposed array in a form similar to that of a conventional acoustic mode beamformer, let us define several quaternion and scalar valued vectors and matrices. The 7×1 spatial difference vector, (ω) expressed as:(ω)=W(ω)D(ω)   (28)

where the finite difference matrix is given as:

$D=\left[\begin{array}{cccccccccc}1& 0& 0& 0& 0& 0& 0& 0& 0& 0\\ 0& 1& 0& 0& 0& 0& 0& 0& 0& 0\\ 0& 0& \frac{1}{2r}& \frac{-1}{2r}& 0& 0& 0& 0& 0& 0\\ 0& 0& 0& 0& \frac{1}{2r}& \frac{-1}{2r}& 0& 0& 0& 0\\ 0& \frac{-2}{r^2}& \frac{1}{r^2}& \frac{1}{r^2}& 0& 0& 0& 0& 0& 0\\ 0& \frac{-2}{r^2}& 0& 0& \frac{1}{r^2}& \frac{1}{r^2}& 0& 0& 0& 0\\ 0& 0& 0& 0& 0& 0& \frac{1}{2r^2}& \frac{-1}{2r^2}& \frac{-1}{2r^2}& \frac{1}{2r^2}\end{array}\right],$

and the integration matrix is expressed as:

$W\left(\omega \right)=\mathrm{diag}\left\{1,1,-\frac{c}{2v\omega },-\frac{c}{2v\omega },\frac{c^2}{4{\omega }^2},\frac{c^2}{4{\omega }^2},\frac{c^2}{4{\omega }^2}\right\}.$

where v is an arbitrary transform axis. The spherical harmonic decomposition of the sound field can then be synthesized as:P_nm(ω)=S[(ω)]  (²⁹)

where is the eigenmode combination matrix given as:

$=\left[\begin{array}{ccccccc}1& 0& 0& 0& 0& 0& 0\\ 0& i-\mathrm{Ij}& 0& 0& 0& 0& 0\\ 0& k& 0& 0& 0& 0& 0\\ 0& i+\mathrm{Ij}& 0& 0& 0& 0& 0\\ 0& 0& i-\mathrm{Ij}& -\left(j+\mathrm{Ii}\right)& 0& 0& 0\\ 0& 0& k& -\mathrm{Ik}& 0& 0& 0\\ 2& 0& 3i& 3j& 0& 0& 0\\ 0& 0& k& \mathrm{Ik}& 0& 0& 0\\ 0& 0& i+\mathrm{Ij}& -\left(j-\mathrm{Ii}\right)& 0& 0& 0\\ 0& 0& 0& 0& i-3\mathrm{Ij}& -3i-\mathrm{Ij}& 0\\ 0& 0& 0& 0& -k& k& -2\mathrm{Ik}\\ 0& 4\left(i-\mathrm{Ij}\right)& 0& 0& -5\left(i+\mathrm{Ij}\right)& -5\left(i+\mathrm{Ij}\right)& 0\\ 0& 2k& 0& 0& -5k& -5k& 0\\ 0& 4\left(i+\mathrm{Ij}\right)& 0& 0& -5\left(i-\mathrm{Ij}\right)& -5\left(i-\mathrm{Ij}\right)& 0\\ 0& 0& 0& 0& -k& k& 2\mathrm{Ik}\\ 0& 0& 0& 0& i+3\mathrm{Ij}& -3i+\mathrm{Ij}& 0\end{array}\right],$

and is the diagonal modal weight matrix that comprises modal weights used in equalizing the eigenmodes, such that:

$=\mathrm{diag}\left\{{\left[-\mathrm{sgn}\left(m\right)\right]}^m\sqrt{\frac{2n+1}{4\pi }\frac{\left(n-❘m❘\right)!}{\left(n+❘m❘\right)!}}\right\}$

where n=0, . . . , N and m=−n, . . . , n. Note that this selection of combination matrix is not unique and neither is it optimized for a specific purpose such as improving robustness of the proposed array to noise. Notice also that the elements of the eigenmode composition matrix are biquaternions (i.e. quaternions whose coefficients are complex).

Once the spherical harmonic decomposition coefficient vector is obtained, a beam with the desired characteristics can be formed by the appropriate selection of a beamforming vector, b such that:Y(ω)=S[b^TP_nm(ω)]  (30)

For example, selecting the beamforming vector as:b=[Y₀⁰(Ω_S)*Y₁⁻¹(Ω_S)* . . . Y₃³(Ω_S)*]^T

would yield a maximum directivity factor (maxDF) beamform steered in the direction Ω_S=(θ_s,ϕ_s) [20]. Notice that not only the maxDF beam but also all other axisymmetric and non-axisymmetric directivity patterns up to N=3 can be obtained this way.

The present invention provides a microphone array comprising P pressure sensors, wherein P is greater than or equal to 1 and Q uniaxial, biaxial or triaxial acoustic particle velocity sensors, wherein Q is greater than or equal to 3, wherein one pressure sensor and one triaxial acoustic particle velocity sensor are positioned at the center of a circular arc and the remaining sensors arranged over the circular arc that subtends an angle φ, wherein φ is less than or equal to 2π; wherein individual signals registered by the sensors are substantially captured, sampled and quantized synchronously;

wherein approximations of all possible second-order and third-order partial spatial derivatives of the sound field at the center of the circular arc are calculated by elementary algebraic operations and frequency-dependent filtering of the signals captured by the individual sensors.

Also, coefficients of a spherical harmonic decomposition of a captured sound field are obtained by linearly combining the second-order and higher-order partial spatial derivatives, where a desired directional response is obtained by linearly combining the spherical harmonic decomposition coefficients.

In another embodiment of the invention, particle velocity signals are obtained by processing signals captured using two or more pressure sensors or the particle velocity signals are obtained by processing signals captured using two or more directional microphones

The present invention also provides a microphone array wherein coefficients of a spherical harmonic decomposition of a captured sound field are obtained by linearly combining the second-order and higher-order partial spatial derivatives and desired directional response is obtained by linearly combining the spherical harmonic decomposition coefficients comprising five triaxial and four uniaxial acoustic particle velocity sensors and one pressure sensor arranged on a circle, wherein one pressure sensor and one triaxial acoustic particle velocity sensor are positioned at the center of the circle, in alignment with the local principal axes of the circle and the remaining sensors are arranged in such a way that each of the sensors on the circle is separated by ϕ=π/4 from the others,

wherein four of the triaxial particle velocity sensors whose local axes are aligned with the principal axes of the circle are positioned at ϕ₁=0, ϕ₂=π/2, ϕ₃=3π/2, and ϕ6hd 4₄=π with respect to the local x-axis of the microphone array;

wherein four uniaxial particle velocity sensors that are aligned with the z-axis of the microphone array are positioned at ϕ₅=π/4, ϕ₆=3π/4, ϕ₇=5π/4, and ϕ₈=7π/4 with respect to the local x-axis of the microphone array,

wherein the sampled and quantized signals obtained from each of the sensors are expressed as quaternion valued signals;

wherein spatial derivatives of the captured sound field are calculated by linear combinations of two or more of the said quaternion valued signals resulting in quaternion valued spatial derivative signals;

wherein spherical harmonic coefficients are obtained as a weighted sum of the said quaternion valued spatial derivative signals;

wherein a spherically steerable directivity pattern is obtained by a weighted sum of the spherical harmonic coefficients.

V. NUMERICAL EXAMPLES

We provide two sets of numerical examples. We will first demonstrate the synthesis of spherical harmonic functions using signals from the proposed array. We will then show the synthesis of maximum directivity factor beam using the approach described above.

A. Spherical Harmonic Components The proposed array structure allows the synthesis of spherical harmonic components up to third order. FIG. 4 shows the spherical harmonics that can be obtained using the proposed VDMA for an array radius of r=2 cm and for a monochromatic sound field with f=1 kHz. The array coordinates are aligned with the problem coordinates. Notice the scale difference between different directivity plots that is due to normalization of different components differently.

B. Maximum Directivity Factor Beamforming

Maximum directivity factor (MaxDF) beam provides the narrowest possible beam width for a given order and is used widely with spherical microphone arrays in DOA estimation methods such as steered response power (SRP) [21], hierarchical grid refinement (HiGRID) [14], and residual energy test (RENT) [22]. VDMAs, by virtue of the fact that they can provide the spherical harmonic decomposition of the sound field, can be used to obtain a frequency and rotation invariant maxDF beam that can be spherically steered. FIGS. 5A-5D show a third order maxDF beam steered in four different directions. Notice that the beam shape is invariant of the steering direction.

An important side effect of using a finite difference approximation is frequency dependence. More specifically, the small angle approximation given in Eqn. (13) ceases to hold when the wavelength is smaller than the array radius. This limits the useful range of frequencies and/or orders that VDMA can be used for. This effect is shown in FIGS. 6A-6D for different values of kr with r=2 cm for a maxDF beam steered in the +x direction. It may be observed that the beam shape starts to deteriorate for kr≥1. However, the beam shape is substantially the same for lower values of kr.

REFERENCES

[1] Craven, P. G., & Gerzon, M. A. (1977). U.S. Pat. No. 4,042,779. Washington, DC: U.S. Patent and Trademark Office.

[2] Rafaely, B., 2011. Bessel nulls recovery in spherical microphone arrays for time-limited signals. IEEE transactions on audio, speech, and language processing, 19(8), pp.2430-2438.

[3] Yu, G., Xie, B. S., & Liu, Y. (2012, October). Analysis on multiple scattering between the rigid-spherical microphone array and nearby surface in sound field recording. In Audio Engineering Society Convention 133. Audio Engineering Society.

[4] Elko, G. W. (2004). Differential microphone arrays. In Audio signal processing for next-generation multimedia communication systems (pp. 11-65). Springer, Boston, Mass.

[5] De Sena, E., Hacihabiboglu, H., & Cvetkovic, Z. (2011). On the design and implementation of higher order differential microphones. IEEE Transactions on Audio, Speech, and Language Processing, 20(1), 162-174.

[6] Song, H., & Liu, J. (2008, July). First-order differential microphone array for robust speech enhancement. In 2008 International Conference on Audio, Language and Image Processing (pp. 1461-1466). IEEE.

[7] De Sena, E., Hacihabiboğlu, H., & Cvetković, Z. (2013). Analysis and design of multichannel systems for perceptual sound field reconstruction. IEEE transactions on audio, speech, and language processing, 21(8), 1653-1665.

[8] Benesty, J., Chen, J., & Cohen, I. (2015). Design of Circular Differential Microphone Arrays (Vol. 12). Switzerland: Springer.

[9] Huang, G., Chen, J., & Benesty, J. (2019). Design of planar differential microphone arrays with fractional orders. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 28, 116-130.

[10] Meyer, J., & Elko, G. (2002, May). A highly scalable spherical microphone array based on an orthonormal decomposition of the soundfield. In 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing (Vol. 2, pp. II-1781). IEEE.

[11] Rafaely, B. (2015). Fundamentals of spherical array processing (Vol. 8, pp. 45-47). Berlin: Springer.

[12] Moreau, S., Daniel, J., & Bertet, S. (2006, May). 3D sound field recording with higher order ambisonics—Objective measurements and validation of a 4th order spherical microphone. In 120th Convention of the AES (pp. 20-23).

[13] Erdem, E., De Sena, E., Hacihabiboğlu, H., & Cvetković, Z. (2019, May). Perceptual Soundfield Reconstruction in Three Dimensions via Sound Field Extrapolation. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 8023-8027). IEEE.

[14] Çöteli, M. B., Olgun, 0., & Hacihabiboğlu, H. (2018). Multiple sound source localization with steered response power density and hierarchical grid refinement. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26(11), 2215-2229.

[15] Tervo, S., & Politis, A. (2015). Direction of arrival estimation of reflections from room impulse responses using a spherical microphone array. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 23(10), 1539-1551.

[16] Fahim, A., Samarasinghe, P. N., & Abhayapala, T. D. (2018). PSD estimation and source separation in a noisy reverberant environment using a spherical microphone array. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26(9), 1594-1607.

[17] Çöteli, M. B., & Hacihabiboğlu, H. (2018, September). Acoustic Source Separation Using Rigid Spherical Microphone Arrays Via Spatially Weighted Orthogonal Matching Pursuit. In 2018 16th International Workshop on Acoustic Signal Enhancement (IWAENC) (pp. 81-85). IEEE.

[18] Jacobsen, F., & De Bree, H. E. (2008). The microflown particle velocity sensor. In Handbook of Signal Processing in Acoustics (pp. 1283-1291). Springer, New York, N.Y.

[19] Ell, T. A., Le Bihan, N., & Sangwine, S. J. (2014). Quaternion Fourier transforms for signal and image processing. John Wiley & Sons.

[20] Sun, H., Yan, S., & Svensson, U. P. (2010, March). Space domain optimal beamforming for spherical microphone arrays. In 2010 IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 117-120). IEEE.

[21] Jarrett, D. P., Habets, E. A., & Naylor, P. A. (2017). Theory and applications of spherical microphone array processing (Vol. 9). New York: Springer.

[22] Çöteli, M. B., & Hacihabiboğlu, H. (2019, May). Multiple Sound Source Localization with Rigid Spherical Microphone Arrays via Residual Energy Test. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 790-794). IEEE.

Claims

1. A microphone array comprising: P pressure sensors, wherein P is greater than or equal to 1, andQ uniaxial, biaxial or triaxial acoustic particle velocity sensors, wherein Q is greater than or equal to 3,wherein one pressure sensor and one triaxial acoustic particle velocity sensor are positioned at a center of a circular arc and remaining sensors arranged over the circular arc subtending an angle φ, wherein φ is less than or equal to 2π;wherein individual signals registered by the Q uniaxial, biaxial or triaxial acoustic particle velocity sensors are substantially captured, sampled, and quantized synchronously;wherein approximations of all possible second-order partial spatial derivatives and third-order partial spatial derivatives of a sound field at the center of the circular arc are calculated by elementary algebraic operations and a frequency-dependent filtering of the individual signals captured by individual sensors.

2. The microphone array according to claim 1, wherein coefficients of a spherical harmonic decomposition of a captured sound field are obtained by linearly combining the second-order partial spatial derivatives and higher-order partial spatial derivatives.

3. The microphone array according to claim 2, wherein a desired directional response is obtained by linearly combining the coefficients of the spherical harmonic decomposition.

4. The microphone array according to claim 1, wherein acoustic particle velocity signals are obtained by processing signals captured using two or more pressure sensors.

5. The microphone array according to claim 1, wherein acoustic particle velocity signals are obtained by processing signals captured using two or more directional microphones.

6. The microphone array according to claim 3, comprising five triaxial acoustic particle velocity sensors and four uniaxial acoustic particle velocity sensors and the one pressure sensor arranged on a circle, wherein the one pressure sensor and the one triaxial acoustic particle velocity sensor are positioned at a center of the circle, in alignment with local principal axes of the circle and the remaining sensors are arranged in such a way that each of the remaining sensors on the circle is separated by ϕ=π/4 from each other, wherein four of the five triaxial acoustic particle velocity sensors are positioned at ϕ1=0, ϕ2=π/2, ϕ3=3π/2, and ϕ4=π with respect to a local x-axis of the microphone array, wherein local axes of the four of the five triaxial acoustic particle velocity sensors are aligned with the local principal axes of the circle;wherein the four uniaxial acoustic particle velocity sensors aligned with a z-axis of the microphone array are positioned at ϕ5=π/4, ϕ6=3π/4, ϕ7=5π/4, and ϕ8=7π/4 with respect to the local x-axis of the microphone array,wherein sampled and quantized signals obtained from the each of the remaining sensors are expressed as quaternion valued signals;wherein spatial derivatives of the captured sound field are calculated by linear combinations of two or more of the quaternion valued signals resulting in quaternion valued spatial derivative signals;wherein spherical harmonic coefficients are obtained as a weighted sum of the quaternion valued spatial derivative signals;wherein a spherically steerable directivity pattern is obtained by a weighted sum of the spherical harmonic coefficients.