This application claims under 35 U.S.C. §119(a) the benefit of Korean Patent Application No. 10-2011-0131710 filed Dec. 9, 2011, the entire contents of which are incorporated herein by reference.
(a) Technical Field
The present invention relates to a technique for localizing a sound source. More particularly, it relates to a technique for localizing a sound source, which can estimate sound pressure distribution with respect to a low frequency noise source, and can improve the resolution of sound field visualization with respect to the low frequency noise source.
(b) Background Art
As the noise characteristics of various products such as vehicles and home appliances are recognized as an important performance indicator, efforts to manufacture products producing less noise have been made at the development stage. A method of finding the location and the cause of noise generation and reducing noise through design modification is being used to reduce noise of products as well. For this, a measurement technique which finds the location of a noise source is primarily needed.
Recently, a method of measuring the intensity of a sound pressure using an intensity probe and a method of localizing a sound source using a microphone array beam forming method have been widely used.
A method of localizing a sound source using a spherical microphone array, which has been relatively recently developed, uses a microphone that includes a plurality of noise-measuring sensors, and utilizes a technique of calculating the intensity distribution of a noise source through signal processing using the phase difference of measured signals according to a distance difference between the noise source and the noise-measuring sensor and localizing the location of the noise source according to the intensity of the noise source. The measurement accuracy of the beam forming method is determined by the number of the sensors used. Generally, it is known that more sensors improve its performance.
On the other hand, a method for measuring the location of a noise source and visualizing a sound field in an interior space of a vehicle includes estimating the location of a noise source via a beam forming method, acquiring an omnidirectional (360 degrees) image of the interior space of the vehicle where the noise source exists using a plurality (e.g., twelve) of image sensors or image capturing devices (e.g., cameras), and displaying the location of the noise source obtained by the beam forming method on the omnidirectional image acquired by the image sensors.
A spherical microphone array used for localization of a noise source is disclosed in Korean Patent Application No. 2011-0093086, filed on Sep. 15, 2011 by the present applicant and inventor and is hereby incorporated by reference in its entirety.
In the typical beam forming method, beam power needs to be calculated, and the location of a noise source is estimated by controlling the time delay between sound pressure signals received by each microphone. The beam power can be expressed as Equation (1) below.
where z({right arrow over (k)},t) is a beam power, m and M denote a microphone index and the total number of microphones, respectively, Δm({right arrow over (k)})={right arrow over (k)}·{right arrow over (r)}m/c is a time delay, {right arrow over (k)} is a traveling direction of a sound wave, {right arrow over (r)}m is a distance from a reference point to m-th microphone, and c is a propagation velocity of a sound wave in the air.
However, in the above delay-sum beam forming technique, there is a limitation in localization of a low frequency noise source (i.e., equal to or less than about 500 Hz) that has a sufficiently long wavelength compared to an interval between microphones adjacent to each other in the microphone array. This limitation inevitably occurs in the delay-sum beam forming technique. In the case of a low frequency noise source, when a typical beam forming method is used, the resolution is reduced due to a reduction of visualization performance, causing a limitation in the localization of the noise source.
Accordingly, an acoustic holography technique may be used to overcome the above limitation. Also known is a commercialized technology (acoustic holography technology for a spherical microphone array) that uses a spherical harmonic function in sound field visualization for a spherical microphone array). In the acoustic holography technique, the sound field estimation is performed using a spherical harmonic function when r≧a. However, in the above acoustic holography technique, only near field estimation is possible due to a limitation on the numerical formula. When a typical acoustic holography is used, frequent measurement (e.g., more than 15 times in the case of the indoor of a vehicle) is needed for the sound field visualization. Accordingly, a lot of numerical calculations are needed, and therefore analysis is delayed.
The above information disclosed in this Background section is only for enhancement of understanding of the background of the invention and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art.
The present invention provides a technique for localizing a sound source, which can estimate a sound pressure distribution with respect to a low frequency noise source, and can improve the resolution of sound field visualization with respect to the low frequency noise source. The present invention also provides a technique for localizing a sound source, which can reduce the measurement frequency and time, and the amount of calculation, compared to a typical acoustic holography technique.
In one aspect, the present invention provides a method for localizing a sound source, including: acquiring a sound pressure signal measured by microphones, using a spherical microphone array sensor where the microphones are fixedly arranged on a surface of a spherical body; obtaining a sound pressure distribution on the surface of the spherical body from a sound pressure calculation formula for calculating a sound pressure at a certain location of a spherical surface using the sound pressure signal measured by the microphones as an input value; and estimating a location of the sound source from the obtained sound pressure distribution.
Other aspects and exemplary embodiments of the invention are discussed infra.
The above and other features of the present invention will now be described in detail with reference to certain exemplary embodiments thereof illustrated the accompanying drawings which are given hereinbelow by way of illustration only, and thus are not limitative of the present invention, and wherein:
Reference numerals set forth in the Drawings includes reference to the following elements as further discussed below:
It should be understood that the appended drawings are not necessarily to scale, presenting a somewhat simplified representation of various preferred features illustrative of the basic principles of the invention. The specific design features of the present invention as disclosed herein, including, for example, specific dimensions, orientations, locations, and shapes will be determined in part by the particular intended application and use environment.
In the figures, reference numbers refer to the same or equivalent parts of the present invention throughout the several figures of the drawing.
Hereinafter reference will now be made in detail to various embodiments of the present invention, examples of which are illustrated in the accompanying drawings and described below. While the invention will be described in conjunction with exemplary embodiments, it will be understood that present description is not intended to limit the invention to those exemplary embodiments. On the contrary, the invention is intended to cover not only the exemplary embodiments, but also various alternatives, modifications, equivalents and other embodiments, which may be included within the spirit and scope of the invention as defined by the appended claims.
It is understood that the term “vehicle” or “vehicular” or other similar term as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g., fuels derived from resources other than petroleum). As referred to herein, a hybrid vehicle is a vehicle that has two or more sources of power, for example both gasoline-powered and electric-powered vehicles.
The above and other features of the invention are discussed infra.
Hereinafter, exemplary embodiment of the present invention will be described in detail with reference to the accompanying drawings.
The localization of the noise source may include estimating the location of a sound source from sound pressure levels at each location of the obtained sound pressure distribution. In the localization of the noise source, the obtained sound pressure distribution may be converted and mapped into Sound Pressure Level (SPL) data at each location on a rainbow palette, and then may be displayed on a separately-photographed omnidirectional planar image of the indoor space of a vehicle to obtain a visualized image of an area where the noise source is located.
Specifically, the omnidirectional (i.e., 360 degrees) planar image of the indoor space (i.e., surroundings of the sensor) of a vehicle where a noise source exists may be separately obtained using a plurality (e.g., twelve) of image sensors or image capturing devices (e.g., cameras), and then a sound pressure distribution on the spherical surface obtained by the spherical microphone array sensor 10 may be converted into SPL data and mapped on the rainbow palette. Thereafter, the rainbow palette where the SPL data are mapped may be synthesized with the omnidirectional planar image to obtain an image that visualizes the locational area of the noise source.
The technique for localizing of the sound source according to the exemplary embodiment of the present invention is characterized in that the sound pressure (sound field) distribution on the spherical surface is directly estimated without calculation of beam power using sound pressure signals measured by each spherical microphone 12 and then the sound source is localized.
Particularly, the technique for localizing of the sound source may accurately localize a low frequency (e.g., equal to or less than about 500 Hz) noise source. In order to localize a low frequency noise source, the sound pressure distribution on the spherical surface (surface of the spherical body where microphones are arranged) may be estimated using the sound pressure signals measured from the surface of the spherical microphone array sensor 10.
In this case, the sound pressure distribution on the spherical surface may be estimated using a spherical harmonic function with respect to a low frequency range of noise source (see Equations 4 and 6 below). It is estimated whether a noise source exists at a certain place distant from the estimated sound pressure distribution. After the sound pressure distribution on the spherical surface is estimated using the sound pressure measured on the surface of the spherical microphone array sensor 10, the sound source may be localized based on the estimated sound pressure distribution. Thus, it is possible to accurately estimate the sound pressure distribution and localize a low frequency noise source compared to a typical beam forming method.
Also, it is possible to reduce the measurement frequency and time, and the amount of calculation compared to a typical acoustic holography technique. More specifically, as shown in
Also, since the rigid body spherical microphone array sensor 10 is used, although considered to be an intrinsic limitation, the sound field may be expressed as Equation (2) below when the radius (radius of the spherical body) of the sphere, i.e., the spherical microphone array sensor 10 is equal to or greater than a (i.e., r≧a).
[Sound Pressure Signal at a certain location (θ, φ) when r≧a]
where jn(kr) is a spherical Bessel function, n is an order of sound field distribution, m={−n, −n+1, . . . , 0, 1, . . . , n−1, n}, Ynm(θ, φ) are spherical harmonic functions, and to is an angular frequency (rad/s).
In Equation (2), (r, θ, φ) denotes parameters on a spherical coordinate shown in
The coefficient Amn of Equation (2), which is a function with respect to the frequency, may be expressed as Equation (3) with respect to one frequency. In this case, p(a,θ0,φo) may be obtained from each microphone 12.
where θ0,φo represented to obtain Amn denotes a location of each microphone 12 in the sensor 10, and a is a radius (i.e., radius of spherical body) of the spherical microphone array sensor 10 where microphones 12 are arranged on the surface of the spherical body. Thus, based on the sound pressure signals measured by the plurality (e.g., thirty) of microphones 12, the coefficient Amn may be mathematically obtained. This means that the sound pressure distribution (i.e., sound field distribution) on the spherical surface can be analytically estimated from the coefficient Amn. Thus, it is possible to estimate the sound pressure distribution on the spherical and estimate the direction and location of the sound source on the microphone array.
When obtaining coefficients using Equations (2) and (3), the sound pressure (r≧a) at a certain location (r,θ,φ) of the spherical coordinate may be expressed as Equation (4) below.
[Sound Pressure Signal at a Certain Location]
where n denotes the order of the sound field, and m denotes a sound field distribution mode of n sound distribution order.
In Equation (4), the sound pressure on a spherical surface (surface of the spherical body of the sensor) means r=a.
Since there is a limitation of unknown quantity generated from the number of the microphones, the sound distribution order n has to be determined such that a smaller number of unknown quantities are generated than the number of the microphones. This relationship may be expressed as Equation (5). For example, when using the spherical microphone array sensor 10 having thirty microphones (M=30), the maximum order N of Equation (5) may be determined to be 4 (the order N is limited to be 4).
[Relationship Between the Number of Microphones and the Order]
M≧(N+1)2 (5)
where M is the total number of microphones, and N is the maximum order.
Thus, when the condition (r=a) of the spherical surface and the order limit condition (n=4) are applied, Equation (6) may be obtained from Equation (5). Finally, the sound pressure distribution on the spherical surface may be estimated from Equation (6) below.
[Sound Pressure Signal (Order Limit)]
Equation (6) may be a sound pressure calculation formula for calculating a sound pressure at a certain location of the spherical surface (surface of the spherical body on which microphones are arranged in a microphone array sensor) using sound pressure signals measured by each microphone 12 as input values. Also, Equation (6) may be obtained by limiting the sound distribution order n to the maximum order (N=4) of Equation 5 that considers the total number of microphones.
In this case, since an actual measured point, i.e., the location θ0,φ0 of the microphone is included in θ,φ, the sound field may be estimated with respect to all points including the measured point, but the sound field can be estimated at a location of r=a that is the surface of the sphere. Accordingly, after the sound pressure distribution on the surface of the sphere is obtained from Equation 6, the sound source located around the sensor can be localized from the sound pressure distribution on the surface of the sphere, and information for localization of the sound source can be created.
From the obtained sound pressure distribution, the highest level of the sound pressure may be estimated to be a region where the sound source is located. The sound field visualization may be performed to generate an image by which the location of the sound source can be visually identified from the obtained sound pressure distribution. In this case, the sound pressure distribution may be divided by discernible colors and shades according to the level.
In this case, a sound field visualization process may be performed. The sound field visualization process may include dividing the sound pressure distribution by colors (e.g., 8 bit RGB color) and shades by converting the sound pressure distribution on the spherical surface into sound pressure level (SPL) data to map the data on a rainbow palette, and obtaining an image that visualizes the location region of the noise source by synthesizing the mapped image pressure distribution with a photographed image. An example of the sound field visualization that forms an image by which the location of the noise source can be visually identified by displaying the location region of the noise source using the sound pressure distribution will be described below.
First, an omnidirectional image of the indoor space of a vehicle, which is obtained using a plurality of image sensors or cameras and shows surroundings of the spherical microphone array sensor, may be processed into a widely-spread omnidirectional planar image as shown in
In this case, the sound pressure may be converted into SPL data having 255 steps to represent measured values on the rainbow palette. The gap between the measured maximum and minimum values may be divided into 255 steps, and a sound pressure at a certain location may be represented as a value therebetween.
Thereafter, the omnidirectional planar image may be matched with the map planar image by pixel location to overlay pixel data. In this case, if the SPL data (for example, converted into colors of
In overlaying data of the omnidirectional planar image and the rainbow palette mapped with the SPL data, the 32-bit RGB color of the photographed image, as shown in
In this case, the color of the planar images may be separated into and expressed by 8-bit data of red, green and blue, respectively. As shown in
Referring to
Table 1 below shows differences between a typical beam forming method and a method for localizing a sound source according to an embodiment of the present invention.
Thus, a method for localizing a sound source according to an embodiment of the present invention can accurately estimate a sound pressure distribution and localize the sound source with respect to a low frequency noise source compared to a typical beam forming technique, and can improve the resolution of sound field visualization with respect to the low frequency noise source, by estimating a sound pressure distribution on a spherical surface using a sound pressure measured on the surface of a spherical microphone array sensor and then estimating the location of the sound source based on the estimated sound pressure distribution. The technique for localizing the sound source can reduce the measurement frequency and time, and the amount of calculation, compared to a typical acoustic holography technique that performs sound field estimation using a spherical harmonic function when r≧a).
Furthermore, the control logic of the present invention may be embodied as non-transitory computer readable media on a computer readable medium containing executable program instructions executed by a processor, controller or the like. Examples of the computer readable mediums include, but are not limited to, ROM, RAM, compact disc (CD)-ROMs, magnetic tapes, floppy disks, flash drives, smart cards and optical data storage devices. The computer readable recording medium can also be distributed in network coupled computer systems so that the computer readable media is stored and executed in a distributed fashion, e.g., by a telematics server or a Controller Area Network (CAN).
The invention has been described in detail with reference to exemplary embodiments thereof. However, it will be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10-2011-0131710 | Dec 2011 | KR | national |