1. Technical Field
The present disclosure relates to a sound velocity correction device that corrects a sound velocity used in forming directivity of a sound in a direction toward a sound source from a microphone array device.
2. Description of the Related Art
In a monitoring system installed at a predetermined position (for example, a ceiling) in a factory, a store (for example, a retail store or a bank), or a public place (for example, a library), a wide viewing angle of video data (including a still image and a movie, the same applies hereinafter) in a predetermined range of a monitoring target is achieved by connecting a plurality of camera devices (for example, pan tilt camera devices or omnidirectional camera devices) to each other through a network.
Since the amount of information obtained is inevitably limited in monitoring only for a video, there is a strong demand for a monitoring system that obtains sound data in a direction in which a camera device captures a specific subject by disposing not only the camera device but also a microphone array device.
Hitherto, in a beam forming process (directivity forming process) for forming directivity in a specific direction with respect to sound data related to sounds collected by a microphone array device including a plurality of microphone elements, a sound velocity used to calculate a delay time necessary for the directivity forming process has been treated as a fixed value. For this reason, when a sound velocity changes due to, for example, changes in air temperature, the accuracy of directivity formed in the directivity forming process deteriorates.
Here, as the related art in which an adjustment value for setting a time difference between sound waves reaching microphones from a sound source to be zero is calculated using a temperature value of a propagation path of the sound waves from the sound source, for example, an image display device disclosed in Japanese Patent Unexamined Publication No. 2013-90289 is known.
The image display device disclosed in Japanese Patent Unexamined Publication No. 2013-90289 includes a microphone group, a sound source position calculation means, a test sound wave generation means, and an adjustment value calculation means. The microphone group includes a plurality of microphones for detecting sound waves emitted from a sound source. The sound source position calculation means calculates the position of a sound source on the basis of a time difference between sound waves reaching each microphone group. The test sound wave generation means are disposed at a position separated from the microphones at equal distances and emit white noise including sound waves having a plurality of different frequencies as sound waves. The adjustment value calculation means calculates a time difference between sound waves having a plurality of different frequencies reaching a microphone group for each frequency on the basis of the position of the test sound wave generation means which is calculated by the sound source position calculation means, and collectively calculates adjustment values for the respective frequencies for making phases of signals of sound waves detected by the microphone group conform to each other so as to set the time difference to be zero. Meanwhile, in Japanese Patent Unexamined Publication No. 2013-90289, an ambient temperature value used to correct propagation velocities of sound waves emitted from a sound source is a value which is input from a keyboard by a user.
An object of the disclosure is to provide a sound velocity correction device that suppresses deterioration in directivity formation accuracy by acquiring at least ambient temperature, humidity, and atmospheric pressure at the time of collecting a sound emitted from a sound source in a specific direction when seen from a microphone array device and by calculating an accurate sound velocity.
According to an aspect of the disclosure, there is provided a sound velocity correction device including an environmental parameter obtainer that acquires a measured value of a surrounding environmental parameter of a sound collector that collects a sound emitted from a sound source; and a sound velocity corrector that corrects a sound velocity of the sound which is used to form directivity in a directing direction toward the sound source from the sound collector, using the measured value of the surrounding environmental parameter of the sound collector which is acquired by the environmental parameter obtainer.
According to the disclosure, it is possible to suppress deterioration in directivity formation accuracy by acquiring at least ambient temperature, humidity, and atmospheric pressure at the time of collecting a sound emitted from a sound source in a specific direction when seen from a microphone array device and by calculating an accurate sound velocity.
Hereinafter, exemplary embodiments of a directivity control system including a sound velocity correction device according to the disclosure will be described with reference to the accompanying drawings. The directivity control system according to each exemplary embodiment is used as a monitoring system (including a manned monitoring system and an unmanned monitoring system) which is installed in, for example, a factory, a public facility (for example, a library or an even hall), or a store (for example, a retail store or a bank), but the disclosure is not particularly limited thereto. In the following exemplary embodiments, a description is given on the assumption that the directivity control system according to each exemplary embodiment is installed in, for example, a store. In the following exemplary embodiments, a sound velocity correction device according to the disclosure is equivalent to an omnidirectional microphone array device or a directivity control device.
Meanwhile, the disclosure can also be expressed as each device (for example, a directivity control device or an omnidirectional microphone array device to be described later) which constitutes the directivity control system or a method including operations (steps) performed by each device (for example, a directivity control device or an omnidirectional microphone array device to be described later) which constitutes the directivity control system.
Omnidirectional microphone array device 2 includes plate-like microphone housing 125 (see
In omnidirectional microphone array device 2, a plurality of microphone units 22 are concentrically disposed in the vicinity of central concave portion 135 and along a circumferential direction of plate-like microphone housing 125. For example, non-directional electret condenser microphone (ECM) 117a having high sound quality and a small size is used as microphone unit 22 as an example of a sound collector, and the same is true of the following exemplary embodiments.
In directivity control system 10 illustrated in
Camera devices C11, . . . , and C1n as examples of imaging units are installed so as to be fixed to, for example, a ceiling of an event hall. Each of camera devices C11, . . . , and C1n has a function as a monitoring camera, for example, in a monitoring system and captures a predetermined video using a zoom function (for example, zoom-in processing and zoom-out processing) and an optical axis moving function (panning and tilting) through a remote operation from a monitoring control room (not shown) which is connected to network NW. Installation positions and installation directions of the respective camera devices are registered in directivity control device 3. Pieces of data regarding panning, tilting, and zooming information are transmitted to directivity control device 3 when necessary, and an image position and the directing direction are always associated with each other. For example, when camera device C11 is an omnidirectional camera, image data (that is, omnidirectional image data) indicating an omnidirectional video of a sound collection region and plane image data generated by performing predetermined distortion correction processing on omnidirectional image data and then performing panorama conversion thereon are transmitted to directivity control device 3 or recorder device 4 through network NW. Hereinafter, a case where camera device C11 is an omnidirectional camera will be described.
In an image displayed on display device 36, when any position is designated by a user, camera device C11 receives coordinate data of the designated position in the image from directivity control device 3, calculates data of a distance between camera device C11 and a sound position (hereinafter, simply referred to as a “sound position”) on a real space corresponding to the designated position and the direction therebetween (including a horizontal angle and a vertical angle, the same applies hereinafter), and transmits the calculated data to directivity control device 3. Meanwhile, since a process of calculating data of a distance and a direction in camera device C11 is a known technique, a description thereof will be omitted here.
Omnidirectional microphone array device 2 is connected to network NW, and is configured to include at least microphone elements 221, 222, . . . , and 22n disposed at equal intervals and controller 281 (see
Omnidirectional microphone array device 2 transmits sound data of sounds collected by microphone units 22 and 23 to directivity control device 3 or recorder device 4 through network NW. Omnidirectional microphone array device 2 detects (measures) surrounding environmental parameters (for example, at least temperature among parameters including temperature, humidity, atmospheric pressure, a wind direction, and a wind velocity) during the collection of sounds and transmits measured values of the respective environmental parameters which are included in the same packet PKT (see
Directivity control device 3 calculates (corrects) sound velocity Vs (see
Omnidirectional microphone array device 2A illustrated in
Omnidirectional microphone array device 2B illustrated in
Omnidirectional microphone array device 2C illustrated in
Omnidirectional microphone array device 2D illustrated in
Omnidirectional microphone array device 2E illustrated in
Directivity control device 3 is connected to network NW, and may be a stationary personal computer (PC) installed in, for example, a monitoring system control room (not shown), or may be a user's portable data communication terminal such as a mobile phone, a tablet terminal, or a smartphone.
Directivity control device 3 is configured to include at least communicator 31, operator 32, signal processor 33, display device 36, speaker device 37, and memory 38. Signal processor 33 is configured to include at least directing direction calculator 34a, sound velocity corrector 34b, and output controller 34c.
Communicator 31 receives packet PKT (for example, see
Operator 32 is a user interface (UI) for notifying signal processor 33 of contents of a user's operation, and is a pointing device such as, for example, a mouse or a keyboard. Operator 32 is disposed corresponding to, for example, a screen of display device 36, and may be configured using a touch panel or a touch pad which is operable by a user's finger or a stylus pen.
Operator 32 acquires coordinate data indicating a position (that is, a position at which a sound volume level of a sound output from speaker device 37 is desired to be increased or decreased) which is designated by a user's operation, with respect to an image (that is, an image captured by one camera device selected among camera devices C11, . . . , and C1n, the same applies hereinafter) which is displayed on display device 36, and outputs the acquired coordinate data to signal processor 33.
Signal processor 33 is configured using, for example, a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP), and performs control processing for controlling operations of units of directivity control device 3 as a whole, data input and output processing with other units, data computation (calculation) processing, and data storage processing.
Directing direction calculator 34a calculates coordinates (θMAh, θMAv) indicating the directing direction toward a sound position (for example, a position of person HM illustrated in
Directing direction calculator 34a calculates directing direction coordinates (θMAh, θMAv) toward a sound position from the installation position of omnidirectional microphone array device 2 using data of a distance between the installation position of camera device C11 and a sound position and the direction therebetween. For example, when the housing of omnidirectional microphone array device 2 and camera device C11 are integrally installed so as to surround the housing of camera device C11, a direction (horizontal angle, vertical angle) between camera device C11 and the sound position can be used as directing direction coordinates (θMAh, θMAv) between omnidirectional microphone array device 2 and the sound position. Meanwhile, when the housing of camera device C11 and the housing of omnidirectional microphone array device 2 are installed at separate locations, directing direction calculator 34a calculates directing direction coordinates (θMAh, θMAv) between omnidirectional microphone array device 2 and the sound position using data of a calibration parameter calculated in advance and data of a direction (horizontal angle, vertical angle) between camera device C11 and the sound position. Meanwhile, the calibration is an operation of calculating or acquiring a predetermined calibration parameter required for directing direction calculator 34a of directivity control device 3 to calculate coordinates (θMAh, θMAv) indicating the directing direction, and is assumed to be performed in advance by a known technique.
In the coordinates (θMAh, θMAv) indicating the directing direction, θMAh denotes a horizontal angle in the directing direction toward a sound position from omnidirectional microphone array device 2, and θMAv denotes a vertical angle in the directing direction toward a sound position from omnidirectional microphone array device 2. Meanwhile, the sound position is a position of the site serving as an actual monitoring target or a sound collection target corresponding to a designated position designated from operator 32 by a user's finger or a stylus pen in an image displayed on display device 36 (see FIG. 13A).
Sound velocity corrector 34b calculates or corrects sound velocity Vs which is a propagation velocity of a sound when omnidirectional microphone array device 2 collects a sound, using environmental parameter data PDT included in packet PKT transmitted from omnidirectional microphone array device 2. Methods of calculating and correcting sound velocity Vs in sound velocity corrector 34b will be described later in detail.
Output controller 34c controls operations of display device 36 and speaker device 37, displays image data transmitted from camera device C11, for example, by a user's operation on display device 36, and causes sound data included in packet PKT transmitted from omnidirectional microphone array device 2 to be output from speaker device 37. Output controller 34c as an example of a directivity formation unit forms the directivity of sound data collected by omnidirectional microphone array device 2 in the directing direction which is indicated by the coordinates (θMAh, θMAv) calculated by directing direction calculator 34a, but may form directivity in omnidirectional microphone array device 2.
Display device 36 as a display displays image data transmitted from, for example, camera device C11 on the screen under the control of output controller 34c, for example, by a user's operation.
Speaker device 37 as a sound output outputs sound data included in packet PKT transmitted from omnidirectional microphone array device 2, or sound data in which directivity is formed in the directing direction which is indicated by coordinates (θMAh, θMAv) calculated by directing direction calculator 34a. Meanwhile, display device 36 and speaker device 37 may be separately configured from directivity control device 3.
Memory 38 as a storage is configured using, for example, a random access memory (RAM), functions as a work memory when units of directivity control device 3 operate, and stores data required when units of directivity control device 3 operate.
Recorder device 4 stores sound data included in packet PKT transmitted from omnidirectional microphone array device 2 and environmental parameter data PDT in association with image data transmitted from, for example, camera device C11. Meanwhile, since directivity control system 10 illustrated in
Sound source 80 is a subject (for example, person HM illustrated in
The sound waves emitted from sound source 80 are first collected by reaching microphone element 221 and are then collected by reaching microphone element 222. Similarly, the sound waves are successively collected, and are finally collected by reaching microphone element 22n.
Meanwhile, a direction toward sound source 80 from the positions of microphone elements 221, 222, 223, . . . , 22(n−1), and 22n of omnidirectional microphone array device 2 is the same as a direction toward a sound position corresponding to a designated position, which is designated on the screen of display device 36 by a user, from the microphone elements of omnidirectional microphone array device 2, for example, when sound source 80 is a sound during the conversation of person HM.
Here, arrival time differences τ1, τ2, τ3, . . . , and τn−1 occur between a time when sound waves reach microphone elements 221, 222, 223, . . . , and 22(n−1) and a time when the sound waves reach microphone element 22n having finally collected a sound. For this reason, when pieces of sound data collected by microphone elements 221, 222, 223, . . . , 22(n−1), and 22n are added up as they are, the pieces of sound data are added up with the phases thereof shifted, and thus sound volume levels of the sound waves weaken each other overall.
Meanwhile, τ1 is time of a difference between a time when sound waves reach microphone element 221 and a time when the sound waves reach microphone element 22n, and τ2 is time of a difference between a time when sound waves reach microphone element 222 and a time when the sound waves reach microphone element 22n. Similarly, τn−1 is time of a difference between a time when sound waves reach microphone element 22(n−1) and a time when the sound waves reach microphone element 22n.
In the directivity forming process according to the present exemplary embodiment, A/D converters 241, 242, 243, . . . , 24(n−1), and 24n provided corresponding to microphone elements 221, 222, 223, . . . , 22(n−1), and 22n convert an analog sound signal into a digital sound signal. Further, predetermined delay times of the digital sound signal are added up by delay units 251, 252, 253, . . . , 25(n−1), and 25n provided corresponding to microphone elements 221, 222, 223, . . . , 22(n−1), and 22n. Outputs of delay units 251, 252, 253, . . . , 25(n−1), and 25n are added up by adder 26.
Meanwhile, when the directivity forming process is performed by omnidirectional microphone array device 2, delay units 251, 252, 253, . . . , 25(n−1), and 25n are provided in omnidirectional microphone array device 2. When the directivity forming process is performed by directivity control device 3, delay units 251, 252, 253, . . . , 25(n−1), and 25n are provided in directivity control device 3.
Further, in the directivity forming process illustrated in
For example, in
Here, L1 denotes a difference in sound wave arrival distance between microphone element 221 and microphone element 22n. In addition, L2 denotes a difference in sound wave arrival distance between microphone element 222 and microphone element 22n. Further, L3 denotes a difference in sound wave arrival distance between microphone element 223 and microphone element 22n. Similarly, L(n−1) denotes a difference in sound wave arrival distance between microphone element 22(n−1) and microphone element 22n. In addition, Vs denotes the sound velocity of a sound wave. Sound velocity Vs may be calculated by omnidirectional microphone array device 2, or may be calculated by directivity control device 3 (to be described later). Here, L1, L2, L3, . . . , and L(n−1) are known values. In
In the directivity forming process, delay times Di (i is an integer of 1 to n, n is an integer of 2 or more) which are applied to pieces of sound data of the sounds collected by the respective microphone elements are inversely proportional to sound velocity Vs expressed as Expression (1). As described later, sound velocity Vs changes depending on temperature, humidity (water vapor pressure), or atmospheric pressure, or depending on a wind velocity when necessary. Accordingly, in order to form highly accurate directivity, the microphone elements need to perform conversion (correction) into accurate sound velocity Vs using environmental parameters (for example, temperature, water vapor pressure (humidity), atmospheric pressure, and a wind velocity) at the time of collecting a sound.
In this manner, omnidirectional microphone array device 2 or directivity control device 3 can easily and arbitrarily form the directivity of sound data of sounds collected by respective microphone elements 221, 222, 223, . . . , 22(n−1), and 22n built into microphone unit 22 or microphone unit 23 by changing delay times D1, D2, D3, . . . , Dn−1, and Dn applied by delay units 251, 252, 253, . . . , 25(n−1), and 25n.
Microphone elements 221, 222, . . . , and 22n collect sound in a sound collection region. Analog sound signals of sounds collected by microphone elements 221, 222, . . . , and 22n are converted into digital sound signals by A/D converters 241, 242, . . . , and 24n and are input to controller 281.
Controller 281 performs control processing for controlling operations of units of omnidirectional microphone array device 2 as a whole, data input and output processing with other units, data computation (calculation) processing, and data storage processing. For example, controller 281 performs encoding of the input digital sound signals and data including measured values of temperature, humidity (water vapor pressure), and atmospheric pressure, as environmental parameters, which are detected (measured) by temperature detector TS, humidity detector HS, and atmospheric pressure detector AS, and outputs the encoded signals and data to transmitter 291. Transmitter 291 generates packet PKT from the encoded data and transmits the generated packet to directivity control device 3 and recorder device 4.
Transmitter 291 generates packet PKT including sound data VD encoded by controller 281 in response to an instruction from controller 281, and transmits the generated packet to directivity control device 3 and recorder device 4.
Temperature detector TS as an example of an environmental parameter obtainer is configured using, for example, a known temperature sensor. The temperature detector periodically detects (measures) the surrounding temperature during the sound collection performed by omnidirectional microphone array device 2, and outputs the measured value of the temperature to controller 281.
Humidity detector HS as an example of an environmental parameter obtainer is configured using, for example, a known humidity sensor. The humidity detector periodically detects (measures) ambient humidity (for example, water vapor pressure) during the sound collection of omnidirectional microphone array device 2, and outputs the measured value of the humidity to controller 281.
Atmospheric pressure detector AS as an example of an environmental parameter obtainer is configured using, for example, a known atmospheric pressure sensor. The atmospheric pressure detector periodically detects (measures) ambient atmospheric pressure during the sound collection of omnidirectional microphone array device 2, and outputs the measured value of the atmospheric pressure to controller 281.
In directivity control system 10 according to the present exemplary embodiment, omnidirectional microphone array device 2 includes concentric plate-like microphone housing 125 in which a disk-like housing of camera device C11 is fitted into central concave portion 135. A plurality of (for example, sixteen) microphone units 22 are concentrically disposed within plate-like microphone housing 125. For example, electret condenser microphone (ECM) 117a having high sound quality and a small size is used as microphone unit 22, and the same is true of the following exemplary embodiments. Microphone unit 22 has rubber bushing 143 inserted thereinto, and electret condenser microphone (ECM) 117a having high sound quality and a small size is fixed to the rubber bushing.
An upper surface (for example, a surface to which microphone unit 22 is attached) of plate-like microphone housing 125 of omnidirectional microphone array device 2 and an upper surface (for example, a surface of fish-eye lens 121) of the disk-like housing of camera device C11 have a positional relationship having no step therebetween (for example, have a horizontal surface or a continuous curved surface close to a horizontal surface) so that a factor due to the deterioration in sound characteristics such as the reflection of a sound does not occur, and the same is true of the following exemplary embodiments.
In plate-like microphone housing 125, circular or quadrilateral microphone substrate 133 having a diameter equal to or larger than the diameter of camera device C11 can be disposed in space 145 within the housing which is formed above camera device C11. In plate-like microphone housing 125, an AD converter may be disposed in the vicinity of connector 151 or may be disposed in the central portion of microphone substrate 133. In plate-like microphone housing 125, since a large area for microphone substrate 133 can be secured, the microphone substrate can be disposed in proximity to microphone unit 22, and thus it is possible to shorten microphone cable 155, which leads to an improvement in noise resistance interference characteristics (EMS).
Vent hole 129 is formed in the lateral side portion of plate-like microphone housing 125, and temperature humidity atmospheric pressure measurement element 161 including temperature detector TS, humidity detector HS, and atmospheric pressure detector AS, which are described above, is disposed in the vicinity of vent hole 129 and in the lateral side portion of plate-like microphone housing 125. In other words, temperature humidity atmospheric pressure measurement element 161 is disposed in the vicinity of vent hole 129 and at the end (that is, on the lateral side portion side of plate-like microphone housing 125) of microphone substrate 133. On the other hand, when a vent hole is formed in the upper surface (specifically, on the mounting surface side of electret condenser microphone (ECM) 117a having a high sound quality and a small size) of plate-like microphone housing 125, some sound waves are incident on the vent hole, and sound characteristics of collected sound waves deteriorate. Accordingly, it is preferable that vent hole 129 is formed in the lateral side portion of plate-like microphone housing 125.
Thereby, the inside (space 145 in the housing) of plate-like microphone housing 125 and the outside (for example, the outside air) do not differ from each other in measured values of temperature, humidity, and atmospheric pressure, and thus omnidirectional microphone array device 2 can suppress the influence of heat generation of electronic components (for example, a CPU and an A/D converter) which are disposed inside plate-like microphone housing 125 and can acquire measured values of appropriate temperature, humidity, and atmospheric pressure. As described later, omnidirectional microphone array device 2 or directivity control device 3 can calculate an accurate sound velocity using measured values of appropriate temperature, humidity, and atmospheric pressure.
Controller 281 acquires a measured value of ambient humidity of omnidirectional microphone array device 2 which is detected by humidity detector HS (S4). Controller 281 outputs humidity data indicating the measured value of the humidity acquired in step S4 to transmitter 291 and gives an instruction for the adding of the humidity data to packet PKT (S5).
Controller 281 acquires a measured value of ambient atmospheric pressure of omnidirectional microphone array device 2 which is detected by atmospheric pressure detector AS (S6). Controller 281 outputs atmospheric pressure data indicating the measured value of the atmospheric pressure acquired in step S6 to transmitter 291 and gives an instruction for the adding of the atmospheric pressure data to packet PKT (S7). Transmitter 291 generates packet PKT illustrated in
First Example of Calculation of Sound Velocity Vs
In
Here, the calculation of sound velocity Vs using temperature data, humidity data, and atmospheric pressure data in sound velocity corrector 34b will be specifically described. Sound velocity V [m/s] in dry air is expressed as Expression (2) based on temperature T [° C.]. Meanwhile, an approximate expression of Expression (2) is known to be expressed as Expression (3).
V=20.055√{square root over (273.15+T)} (2)
V=331.5+0.6T (3)
A relationship between sound velocity V in dry air and sound velocity Vs in the air including water vapor having water vapor pressure P [Pa] is expressed as Expression (4). In Expression (4), γw denotes a ratio of specific heat at constant pressure of water vapor to specific heat at constant volume thereof and has a value of approximately 1.33, γa denotes a ratio of specific heat at constant pressure of dry air to specific heat at constant volume thereof and has a value of approximately 1.40, and H denotes atmospheric pressure [Pa].
Humidity measured by a general humidity sensor is relative humidity RH (that is, a ratio of water vapor pressure P to saturated water vapor pressure P0 in temperature during measurement (partial pressure)), and a relationship between relative humidity RH and water vapor pressure P is expressed as Expression (5). In Expression (5), in order to calculate water vapor pressure P, it is necessary to know saturated water vapor pressure P0. Saturated water vapor pressure P0 changes depending on temperature T, and is expressed as Expression (6). Expression (6) is called Teten's formula. For example, Wagner's formula may be used as an expression for obtaining saturated water vapor pressure P0.
P=P
0
×RH÷100 (5)
P
0=6.1078×10(7.5T/T+237.3)×100 (6)
Accordingly, sound velocity in the air changes depending on at least temperature, and also changes depending on water vapor pressure in the air. The degree of influence of the change in sound velocity depending on water vapor pressure also changes depending on atmospheric pressure as expressed as Expression (4). As described later, since a sound velocity also changes depending on wind, more accurate directivity is required to be formed, for example, when omnidirectional microphone array device 2 is installed outdoors. Accordingly, it is preferable that sound velocity Vs is calculated in view of wind direction and wind velocity (to be described later). Meanwhile, factors affecting the change in sound velocity Vs have an order of temperature, water vapor pressure (in other words, humidity), and atmospheric pressure. Atmospheric pressure (barometic pressure) affects sound velocity Vs only when water vapor pressure is not 0.
As described above, sound velocity corrector 34b calculates sound velocity V as sound velocity Vs according to Expression (2) when only temperature data among temperature data, humidity data, and atmospheric pressure data is used, and calculates sound velocity Vs according to Expression (4) when temperature data, humidity data, and atmospheric pressure data are used.
Meanwhile, although not shown in
As described above, in directivity control system 10 according to the present exemplary embodiment, directivity control device 3 as an example of a sound velocity correction device according to the disclosure acquires surrounding environmental parameters (for example, temperature, humidity, and atmospheric pressure) during the collection of a sound emitted from a sound source (for example, person HM illustrated in
Second Example of Calculation of Sound Velocity Vs
In the present exemplary embodiment, omnidirectional microphone array device 2 may detect at least temperature and may transmit the detected temperature to directivity control device 3 (see
In
On the other hand, initial setting values may be used as values of humidity and atmospheric pressure, as factors of changes in sound velocity Vs, which have a lower degree of influence than temperature. For example, during the initial setting of directivity control system 10, average values of humidity and atmospheric pressure are measured in advance, and values of humidity and atmospheric pressure input from operator 32 by a user's operation are stored in memory 38. Sound velocity corrector 34b uses initial setting values of humidity and atmospheric pressure from memory 38 during the calculation of sound velocity Vs. Meanwhile, the values of humidity and atmospheric pressure are not limited to those during initial setting, and may be appropriately changed to values input from operator 32 by a user's operation and may be stored in memory 38.
In
In the description of
As illustrated in
As described above, in the second example of the calculation of sound velocity Vs, only temperature measurement element 161a corresponding to temperature detector TS is disposed in the lateral side portion of plate-like microphone housing 125. Directivity control device 3 as an example of a sound velocity correction device according to the disclosure can suppress the influence due to heat generation of electronic components (for example, a CPU and an A/D converter) which are disposed inside plate-like microphone housing 125. When temperature inside plate-like microphone housing 125 is set to be in a balanced state, it is possible to calculate accurate sound velocity by correcting measured temperature data by a predetermined amount (for example, +2 [° C.]) based on a difference value between the internal temperature of plate-like microphone housing 125 and the external temperature thereof, using a property that the above-mentioned difference value becomes substantially constant.
Third Example of Calculation of Sound Velocity Vs
In the present exemplary embodiment, omnidirectional microphone array device 2 may calculate sound velocity Vs (see
Sound velocity converter 301 calculates sound velocity Vs necessary for the formation of the directivity of sound data in accordance with Expression (4) to Expression (6) mentioned above, using outputs (that is, temperature data, humidity data, and atmospheric pressure data) of temperature detector TS, humidity detector HS, and atmospheric pressure detector AS and outputs the calculated sound velocity to controller 281. Controller 281 performs encoding of an input digital sound signal and data of sound velocity Vs output from sound velocity converter 301 and outputs the encoded signal and data to transmitter 291.
Transmitter 291 stores encoded sound velocity data VsDT, for example, in a storage region of header HD and generates packet PKTb that stores encoded sound data VD in a storage region of a payload (see
In the description of
Sound velocity converter 301 calculates sound velocity Vs necessary for the formation of the directivity of sound data in accordance with Expression (4) to Expression (6) mentioned above, using the temperature data, the humidity data, and the atmospheric pressure data which are acquired in step S2a, step S4a, and step S6a, and outputs the calculated sound velocity to controller 281 (S15a). Controller 281 outputs data of sound velocity Vs calculated by sound velocity converter 301 to transmitter 291 and gives an instruction for the adding of the sound velocity data to packet PKT (S18). Transmitter 291 generates packet PKTb illustrated in
Meanwhile, omnidirectional microphone array device 2ka may transmit the calculated value of sound velocity Vs, which is included in packet PKTb, to directivity control device 3 and recorder device 4, and may transmit a difference value between the calculated value of sound velocity Vs and a predetermined reference value, which is included in packet PKTb, to directivity control device 3 and recorder device 4. In this case, directivity control device 3 calculates sound velocity Vs using the predetermined reference value and the difference value.
As described above, in the third example of the calculation of sound velocity Vs, omnidirectional microphone array device 2ka as an example of a sound velocity correction device according to the disclosure can calculate sound velocity Vs using measured values of environmental parameters (for example, temperature, humidity, and atmospheric pressure). Since a difference value between a calculated value of sound velocity Vs or a difference value between the calculated value of sound velocity Vs and a predetermined reference value (for example, 340 [m/s]) of a sound velocity is transmitted to directivity control device 3 and recorder device 4, directivity control device 3 corrects sound velocity Vs using the difference value between sound velocity Vs, calculated using the measured values of the environmental parameters, and the predetermined reference value. Thus, it is possible to easily correct a sound velocity by acquiring a difference value between a sound velocity value, calculated using the measured values of the environmental parameters, and a predetermined reference value. When omnidirectional microphone array device 2ka transmits a difference value between a calculated value of sound velocity Vs and a predetermined reference value (for example, 340 [m/s]) of a sound velocity, it is possible to reduce the amount of data to be transmitted. Therefore, it is possible to shorten the amount of time required to acquire data necessary for the correction of a sound velocity in directivity control device 3.
Fourth Example of Calculation of Sound Velocity Vs
In the present exemplary embodiment, as described above, sound velocity Vs may be calculated in view of wind direction and wind velocity in addition to temperature, humidity, and atmospheric pressure as environmental parameters (see
In the description of
One x-direction anemometer 321aa (or 321ab) transmits ultrasonic waves to the other x-direction anemometer 32 lab (or 321aa) disposed in parallel in an x-direction. The other x-direction anemometer 321ab (or 321aa) receives the ultrasonic waves transmitted from one x-direction anemometer 321aa (or 321ab).
One y-direction anemometer 321ba (or 321bb) transmits ultrasonic waves to the other y-direction anemometer 321bb (or 321ba) disposed in parallel in a y-direction. The other y-direction anemometer 321bb (or 321ba) receives the ultrasonic waves transmitted from one y-direction anemometer 321ba (or 321bb).
Wind direction and wind velocity detector 311 detects wind direction and wind velocity around omnidirectional microphone array device 2kb on the basis of outputs of x-direction anemometers 321aa and 32 lab and outputs of y-direction anemometers 321ba and 321bb, and outputs measured values of wind direction and wind velocity to controller 281. Meanwhile, since a method of measuring wind direction and wind velocity with wind direction and wind velocity detector 311, x-direction anemometers 321aa and 321ab, and y-direction anemometers 321ba and 321bb is a known technique, a description thereof will be omitted here.
Controller 281 acquires measured values of temperature detector TS, humidity detector HS, atmospheric pressure detector AS, and wind direction and wind velocity detector 311, outputs the acquired measured values to transmitter 291, and gives an instruction for adding the measured values to packet PKT (see
Here, correction of sound velocity Vs using wind direction and wind velocity will be described with reference to
When a target sound (for example, sound “” emitted by person HM) is present in a direction of (θ, φ) (sound collection direction) from omnidirectional microphone array device 2kb and wind blows in a +x-direction of an x-y plane, sound velocity Vs changes by vector components in the sound collection direction of wind velocity Vw. For this reason, as expressed as Expression (7), velocity based on the wind direction and wind velocity Vw are added to or subtracted from sound velocity Vs (see Expression (4)) which is calculated using temperature data, humidity data, and atmospheric pressure data. The first term on the right side of Expression (7) is wind velocity Vs which is calculated in accordance with Expression (4).
Vs′=Vs(T,P,H)+Vw×cos θ×cos φ (7)
In
As described above, in the fourth example of the calculation of sound velocity Vs, directivity control device 3 as an example of a sound velocity correction device according to the disclosure corrects sound velocity Vs to sound velocity Vs′ using data of measured values of temperature, humidity, and atmospheric pressure which are environmental parameters and data of measured values of wind direction and wind velocity around omnidirectional microphone array device 2kb. Thus, even when omnidirectional microphone array device 2kb is installed at a place (for example, outdoors or in the vicinity of air conditioner or a ventilating opening) which tends to be influenced by wind, it is possible to accurately calculate a sound velocity in view of not only the measured values (temperature data, humidity data, atmospheric pressure data) of environmental parameters but also the measured values of the wind direction and the wind velocity.
Fifth Example of Calculation of Sound Velocity Vs
In the present exemplary embodiment, only when each of measured values of temperature, humidity, and atmospheric pressure which are environmental parameters has changed by a predetermined amount or more, omnidirectional microphone array device 2 may transmit the measured value of an environmental parameter which has changed by a predetermined amount or more to directivity control device 3 and recorder device 4 (see
In
Controller 281 determines whether or not humidity data acquired in step S4 has changed by a predetermined amount (for example, 10 [%]) or more based on the humidity data (S32). When the humidity data has changed by a predetermined amount or more (S32, YES), the controller outputs the humidity data, indicating a measured value of humidity, which is acquired in step S4 to transmitter 291 and gives an instruction for the adding of the humidity data to packet PKT (S5). On the other hand, when the humidity data has not changed by a predetermined amount or more (S32, NO), the processing of controller 281 proceeds to step S6.
Similarly, controller 281 determines whether or not atmospheric pressure data acquired in step S6 has changed by a predetermined amount (for example, 0.1 [atmospheric pressure]) or more based on the atmospheric pressure data (S33). When the atmospheric pressure data has changed by a predetermined amount or more (S33, YES), the controller outputs the atmospheric pressure data, indicating a measured value of atmospheric pressure, which is acquired in step S6 to transmitter 291 and gives an instruction for the adding of the atmospheric pressure data to packet PKT (S7). On the other hand, when the atmospheric pressure data has not changed by a predetermined amount or more (S33, NO), the processing of controller 281 proceeds to step S8. The process of step S8 is the same as that in
In
Sound velocity corrector 34b determines whether or not humidity data is included in packet PKT received by communicator 31 in step S11 (S43). When it is determined that the humidity data is included (S43, YES), the humidity data is extracted and is stored in memory 38 (S13, S22). On the other hand, when the humidity data is not included (S43, NO), sound velocity corrector 34b acquires the humidity data (that is, humidity data, measured last time, which has not changed by a predetermined amount or more) which is stored in memory 38 (S44).
Similarly, sound velocity corrector 34b determines whether or not atmospheric pressure data is included in packet PKT received by communicator 31 in step S11 (S45). When it is determined that the atmospheric pressure data is included (S45, YES), the atmospheric pressure data is extracted and is stored in memory 38 (S14, S24). On the other hand, when the atmospheric pressure data is not included (S45, NO), sound velocity corrector 34b acquires the atmospheric pressure data (that is, atmospheric pressure data, measured last time, which has not changed by a predetermined amount or more) which is stored in memory 38 (S46). The operations subsequent to step S24 or step S46 are the same as the operation in step S15 and the subsequent operations illustrated in
As described above, in the fifth example of the calculation of sound velocity Vs, only when each of measured values of temperature, humidity, and atmospheric pressure which are environmental parameters periodically measured has changed by a predetermined amount or more based on each measured value, directivity control device 3 as an example of a sound velocity correction device according to the disclosure corrects a sound velocity using the changed measured values of the environmental parameters. Accordingly, it is possible to reduce the number of times of correction of the sound velocity under an environment where surrounding environmental parameters do not change frequently and to reduce processing load required for the correction of a sound velocity.
Sixth Example of Calculation of Sound Velocity Vs
In the present exemplary embodiment, only when a certain period of time elapses after temperature, humidity, and atmospheric pressure which are environmental parameters are measured, omnidirectional microphone array device 2 may transmit temperature data, humidity data, and atmospheric pressure data which are measured values of the environmental parameters to directivity control device 3 and recorder device 4 (see
In
As described above, in the sixth example of the calculation of sound velocity Vs, since the next measurement is not performed before a certain period of time elapses after temperature, humidity, and atmospheric pressure which are environmental parameters are measured, directivity control device 3 as an example of a sound velocity correction device according to the disclosure can reduce the number of times of the correction of a sound velocity and to reduce processing load required for the correction of a sound velocity because a sound velocity hardly changes even when the number of times of the measurement of temperature, humidity, and atmospheric pressure which are environmental parameters is reduced under an environment where surrounding environmental parameters do not change frequently.
Meanwhile, when there is no environmental parameter information when an operation is started, directivity control device 3 may calculate the directing direction from a reference sound velocity which is set in memory 38 in advance.
Seventh Example of Calculation of Sound Velocity Vs
In
Sound velocity corrector 34b calculates sound velocity Vs in accordance with Expression (4) using temperature data extracted in step S12, humidity data extracted in step S13, and atmospheric pressure data extracted in step S14 (S15), and stores data of the calculated sound velocity Vs in memory 38 (S52). Further, sound velocity corrector 34b extracts the data of the wind direction and the wind velocity which is acquired from communicator 31 in step S51 and stores the extracted data in memory 38 (S53, S54).
After the directing direction (that is, the sound collection direction (θ, φ) illustrated in
As illustrated in
As illustrated in
As described above, in directivity control system 10A according to the present exemplary embodiment, directivity control device 3 as an example of a sound velocity correction device according to the disclosure corrects sound velocity Vs to sound velocity Vs′ using pieces of data of measured values of temperature, humidity, atmospheric pressure, and wind direction and wind velocity which are environmental parameters measured by environmental parameter measurement device EPM. Thus, even when omnidirectional microphone array device 2kb is installed at a place (for example, outdoors or in the vicinity of air conditioner or a ventilation opening) which tends to be influenced by wind, it is possible to accurately calculate a sound velocity in view of not only the measured values (temperature data, humidity data, atmospheric pressure data) of environmental parameters but also the measured values of the wind direction and the wind velocity.
When omnidirectional microphone array device 2 is installed outdoors, the omnidirectional microphone array device is affected by wind. Thus, not only a change in sound velocity but also the occurrence of an error of a sound source direction due to the bending of a propagation path of sound waves, in other words, a change in an incident angle of a sound wave incident on each microphone element of omnidirectional microphone array device 2 is considered.
Consequently, for example, camera device C11 estimates a distance between camera device C11 and a sound source on the basis of an image obtained by camera device C11, calculates a transmission time of sound waves using the estimated value of the distance between camera device C11 and the sound source and corrected sound velocity Vs′, and transmits the calculated transmission time to omnidirectional microphone array device 2. Omnidirectional microphone array device 2 may correct an incident angle of a sound wave incident on each microphone element using the transmission time transmitted from camera device C11.
Eighth Example of Calculation of Sound Velocity Vs
Meanwhile, in the first exemplary embodiment, in an environment that does not significantly change, for example, because omnidirectional microphone array device 2 is installed indoors, in other words, in an environment where temperature data, humidity data, and atmospheric pressure data which are environmental parameters are not likely to change, an average value of the temperature data, the humidity data, and the atmospheric pressure data which are environmental parameters may be input during initial setting, and a sound velocity may be corrected using the input value (see
In
As described above, in the eighth example of the calculation of sound velocity Vs, when a difference between a measured value of an environmental parameter which is periodically measured and a predetermined setting value (for example, an initial setting value) of the environmental parameter is less than a predetermined value, directivity control device 3 as an example of a sound velocity correction device according to the disclosure corrects a sound velocity using not the measured value of the environmental parameter, but the predetermined setting value. Accordingly, it is possible to reduce the number of times of correction of the sound velocity under an environment (for example, indoors) where surrounding environmental parameters do not change frequently and to reduce a processing load required for the correction of a sound velocity.
Ninth Example of Calculation of Sound Velocity Vs
Initial setting values of temperature data, humidity data, and atmospheric pressure data which are environmental parameters are input in advance during initial setting. When an environment during sound collection performed by omnidirectional microphone array device 2 is significantly different from that during initial setting, sound velocity corrector 34b may calculate (correct) sound velocity Vs using the temperature data, the humidity data, and the atmospheric pressure data which are environmental parameters which are input from operator 32 by a user's operation (see
In
When temperature data, humidity data, and atmospheric pressure data which are environmental parameters are input from operator 32 by a user's operation after step S61 is performed (S62, YES), sound velocity corrector 34b acquires the input values of the temperature data, the humidity data, and the atmospheric pressure data (S63), and calculates sound velocity Vs in accordance with Expression (4) to Expression (6) (S64).
On the other hand, when temperature data, humidity data, and atmospheric pressure data which are environmental parameters are not input from operator 32 by a user's operation (S62, NO), sound velocity corrector 34b acquires predetermined setting values (for example, initial setting values) of temperature data, humidity data, and atmospheric pressure data which are stored in memory 38 in advance (S65), and calculates sound velocity Vs in accordance with Expression (4) to Expression (6) (S66). The operation subsequent to step S64 or step S66 is the same as step S16 illustrated in
As described above, in the ninth example of the calculation of sound velocity Vs, only when temperature data, humidity data, and atmospheric pressure data which are measured values of environmental parameters are input from operator 32, directivity control device 3 as an example of a sound velocity correction device according to the disclosure corrects sound velocity Vs using the input values of the temperature data, the humidity data, and the atmospheric pressure data. Accordingly, measured values of environmental parameters may not be input under user's determination, for example, in an environment where surrounding environmental parameters do not change frequently. Thus, it is possible to reduce the number of times of correction of the sound velocity and to reduce processing load required for the correction of a sound velocity, unlike in a case where a sound velocity is corrected using periodic measured values of environmental parameters.
Tenth Example of Calculation of Sound Velocity Vs
In
Sound velocity corrector 34b extracts the time stamp acquired from communicator 31 in step S61 (S71). The sound velocity corrector acquires temperature data, humidity data, atmospheric pressure data, and data of wind direction and wind velocity which correspond to the time stamp from external database EXDB and reads out the acquired data (S72). Sound velocity corrector 34b calculates sound velocity Vs in accordance with Expression (4) to Expression (6) using the temperature data, the humidity data, and the atmospheric pressure data which are read out in step S72 (S15). Sound velocity corrector 34b stores sound velocity Vs calculated in step S15 in memory 38 (S52).
Further, sound velocity corrector 34b extracts the data of the wind direction and the wind velocity read out in step S72 (S73), and stores the data of the wind direction and the wind velocity in memory 38 (S54). Sound velocity corrector 34b corrects sound velocity Vs stored in memory 38 in step S52 to sound velocity Vs′ in accordance with Expression (7) (S74). The operation subsequent to step S74 is the same as step S16 illustrated in
As illustrated in
As illustrated in
As described above, in the ninth example of the calculation of sound velocity Vs, directivity control device 3 as an example of a sound velocity correction device according to the disclosure acquires measured values of environmental parameters corresponding to an installation position of omnidirectional microphone array device 2 from external database EXDB in which measured values of temperature data, humidity data, atmospheric pressure data, data of wind direction and wind velocity, which are environmental parameters, for each region are stored in association with a measurement date and time and a measurement time. Accordingly, it is possible to calculate an accurate sound velocity using measured values of surrounding environmental parameters during sound collection performed by omnidirectional microphone array device 2.
Although various exemplary embodiments have been described with reference to the accompanying drawings, it is needless to say that the disclosure is not limited to the examples. It is apparent that those skilled in the art can make various changes and modifications within the scope described in the claims, and it is understood that the changes and the modifications obviously belong to the technical scope of the disclosure.
The disclosure is useful as a sound velocity correction device that suppresses deterioration in directivity formation accuracy by acquiring at least ambient temperature, humidity, and atmospheric pressure during the collection of a sound emitted from a sound source in a specific direction when seen from a microphone array device and calculating an accurate sound velocity.
Number | Date | Country | Kind |
---|---|---|---|
2014-145367 | Jul 2014 | JP | national |