1. Field of the Invention
The present invention relates to a directivity control system, a directivity control method, a sound collection system and a sound collection control method of forming directivity of a sound in a directivity direction oriented from a microphone array apparatus to a prearranged sound position.
2. Description of the Related Art
In the past, in monitoring systems installed at predetermined positions (for example, ceilings) of factories or stores (for example, retail stores or banks) or public places (for example, libraries), wide angles of view of video data (including still images and moving images, and the same applies hereinafter) of predetermined ranges of monitoring targets have been contrived by connecting a plurality of camera apparatuses (for example, pan-tilt camera apparatuses or omnidirectional camera apparatuses) via networks.
Since the amount of information obtained from monitoring of only videos are restricted anyhow, there have been high demands for monitoring systems obtaining sound data in directions (hereinafter, referred to as “imaging directions”) in which specific subjects are imaged by camera apparatuses by disposing not only the camera apparatus but also microphone array apparatuses.
Here, a control apparatus is known which obtains sound data of a subject present in an imaging direction of a camera apparatus by controlling operations of the camera apparatus and a microphone array apparatus (for example, see JP-A-2012-186551). The control apparatus disclosed in JP-A-2012-186551 is installed in a conference room in which, for example, a TV conference system can be used and controls the operations of the camera apparatus which can be operated in a horizontal direction (pan direction) and the microphone array apparatus which can change a sound collection range.
The control apparatus disclosed in JP-A-2012-186551 changes the sound collection range of the microphone array apparatus based on a distance between the position of the camera apparatus and the position of a subject pictured in an image obtained by the camera apparatus, a pan direction of the camera apparatus, a distance between the position of the camera apparatus and the position of the microphone array apparatus, and a direction of the position of the microphone array apparatus with reference to the position of the camera apparatus.
In JP-A-2012-186551, for example, a usage in the television conference system is supposed and it is assumed that the camera apparatus, the microphone array apparatus, and a subject (for example, a speaking person) are present on the same plane. In the above-described monitoring system, however, cases in which the camera apparatus, the microphone array apparatus, and all of the subjects (for example, shop assistants or guests in a store) are actually present on the same plane are infrequent.
For example, since the camera apparatus and the microphone array apparatus are installed on an upward side (for example, a ceiling surface of a store) from a subject in many cases, the camera apparatus, the microphone array apparatus, and the subject are not present on planar two-dimensional coordinates, but rather are present on stereoscopic three-dimensional coordinates in many cases.
Accordingly, when the microphone array apparatus collects a sound of dialog of a subject in a video captured by the camera apparatus in the above-described monitoring system, there is a problem that it is difficult to directly use coordinates (a horizontal angle and a vertical angle) calculated according to the method of JP-A-2012-186551 and indicating a direction in which the microphone array apparatus collects a sound.
According to a place (for example, a store) in which the monitoring system is introduced, it is desirable to determine a directivity direction in advance to collect a sound at a position at which the microphone array apparatus is preset, for example, even in a case in which no camera apparatus is installed in the monitoring system, when a prearranged sound position (hereinafter referred to as a “preset position”) at which a sound is desired to be acquired in the store is determined.
A non-limited object of the present invention is to provide a directivity control system and a directivity control method outputting a clear sound of an object present in a direction oriented from a microphone array apparatus to a preset position by calculating a directivity direction oriented from the microphone array apparatus to the preset position and forming directivity in the calculated directivity direction.
A first aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a designation screen used to designate a directivity direction oriented from the sound collection unit to a first sound position; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the first sound position corresponding to the designated directivity direction in accordance with a designation of the directivity direction on the designation screen displayed by the display unit; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit.
A second aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas or a designation screen of a directivity direction oriented from the sound collection unit to a third arbitrary sound position in the one or more sound collection areas; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged second sound position corresponding to the directivity direction as set in accordance with a set value of the directivity direction on the setting screen displayed by the display unit; a storage unit, configured to store the horizontal angle and the vertical angle calculated for each of the prearranged second sound positions in the sound collection areas in association with each of the prearranged second sound positions in the sound collection areas; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit, wherein the directivity direction calculation unit calculates the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the designation screen displayed by the display unit, based on the horizontal angle and the vertical angle corresponding to the prearranged second sound position in the sound collection area stored in the storage unit.
A third aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas or a designation screen of a directivity direction oriented from the sound collection unit to a third arbitrary sound position in the one or more sound collection areas; a storage unit, configured to store a set value of the one or more directivity directions on the setting screen displayed by the display unit in association with the prearranged second sound position in the sound collection area; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle up to the prearranged second sound position corresponding to the directivity direction based on the set value of the directivity direction stored in the storage unit; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit, wherein the set value of the directivity direction indicates a horizontal distance and a horizontal angle or a first horizontal distance and a second horizontal distance from the sound collection unit to the prearranged second sound position, and the directivity direction calculation unit calculates the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one or more sound collection areas on the designation screen displayed by the display unit, based on the set value of the horizontal angle and the vertical angle corresponding to the prearranged second sound position in the sound collection area stored in the storage unit.
A fourth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a designation screen used to designate a directivity direction oriented from the sound collection unit to a first sound position; calculating a horizontal angle and a vertical angle from the sound collection unit to the first sound position corresponding to the directivity direction as designated in accordance with designation of the directivity direction on the displayed designation screen; and forming directivity of the sound collected by the sound collection unit based on the calculated horizontal angle and the calculated vertical angle.
A fifth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged second sound position corresponding to the directivity direction as set in accordance with a set value of the directivity direction on the displayed setting screen; storing the horizontal angle and the vertical angle calculated for each of the prearranged second sound positions in the sound collection areas in association with each of the prearranged second sound positions in the sound collection areas; displaying a designation screen of the directivity direction oriented from the sound collection unit to the third arbitrary sound position on the one or more sound collection areas; calculating the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the displayed designation screen, based on the stored directivity direction of each of the prearranged second sound positions in the sound collection areas; and forming directivity of the sound collected by the sound collection unit based on the calculated horizontal angle and the calculated vertical angle.
A sixth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas; storing a set value of the directivity direction on the displayed setting screen in association with the prearranged second sound position in the sound collection area; calculating a horizontal angle and a vertical angle up to the prearranged second sound position corresponding to the directivity direction based on the stored set value of the directivity direction; displaying a designation screen of the directivity direction oriented from the sound collection unit to the third arbitrary sound position on the one or more sound collection areas; and calculating the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the displayed designation screen, based on the stored set value of the directivity direction of each of the prearranged second sound positions in the sound collection areas, wherein the set value of the directivity direction indicates a horizontal distance and a horizontal angle or a first horizontal distance and a second horizontal distance from the sound collection unit to the prearranged second sound position.
A seventh aspect of the present invention provides a sound collection system including: a sound collection unit, configured to collect a sound; a first camera apparatus that has a same reference coordinate system as the sound collection unit; a display unit, configured to display a designation screen used to designate a position corresponding to one or more prearranged fourth sound positions from a captured image of the first camera apparatus; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged fourth sound position in accordance with designation of the position corresponding to the prearranged fourth sound position on the designation screen; a storage unit, configured to store the horizontal angle and the vertical angle acquired for each of the prearranged fourth sound positions in association with the prearranged fourth sound position; and a directivity control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fourth sound positions.
An eighth aspect of the present invention provides a sound collection system including: a sound collection unit, configured to collect a sound; a first camera apparatus that has a same reference coordinate system as the sound collection unit; one or more second camera apparatuses, configured to image predetermined different sound collection areas; a display unit, configured to display a designation screen used to designate a position corresponding to one or more prearranged fifth sound positions from a captured image of the first camera apparatus corresponding to any one selected from the second camera apparatuses; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged fifth sound position in accordance with designation of the position corresponding to the prearranged fifth sound position on the designation screen; a storage unit, configured to store the horizontal angle and the vertical angle acquired for each of the prearranged fifth sound positions, in association with the prearranged fifth sound position; and a directivity control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fifth sound positions.
A ninth aspect of the present invention provides a sound collection control method in a sound collection system including a sound collection unit that collects a sound, the sound collection control method including: displaying a captured image captured by a first camera apparatus having a same reference coordinate system as the sound collection unit; displaying a designation screen used to designate a position corresponding to one or more prearranged fourth sound positions from the captured image of the first camera apparatus; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged fourth sound position in accordance with designation of the position corresponding to the prearranged fourth sound position on the designation screen; storing the horizontal angle and the vertical angle acquired for each of the prearranged fourth sound positions in association with the prearranged fourth sound position in a storage unit; and forming directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fourth sound positions in the storage unit.
A tenth aspect of the present invention provides a sound collection control method in a sound collection system including a sound collection unit that collects a sound, the sound collection control method including: displaying a captured image captured by a first camera apparatus having a same reference coordinate system as the sound collection unit; receiving a selection of one or more second camera apparatuses that image different predetermined sound collection areas; displaying a designation screen used to designate a position corresponding to one or more prearranged fifth sound positions from a captured image of the first camera apparatus corresponding to a captured image of any one selected from the second camera apparatuses; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged fifth sound position in accordance with designation of the position corresponding to the prearranged fifth sound position on the designation screen; storing the horizontal angle and the vertical angle acquired for each of the prearranged fifth sound positions in association with the prearranged fifth sound position in a storage unit; and forming directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fifth sound positions in the storage unit.
According to non-limited aspects of the present invention, it is possible to output a clear sound of an object present in a direction oriented from a microphone array apparatus to a preset position by calculating a directivity direction oriented from the microphone array apparatus to the preset position and forming directivity in the calculated directivity direction.
According to non-limited aspects of the present invention, it is possible to easily acquire a directivity direction oriented from a microphone array apparatus to a prearranged sound position and to output a clear sound of an object present in a direction oriented from the microphone array apparatus to the prearranged sound position.
In the accompanying drawings:
Hereinafter, embodiments of a directivity control system and a directivity control method according to the present invention will be described with reference to the drawings. In the embodiments, the directivity control system is used as a monitoring system (including a manned monitoring system and an unmanned monitoring system) installed in, for example, a factory, a public facility (for example, a library or an event place), or a store (for example, a retail store or a bank), but the present invention is not particularly limited thereto. In the embodiments, the directivity control system according to the embodiments will be described on the assumption that the directivity system is installed in, for example, a store.
The present invention can be expressed as each apparatus (for example, a directivity control apparatus to be described below) included in the directivity control system or a directivity control method including each operation (step) performed by each apparatus (for example, a directivity control apparatus to be described below) included in the directivity control system.
The omnidirectional microphone array apparatus 2 includes a casing 21C (see
In the omnidirectional microphone array apparatus 2, a plurality of microphone units 22 are disposed concentrically around the opening 21a and along the circumferential direction of the casing 21c. In the microphone unit 22, for example, an electret condenser microphone (ECM) with high sound quality and a small size is used and the same also applies to the following embodiments.
In the directivity control system 10 illustrated in
The omnidirectional microphone array apparatus 2 is connected to the network NW and includes at least the microphone units 22 and 23 (see
The omnidirectional microphone array apparatus 2 collects a sound in the directivity direction in which a target that is a sound collection target is present using the microphones 22 and 23 and transmits sound data collected by the microphone units 22 and 23 to the directivity control apparatus 3 or the recorder apparatus 4 via the network NW.
The omnidirectional microphone array apparatus 2 forms directivity of each of the microphone units 22 and 23 in a directivity direction (θMAh, θMAv) calculated by a direction directivity calculation unit 34 of a signal processing unit 33 of the directivity control apparatus 3 in response to a directivity forming instruction from the directivity control apparatus 3 to be described below.
Thus, the omnidirectional microphone array apparatus 2 can relatively increase a volume level of a sound collected in the directivity direction (θMAh, θMAv) in which the directivity is formed and can relatively reduce a volume level of a sound collected in a direction in which the directivity is not formed. A method of calculating the directivity direction (θMAh, θMAv) will be described below.
The microphone units 22 and 23 of the omnidirectional microphone array apparatus 2 may each be a non-directional microphone, a bi-directional microphone, a unidirectional microphone, a sharp directional microphone, a super-directional microphone (for example, a shot-gun microphone), or a combination thereof.
The directivity control apparatus 3 may be a stationary personal computer (PC) connected to the network NW and installed in, for example, a monitoring system control room (not illustrated) or may be a data communication terminal which can be carried by a user, such as a portable telephone, a tablet terminal, or a smartphone.
The directivity control apparatus 3 includes at least a communication unit 31, a manipulation unit 32, the signal processing unit 33, a display apparatus 36, a speaker apparatus 37, and a memory 38. The signal processing unit 33 includes the directivity direction calculation unit 34 and an output control unit 35.
The communication unit 31 receives sound data transmitted by the omnidirectional microphone array apparatus 2 and outputs the sound data to the signal processing unit 33 via the network NW.
The manipulation unit 32 is a user interface (UI) for notifying the signal processing unit 33 of content of an input manipulation of the user and is a pointing apparatus such as a mouse or a keyboard. The manipulation unit 32 may be disposed to correspond to a screen of the display apparatus 36 and may be configured using a touch panel or a touch pad on which an input manipulation can be performed with a finger FG of the user or a stylus pen.
The manipulation unit 32 acquires coordinate data indicating a place where the user desires to increase or decrease a volume level of a sound, i.e., a designation position A′ on a directivity direction designation screen illustrated in
The signal processing unit 33 is configured using a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP) and performs a control process of overall controlling the operation of each unit of the directivity control apparatus 3 as a whole, a process of inputting and outputting data with each of the other units, a process of computing (calculating) data, and a process of storing data.
The directivity direction calculation unit 34 calculates coordinates (θMAh, θMAv) indicating a directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A corresponding to the designation position A′ according to designation of an arbitrary position (=the designation position A′) by the user on the directivity direction designation screen (see
In the coordinates (θMAh, θMAv) indicating the directivity direction, θMAh indicates a horizontal angle of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A and θMAv indicates a vertical angle of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A. The sound position A is a position which corresponds to the designation position A′ designated with the finger FG of the user of a stylus pen on the directivity direction designation screen displayed on the display apparatus 36 by the manipulation unit 32 and which is the position of an actual site to be actually monitored (see
Here, the directivity direction designation screen will be described with reference to
On the directivity direction designation screen illustrated in
For example, as illustrated in
On the directivity direction designation screen illustrated in
For example, as illustrated in
The output control unit 35 serving as a control unit controls operations of the omnidirectional microphone array apparatus 2, the display apparatus 36, and the speaker apparatus 37. For example, in response to an input manipulation of the user, the output control unit 35 displays the directivity direction designation screen illustrated in
The display apparatus 36 serving as a display unit displays a directivity direction designation screen used to designate a directivity direction oriented from a position at which the omnidirectional microphone array apparatus 2 is installed to the sound position A at which a target is present under the control of the signal processing unit 33 in response to, for example, an input manipulation of the user.
The speaker apparatus 37 serving as a sound output unit outputs, as a sound, the sound data collected by the omnidirectional microphone array apparatus 2 or the sound data collected by the omnidirectional microphone array apparatus 2 after the directivity is formed in the directivity direction (θMAh, θMAv) calculated by the directivity direction calculation unit 34. The display apparatus 36 and the speaker apparatus 37 may be configured independently from the directivity control apparatus 3.
The memory 38 serving as a storage unit is configured using, for example, a random access memory (RAM), functions as a work memory when each unit of the directivity control apparatus 3 operates, and stores data necessary when each unit of the directivity control apparatus 3 operates.
The recorder apparatus 4 records the sound data collected by the omnidirectional microphone array apparatus 2. When one or more camera apparatuses are included in the directivity control system 10 illustrated in
The omnidirectional microphone array apparatus 2 illustrated in
An omnidirectional microphone array apparatus 2A illustrated in
An omnidirectional microphone array apparatus 2B illustrated in
An omnidirectional microphone array apparatus 2C illustrated in
An omnidirectional microphone array apparatus 2D illustrated in
The sound source 80 is, for example, a target (for example, two persons illustrated in
The sound waves generated from the sound source 80 first arrive at the microphone 221 so that a sound is collected and then arrive at the microphone 222 so that the sound is collected, the sound is likewise collected in sequence, and the sound waves finally arrive at the microphone 22n so that the sound is collected.
A direction oriented from the position of each of the microphones 221, 222, 223, . . . , 22(n−1), and 22n of the omnidirectional microphone array apparatus 2 to the sound source 80 is the same as, for example, a direction oriented from each microphone of the omnidirectional microphone array apparatus 2 to the sound source A corresponding to the designation position A′ designated on the screen of the display apparatus 36 by the user, when the sound source 80 is a sound at the time of dialog of the persons.
Here, arrival time differences τ1, τ2, τ3, . . . , and τn−1 occur between times at which the sound waves arrive at the microphones 221, 222, 223, . . . , and 22(n−1) and a time at which the sound waves arrive at the microphone 22n and the sound is collected finally. Therefore, when sound data collected by the microphones 221, 222, 223, . . . , 22(n−1), and 22n are added without change, the sound data is added in a state in which phases are deviated, and thus volume levels of the sound waves may be weakened overall.
Further, τ1 is a time difference between a time at which the sound waves arrive at the microphone 221 and a time at which the sound waves arrive at the microphone 22n, τ2 is a time difference between a time at which the sound waves arrive at the microphone 222 and the time at which the sound waves arrive at the microphone 22n, and τn−1 is likewise a time difference between a time at which the sound waves arrive at the microphone 22(n−1) and the time at which the sound waves arrive at the microphone 22n.
In the embodiment, the omnidirectional microphone array apparatus 2 includes A/D converters 241, 242, 243, . . . , 24(n−1), and 24n and delay units 251, 252, 253, . . . , 25(n−1), and 25n installed to correspond to the microphones 221, 222, 223, . . . , 22(n−1), and 22n and an adder 26 (see
That is, in the omnidirectional microphone array apparatus 2, the A/D converters 241, 242, 243, . . . , 24(n−1), and 24n perform AD conversion on analog sound data collected by the microphones 221, 222, 223, . . . , 22(n−1), and 22n to obtain digital sound data.
In the omnidirectional microphone array apparatus 2, the delay units 251, 252, 253, . . . . , 25(n−1), and 25n give delay times corresponding to the arrival time differences in the microphones 221, 222, 223, . . . , 22(n−1), and 22n to arrange the phases of all of the sound waves, and subsequently the adder 26 adds the sound data subjected to the delay process. Thus, the omnidirectional microphone array apparatus 2 can form directivity of the sound data in the direction of the predetermined angle θ in the microphones 221, 222, 223, . . . , 22(n−1), and 22n.
For example, in
L1 is a difference in a sound wave arrival distance between the microphone 221 and the microphone 22n. L2 is a difference in a sound wave arrival distance between the microphone 222 and the microphone 22n. L3 is a difference in a sound wave arrival distance between the microphone 223 and the microphone 22n. Likewise, L(n−1) is a difference in a sound wave arrival distance between the microphone 22(n−1) and the microphone 22n. Vs is a speed (sound speed) of the sound waves. L1, L2, L3, . . . , L(n−1), and Vs are known values. In
Thus, the omnidirectional microphone array apparatus 2 can simply form the directivity of the sound data collected by the microphones 221, 222, 223, . . . , 22(n−1), and 22n included in the microphone units 22 or the microphone units 23 by changing the delay times D1, D2, D3, . . . , Dn−1, and Dn set in the delay units 251, 252, 253, . . . , 25(n−1), and 25n.
The description has been made on the assumption that the process described with reference to
Next, a detailed operation order of the directivity control system 10 according to the embodiment will be described with reference to
In
After step ST11, the directivity control apparatus 3 causes the display apparatus 36 to display the directivity direction designation screen illustrated in
Thus, when the arbitrary designation position A′ is designated with the finger FG of the user on, for example, the directivity direction designation screen illustrated in
After step ST12, the directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle (θMAh, θMAh) of the directivity direction oriented from the installation position of the omnidirectional microphone array apparatus 2 to the sound position A corresponding to the designation position A′ designated in step ST12 based on the coordinate data of (horizontal distance, horizontal angle) or (first horizontal distance, second horizontal distance) acquired in step ST12, the height HM of the omnidirectional microphone array apparatus 2 from the reference surface (for example, a floor surface of a store, the same applies hereinafter), and a height HA of the sound position A from a reference surface (for example, a floor surface of a store, the same applies hereinafter) (ST13). The details of the operation of step ST13 will be described below with reference to
Thus, the directivity control apparatus 3 can simply calculate the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A corresponding to the arbitrary designation position A′ designated on the directivity direction designation screen by the user.
The output control unit 35 of the directivity control apparatus 3 transmits a directivity forming instruction including data of the coordinates (θMAh, θMAv) indicating the directivity direction calculated in step ST13 to the omnidirectional microphone array apparatus 2. The omnidirectional microphone array apparatus 2 forms the directivity of each of the microphone units 22 and 23 in the sound collection direction of the sound collection direction coordinates (θMAh, θMAv) calculated by the directivity control apparatus 3 in response to the directivity forming instruction from the directivity control apparatus 3 (ST14).
Thus, the omnidirectional microphone array apparatus 2 can relatively increase the volume level of the sound data collected in the sound collection direction decided by the sound collection direction coordinates (θMAh, θMAv) in which the directivity is formed and can relatively reduce the volume level of the sound data collected in the direction in which no directivity is formed.
In the directivity control system 10 according to the embodiment, a timing at which the omnidirectional microphone array apparatus 2 collects the sound is not limited to a time immediately after step ST14, but may be, for example, a time at which the omnidirectional microphone array apparatus 2 is turned on. The same also applies to each embodiment to be described below.
(Method of Calculating Coordinates (θMAh, θMAv) Indicating Directivity Direction of Omnidirectional Microphone Array Apparatus 2)
Next, a method of calculating the coordinates (θMAh, θMAv) indicating the directivity direction in the directivity control apparatus 3 will be described in detail with reference to
(First Calculation Method: See
In response to the designation of the arbitrary designation position A′ by the user on the directivity direction designation screen (see
(1) the height HM of the omnidirectional microphone array apparatus 2 from the floor surface measured in step ST11;
(2) the coordinate data of (horizontal distance, horizontal angle)=(LA, θA) of the designation position A′ obtained in step ST12; and
(3) the height HA of the sound position A from the floor surface. The horizontal angle θMAh of the directivity direction is the same as the horizontal angle θA obtained in step ST12.
(3) The height HA of the sound position A from the horizontal surface is a fixed value determined in advance. Alternatively, the height HA is a value input or selected as HA of the height of a person when the person is present around the sound position A, for example, when the designation position A′ is designated with the finger FG of the user on the directivity direction designation screen.
Hereinafter, a first calculation method and a second calculation method for the directivity direction (θMAh, θMAv) in the directivity direction calculation unit 34 will be described specifically. First, as the assumption of the description of the first calculation method and the second calculation method, a reference direction (for example, a 0° direction) of the horizontal angle necessary at the time of determination of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2 is assumed to be known and be, for example, a direction oriented from a point Y′ to a point Y of the horizontal Y axis illustrated in
The directivity direction calculation unit 34 determines that the horizontal angle θMAh of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A is the same as ∠AMY illustrated in
The directivity direction calculation unit 34 calculates the vertical angle θMAv of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A according to Equation (2) based on the horizontal distance LA from the omnidirectional microphone array apparatus 2 to the sound position A obtained in step ST12, the height HM of the omnidirectional microphone array apparatus 2 from the floor surface, and the height HA of the sound position A from the floor surface in ΔAMP illustrated in
(Second Calculation Method: See
In response to the designation of the arbitrary designation position A by the user on the directivity direction designation screen (see
(1) the height HM of the omnidirectional microphone array apparatus 2 from the floor surface measured in step ST11;
(2) the coordinate data of (first horizontal distance, second horizontal distance)=(LAx, LAy) of the designation position A′ obtained in step ST12; and
(3) the height HA of the sound position A from the floor surface.
The directivity direction calculation unit 34 calculates the horizontal angle θMAh of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A according to Equation (3) based on the first horizontal distance LAx and the second horizontal distance LAy obtained in step ST12 in ΔAMY0 or ΔAMX0 illustrated in
The directivity direction calculation unit 34 calculates the vertical angle θMAv of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A according to Equation (4) based on the first horizontal distance LAx and the second horizontal distance LAy from the omnidirectional microphone array apparatus 2 to the sound position A obtained in step ST12, the height HM of the omnidirectional microphone array apparatus 2 from the floor surface, and the height HA of the sound position A from the floor surface in ΔAMP illustrated in
As described above, in the directivity control system 10 according to the embodiment, the directivity direction designation screen used to designate the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A at which a target is present is displayed by the display apparatus 36. The directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the sound position A corresponding in the designated directivity direction according to the designation of the directivity direction on the directivity direction designation screen displayed by the display apparatus 36. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the collected sound based on the calculated horizontal angle and vertical angle.
Thus, in the directivity control system 10, the directivity control apparatus 3 can calculate the horizontal angle and the vertical angle indicating the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A designated on the directivity direction designation screen. Further, the directivity control apparatus 3 can form the directivity to output a clear sound of a target which the user desires to hear based on the calculated horizontal angle and vertical angle of the directivity direction, and thus the clear sound of the target present at the corresponding sound position A can be output.
In the embodiment, the horizontal distance and the horizontal angle from the omnidirectional microphone array apparatus 2 to the sound position A are displayed on the directivity direction designation screen displayed by the display apparatus 36. Accordingly, the directivity direction calculation unit 34 of the directivity control apparatus can simply calculate the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the sound position A based on the height HM of the omnidirectional microphone array apparatus 2 from the floor surface, the height HA of the sound position A from the floor surface, and the the horizontal distance LA and the horizontal angle θA from the omnidirectional microphone array apparatus 2 to the sound position A.
In the embodiment, the first horizontal distance LAx and the second horizontal distance LAy from the omnidirectional microphone array apparatus 2 to the sound position A are displayed on the directivity direction designation screen displayed by the display apparatus 36. Accordingly, the directivity direction calculation unit 34 of the directivity control apparatus can simply calculate the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the sound position Abased on the height HM of the omnidirectional microphone array apparatus 2 from the floor surface, the height HA of the sound position A from the floor surface, and the first horizontal distance LAx and the second horizontal distance LAy from the omnidirectional microphone array apparatus 2 to the sound position A.
In a directivity control system 10 according to a second embodiment, one or more sound positions at which a user desires to hear sounds are determined in advance. When one or more prearranged sound positions are designated, a directivity control apparatus 3 calculates coordinates (horizontal angle, vertical angle) indicating directivity directions oriented from an omnidirectional microphone array apparatus 2 to the designated sound positions and stores the calculation result in a memory 38 of the directivity control apparatus 3. In the directivity control system 10 according to the second embodiment, when an arbitrary sound position is designated on a sound position designation screen (see the following description) displayed by a display apparatus 36, the directivity control apparatus 3 calculates coordinates (horizontal angle, vertical angle) indicating a directivity direction oriented from the omnidirectional microphone array apparatus 2 to the designated sound position based on the coordinates (horizontal angle, vertical angle) indicating the directivity direction of the stored prearranged sound position (preset position).
In each embodiment to be described, an actual prearranged sound position at which the user desires to hear a sound in a store in which the directivity control system 10 illustrated in
In an operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3 and the recorder apparatus 4 included in the directivity control system 10 according to the embodiment, the same reference numerals are given to the same content as the operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3, and the recorder apparatus 4 included in the directivity control system 10 according to the first embodiment, description will be omitted or simplified, and other content will be described.
The preset designation position diagram illustrated in
On the preset designation position setting screen displayed by the display apparatus 36 and illustrated in
In the entire sound collection area AR1 illustrated in
A radial coordinate system is shown in
When a direction in which the user desires to hear in
Next, a detailed operation order of the directivity control system 10 according to the embodiment will be described with reference to
In
After step ST11, the directivity control apparatus 3 causes the display apparatus 36 to display the preset designation position setting screen illustrated in
After step ST15, the directivity direction calculation unit 34 of the directivity control apparatus 3 calculates a horizontal angle and a vertical angle (for example, (horizontal angle, vertical angle)=(θhp1, θvp1)) of the directivity direction oriented from the installation position of the omnidirectional microphone array apparatus 2 to the preset position (for example, the preset position P1) corresponding to the preset designation position (for example, the preset designation position P1′) set in step ST15 based on coordinate data of (horizontal distance, horizontal angle) or (first horizontal distance, second horizontal distance) corresponding to the coordinate data set in step ST15, the height HM of the omnidirectional microphone array apparatus 2 from the floor surface, and a height HP1 of the preset position (for example, the preset position P1) from the floor surface (ST16). Since the details of the operation of step ST16 is the same as the first or second calculation method for the horizontal angle and the vertical angle in the above-described first embodiment, the description thereof will be omitted.
The directivity direction calculation unit 34 of the directivity control apparatus 3 stores the horizontal angle and the vertical angle (for example, (horizontal angle, vertical angle)=(θhp1, θvp1)) of the directivity direction oriented to the preset position (for example, the preset position P1), as calculated in step ST16, as the preset value of the preset position (for example, the preset position P1) in the sound collection area in the memory 38 (ST17, see
In step ST15, the setting of the preset designation position may be directly input on a predetermined manipulation screen from the manipulation unit 32 without using the preset designation position setting screen illustrated in
Next, a process of forming the directivity in the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A illustrated in
The directivity control apparatus 3 causes the display apparatus 36 to display the sound position designation screen illustrated in
After step ST19, based on the coordinate data of the designation position A′ acquired in step ST19, the directivity direction calculation unit 34 of the directivity control apparatus 3 determines which sound collection area the sound position A corresponding to the designation position A′ is present in or near the entire sound collection area AR1 (ST20).
The directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle (θMAh, θMAv) of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the actual sound position A according to the determination result of step ST20 (ST20A). Here, when the determination result of step ST20 is one of the following three methods, a calculation example of step ST20A will be described.
That is, the determination result of step ST20 is one of the following cases:
(determination result 1) a case in which a position determined by the coordinate data of the designation position A′ on the sound position designation screen is included in a position in a range of one sound collection area;
(determination result 2) a case in which a position determined by the coordinate data of the designation position A′ on the sound position designation screen is included in a position between ranges of two adjacent sound collection areas; and
(determination result 3) a case in which distances between a position on the sound position designation screen determined by the coordinate data of the designation position A′ and the preset designation positions of a plurality of sound collection areas (for example, n sound collection areas and n is an integer equal to or greater than 3) are equal.
The range of the sound collection area is, for example, an area of a circle or an ellipse of a radius prearranged for each sound collection area and is assumed to be stored in advance in the memory 38 at the time of the initial setting.
Accordingly, when the determination result of step ST20 is the above-described (determination result 1), the directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the preset value of the preset position within the range of the corresponding sound collection area as the horizontal angle and the vertical angle (θMAh, θMAv) of the directivity direction.
When the determination result of step ST20 is the above-described (determination result 2), the directivity direction calculation unit 34 of the directivity control apparatus 3 selects the sound collection area, for which the distance between the designation position A′ and the preset designation position is closer, between two sound collection areas adjacent to each other and calculates the preset value of the preset position within the range of the selected sound collection area as the horizontal angle and the vertical angle (θMAh, θMAv) of the directivity direction.
When the determination result of step ST20 is the above-described (determination result 3), the directivity direction calculation unit 34 of the directivity control apparatus 3 adds and averages the preset values of the preset positions within the ranges of all (for example, n) of the sound collection areas for which the distance between the designation positions A and the preset designation positions on the sound position designation screen are equal and calculates the averaged value as the horizontal angle and the vertical angle (θMAh, θMAv) of the directivity direction (see Equation (6)).
In Equation 6, θih indicates the horizontal angles of the preset values of the preset positions within the ranges of all (for example, n) of the sound collection areas for which the distances between the designation positions A′ and the preset designation positions are equal. Further, θiv indicates the vertical angles of the preset values of the preset positions within the ranges of all (for example, n) of the sound collection areas for which the distances between the designation positions A′ and the preset designation positions are equal.
Thus, the directivity control apparatus 3 can simply calculate the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A corresponding to the arbitrary designation position A′ designated on the preset designation position setting screen by the user.
The output control unit 35 of the directivity control apparatus 3 transmits a directivity forming instruction including data of the coordinates (θMAh, θMAv) indicating the directivity direction calculated in step ST20 to the omnidirectional microphone array apparatus 2. The omnidirectional microphone array apparatus 2 forms the directivity of each of the microphone units 22 and 23 in the sound collection direction of the coordinates (θMAh, θMAv) calculated by the directivity control apparatus 3 in response to the directivity forming instruction from the directivity control apparatus 3 (ST14).
Thus, the omnidirectional microphone array apparatus 2 can relatively increase the volume level of the sound data collected in the sound collection direction decided by the sound collection direction coordinates (θMAh, θMAv) in which the directivity is formed and can relatively reduce the volume level of the sound data collected in the direction in which no directivity is formed.
In the directivity control system 10 according to the embodiment, as described above, the display apparatus 36 displays the preset designation position setting screen used to set the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the prearranged preset position within one or more sound collection areas. The directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the preset position corresponding to the designated preset designation position according to the designation of the preset designation position on the preset designation position setting screen displayed by the display apparatus 36, and then stores the horizontal angle and the vertical angle as the preset value. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the collected sound based on the calculated horizontal angle and vertical angle. Further, when the arbitrary designation position A′ is designated on the sound position designation screen displayed by the display apparatus, the directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle of the directivity direction oriented to an arbitrary sound position A designated by the user based on the determination result obtained by determining in which area of one or more sound collection areas the designation position A′ is present and based on the horizontal angle and the vertical angle of the directivity direction calculated for each preset position within one or more sound collection areas on the preset position designation setting screen. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the collected sound based on the calculated horizontal angle and vertical angle.
Thus, in the directivity control system 10, the directivity control apparatus 3 can simply calculate the horizontal angle and the vertical angle indicating the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position corresponding to the preset designation position designated on the preset designation position setting screen. The directivity control apparatus 3 can form the directivity in which a clear sound of a target which the user desires to hear is output based on the calculated horizontal angle and vertical angle of the directivity direction, and thus can output the clear sound of the target present in the corresponding sound position A. The directivity control apparatus 3 can calculate the horizontal angle and the vertical angle of the directivity direction oriented to the arbitrary sound position A designated on the sound position designation screen by the user based on the horizontal angle and the vertical angle of the directivity direction calculated for each preset position, can form the directivity in the directivity direction, and thus can output the clear sound in the directivity direction oriented to the arbitrary sound position desired by the user.
In the embodiment, the horizontal angle and the vertical angle of the directivity direction are stored as the preset value in the memory 38. However, as in
For example, in step ST20, the directivity direction calculation unit 34 calculates coordinates (horizontal angle, vertical angle) indicating the directivity direction based on the preset values illustrated in
In a directivity control system 10A according to a third embodiment, one or more camera apparatuses C11 to C1n are further included in addition to the configuration of the directivity control system 10 according to the second embodiment (see
In an operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3 and the recorder apparatus 4 included in the directivity control system 10A according to the embodiment, the same reference numerals are given to the same content as the operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3, and the recorder apparatus 4 included in the directivity control system 10 according to the second embodiment, description will be omitted or simplified, and other content will be described.
Each of the camera apparatuses C11 to C1n has a function of a monitoring camera, has a casing including an optical system (for example, a wide-angle lens) and an imaging system (for example, an image sensor) (none of which is illustrated), and is installed on a predetermined installation surface (for example, a ceiling surface in a store). Each of the camera apparatuses C11 to C1n is connected to a host computer (not illustrated) of a central control room via a network (not illustrated) and performs a pan-direction operation, a tilt-direction operation, a zoom operation, an imaging operation on a video within the range of a predetermined angle of view, and the like in response to a remote manipulation from the host computer. Each of the camera apparatuses C11 to C1n transmits captured-video data to the directivity control apparatus 3 or the recorder apparatus 4 via a network NW.
In the embodiment, an imaging range of a video in each of the camera apparatuses C11 to C1n is determined in advance in the preset table illustrated in
In the preset designation position diagram illustrated in
On a sound collection area selection screen WD1 illustrated in
Next, the detailed operation order of the directivity control system 10A according to the embodiment will be described with reference to
In
When the sound collection area (for example, “magazine rack”) in which the user desires to hear the sound is selected, the signal processing unit 33 of the directivity control apparatus 3 reads the preset table (see
Here, on the captured-video display screen WD2 displayed by the display apparatus 36, the preset designation position (for example, the preset designation position P3-1′) corresponding to the preset position at which the user desires to hear the sound is selected through an input manipulation by the user (ST23).
When the preset designation position (for example, the preset designation position P3-1′) corresponding to the preset position at which the user desires to hear the sound is selected, the signal processing unit 33 of the directivity control apparatus 3 reads the directivity direction (preset value) oriented from the omnidirectional microphone array apparatus 2 to the preset position (for example, the preset position P3-1) corresponding to the selected preset designation position (for example, the preset designation position P3-1′) from the preset table (ST24).
The output control unit 35 of the directivity control apparatus 3 transmits a directivity forming instruction including data of the coordinates (θMAh, θMAv) (=(θh31, θv31)) indicating the preset value read in step ST24 to the omnidirectional microphone array apparatus 2. The omnidirectional microphone array apparatus 2 forms the directivity of each of the microphone units 22 and 23 in the sound collection direction of the coordinates (θMAh, θMAv) calculated by the directivity control apparatus 3 in response to the directivity forming instruction from the directivity control apparatus 3 (ST14).
Thus, the omnidirectional microphone array apparatus 2 can relatively increase the volume level of the sound data collected in the directivity direction oriented to the specific preset position (for example, the preset position P3-1) in the sound collection area in which the user desires to hear the sound and can relatively decrease the volume level of the sound data collected in a direction not oriented from the omnidirectional microphone array apparatus 2 to the preset position.
In the directivity control system 10A according to the embodiment, as described above, one or more camera apparatuses C11 to C1n (where n is an integer equal to or greater than 2) capture videos in the ranges of predetermined different sound collection areas. The display apparatus 36 displays the sound collection area selection screen WD1 used to select one sound collection area from one or more sound collection areas and the captured-video display screen WD2 used to display the captured video of the camera apparatus including the preset position corresponding to the selected sound collection area. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the collected sound based on the horizontal angle and the vertical angle of the directivity direction at each preset position stored in the memory 38 according to the selection of the preset designation position in the captured video displayed on the captured-video display screen WD2 of the camera apparatus.
Thus, in the directivity control system 10A, the directivity control apparatus 3 can allow the user to visually confirm the location of the preset position corresponding to the sound collection area selected on the sound collection area selection screen WD1 displayed by the display apparatus 36 in the captured video of the involved camera apparatus, can form the directivity of the sound in the directivity direction oriented to the preset position corresponding to the sound collection area desired by the user, and thus can output the clear sound of the target present at the preset position.
In a directivity control system 10B according to the fourth embodiment, captured images of camera apparatuses C11 to C1n correspond to directivity in a one-to-one manner (see
In an operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3 and the recorder apparatus 4 included in the directivity control system 10B according to the embodiment, the same reference numerals are given to the same content as the operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3, and the recorder apparatus 4 included in the directivity control system 10A according to the third embodiment, description will be omitted or simplified, and other content will be described.
In the embodiment, one or more sound collections area or a plurality of sound collection areas of the entire sound collection area AR1 in a store illustrated in
In the preset designation position diagram illustrated in
On the camera apparatus selection screen WD3 illustrated in
Next, the detailed operation order of the directivity control system 10B according to the embodiment will be described with reference to
In
When the camera apparatus (for example, “C13”) in which the user desires to display the video is selected, the signal processing unit 33 of the directivity control apparatus 3 reads the preset table (see
The signal processing unit 33 of the directivity control apparatus 3 reads the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position (for example, the preset position P3) allocated to the selected camera apparatus (for example, the camera apparatus C13) and the directivity control parameter (preset value) from the preset table.
The output control unit 35 of the directivity control apparatus 3 transmits a directivity forming instruction including data of the coordinates (θMAh, θMAv) (=(θh31, θv31)) indicating the preset value read in step ST24 and data of the directivity control parameter to the omnidirectional microphone array apparatus 2. The omnidirectional microphone array apparatus 2 forms the directivity with the range of the directivity control parameter in each of the microphone units 22 and 23 in the sound collection direction of the sound collection direction coordinates (θMAh, θMAv) calculated by the directivity control apparatus 3 in response to the directivity forming instruction from the directivity control apparatus 3 (ST33).
The output control unit 35 of the directivity control apparatus 3 outputs the sound collected by the omnidirectional microphone array apparatus 2 from the speaker apparatus 37 after the directivity is formed in the range of the directivity control parameter in step ST33, while displaying the captured video of the camera apparatus (for example, the camera apparatus C13) selected in step ST31 on the captured-video display screen WD4 (ST34).
Thus, the omnidirectional microphone array apparatus 2 can relatively increase the volume level of the sound data collected in the directivity direction oriented to the specific preset position (for example, the preset position P3) in the sound collection area in which the user desires to display the video and can relatively decrease the volume level of the sound data collected in a direction not oriented from the omnidirectional microphone array apparatus 2 to the preset position.
In the directivity control system 10B according to the embodiment, as described above, one or more camera apparatuses C11 to C1n (where n is an integer equal to or greater than 2) each capture a video in the range of one predetermined sound collection area allocated in advance. The display apparatus 36 displays the camera apparatus selection screen WD3 used to select one camera apparatus among one or more camera apparatuses and the captured-video display screen WD4 used to display the captured video of the selected camera apparatus. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the sound with the range of the directivity control parameter based on the data of the directivity direction of the preset position corresponding to the selected camera apparatus and the data of the preset value of the directivity control parameter.
Thus, in the directivity control system 10B, the directivity control apparatus 3 can synchronize the video captured by the camera apparatus selected on the camera apparatus selection screen WD3 displayed by the display apparatus 36 and the sound around the preset position corresponding to the selected camera apparatus so that the user can view the video.
In each of the above-described embodiments, when the user determines the preset position, the user desires to adjust the directivity direction in some cases in order to change the once determined preset position subjectively when the user designates a specific position on the directivity direction designation screen illustrated in
The adjustment interface CTL shows, for example, a pair of a plus button and a minus button for “noise suppression” and a pair of a plus button and a minus button for “target sound emphasis” as items used to adjust the directivity. When the plus button in “noise suppression” is pressed, the signal processing unit 33 of the directivity control apparatus 3 increases the intensity of “noise suppression” through predetermined signal processing. In contrast, when the minus button in “noise suppression” is pressed, the signal processing unit 33 of the directivity control apparatus 3 decreases the intensity of “noise suppression” through predetermined signal processing.
When the plus button in “target sound emphasis” is pressed, the signal processing unit 33 of the directivity control apparatus 3 raises the volume level of a target sound (for example, a sound of a target output from the speaker apparatus 37) through predetermined signal processing. In contrast, when the minus button in “target sound emphasis” is pressed, the signal processing unit 33 of the directivity control apparatus 3 lowers the volume level of a target sound (for example, a sound of a target output from the speaker apparatus 37) through predetermined signal processing.
In
Thereafter, the user confirms a sound (for example, a confirmation sound) in the directivity direction in which the directivity is formed in step S14 (ST51). When it is determined that the adjustment of the directivity formed in step ST14 is not necessary (ST52: NO), the operation of the flowchart illustrated in
Thus, the display apparatus 36 displays the adjustment interface CTL of the directivity control parameter used to adjust the directivity on the directivity direction designation screen. The directivity control apparatus 3 forms the directivity of the collected sound based on the changed directivity control parameter in response to an input manipulation of the directivity control parameter on the adjustment interface, and thus can form the directivity of the sound suitable for preference or demand of the user, for example, when the user hearing the sound (confirmation sound) of which the directivity is formed once changes and manipulates the adjustment interface.
In each of the above-described embodiments, the present invention is not limited to the case in which the user determines the preset position. The user designates a specific position on the sound position designation screen illustrated in
For example, the sound position designation screen illustrated in
When the designation position A′ is designated with the finger FG of the user once in
Here, when the user subjectively considers changing the preset position P2 and performs, for example, a right-side click manipulation on the sound position designation screen displayed by the display apparatus 36, the directivity control apparatus 3 displays an adjustment menu box PD-2 as an example of the adjustment interface. As shown in
On the other hand, when the designation position A′ is designated with the finger FG of the user once in
Here, when the user subjectively considers changing the directivity control parameters of the directivity oriented to the preset position P2 and performs, for example, a right-side click manipulation on the sound position designation screen displayed by the display apparatus 36, the directivity control apparatus 3 displays the adjustment menu box PD-2. As shown in
In
Here, when it is determined that the change (adjustment) in the preset position or the change (adjustment) in the directivity control parameter of the directivity is not necessary (ST63: NO), the process of correcting the preset value ends via a process (ST80) of reflecting the adjustment result. The process of reflecting the adjustment result will be described in detail in
Conversely, when it is determined that the change (adjustment) in the preset position or the change (adjustment) in the directivity control parameter of the directivity is not necessary (ST63: YES) and, for example, a right-side click manipulation is performed on the sound position designation screen displayed by the display apparatus 36, the directivity control apparatus 3 displays the adjustment menu box PD-2 (ST64). A manipulation of enabling the adjustment menu of the adjustment menu box PD-2 to be used is assumed to be performed (ST65).
When “position” of the adjustment menu of the adjustment menu box PD-2 is selected with the finger FG of the user (“position” of ST66) and then a movement manipulation (for example, a drag manipulation) is performed to move the preset designation position from the preset designation position P2′ to the designation position A′ (ST67), the directivity control apparatus 3 temporarily changes the preset designation position from the preset designation position P2′ to the designation position A′, recalculates the directivity direction oriented to the sound position corresponding to the changed designation position A′, and forms the directivity in the recalculated directivity direction (ST68). After step ST68, the process of the directivity control apparatus 3 returns to step ST62.
Conversely, after “parameter” of the adjustment menu of the adjustment menu box PD-2 is selected with the finger FG of the user (“parameter” of ST66), the directivity control apparatus 3 displays the control box CTL on the sound position designation screen to change the directivity control parameters (ST69). When the plus button and the minus button of “noise suppression” and “target sound emphasis” which are the directivity control parameters are subjected to a pressing manipulation (for example, a touch manipulation) with the finger FG of the user (ST70), the directivity control apparatus 3 temporarily changes the directivity control parameters of the directivity corresponding to the directivity direction oriented to the preset position (for example, the preset position P2) corresponding to the preset designation position (for example, the preset designation position P2′), recalculates the directivity direction oriented to the preset position P2 corresponding to the preset designation position P2′ based on the changed directivity control parameters, and forms the directivity in the recalculated directivity direction (ST71). After step ST71, the process of the directivity control apparatus 3 returns to step ST62.
In the process of reflecting the adjustment result in step ST80, the directivity control apparatus 3 temporarily stores the final preset position or the adjustment result of the directivity control parameters in the memory 38 (ST81).
After step ST81, when a predetermined manipulation is performed to use the preset position adjusted in the process of correcting the preset value in step ST60 or the directivity control parameters as the preset value (ST81: YES), the directivity control apparatus 3 updates the preset value of the preset table stored in the memory 38 in order to use the adjustment result of the final preset position or the directivity control parameters temporarily stored in step ST81 as the preset value (ST83).
Conversely, when a predetermined manipulation is performed in order not to use the preset position or the directivity control parameters adjusted in the process of correcting the preset value in step ST60 as the preset value (ST81: NO), the adjustment result of the adjustment result of the final preset position or the directivity control parameters is not updated in the preset table and the process of reflecting the adjustment result ends.
Thus, the memory 38 stores the changed directivity control parameters, and the horizontal angle and the vertical angle indicating the directivity direction oriented to the preset position in association with the preset position in the sound collection area. Therefore, it is not necessary for the user to perform a manipulation of changing the control box CTL which is an example of the adjustment interface again, and the directivity control apparatus 3 can simply form the directivity using the changed directivity control parameters, and the horizontal angle and the vertical angle indicating the directivity direction oriented to the preset position (second sound position) as the preset value.
The display apparatus 36 displays, on the sound position designation screen, the control box CTL which is an example of the adjustment interface of the designation position used to change a position corresponding to the preset position on the sound position designation screen to a position corresponding to another sound position on the sound position designation screen. The directivity control apparatus 3 forms the directivity of the collected sound based on the horizontal angle and the vertical angle oriented to another sound position corresponding to the changed designation position through an input manipulation on the control box CTL. Therefore, for example, the user hearing the sound (confirmation sound) of which the directivity is formed once performs a changing manipulation on the adjustment interface so that the directivity of the sound suitable for the preference or the demand of the user can be formed.
The memory 38 stores the horizontal angle and the vertical angle oriented to another sound position corresponding to the changed designation position in association with the preset position in the sound collection area. Therefore, it is not necessary for the user to perform a manipulation of changing the control box CTL which is an example of the adjustment interface again, and the directivity control apparatus 3 can simply form the directivity using the horizontal angle and the vertical angle corresponding to the changed designation position as the preset value.
Each embodiment subsequent to the fifth embodiment, examples of a sound collection system and a sound collection method will be described which easily acquire or calculate a directivity direction oriented from a microphone array apparatus to a prearranged sound position and output a clear sound of a target present in a direction oriented from the microphone array apparatus to the prearranged sound position.
In each embodiment subsequent to the fifth embodiment, the present invention can be expressed as each apparatus (for example, a directivity control apparatus described above) included in the sound collection system or a sound collection control method including each operation (step) performed by each apparatus included in the sound collection system.
In an operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3, and the recorder apparatus 4 included in the sound collection system 10C according to the embodiment, the same reference numerals are given to the same content as the operation of each unit of the omnidirectional microphone array apparatus 2, the directivity control apparatus 3, and the recorder apparatus 4 included in the sound collection system 10 according to the first embodiment, description will be omitted or simplified, and other content will be described.
The omnidirectional microphone array apparatus 2 forms directivity to collect a sound with high precision in a directivity direction oriented from the installation position of the omnidirectional microphone array apparatus 2 to a prearranged preset position (sound position) A to be described below in a sound collection area AR illustrated in
In sound collection systems 10C and 10D according to the following embodiments, the temporary omnidirectional camera apparatus Ct acquires data of a horizontal angle and a vertical angle of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the prearranged preset position A to be described below and data necessary to calculate the horizontal angle and the vertical angle, and then the temporary omnidirectional camera apparatus Ct is detached from the installation position. Thereafter, the omnidirectional microphone array apparatus 2 is installed at the installation position of the temporary omnidirectional camera apparatus Ct so that a reference direction (for example, a direction in which a horizontal angle is 0 degrees and the same applies hereinafter) of the horizontal angle in the directivity direction of the omnidirectional microphone array apparatus 2 matches a reference direction of a horizontal angle acquired based on the coordinates of an omnidirectional captured image by the temporary omnidirectional camera apparatus Ct.
In the sound collection system 10C illustrated in
Before the omnidirectional microphone array apparatus 2 is installed, the temporary omnidirectional camera apparatus Ct which is an example of a first camera apparatus is installed at an installation position of the omnidirectional microphone array apparatus 2 so that a reference direction of a horizontal angle acquired based on the coordinates of an omnidirectional captured image by the temporary omnidirectional camera apparatus Ct is a prearranged direction. The prearranged direction refers to, for example, a reference direction of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2 installed after the temporary omnidirectional camera apparatus Ct is detached from the installation position.
The temporary omnidirectional camera apparatus Ct images all directions centering on the installation position of the temporary omnidirectional camera apparatus Ct, i.e., the prearranged range in the degree of 360 degrees, in the store in which the sound collection system 10C according to the embodiment is installed. A captured image (captured video) captured by the temporary omnidirectional camera apparatus Ct is displayed as a preset designation position designation screen CAM-t by the display apparatus 36 of the directivity control apparatus 3 (see
When the preset designation position A′ corresponding to a prearranged preset position (for example, a preset position A illustrated in
The manipulation unit 32 acquires coordinate data indicating a position at which the user desires to increase or decrease a volume level of a sound, i.e., a designation position A′ on a preset designation position designation screen CAM-t illustrated in
The directivity direction calculation unit 34 acquires data of the horizontal angle θCAh and the vertical angle θCAv transmitted from the temporary omnidirectional camera apparatus Ct and oriented to the preset designation position A′ on the preset designation position designation screen CAM-t from the communication unit 31. The directivity direction calculation unit 34 stores the data of the horizontal angle θCAh and the vertical angle θCAv in association with the preset position A corresponding to the preset designation position A′ in the memory 38 (see
Here, in the embodiments, as described above, the temporary omnidirectional camera apparatus Ct acquires the data of the horizontal angle θCAh and the vertical angle θCAv indicating the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position A, and then the temporary omnidirectional camera apparatus Ct is detached from the installation position. Thereafter, the omnidirectional microphone array apparatus 2 is installed at the installation position of the temporary omnidirectional camera apparatus Ct so that the reference direction of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2 matches the reference direction of the horizontal angle acquired based on the coordinates of the omnidirectional captured image by the temporary omnidirectional camera apparatus Ct. That is, the temporary omnidirectional camera apparatus Ct and the omnidirectional microphone array apparatus 2 have the same reference coordinate system.
Accordingly, the data of the horizontal angle θCAh and the vertical angle θCAv transmitted from the temporary omnidirectional camera apparatus Ct and oriented to the preset designation position A′ on the preset designation position designation screen CAM-t can be used as data of the horizontal angle and the vertical angle of the directivity direction oriented to the preset position A by the omnidirectional microphone array apparatus 2. In other words, the omnidirectional microphone array apparatus 2 can form the directivity in the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ designated on the preset designation position designation screen CAM-t based on the horizontal angle θCAh and the vertical angle θCAv transmitted from the temporary omnidirectional camera apparatus Ct.
The preset table illustrated in
In the preset designation position diagram illustrated in
When one sound collection area (for example, “register 2”) is selected with the finger FG of the user on a sound collection area selection screen WD displayed by the display apparatus 36, the directivity direction calculation unit 34 acquires data of a preset value (for example, (horizontal angle θhp2, vertical angle θvp2) corresponding to the selected sound collection area with reference to the preset table (see
In the data (θhp1, δvp1) to (θhp3, θvp3) of the preset values illustrated in
The output control unit 35 serving as an example of a directivity control unit controls operations of the omnidirectional microphone array apparatus 2, the temporary omnidirectional camera apparatus Ct, the display apparatus 36, and the speaker apparatus 37 and causes the display apparatus 36 to display, for example, the preset designation position designation screen CAM-t illustrated in
The display apparatus 36 serving as an example of a display unit displays the preset designation position designation screen CAM-t used to designate the preset designation position A′ corresponding to the preset position A from the installation position of the omnidirectional microphone array apparatus 2 or the sound collection area selection screen WD illustrated in
The detailed operation order of the sound collection system 10C according to the embodiment will be described with reference to
In
After the temporary omnidirectional camera apparatus Ct is installed in step ST41, the directivity control apparatus 3 causes the display apparatus 36 to display the preset designation position designation screen CAM-t illustrated in
When the preset designation position A′ corresponding to the preset position A is designated with the finger FG of the user on the preset designation position designation screen CAM-t displayed by the display apparatus 36, the temporary omnidirectional camera apparatus Ct acquires the horizontal angle θCAh and the vertical angle θCAv of the direction oriented from the temporary omnidirectional camera apparatus Ct to the preset designation position A′ based on the coordinates of the omnidirectional captured image of the temporary omnidirectional camera apparatus Ct (ST43). The temporary omnidirectional camera apparatus Ct transmits the data of the horizontal angle θCAh and the vertical angle θCAv to the directivity control apparatus 3.
Thus, the directivity control apparatus 3 can easily acquire the horizontal angle and the vertical angle of the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ designated on the preset designation position designation screen CAM-t by the user.
The directivity control apparatus 3 receives the data of the horizontal angle θCAh and the vertical angle θCAv oriented to the preset designation position A′ on the preset designation position designation screen CAM-t from the temporary omnidirectional camera apparatus Ct. The directivity control apparatus 3 stores and registers the data of the horizontal angle θCAh and the vertical angle θCAv in association with the preset position A corresponding to the preset designation position A′ in the memory 38 (ST44).
When the registration of the preset values corresponding to all of the preset positions desired by the user in the memory 38 does not end after step ST44 (ST45: NO), the directivity control apparatus 3 repeats the operations of steps ST42 to ST44 until the end of the registration of the preset values corresponding to all of the preset positions desired by the user in the memory 38.
Conversely, when the registration of the preset values corresponding to all of the preset positions desired by the user in the memory 38 ends (ST45: YES), the temporary omnidirectional camera apparatus Ct is detached from the installation position. After the temporary omnidirectional camera apparatus Ct is detached, the omnidirectional microphone array apparatus 2 is installed at the installation position of the temporary omnidirectional camera apparatus Ct so that the reference direction of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2 matches the reference direction of the horizontal angle acquired based on the coordinates of the omnidirectional captured image by the temporary omnidirectional camera apparatus Ct (ST46).
In step ST46, the omnidirectional microphone array apparatus 2 is installed, for example, in the following way so that the reference direction of the horizontal angle acquired based on the coordinates of the omnidirectional captured image by the temporary omnidirectional camera apparatus Ct matches the reference direction of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2. However, the method of installing the omnidirectional microphone array apparatus 2 in step ST46 is not limited to a method of using a marker to be described below.
Specifically, for example, a triangular or rectangular marker (not illustrated) is added to the outer circumference of the casing of the temporary omnidirectional camera apparatus Ct. The marker is added in a direction indicating a reference direction (for example, a 0-degree direction of the horizontal angle) of the horizontal angle acquired based on the coordinates of the omnidirectional captured image by the temporary omnidirectional camera apparatus Ct.
For example, a marker (not illustrated) with the same shape is added to the periphery of the opening 21a formed at the casing center of the omnidirectional microphone array apparatus 2 at a position facing the marker added to the temporary omnidirectional camera apparatus Ct.
Accordingly, by installing the omnidirectional microphone array apparatus 2 so that the marker of the temporary omnidirectional camera apparatus Ct faces the marker of the omnidirectional microphone array apparatus 2, the omnidirectional microphone array apparatus 2 can be installed so that the reference direction of the horizontal angle of the directivity direction of the omnidirectional microphone array apparatus 2 matches the reference direction of the horizontal angle acquired based on the coordinates of the omnidirectional captured image by the temporary omnidirectional camera apparatus Ct.
After the omnidirectional microphone array apparatus 2 is installed, the directivity control apparatus 3 causes the display apparatus 36 to display the sound collection area selection screen WD illustrated in
When one sound collection area (for example, “register 2”) is selected with the finger FG of the user on the sound collection area selection screen WD displayed by the display apparatus 36, the directivity control apparatus 3 acquires the data (for example, (horizontal angle θhp2, vertical angle θvp2)) of the preset value corresponding to the selected sound collection area with reference to the preset table stored in the memory 38 (ST48). The directivity direction calculation unit 34 outputs the data (horizontal angle θhp2, vertical angle θvp2) of the preset value corresponding to the selected sound collection area to the output control unit 35.
The directivity control apparatus 3 causes the output control unit 35 to form the directivity of the sound data in the directivity direction corresponding to the data (horizontal angle θhp2, vertical angle θvp2) of the preset value acquired in step ST48 or causes the omnidirectional microphone array apparatus 2 to form the directivity (ST49).
Thus, the omnidirectional microphone array apparatus 2 can relatively increase the volume level of the sound data collected in the sound collection direction decided by the sound collection direction coordinates (θhp2, θvp2) in which the directivity is formed and can relatively reduce the volume level of the sound data collected in the direction in which no directivity is formed.
In the sound collection system 10C according to the embodiment, a timing at which the sound is collected by the omnidirectional microphone array apparatus 2 is not limited to a timing immediately after step ST14, but may be, for example, a timing after the omnidirectional microphone array apparatus 2 is turned on. The same also applies to each of the following embodiments.
In the sound collection system 10C according to the embodiment, as described above, the display apparatus 36 displays the preset designation position designation screen CAM-t used to designate one or more preset designation positions A′ from a captured image of the temporary omnidirectional camera apparatus Ct having the same reference coordinate system as the omnidirectional microphone array apparatus 2. The directivity direction calculation unit 34 of the directivity control apparatus 3 acquires the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ from the temporary omnidirectional camera apparatus Ct according to the designation of the preset designation position A′ on the preset designation position designation screen CAM-t or the directivity direction calculation unit 34 calculates the horizontal angle and the vertical angle based on data from the temporary omnidirectional camera apparatus Ct, and then stores the horizontal angle and the vertical angle in association with the preset position A in the memory 38. The output control unit 35 of the directivity control apparatus 3 forms the directivity of the collected sound based on the horizontal angle and the vertical angle stored for each preset position.
Thus, in the sound collection system 10C, the directivity control apparatus 3 can easily acquire the horizontal angle and the vertical angle indicating the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ designated on the preset designation position designation screen CAM-t displayed as the captured image of the temporary omnidirectional camera apparatus Ct, from the temporary omnidirectional camera apparatus Ct or can simply calculate the horizontal angle and the vertical angle in the directivity control apparatus 3 based on the data from the temporary omnidirectional camera apparatus Ct. The directivity control apparatus 3 can form the directivity in which a clear sound of a target at the preset position A is output based on the horizontal angle and the vertical angle of the directivity direction acquired from the temporary omnidirectional camera apparatus Ct or calculated in the directivity control apparatus 3, and thus can output the clear sound of the target present at the corresponding preset position A.
Thus, when the user designates the preset designation position A′ on the preset designation position designation screen CAM-t, the user can designate the suitable preset designation position A′ with reference to the captured image of the monitoring camera apparatus in which the preset position A corresponding to the preset designation position A′ is best pictured.
In an operation of each unit of the omnidirectional microphone array apparatus 2, the temporary omnidirectional camera apparatus Ct, the directivity control apparatus 3D, and the recorder apparatus 4 included in the sound collection system 10D according to the embodiment, the same reference numerals are given to the same content as the operation of each unit of the omnidirectional microphone array apparatus 2, the temporary omnidirectional camera apparatus Ct, the directivity control apparatus 3, and the recorder apparatus 4 included in the sound collection system 10C according to the fifth embodiment, description will be omitted or simplified, and other content will be described.
The monitoring camera apparatuses CM11 to CM1n image predetermined different sound collection areas in a store in which the sound collection system 10D is installed and transmits data of the captured images to the directivity control apparatus 3D or the recorder apparatus 4 via a network NW. Of the monitoring camera apparatuses CM11 to CM1n, imaging ranges of some monitoring camera apparatuses may be overlapped.
The preset table illustrated in
In the preset designation position diagram illustrated in
The monitoring camera apparatus CM11 images the periphery of the preset position P1 near the sound collection area “register 1.” The monitoring camera apparatus CM12 images the periphery of the preset position P2 near the sound collection area “register 2.” The monitoring camera apparatus CM13 images the periphery of the preset position P3 near the sound collection area “magazine rack.” The monitoring camera apparatus CM1n images the periphery of the preset position Pn near the sound collection area “drink rack.”
An output control unit 35D which is an example of a directivity control unit controls the operations of the omnidirectional microphone array apparatus 2, the temporary omnidirectional camera apparatus Ct, the display apparatus 36, and the speaker apparatus 37 and causes the display apparatus 36 to display, for example, a display screen of the captured image of one monitoring camera apparatus (for example, the monitoring camera apparatus CM11) illustrated in
On the display screen illustrated in
On the display screen illustrated in
The output control unit 35D alternately switches and displays the display screen of the captured image of the monitoring camera apparatus CM11 illustrated in
As illustrated in
The recorder apparatus 4 according to the embodiment may store video data captured by each monitoring camera apparatus and sound data collected by the omnidirectional microphone array apparatus 2 in association therewith.
Next, the detailed operation order of the sound collection system 10D according to the embodiment will be described with reference to
In
The directivity control apparatus 3D causes the display apparatus 36 to display the preset designation position designation screen CAM-t illustrated in
After steps ST42′ and ST43, the directivity control apparatus 3D receives the data of the horizontal angle θCAh and the vertical angle θCAv oriented to the preset designation position A′ on the preset designation position designation screen CAM-t from the temporary omnidirectional camera apparatus Ct. The directivity control apparatus 3D stores and registers the data of the horizontal angle θCAh and the vertical angle θCAv and the identification number of the monitoring camera apparatus temporarily stored in the memory 38 in step ST42′ in association with the preset position A corresponding to the preset designation position A′ in the memory 38 (ST44′).
In step ST49′, when one sound collection area is selected on the sound collection area selection screen WD1 displayed by the display apparatus 36, the directivity control apparatus 3D displays the captured image of the monitoring camera apparatus with the identification number which is the data of the preset value read in step ST48 on the display screen WD2 of the display apparatus 36 with reference to the preset table stored in the memory 38.
In the sound collection system 10D according to the embodiment, as described above, the display apparatus 36 displays the preset designation position designation screen CAM-t used to designate one or more preset designation positions A′ from the captured image of the temporary omnidirectional camera apparatus Ct corresponding to the captured image of the monitoring camera apparatus selected from one or more monitoring camera apparatuses CM11 to CM1n imaging the predetermined different sound collection areas. The directivity direction calculation unit 34 of the directivity control apparatus 3D acquires the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ from the temporary omnidirectional camera apparatus Ct according to designation of the preset designation position A′ on the preset designation position designation screen CAM-t or calculates the horizontal angle and the vertical angle of the directivity direction calculation unit 34 based on the data from the temporary omnidirectional camera apparatus Ct, and stores the horizontal angle and the vertical angle along with the identification number of the selected monitoring camera apparatus in association with the preset position A in the memory 38. The output control unit 35D of the directivity control apparatus 3D forms the directivity in which the sound of the target is collected in the output control unit 35D based on the horizontal angle and the vertical angle stored for each preset position and causes the omnidirectional microphone array apparatus 2 to form the directivity, and displays the captured image of the monitoring camera apparatus with the recorded identification number.
Thus, in the sound collection system 10D, the user views the captured image of the corresponding monitoring camera apparatus, and then designates the preset designation position A′ corresponding to the preset position A. Therefore, the directivity control apparatus 3D can easily and accurately acquire the horizontal angle and the vertical angle indicating the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the preset position A corresponding to the preset designation position A′ from the temporary omnidirectional camera apparatus Ct or can calculate the horizontal angle and the vertical angle in the directivity control apparatus 3D based on the data acquired from the temporary omnidirectional camera apparatus Ct. Further, the directivity control apparatus 3D can form the directivity in which the clear sound of the target at the preset position A is output based on the horizontal angle and the vertical angle of the directivity direction acquired from the temporary omnidirectional camera apparatus Ct, and can display the captured image of the sound collection area including the preset position A and output the clear sound of the target present at the corresponding preset position A.
The configurations, the operations, and the advantages of the directivity control system and the directivity control method according to some aspects of the present invention will be described.
A first aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a designation screen used to designate a directivity direction oriented from the sound collection unit to a first sound position; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the first sound position corresponding to the designated directivity direction in accordance with a designation of the directivity direction on the designation screen displayed by the display unit; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit.
The directivity control system may be configured so that a horizontal distance and a horizontal angle from the sound collection unit to the first sound position are displayed on the designation screen, and the directivity direction calculation unit calculates the horizontal angle and the vertical angle from the sound collection unit to the first sound position based on a height of the sound collection unit from a horizontal surface, a height of the first sound position from the horizontal surface, and the horizontal distance and the horizontal angle from the sound collection unit to the first sound position displayed on the designation screen.
The directivity control system may be configured so that a first horizontal distance and a second horizontal distance from the sound collection unit to the first sound position are displayed on the designation screen, and the directivity direction calculation unit calculates the horizontal angle and the vertical angle of the directivity direction oriented from the sound collection unit to the first sound position based on a height of the sound collection unit from a horizontal surface, a height of the first sound position from the horizontal surface, and the first horizontal distance and the second horizontal distance from the sound collection unit to the first sound position displayed on the designation screen.
A second aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas or a designation screen of a directivity direction oriented from the sound collection unit to a third arbitrary sound position in the one or more sound collection areas; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged second sound position corresponding to the directivity direction as set in accordance with a set value of the directivity direction on the setting screen displayed by the display unit; a storage unit, configured to store the horizontal angle and the vertical angle calculated for each of the prearranged second sound positions in the sound collection areas in association with each of the prearranged second sound positions in the sound collection areas; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit, wherein the directivity direction calculation unit calculates the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the designation screen displayed by the display unit, based on the horizontal angle and the vertical angle corresponding to the prearranged second sound position in the sound collection area stored in the storage unit.
A third aspect of the present invention provides a directivity control system including: a sound collection unit, configured to collect a sound; a display unit, configured to display a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas or a designation screen of a directivity direction oriented from the sound collection unit to a third arbitrary sound position in the one or more sound collection areas; a storage unit, configured to store a set value of the one or more directivity directions on the setting screen displayed by the display unit in association with the prearranged second sound position in the sound collection area; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle up to the prearranged second sound position corresponding to the directivity direction based on the set value of the directivity direction stored in the storage unit; and a control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle calculated by the directivity direction calculation unit, wherein the set value of the directivity direction indicates a horizontal distance and a horizontal angle or a first horizontal distance and a second horizontal distance from the sound collection unit to the prearranged second sound position, and the directivity direction calculation unit calculates the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one or more sound collection areas on the designation screen displayed by the display unit, based on the set value of the horizontal angle and the vertical angle corresponding to the prearranged second sound position in the sound collection area stored in the storage unit.
The directivity control system may be configured so that the directivity direction calculation unit calculates the horizontal angle and the vertical angle from the sound collection unit to the prearranged second sound position corresponding to the directivity direction as designated in accordance with designation of the prearranged second sound position corresponding to the directivity direction on the designation screen displayed by the display unit.
The directivity control system may be configured by further including one or more camera apparatuses, configured to image predetermined different sound collection areas, wherein the display unit further displays a selection screen of one or more sound collection areas and a captured video of the camera apparatus including a sound collection area as selected, and the control unit forms directivity of the sound collected by the sound collection unit based on the directivity direction corresponding to the prearranged second sound position stored in the storage unit in accordance with selection of the prearranged second sound position displayed in the captured video of the camera apparatus.
The directivity control system may be configured by further including one or more camera apparatuses, each configured to image one prearranged sound collection area, wherein the display unit further displays a selection screen of the one or more camera apparatuses and a captured video of a camera apparatus as selected including the sound collection area corresponding to the camera apparatus as selected, and the control unit forms directivity of the sound collected by the sound collection unit based on the directivity direction corresponding to the prearranged second sound position stored in the storage unit in accordance with selection of the camera apparatus.
A fourth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a designation screen used to designate a directivity direction oriented from the sound collection unit to a first sound position; calculating a horizontal angle and a vertical angle from the sound collection unit to the first sound position corresponding to the directivity direction as designated in accordance with designation of the directivity direction on the displayed designation screen; and forming directivity of the sound collected by the sound collection unit based on the calculated horizontal angle and the calculated vertical angle.
In the above-described method, the display apparatus 36 displays the directivity direction designation screen used to designate the directivity direction oriented from the omnidirectional microphone array apparatus 2 to the sound position A (first sound position) at which the target is present. The directivity direction calculation unit 34 of the directivity control apparatus 3 calculates the horizontal angle and the vertical angle from the omnidirectional microphone array apparatus 2 to the corresponding sound position A in the designated directivity direction according to the designation of the directivity direction on the directivity direction designation screen displayed by the display apparatus 36. The output control unit 35 of the directivity control apparatus 3 forms the directivity in which the sound of the target is collected based on the calculated horizontal angle and vertical angle.
A fifth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged second sound position corresponding to the directivity direction as set in accordance with a set value of the directivity direction on the displayed setting screen; storing the horizontal angle and the vertical angle calculated for each of the prearranged second sound positions in the sound collection areas in association with each of the prearranged second sound positions in the sound collection areas; displaying a designation screen of the directivity direction oriented from the sound collection unit to the third arbitrary sound position on the one or more sound collection areas; calculating the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the displayed designation screen, based on the stored directivity direction of each of the prearranged second sound positions in the sound collection areas; and forming directivity of the sound collected by the sound collection unit based on the calculated horizontal angle and the calculated vertical angle.
A sixth aspect of the present invention provides a directivity control method in a directivity control system including a sound collection unit that collects a sound, the directivity control method including: displaying a setting screen of a directivity direction oriented from the sound collection unit to a prearranged second sound position in one or more sound collection areas; storing a set value of the directivity direction on the displayed setting screen in association with the prearranged second sound position in the sound collection area; calculating a horizontal angle and a vertical angle up to the prearranged second sound position corresponding to the directivity direction based on the stored set value of the directivity direction; displaying a designation screen of the directivity direction oriented from the sound collection unit to the third arbitrary sound position on the one or more sound collection areas; and calculating the horizontal angle and the vertical angle of the directivity direction oriented to the third arbitrary sound position as designated in accordance with designation of the directivity direction oriented to the third arbitrary sound position of the one more sound collection areas on the displayed designation screen, based on the stored set value of the directivity direction of each of the prearranged second sound positions in the sound collection areas, wherein the set value of the directivity direction indicates a horizontal distance and a horizontal angle or a first horizontal distance and a second horizontal distance from the sound collection unit to the prearranged second sound position.
The directivity control system may be configured so that the display unit displays an adjustment interface of a directivity control parameter used to adjust the directivity formed by the control unit on the setting screen or the designation screen, and the control unit forms the directivity of the sound collected by the sound collection unit based on the directivity control parameter as changed in accordance with an input manipulation on the adjustment interface of the directivity control parameter.
The directivity control system may be configured so that the storage unit stores the changed directivity control parameter and the horizontal angle and the vertical angle oriented to the prearranged second sound position, in association with the prearranged second sound position in the sound collection area.
The directivity control system may be configured so that the display unit displays a designation position adjustment interface used to change a first designation position corresponding to the prearranged second sound position on the setting screen to a second designation position corresponding to another sound position on the setting screen, and the control unit forms the directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle oriented to the other sound position corresponding to the second designation position as changed in accordance with an input manipulation on the designation position adjustment interface.
The directivity control system may be configured so that the storage unit stores the horizontal angle and the vertical angle oriented to the other sound position corresponding to the second designation position as changed, in association with the prearranged second sound position in the sound collection area.
The configurations, the operations, and the advantages of the sound collection system and the sound collection control method according to some aspects of the present invention will be described.
A seventh aspect of the present invention provides a sound collection system including: a sound collection unit, configured to collect a sound; a first camera apparatus that has a same reference coordinate system as the sound collection unit; a display unit, configured to display a designation screen used to designate a position corresponding to one or more prearranged fourth sound positions from a captured image of the first camera apparatus; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged fourth sound position in accordance with designation of the position corresponding to the prearranged fourth sound position on the designation screen; a storage unit, configured to store the horizontal angle and the vertical angle acquired for each of the prearranged fourth sound positions in association with the prearranged fourth sound position; and a directivity control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fourth sound positions.
The sound collection system may be configured so that the display unit further displays a selection screen of sound collection areas including the prearranged fourth sound position, the directivity direction calculation unit acquires the horizontal angle and the vertical angle of the directivity direction oriented from the sound collection unit to the prearranged fourth sound position in the selected sound collection area from the storage unit in accordance with selection of one of the sound collection areas on the selection screen, and the directivity control unit forms the directivity of the sound collected by the sound collection unit in the selected sound collection area based on the horizontal angle and vertical angle acquired by the directivity direction calculation unit.
An eighth aspect of the present invention provides a sound collection system including: a sound collection unit, configured to collect a sound; a first camera apparatus that has a same reference coordinate system as the sound collection unit; one or more second camera apparatuses, configured to image predetermined different sound collection areas; a display unit, configured to display a designation screen used to designate a position corresponding to one or more prearranged fifth sound positions from a captured image of the first camera apparatus corresponding to any one selected from the second camera apparatuses; a directivity direction calculation unit, configured to calculate a horizontal angle and a vertical angle from the sound collection unit to the prearranged fifth sound position in accordance with designation of the position corresponding to the prearranged fifth sound position on the designation screen; a storage unit, configured to store the horizontal angle and the vertical angle acquired for each of the prearranged fifth sound positions, in association with the prearranged fifth sound position; and a directivity control unit, configured to form directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fifth sound positions.
The sound collection system may be configured so that the storage unit stores the horizontal angle and the vertical angle acquired for each of the prearranged fifth sound positions and an identification number of the selected second camera apparatus, in association with the prearranged fifth sound position.
The sound collection system may be configured so that the display unit displays a selection screen of the sound collection area corresponding to the second camera apparatus and a display screen of a captured image of the second camera apparatus imaging the sound collection area selected on the selection screen, the directivity direction calculation unit acquires the horizontal angle and the vertical angle of a directivity direction corresponding to the identification number of the second camera apparatus imaging the sound collection area from the storage unit as selected in accordance with selection of the sound collection area corresponding to the second camera apparatus, and the directivity control unit forms the directivity of the sound collected by the sound collection unit in the selected sound collection area based on the horizontal angle and the vertical angle acquired by the directivity direction calculation unit.
The sound collection system may be configured so that the first camera apparatus is an omnidirectional camera apparatus.
A ninth aspect of the present invention provides a sound collection control method in a sound collection system including a sound collection unit that collects a sound, the sound collection control method including: displaying a captured image captured by a first camera apparatus having a same reference coordinate system as the sound collection unit; displaying a designation screen used to designate a position corresponding to one or more prearranged fourth sound positions from the captured image of the first camera apparatus; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged fourth sound position in accordance with designation of the position corresponding to the prearranged fourth sound position on the designation screen; storing the horizontal angle and the vertical angle acquired for each of the prearranged fourth sound positions in association with the prearranged fourth sound position in a storage unit; and forming directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fourth sound positions in the storage unit.
A tenth aspect of the present invention provides a sound collection control method in a sound collection system including a sound collection unit that collects a sound, the sound collection control method including: displaying a captured image captured by a first camera apparatus having a same reference coordinate system as the sound collection unit; receiving a selection of one or more second camera apparatuses that image different predetermined sound collection areas; displaying a designation screen used to designate a position corresponding to one or more prearranged fifth sound positions from a captured image of the first camera apparatus corresponding to a captured image of any one selected from the second camera apparatuses; calculating a horizontal angle and a vertical angle from the sound collection unit to the prearranged fifth sound position in accordance with designation of the position corresponding to the prearranged fifth sound position on the designation screen; storing the horizontal angle and the vertical angle acquired for each of the prearranged fifth sound positions in association with the prearranged fifth sound position in a storage unit; and forming directivity of the sound collected by the sound collection unit based on the horizontal angle and the vertical angle stored for each of the prearranged fifth sound positions in the storage unit.
The various embodiments have been described above with reference to the drawings. Of course, the present invention is not limited to the examples. It should be apparent to those skilled in the art that various modifications and corrections occur within the ranges of the present invention and, of course, the modifications and the corrections are construed to pertain to the technical range of the present invention.
The present invention is useful as a directivity control system and a directivity control method that output a clear sound of a target present in a direction oriented from a microphone array apparatus to a preset position by calculating a directivity direction oriented from the microphone array apparatus to the preset position and forming directivity in the calculated directivity direction.
The present invention is useful as a sound collection system and a directivity control method that output a clear sound of a target present in a direction oriented from a microphone array apparatus to a preset position by calculating a directivity direction oriented from the microphone array apparatus to the preset position and forming directivity in the calculated directivity direction.
The present application is based on and claims the benefits of three Japanese patent applications No. 2013-151012 filed on Jul. 19, 2013, No. 2013-189379 filed on Sep. 12, 2013 and No. 2014-135117 filed on Jun. 30, 2014, the contents of which are incorporated by reference in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2013-151012 | Jul 2013 | JP | national |
2013-189379 | Sep 2013 | JP | national |
2014-135117 | Jun 2014 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
8411165 | Ozawa | Apr 2013 | B2 |
20010024233 | Urisaka | Sep 2001 | A1 |
20050140810 | Ozawa | Jun 2005 | A1 |
20100254543 | Kjolerbakken | Oct 2010 | A1 |
20120155703 | Hernandez-Abrego | Jun 2012 | A1 |
Number | Date | Country |
---|---|---|
2005-124090 | May 2006 | JP |
2008-193196 | Aug 2008 | JP |
2010-145524 | Jul 2010 | JP |
2011-041096 | Feb 2011 | JP |
2012-186551 | Sep 2012 | JP |
Entry |
---|
Extended European Search Report dated Sep. 23, 2015, for corresponding EP Application No. 14177551.0-1901 / 2827610, 24 pages. |
Partial European Search Report dated Apr. 13, 2015, for corresponding EP Application No. 14177551.0-1901 / 2827610, 10 pages. |
Number | Date | Country | |
---|---|---|---|
20150023524 A1 | Jan 2015 | US |