The present invention relates to a sound localized reproduction technique.
There is a technique for realizing localized reproduction of an acoustic signal by using at least two speakers as a pair (refer to PTL 1).
In NPL 1, a technique is disclosed in which a plurality of speakers can be heard by a user only at a localized location in a vicinity of a speaker system by utilizing bi-directivity of the speakers without using a speaker box.
Since the technique described in NPL 1 allows the user to view only in the vicinity of the speaker system, an audible region need to be set in consideration of a position of the speaker system and a position of a user's head for listening (particularly, a position of an ear).
Therefore, in the present invention, it is an object to provide a sound system capable of reproducing a sound that is not heard around the user while reducing movement of a position of the speaker system or a position of the user's head.
In an aspect of the present invention, a sound system includes a directivity control device that includes at least one directivity control unit that generates a first processed acoustic signal from an acoustic signal (hereinafter referred to as a first acoustic signal) of a predetermined sound source and a second processed acoustic signal from an acoustic signal (hereinafter referred to as a second acoustic signal) having an opposite phase to that of the first acoustic signal by executing predetermined signal processing and a speaker system that includes at least one speaker unit pair that includes a speaker (hereinafter referred to as a positive speaker) that emits a sound based on the first processed acoustic signal and a speaker (hereinafter referred to as a negative speaker) that emits a sound based on the second processed acoustic signal. The positive speaker and the negative speaker do not include a speaker box, the signal processing executed by the directivity control unit is processing that gives directivity to the sound emitted by the speaker unit pair, and the directivity of the sound emitted by the speaker unit pair is controlled depending on a position where an auditory organ of a user exists, and a position where the speaker unit pair exists.
According to the present invention, it is possible to reproduce a sound that can be heard only in a limited narrow range while reducing movement of a position of a speaker system or a position of a user.
The following describes embodiments of the present invention in detail. Note that components having the same function will be denoted by the same reference numerals and redundant description thereof will be omitted.
First, directivity of a sound emitted from a speaker will be described. Next, the directivity of the sound emitted from the speaker unit pair according to the present invention of the application will be described. Finally, results of experiments for confirming effects of the speaker unit pair according to the present invention of the application will be described.
Usually, the speaker is composed of a speaker unit and a speaker box. The speaker unit is a component that includes a diaphragm that converts acoustic signals, which are electric signals, into air vibrations (that is, generates sound waves). In addition, the speaker box is a component that houses the speaker unit.
When the acoustic signal is inputted to the speaker, the diaphragm of the speaker unit vibrates, and sound waves are radiated in both directions in which the diaphragm vibrates. Here, the sound wave radiated to the outside of the speaker box (that is, the front direction of the speaker unit) is referred to as a positive sound wave, and the sound wave radiated to the inside of the speaker box (that is, the back direction of the speaker unit) is referred to as a negative sound wave. The negative sound wave is a sound wave that has an opposite phase to that of the positive sound wave.
Here, the directivity of the sound emitted from the speaker unit which is a bare speaker will be described first.
In the present invention of the application, the bi-directivity is utilized. This is described specifically hereinafter. First, as shown in
That is, when a predetermined acoustic signal is inputted to one speaker unit constituting the speaker unit pair and an acoustic signal having an opposite phase to that of the predetermined acoustic signal is inputted to the other speaker unit, it is possible to create a situation in which only a user in the vicinity of the speaker unit pair can hear and other users cannot hear the sound by utilizing a characteristic in which the sound can be heard in the vicinity of the speaker unit pair.
Here, results of experiments that measure frequency characteristics of the speaker, the speaker unit, and the speaker unit pair will be described. In the experiment, as the speaker, the speaker unit, and the speaker unit pair, a speaker having a diaphragm of 4.5 cm in a diameter (see
Also, for each of the conditions, for comparison, microphones are also installed at positions of 100 cm from each of the front, back, and side of the speaker, the speaker unit, and the speaker unit pair (see
Hereinafter, the experiment results will be described.
As described above, it was confirmed by the experiments that the sound emitted from the speaker unit pair of the present invention of the application was heard only in the vicinity of the speaker unit pair.
A system that reproduces an acoustic signal obtained based on a reproduction object is called a sound system. The sound system includes a speaker system in order to emit the acoustic signal as the sound (hereinafter, this sound is referred to as a sound based on the acoustic signal). Here, the speaker system is a device that converts the acoustic signal, which is an analogue signal, into the sound. In addition, the reproduction objects are data and signal in which the acoustic signal can be obtained by the predetermined processing, for example, such as data recorded in a CD, a DVD, and a record, data received by the Internet, and signals received by radio broadcasting and television broadcasting.
Here, the sound system in which the sound based on the acoustic signal obtained from the reproduction objects is reproduced so as to be heard only by a user in the vicinity of the speaker system will be described. That is, the reproduced sound of the sound system is not heard by users other than the user in the vicinity of the speaker system. When such a sound system is used as a sound system for a user who uses a seat of an aircraft, for example, a system can be provided which allows only the user who uses the seat to hear the reproduced sound.
Hereinafter, a sound system 100 will be described with reference to
Note that the direction in which the n-th speaker unit pair 122 faces the user is defined as an n-th user direction (n=1, . . . , N), and the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122 (n=1, . . . , N) are arranged so that the sound emitted in the opposite direction to the n-th user direction from the positive speaker unit 1221 and the sound emitted in the opposite direction to the n-th user direction from the negative speaker unit 1221 are transmitted in the n-th user direction by the wraparound. Here, the n-th user direction is the front direction of the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122. In addition, the opposite direction to the n-th user direction is the back direction of the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122.
Further, the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122 (n=1, . . . , N) are arranged in a positional relationship in which the sound emitted from the positive speaker unit 1221 and the sound emitted from the negative speaker unit 1221 are erased from each other so that a user who uses another seat cannot hear the sound.
The operations of the sound system 100 will be described in accordance with
The reproduction device 110 inputs a first acoustic signal, a third acoustic signal, . . . , and a 2N−1-th acoustic signal which are acoustic signals obtained based on the reproduction objects, and outputs the first acoustic signal, the second acoustic signal, . . . , and the 2N-th acoustic signal. More specifically, an n-th reproduction unit 112 (n=1, . . . , N) inputs a 2n−1-th acoustic signal, generates a 2n-th acoustic signal which is an acoustic signal having an opposite phase to that of the 2n−1-th acoustic signal from the 2n−1-th acoustic signal, and outputs the 2n−1-th acoustic signal and the 2n-th acoustic signal. The 2n−1-th acoustic signal and the 2n-th acoustic signal are respectively inputted to the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122.
The speaker system 120 inputs the first acoustic signal, the second acoustic signal, . . . , and the 2N-th acoustic signal outputted by the reproduction device 110, and emits a sound based on the first acoustic signal, a sound based on the second acoustic signal, . . . , and a sound based on the 2N-th acoustic signal. More specifically, the n-th speaker unit pair 122 (n=1, . . . , N) inputs the 2n−1-th acoustic signal and the 2n-th acoustic signal, and emits the sound based on the 2n−1-th acoustic signal from the positive speaker unit 1221, and emits the sound based on the 2n-th acoustic signal from the negative speaker unit 1221. Since the 2n−1-th acoustic signal and the 2n-th acoustic signal have an opposite phase relationship to each other, the sound can be heard only in the vicinity of the seat where the speaker system 120 is installed, as described in <Technical Background>. For example, in the case where N=2 is established, when the first acoustic signal and the third acoustic signal are respectively an acoustic signal of a right channel and an acoustic signal of a left channel of a certain sound source, a stereo sound can be heard only in the vicinity of the seat where the speaker system 120 is installed.
Note that the sound emitted in the n-th user direction from the positive speaker unit 1221 of the n-th speaker unit pair 122 and the sound emitted in an opposite direction to the n-th user direction from the positive speaker unit 1221 of the n-th speaker unit pair 122 have an opposite phase relationship to each other. Similarly, the sound emitted in the n-th user direction from the negative speaker unit 1221 of the n-th speaker unit pair 122 and the sound emitted in an opposite direction to the n-th user direction from the negative speaker unit 1221 of the n-th speaker unit pair 122 have an opposite phase relationship to each other.
According to the embodiment of the present invention, it is possible to reproduce the sound that can be heard only in the very limited narrow range in the vicinity of the speaker system. Note that the vicinity is a distance defined in consideration of experiment results based on environment in accordance with frequency and degree of sound erasure. For example, in the case where a state of the sound at a distance where a sound pressure at a position separated from the center of the speaker diaphragm by about the diameter of the speaker diaphragm is changed to a sound pressure equivalent to a background noise by gradually separating from the center of the speaker diaphragm is regarded as the erasure of the sound in <<3: Experiment Result>>, the “vicinity” is set to a distance separated from the center of the speaker diaphragm by about twice the diameter of the speaker diaphragm, for example. In addition, in another way, when an environment having a certain degree of background noise such as inside a vehicle is assumed, the range of vicinity is set so that a person sitting on the seat where the speaker system 120 is installed can hear and a person sitting on the adjacent seat cannot hear. For example, in the case where the sound radiated from the speaker unit is radiated to the periphery and becomes a sound pressure equivalent to the background noise is regarded as the erasure of the sound in <<3: Experiment Result>>, the “vicinity” can be regarded as a distance of about twice the shoulder width of the user from the center of the speaker diaphragm.
Hereinafter, a sound system 200 will be described with reference to
The sound system 200 is different from the sound system 100 in that it includes the directivity control device 210.
In the following, the operations of the directivity control device 210 and the speaker system 120 will be described in accordance with
The directivity control device 210 inputs the first acoustic signal, the second acoustic signal, . . . , and the 2N-th acoustic signal outputted by the reproduction device 110, and outputs a first processed acoustic signal which is a signal obtained by signal processing the first acoustic signal, a second processed acoustic signal which is a signal obtained by signal processing the second acoustic signal, and a 2N-th processed acoustic signal which is a signal obtained by signal processing the 2N-th acoustic signal. More specifically, a n-th directivity control unit 212 (n=1, . . . , N) inputs the 2n−1-th acoustic signal and the 2n-th acoustic signal, generates a 2n−1-th processed acoustic signal from the 2n−1-th acoustic signal and a 2n-th processed acoustic signal from the 2n-th acoustic signal by executing predetermined signal processing, and outputs the 2n−1-th processed acoustic signal and the 2n-th processed acoustic signal. Here, the predetermined signal processing is processing for controlling the directivity, and for example, a method of Reference Document 1, other directivity control techniques can be used. It is needless to say that the predetermined signal processing may be realized by the directivity control by other methods. In short, any technique may be used as long as the directivity control can be performed in accordance with the position of the user's ear and the position of the speaker unit pair.
(Reference Document 1) Futoshi Asano, “array signal processing of sound-localization, tracking and separation of sound source”, CORONA PUBLISHING CO., LTD, 2011, p. 69-91
The predetermined signal processing is, for example, filtering using an FIR (Finite Impulse Response) filter. The FIR filter used here is designed so that microphones are respectively installed in a region to be audible and a region not to be audible, that the value of the filter coefficient is made to approach 1 in the microphone installed in the region to be audible, and that the value of the filter coefficient is made to approach 0 in the microphone installed in the region not to be audible. This is described specifically hereinafter. The region to be audible and the region not to be audible need to be designed in accordance with the case. For example, a case to be installed in the seat (hereinafter referred to as a seat S) of the automobile is considered. A position where the ear is present when a user who uses the seat S moves the head or changes the direction of the face is included in the region to be audible, and a position where the ear is present when a user who uses a seat close to the seat S (for example, an adjacent seat or front and rear seats) moves the head or changes the direction of the face is included in the region not to be audible. Therefore, for example, in a microphone installed in the region including the seat close to the seat S but not including the seat S, the value of the filter coefficient is made to approach 0. Note that in consideration that the sound may not be heard even at the position where the ear is present when the head is moved or the direction of the face is changed because of the fact that the sounds cancel each other in the intermediate region between the two speaker units as described above, and the value of the filter coefficient in the microphone installed in the intermediate region is made to approach 1. In short, the microphone installed in the region where the user's ear is assumed to be present should be controlled so that the filter coefficient is made to approach 1, and the microphone installed in the region where the user's ear is assumed not to be present should be controlled so that the filter coefficient is made to approach 0. In other words, the filter may be configured so that the sound as large as possible may arrive in the region where the user's ear is assumed to be present, and the sound as small as possible may arrive in the region where the user's ear is assumed not to be present.
As a result, the n-th directivity control unit (n=1, . . . , N) executes the signal processing so that the sound emitted from the positive speaker unit of the n-th speaker unit pair and the sound emitted from the negative speaker unit of the n-th speaker unit pair can be heard in the region to be audible in the vicinity of the n-th speaker unit pair and cannot be heard in the region not to be audible. Note that the region to be the audible region includes a point located at an equal distance from the positive speaker unit of the n-th speaker unit pair and the negative speaker unit of the n-th speaker unit pair, in which the sound emitted from the positive speaker unit of the n-th speaker unit pair and the sound emitted from the negative speaker unit of the n-th speaker unit pair cancel each other.
The speaker system 120 inputs the first processed acoustic signal, the second processed acoustic signal, . . . , and the 2N-th processed acoustic signal outputted by the directivity control device 210, and emits the sound based on the first processed acoustic signal, and emits the sound based on the second processed acoustic signal, . . . , and the sound based on the 2N-th processed acoustic signal. More specifically, the n-th speaker unit pair 122 (n=1, . . . , N) inputs the 2n−1-th processed acoustic signal and the 2n-th processed acoustic signal, and emits the sound based on the 2n−1-th processed acoustic signal from the positive speaker unit 1221, and the sound based on the 2n-th processed acoustic signal from the negative speaker unit 1221.
Here, a sound system in which a higher region sound is hardly leaked by using a member having a sound absorption characteristic will be described.
Hereinafter, a sound system 202 will be described with reference to
The structure of the n-th speaker unit pair 122 (n=1, . . . , N) will be described below in accordance with
The n-th speaker unit pair 122 is provided with the member 1224 that absorbs sounds emitted in the opposite direction to the n-th user direction from the positive speaker unit 1221 and the negative speaker unit 1221 of the n-th speaker unit pair 122 (see
Examples other than the seat of the automobile, specifically, a seat for an amusement machine such as a pachinko machine and a slot machine, will be described. Usually, a user uses a seat in front of the amusement machine to enjoy the amusement on the amusement machine. Therefore, the arm as described in the example of the automobile may be installed for the seat of the amusement machine, and the speaker unit pair may be present near the position where the ear of the user seated on the seat is present. Note that since the seat of the amusement machine has no backrest, the arm may be installed on the amusement machine instead of installing the arm on the seat. Alternatively, the arm may be a movable type, and the user may adjust the speaker unit pair so that the speaker unit pair is present near the ear.
In the second embodiment, a case where an ear (hereinafter referred to as an auditory organ) may exist in deviation or a gap of an audible region (see
Hereinafter, a sound system 300 will be described with reference to
Hereinafter, in accordance with
First, the position acquisition unit 330 acquires a position where the auditory organ of the user exists. Note that the position may be acquired through any method. An example in which the position acquisition unit 330 estimates the position and an example in which the user selects the position will be described below.
For example, the position acquisition unit 330 estimates the position of the user's head, and estimates the position where the auditory organ exists from the position of the head. Note that the position of the head may be estimated through any method.
For example, a pressure sensor is installed in the headrest, and it is estimated that the user's head exists at a position where strong pressure is applied.
Also, for example, the user's head is photographed by using a camera or the like, a feature amount is extracted from the photographed image, and a position where the head or the auditory organ of the user exists is estimated from the extracted feature amount.
Further, for example, when the headrest portion and the backrest portion of the seat have different members, the speaker unit pair is installed in the backrest portion, and the position of the headrest portion can be freely changed with respect to the backrest portion, the position of the headrest can be detected from a physical structure such as a state of a belt and a gear operating in conjunction with a position change of the headrest portion, the position where the user's head exists is estimated from the position of the headrest based on the assumption that the user's head exists at the position of the headrest. Note that, in this case, the speaker unit pair may be arranged side by side in a vertical direction with respect to the backrest portion where the head exists when a user of an average body shape sits on a seat.
For example, the position acquisition unit 330 has a selection unit such as a button that is not shown, and the user selects the position of the head or the auditory organ via the selection unit, a position where the auditory organ of the user exists may be acquired from the selection result. It is also possible to have a communication function that is not shown and to select from a terminal owned by a user. The terminal may be configured integrally with the sound system, or may be a terminal owned by a user such as a smartphone or a tablet.
Next, the position acquisition unit 330 selects a filter in which directivity of a sound emitted by the speaker unit pair is directed to a position where the auditory organ of the user exists, and sets the selected filter as a filter to be used in the directivity control device 210. In short, the position acquisition unit 330 changes a filter used in the directivity control device 210 in accordance with a positional relationship between the positions where the speaker unit pair exists and where the auditory organ of the user exists to change a region to be audible and a region not to be audible, and it is only necessary to design so that a position where the auditory organ of the user exists (a position assumed to exist) becomes the region to be audible, and a position where the auditory organ of the user does not exist (a position assumed not to exist) becomes the region not to be audible. Note that the positional relationship may be determined based on the estimated or selected positions of the head and the auditory organ and the reference location of the speaker unit pair (for example, the center position of the speaker unit pair, the center or lower end position of the speaker near the ground, etc.).
The filter may be obtained by calculation in advance by simulation or experiment, and stored in a storage unit that is not shown in association with the positional relationship between the positions where the speaker unit pair and where the auditory organ of the user exists. Instead of selecting the filter, the filter may be sequentially calculated so that the directivity of the sound emitted by the speaker unit pair is directed to the position where the auditory organ of the user exists.
As shown in
As shown in
As shown in
As shown in
For example, a filter for achieving directivity as shown in
In the directivity control device 210, processing is performed by using the filter selected by the position acquisition unit 330. Since the processing itself performed in the directivity control device 210 is similar to that of the second embodiment, the description thereof will be omitted.
Note that, as described in the second embodiment, the positive speaker and the negative speaker emit sounds in a predetermined direction so as to have opposite phases to each other in the region not to be audible. In addition, as described in the first embodiment, the positive speaker unit and the negative speaker unit are obtained by removing the speaker box from the speaker, and are arranged so that the sound emitted from the positive speaker unit in a direction opposite to the n-th user direction and the sound emitted from the negative speaker unit in a direction opposite to the n-th user direction are transmitted in the n-th user direction by wraparound.
According to the embodiment of the present invention, it is possible to reproduce the sound that can be heard only in a very limited narrow range in the vicinity of the speaker system, and it is possible to appropriately control the directivity in accordance with the position where the auditory organ of the user exists.
Note that the present embodiment and the modification example of the second embodiment may be combined.
Further, in the present embodiment, an example where N=1 is established has been described, but N may be any of integers of 2 or more, and even when N is an integer of 2 or more, localized reproduction can be performed, and the directivity can be appropriately controlled in accordance with the position where the auditory organ of the user exists.
In the present embodiment, one speaker unit pair is installed on the headrest of the seat, but as shown in
In addition, although two speaker unit pairs are installed on the headrest of the seat shown in
In
Based on the direction where the user faces, the directivity is controlled so as to be directed to the forward direction when the head of the user is in front of the speaker unit pair and to the backward direction when the head of the user is behind the speaker unit pair. In short, the directivity is directed to the direction of the position of the head of the user, especially the position of the ear.
Also in this case, the position acquisition unit 330 acquires the position where the auditory organ of the user exists. Note that the position may be acquired through any method. An example in which the position acquisition unit 330 estimates the position and an example in which the user selects the position will be described below.
For example, the position acquisition unit 330 estimates the position of the user's head, and estimates the position where the auditory organ exists from the position of the head. Note that the position of the head may be estimated through any method.
For example, a tilt sensor is installed on the seat surface of the chair, and when the front surface of the chair is down and the tilt is equal to or greater than a predetermined amount, the user is presumed to be leaning the head forward, and the user's head is presumed to be in front of the speaker unit pair. When the back surface of the chair is down and the tilt is equal to or greater than a predetermined amount, the user is presumed to leaning to the backrest, and the user's head is presumed to be behind the speaker unit pair.
Also, for example, the user's head is photographed from the side by using a camera or the like, a feature amount is extracted from the photographed image, and a position where the head or auditory organ of the user exists is estimated from the extracted feature amount.
For example, the position acquisition unit 330 has a selection unit such as a button that is not shown, and the user selects the position of the head or the auditory organ via the selection unit, and the position where the auditory organ of the user exists may be acquired from the selection result.
Next, the position acquisition unit 330 selects a filter in which the directivity of the sound emitted by the speaker unit pair is directed to the position where the auditory organ of the user exists, and sets the selected filter as a filter to be used in the directivity control device 210. The processing itself in the directivity control device 210 is similar to that of the second embodiment, except that the directivity direction is different.
As shown in
As shown in
As shown in
As shown in
As shown in
In the present modification example, the directivity control is performed in accordance with the size of the face and the positional relationship of the speaker unit pair.
In this case, the position acquisition unit 330 estimates the size of the user's face, and estimates the position where the auditory organ exists from the estimated size of the face. Note that the size of the user's face may be acquired through any method. An example in which the position acquisition unit 330 estimates the size of the user's face and an example in which the user selects the size of the user's face will be described below.
For example, the position acquisition unit 330 estimates the size of the user's face, and estimates the position where the auditory organ exists from the size of the user's face. Note that the size of the face may be acquired through any method.
For example, pressure sensors are arranged inside and outside with reference to a center line of the headrest, and when a difference between a pressure detected by the pressure sensor arranged inside and a pressure detected by the pressure sensor arranged outside is equal to or greater than a predetermined value, it may be judged that the face is a small face.
Also, for example, the user's head is photographed by using a camera or the like, a feature amount is extracted from the photographed image, and the size of the user's face is estimated from the extracted feature amount.
For example, the position acquisition unit 330 has the selection unit such as a button that is not shown, and the user selects the size of the face via the selection unit, the position where the auditory organ of the user exists may be acquired from the selection result.
Next, the position acquisition unit 330 selects a filter in which the directivity of the sound emitted by the speaker unit pair is directed to the position where the auditory organ of the user exists, and sets the selected filter as a filter to be used in the directivity control device 210. The processing itself is similar to that of the second embodiment except that the direction of directivity is different.
As shown in
In the present modification example, as shown in
First, the position acquisition unit 330 acquires the position where the auditory organ of the user exists in the similar method of the present embodiment.
As shown in
As shown in
As shown in
As shown in
Since the processing itself in the position acquisition unit 330 is similar to that of the third embodiment, the description thereof will be omitted.
In the present modification example, as shown in
As shown in
In the present modification example, as shown in
As shown in
The above description of the embodiments of the present invention is presented for the purpose of illustration and description. There is no intention to be exhaustive and there is no intention to limit the invention to a disclosed exact form. Modifications or variations are possible from the above-mentioned teachings. The embodiments are selectively represented in order to provide the best illustration of the principle of the present invention and in order for those skilled in the art to be able to use the present invention in various embodiments and with various modifications so that the present invention is suitable for deliberated practical use. All of such modifications or variations are within the scope of the present invention defined by the appended claims interpreted according to a width given fairly, legally and impartially.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2022/014993 | 3/28/2022 | WO |