The present technique relates to an earhole-wearable sound collection device that includes an attachment unit designed to have at least a portion to be inserted into an earhole portion, a signal processing device that performs signal processing on a sound collection signal generated by an internal microphone located in the attached unit, and a sound collection method.
In recent years, information processing devices having verbal communication functions, such as so-called smartphones, have started spreading widely.
In an information processing device having such a verbal communication function, an earpiece microphone (an earphone integrated with a microphone) that enables hearing of received speech voice and collection of emitted speech voice is employed.
As shown in
In the conventional earpiece microphone 100 having the above structure, speech voice emitted from the wearer (the speaker) reaches the microphone 102A via the outside (the external air), and is then collected.
In the conventional earpiece microphone 100 having the above structure, the microphone 102A for collecting emitted speech voice is exposed to the outside. That is, the microphone 102A is in direct contact with extraneous noise (environmental noise).
Therefore, with the conventional earpiece microphone 100, a relatively large amount of ambient noise is collected together with emitted speech voice, and the S/N ratio (signal-to-noise ratio) of emitted speech signals tends to become lower. As a result, it becomes difficult for the person at the other end of the line to hear the speech voice emitted from the wearer H.
To suppress the S/N ratio degradation due to noise, it is possible to perform a so-called noise reduction process according to the SS (Spectrum Subtraction) method, for example.
However, a relatively large processing resource is required for performing such a noise reduction process, resulting in disadvantages in terms of product cost, power consumption, and the like.
Also, the noise reduction process involving nonlinear processing on the frequency axis according to the above mentioned SS method or the like normally has a problem of sound quality degradation after the processing.
The present technique has been developed in view of the above problems, and aims to realize sound collection with a high S/N ratio by reducing noise influence without the noise reduction process.
To solve the above problems, an earhole-wearable sound collection device according to the present technique has the following structure.
Specifically, the earhole-wearable sound collection device includes an attachment unit that is designed so that at least part of the attachment unit can be inserted into an earhole portion, and is designed to form a substantially sealed internal space therein when attached to the earhole portion, the internal space connecting to an ear canal.
The earhole-wearable sound collection device also includes an internal microphone that is located in the internal space of the attachment unit, and collects emitted speech voice that is emitted by the wearer and propagates through the ear canal when the attachment unit is attached to the earhole portion.
The earhole-wearable sound collection device also includes an equalizing unit that performs an equalizing process of a high-frequency emphasizing type on a sound collection signal from the internal microphone.
The earhole-wearable sound collection device also includes a speaker that is located in the internal space of the attachment unit.
The earhole-wearable sound collection device also includes a noise cancelling unit that causes the speaker to output noise cancelling sound based on a sound collection signal from a microphone provided for the attachment unit, the noise cancelling sound being output to reduce noise that propagates in the internal space of the attachment unit.
According to the present technique, a microphone (the internal microphone) that collects emitted speech voice is located in a space that is substantially sealed off from outside and connects to an ear canal of the wearer (the speaker). As the microphone is located in a space sealed off from outside, influence of noise can be effectively reduced. As emitted speech voice that propagates through the ear canal of the speaker, the emitted speech voice can be collected at a higher S/N ratio than that in a case where a conventional earpiece microphone (
According to the present technique, the noise cancelling unit is further provided to reduce the noise that propagates in the internal space having the internal microphone located therein. Accordingly, the S/N ratio of emitted speech voice collection signals is further improved.
As will be apparent from the description below, the equalizing unit is provided only to reduce muffled sound that is generated when emitted speech voice propagating through an ear canal is collected.
As described above, according to the present technique, emitted speech voice can be collected at a higher S/N ratio than that with a conventional earpiece microphone that collects emitted speech voice propagating through the external air.
Also, according to the present technique, the noise reduction process for sound collection signals is unnecessary. As a result, an increase in the signal processing resource can be prevented, and advantages can be achieved in terms of production cost and power consumption.
The following is a description of embodiments according to the present technique.
Explanation will be made in the following order.
<1. Collection of Speech Voice via an Ear Canal>
<2. Signal Processing for Sound Quality Improvement>
<3. Further S/N Ratio Improvement by Noise Cancelling in the Internal Space>
[3-1. First Embodiment]
[3-2. Second Embodiment]
[3-3. Third Embodiment]
[3-4. Fourth Embodiment]
[3-5. Fifth Embodiment]
<4. Modifications>
<1. Collection of Speech Voice Via an Ear Canal>
Specifically, A of
First, the attachment unit 1 has an internal microphone 1B provided therein to collect speech voice of the wearer (the speaker) H.
In this example, the internal microphone 1B may be a MEMS (Micro Electro Mechanical Systems) microphone, with the installation space being taken into account.
The external shape of the attachment unit 1 is designed so that at least part of the attachment unit 1 can be inserted into an earhole portion of the wearer H, and accordingly, the attachment unit 1 can be attached to an ear of the wearer H. Specifically, the attachment unit 1 in this case includes an earhole insertion portion 1A having such a shape that can be inserted into the earhole portion HB of the wearer H, and the earhole insertion portion 1A is inserted into the earhole portion HB, so that the attachment unit 1 is attached to the ear of the wearer H.
The attachment unit 1 is designed so that an internal space 1V connecting to the ear canal HA of the wearer H is formed as shown in B of
At this point, the earhole insertion portion 1A of the attachment unit 1 is covered with a material having elasticity in its surface portion like the earhole insertion portion of a canal-type earphone portion, so that contact with the earhole portion HB is achieved at the time of attachment.
Accordingly, at the time of attachment, the above described internal space 1V becomes a space that is substantially sealed off from the outside.
The internal microphone 1B is provided in this internal space 1V.
First, the sound collection system of this embodiment is based on the premise that collection of speech voice is performed while the attachment unit 1 is attached to an ear of the wearer H.
When the wearer H speaks while the attachment unit 1 is in an attached state, the vibrations accompanying the speaking are transmitted to the ear canal HA from the vocal cords of the wearer H via bones and the skin (as indicated by an arrow with a dashed line). As explained above with reference to
In this sound collection system as an embodiment, as long as the inside of the housing of the attachment unit 1 maintains sufficient sealability, insulation against noise that propagates from the outside of the housing becomes sufficiently higher even in loud environments, and noise is effectively prevented from entering the internal microphone 1B. Accordingly, speech voice can be collected at a higher S/N ratio (signal-to-noise ratio) than that with the conventional earpiece microphone 100 (see
The sound insulation should be strong enough to cover at least the band of noise to be restrained, and, in that sense, completely hermetic sealing is not required.
<2. Signal Processing for Sound Quality Improvement>
In the sound collection system of this embodiment that collects speech voice that propagates via the ear canal HA and performs the sound collection while securing the sealability of the internal space 1V having the internal microphone 1B provided therein, speech voice can be collected at a higher S/N ratio than that with the conventional earpiece microphone 100.
However, in a case where the sealability is relatively high as in a case with a conventional canal-type earphone, for example, gain (response) in the ear canal HA becomes greater in lower bands than in a normal free space. Therefore, the sound collection signal generated by the internal microphone 1B has relatively high response characteristics in lower bands.
Due to this influence, transmitted speech voice based on the sound collection signal generated by the internal microphone 1B is muffled in the lower bands, and is difficult for the person at the other end of the line to hear.
Therefore, to correct the sound collection signal response characteristics in the lower bands, it is preferable to provide a signal processing means as an equalizer (EQ) as shown in A of
Specifically, in the configuration shown in A of
First, to explain that the low-frequency gain of a sound collection signal transmitted via the ear canal HA becomes larger, A of
The frequency characteristics shown in this drawing are temporally averaged on the frequency axis.
In the substantially sealed internal space 1V connecting to the ear canal HA, the diaphragm of the internal microphone 1B has greater vibrations than those of the outside as a non-sealed environment when low-frequency acoustic waves and vibrations are caused in the ear canal HA by speaking. As a result, a higher microphone output voltage than that of the microphone located outside is obtained in the lower bands.
As can be seen from A of
With the sound collection signal of the internal microphone 1B having the characteristics shown in A of
In view of this, the frequency characteristics of the sound collection signal generated by the internal microphone 1B are corrected to achieve a more natural frequency characteristics balance. In this manner, the clarity of the transmitted speech voice to be heard by the person at the other end is increased.
To do so, the frequency characteristics of the sound collection signal generated by the internal microphone 1B need to approximate the frequency characteristics of the sound collection signal generated by the microphone located outside.
Specifically, a filter (or the equalizer 11) expressed by the transfer function shown in B of
After equalizing, more natural voice sound with a higher clarity than the voice sound prior to the equalizing can be obtained.
In A of
As can be seen from the frequency characteristics, the sound collection signal generated by the internal microphone 1B approximates the sound collection signal generated by the microphone located outside, and a more natural frequency characteristics balance is maintained.
So as to improve the sound quality of transmitted speech voice, it is effective to perform a noise gate process and a compressor process, as well as the correction by the equalizer 11, on the sound collection signal generated by the internal microphone 1B, as shown in B of
Specifically, in the configuration shown in B of
In the noise gate process, the noise gate processing unit 12 lowers the output signal level (or closes the gate) when the input signal level becomes equal to or lower than a certain level, and returns the output signal level to the original level (or opens the gate) when the input signal level becomes higher than the certain level.
As is normally conducted, parameters, such as the rate of attenuation of the output level, the open/close envelope of the gate, and the frequency bands to which the gate reacts, are appropriately set so that the clarity of speech voice will increase.
In the compressor process, the compressor 13 performs a process to adjust the temporal amplitude of the input sound collection signal.
Referring now to
In
While the above described equalizer 11 improves sound quality by adjusting the frequency characteristics of a sound collection signal, the compressor process is performed to correct the waveform of the sound collection signal on the temporal axis.
In this embodiment, speech voice reaches the diaphragm of the internal microphone 1B via the ear canal HA by virtue of vibrations of the body such as flesh and bones of the wearer H, as described above. This means that the speech voice has a certain level of nonlinearity, unlike speech voice that propagates through the external air.
Therefore, the difference in speech voice volume that varies depending on the voice volume at the time of speaking might become larger than that in a case where sound collection is performed through normal propagation in the external air, and, if not corrected, the collected voice might become difficult to hear.
As can be seen from A of
The compressor 13 then adjusts the temporal amplitude of the sound collection signal generated by the internal microphone 1B as shown in B of
As a result, the emitted speech voice becomes easier to hear, and sound quality is improved.
In this embodiment, the various kinds of signal processing on sound collection signals may be performed by an analog electrical circuit, or may be performed by digital signal processing via an ADC (A/D converter).
<3. Further S/N Ratio Improvement by Noise Cancelling in The Internal Space>
[3-1. First Embodiment]
As can be understood from the above explanation, sound collection via the ear canal HA described with reference to
In the description below, the same components as those already described are denoted by the same reference numerals as those used for the already described components, and explanation of them will not be repeated.
The sound collection system as the first embodiment is designed to include an attachment unit 1, an attachment unit 2, and a signal processing unit 3.
In this case, the attachment unit 1 is to be attached to one ear of a wearer H, and the attachment unit 2 is to be attached to the other ear of the wearer H.
Like the attachment unit 1, the attachment unit 2 is designed so that at least part of the attachment unit 2 can be inserted into an earhole portion HB of the wearer H, and accordingly, the attachment unit 2 can be attached to an ear of the wearer H. Specifically, the attachment unit 2 also includes an earhole insertion portion 2A having such a shape that can be inserted into the earhole portion HB of the wearer H, and the earhole insertion portion 2A is inserted into the earhole portion HB, so that the attachment unit 2 is attached to the ear of the wearer H.
The attachment unit 2 is also designed so that an internal space 2V connecting to the ear canal HA of the wearer H is formed when the attachment unit 2 is attached to the wearer H. The earhole insertion portion 2A is covered with a material having elasticity in its surface portion so that contact with the earhole portion HB is achieved at the time of attachment.
The attachment unit 2 has a speaker 2S provided in the internal space 2V thereof. The speaker 2S is provided for outputting received speech voice based on a received speech signal. That is, the speaker 2S is driven based on a received speech signal amplified by an amplifier 17 provided in the signal processing unit 3, and outputs received speech voice in accordance with the received speech signal.
In this example, the speaker S2 is of a BA (balanced armature) type, with the installation space being taken into consideration.
In the sound collection system of this example, an external microphone 1C that is installed to directly collect sound generated outside the housing of the attachment unit 1 is provided for the attachment unit 1. The attachment unit 1 in this case also has a speaker 1S provided in the internal space 1V thereof.
In this example, the external microphone 1C is a MEMS microphone, like the internal microphone 1B.
The speaker 1S is also a BA-type speaker, with the installation space being taken into account.
The external microphone 1C is installed to be able to perform sound collection compatible with a noise cancelling process according to the FF (feedforward) method described later, and the sound collection port thereof is not necessarily in direct contact with the outside of the housing of the attachment unit 1.
In addition to the above described amplifier 17 for received speech signal amplification, the signal processing unit 3 includes a microphone amplifier 10, an equalizer 11, a noise gate processing unit 12, and a compressor 13, which have been described above with reference to
The microphone amplifier 10, the equalizer 11, the noise gate processing unit 12, and the compressor 13 have already been described, and therefore, explanation of them is not repeated herein.
A sound collection signal generated by the external microphone 1C attached to the attachment unit 1 is amplified by the microphone amplifier 14, and is then input to the NC filter 15.
Based on the sound collection signal that is input from the external microphone 1C via the microphone amplifier 14, the NC filter 15 generates a noise cancelling signal according to the FF method. Specifically, the NC filter 15 performs an equalizing process compatible with the FF method on the sound collection signal, to generate the noise cancelling signal for reducing the noise propagating in the internal space 1V of the attachment unit 1.
The amplifier 16 amplifies the noise cancelling signal obtained at the NC filter 15, to drive the speaker 1S in the attachment unit 1. Noise cancelling sound based on the noise cancelling signal is then output from the speaker 1S. As a result, the noise components propagating in the internal space 1V are reduced.
The NC process may be realized by using an analog filter circuit, or may be realized by digital signal processing that involves an ADC according to a method disclosed in Reference Document 1 mentioned below.
Reference Document 1: Japanese Patent Application Laid-Open No. 2008-193421
In the above described sound collection system as the first embodiment, the S/N ratio of emitted speech voice collection signals is secured by virtue of the (passive) sound insulating properties of the housing of the attachment unit 1 against environmental noise, and noise in the internal space 1V is reduced by the NC process. In this manner, the S/N ratio of emitted speech voice collection signals can be further increased.
It should be noted that speech voice of the wearer H propagates based on vibrations through the ear canal HA, regardless of the NC process. Therefore, the speech voice is collected by the same amount as that in a case where the NC process is not performed.
Also, with the configuration of the first embodiment shown in
A specific configuration of the sound collection system of this embodiment including the signal processing unit 3 that realizes the above described NC process for noise cancelling in the internal space 1V and the various kinds of signal processing (from the equalizer 11 to the compressor 13) for sound quality improvement may be of an “integrated type” having the signal processing unit 3 provided in the attachment unit 1, or of a “separated type” having the signal processing unit 3 provided outside the attachment unit 1.
First, the configuration of the “integrated type” shown in A of
In the case of the “integrated type”, the signal processing unit (the amplifier 17 in the case shown in
In the configuration of the “separated type” shown in B of
Although not shown in the drawing, in the case of the “separated type”, a received speech signal amplified by the amplifier 17 is transmitted from the external device 50 to the attachment unit 2 (the speaker 2S).
[3-2. Second Embodiment]
In the second embodiment, an external microphone 2C and a NC filter 22 are provided in the channel (hereinafter also referred to as “ch”) on the side of the attachment unit 2, so as to reduce noise in the internal space 2V and make hearing of received speech voice easier for the wearer H. Also, a control unit 20A shown in the drawing is provided so as to realize switching between a telephone call mode and a music listening mode.
First, the second embodiment is based on the premise that the signal processing unit 20 in the drawings (
In the second embodiment, the side of the attachment unit 1 is indicated as the Lch side, and the side of the attachment unit 2 is indicated as the Rch side, for example.
Like the external microphone 1C installed on the side of the attachment unit 1, the attachment unit 2 in this case has the external microphone 2C attached thereto, so as to obtain sound collection signals compatible with noise canceling according to the FF method.
In the telephone call mode shown in
The microphone amplifier 21 amplifies a sound collection signal generated by the external microphone 2C.
The NC filter 22 performs the same equalizing process according to the FF method as that of the above described NC filter 15, on the sound collection signal that has been generated by the external microphone 2C and been amplified by the microphone amplifier 21. As a result, a noise cancelling signal for reducing noise propagating in the internal space 2V is obtained.
The adder 23 adds the noise cancelling signal obtained by the NC filter 23 to a received speech signal, and supplies the signal obtained as a result of the adding to the amplifier 17.
With the above configuration on the Rch side, noise in the internal space 2V of the attachment unit 2 is reduced in the sound collection system of this example. Accordingly, in the telephone call mode shown in
It should be noted that, in the telephone call mode shown in
The control unit 20A controls the configuration of the function unit of the signal processing unit 20 to switch between the configuration shown in
In the music listening mode shown in
In the music listening mode, the function unit (from the microphone amplifier 10 to the compressor 13 shown in
In this case, the combined signal generated by the adder 24 adding the Lch music signal and the noise cancelling signal is amplified by the amplifier 16, and is output from the speaker 1S.
On the Rch side, the configuration of the function unit is the same as that in the telephone call mode shown in
As described above, in the music listening mode, the sound collection system as the second embodiment has the same function as that of a conventional sound reproducing system having a NC function, to cause the wearer H to listen to sound based on the Lch and Rch music signal in a quiet environment having noise reduced.
As can be understood from the above description, the respective attachment units (1 and 2) of the sound collection system as the second embodiment can be realized simply by adding the internal microphone 1B to the earphone unit on one of the channels of the earphone system compatible with a NC system according to the FF method.
That is, since an earphone device compatible with a NC system according to the FF method originally has the right and left speakers (1S and 2S) and the external microphones (1C and 2C) for collecting noise for NC, the respective attachment units of the second embodiment can be realized simply by adding the external microphone 1B to one of the earphone units.
The number of changes that need to be made to an existing product can be reduced in this manner. Accordingly, an increase of the product cost can be effectively reduced in realizing the system as the second embodiment.
It should be noted that the second embodiment can also have both of the configurations of the “integrated type” and the “separated type” shown in
This aspect also applies to the embodiments described later.
The sound collection system of the second embodiment can be formed with hardware.
The configuration of the signal processing unit 20 on the Lch side in such a case includes the components from the microphone amplifier 10 to the compressor 13 shown in
The Rch side is designed to have the configurations shown in
[3-3. Third Embodiment]
In each of the foregoing embodiments, only noise cancelling sound is output but no received speech voice is output from the ch on the side for collecting emitted speech sound at the time of a telephone call. Therefore, hearing of received speech voice is performed only at the ch on the side on which emitted speech voice is not collected.
In a third embodiment, received speech voice is also output from the ch on the side for collecting emitted speech voice, and hearing of received speech voice is performed at both ears of a wearer H.
Although only the configurations of an attachment unit 1 and the signal processing system of the ch on the side of the attachment unit 1 are shown in
First, the sound collection system in this case differs from the sound collection system of the first embodiment shown in
Like the adder 24 shown in
As a result, the speaker 1S in the attachment unit 1 outputs noise cancelling sound and received speech voice based on the received speech signal.
With the above described configuration, the received speech voice (and the noise cancelling sound) output from the speaker 1S is released into the internal space 1V of the attachment unit 1, and the internal microphone 1B collects the received speech voice. That is, the internal microphone 1B in this case collects the received speech voice as well as emitted speech voice of the wearer H. As a result, it might become difficult for the person at the other end to hear the emitted speech voice.
In view of this, the echo canceller 26 and the adder 27 are provided in the third embodiment, so as to subtract the component of the received speech voice collected by the internal microphone 1B via the internal space 1V from the sound collection signal generated by the internal microphone 1B.
The echo canceller 26 performs a filtering process (an equalizing process) using a transfer function that represents the characteristics of the speaker 1S, the sound space characteristics of the internal space 1V, and the microphone characteristics of the internal microphone 1B, so that not the received speech signal but the received speech signal component that has passed through the speaker 1S, the internal space 1V, and the internal microphone 1B, and is to be actually added to the sound collection component of emitted speech voice is subtracted from the sound collection signal.
The adder 27 adds the received speech signal subjected to the filtering process by the echo canceller 26, to the sound collection signal that has been generated by the internal microphone 1B and has passed through the microphone amplifier 10, and outputs the result to the noise gate processing unit 12.
With the above described configuration, the received speech voice component to be heard by the person at the other end can be effectively reduced. As a result, the person at the other end can hear the emitted speech voice more clearly.
Although the echo canceller that successively updates the filter contents is provided in the above described example, a filter that performs a regular equalizing process taking into account the above described characteristics (the characteristics of the speaker 1S, the sound space characteristics of the internal space 1V, and the microphone characteristics of the internal microphone 1B) may be provided in place of the echo canceller.
[3-4. Fourth Embodiment]
In the fourth embodiment, a FB (feedback) method, instead of the FF method, is adopted as the noise cancelling method.
As shown in the drawing, the sound collection system in this case differs from the sound collection system of the third embodiment shown in
The signal processing unit 30 differs from the signal processing unit 25 in that the microphone amplifier 14 and the NC filter 15 used in the NC process according to the FF method are not provided, but a NC filter 31 compatible with the FB method and an equalizer 32 are provided.
It should be noted that the fourth embodiment is the same as the third embodiment in that a received speech signal component reproduced by the speaker 1S is subtracted by using an echo canceller 26.
As is widely known, the FB method is a method of generating a noise cancelling signal based on a result of collection of noise propagating in the internal space 1V (the space in which sound is output from the speaker 1S) of the attachment unit 1.
The internal microphone 1B also serves as the microphone that performs the noise collection according to the FB method.
In this case, the sound collection signal generated by the internal microphone 1B is amplified by the microphone amplifier 10, and is then supplied to the adder 27 and the NC filter 31 as shown in the drawing.
The NC filter 31 performs an equalizing process according to the FB method on the sound collection signal that is generated by the internal microphone 1B and is input via the microphone amplifier 10, to generate a noise cancelling signal for reducing noise propagating in the internal space 1V of the attachment unit 1.
The adder 24 adds the noise cancelling signal obtained at the NC filter 31 to the received speech signal subjected to the equalizing process by the equalizer 32. The combined signal is then output to the amplifier 16.
As a result, noise cancelling sound compatible with the FB method is output from the speaker 1S, and noise in the internal space 1V is reduced accordingly.
In the case where the FB method is adopted, unlike in the case of the FF method, sound based on a received speech signal is reproduced by the speaker 1S, and then enters the internal microphone 1B (also serving as a noise collection microphone in this case). The sound is affected by the NC effect, and the sound quality differs from that in the case of regular reproduction. Therefore, the equalizer 32 that corrects sound quality by taking such influence into account beforehand is provided for received speech signals.
With the above described configuration of the fourth embodiment, noise that propagates in the internal space 1V and is to be heard by the wearer H is reduced. Accordingly, the same effect to improve the S/N ratio of transmitted speech signals is achieved as in the above described first through third embodiments.
Also, by adopting the FB method, the external microphone 1C can be advantageously excluded.
[3-5. Fifth Embodiment]
In the fifth embodiment, the S/N ratio of emitted speech voice collection signals is further improved by performing a so-called beam forming process on emitted speech signals generated by collecting sound in both L and R channels.
Also, a so-called FF+FB method for simultaneously implementing the FF method and the FB method is adopted as the noise cancelling method to further reduce noise in the internal space of an attachment unit and improve the S/N ratio in emitted speech voice collection.
In the fifth embodiment, the speaker 1S (and the speaker 2S) also outputs received speech voice, as in the above described third and fourth embodiments.
In
The signal processing unit 35 differs from the signal processing unit 20 in the following aspects.
First, an adder 24, a NC filter 31, an echo canceller 26, and an adder 27 are added to the configuration on the Lch side, which is the side of the attachment unit 1, so as to cope with the FB method and received speech voice outputs.
Meanwhile, a microphone amplifier 36 and a NC filter 37 for coping with the FB method, and an echo canceller 38 and an adder 39 are added to the configuration on the Rch side, which is the side of the attachment unit 2.
Also, an equalizer 32 that performs an equalizing process on a received speech signal to cope with the FB method, and a beam forming unit 40 are added as components to be shared between the two channels.
On the Lch side, a sound collection signal that has been generated by the internal microphone 1B and been amplified by the microphone amplifier 10 is input to the NC filter 31 compatible with the FB method, and the output of the NC filter 31 is supplied to the adder 24.
The adder 24 in this case adds the output of the NC filter 31, an output of the NC filter 15 compatible with the FF method, and a received speech signal subjected to the equalizing process by the equalizer 32 used by the FB method. The result is output to the amplifier 16.
Likewise, on the Rch side, a sound collection signal that has been generated by the internal microphone 2B and been amplified by the microphone amplifier 36 is input to the NC filter 37 compatible with the FB method, and the output of the NC filter 37 is supplied to the adder 23.
The adder 23 in this case adds the output of the NC filter 37, an output of the NC filter 22 compatible with the FF method, and a received speech signal having passed through the equalizer 32. The result is output to the amplifier 17.
With the above described configurations on the Lch side and the Rch side, a noise cancelling process according to the FF+FB method can be performed in both Lch and Rch.
As disclosed in Reference Document 2 mentioned below, according to the FF+FB method, a greater noise reduction effect can be achieved in a wider band, compared with the noise reduction effect in a case where only the FF method or the FB method is implemented. That is, with the above described configuration, noise in the internal spaces 1V and 2V can be more effectively reduced, and the S/N ratio of emitted speech voice collection signals can be further improved.
As noise in the internal spaces 1V and 2V can be more effectively reduced, hearing of received speech voice is made even easier for the wearer H.
It goes without saying that, in this case, the filter characteristics of the respective NC filters (15, 22, 31, and 37) should be appropriately set according to the FF+FB method.
Reference Document 2: Japanese Patent Application Laid-Open No. 2008-116782
As the speakers 1S and 2S output received speech voice, the same echo canceller 26 as that of the above described third and fourth embodiments, and an echo canceller 38 are provided in the signal processing unit 35.
The echo canceller 26 receives a received speech signal having passed through the equalizer 32, and performs the same echo cancelling process as that described in the third embodiment on the received speech signal. The adder 27 adds the output of the echo canceller 26 to a sound collection signal that has been generated by the internal microphone 1B and been amplified by the microphone amplifier 10.
Meanwhile, the echo canceller 38 receives a received speech signal having passed through the equalizer 32, and performs the same echo cancelling process as that described in the third embodiment on the received speech signal. The adder 39 adds the output of the echo canceller 38 to a sound collection signal that has been generated by the internal microphone 2B and been amplified by the microphone amplifier 36.
With the above described configuration, received speech voice components to be mixed with sound collection signals generated by the internal microphones 1B and 2B are reduced, and as a result, the emitted speech voice to be heard by the person at the other end can be made clearer.
The beam forming unit 40 is also provided in the signal processing unit 35.
The beam forming unit 40 receives a sound collection signal that has been generated by the internal microphone 1B and is obtained from the adder 27 (a Lch-side sound collection signal), and a sound collection signal that has been generated by the internal microphone 2B and is obtained from the adder 39 (a Rch-side sound collection signal). The beam forming unit 40 then performs a beam forming process.
The simplest specific example of the beam forming process using the Lch and Rch sound collection signals may be a process in which the Lch sound collection signal is added to the Rch sound collection signal.
In the configuration shown in
Specific example techniques that can be used in the beam forming process include not only the above described adding operation but also a technique of determining voice components coming from the direction of the sound source based on a result of sound analysis conducted on sound collection signals, and extracting only the voice components from the direction of the sound source based on the determination result. At this point, a process of determining dominant components in the sound collection signals may be performed as a specific process in the sound analysis.
To sum up the beam forming process in this case, voice components coming from the direction of the sound source should be emphasized, and voice components coming from the other directions should be suppressed.
In the fifth embodiment, the signal processing for further improving the S/N ratio of emitted speech voice collection signals may be a noise reduction process according to a SS (Spectrum Subtraction) method, for example, as well as the above described beam forming process.
The noise reduction process according to the SS method is disclosed in Reference Document 3 mentioned below, for example.
A configuration for simultaneously performing a noise cancelling process according to the FF method or the FB method and the noise reduction process according to the SS method or the like is also disclosed in Reference Document 3 mentioned below.
Reference Document 3: Japanese Patent Application Laid-Open No. 2010-11117
<4. Modifications>
Although embodiments according to the present technique have been described so far, the present technique is not limited to the above described specific examples.
For example, a sound collection system according to the present technique is used for telephone calls in the above described examples. However, the present technique can be suitably applied to a system for recording collected speech signals.
In the above descriptions, sound collection is monaurally performed. However, in a case where the present technique is applied to the above described recording system, stereo sound collection can also be performed. In this case, the equalizer 11, the noise gate processing unit 12, and the compressor 13 are provided on each of the Lch side and the Rch side independently of each other.
In the above descriptions, the speakers 1S and 2S are of the BA type, but speakers of a dynamic type or a capacitor type may be used instead.
The internal microphones 1B and 2B and the external microphones 1C and 2C are not particularly limited to certain types, either.
The present technique can also be embodied in the following structures.
(1) An earhole-wearable sound collection device including:
an attachment unit that is designed so that at least part of the attachment unit can be inserted into an earhole portion, and is designed to form a substantially sealed internal space therein when attached to the earhole portion, the internal space connecting to an ear canal;
an internal microphone that is located in the internal space of the attachment unit, and collects emitted speech voice that is emitted by a wearer and propagates through the ear canal when the attachment unit is attached to the earhole portion;
an equalizing unit that performs an equalizing process of a high-frequency emphasizing type on a sound collection signal from the internal microphone;
a speaker located in the internal space of the attachment unit; and
a noise cancelling unit that causes the speaker to output noise cancelling sound based on a sound collection signal from a microphone provided for the attachment unit, the noise cancelling sound being output to reduce noise that propagates in the internal space of the attachment unit.
(2) The earhole-wearable sound collection device of (1), wherein the noise cancelling unit generates a noise cancelling signal compatible with a feedforward method based on a sound collection signal from an external microphone provided to collect sound outside the attachment unit, and causes the speaker to output the noise cancelling sound based on the noise cancelling signal.
(3) The earhole-wearable sound collection device of (1), wherein the noise cancelling unit generates a noise cancelling signal compatible with a feedback method based on a sound collection signal from a microphone provided to collect sound inside the internal space of the attachment unit, and causes the speaker to output the noise cancelling sound based on the noise cancelling signal.
(4) The earhole-wearable sound collection device of (3), wherein the noise cancelling unit generates the noise cancelling signal compatible with the feedback method based on the sound collection signal from the internal microphone.
(5) The earhole-wearable sound collection device of (1), wherein the noise cancelling unit generates a noise cancelling signal compatible with a feedforward method based on a sound collection signal from an external microphone provided to collect sound outside the attachment unit, generates a noise cancelling signal compatible with a feedback method based on a sound collection signal from a microphone provided to collect sound inside the internal space of the attachment unit, and causes the speaker to output the noise cancelling sound based on the two noise cancelling signals.
(6) The earhole-wearable sound collection device of (1) to (5), wherein
the attachment unit is a first attachment unit to be attached to one ear of the wearer, and a second attachment unit to be attached to the other ear of the wearer,
the internal microphone and the speaker are provided as a first internal microphone and a first speaker in the internal space of the first attachment unit,
the noise cancelling unit is a first noise cancelling unit that causes the first speaker to output first noise cancelling sound based on a sound collection signal from a microphone provided on the side of the first attachment unit, the first noise cancelling sound being output to reduce noise that propagates in the internal space of the first attachment unit,
a second speaker is located in the internal space of the second attachment unit, and
a second received speech voice output unit is provided to cause the second speaker to output sound based on a received speech signal.
(7) The earhole-wearable sound collection device of (6), further including
a second noise cancelling unit that causes the second speaker to output second noise cancelling sound based on a sound collection signal from a microphone provided on the side of the second attachment unit, the second noise cancelling sound being output to reduce noise that propagates in the internal space of the second attachment unit.
(8) The earhole-wearable sound collection device of (1) to (7), further including:
a sound output unit that causes the speaker to output received speech voice based on an input received speech signal, and the noise cancelling sound from the noise cancelling unit; and
a received speech voice removing unit that removes, from the sound collection signal from the internal microphone, the component of the received speech voice output from the speaker based on the received speech signal.
(9) The earhole-wearable sound collection device of (1) to (8), further including
a control unit that controls switching between a telephone call mode and a listening mode,
wherein,
in the telephone call mode, only the noise cancelling sound from the noise cancelling unit is output from the speaker, and,
in the listening mode, the noise cancelling sound from the noise cancelling unit and sound for listening based on an audio signal for listening that is input from outside are output from the speaker.
(10) The earhole-wearable sound collection device of (1), wherein
the attachment unit is a first attachment unit to be attached to one ear of the wearer, and a second attachment unit to be attached to the other ear of the wearer,
a first internal microphone and a first speaker are provided as the internal microphone and the speaker in the internal space of the first attachment unit,
a second internal microphone and a second speaker are provided as the internal microphone and the speaker in the internal space of the second attachment unit,
the noise cancelling unit is a first noise cancelling unit that causes the first speaker to output first noise cancelling sound based on a sound collection signal from a microphone provided on the side of the first attachment unit, and a second noise cancelling unit that causes the second speaker to output second noise cancelling sound based on a sound collection signal from a microphone provided on the side of the second attachment unit, the first noise cancelling sound being output to reduce noise that propagates in the internal space of the first attachment unit, the second noise cancelling sound being output to reduce noise that propagates in the internal space of the second attachment unit, and
a beam forming unit is further provided to perform a beam forming process based on a sound collection signal from the first internal microphone and a sound collection signal from the second internal microphone.
(11) The earhole-wearable sound collection device of (1) to (10), wherein the equalizing unit and the noise cancelling unit are located inside the attachment unit.
(12) The earhole-wearable sound collection device of (1) to (11), further including
a noise gate processing unit that performs a noise gate process on the sound collection signal from the internal microphone.
(13) The earhole-wearable sound collection device of (1) to (12), further including
a compressor unit that performs a compressor process on the sound collection signal from the internal microphone.
(14) A signal processing device including:
an equalizing unit that performs an equalizing process of a high-frequency emphasizing type on a sound collection signal from an internal microphone, the internal microphone being located in an internal space of an attachment unit, at least part of the attachment unit being to be inserted to an earhole portion, the attachment unit forming a substantially sealed internal space therein when attached to the earhole portion, the internal space connecting to an ear canal, the internal microphone collecting speech voice emitted by a wearer when the attachment unit is attached to the earhole portion, the speech voice propagating through the ear canal; and
a noise cancelling unit that causes a speaker to output noise cancelling sound based on a sound collection signal from a microphone provided for the attachment unit, the noise cancelling sound being output to reduce noise that propagates in the internal space of the attachment unit, the speaker being located in the internal space of the attachment unit.
Number | Date | Country | Kind |
---|---|---|---|
2011-268781 | Dec 2011 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2012/081055 | 11/30/2012 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2013/084811 | 6/13/2013 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20090147982 | Ashida et al. | Jun 2009 | A1 |
20110096939 | Ichimura | Apr 2011 | A1 |
20120014532 | Kimura | Jan 2012 | A1 |
20120209601 | Jing | Aug 2012 | A1 |
Number | Date | Country |
---|---|---|
08-079873 | Mar 1996 | JP |
2009-141698 | Jun 2009 | JP |
4352932 | Aug 2009 | JP |
2010-147982 | Jul 2010 | JP |
Number | Date | Country | |
---|---|---|---|
20140307884 A1 | Oct 2014 | US |