This disclosure relates to mitigating self-voice occlusion in headsets.
A headset, whether wired or wireless, may include a pair of earphones with transducers for outputting audio signals and a microphone for detecting near-end speech uttered by a wearer of the headset.
A wearer of a headset with ear cups, ear buds or in-the-canal hardware (collectively “ear occluders”) that occlude the wearer's ears will experience an effect, commonly called the “occlusion effect,” which typically causes the wearer to perceive his voice as having over-emphasized lower frequencies and under-emphasized higher frequencies. The overall effect is that the wearer's voice sounds less natural to himself and may impede communication.
In accordance with a first aspect, a device includes an ear occluder, an output transducer that is acoustically coupled to an ear canal of a wearer of the device, a voice microphone configured to generate a first electrical signal that is proportional to a voice-generated sound pressure at the microphone, and signal processing circuitry that is electrically coupled to the output transducer and the microphone. The circuitry includes a compensator configured to generate, from the first electrical signal, a second electrical signal, and output the second electrical signal to the output transducer, wherein the compensator is tuned to cause GOE, a ratio of a sound pressure within the ear canal to a voice-generated sound pressure at a mouth reference point when the ear is occluded and electronically-aided to be approximately equal to GU, a ratio of the sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is unoccluded.
In some implementations of the first aspect, the compensator is a linear-time-invariant filter with a frequency response that is defined by
GO is a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is occluded and unaided, GMM is a ratio of voltage output from the voice microphone to the voice-generated sound pressure at the mouth reference point, and GDE is a ratio of the sound pressure within the ear canal to the voltage input to a driver of the communications device.
In some implementations of the first aspect, the compensator is tuned to cause GOE to be approximately equal to GU over one or more predetermined bands of frequencies.
In some implementations of the first aspect, the compensator is tuned to cause GOE to be approximately equal to GU over a band of frequencies that experiences occlusion effect amplification.
In some implementations of the first aspect, the compensator is tuned to perform one or more of the following: roll off frequencies above a first threshold and roll off frequencies below a different, second threshold.
In some implementations of the first aspect, the compensator is tuned to actively attenuate low frequency self-voice sound pressure and amplify high frequency self-voice sound pressure within the ear canal.
In some implementations of the first aspect, the device further includes a second ear occluder, and a second output transducer that is electrically coupled to the signal processing circuitry and acoustically coupled to a second ear canal of the wearer of the device. The compensator is further configured to output the second electrical signal to the second output transducer. The compensator is tuned to cause GOE, the ratio of the respective sound pressure within each of the first and the second ear canals to the voice-generated sound pressure at a mouth reference point to be approximately equal to GU.
In some implementations of the first aspect, the ear occluder is a circumaural or supra-aural ear cup, an ear bud, or an in-the-canal component.
In accordance with a second aspect, in a device including an ear occluder, an output transducer that is acoustically coupled to an ear canal of a wearer of the device, a voice microphone configured to generate a first electrical signal that is proportional to a voice-generated sound pressure at the microphone, and signal processing circuitry, electrically coupled to the output transducer and the voice microphone, a method for mitigating self-voice occlusion includes generating, by a compensator of the circuitry, from the first electrical signal, a second electrical signal, and outputting the second electrical signal to the output transducer. The compensator is tuned to cause GOE, a ratio of a sound pressure within the ear canal to a voice-generated sound pressure at a mouth reference point when the ear is occluded and electronically-aided to be approximately equal to GU, a ratio of the sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is unoccluded.
In some implementations of the second aspect, the method further includes tuning the compensator to have a frequency response that is defined by
where GO is a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is occluded and unaided, GMM is a ratio of voltage output from the voice microphone to the voice-generated sound pressure at the mouth reference point, and GDE is a ratio of the sound pressure within the ear canal to the voltage input to a driver of the communications device.
In some implementations of the second aspect, the method further includes tuning the compensator to cause GOE to be approximately equal to GU over one or more predetermined bands of frequencies.
In some implementations of the second aspect, the method further includes tuning the compensator to cause GOE to be approximately equal to GU over a band of frequencies that experiences occlusion effect amplification.
In some implementations of the second aspect, the method further includes tuning the compensator to perform one or more of the following: roll off frequencies above a first threshold and roll off frequencies below a different, second threshold.
In some implementations of the second aspect, the method includes converting, by the transducer, the second electrical signal to acoustic energy that actively attenuates low frequency self-voice sound pressure in the ear canal and amplifies high frequency self-voice sound pressure in the ear canal.
In accordance with a third aspect, a device includes a first ear occluder and a second ear occluder, a first output transducer that is acoustically coupled to a first ear canal of a first ear of a wearer of the device, a second output transducer that is acoustically coupled to a second ear canal of a second ear of the wearer of the device, a voice microphone configured to generate a first electrical signal that is proportional to a voice-generated sound pressure at the microphone, signal processing circuitry, electrically coupled to the first and the second output transducers and the voice microphone. The circuitry includes a compensator configured to generate, from the first electrical signal, a second electrical signal, and output the second electrical signal to the first and the second output transducers, wherein the compensator is tuned to cause GOE, an average ratio of a sound pressure within the first and the second ear canals to the voice-generated sound pressure at a mouth reference point to be approximately equal to GU, a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is unoccluded.
In some implementations of the third aspect, the compensator is a linear-time-invariant filter with a frequency response that is defined by
GO is an average ratio of the sound pressure within the first and the second ear canals to the voice-generated sound pressure at the mouth reference point when the ear is occluded and unaided, GMM is a ratio of voltage output from the communications voice microphone to the voice-generated sound pressure at the mouth reference point, and GDE is an average ratio of the sound pressure within the first and the second ear canals to the voltage input to a driver of the communications device.
In accordance with a fourth aspect, a device includes an ear occluder, an output transducer that is acoustically coupled to an ear canal of a wearer of the device, a voice microphone configured to generate a first electrical signal that is proportional to a voice-generated sound pressure at the microphone, and signal processing circuitry that is electrically coupled to the output transducer and the voice microphone. The circuitry includes a compensator configured to generate, from the first electrical signal, a second electrical signal, and output the second electrical signal to the output transducer. The compensator is tuned to cause GOE, a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at a mouth reference point when the ear is occluded and electronically-aided to be approximately equal to GT, a target ratio of sound pressure within the ear to the voice-generated sound pressure at the mouth reference point when the ear is occluded and electronically-aided that is selected to provide a predetermined self-voice experience.
In some implementations of the fourth aspect, the compensator is a linear-time-invariant filter with a frequency response that is defined by
GO is a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is occluded and unaided, GMM is a ratio of voltage output from the microphone to the voice-generated sound pressure at the mouth reference point, and GDE is a ratio of the sound pressure within the ear canal to the voltage input to a driver of the device.
In some implementations of the fourth aspect, GT=2*GU, where GU is a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is unoccluded, and the predetermined self-voice experience is louder than a natural self-voice experience.
In some implementations of the fourth aspect, GT=0.5*GU, where GU is a ratio of a sound pressure within the ear canal to the voice-generated sound pressure at the mouth reference point when the ear is unoccluded, and the predetermined self-voice experience is softer than a natural self-voice experience.
In some implementations of the fourth aspect, the compensator is dynamically tuned in response to a user-controlled mode selection.
In some implementations of the fourth aspect, the compensator is dynamically tuned in response to detection that the headset is engaged in an active telephone call with a far-end communications device.
Hearing one's own voice sound unnatural can cause one to be self-conscious of how one sounds, which can be quite irritating and/or distracting. Advantages of reducing the occlusion effect include one or more of the following. Reducing the occlusion effect increases speaking ease by making the headset wearer more comfortable with how his own voice sounds. Also, reducing the occlusion effect and allowing the headset wearer to hear his own voice naturally encourages the headset wearer to speak at a normal level, for example, when talking to someone else (during a call or face-to-face), while providing voice commands, or when recording a voice memo.
All examples and features mentioned above can be combined in any technically possible way. Other features and advantages will be apparent from the description and the claims.
A headset can be operated with or without self-voice occlusion mitigation. At times in this description, it will be useful to distinguish between those cases in which self-voice occlusion mitigation is inactive or active. As used herein, the term “occluded and unaided” refers to the former case and the term “occluded and electronically-aided” refers to the latter case. Note that in either case, the headset's physical characteristics and electro-acoustic features, including active noise reduction or noise canceling features, if available, have an effect on the sound signals that are delivered to the headset wearer and hence his perception of self-voice.
Referring to
Referring to
Referring to
A person's perception of his own voice depends on the combination of these three acoustic pressures, which in turn depends upon whether the person's ears are unoccluded or occluded, unaided or electronically-aided. For example, when the ear canals are unoccluded as shown in
When describing the person's perception of his own voice, the term “self naturalness” generally refers to the effect of a person hearing his own voice as sounding natural. This description details techniques for mitigating the self-voice occlusion effect when a person's ears are occluded, for example, by one or more ear cups of a headset, thus improving self-naturalness for the headset user. In particular, we describe these techniques, implemented using a feed-forward system that includes a self-voice occlusion effect compensator, in the context of a circumaural headset 200 (
When the headset 200 is positioned on a person's head, the cushion 212, 214 of each earphone 202, 204 deforms slightly to form a seal against the headset wearer's ear in the case of a supra-aural headset or against the headset wearer's head in the case of a circumaural headset. In the case of an in-ear headset (not shown), a seal is formed between an earpiece of the earphone and the concha or ear canal of the headset wearer. Each seal significantly reduces the amplitude of external acoustic energy reaching a respective ear canal of the headset wearer. Typically, lower frequency sound pressure resulting from the user's voice is amplified and higher frequency sound pressure is attenuated inside the ear canals of the headset wearer when the ears are occluded by the headset 200.
Generally, the feed-forward system 300 processes audio signals carrying speech uttered by the headset wearer and detected by the communications voice microphone 220, using the self-voice occlusion effect compensator, KC 310, to actively attenuate low frequency self-voice sound pressure and amplify high frequency self-voice sound pressure within the ear canals. The signals carrying the processed near-end speech that are outputted to transducers 216, 218 in the headset 200 allow the headset wearer to hear his own voice naturally through the headset 200 with minimal delay. In the implementation of the feed-forward system 300 depicted in
GU=GOEdef=GO+GMM×KC×GDE
Solving the above equation for KC leads to:
In effect, the self-voice occlusion effect compensator, KC 310, actively attenuates the sound pressure at frequencies where occlusion causes amplification and amplifies the sound pressure at frequencies where occlusion causes attenuation at the headset wearer's ears when they are occluded by the headset 200.
To illustrate the performance of the techniques, described above, for mitigating self-voice occlusion in a headset, experiments were performed on a test subject. The resulting measurements and computations are shown in the graphs depicted in
The thick solid line of
Although the techniques, described above, for mitigating self-voice occlusion in a headset are illustrated in
In some implementations of a feed-forward system that is provided in a headset to mitigate the self-voice occlusion effect that the headset wearer would experience when he speaks, the self-voice occlusion effect compensator, KC, is designed and tuned such that GOE, the sum of self-voice audio received via the unaided path, GO, and the self-voice audio received via the active electro-acoustic path, GMM*KC*GDE, is as close as possible to GT, a target mouth-to-ear response. In one example, the headset is implemented with a user-controlled mode switch that, when activated by the headset wearer, dynamically tunes the compensator such that GT is set at 0.5*GU. In so doing, the self-voice audio that is presented to the headset wearer is softer than the natural level, which would encourage the headset wearer to speak at a louder level so that he can be heard more easily by the far-end party to the phone call. In another example, the headset is implemented with software that automatically triggers a privacy mode when the headset wearer is on a phone call. In such an example, the compensator is dynamically tuned such that GT is set at 2*GU, which causes the self-voice audio that is presented to the headset wearer to be louder than the natural level. This would encourage the headset wearer to speak more softly, thus increasing the privacy of the conversation.
In some implementations of a feed-forward system that is provided in a headset to mitigate the self-voice occlusion effect that the headset wearer would experience when he speaks, the self-voice occlusion effect compensator is designed and tuned such that GOE, the sum of self-voice audio received via the unaided path, GO, and the self-voice audio received via the active electro-acoustic path, GMM*KC*GDE, is as close as possible to GU in one or more frequency bands, including, for example, a voice frequency band that ranges from approximately 100 Hz to 7 kHz. In particular, the compensator may be designed and tuned such that GOE is as close as possible to GU in the portion of the voice frequency band in which there is amplification due to the occlusion effect. In some cases, the tuning is performed to optimize self-voice occlusion mitigation for a particular headset. In other cases, the tuning is performed in a manner that optimizes self-voice occlusion mitigation for a particular headset and headset wearer combination.
In some implementations of a feed-forward system that is provided in a headset to mitigate the self-voice occlusion effect that the headset wearer would experience when he speaks, the self-voice occlusion effect compensator is designed and tuned to roll off the lower frequencies so as to reduce unwanted background noise, reduce susceptibility to wind noise, and/or reduce overload caused by aberrant incidents (e.g., a car door slamming shut while the headset wearer is inside the car). The compensator can also be designed and tuned to roll off the higher frequencies so as to reduce unwanted background noise. In some implementations, the tuning is performed dynamically based on a detected amount of background noise. In such implementations, when the detected amount of background noise exceeds a particular threshold, the compensator mitigates the self-voice occlusion effect within a voice frequency band that is smaller relative to that when the detected amount of background noise is below the particular threshold. Further, when the detected amount of background noise is negligible, the compensator mitigates the self-voice occlusion effects with full spectral fidelity over a significant portion of the voice frequency band.
A number of implementations have been described. Nevertheless, it will be understood that additional modifications may be made without departing from the scope of the inventive concepts described herein, and, accordingly, other embodiments are within the scope of the following claims.
Number | Name | Date | Kind |
---|---|---|---|
7627352 | Gauger, Jr. et al. | Dec 2009 | B2 |
7920903 | Ueda et al. | Apr 2011 | B2 |
8447370 | Ueda et al. | May 2013 | B2 |
8488829 | Ring | Jul 2013 | B2 |
8620650 | Walters et al. | Dec 2013 | B2 |
8798278 | Isabelle et al. | Aug 2014 | B2 |
20110299692 | Rung | Dec 2011 | A1 |
20120076312 | Iyengar | Mar 2012 | A1 |
20120076320 | Iyengar | Mar 2012 | A1 |
20140126735 | Gauger, Jr. | May 2014 | A1 |
Entry |
---|
International Search Report and Written Opinion dated Dec. 22, 2015 for International Application No. PCT/US2015/057603. |
Mejia Jorge et al: “Active cancellation of occlusion: An electronic vent for hearing aids and hearing protectors”, The Journal of the Acoustical Society of America, American Institute of Physics for the Acoustical Society of America, New York, NY, US, vol. 124, No. I, Jul. 1, 2008 (Jul. 1, 2008). pp. 235-240, P012120265, ISSN: 0001-4966, 001: 10.1121/1.2908279 p. 238, left-hand column abstract. |
Antoine Bernier et al: “An active hearing protection device for musicians”, Proceedings of Meetings on Acoustics, ICA 2013, Montreal, vol. 19, Jun. 2, 2013 (Jun. 2, 2013), pp. 1-9, XP055235670, ISSN: 1939-800X, 001: 10.1121/1.4800066 p. 1-p. 6, line 11; figures 1-9. |
Number | Date | Country | |
---|---|---|---|
20160127829 A1 | May 2016 | US |