1. Field of the Invention
The present invention relates to a method for providing hearing assistance to a user; it also relates to a corresponding system. In particular, the invention relates to a system comprising a transmission unit comprising a microphone arrangement for capturing audio signals, a receiver unit, and means for stimulating the hearing of the user wearing the receiver unit, with the audio signals being transmitted via a wireless audio link from the transmission unit to the receiver unit.
2. Description of Related Art
Usually in such systems the wireless audio link is an FM radio link. The benefit of such systems is that sound captured by a remote microphone at the transmission unit can be presented at a high sound pressure level to the hearing of the user wearing the receiver unit at his ear(s).
According to one typical application of such wireless audio systems, the stimulating means is a loudspeaker which is part of the receiver unit or is connected thereto. Such systems are particularly helpful for being used in teaching normal-hearing children suffering from auditory processing disorders (APD), wherein the teacher's voice is captured by the microphone of the transmission unit, and the corresponding audio signals are transmitted to and are reproduced by the receiver unit worn by the child, so that the teacher's voice can be heard by the child at an enhanced level, in particular with respect to the background noise level prevailing in the classroom. It is well known that presentation of the teacher's voice at such enhanced level supports the child in listening to the teacher.
Usually in such systems the audio signals received by the receiver are amplified at a given constant gain for being reproduced by the output transducer.
According to another typical application of wireless audio systems the receiver unit is connected to or integrated into a hearing instrument, such as a hearing aid. The benefit of such systems is that the microphone of the hearing instrument can be supplemented or replaced by the remote microphone which produces audio signals which are transmitted wirelessly to the FM receiver and thus to the hearing instrument. In particular, FM systems have been standard equipment for children with hearing loss in educational settings for many years. Their merit lies in the fact that a microphone placed a few inches from the mouth of a person speaking receives speech at a much higher level than one placed several feet away. This increase in speech level corresponds to an increase in signal-to-noise ratio (SNR) due to the direct wireless connection to the listener's amplification system. The resulting improvements of signal level and SNR in the listener's ear are recognized as the primary benefits of FM radio systems, as hearing-impaired individuals are at a significant disadvantage when processing signals with a poor acoustical SNR.
Most FM systems in use today provide two or three different operating modes. The choices are to get the sound from: (1) the hearing instrument microphone alone, (2) the FM microphone alone, or (3) a combination of FM and hearing instrument microphones together.
Usually, most of the time the FM system is used in mode (3), i.e. the FM plus hearing instrument combination (often labeled “FM+M” or “FM+ENV” mode). This operating mode allows the listener to perceive the speaker's voice from the remote microphone with a good SNR while the integrated hearing instrument microphone allows to listener to also hear environmental sounds. This allows the user/listener to hear and monitor his own voice, as well as voices of other people or environmental noise, as long as the loudness balance between the FM signal and the signal coining from the hearing instrument microphone is properly adjusted. The so-called “FM advantage” measures the relative loudness of signals when both the FM signal and the hearing instrument microphone are active at the same time. As defined by the ASHA (American Speech-Language-Hearing Association 2002), FM advantage compares the levels of the FM signal and the local microphone signal when the speaker and the user of an FM system are spaced by a distance of two meters. In this example, the voice of the speaker will travel 30 cm to the input of the FM microphone at a level of approximately 80 dB-SPL, whereas only about 65 dB-SPL will remain of this original signal after traveling the 2 m distance to the microphone in the hearing instrument. The ASHA guidelines recommend that the FM signal should have a level 10 dB higher than the level of the hearing instrument's microphone signal at the output of the user's hearing instrument.
When following the ASHA guidelines (or any similar recommendation), the relative gain, i.e. the ratio of the gain applied to the audio signals produced by the FM microphone and the gain applied to the audio signals produced by the hearing instrument microphone, has to be set to a fixed value in order to achieve e.g. the recommended FM advantage of 10 dB under the above-mentioned specific conditions. Accordingly, heretofore—depending on the type of hearing instrument used—the audio output of the FM receiver has been adjusted in such a way that the desired FM advantage is either fixed or programmable by a professional, so that during use of the system the FM advantage—and hence the gain ratio—is constant in the FM+M mode of the FM receiver.
EP 0 563 194 B1 relates to a hearing system comprising a remote microphone/transmitter unit, a receiver unit worn at the user's body and a hearing aid. There is radio link between the remote unit and the receiver unit, and there is an inductive link between the receiver unit and the hearing aid. The remote unit and the receiver unit each comprise a microphone, with the audio signals of theses two microphones being mixed in a mixer. A variable threshold noise-gate or voice-operated circuit may be interposed between the microphone of the receiver unit and the mixer, which circuit is primarily to be used if the remote unit is in a line-input mode, i.e. the microphone of the receiver then is not used.
WO 97/21325 A1 relates to a hearing system comprising a remote unit with a microphone and an FM transmitter and an FM receiver connected to a hearing aid equipped with a microphone. The hearing aid can be operated in three modes, i.e. “hearing aid only”, “FM only” or “FM+M”. In the FM+M mode the maximum loudness of the hearing aid microphone audio signal is reduced by a fixed value between 1 and 10 dB below the maximum loudness of the FM microphone audio signal, for example by 4 dB. Both the FM microphone and the hearing aid microphone may be provided with an automatic gain control (AGC) unit.
WO 2004/100607 A1 relates to a hearing system comprising a remote microphone, an FM transmitter and left-and right-ear hearing aids, each connected with an FM receiver. Each hearing aid is equipped with a microphone, with the audio signals from remote microphone and the respective hearing aid microphone being mixed in the hearing aid. One of the hearing aids may be provided with a digital signal processor which is capable of analyzing and detecting the presence of speech and noise in the input audio signal from the FM receiver and which activates a controlled inverter if the detected noise level exceeds a predetermined limit when compared to the detected level, so that in one of the two hearing aids the audio signal from the remote microphone is phase-inverted in order to improve the SNR.
WO 02/30153 A1 relates to a hearing system comprising an FM receiver connected to a digital hearing aid, with the FM receiver comprising a digital output interface in order to increase the flexibility in signal treatment compared to the usual audio input parallel to the hearing aid microphone, whereby the signal level can easily be individually adjusted to fit the microphone input and, if needed, different frequency characteristics can be applied. However, is not mentioned how such input adjustment can be done.
Contemporary digital hearing aids are capable of permanently performing a classification of the present auditory scene captured by the hearing aid microphones in order to select the hearing aid operation mode which is most appropriate for the determined present auditory scene. Examples for such hearing aids with auditory scene analyses can be found in US2002/0037087, US2002/0090098, CA 2 439 427 A1 and US2002/0150264.
Usually FM or inductive receivers are equipped with a squelch function by which the audio signal in the receiver is muted if the level of the demodulated audio signal is too low in order to avoid user's perception of excessive noise due a too low sound pressure level at the remote microphone or due to a large distance between the transmission unit and the receiver unit exceeding the reach of the FM link, see for example U.S. Pat. No. 5,734,976 and EP 1 619 926 A1
It is an object of the invention to provide for a method and a system for providing hearing assistance to a user, wherein a remote microphone arrangement coupled by a wireless audio link to a receiver unit which provides the audio signals to means for stimulating the hearing of the user wearing the receiver unit is used and wherein the listening comfort, and in particular the signal-to-noise-ratio (SNR), of the audio signals from the microphone arrangement should be optimized at any time.
It is a further object of the invention to provide for a method and a system for providing hearing assistance to a user, wherein a remote first microphone arrangement coupled by a wireless audio link to a hearing instrument and a second microphone arrangement connected to or integrated into the hearing instrument are used and wherein the SNR of the audio signals from at least one of the first and second microphone arrangement should be optimized at any time.
According to the invention, these objects achieved by a method as defined in claim 1 and a system as defined in claim 55, and by a method as defined in claim 33 and a system as defined in claim 57, respectively.
The aspect of the invention according to claims 1 and 55 is beneficial in that by permanently analyzing the captured audio signals by a classification unit in order to determine the present auditory scene category and by setting the gain applied to the audio signals according to the thus determined present auditory scene category, the gain applied to the audio signals can be permanently optimized according to the present auditory scene in order to provide the user of the receiver unit with a stimulus having an optimized SNR according to the present auditory scene. In other words, the level of the audio signals can be optimized according to the present auditory scene. This is a significant improvement over conventional systems provided with a remote microphone wherein the gain of the remote microphone audio signals has a fixed value which does not depend on the present auditory scene and hence inherently is optimized only for one certain auditory scene.
On the one hand, the invention is beneficial for applications in which the stimulating means is part of the receiver unit or directly connected thereto. In this case the stimulating means will reproduce only the audio signals from the receiver unit.
On the other hand, the invention is also beneficial for applications in which the receiver unit is part of a hearing instrument or is connected thereto. In this case there will be second audio signals from the microphone of the hearing instrument with which the audio signals from the receiver unit may be mixed prior to being reproduced by the stimulating means. Usually the audio signals from the receiver unit and the hearing instrument microphone will be mixed in the hearing instrument in such a manner that they are processed and power-amplified together so that gain applied to these audio signals in the hearing instrument is the same for both kinds of audio signals; consequently, after mixing the gain ratio will not be changed by the usual dynamic audio signal processing of the hearing instrument. Thus, by controlling the gain applied to the audio signals from the remote microphone arrangement by the gain control unit of the receiver unit, also the gain ratio, i.e. the ratio of the gain applied to the audio signals from the remote microphone arrangement and the gain applied to the audio signals from the hearing instrument microphone, can be controlled according to the result of the auditory scene analysis. Thereby the “FM advantage” can be dynamically adapted to the present auditory scene.
The aspect of the invention according to claims 33 and 57 is beneficial in that by permanently analyzing at least one of the first and second audio signals by a classification unit in order to determine the present auditory scene category and by setting the relative gain applied to the first and second audio signals, respectively, according to the thus determined present auditory scene category, the relative gain, i.e. the ratio of the gain applied to the first audio signals and the gain applied to a second audio signals, can be permanently optimized according to the present auditory scene in order to provide the user of the hearing instrument with a stimulus having an optimized SNR according to the present auditory scene. In other words, the level of the first audio signals and the level of the second audio signals can be optimized according to the present auditory scene. This is a significant improvement over conventional systems provided with a remote microphone wherein the gain ratio of the remote microphone audio signals and the hearing instrument microphone audio signals has a fixed value which does not depend on the present auditory scene and hence inherently is optimized only for one certain auditory scene.
These and further objects, features and advantages of the present invention will become apparent from the following description when taken in connection with the accompanying drawings which, for purposes of illustration only, show several embodiments in accordance with the present invention.
A first example of the invention is illustrated in
According to
The internal architecture of the FM transmission unit 102 is schematically shown in
The transmission unit 102 comprises a classification unit 134 which includes units 114, 115, 116, 117 and 118, as will be explained in detail in the following.
The unit 114 is a voice energy estimator unit which uses the output signal of the beam former unit 111 in order to compute the total energy contained in the voice spectrum with a fast attack time in the range of a few milliseconds, preferably not more than 10 milliseconds. By using such short attack time it is ensured that the system is able to react very fast when the speaker 100 begins to speak. The output of the voice energy estimator unit 114 is provided to a voice judgement unit 115 which decides, depending on the signal provided by the voice energy estimator 114, whether close voice, i.e. the speaker's voice, is present at the microphone arrangement 26 or not.
The unit 117 is a surrounding noise level estimator unit which uses the audio signal produced by the omnidirectional rear microphone M2 in order to estimate the surrounding noise level present at the microphone arrangement 26. However, it can be assumed that the surrounding noise level estimated at the microphone arrangement 26 is a good indication also for the surrounding noise level present at the ears of the user 101, like in classrooms for example. The surrounding noise level estimator unit 117 is active only if no close voice is presently detected by the voice judgement unit 115 (in case that close voice is detected by the voice judgement unit 115, the surrounding noise level estimator unit 117 is disabled by a corresponding signal from the voice judgment unit 115). A very long time constant in the range of 10 seconds is applied by the surrounding noise level estimator unit 117. The surrounding noise level estimator unit 117 measures and analyzes the total energy contained in the whole spectrum of the audio signal of the microphone M2 (usually the surrounding noise in a classroom is caused by the voices of other pupils in the classroom). The long time constant ensures that only the time-averaged surrounding noise is measured and analyzed, but not specific short noise events. According to the level estimated by the unit 117, a hysteresis function and a level definition is then applied in the level definition unit 118, and the data provided by the level definition unit 118 is supplied to the unit 116 in which the data is encoded by a digital encoder/modulator and is transmitted continuously with a digital modulation having a spectrum a range between 5 kHz and 7 kHz. That kind of modulation allows only relatively low bit rates and is well adapted for transmitting slowly varying parameters like the surrounding noise level provided by the level definition unit 1118.
The estimated surrounding noise level definition provided by the level definition unit 118 is also supplied to the voice judgement unit 115 in order to be used to adapt accordingly to it the threshold level for the close voice/no close voice decision made by the voice judgement unit 115 in order to maintain a good SNR for the voice detection.
If close voice is detected by the voice judgement unit 115, a very fast DTMF (dual-tone multi-frequency) command is generated by a DTMF generator included in the unit 116. The DTMF generator uses frequencies in the range of 5 kHz to 7 kHz. The benefit of such DTMF modulation is that the generation and the decoding of the commands are very fast, in the range of a few milliseconds. This feature is very important for being able to send a very fast “voice ON” command to the receiver unit 103 in order to catch the beginning of a sentence spoken by the speaker 100. The command signals produced in the unit 116 (i.e. DTMF tones and continuous digital modulation) are provided to the adder unit 113, as already mentioned above.
The units 109 to 119 all can be realized by the digital signal processor 122 of the transmission unit 102.
The receiver unit 103 is schematically shown in
The command signals decoded in the unit 128 are provided separately to a parameter update unit 129 in which the parameters of the commands are updated according to information stored in an EEPROM 130 of the receiver unit 103. The output of the parameter update unit 129 is used to control the audio signal amplifier 126 which is gain controlled. Thereby the audio signal output of the amplifier 126—and thus the sound pressure level at which the audio signals are reproduced by the loudspeaker 136—can be controlled according to the result of the auditory scene analysis performed in the classification unit 134 in order to control the gain applied to the audio signals from the microphone arrangement 26 of the transmission unit 102 according to the present auditory scene category determined by the classification unit 134.
As already explained above, the voice judgement unit 115 provides at its output for a parameter signal which may have two different values:
“Voice ON”: This value is provided at the output if the voice judgement unit 115 has decided that close voice is present at the microphone arrangement 26. In this case, fast DTMF modulation occurs in the unit 116 and a control command is issued by the unit 116 and is transmitted to the amplifier 126, according to which the gain is set to a given value.
“Voice OFF”: If the voice judgement unit 115 decides that no close voice is present at the microphone arrangement 26, a “voice OFF” command is issued by the unit 116 and is transmitted to the amplifier 126. In this case, the parameter update unit 129 applies a “hold on time” constant 131 and then a “release time” constant 132 defined in the EEPROM 130 to the amplifier 126. During the “hold on time” the gain set by the amplifier 126 remains at the value applied during “voice ON”. During the “release time” the gain set by the amplifier 126 is progressively reduced from the value applied during “voice ON” to a lower value corresponding to a “pause attenuation” value 133 stored in the EEPROM 130. Hence, in case of “voice OFF” the gain of the microphone arrangement 26 is reduced relative to the gain of the microphone arrangement 26 during “voice ON”. This ensures an optimum SNR of the sound signals present at the user's ear, since at that time no useful audio signal is present at the microphone arrangement 26 of the transmission unit 102, so that user 101 may perceive ambient sound signals (for example voice from his neighbor in the classroom) without disturbance by noise of the microphone arrangement 26.
The control data/command issued by the surrounding noise level definition unit 18 is the “surrounding noise level” which has a value according to the detected surrounding noise level. As already mentioned above, according to one embodiment the “surrounding noise level” is estimated only during “voice OFF” but the level values are sent continuously over the data link. Depending on the “surrounding noise level” the parameter update unit 129 controls the amplifier 126 such that according to the definition stored in the EEPROM 130 the amplifier 126 applies an additional gain offset to the audio signals sent to the power amplifier 137. According to alternative embodiments, the “surrounding noise level” is estimated only or also during “voice ON”. In these cases, during “voice ON”, the parameter update unit 129 controls the amplifier 126 depending on the “surrounding noise level” such that according to the definition stored in the EEPROM 130 the amplifier 126 applies an additional gain offset to the audio signals sent to the power amplifier 137.
The difference of the gain values applied for “voice ON” and “voice OFF”, i.e. the dynamic range, usually will be less than 20 dB, e.g. 12 dB.
In all embodiments, the present auditory scene category determined by the classification unit 134 may be characterized by a classification index.
In general, the classification unit will analyze the audio signals produced by the microphone arrangement 26 of the transmission unit 102 in the time domain and/or in the frequency domain, i.e. it will analyze at least one of the following: amplitudes, frequency spectra and transient phenomena of the audio signals.
In
The first audio signals provided at the separate audio input of the hearing instrument 104 may undergo pre-amplification in a pre-amplifier 33, while the audio signals produced by the microphone 36 of the hearing instrument 104 may undergo pre-amplification in a pre-amplifier 37. The hearing instrument 104 further comprises a digital central unit 35 into which the audio signals from the microphone 36 and the audio input are supplied as a mixed audio signal for further audio signal processing and amplification prior to being supplied to the input of the output transducer 38 of the hearing instrument 104. The output transducer 38 serves to stimulate the user's hearing 39 according to the combined audio signals provided by the central unit 35.
Since pre-amplification in the pre-amplifiers 33 and 37 is not level-dependent the receiver unit 103 may control—by controlling the gain applied by the variable gain amplifier 126—also the ratio of the gain applied to the audio signals from the microphone arrangement 26 and the gain applied to the audio signals from the microphone 36.
U1×(R2/(R1+R2))+U2×(R1/(R1+R2)).
Consequently, the amplitude U1 and the impedance Z1(R1) of the output signal of the receiver unit 103 will determine the ratio of the amplitude U1 (i.e. the amplitude of the first audio signals from the remote microphone 26) and U2 (i.e. the amplitude of the second audio signals from the hearing instrument microphone 36), since the impedance Z2(R2) of the microphone 36 typically is 3.9 kOhm and the sensitivity of the microphone 36 is calibrated.
This means that in the case of an audio input in parallel to the second microphone 36 the audio signal U2 of the hearing instrument microphone 36 can be dynamically attenuated according to the control signal from the classification unit 134 by varying the amplitude U1 and the impedance Z1(R1) of the audio output of the receiver unit 103.
The transmission unit to be used with the receiver unit of
The permanently repeated determination of the present auditory scene category and the corresponding setting of the gain ratio allows to automatically optimize the level of the first audio signals and the second audio signals according to the present auditory scene. For example, if the classification unit 134 detects that the speaker 100 is silent, the gain for the audio signals from the remote microphone 26 may be reduced in order to facilitate perception of the sounds in the environment of the hearing instrument 104—and hence in the environment of the user 101. If, on the other hand, the classification unit 134 detects that the speaker 100 is speaking while significant surrounding noise around the user 101 is present, the gain for the audio signals from the microphone 26 may be increased and/or the gain for the audio signals from the hearing instrument microphone 36 may be reduced in order to facilitate perception of the speaker's voice over the surrounding noise.
Attenuation of the audio signals from the hearing instrument microphone 36 is preferable if the surrounding noise level is above a given threshold value (i.e. noisy environment), while increase of the gain of the audio signals from the remote microphone 26 is preferable if the surrounding noise level is below that threshold value (i.e. quiet environment). The reason for this strategy is that thereby the listening comfort can be increased.
In
The first audio signals provided at the separate audio input of the hearing instrument 15 may undergo signal processing in a processing module 33, while the audio signals produced by the microphone 36 of the hearing instrument 15 (in the following referred to “second audio signals”) may undergo signal processing in a processing module 37. The hearing instrument 15 further comprises a digital central unit 35 into which the first and second audio signals are introduced separately and which serves to combine/mix the first and second audio signals which then are provided as a combined audio signal from the output of the central unit 35 to the input of the output transducer 38 of the hearing instrument 15. The output transducer 38 serves to stimulate the user's hearing 39 according to the combined audio signals provided by the central unit 35. The central unit 35 also serves to set the ratio of the gain applied to the first audio signals and the second the gain applied to the second audio signals. To this end, a classification unit 34 is provided in the hearing instrument 15 which analyses the first and the second audio signals in order to determine a present auditory scene category selected from a plurality of auditory scene categories and which acts on the central unit 35 in such a manner that the central unit 35 sets the gain ratio according to the present auditory scene category determined by the classification unit 34. Thus the central unit 35 serves as a gain ratio control unit.
Consequently, in the embodiment of
While in the above embodiments the receiver unit 24, 103 and the hearing instrument 15, 104 have been shown as separate devices connected by some kind of plug connection (usually an audio shoe) it is to be understood that the functionality of the receiver unit 24, 103 also could be integrated with the hearing instrument 15, 104, i.e. the receiver unit and the hearing instrument could form a single device.
While various embodiments in accordance with the present invention have been shown and described, it is understood that the invention is not limited thereto, and is susceptible to numerous changes and modifications as known to those skilled in the art. Therefore, this invention is not limited to the details shown and described herein, and includes all such changes and modifications as encompassed by the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
06002886 | Feb 2006 | EP | regional |
Number | Name | Date | Kind |
---|---|---|---|
5511128 | Lindemann | Apr 1996 | A |
5721783 | Anderson | Feb 1998 | A |
5734976 | Bartschi et al. | Mar 1998 | A |
6895098 | Allegro et al. | May 2005 | B2 |
6910013 | Allegro et al. | Jun 2005 | B2 |
7343023 | Nordqvist et al. | Mar 2008 | B2 |
20020150264 | Allegro et al. | Oct 2002 | A1 |
Number | Date | Country |
---|---|---|
2439427 | Apr 2002 | CA |
0563194 | Mar 2002 | EP |
1619926 | Jan 2006 | EP |
1 565 701 | Apr 1980 | GB |
9721325 | Jun 1997 | WO |
0176321 | Oct 2001 | WO |
0230153 | Apr 2002 | WO |
2004100607 | Nov 2004 | WO |
Number | Date | Country | |
---|---|---|---|
20070189561 A1 | Aug 2007 | US |