1. Field of the Invention
The present invention relates to a system and a method for providing hearing assistance to a user wherein audio signals from an audio signal source, which usually is a microphone arrangement, are transmitted by a transmission unit via a wireless audio link to a right ear unit and a left ear unit which are worn at or at least in part in the user's right ear and left ear, respectively, and which comprise means for stimulating the respective user's ear according to the transmitted audio signals.
2. Description of Related Art
Usually in such systems the wireless audio link is an FM radio link. The benefit of such systems is that sound captured by a remote microphone at the transmission unit can be presented at a proper sound pressure level to the hearing of the user wearing the receiver unit at the user's ear(s) without being effected by background noise, reverberations and distance issues.
According to one typical application of such wireless audio systems, the stimulating means is a loudspeaker which is part of the receiver unit or is connected thereto. Such systems are particularly helpful for being used in teaching normal-hearing children suffering from auditory processing disorders (APD), Attention Deficit or Hyperactivity Disorders (ADHD) or Learning Disabilities, wherein the teacher's voice is captured by the microphone of the transmission unit, and the corresponding audio signals are transmitted to and are reproduced by the receiver unit worn by the child, so that the teacher's voice can be heard by the child at an enhanced level, in particular, with respect to the background noise level and reverberations prevailing in the classroom. It is well known that presentation of the teacher's voice at such enhanced level supports the child in listening to the teacher. Such systems also may be used by all hearing impaired or normal-hearing students with understanding problems in noisy situations or situations with background speech.
According to another typical application of wireless audio systems, the receiver unit is connected to or integrated into a hearing instrument, such as a hearing aid. The benefit of such systems is that the microphone of the hearing instrument can be supplemented or replaced by the remote microphone which produces audio signals which are transmitted wirelessly to the FM receiver and thus to the hearing instrument. In particular, FM systems have been standard equipment for children with hearing loss in educational settings for many years. Their merit lies in the fact that a microphone placed a few inches from the mouth of a person speaking receives speech from that person at a much higher level than one placed several feet away at the ear of a listener. This increase in speech level corresponds to an increase in signal-to-noise ratio (SNR) due to the direct wireless connection to the listener's amplification system. The resulting improvements of signal level and SNR in the listener's ear are recognized as the primary benefits of FM radio systems, as hearing-impaired individuals are at a significant disadvantage when processing signals with a poor acoustical SNR.
Most FM systems in use today provide two or three different operating modes. The choices are to get the sound from: (1) the hearing instrument microphone alone, (2) the FM microphone alone, or (3) a combination of FM and hearing instrument microphones together.
Usually, most of the time, the FM system is used in mode (3), i.e., the FM plus hearing instrument combination (often labeled “FM+M” or “FM+ENV” mode). This operating mode allows the listener to perceive the speaker's voice from the remote microphone with a good SNR while the integrated hearing instrument microphone allows the listener to also hear environmental sounds. This allows the user/listener to hear and monitor his own voice, as well as voices of other people or environmental noise, as long as the loudness balance between the FM signal and the signal coming from the hearing instrument microphone is properly adjusted. The so-called “FM advantage” measures the relative loudness of signals when both the FM signal and the hearing instrument microphone are active at the same time. As defined by the ASHA (American Speech-Language-Hearing Association 2002), FM advantage compares the levels of the FM signal and the local microphone signal when the speaker and the user of an FM system are spaced by a distance of two meters. In this example, the voice of the speaker will travel 30 cm to the input of the FM microphone at a level of approximately 80 dB-SPL, whereas only about 65 dB-SPL will remain of this original signal after traveling the 2 m distance to the microphone in the hearing instrument. The ASHA guidelines recommend that the FM signal should have a level 10 dB higher than the level of the hearing instrument's microphone signal at the output of the user's hearing instrument.
When following the ASHA guidelines (or any similar recommendation), the relative gain, i.e., the ratio of the gain applied to the audio signals produced by the FM microphone and the gain applied to the audio signals produced by the hearing instrument microphone, has to be set to a fixed value in order to achieve, e.g., the recommended FM advantage of 10 dB under the above-mentioned specific conditions.
An example of an FM system allowing to vary the FM advantage according to the present auditory scene in order to optimize the SNR at any time is known from European Patent Application EP 1 691 574 A1.
Other known measures for increasing the intelligibility of speech are the use of at least two spaced apart microphones for achieving acoustic beam-forming in order to enhance the desired speech signals over the undesired background noise, the use of audio signal processing algorithms for separating speech signals from background noise, such as blind source separation (BSS), and the automatic selection of one of a plurality of hearing aid programs depending on a classification of the present auditory scene in order to optimize the parameters of the audio signal processing in the hearing aid according to the present auditory scene.
From U.S. Patent Application Publication 2006/0093172 A1, a radio transmission system is known wherein audio signals captured by a remote microphone are transmitted to the radio receivers of two hearing aids, with the phase of the audio signal received by the radio receiver of one of the hearing aids being inverted in order to improve the perceived SNR in order to improve speech intelligibility.
According to an article by H. Levitt and L. R. Rabiner “Binaural Release from Masking for Speech and Gain in Intelligibility”, The Journal of the Acoustical Society of America, 1967, the intelligibility of speech signals presented binaurally to a test person, with narrow-band Gaussian masking noise being presented at the same time to both ears of the test person in an identical manner, was improved if the binaural speech signal is delayed by 0.5 msec to 10 msec at one of the ears. A perceived SNR improvement of 13 dB was achieved for single words.
Such tests exploit a psychoacoustic phenomenon known as the binaural masking level difference (BMLD). The BMLD is evaluated where tones are presented to both ears at the same time that a masking or competing noise is being delivered binaurally. A different type of measurement is known as the binaural intelligibility level difference (BILD). This test is based on the fact that the recognition of speech can be measured by presenting nonsense, one-syllable words, denoted logatomes, to a test person at varying sound pressure levels to determine the degree of syllabic recognition. This is measured as the percentage of syllables in a spoken sentence that are perceived correctly. The syllabic intelligibility level is defined as the sound pressure of speech in connection with which a given degree, for example, 50%, of syllabic intellegibility is attained (see Blauert et al., Spatial Hearing, The MIT Press, 1974). The measurements of Levitt and Rabiner, 1967, show an essentially constant BMLD of about 13 dB and an essentially constant BILD of about 3 dB for an interaural time delay of 0.5 msec to about 10 msec.
It is an object of the invention to provide for a hearing assistance system wherein audio signals from a remote audio signal source are provided wirelessly to both ears of the user and wherein speech intelligibility should be further enhanced. It is a further object of the invention to provide for a corresponding method of providing hearing assistance to a user.
According to the invention these objects are achieved by a system and a method as described herein. The invention is beneficial in that, by delaying the stimulation of one of the user's ear with the audio signals received from the transmission unit relative to the stimulation of the other one of the user's ears with the audio signals received from the transmission unit by 1 msec to 10 msec, speech intelligibility can be enhanced in situations where background noise is present at the user's ears in addition to the audio signals received from the transmission unit. The invention is particularly beneficial if the background noise is identical at both ears. However, a benefit is also obtained if also the background noise is delayed at one of the ears together with the audio signal from the transmission unit, as long as the background is uncorrelated.
These and further objects, features and advantages of the present invention will become apparent from the following description when taken in connection with the accompanying drawings which, for purposes of illustration only, show several embodiments in accordance with the present invention.
The invention is based on the acoustic phenomenon of binaural interaction of the auditory system, which is affected both by interaural time differences (ITD) and interaural level differences (ILD). Due to the physical properties of frequency/wave length of acoustic signals, the sensitivity of the auditory system to ITD and ILD depends on the frequency. For example, at low frequencies (around 500 Hz) the auditory system is more responsive to changes of the ITD, whereas at high frequencies (above 1500 Hz) the auditory system is more sensitive to changes of the ILD. For complex signals like speech or music both ITD and ILD play a role. A change in one or both of ITD (predominant at low frequencies) and ILD (predominant at high frequencies) is detected and results in improved signal intelligibility. If the time of arrival of the sound signal at one of the ears is delayed relative to the other one of the ears, signal detection by the auditory system is facilitated and the signal consequently can be perceived more clearly due to this signal delay between the two ears.
As already mentioned above, this effect has been mentioned by Levitt and Rabiner in 1967. The inventors of the present invention have conducted experiments in order to investigate whether this effect could be exploited for hearing assistance systems. In these experiments, a speech signal was presented to a test person via a headset, which was masked by white noise. Both the speech signal and the noise signal were presented as stereo signals. The speech signals were selected according to the “Oldenburg sentence recognition test” (see, e.g., Wagener, K., Kühnel, V., Kollmeier, B., 2001, “Entwicklung and Evaluation eines Satztests für die deutsche Sprache, Teil 1: Design des Oldenburger Satztests” Z. für Audiologie, 1: 4-15, 2001). During the tests for a given time delay Δt of the speech signal between the two ears, the level of the speech signal relative to level of the noise signal was changed step-wise in order to determine the volume level at which the speech reception threshold was 50% (i.e., the level at which 50% of the test words were correctly understood by the test person). The measurements were carried-out with various test persons for various values of the time delay Δt.
In
For white noise the SNR for 3 msec, 5 msec and 7 msec time delay was enhanced by 4.7 dB, 5.8 dB and 8.4 dB, respectively, with regard to the case without time delay. The phase shift of 180° resulted in an enhancement of the SNR of 3.7 dB. Also for Icra8 noise an enhanced SNR was obtained with a delayed signal of 7 msec.
Consequently, speech recognition in noise can be significantly enhanced by introducing a time difference of a few milliseconds for presentation of a speech signal to the right ear and the left ear, respectively. The best results can be achieved if the noise signal is identical at both ears. However, an improvement of the speech recognition is also possible if both the speech signal and the noise are subject to the monaural time delay if the noise is uncorrelated.
A second effect of a time difference between the right ear signal and the left ear signal is known as the “Haas-effect” according to which the signal which arrives first generates a virtual hearing direction. This effect might result in confusion by the perceived acoustic impressions in situations in which the position of the speaker is not known. However, for the usual applications of the invention, the user of the hearing assistance system usually will be able to see the speaker (i.e., the person who is using the microphones of the transmission unit), so that the “Haas-effect” usually will not be critical.
An embodiment wherein the ear units 14R, 14L consist of a receiver unit 16 and a hearing instrument 18 is shown in more detail in
According to the embodiment shown in
The transmission unit 10 comprises an audio signal processing unit 28 for processing the audio signals captured by the microphone arrangement 12 and a transmitter 30 for transmitting the processed audio signals via the antenna 26 via the audio link 107 to the ear units 14R, 14L, which are supplied, in the embodiment of
The system shown in
In order to improve the intelligibility of the audio signals received via the audio link 107, one of the two ear units 14R, 14L is provided with a signal delay unit 40 which serves to delay the audio signal supplied to the speaker 20 by 1 msec to 10 msec with regard to the audio signal supplied to the loudspeaker 20 of the other one of the ear units 14R, 14L (in the example shown in
An example of such time delay At between the audio signal presented by the right ear unit 14R to the right ear 26R and the audio signal presented by the left ear unit 14L to the left ear 26L is illustrated in
Preferably, the value of the time delay Δt will be variable in order to optimize the beneficial effect for different listening situations/auditory scenes. For example, for a quiet environment (i.e., no significant background noise) the time delay may be turned-off, i.e., the time delay Δt will be 0. To this end, the right ear unit 14R may comprise a control element 42 which can be manually operated by the user 101 in order to control the signal delay unit 40 in predefined steps, e.g., with a step size of 1 ms. Alternatively or in addition, the transmission unit 10 may be provided with a control element 44 which can be manually operated in order to transmit corresponding control commands for the time delay unit 40 to the right ear unit 14R via the wireless link 107, which in this case also serves as a data link. Alternatively or in addition, the right ear unit 14R may comprise a classifier unit for analyzing the audio signals received from the transmission unit 10 in order to determine the present auditory scene and to control the time delay unit 40 accordingly. As an alternative, such auditory scene analysis may be performed in the transmission unit 10 and corresponding control commands for the time delay unit 40 may be transmitted via the wireless link 107.
In
In
The ear units 14R, 14L usually will have at least three different modes of operation: a first mode in which only the audio signals provided by the receiver unit 16 are supplied to the speaker 20, a second mode in which only the audio signals captured by the microphone 48 are supplied to the speaker 20, and a third mode in which the audio signals provided by the receiver unit 16 and by the microphone 48 are both supplied to the speaker 20. The third mode usually will be used during most of the time. Usually the gain applied to the audio signals of the receiver unit 16 will be set such that for a given distance, e.g., 2 m, the level at the speaker 20 is higher, for example, by 10 dB, compared to the level of the same sound captured by the microphone 48, i.e., the so-called “FM advantage” may be set to, for example, 10 dB. According to an alternative embodiment, the FM advantage may be adapted according to the present auditory scene, as described for example in European Patent Application EP 1 691 574 A2.
According to the embodiment of
In order to control the signal delay unit 40, the hearing aid 18 may be provided with a manual control element 42. Alternatively or in addition, the signal delay unit 40 may be controlled by the central unit 50 according to the result of an auditory scene analysis. In this case, auditory scene analysis may include analysis both of the audio signals from the receiver unit and from the microphone 48.
While various embodiments in accordance with the present invention have been shown and described, it is understood that the invention is not limited thereto, and is susceptible to numerous changes and modifications as known to those skilled in the art. Therefore, this invention is not limited to the details shown and described herein, and includes all such changes and modifications as encompassed by the scope of the appended claims.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP07/00177 | 1/10/2007 | WO | 00 | 3/2/2010 |