The invention is a system for processing and reproducing speech to enhance its intelligibility for hearing impaired individuals.
Hearing impairment detracts from the quality of life of a substantial portion of the population. Problems caused by hearing loss can range from a source of frustration to depression and withdrawal.
The ability of hearing impaired individuals to understand speech, also sometimes known as the intelligibility of speech, is limited by a number of factors. One is the level of ambient noise in the environment in which the speech is occurring. Another is the inability of the hearing impaired to hear the very soft levels of the important high frequency components of human speech. Reverberation from room acoustics also limits hearing impaired individuals' ability to understand speech.
Systems for enhancing the intelligibility of speech are generally known and disclosed, for example, in the Klayman U.S. Pat. No. 6,993,480 and the Dunn et al. U.S. Patent Application Publications 2005/0195996 and 2010/0166209, which are incorporated herein by reference in their entirety for all purposes. There remains, however, a continuing need for improved systems to enhance the intelligibility of speech for the hearing impaired.
An embodiment of a speech intelligibility enhancement system comprises a talker unit, a listener unit and an earpiece. The talker unit includes a microphone to receive audible speech content and to produce electrical signals representative of the speech content, and a transmitter coupled to the microphone to produce wireless transmissions containing the speech content. The listener unit includes a receiver to receive the wireless transmissions and to produce electrical signals representative of the speech content. At least one of the talker unit and the listener unit includes an amplifier to amplify spectral components of the speech content within a frequency range having a lower end between about 800 Hz and 1,700 Hz and an upper end between about 7,000 Hz and 11,000 Hz. The earpiece is coupled to the listener unit and includes a speaker to produce audible speech content having the amplified spectral components and a tube to direct the audible speech content from the speaker toward a user's ear canal.
A speech intelligibility enhancement system 10 in accordance with embodiments of the invention is shown in
To enhance the intelligibility of the audible speech provided to the user by system 10, one or both of the talker unit amplifier 22 and the listener unit amplifier 34 selectively amplifies the spectral or frequency content of the speech signals. In some embodiments of the invention, the selective amplification is provided solely by the amplifier 22 of the talker unit 12. Amplifiers 22 and/or 34 can be of conventional or otherwise known design, and can provide amplification by conventional or otherwise known approaches such as by providing positive gain and/or through filtering (i.e., negative gain).
The amplification frequency thresholds of the amplifiers 22 and/or 34 (i.e., the frequencies at which the amplification begins and/or ends), and the amplification transfer function of the amplifier, can vary in different embodiments of the invention. In general, the amplifiers 22 and/or 34 are configured to amplify sound having frequencies above the range of significant portions of ambient noise in the sound. For example the amplification threshold frequency and/or transfer function of a version of the system 10 adapted for use in an airplane may be different than one adapted for use in an outdoor street setting. In general, the speech intelligibility index (SII) assumes that speech recognition increases in direct proportion to speech spectrum audibility, which can be calculated from the hearing thresholds of the listener, and the long term average spectra of the speech and noise reaching the ear of the listener. SII=ΣIiAi where Ii is the function that characterizes the importance of the ith frequency band to speech intelligibility, and Ai expresses the proportion of the speech dynamic range in the ith frequency band that is above the listener's threshold or masking noise. Noise and other relatively low-frequency components of the sound signals that typically do not contain information important to the intelligibility of the speech, and that can detract from the ability of the hearing impaired to derive useful information from the sound, are effectively filtered out. Amplifiers 22 and/or 34 therefore do not add proportional perceived noise into the environment, while enhancing the volume of the information-containing content of the sound spectrum. Reverberations from room acoustics can also be significantly reduced by system 10, another factor contributing to the enhanced speech intelligibility provided by the system.
In summary, the components of speech processing system 10 cooperate to increase the volume of the frequency portions of the sound received by microphone 20 that commonly contain speech content that can be perceived by hearing impaired individuals. Other embodiments of the invention (not shown) include output limiters in the talker unit 12 and/or listener unit 14 to limit the overall volume of the sound outputted by the speaker 42 to safe operating levels. The content of the speech provided by the earpiece 16 can therefore be understood by hearing impaired individuals better (i.e., is more intelligible) than the original sound containing the speech received at talker unit 12. Complications associated with hearing loss can thereby be reduced, enhancing overall quality of life. For example, system 10 can be a portable or stationary device used in home settings to overcome distance during speaking. It can also be used in noisy environments such as in meetings and restaurants to enhance intelligibility. Other common daily settings where system 10 can enhance the quality of life of hearing impaired individuals include shopping, medical care appointments, and transportation (e.g., while on airplanes, cars and buses). Effectiveness of communications and safety can also be enhanced through use of system 10. Tests have demonstrated significant improvements (e.g., on the order of 20%) in word understanding with gain transfer functions such as those shown in
Speech processing system 10 can be implemented in any of a number of additional embodiments. For example, the system 10 can have a plurality of listener units 14 used by different users (e.g., in the course of a conversation). Similarly, the system 14 can have a plurality of talker units 12 that communicate with one or more listener units 14. Talker unit 12 and listener unit 14 can be configured for packet based communication protocols such as those described in the Dunn U.S. Patent Application Publication 2010/0166209. Talker unit 12 and listener unit 14 can have clips or lanyards to enable the units to be conveniently attached to or worn by the users. Other user interface functionality such as on/off switches, controls and displays can be incorporated into the talker unit 12 and listener unit 14. An advantage of the use of sound distribution tube 44 is that the end of the tube can be positioned near the user's ear canal to provide the speech from the speaker 42 to the user, while enabling the ear canal to remain open to receive ambient sounds (and also enabling the use of the device by users with hearing aids). In other embodiments of the invention (not shown) the earpiece 16 is an in-ear device. Yet other embodiments of the invention (not shown) have wireless technology (e.g., Bluetooth) to couple the speech content signals from the listener unit 14 to the earpiece 16. In still other embodiments (not shown) the components and functionality of the listener unit 14 are incorporated into the earpiece 16.
Headset 115 includes an earpiece 116 and microphone 117. The components and functionality of earpiece 116, including ear hook 140, speaker 142 and sound distribution tube 144, can be the same as or similar to those of earpiece 16 described above, and similar reference numbers are used to identify similar components. The speaker 142 is coupled through wires 150 to a plug 148 that connects to the jack 139 of the listener unit 114. Microphone 117 is coupled through wires 151 to a plug 149. In embodiments, headset 115 can have two earpieces 116, one for each ear of the user. Embodiments of headset 115 can also include other structures for coupling sound to the user's ear or ears, such as ear tips. By way of example, headset 115 can be a HF3 headset available from Etymotic Research of Elk Grove Village, Ill.
Talker unit 112 includes a microphone 120, amplifier 122, transmitter 124 and antenna 126 that can function in a manner that is the same as or similar to those of talker unit 12, described above, and similar reference numbers are used to identify similar components. In particular, amplifier 122 can have the gain transfer functions described above in connection with system 10. As shown, talker unit 112 includes a switch 153 that can be actuated to couple microphone 120 or an input connection or jack 155 to the amplifier 122. Jack 155 is configured to be coupled to the plug 149 of headset 115. A user of talker/listener system 111 can thereby operate the system to receive speech through the microphone 117 of the headset 115 or through the microphone 120 of the talker unit 112 (e.g., by actuating the switch 153). An amplified speech content signal produced by the talker unit 112 can be transmitted, for example to the listener unit 114 of the system 111, to one or more other listener/talker systems (not shown) such as 111 being used by another person, and/or to one or more listener units 14 of the type described above. In other embodiments, the speech content signal produced by the talker unit 112 is transferred by a wired connection to the associated listener unit 114 of the system 111 (e.g., as opposed to the wireless transmission shown in
All participants completed four listening conditions: 1) unaided word recognition in quiet; 2) aided word recognition in quiet; 3) unaided speech recognition in noise; and 4) aided speech recognition in noise. The participants wore the HearHook device in the aided condition and did not in the unaided condition. Hearing aid users enrolled in the study removed their hearing aids prior to all test conditions. The unaided and aided conditions were randomized for both word recognition and speech in noise testing. Periodic breaks were provided as needed throughout testing.
For the aided conditions, the HearHook receiver was coupled to both ears using small flexible open-fit ear hooks. The HearHook transmitter was hung four inches from the target speaker. This was done to mimic the lapel microphone transmission distance. The amount of high-frequency gain applied with the HearHook system was constant across all participants, with a peak gain of 17 dB between 1000 Hz to 4000 Hz.
Word recognition in quiet was completed in sound field. Stimuli were phonemically-balanced recorded consonant-vowel-consonant (CVC) monosyllabic word lists (English Speech Audiometry, Brigham Young University, 1998). Two lists of 10 phonemically-balanced words were scored for both the aided and unaided conditions. The presentation level in dB HL was adjusted adaptively in 3 dB increments to determine the binaural reception threshold for words (RTW), or when the participant correctly scored between 45% and 55% of the words. The percent of words correct was also recorded at two to three presentation levels above and below the threshold. Percent correct for isophonemes was also calculated for threshold presentation level, as well as two to three additional presentations above and below to confirm findings.
Speech in noise testing was conducted using adult AzBio sentences and noise. Listeners heard recorded AzBio sentences from the front speaker in a calibrated eight-speaker R-SPACE array (“Developing and Testing a Laboratory Sound System That Yields Accurate Real-World Results,” hearingreview.com, October, 2007). The R-SPACE system was chosen for this study to test the HearHook device in the most accurate laboratory simulation of real-world acoustic environments possible {Compton-Conley, 2004 #129}. The Lou Malnati stimulus was created from live restaurant sounds recorded with a KEMAR manikin at a popular pizzeria in Chicago, Ill., and was used to mimic as real-world a restaurant environment as possible for this study. This omnidirectional restaurant noise accompanied the AzBio target sentences at 0 degrees azimuth. Signal levels were initially presented at a signal-to-noise ratio (SNR) of +5 dB and then were adjusted to create various SNRs. The illuminati noise presentation level remained constant at 60 dB SPL. The percent correct was calculated at each SNR presentation level. The SNR was adjusted adaptively to determine the binaural reception threshold of sentences (RTS) or the SNR at which the participant scored between 45 to 55% words correct. The percent words correct was recorded for the SNR at RTS and two to three additional SNRs above and below this presentation level to confirm findings.
A total of 14 participants with sensorineural hearing loss were included in the study (10 female, 4 male) with a mean age of 73.4 years (SD=+8.5; range: 56-86 years). Of the 14 participants, seven were experienced hearing aid users and seven had never worn hearing aids. Audiometric data resulted in slight to severe sloping sensorineural hearing across the group.
In connection with word recognition in quiet, in the aided condition, the RTW improved by 9.29 dB compared to the unaided condition. Using paired sample t-test, these two conditions were significantly different (t=6.52, df=13, p<0.0001).
In connection with speech in noise, in the aided condition, the RTS improved by an SNR of 4.71 dB compared to the unaided condition. Using paired sample t-test, these two conditions were significantly different (t=9.95, df=13, p<0.0001)
Although the invention has been described with reference to preferred embodiments, those skilled in the art will recognize that changes can be made in form and detail without departing from the spirit and scope of the invention. Although described in connection with use by hearing impaired individuals, the device can be used by anyone with a desire for better speech understanding (e.g., to overcome listening problems relating to distance, noise and/or reverberation), in a wide range of locations such as in conference rooms.
This application is a continuation of U.S. application Ser. No. 15/548,660, filed Aug. 3, 2017, and entitled, SPEECH INTELLIGIBILITY ENHANCEMENT SYSTEM, which is a national phase application of PCT Application No. PCT/US2016/015995, internationally filed Feb. 1, 2016 and entitled SPEECH INTELLIGIBILITY ENHANCEMENT SYSTEM, which claims the benefit of U.S. Provisional Application No. 62/111,930, filed Feb. 4, 2015 and entitled SPEECH INTELLIGIBILITY ENHANCEMENT SYSTEM, all of which are incorporated herein by reference in their entireties and for all purposes.
Number | Date | Country | |
---|---|---|---|
62111930 | Feb 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15548660 | Aug 2017 | US |
Child | 16023639 | US |