The present subject matter relates generally to hearing assistance systems and more particularly to methods and apparatus for own-voice sensing in a hearing assistance device.
Hearing assistance devices include a variety of devices such as assistive listening devices, cochlear implants and hearing aids. Hearing aids are useful in improving the hearing and speech comprehension of people who have hearing loss by selectively amplifying certain frequencies according to the hearing loss of the subject. A hearing aid typically has three basic parts; a microphone, an amplifier and a speaker. The microphone receives sound (acoustic signal) and converts it to an electrical signal and sends it to the amplifier. The amplifier increases the power of the signal, in proportion to the hearing loss, and then sends it to the ear through the speaker. Cochlear devices may employ electrodes to transmit sound to the patient.
Undesired sounds such as noise, feedback and the user's own voice may also be amplified, which can result in decreased sound quality and benefit for the user. It is undesirable for the user to hear his or her own voice amplified. Further, if the user is using an ear mold with little or no venting, he or she will experience an occlusion effect where his or her own voice sounds hollow (“talking in a barrel”). Thirdly, if the hearing aid has a noise reduction/environment classification algorithm, the user's own voice can be wrongly detected as desired speech.
Typical hearing aid microphones have difficulties properly detecting a wearer's own voice. Problems include poor signal to (ambient) noise ratio, poor speech intelligibility, and ingress of foreign debris into the microphone. Prior solutions to this problem include: (1) the telecom industry typically uses a directional microphone system either in the housing (on the lateral side of an in-ear device) or on a boom, thereby positioning the microphones closer to the mouth. However, these directional microphones are susceptible to outside ambient noise, thereby degrading SNR and speech intelligibility, and are susceptible to foreign debris; (2) Kruger (U.S. Pat. No. 5,692,059) entitled Two active element in-the-ear microphone system combined the outputs of a dedicated airborne transducer together with a dedicated non-airborne transducer to produce a composite own-voice signal. Each transducer sensed a different frequency portion of the user's own-voice to produce the composite output. A piezoelectric accelerometer was the preferred non-airborne transducer. However, Kruger requires two different transducers: an airborne transducer and a non-airborne transducer. One transducer is dedicated to high frequency fricatives and the other is dedicated to low frequencies. A separate transducer dedicated to low frequencies, though it may give better sound quality, is superfluous for speech intelligibility in that low frequencies are not crucial for such as shown in
Thus, there is a need in the art for an improved method and apparatus for own-voice sensing in hearing assistance devices.
Disclosed herein, among other things, are methods and apparatus for own-voice sensing in hearing assistance devices. One aspect of the present subject matter includes an in-the-ear (ITE) hearing assistance device adapted to process sounds, including sounds from a wearer's mouth. According to various embodiments, the device includes a hollow plastic housing adapted to be worn in the ear of the wearer and a differential sensor mounted to an interior surface of the housing in an ear canal of the wearer. The differential sensor includes inlets located within the housing and the differential sensor is configured to improve speech intelligibility of sounds from the wearer's mouth, in various embodiments.
This Summary is an overview of some of the teachings of the present application and not intended to be an exclusive or exhaustive treatment of the present subject matter. Further details about the present subject matter are found in the detailed description and appended claims. The scope of the present invention is defined by the appended claims and their legal equivalents.
The following detailed description of the present subject matter refers to subject matter in the accompanying drawings which show, by way of illustration, specific aspects and embodiments in which the present subject matter may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present subject matter. References to “an”, “one”, or “various” embodiments in this disclosure are not necessarily to the same embodiment, and such references contemplate more than one embodiment. The following detailed description is demonstrative and not to be taken in a limiting sense. The scope of the present subject matter is defined by the appended claims, along with the full scope of legal equivalents to which such claims are entitled.
Modern hearing assistance devices, such as hearing aids typically include a processor, such as a digital signal processor in communication with a microphone and receiver. Such designs are adapted to perform a great deal of processing on sounds received by the microphone. These designs can be highly programmable and may use inputs from remote devices, such as wired and wireless devices.
The detection of a wearer or user's own-voice for telecommunications or hearing assistance devices would benefit by improving its signal to (ambient) noise ratio, improving its speech intelligibility, and protecting it from foreign debris. For telecommunications, own-voice is typically detected with some type of boom microphone or directional microphone on the exterior housing. For hearing assistance devices, own-voice has been previously detected with one (or more) microphones in the faceplate housing. In-the-ear (ITE) hearing instruments with sensors positioned along the tip or canal of the earmold rather than the faceplate have also been used. These instruments are targeted for first-responder communication applications such as firefighters and omnidirectional microphones are typically used. The acoustical inlet of the omnidirectional microphone can be located at the tip of the earmold so as to sense the sound pressure in the air cavity of the ear canal. In this approach, the microphone is susceptible to foreign debris. Alternatively, the plastic ITE housing can contain a small elastomeric bladder with one side-wall of the bladder in contact with the ear canal skin, and the other side of the bladder connected to the microphone inlet, where the inside of the bladder contains a closed air cavity sharing air with the microphone inlet. These devices have the advantage of being acoustically isolated from the outside ambient noise, thereby protecting the microphone from foreign debris. However, they have the disadvantage of capturing an own-voice signal that is intrinsically ‘boomy’ and inferior for speech intelligibility. There would be an advantage, therefore, to use a sensor that can capture an own-voice signal that produces greater speech intelligibility, and is shielded from foreign debris.
Therefore, the present subject matter uses a sensor with a frequency response that resembles the SII weightings. In general, omnidirectional microphones have relatively flat frequency responses whereas directional (pressure-differential) microphones have freefield responses that roll off at lower frequencies, thereby resembling the SII weightings as shown above. In addition, the internal membranes of typical pressure-differential electret microphones are not loaded with closed air cavities, and for this reason they are more sensitive to bone-conducted vibration than typical omni electret microphones. Differential microphones, therefore, are better suited for this application—not because of their directional polar response in a freefield, but because of their intrinsic frequency response and their susceptibility to bone-conducted vibration.
The present subject matter includes a differential microphone placed deep in the ear canal, mounted (directly or indirectly) to the plastic ITE housing and contained within the air cavity of the hollow plastic housing. Advantages of the present subject matter include: 1) isolation from outside ambient noise, 2) protection from foreign debris, 3) a frequency response that is similar to the SII frequency weightings, and 4) higher sensitivity to bond-conducted vibration. This last item implies that it is advantageous to mount the sensor so as to amplify bone-conducted vibrations in the frequency regions as depicted in the SII weightings. Toward that end, the sensor could be placed in an elastomeric sleeve so that its resonance frequency, i.e., the compliance of the elastomeric sleeve resonating with the mass of the sensor, enhances the overall response in the SII weighted frequency bands.
There are a number of ways the present subject matter can be implemented in an ITE hearing instrument. While the present subject matter is demonstrated using an ITE device, other types of hearing assistance devices can be used without departing from the scope of the present subject matter.
The present subject matter provides ways to arrange and mount a sensor within the housing of an ITE housing instrument so as to improve the speech intelligibility of the sensor's output signal. Unique aspects of the present subject matter include, but are not limited to: (1) a single, passive, pressure-differential electret microphone can be used for enhanced speech intelligibility; (2) the passive, pressure-differential microphone can have either a 1st- or 2nd-order freefield response; (3) the mounting suspension stiffness is engineered to resonate with the mass of the differential microphone so as to amplify and enhance the sensor's bone-conduction response in the SII weighted frequency bands. Engineering includes the choice of elastomer and its geometrical dimensions, particularly its thickness; (4) the tension and effective mass of the elastomeric window barrier, integrated into the wall of the plastic housing, is engineered to resonate with the stiffness of the air cavity within the plastic housing so as to amplify and enhance the sensor's response in the SII weighted frequency bands. Engineering includes the choice of elastomer and its geometrical dimensions, particularly its thickness; and (5) a combination module containing both an omni and pressure-differential sensor can be used to extend low frequencies for a sound quality of own-voice that is fuller.
Advantages of the present subject matter over previous solutions include, but are not limited to: (1) a sensor comprising a single electret microphone consumes less electrical power than multi-microphone approaches; (2) a sensor comprising a single, pressure-differential electret microphone is more sensitive to bone-conducted vibration as compared to an omni electret microphone; (3) a sensor comprising a single, piezoceramic microphone is more sensitive to bone-conducted vibration as compared to an omni electret microphone; (4) the mounting of the sensor does not require any specialty bladders or pillows that protrude out of the shell, thereby causing potential discomfort to the user; (5) the sensor is located inside of the ITE earmold thereby protecting it from foreign debris; and (6) the output of a second omni sensor can be combined with the output of the differential sensor to extend low frequencies and provide a fuller quality of sound to own-voice.
Additional embodiments of the present subject matter include, but are not limited to: (1) using a piezoceramic microphone instead of an electret microphone. Piezoceramic microphones were used in hearing instruments briefly in the early 1970's, and are intrinsically more sensitive to (bone conduction) vibration than typical electrets. The piezoceramic microphone can either be omni or differential; (2) using a silicon MEMS microphone instead of an electret microphone. MEMS microphones are used considerably in today's telecom instruments, and may be more sensitive to (bone conduction) vibration than typical electrets. The MEMS microphone can either be omni or differential; (3) in each above embodiment, the output signal of a separate faceplate microphone could be used in a digital signal processing method to enhance the quality of the own-voice sensor signal. In one example such as quiet ambient noise environments, the faceplate microphone output signal could be combined with the own-voice sensor signal to produce an enhanced system output signal. In another example, the faceplate microphone output signal could be cross-correlated with the own-voice sensor signal to determine when the user is actually talking, thereby gating the transmission of the own-voice signal; (4) in each above embodiment having a pressure-differential sensor whose output signal is inherently deficient of low frequency energy, a DSP scheme using psychoacoustic bass-enhancement algorithms can be used to artificially extend and enhance the perception of the low-frequency harmonics (60 to 250 Hz) of the speech signal, thereby providing a fuller, richer sound quality of own-voice.
Benefits of the present subject matter, including those based on choice of sensor and mounting system, include, but are not limited to: (1) provides higher speech intelligibility; (2) provides protection against foreign debris, (3) uses a pressure-differential sensor that is more susceptible to bone-conducted vibration, (4) uses a pressure-differential sensor that enhances the response in the critical frequency regions for speech intelligibility, (5) uses a suspension system whose resonance frequency is tuned to enhance the response in the critical frequency regions for speech intelligibility, (6) uses a secondary omnidirectional sensor to enhance the fullness of sound quality for own-voice, (7) uses a piezoceramic sensor that is more susceptible to bone-conducted vibration, (8) uses a differential sensor and a DSP algorithm to extend and enhance the low frequency harmonics of the speech signal, thereby providing a fuller, richer sound quality of own voice, (9) uses a faceplate microphone together with a DSP algorithm to gate the transmission of the own-voice signal, uses a faceplate microphone together with a DSP algorithm to determine quiet ambient noise environments and enhance the quality of own-voice by combining the faceplate microphone output with the own-voice sensor output.
It is understood that variations in communications standards, protocols, and combinations of components may be employed without departing from the scope of the present subject matter. Hearing assistance devices typically include an enclosure or housing, a microphone, hearing assistance device electronics including processing electronics, and a speaker or receiver. Processing electronics include a controller or processor, such as a digital signal processor (DSP), in various embodiments. Other types of processors may be used without departing from the scope of this disclosure. It is understood that in various embodiments the microphone is optional. It is understood that in various embodiments the receiver is optional. Thus, the examples set forth herein are intended to be demonstrative and not a limiting or exhaustive depiction of variations.
It is understood that the hearing aids referenced in this patent application include a processor. The processor may be a digital signal processor (DSP), microprocessor, microcontroller, other digital logic, or combinations thereof. The processing of signals referenced in this application can be performed using the processor. Processing may be done in the digital domain, the analog domain, or combinations thereof. Processing may be done using subband processing techniques. Processing may be done with frequency domain or time domain approaches. Some processing may involve both frequency and time domain aspects. For brevet, in some examples drawings may omit certain blocks that perform frequency synthesis, frequency analysis, analog-to-digital conversion, digital-to-analog conversion, amplification, and certain types of filtering and processing. In various embodiments the processor is adapted to perform instructions stored in memory which may or may not be explicitly shown. Various types of memory may be used, including volatile and nonvolatile forms of memory. In various embodiments, instructions are performed by the processor to perform a number of signal processing tasks. In such embodiments, analog components are in communication with the processor to perform signaltasks, such as microphone reception, or receiver sound embodiments (i.e., in applications where such transducers are used). In various embodiments, different realizations of the block diagrams, circuits, and processes set forth herein may occur without departing from the scope of the present subject matter.
The present subject matter is demonstrated for hearing assistance devices, including hearing aids, including but not limited to, behind-the-ear (BTE), in-the-ear (ITE), in-the-canal (ITC), receiver-in-canal (RIC), or completely-in-the-canal (CIC) type hearing aids. It is understood that behind-the-ear type hearing aids may include devices that reside substantially behind the ear or over the ear. Such devices may include hearing aids with receivers associated with the electronics portion of the behind-the-ear device, or hearing aids of the type having receivers in the ear canal of the user, including but not limited to receiver-in-canal (RIC) or receiver-in-the-ear (RITE) designs. The present subject matter can also be used in hearing assistance devices generally, such as cochlear implant type hearing devices and such as deep insertion devices having a transducer, such as a receiver or microphone, whether custom fitted, standard, open fitted or occlusive fitted. It is understood that other hearing assistance devices not expressly stated herein may be used in conjunction with the present subject matter.
This application is intended to cover adaptations or variations of the present subject matter. It is to be understood that the above description is intended to be illustrative, and not restrictive. The scope of the present subject matter should be determined with reference to the appended claims, along with the full scope of legal equivalents to which such claims are entitled.
The present application is a continuation of U.S. patent application Ser. No. 13/966,058, filed on Aug. 13, 2013, which application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application 61/682,589, filed Aug. 13, 2012, which applications are incorporated herein by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
4150262 | Ono | Apr 1979 | A |
5201006 | Weinrich | Apr 1993 | A |
5692059 | Kruger | Nov 1997 | A |
5812659 | Mauney et al. | Sep 1998 | A |
6754359 | Svean et al. | Jun 2004 | B1 |
7433484 | Asseily | Oct 2008 | B2 |
7477754 | Rasmussen et al. | Jan 2009 | B2 |
7502484 | Ngia et al. | Mar 2009 | B2 |
7590253 | Killion | Sep 2009 | B2 |
7853031 | Hamacher | Dec 2010 | B2 |
7929713 | Victorian et al. | Apr 2011 | B2 |
8059847 | Nordahn | Nov 2011 | B2 |
8600090 | Hies | Dec 2013 | B2 |
9042586 | Burns et al. | May 2015 | B2 |
20060177083 | Sjursen | Aug 2006 | A1 |
20070127757 | Darbut et al. | Jun 2007 | A2 |
20090238388 | Saltykov et al. | Sep 2009 | A1 |
20100119086 | Fukuda | May 2010 | A1 |
20100172523 | Burns et al. | Jul 2010 | A1 |
20100172529 | Burns | Jul 2010 | A1 |
20100246860 | Rye et al. | Sep 2010 | A1 |
20100260364 | Merks | Oct 2010 | A1 |
20110135120 | Larsen et al. | Jun 2011 | A1 |
20110243358 | Platz et al. | Oct 2011 | A1 |
20140023217 | Zhang | Jan 2014 | A1 |
20140044294 | Burns et al. | Feb 2014 | A1 |
Number | Date | Country |
---|---|---|
2055139 | Dec 2009 | EP |
1519625 | May 2010 | EP |
1744589 | Feb 2011 | EP |
WO-2008151623 | Dec 2008 | WO |
WO-2008151624 | Dec 2008 | WO |
WO-2008151638 | Dec 2008 | WO |
Entry |
---|
“European Application Serial No. 13179859.7, Invitation Pursuant to Art. 94(3)/Rule 71(1) dated Aug. 10, 2015”, 3 pgs. |
“European Application Serial No. 13179859.7, Response filed Aug. 26, 2015 to Invitation Pursuant to Art. 94(3)/Rule 71(1) dated Aug. 10, 2015”, 9 pgs. |
“U.S. Appl. No. 13/966,058, Non Final Office Action dated Oct. 1, 2014”, 14 pgs. |
“U.S. Appl. No. 13/966,058, Notice of Allowance dated Jan. 23, 2015”, 10 pgs. |
“U.S. Appl. No. 13/966,058, Response filed Jan. 2, 2014 to Non Final Office Action dated Oct. 1, 2014”, 9 pgs. |
“European Application Serial No. 13179859.7, Examination Notification Art. 94(3) dated Dec. 2, 2014”, 4 pgs. |
“European Application Serial No. 13179859.7, Extended European Search Report dated Nov. 6, 2013”, 6 pgs. |
“European Application Serial No. 13179859.7, Extended Search Report Response filed Aug. 7, 2014 to Extended Search Report dated Nov. 6, 2014”, 19 pgs. |
“Method of Measurement of Performance Characteristics of Hearing Aids Under Simulated Real-Ear Working Conditions”, ANSI/ASA S3.35/2010, (2010), 49 pgs. |
“Method of Measurement of Performance Characteristics of Hearing Aids Under Simulated Real-Ear Working Conditions, Table C.1.”, ANSI 53.35/2010, (2010), 36-38. |
Mather, G., “Perception of Sound”, Foundations of Perception, Taylor & Francis, ISBN 0863778356, (2006), 9 pgs. |
Number | Date | Country | |
---|---|---|---|
20150334492 A1 | Nov 2015 | US |
Number | Date | Country | |
---|---|---|---|
61682589 | Aug 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13966058 | Aug 2013 | US |
Child | 14720036 | US |