The present subject matter relates generally to hearing assistance systems and more particularly to methods and apparatus for own-voice sensing in a hearing assistance device.
Hearing assistance devices include a variety of devices such as assistive listening devices, cochlear implants and hearing aids. Hearing aids are useful in improving the hearing and speech comprehension of people who have hearing loss by selectively amplifying certain frequencies according to the hearing loss of the subject. A hearing aid typically has three basic parts; a microphone, an amplifier and a speaker. The microphone receives sound (acoustic signal) and converts it to an electrical signal and sends it to the amplifier. The amplifier increases the power of the signal, in proportion to the hearing loss, and then sends it to the ear through the speaker. Cochlear devices may employ electrodes to transmit sound to the patient.
Undesired sounds such as noise, feedback and the user's own voice may also be amplified, which can result in decreased sound quality and benefit for the user. It is undesirable for the user to hear his or her own voice amplified. Further, if the user is using an ear mold with little or no venting, he or she will experience an occlusion effect where his or her own voice sounds hollow (“talking in a barrel”). Thirdly, if the hearing aid has a noise reduction/environment classification algorithm, the user's own voice can be wrongly detected as desired speech.
Typical hearing aid microphones have difficulties properly detecting a wearer's own voice. Problems include poor signal to (ambient) noise ratio, poor speech intelligibility, and ingress of foreign debris into the microphone. Prior solutions to this problem include: (1) the telecom industry typically uses a directional microphone system either in the housing (on the lateral side of an in-ear device) or on a boom, thereby positioning the microphones closer to the mouth. However, these directional microphones are susceptible to outside ambient noise, thereby degrading SNR and speech intelligibility, and are susceptible to foreign debris; (2) Kruger (U.S. Pat. No. 5,692,059) entitled Two active element in-the-ear microphone system combined the outputs of a dedicated airborne transducer together with a dedicated non-airborne transducer to produce a composite own-voice signal. Each transducer sensed a different frequency portion of the user's own-voice to produce the composite output. A piezoelectric accelerometer was the preferred non-airborne transducer. However, Kruger requires two different transducers: an airborne transducer and a non-airborne transducer. One transducer is dedicated to high frequency fricatives and the other is dedicated to low frequencies. A separate transducer dedicated to low frequencies, though it may give better sound quality, is superfluous for speech intelligibility in that low frequencies are not crucial for such as shown in FIG. 10; (3) Darbut (U.S. Patent Application No. 2007/0127757) entitled Behind-the-ear auditory device used an acoustic canal pad comprised of a flexible membrane and rigid base such that acoustic signals were amplified and routed to a microphone (paragraph 0130). Furthermore, the single-port (omni) microphone is coupled to this rigid base via “dampening elements whose internal prongs are offset from the external prongs, thereby isolating the microphone from vibration” (paraphrased from paragraphs 0072-3). However, Darbut employs an “at least partially in-ear element’ which consists of a standard housing with an ‘acoustic pickup cushion pillow’ or ‘acoustic canal pad’ as described in 1(c) above. It functions as a “stethoscope-like” device; specifically, it provides acoustical amplification from vibrations of the cartilaginous portion of the ear canal. Since a standard housing is used for the in-ear element, a second pad is positioned opposite the acoustic canal pad in order to snugly position the standard housing against the cartilaginous portion of the ear canal and thereby allow the stethoscope-like device to amplify properly; (4) Platz (U.S. Patent Application No. 2011/0243385) entitled System for picking-up a user's voice used a standard ‘one-size-fits-all’ earmold to be worn at least partly in a user's ear canal together with an elongated, C-shaped retention element attached to the shell of the earmold and brought into engagement of a user's concha by manual plastic deformation by the user, thereby providing the necessary contact force between an ear microphone (i.e., a microphone oriented acoustically inwardly towards the user's ear canal and adapted for picking up the user's voice via bone conduction from the skull) and the ear canal wall. In a different embodiment, a first ‘ear’ microphone oriented acoustically inward towards the user's ear canal and a second ‘ambient’ microphone oriented outwardly towards the environment, with a sound port terminating at the outer end of the earmold, is used. Digital signal processing of the two microphone signals is performed to achieve Blind Source Separation (BSS) of the signals and thus eliminate the need of “bone-conduction microphones which would cause discomfort to the user” (paragraph 0032). However, in Platz the ear-canal microphone will not function properly without the C-shaped retention element engaged within a user's concha. In addition, this bone conduction microphone “would cause discomfort to the user” (described in paragraph 0032). As shown, the ear-canal bone conduction microphone depicted in the FIG. 3 of Platz has a separate protrusion from the earmold housing, presumably the cause of user discomfort.
Thus, there is a need in the art for an improved method and apparatus for own-voice sensing in hearing assistance devices.
Disclosed herein, among other things, are methods and apparatus for own-voice sensing in hearing assistance devices. One aspect of the present subject matter includes an in-the-ear (ITE) hearing assistance device adapted to process sounds, including sounds from a wearer's mouth. According to various embodiments, the device includes a hollow plastic housing adapted to be worn in the ear of the wearer and a differential sensor mounted to an interior surface of the housing in an ear canal of the wearer. The differential sensor includes inlets located within the housing and the differential sensor is configured to improve speech intelligibility of sounds from the wearer's mouth, in various embodiments.
This Summary is an overview of some of the teachings of the present application and not intended to be an exclusive or exhaustive treatment of the present subject matter. Further details about the present subject matter are found in the detailed description and appended claims. The scope of the present invention is defined by the appended claims and their legal equivalents.
The following detailed description of the present subject matter refers to subject matter in the accompanying drawings which show, by way of illustration, specific aspects and embodiments in which the present subject matter may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present subject matter. References to “an”, “one”, or “various” embodiments in this disclosure are not necessarily to the same embodiment, and such references contemplate more than one embodiment. The following detailed description is demonstrative and not to be taken in a limiting sense. The scope of the present subject matter is defined by the appended claims, along with the full scope of legal equivalents to which such claims are entitled.
Modern hearing assistance devices, such as hearing aids typically include a processor, such as a digital signal processor in communication with a microphone and receiver. Such designs are adapted to perform a great deal of processing on sounds received by the microphone. These designs can be highly programmable and may use inputs from remote devices, such as wired and wireless devices.
The detection of a wearer or user's own-voice for telecommunications or hearing assistance devices would benefit by improving its signal to (ambient) noise ratio, improving its speech intelligibility, and protecting it from foreign debris. For telecommunications, own-voice is typically detected with some type of boom microphone or directional microphone on the exterior housing. For hearing assistance devices, own-voice has been previously detected with one (or more) microphones in the faceplate housing. In-the-ear (ITE) hearing instruments with sensors positioned along the tip or canal of the earmold rather than the faceplate have also been used. These instruments are targeted for first-responder communication applications such as firefighters and omnidirectional microphones are typically used. The acoustical inlet of the omnidirectional microphone can be located at the tip of the earmold so as to sense the sound pressure in the air cavity of the ear canal. In this approach, the microphone is susceptible to foreign debris. Alternatively, the plastic ITE housing can contain a small elastomeric bladder with one side-wall of the bladder in contact with the ear canal skin, and the other side of the bladder connected to the microphone inlet, where the inside of the bladder contains a closed air cavity sharing air with the microphone inlet. These devices have the advantage of being acoustically isolated from the outside ambient noise, thereby protecting the microphone from foreign debris. However, they have the disadvantage of capturing an own-voice signal that is intrinsically ‘boomy’ and inferior for speech intelligibility. There would be an advantage, therefore, to use a sensor that can capture an own-voice signal that produces greater speech intelligibility, and is shielded from foreign debris.
Therefore, the present subject matter uses a sensor with a frequency response that resembles the SII weightings. In general, omnidirectional microphones have relatively flat frequency responses whereas directional (pressure-differential) microphones have freefield responses that roll off at lower frequencies, thereby resembling the SII weightings as shown above. In addition, the internal membranes of typical pressure-differential electret microphones are not loaded with closed air cavities, and for this reason they are more sensitive to bone-conducted vibration than typical omni electret microphones. Differential microphones, therefore, are better suited for this application—not because of their directional polar response in a freefield, but because of their intrinsic frequency response and their susceptibility to bone-conducted vibration.
The present subject matter includes a differential microphone placed deep in the ear canal, mounted (directly or indirectly) to the plastic ITE housing and contained within the air cavity of the hollow plastic housing. Advantages of the present subject matter include: 1) isolation from outside ambient noise, 2) protection from foreign debris, 3) a frequency response that is similar to the SII frequency weightings, and 4) higher sensitivity to bond-conducted vibration. This last item implies that it is advantageous to mount the sensor so as to amplify bone-conducted vibrations in the frequency regions as depicted in the SII weightings. Toward that end, the sensor could be placed in an elastomeric sleeve so that its resonance frequency, i.e., the compliance of the elastomeric sleeve resonating with the mass of the sensor, enhances the overall response in the SII weighted frequency bands.
There are a number of ways the present subject matter can be implemented in an ITE hearing instrument. While the present subject matter is demonstrated using an ITE device, other types of hearing assistance devices can be used without departing from the scope of the present subject matter.
The present subject matter provides ways to arrange and mount a sensor within the housing of an ITE housing instrument so as to improve the speech intelligibility of the sensor's output signal. Unique aspects of the present subject matter include, but are not limited to: (1) a single, passive, pressure-differential electret microphone can be used for enhanced speech intelligibility; (2) the passive, pressure-differential microphone can have either a 1st- or 2nd-order freefield response; (3) the mounting suspension stiffness is engineered to resonate with the mass of the differential microphone so as to amplify and enhance the sensor's bone-conduction response in the SII weighted frequency bands. Engineering includes the choice of elastomer and its geometrical dimensions, particularly its thickness; (4) the tension and effective mass of the elastomeric window barrier, integrated into the wall of the plastic housing, is engineered to resonate with the stiffness of the air cavity within the plastic housing so as to amplify and enhance the sensor's response in the SII weighted frequency bands. Engineering includes the choice of elastomer and its geometrical dimensions, particularly its thickness; and (5) a combination module containing both an omni and pressure-differential sensor can be used to extend low frequencies for a sound quality of own-voice that is fuller.
Advantages of the present subject matter over previous solutions include, but are not limited to: (1) a sensor comprising a single electret microphone consumes less electrical power than multi-microphone approaches; (2) a sensor comprising a single, pressure-differential electret microphone is more sensitive to bone-conducted vibration as compared to an omni electret microphone; (3) a sensor comprising a single, piezoceramic microphone is more sensitive to bone-conducted vibration as compared to an omni electret microphone; (4) the mounting of the sensor does not require any specialty bladders or pillows that protrude out of the shell, thereby causing potential discomfort to the user; (5) the sensor is located inside of the ITE earmold thereby protecting it from foreign debris; and (6) the output of a second omni sensor can be combined with the output of the differential sensor to extend low frequencies and provide a fuller quality of sound to own-voice.
Additional embodiments of the present subject matter include, but are not limited to: (1) using a piezoceramic microphone instead of an electret microphone. Piezoceramic microphones were used in hearing instruments briefly in the early 1970's, and are intrinsically more sensitive to (bone conduction) vibration than typical electrets. The piezoceramic microphone can either be omni or differential; (2) using a silicon MEMS microphone instead of an electret microphone. MEMS microphones are used considerably in today's telecom instruments, and may be more sensitive to (bone conduction) vibration than typical electrets. The MEMS microphone can either be omni or differential; (3) in each above embodiment, the output signal of a separate faceplate microphone could be used in a digital signal processing method to enhance the quality of the own-voice sensor signal. In one example such as quiet ambient noise environments, the faceplate microphone output signal could be combined with the own-voice sensor signal to produce an enhanced system output signal. In another example, the faceplate microphone output signal could be cross-correlated with the own-voice sensor signal to determine when the user is actually talking, thereby gating the transmission of the own-voice signal; (4) in each above embodiment having a pressure-differential sensor whose output signal is inherently deficient of low frequency energy, a DSP scheme using psychoacoustic bass-enhancement algorithms can be used to artificially extend and enhance the perception of the low-frequency harmonics (60 to 250 Hz) of the speech signal, thereby providing a fuller, richer sound quality of own-voice.
Benefits of the present subject matter, including those based on choice of sensor and mounting system, include, but are not limited to: (1) provides higher speech intelligibility; (2) provides protection against foreign debris, (3) uses a pressure-differential sensor that is more susceptible to bone-conducted vibration, (4) uses a pressure-differential sensor that enhances the response in the critical frequency regions for speech intelligibility, (5) uses a suspension system whose resonance frequency is tuned to enhance the response in the critical frequency regions for speech intelligibility, (6) uses a secondary omnidirectional sensor to enhance the fullness of sound quality for own-voice, (7) uses a piezoceramic sensor that is more susceptible to bone-conducted vibration, (8) uses a differential sensor and a DSP algorithm to extend and enhance the low frequency harmonics of the speech signal, thereby providing a fuller, richer sound quality of own voice, (9) uses a faceplate microphone together with a DSP algorithm to gate the transmission of the own-voice signal, uses a faceplate microphone together with a DSP algorithm to determine quiet ambient noise environments and enhance the quality of own-voice by combining the faceplate microphone output with the own-voice sensor output.
It is understood that variations in communications standards, protocols, and combinations of components may be employed without departing from the scope of the present subject matter. Hearing assistance devices typically include an enclosure or housing, a microphone, hearing assistance device electronics including processing electronics, and a speaker or receiver. Processing electronics include a controller or processor, such as a digital signal processor (DSP), in various embodiments. Other types of processors may be used without departing from the scope of this disclosure. It is understood that in various embodiments the microphone is optional. It is understood that in various embodiments the receiver is optional. Thus, the examples set forth herein are intended to be demonstrative and not a limiting or exhaustive depiction of variations.
It is understood that the hearing aids referenced in this patent application include a processor. The processor may be a digital signal processor (DSP), microprocessor, microcontroller, other digital logic, or combinations thereof. The processing of signals referenced in this application can be performed using the processor. Processing may be done in the digital domain, the analog domain, or combinations thereof. Processing may be done using subband processing techniques. Processing may be done with frequency domain or time domain approaches. Some processing may involve both frequency and time domain aspects. For brevet, in some examples drawings may omit certain blocks that perform frequency synthesis, frequency analysis, analog-to-digital conversion, digital-to-analog conversion, amplification, and certain types of filtering and processing. In various embodiments the processor is adapted to perform instructions stored in memory which may or may not be explicitly shown. Various types of memory may be used, including volatile and nonvolatile forms of memory. In various embodiments, instructions are performed by the processor to perform a number of signal processing tasks. In such embodiments, analog components are in communication with the processor to perform signaltasks, such as microphone reception, or receiver sound embodiments (i.e., in applications where such transducers are used). In various embodiments, different realizations of the block diagrams, circuits, and processes set forth herein may occur without departing from the scope of the present subject matter.
The present subject matter is demonstrated for hearing assistance devices, including hearing aids, including but not limited to, behind-the-ear (BTE), in-the-ear (ITE), in-the-canal (ITC), receiver-in-canal (RIC), or completely-in-the-canal (CIC) type hearing aids. It is understood that behind-the-ear type hearing aids may include devices that reside substantially behind the ear or over the ear. Such devices may include hearing aids with receivers associated with the electronics portion of the behind-the-ear device, or hearing aids of the type having receivers in the ear canal of the user, including but not limited to receiver-in-canal (RIC) or receiver-in-the-ear (RITE) designs. The present subject matter can also be used in hearing assistance devices generally, such as cochlear implant type hearing devices and such as deep insertion devices having a transducer, such as a receiver or microphone, whether custom fitted, standard, open fitted or occlusive fitted. It is understood that other hearing assistance devices not expressly stated herein may be used in conjunction with the present subject matter.
This application is intended to cover adaptations or variations of the present subject matter. It is to be understood that the above description is intended to be illustrative, and not restrictive. The scope of the present subject matter should be determined with reference to the appended claims, along with the full scope of legal equivalents to which such claims are entitled.
The present application is a continuation of U.S. patent application Ser. No. 17/247,821, filed Dec. 23, 2020, which is a continuation of U.S. patent application Ser. No. 15/884,850, filed Jan. 31, 2018, now issued as U.S. Pat. No. 10,880,657, which is a continuation of U.S. patent application Ser. No. 14/720,036, filed May 22, 2015, now issued as U.S. Pat. No. 9,900,710, which is a continuation of U.S. patent application Ser. No. 13/966,058, filed on Aug. 13, 2013, now issued as U.S. Pat. No. 9,042,586, which application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application 61/682,589, filed Aug. 13, 2012, which applications are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
61682589 | Aug 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17247821 | Dec 2020 | US |
Child | 18514140 | US | |
Parent | 15884850 | Jan 2018 | US |
Child | 17247821 | US | |
Parent | 14720036 | May 2015 | US |
Child | 15884850 | US | |
Parent | 13966058 | Aug 2013 | US |
Child | 14720036 | US |