In order to reduce power consumption, many personal audio devices have a dedicated “in-ear detect” function, operable to detect the presence or absence of an ear in proximity to the device. Additionally, specific for in-ear transducers (earphones), for some applications there is a need to evaluate the quality of the seal formed between the earphone and the ear canal. For example, the playback quality, in particular the bass response, is affected by the quality of the seal formed between the earphone and the ear canal. Additionally, in the realm of ear biometrics, the ear canal impulse response (ECIR) is affected by the insertion quality.
Infra-red sensors have been used in mobile phones to detect the proximity of an ear. Light sensors have been proposed to detect the insertion of earphones and headphones into or onto a user's ears. However, these non-acoustical mechanisms suffer from the drawback that they require additional hardware in the device. Furthermore, they cannot assess the seal/insertion quality.
Measuring transducer (e.g., receiver) impedance is an acoustical method that can be used to detect ear in/out status of a device, but not seal quality. It is also possible to use very low frequency (e.g., 5 Hz) probe sounds, requiring direct measurements of the sound levels at these frequencies. Such measurements, in addition to requiring specific probe signals to be generated, suffer from high noise levels and microphone response inaccuracies.
In one embodiment, the present disclosure provides a system for evaluating an ear seal between an earphone of a hearing device and an ear canal that includes a first transducer configured to play sound into the ear canal in response to an electrical signal, wherein the electrical signal includes a reference frequency component and at least one test frequency component. The sound includes a reference frequency component and at least one test frequency component. The at least one test frequency is lower than the reference frequency. A second transducer is configured to receive the sound in the ear canal. A controller is configured to: calculate at least one electrical signal level difference between the reference frequency component and the at least one test frequency component of the electrical signal, measure acoustical levels of the reference frequency component and the at least one test frequency component of the sound in the ear canal, calculate at least one acoustical signal level difference between the measured acoustical level of the reference frequency component and the measured acoustical level of the at least one test frequency component, calculate at least one normalized acoustical difference value by subtracting the electrical signal level difference from the at least one acoustical signal level difference, and determine a measurement of the ear seal based on the at least one normalized acoustical difference value.
In another embodiment, the present disclosure provides a method for evaluating an ear seal between an earphone of a hearing device and an ear canal. The method includes playing, by a first transducer of the earphone, sound into the ear canal in response to an electrical signal. The electrical signal includes a reference frequency component and at least one test frequency component. The sound includes a reference frequency component and at least one test frequency component. The at least one test frequency is lower than the reference frequency. The method also includes calculating at least one electrical signal level difference between the reference frequency component and the at least one test frequency component of the electrical signal, measuring acoustical levels of the reference frequency component and the at least one test frequency component of the sound in the ear canal received by a second transducer of the earphone, calculating at least one acoustical signal level difference between the measured acoustical level of the reference frequency component and the measured acoustical level of the at least one test frequency component, calculating at least one normalized acoustical difference value by subtracting the electrical signal level difference from the at least one acoustical signal level difference, and determining a measurement of the ear seal based on the at least one normalized acoustical difference value.
In yet another embodiment, the present disclosure provides a non-transitory computer-readable medium having instructions stored thereon that are capable of causing or configuring a system for evaluating a seal between an earphone of a hearing device and an ear canal or ear cavity to perform operations. The operations include playing, by a first transducer of the earphone, sound into the ear canal in response to an electrical signal. The electrical signal includes a reference frequency component and at least one test frequency component. The sound includes a reference frequency component and at least one test frequency component. The at least one test frequency is lower than the reference frequency. The method also includes calculating at least one electrical signal level difference between the reference frequency component and the at least one test frequency component of the electrical signal, measuring acoustical levels of the reference frequency component and the at least one test frequency component of the sound in the ear canal received by a second transducer of the earphone, calculating at least one acoustical signal level difference between the measured acoustical level of the reference frequency component and the measured acoustical level of the at least one test frequency component, calculating at least one normalized acoustical difference value by subtracting the electrical signal level difference from the at least one acoustical signal level difference, and determining a measurement of the ear seal based on the at least one normalized acoustical difference value.
Embodiments are described in which a system uses a lower-frequency region of wideband program material spectrum to assess both the in/out position of an earbud as well as ear seal quality. Sound levels at one or more low frequencies (LF), referred to herein as test frequencies, are measured relative to at least one higher frequency (HF), referred to herein as reference frequency, using an electrical program signal difference as a normalization reference. Take as an example a LF test frequency of 100 Hz (e.g., see
As may be observed from
Each of the earphones 18A and 18B (referred to generically as earphone 18 and collectively as earphones 18) includes a reference microphone R, an error microphone E and a speaker SPKR. When the earphone 18 is inserted into an ear canal, the reference microphone R is external to the ear canal and the error microphone E is internal to the ear canal. The reference microphone R, also referred to as the external microphone, measures the ambient, or external, acoustic environment. The error microphone E, also referred to as the internal microphone, measures the attenuated ambient audio within the ear canal combined with the audio reproduced by the speaker SPKR. The speaker SPKR may reproduce distant speech received by mobile audio device 10, along with other local audio events such as ringtones, stored or streamed audio program material, injection of near-end speech (i.e., the speech of the user of mobile audio device 10) to provide a balanced conversational perception, and other audio that requires reproduction by mobile audio device 10, such as sources from webpages or other network communications received by mobile audio device 10 and audio indications such as a low battery indication and other system event notifications.
The hearing device 13 may include a controller 17, e.g., in the combox 16 or within one or both of the earphones 18, that performs various operations or functions described herein to determine ear seal quality using sound levels measured on the error (internal) microphone E at test and reference frequencies. The operations may include measuring sound levels at the error microphone E at the reference and test frequencies, calculating an acoustical difference between the measured sound levels, calculating a difference between the test and reference frequency components of the electrical signal used to drive the speaker SPKR to generate the sound, calculating a normalized acoustical signal difference based on the acoustical difference and the electrical signal difference, and determining the ear seal quality based on the normalized acoustical difference. The controller 17 may also perform actions based on the determined ear seal quality that may improve the listening experience for the user of the hearing device 13. The controller 17 may include a processing element that fetches and executes program instructions. The controller 17 may also include volatile and non-volatile memory for storing data and program instructions executable by the controller 17. The controller 17 may also include an audio coder/decoder (CODEC) circuit (not shown) that receives the signals from reference microphone R and error microphone E and generates the electrical signals to the speaker SPKR.
The audio device 10 also includes a controller 19 that may perform some of the operations to determine the ear seal quality and/or perform actions based on the determined ear seal quality that may improve the listening experience for the user. The controller 19 may be included in an integrated circuit (IC) of the audio device 10. The controller 19 may also include an audio CODEC circuit and volatile and non-volatile memories (not shown). The audio device 10 may include an audio port 15 for connecting to the hearing device 13. The audio port 15 may be communicatively coupled to a radio frequency (RF) circuit (not shown) and the controller 19 within the audio device 10, thus permitting communication with components of the hearing device 13. The RF circuit may include a wireless telephone transceiver. In other embodiments, the hearing device 13 may connect wirelessly to the mobile audio device 10, e.g., via Bluetooth or other short-range wireless technology.
The hearing device 13 and/or mobile audio device 10 may include acoustic noise cancellation (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. In general, the ANC system measures ambient acoustic events (as opposed to the output of speaker SPKR and/or near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, ANC processing circuits adapt an anti-noise signal generated using the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events at error microphone E. In some embodiments, the hearing device 13 and/or audio device 10 may also include a near speech microphone that may be employed in ANC operation.
In some embodiments of the disclosure, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that includes control circuits and other functionality for implementing the hearing device 13 and/or the portable audio device 10, such as an MP3 player-on-a-chip integrated circuit. In these and other embodiments, the circuits and techniques disclosed herein may be implemented partially or fully in software and/or firmware embodied in computer-readable media and executable by a controller or other processing device, such as a controller that may perform operations as described herein. The controller may include an electronic circuit capable of fetching program instructions stored in addressed memory locations and executing the fetched instructions. The IC may also include a non-volatile memory for storing threshold values as described in more detail below.
At block 502, an electrical signal is driven into a transducer (e.g., speaker SPKR of
At block 504, an electrical signal level difference is calculated between the reference frequency and test frequency components of the electrical signal. In one embodiment, multiple test frequencies are used, and multiple electrical signal level differences are calculated between the reference frequency component and the multiple test frequency components of the electrical signal. Additionally, acoustical signal levels of the reference frequency component and the test frequency component or components of the sound generated at block 502 are measured. Still further, one or more acoustical signal level differences are calculated between the measured acoustical signal level of the reference frequency component and the one or more measured acoustical signal levels of the test frequency components. Finally, one or more normalized acoustical difference values are calculated by subtracting the one or more electrical signal level differences from the respective one or more acoustical signal level differences. As described above, multiple test frequencies may be used with a given reference frequency to facilitate better discrimination of the ear seal quality under various conditions. For example, multiple normalized acoustical differences are calculated for different test frequencies and then statistically combined (e.g., averaged, weighted averaged) to generate a single normalized acoustical difference. Additionally, one or more test frequencies may be used with each of multiple reference frequencies to facilitate better discrimination of the ear seal quality under various conditions. The operations at block 504 may be performed by a controller of the hearing device and/or of the mobile audio device. Operation proceeds to block 506.
At block 506, an ear seal measurement is determined based on the normalized acoustical difference or differences calculated at block 504. In one embodiment, the normalized acoustical difference or differences are compared against thresholds associated with different ear seal qualities, or leak sizes. For example, a difference of X (e.g., −20) dBr may be associated with a leak size of Y (e.g., 0.01) millimeters. The threshold values may be established based on previously measured and calculated information such as the information shown in
At decision block 508, a determination is made whether the normalized acoustical difference calculated at block 504 (e.g., for a given test frequency) is less than a predetermined threshold, referred to as a “device out” threshold. If so, operation proceeds to block 512; otherwise, operation proceeds to block 514.
At block 512, an indication that the earphone is out of the ear canal is stored. The “device out” indication may be used as a trigger for other actions, e.g., as described with respect to block 514.
At block 514, an action is taken based on the ear seal measurement made at block 506 and/or the “device out” indication determined at blocks 508 and 512. The actions may include, but are not limited to: using the ear seal measurement and/or the “device out” indication to assist an ANC algorithm employed by the hearing device 13 and/or mobile audio device 10; adjust the playback quality and/or level; adjust the balance between the right and left earphones; adjust the equalization of the earphone, e.g., boost the bass level; display a message to the user, e.g., “earphone is out, please replace” or “ear seal quality low, please re-insert earphone.” As described herein, in some embodiments the operations described with respect to
Advantages of the embodiments described herein may include the following. Because program material or a musical chime signal, for example, may be used (e.g., the lowest guitar note is 80 Hz and the lowest bass note is 40 Hz), no infrasound probe signals are required. A reduction in measurement uncertainty may be avoided since the high-pass filter slope range of the internal microphone may be avoided (e.g., typical −3 dB frequency range for error microphones is 35 to 85 Hz). The embodiments may be used as a coarse measure of insertion quality for a generic, i.e., unknown, sealed earphone design. The use of multiple test and/or reference frequencies may allow fine-tuning for a given earphone and better confidence in the measurements. The embodiments may be fine-tuned to a great degree of seal assessment accuracy for a known earbud. For example, the embodiments may be used as a noisy independent, i.e., uncorrelated with other methods, measure of the insertion depth for ear biometrics and may be used to assist an ANC algorithm.
It should be understood—especially by those having ordinary skill in the art with the benefit of this disclosure—that the various operations described herein, particularly in connection with the figures, may be implemented by other circuitry or other hardware components. The order in which each operation of a given method is performed may be changed, unless otherwise indicated, and various elements of the systems illustrated herein may be added, reordered, combined, omitted, modified, etc. It is intended that this disclosure embrace all such modifications and changes and, accordingly, the above description should be regarded in an illustrative rather than a restrictive sense.
Similarly, although this disclosure refers to specific embodiments, certain modifications and changes can be made to those embodiments without departing from the scope and coverage of this disclosure. Moreover, any benefits, advantages, or solutions to problems that are described herein with regard to specific embodiments are not intended to be construed as a critical, required, or essential feature or element.
Further embodiments, likewise, with the benefit of this disclosure, will be apparent to those having ordinary skill in the art, and such embodiments should be deemed as being encompassed herein. All examples and conditional language recited herein are intended for pedagogical objects to aid the reader in understanding the disclosure and the concepts contributed by the inventor to furthering the art and are construed as being without limitation to such specifically recited examples and conditions.
This disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Similarly, where appropriate, the appended claims encompass all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Moreover, reference in the appended claims to an apparatus or system or a component of an apparatus or system being adapted to, arranged to, capable of, configured to, enabled to, operable to, or operative to perform a particular function encompasses that apparatus, system, or component, whether or not it or that particular function is activated, turned on, or unlocked, as long as that apparatus, system, or component is so adapted, arranged, capable, configured, enabled, operable, or operative.
Finally, software can cause or configure the function, fabrication and/or description of the apparatus and methods described herein. This can be accomplished using general programming languages (e.g., C, C++), hardware description languages (HDL) including Verilog HDL, VHDL, and so on, or other available programs. Such software can be disposed in any known non-transitory computer-readable medium, such as magnetic tape, semiconductor, magnetic disk, or optical disc (e.g., CD-ROM, DVD-ROM, etc.), a network, wire line or another communications medium, having instructions stored thereon that are capable of causing or configuring the apparatus and methods described herein.
This application claims priority based on U.S. Provisional Application Ser. No. 63/039,988, filed Jun. 17, 2020, entitled System and Method for Evaluating an Ear Seal using Normalization, which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
63039988 | Jun 2020 | US |