The present disclosure relates to an audio system and to a signal processing method, each for an ear mountable playback device, e.g. a headphone, comprising a speaker.
Nowadays a significant number of headphones, including earphones, employ techniques that enhance the sound experience of a user, such as noise cancellation techniques. For example, such noise cancellation techniques are referred to as active noise control or ambient noise cancellation, both abbreviated with ANC. ANC generally makes use of recording ambient noise that is processed for generating an anti-noise signal, which is then combined with a useful audio signal to be played over a speaker of the headphone. ANC can also be employed in other audio devices like handsets or mobile phones.
Various ANC approaches make use of feedback, FB, microphones, feedforward, FF, microphones or a combination of feedback and feedforward microphones. Efficient FF and FB ANC is achieved by tuning a filter or by adjusting an audio signal, e.g. via an equalizer, based on given acoustics of a system.
Hybrid noise cancellation headphones are generally known. For instance, a microphone is placed inside a volume that is directly acoustically coupled to the ear drum, conventionally close to the front of the headphones driver. This is referred to as the feedback (FB) microphone. A second microphone, the feedforward (FF) microphone, may be placed on the outside of the headphone, such that it is acoustically decoupled from the headphones driver.
For each system to work effectively, the headphone preferably makes a near perfect seal to the ear/head of the user which does not change whilst the device is worn and that is consistent for any user. Any change in this seal as a result of a poor fit will change the acoustics and ultimately the ANC performance. This seal is typically between the ear cushion and the user's head, or between an earphone's rubber tip and the ear canal wall.
For most noise cancellation headphones and earphones, effort is put into maintaining a consistent fit when being worn and from user to user to ensure that the headphone acoustics do not change and always have a good match to the noise filters. However, “leaky” earphones and headphones, which do not make a seal between the ear cushion/tips and the ear, have a large variation in the acoustics when worn by different people. Furthermore the acoustics can vary for the user whilst the earphone moves in their ear as a result of typical everyday head movements. Therefore, for any headphones or earphones which are leaky, some adaptation is required to ensure that the filters always match the acoustics.
Some headphones and earphones already feature some form of off-ear detection, i.e. a detection whether the headphone is worn by a user or not. Typically this is achieved by several means including optical proximity sensors, pressure sensors and capacitive sensors. However, the off-ear detection merely is able to distinguish between two extreme states of acoustic leakage, i.e. whether the headphone is on the ear or off the ear. Moreover, the listed solutions all require adding an extra sensor into the device solely for this purpose.
An objective to be achieved is to provide an improved concept for detecting an acoustical leakage of an ear mountable playback device like a headphone, earphone or mobile handset.
This object is achieved with the subject matter of the independent claims. Embodiments and developments of the improved concept are defined in the dependent claims.
The improved concept is based on the idea of estimating a leakage condition in terms of its extent, i.e. determining a degree of acoustic leakage between an ear mountable playback device and the ear canal of the user, during regular usage of said ear mountable playback device. This leakage condition can consequently be used to enhance the sound experience of the user, e.g. by removing unwanted portions of a sound signal transmitted to the ear canal of the user. This enhancement can be achieved by adjusting a noise control algorithm based on the estimated leakage condition, for instance. For example, FF and/or FB filters of a noise canceling headset may be tuned depending on the extent of the acoustic leakage.
In contrast, at present tuning of the aforementioned filters for conventional earphones and headsets is only performed once during or at the end of production of the ANC devices, for example by measuring acoustic properties of the device. In particular, tuning is performed during a calibration process with some measurement fixture like an artificial head with a microphone in the ear canal of the artificial head. The measurement, including the playing of some test sound, is coordinated from some kind of processing device which can be a personal computer or the like. To achieve an optimum ANC performance for each ANC device produced, a dedicated measurement has to be performed for each of the ANC devices under control of the processing device, which is time-consuming, especially if larger volumes of ANC devices are to be calibrated.
In the following, the improved concept will be explained, sometimes referring to a headphone or earphone as an example of the playback device. However, it shall be appreciated that this example is not limiting and will also be understood by a skilled person for other kinds of playback devices where different leakage conditions can occur during usage by a user. In general the term playback device should include all types of audio reproducing devices.
In an embodiment of an audio system according to the improved concept, which is to be used for an ear mountable playback device like a headphone, earphone, mobile phone, handset or the like, this system comprises a speaker and an error microphone that is configured to sense sound being output from the speaker and ambient sound. The audio system further comprises a detection engine that is configured to determine a driver response between the speaker and the error microphone, and to estimate a leakage condition from the determined driver response.
For example, the speaker of the audio system is arranged in a housing of the playback device such that a first volume is arranged on the preferential side for sound emission of the speaker. The housing may have an opening for coupling the first volume to the ear canal volume of the user. The housing may further comprise a front vent that is covered with an acoustic resistor and couples the first volume to the ambient environment. The front volume will also be coupled to the ambient environment via an acoustic leakage due to an imperfect fit of the earphone to the ear of the user. This acoustic leakage varies from person to person and depends on how the earphone sits in the ear at a specific time. The error microphone is arranged within the first volume such that it detects sound output from the speaker as well as ambient sound. For example, it is arranged close to the opening.
In addition, a second volume is arranged within the housing on the side of the speaker facing away from the preferential side for sound emission. The second volume is acoustically coupled to the ambient environment via a rear vent of the housing which may also be covered with an acoustic resistor. A further microphone may for example be arranged outside of the rear volume, i.e. at the outside of the housing, in order to predominantly sense ambient sound.
The detection engine is configured to determine a driver response between the speaker and the error microphone. The driver response corresponds to the driver, i.e. speaker, to error microphone transfer function. For example, the speaker output is a wanted signal, such as a music signal, that is consequently detected by means of the error microphone in addition to ambient noise due to an acoustic leakage.
The detection engine is further configured to estimate said leakage condition from the determined driver response. The estimation of an acoustic leakage based on the determined driver response offers a solution for adapting noise cancelling filters of a feedforward, feedback or hybrid ANC system for situations when the wanted signal, e.g. music, is loud relative to ambient noise. In these situations, determining a coherence between ambient noise signals at a further microphone of the audio system, e.g. a feedforward microphone, and at the error, i.e. feedback microphone, may be not possible causing an adaptive noise cancellation process to substantially deviate or oscillate around an optimum solution and resulting in a sub-optimal noise cancellation process.
Other systems that feature a leakage detection realize this feature by adapting and monitoring a filter that matches the driver response. In contrast, the improved concept of estimating the leakage directly from the driver response eliminates the error from the matching of the filter to the driver response, which is particularly an issue when adaption of the filter has not yet converged.
In some embodiments, determining the driver response comprises measuring a property of a first signal that is applied to the speaker, measuring a property of a second signal that is detected by the error microphone, and calculating the driver response from the first and the second property.
For example, the leakage condition is estimated based on a distinction between the wanted signal that is applied to the speaker, such as a music signal, and the signal detected by means of the error microphone, i.e. the error signal. This distinction is proportional to the determined driver response, for instance. Properties of the first and the second signal include an amplitude, an energy level, or mean amplitude of frequency components, i.e. a mean of several bins of a Fast Fourier transform, of the first and second signal, respectively.
In some embodiments, the property of the first and the second signal is an amplitude of the respective signal.
For example, a reference signal level, i.e. an amplitude, is taken of the signal applied to the driver and a response signal level is taken of the signal detected by the error microphone.
In some embodiments, for calculating the driver response, the first and the second signal are bandpass filtered with a predetermined bandpass frequency range.
The first and the second signal, which may be referred to as a reference signal and a response signal as described above, may be bandpass filtered to a frequency range at which the driver response differs substantially for different acoustic leaks. For example, the predetermined frequency range is at low acoustic frequencies such as 80-200 Hz.
In some embodiments, the driver response is calculated as a ratio of energy levels of the first and the second signal.
The energy level of each signal is determined, for example via the amplitude of the first and the second signal, and the ratio of energy levels is computed to determine the driver response. For example, the ratio of energy levels results in a scalar indication of the driver response.
In some embodiments, the driver response is calculated from response values determined at predetermined frequencies or frequency ranges of the first and the second signal, respectively.
For example, the signal amplitude or energy level of the reference and the response signal is evaluated at a specific frequency or multiple frequencies.
Typically, driver responses are evaluated only in the frequency band of interest, e.g. the frequency band that differs due to leakage changes. Therefore, the detection engine in these implementations is configured to only evaluate the first and the second signal in said frequency band of interest and to ignore the driver responses outside of this band for instance. For example, the driver response is only evaluated and compared to the predetermined responses between 100 Hz and 1 kHz.
For example, the detection engine evaluates the first and the second signal at a number of distinct frequencies, for example at at least three distinct frequencies within the audio band. The amplitude or energy level of the first and the second signal, respectively, is monitored at the at least three frequencies, for instance. The result is then used to determine multiple leakage conditions for the at least three frequencies. The resulting leakage condition may be consequently determined from the multiple acoustic leakage conditions, for example as a mean value.
In an embodiment, the respective energy level of the first and the second signal is optionally computed at a number of discrete frequencies via a Goertzel filter, a peak filter or a bandpass filter. As described above, the energy levels at the different frequencies can be reduced to a scalar driver response factor and thus be used to estimate the leakage condition.
In some embodiments, the driver response is calculated by applying to the first and the second signal a process which differentiates energy into at least two frequency bands, such as a frequency transformation.
In these embodiments, the detection engine is configured to acquire the first and the second signal over a specific measurement time and consequently perform a process such as applying peak filters or a Fourier Transformation on the acquired first and second signal, respectively. For example, a Discrete or a Fast Fourier Transformation is obtained by decomposing a sequence of values of the first and the second signal into components of different frequencies. For example, the process is applied across a frequency range.
The driver response is consequently calculated by means of comparing the respective obtained signals after applying the process to the first and the second signal. For example, the driver response is proportional to or is derived from a difference or ratio of the respective obtained signals. While this method increases the total amount of processing, it in addition provides a higher degree of accuracy to the calculation of the driver response.
In some embodiments, calculating the driver response further comprises determining a first value from applying the process to the first signal, determining a second value from applying the process to the second signal, and comparing the first value to the second value.
For example, the detection engine is configured to determine a characteristic value of the respective signals obtained after applying the process to the first and the second signal, such as a mean value or a maximum value, at a predetermined frequency or frequency range. Consequently, the driver response is calculated from the first value and the second value, e.g. from a ratio of the first value and the second value.
In some embodiments, the first and the second value are calculated as mean values from data points of respective frequency transformations of the first and the second signal.
The detection engine in these embodiments is configured to calculate a first mean value of the frequency transformation of the first signal, e.g. across the entire or a specific frequency range, and a second mean value of the frequency transformation of the second signal at the same frequency range. Consequently, the detection engine calculates the driver response from a ratio of said first and second mean values, for instance.
In some embodiments, the first and the second value are determined for predetermined frequencies or frequency ranges after applying the process to the first and the second signal.
Analogous to the case in which the driver response is calculated based on energy levels of the first and the second signal, the driver response can likewise be calculated from the values of the respective frequency transformation obtained at a number of distinct frequencies. The first and the second value can for example be mean values of characteristic values of the respective frequency transformation acquired at several frequencies or frequency ranges. For example, for estimating the leakage condition the driver response at different frequency intervals, such as a lower and an upper region of the acoustic frequency band, is of interest, since varying acoustic leakage significantly impacts said frequency intervals.
In some embodiments, estimating the leakage condition comprises determining a leakage value from the determined driver response.
A convenient way of describing the leakage condition is the determination of an actual leakage value that quantifies the acoustic leakage condition currently present. For example, the leakage value is calculated as a normalized value between 0 and 1 scaling the determined driver response to a predetermined maximum and/or minimum driver response. A leakage value of 0 indicates the smallest possible acoustic leakage or no leak and a leakage value of 1 indicates the largest acceptable acoustic leakage, i.e. if the playback device has a very large leak between the front volume and the ambient environment.
In some embodiments, the leakage value is determined by comparing the determined driver response to reference values in a lookup table.
The detection engine may comprise a lookup table, for example stored in a memory of the detection engine, wherein different values of the driver response are associated to corresponding leakage values. This way, the leakage value, and therefore the leakage condition, is determined without the need of further calculations based on the driver response.
In some embodiments, the leakage condition is determined if a ratio between the sound output from the speaker and the ambient noise ratio exceeds a set threshold.
In these embodiments, the leakage condition may only be determined via the driver response if the wanted signal is loud relative to, e.g. louder than, the ambient noise at the location of the error microphone. In other cases, the leakage condition can be determined via another means, e.g. conventional means.
In cases where the leakage condition is determined by another means, a translation method between the leakage derived from the driver response and the leakage determined by said other means may be necessary. This translation method may be a lookup table.
In some embodiments, the audio system further comprises a further microphone, and the leakage condition is used to adjust a feedforward filter and/or a feedback filter and/or a compensation filter of the audio system. In this embodiment, when the ratio of wanted signal to ambient noise is taken, the ambient noise level may be taken at the location of the further microphone.
Particularly in situations when the wanted signal, e.g. music, is loud relative to ambient noise, conventional methods to adjust noise cancellation processes, i.e. feedforward and/or feedback filter, may lead to an unstable noise cancellation process or to an oscillation around an optimal value, which may be perceived as disruptive by the user of the audio system. Therefore, adjusting the noise cancellation processes based on a leakage condition that is directly derived from the driver response provides a fast and accurate means in the aforementioned situations. Furthermore, a compensation filter may be adjusted in dependence of the leakage condition for compensating for a wanted signal, e.g. music, being attenuated by the feedback noise cancellation, for instance.
In some embodiments, the leakage condition is estimated when a ratio of a wanted signal to a disturbance signal, in particular an ambient noise signal, is larger than a threshold. Otherwise, the leakage condition is estimated via a different means. In embodiments, in which estimating the leakage condition comprises calculating a leakage value, leakage values calculated via different means can be translated to the same scale, e.g. normalized to a value between 0 and 1 via a predetermined lookup table.
The above-mentioned object is further solved by a signal processing method for an ear mountable playback device that comprises a speaker and an error microphone that senses sound being output from the speaker as well as ambient sound. The method comprises generating, by means of the error microphone, an error signal, and determining from the error signal and from a signal applied to the speaker a driver response. The method further comprises estimating a leakage condition from the determined driver response.
The error signal corresponds to or is derived from the signal detected by the error microphone, i.e. a wanted signal from the speaker such as music and ambient sound.
Further embodiments of the signal processing method become apparent to a person skilled in the art from the embodiments of the audio system described above.
The improved concept will be described in more detail in the following with the aid of drawings. Elements having the same or similar function bear the same reference symbols throughout the drawings. Hence their description is not necessarily repeated in the description to the following drawings.
In the drawings:
Depending on the type of ANC to be performed, the optional ambient noise microphone FF_MIC may be omitted, if only feedback ANC is performed. The error microphone FB_MIC may be used according to the improved concept to provide an error signal being the basis for a determination of the wearing condition, respectively leakage condition, of the headphone HP, when the headphone HP is worn by a user.
In the embodiment of
The headphone HP in this example features a loudspeaker SP, a feedback noise microphone FB_MIC and, optionally, an ambient noise microphone FF_MIC, which e.g. is designed as a feedforward noise cancellation microphone. Internal processing details of the headphone HP are not shown here for reasons of a better overview.
In the configuration shown in
If the ambient noise microphone FF_MIC is present, a fifth acoustic transfer function AFFM represents the acoustic sound path between the ambient sound source and the ambient noise microphone FF_MIC, and may be called an ambient-to-feedforward microphone response function.
Response functions or transfer functions of the headphone HP, in particular between the microphones FB_MIC and FF_MIC and the speaker SP, can be used with a feedback filter function B and feedforward filter function F, which may be parameterized as noise cancellation filters during operation.
The headphone HP as an example of the ear-mountable playback device may be embodied with both the microphones FB_MIC and FF_MIC being active or enabled such that hybrid ANC can be performed, or as a FB ANC device, where only the feedback noise microphone FB_MIC is active and an ambient noise microphone FF_MIC is not present or at least not active. Hence, in the following, if signals or acoustic transfer functions are used that refer to the ambient noise microphone FF_MIC, this microphone is to be assumed as present, while it is otherwise assumed to be optional.
Any processing of the microphone signals or any signal transmission are left out in
In the various embodiments, the FB or error microphone FB_MIC may be located in a dedicated cavity, as for example detailed in ams application EP17208972.4.
Referring now to
In a further implementation, not shown, a headphone HP, e.g. like that shown in
In the following, several implementations of the improved concept will be described in conjunction with a specific use case. It should however be apparent to the skilled person that details described for the implementation may still be applied to other implementations.
The total signal applied to the speaker SP and the error signal from the error microphone FB_MIC are further provided to the detection engine DET for determining the driver response and a subsequent estimation of the leakage condition. For example, the driver response is calculated from the two signals and subsequently evaluated and compared to known driver responses at different leakage conditions, e.g. stored in a lookup table, in order to determine a leakage value quantifying the actual leakage condition of the earphone. Consequently, the leakage value is used by the adaptation engine ADP to adjust a filter response of the feedforward filter F and/or the of the feedback filter B.
The hybrid system in this implementation further comprises an optional music compensation filter C as detailed in ams patent U.S. Pat. No. 9,779,718 B2. The wanted signal, e.g. music, in this case is provided to the music compensation filter C in order to compensate for the wanted signal being attenuated by the feedback noise cancellation, for instance.
The detection engine DET may be configured to evaluate the determined driver response and to compare it to the predetermined minimum and maximum driver responses at a frequency range or at several distinct frequencies. From this, a leakage value quantifying the leakage condition may be determined, for example as a normalized value between 0 and 1, with 0 indicating the minimum and 1 corresponding to the maximum leakage condition.
Number | Date | Country | Kind |
---|---|---|---|
19200528.8 | Sep 2019 | EP | regional |
The present application is the national stage entry of International Patent Application No. PCT/EP2020/075980, filed on Sep. 17, 2020, and published as WO 2021/063688 A1 on Apr. 8, 2021, which claims the benefit of priority of European Patent Application No. 19200528.8, filed on Sep. 30, 2019, all of which are incorporated by reference herein in their entireties.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/075980 | 9/17/2020 | WO |