Various audio devices incorporate active noise reduction (ANR) features, also known as active noise control or cancellation (ANC), in which one or more microphones detect sound, such as exterior acoustics captured by a feedforward microphone or interior acoustics captured by a feedback microphone. Signals from a feedforward microphone and/or a feedback microphone are processed to provide anti-noise signals to be fed to an acoustic transducer (e.g., a speaker, driver) to counteract noise that may otherwise be heard by a user. Feedback microphones pick up acoustic signals produced by the driver, and thereby form a closed loop system that could become unstable at times or under certain conditions. Various audio systems that may provide feedback noise reduction include, for example, headphones, earphones, headsets and other portable or personal audio devices, as well as automotive systems to reduce or remove engine and/or road noise, office or environmental acoustic systems, and others. In various situations it is therefore desirable to detect when a condition of feedback instability exists.
All examples and features mentioned below can be combined in any technically possible way.
In one aspect, a playback audio signal is combined with a feedback signal from a feedback microphone to provide a first combined signal. The first combined signal is filtered with a feedback filter to provide a driver command signal. The driver command signal is provided to an acoustic transducer for transduction to acoustic energy. The first combined signal is compared with the feedback signal to detect a feedback instability based upon the comparison.
Implementations may include one of the following features, or any combination thereof.
In some implementations, combining the playback audio signal with the feedback signal includes filtering the playback audio signal with an equalization filter to provide a filtered playback signal and combining the filtered playback signal with the feedback signal to provide the first combined signal.
In certain implementations, combining the playback audio signal with the feedback signal includes: (i) filtering a feedforward signal from a feedforward microphone with an aware mode filter to provide an aware mode signal; and (ii) combining the aware mode signal, the filtered playback signal, and the feedback signal to provide the first combined signal.
In some cases, combining the playback signal with the feedback signal includes: (i) filtering the feedforward signal with a feedforward filter to provide a feedforward noise cancellation signal; and (ii) combining the feedforward noise cancellation signal, the aware mode signal, and the filtered playback signal with the feedback signal to provide the first combined signal.
In certain cases, combining the playback signal with the feedback signal includes: (i) combining the feedforward noise cancellation signal, the aware mode signal, and the filtered playback signal to provide a second combined signal; and (ii) combining the second combined signal with the feedback signal to provide the first combined signal.
In some examples, in response to detecting the feedback instability, the driver command signal is filtered with a first notch filter to provide a filtered driver command signal, and the filtered driver command signal is provided to an acoustic transducer for transduction to acoustic energy.
In certain examples, in response to detecting the feedback instability, the playback audio signal is filtered with a second notch filter.
In some implementations the steps of combining the playback audio signal with the feedback signal and filtering the first combined signal with the feedback filter are performed on a first processing component and the step of comparing the first combined signal with the feedback signal to detect the feedback instability is performed on a second processing component.
In another aspect, a playback audio signal is filtered with an equalization filter to provide a filtered playback signal. A feedforward signal from a feedforward microphone is filtered with an aware mode filter to provide an aware mode signal. The aware mode signal and the filtered playback signal are combined to provide a first combined signal. The feedforward signal is filtered with a feedforward filter to provide a feedforward noise cancellation signal. The feedforward noise cancellation signal and the first combined signal are combined to provide a second combined signal. The second combined signal is combined with a feedback signal from a feedback microphone to provide a third combined signal. The third combined signal is filtered with a feedback filter to provide a driver command signal. The driver command signal is provided to an acoustic transducer for transduction to acoustic energy. The third combined signal is compared with the feedback signal to detect a feedback instability based upon the comparison.
Implementations may include one of the above and/or below features, or any combination thereof.
According to another aspect, a feedback signal from a feedback microphone is filtered with a feedback noise cancellation filter to provide a feedback noise cancellation signal the feedback noise cancellation signal being related to the feedback signal by a first transfer function. A playback audio signal is combined with the feedback noise cancellation signal to provide a driver command signal. The driver command signal is provided to an acoustic transducer for transduction to acoustic energy. The driver command signal is filtered with a first inverse filter to provide a reference signal, the first inverse filter being configured to have a second transfer function that is the inverse of the first transfer function. The feedback noise cancellation signal is filtered with a second inverse filter to provide an estimate of the feedback signal, the second inverse filter being configured to have a third transfer function that is the inverse of the first transfer function. The reference signal is compared with the estimate of the feedback signal to detect a feedback instability based upon the comparison.
Implementations may include one of the above and/or below features, or any combination thereof.
In some implementations, combining a playback audio signal with the feedback noise cancellation signal includes filtering the playback audio signal with an equalization filter to provide a filtered playback signal and combining the filtered playback signal with the feedback noise cancellation signal to provide the driver command signal.
In certain implementations, combining the playback audio signal with the feedback noise cancellation signal includes: (i) filtering a feedforward signal from a feedforward microphone with an aware mode filter to provide an aware mode signal; and (ii) combining the aware mode signal, the filtered playback signal, and the feedback noise cancellation signal to provide the driver command signal.
In some examples, combining the playback signal with the feedback noise cancellation signal includes filtering the feedforward signal with a feedforward filter to provide a feedforward noise cancellation signal and combining the feedforward noise cancellation signal, the aware mode signal, and the filtered playback signal with the feedback noise cancellation signal to provide the driver command signal.
In certain examples, combining the playback signal with the feedback noise cancellation signal includes: (i) combining the feedforward noise cancellation signal, the aware mode signal, and the filtered playback signal to provide a first combined signal; and (ii) combining the first combined signal with the feedback noise cancellation signal to provide the driver command signal.
In some implementations, in response to detecting the feedback instability, the feedback noise cancellation signal is filtered with a first notch filter to provide a filtered feedback noise cancellation signal.
In certain implementations, in response to detecting the feedback instability, the playback audio signal is filtered with a second notch filter.
In some cases, the steps of filtering the feedback signal and combining the playback audio signal with the feedback noise cancellation signal are performed on a first processing component and the steps of filtering the driver command signal with the first inverse filter; filtering the feedback noise cancellation signal with the second inverse filter; and comparing the reference signal with the estimate of the feedback signal are performed on a second processing component.
In yet another aspect, a playback audio signal is filtered with an equalization filter to provide a filtered playback signal. A feedforward signal from a feedforward microphone is filtered with an aware mode filter to provide an aware mode signal. The aware mode signal and the filtered playback signal are combined to provide a first combined signal. The feedforward signal is filtered with a feedforward filter to provide a feedforward noise cancellation signal. The feedforward noise cancellation signal and the first combined signal are combined to provide a second combined signal. A feedback signal from a feedback microphone is filtered with a feedback noise cancellation filter to provide a feedback noise cancellation signal. The feedback noise cancellation signal is related to the feedback signal by a first transfer function. The second combined signal is combined with the feedback noise cancellation signal to provide a driver command signal. The driver command signal is provided to an acoustic transducer for transduction to acoustic energy. The driver command signal is filtered with a first inverse filter to provide a reference signal. The first inverse filter is configured to have a second transfer function that is the inverse of the first transfer function. The feedback noise cancellation signal is filtered with a second inverse filter to provide an estimate of the feedback signal. The second inverse filter is configured to have a third transfer function that is the inverse of the first transfer function. The reference signal is compared with the estimate of the feedback signal to detect a feedback instability based upon the comparison.
Implementations may include one of the above features, or any combination thereof.
Still other aspects, examples, and advantages of these exemplary aspects and examples are discussed in detail below. Examples disclosed herein may be combined with other examples in any manner consistent with at least one of the principles disclosed herein, and references to “an example,” “some examples,” “an alternate example,” “various examples,” “one example” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least one example. The appearances of such terms herein are not necessarily all referring to the same example.
Various aspects of at least one example are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and examples, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, identical or nearly identical components illustrated in various figures may be represented by identical or similar numerals. For purposes of clarity, not every component may be labeled in every figure. In the figures:
Aspects of the present disclosure are directed to noise cancelling headphones, headsets, or other audio systems, and methods, that detect instability in the noise canceling system. Noise cancelling systems operate to reduce acoustic noise components heard by a user of the audio system. Noise cancelling systems may include feedforward and/or feedback characteristics. A feedforward component detects noise external to the headset (e.g., via an external microphone) and acts to provide an anti-noise signal to counter the external noise expected to be transferred through to the user's ear. A feedback component detects acoustic signals reaching the user's ear (e.g., via an internal microphone) and processes the detected signals to counteract any signal components not intended to be part of the user's acoustic experience. Examples disclosed herein may be coupled to, or placed in connection with, other systems, through wired or wireless means, or may be independent of any other systems or equipment.
The systems and methods disclosed herein may include or operate in, in some examples, headsets, headphones, hearing aids, or other personal audio devices, as well as acoustic noise reduction systems that may be applied to home, office, or automotive environments. Throughout this disclosure the terms “headset,” “headphone,” “earphone,” and “headphone set” are used interchangeably, and no distinction is meant to be made by the use of one term over another unless the context clearly indicates otherwise. Additionally, aspects and examples in accord with those disclosed herein are applicable to various form factors, such as in-ear transducers or earbuds and on-ear or over-ear headphones, and others.
Examples disclosed may be combined with other examples in any manner consistent with at least one of the principles disclosed herein, and references to “an example,” “some examples,” “an alternate example,” “various examples,” “one example” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least one example. The appearances of such terms herein are not necessarily all referring to the same example.
It is to be appreciated that examples of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other examples and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
For various components described herein, a designation of “a” or “b” in the reference numeral may be used to indicate “right” or “left” versions of one or more components. When no such designation is included, the description is without regard to the right or left and is equally applicable to either of the right or left, which is generally the case for the various examples described herein. Additionally, aspects and examples described herein are equally applicable to monaural or single-sided personal acoustic devices and do not necessarily require both of a right and left side.
While the reference numerals 106 and 108 are used to refer to one or more microphones, the visual elements illustrated in the figures may, in some examples, represent an acoustic port wherein acoustic signals enter to ultimately reach such microphones, which may be internal and not physically visible from the exterior. In examples, one or more of the microphones 106, 108 may be immediately adjacent to the interior of an acoustic port or may be removed from an acoustic port by a distance and may include an acoustic waveguide between an acoustic port and an associated microphone.
Shown in
In some implementations, the headphone 100 can include a feature that may be referred to as “aware mode.” In some cases, this feature may also be called “hear-through” mode, “talk-through” mode, or “pass-through” mode. In such a mode, the feedforward microphone 106 or other detection means can be used to detect external sounds that the user might want to hear, and the ANR system can be configured to pass such sounds through to be reproduced by the driver 110. In some cases, the sensor used for the aware mode feature can be a sensor, such as a microphone, that is separate from the feedforward microphone 106.
In some implementations, the ANR system can allow a user to control the amount of ambient noise passed through the device while maintaining ANR functionalities, such as described in U.S. Pat. No. 10,096,313 which is incorporated herein by reference in its entirety. For example, to enable a user to control the amount of ambient noise passed through the device, an adjustable gain may be implemented, such as by selecting a set of coefficients for an aware mode filter 318. Alternatively or additionally, an adjustable gain may be implemented using a variable gain amplifier (not shown) arranged in series with the aware mode filter 318. In some cases, an adjustable gain may be implemented using a combination of adjustments to a variable gain amplifier (not shown) and the aware mode filter 318, each disposed in the aware mode signal flow path.
In the example illustrated in
The electrical and physical system shown in
When the loop transfer function, GsdKfb, becomes equal to unity, GsdKfb=1, at one or more frequencies, the loop system may diverge, causing at least one frequency component of the driver signal 316 to progressively increase in amplitude. This may be perceived by the user as an audible artifact, such as a tone or squealing, and may reach a limit at a maximum amplitude the driver 110 is capable of producing, which may be extremely loud. Accordingly, when such a condition exists, the feedback noise reduction system may be described as unstable.
To detect an impending squeal/instability, the prior art system of
The comparison operations are off loaded to the generalpurposeDSP 210. First, the signals are each filtered via respective high-pass filters 330a, 330b. Then, a sum and a difference are calculated for those high-pass filtered signals. The sum and difference signals are then squared 332a, 332b and smoothed 334a, 334b. Finally, the smoothed squared sum (SSS) and the smoothed squared difference (SSD) are compared. In one specific example, instability is detected when the following two conditions are satisfied:
SSS>−15 dB; and
SSS/SSD>9 dB for 2 milliseconds (ms)
If an instability is detected, a notch filter 336 is activated, which reduces the gain of the controller in a sensitive frequency region so that the whole system will be stable even if the nozzle is blocked. When the system is stable, the feedback notch filter 336 operates as a simple pass-through filter. The system also includes a second notch filter 338.
Because the aware mode signal 320 and the equalized audio signal 315 are injected after the feedback filter 312, the feedback filter 312 is actually trying to reject the playback signal 315 and aware mode content (input audio). The equalization filter 313 is designed to account for the fact that the controller is naturally trying to reject that input. Simply put, the equalization filter 313 essentially boosts the gain until the sound is right. However, when the feedback filter 312 is effectively changed by activating the feedback notch filter 336 the input audio path needs to be modified to account for that change, and that is the function of the second notch filter 338.
There are two undesirable aspects of this existing system. First, the inverse feedback filter 326 must be the same size as the feedback filter 312—it has the same number of biquads. Unfortunately, there are a limited number of instructions that can fit on the fast processor 208, and it may be preferable to use those instructions for other things. Second, when an instability is detected and the notch filter 336 is added to the to the controller, the transfer function, Kfb, of the feedback filter is effectively changed. As a result, the filtered driver signal 328 is no longer valid as a detection signal because it relied on Kfb−1, which is not updated to match the change to Kfb when the notch filter 336 is added. The transfer function, Kfb−1, of the inverse feedback filter 326 could also be updated when the notch filter 336 is added, but that would require using up more instructions.
The second benefit is that because the detection is not influenced by the feedback filter 312 it should still be valid even when the feedback filter 312 is effectively changed via activation of the feedback notch filter 336. That is, because the reference signal 402 is tapped before it goes through the feedback filter 312, changing the effective transfer function of the feedback filter 312 does not change the meaning of the signal 402. So, the reference signal 402 can still usefully be compared to the feedback microphone signal 310.
All of the processing for the comparison remains the same, only the reference signal 402 is different. Operations are rearranged in the fastDSP 208 so that equivalent signals can be obtained without having to use the extra inverse feedback filter 326. The change to the command injection point does not change anything that is running in the generalpurposeDSP 210.
All of the processing for the comparison remains essentially the same except for the addition of the inverse feedback filters 502a, 502b in the processing path on the slow (general purpose) processor.
The above-described aspects and examples provide numerous potential benefits to a personal audio device that includes feedback noise reduction. Stability criteria for feedback control may be defined by an engineer at the controller design stage, and various considerations assume a limited range of variation (of system characteristics) over the lifetime of the system. For example, driver output and microphone sensitivity may vary over time and contribute to the electroacoustic transfer function between the driver and the feedback microphone. Further variability may impact design criteria, such as production variation, head-to-head variation, variation in user handling, and environmental factors. Any such variations may cause stability constraints to be violated, and designers must conventionally take a conservative approach to feedback system design to ensure that instability is avoided. Such an instability may cause the noise reduction system to add undesired signal components rather than reduce them, thus conventional design practices may take highly conservative approaches to avoid an instability occurring, potentially at severe costs to system performance.
However, aspects and examples of detecting feedback instability, as described herein, allow corrective action to be taken to remove the instability when such condition occurs, allowing system designers to design systems that operate under conditions nearer to a boundary of instability, and thus achieve improved performance over a wider feedback bandwidth. Aspects and examples herein allow reliable detection if or when the instability boundary is crossed. For example, in an in-ear noise cancelling headphone, a user's handling may commonly block the “nozzle” of an earbud (e.g., a finger momentarily covering the audio port), which may cause an extreme physical change to the electroacoustic coupling between the driver and the feedback microphone. Conventional systems need to be designed to avoid instability even with a blocked nozzle, but instability detection in accord with aspects and examples described herein allow the feedback controller or processor to be designed without the “blocked nozzle” condition as a constraint. Accordingly, systems and methods herein may more than double the range of bandwidth in which noise reduction by a feedback processor may be effective.
In various examples, any of the functions of the systems and methods described herein may be implemented or carried out in a digital signal processor (DSP), a microprocessor, a logic controller, logic circuits, and the like, or any combination of these, and may include analog circuit components and/or other components with respect to any particular implementation. Functions and components disclosed herein may operate in the digital domain and certain examples include analog-to-digital (ADC) conversion of analog signals generated by microphones, despite the lack of illustration of ADC's in the various figures. Such ADC functionality may be incorporated in or otherwise internal to a signal processor. Any suitable hardware and/or software, including firmware and the like, may be configured to carry out or implement components of the aspects and examples disclosed herein, and various implementations of aspects and examples may include components and/or functionality in addition to those disclosed.
Having described above several aspects of at least one example, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.
A number of implementations have been described. Nevertheless, it will be understood that additional modifications may be made without departing from the scope of the inventive concepts described herein, and, accordingly, other implementations are within the scope of the following claims.
Number | Name | Date | Kind |
---|---|---|---|
10244306 | Ku | Mar 2019 | B1 |
10540954 | Kumar et al. | Jan 2020 | B2 |
10748521 | Mulvey et al. | Aug 2020 | B1 |
10964304 | Barnes | Mar 2021 | B2 |
Entry |
---|
International Search Report and Written Opinion dated Dec. 5, 2023 for International Application No. PCT/US2023/029427. |
Hober Sven et al.: “Real.—Time Detection of Unstable Control. Loop Behavior in a Feedback Active Noise Cancellation System for In-Ear Headphones”, A—A Engineering (Eng), [Online] vol. 07, No. 12, Dec. 17, 2015 (Dec. 17, 2015) , pp. 796-802, XP093102150, ISSN: 1947-3931, DOI: 10.4236/eng.2015.712069 Retrieved from the Internet: URL: https://www.scirp.org/pdf/ENG_2015121717451889.pdf> [retrieved on Nov. 16, 2023] abstract pp. 796-802. |
Number | Date | Country | |
---|---|---|---|
20240046910 A1 | Feb 2024 | US |