The field of representative embodiments of this disclosure relates to audio signal processing methods and circuits that suppress ambient noise with a feed-forward filter, in which filter selection is made by classifying an acoustic environment of a noise-canceling system in order to adapt the adaptive noise-canceling system.
Personal audio devices, including personal communications devices are frequently operated in the vicinity of ambient noise sources, such as room noise, traffic noise, machinery noise, etc. Performance of such devices with respect to intelligibility of voice communications or program audio can be improved by providing noise-canceling using a microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events/noise.
Since the acoustic environment around the personal audio devices may change dramatically, depending on the sources of noise that are present and the position of the device itself, it is generally desirable to adapt the noise canceling to take into account such environmental changes. In particular, for earspeakers, the “fit” of the earspeakers to the user's ears may alter the performance of the noise canceling system significantly. Adaptive noise canceling circuits, in particular those that can adapt to both the ambient noise and the position of the device or fit of earspeakers, can be complex, consume additional power, and may generate undesirable results under certain circumstances, including instabilities due to changes in the acoustic environment. In order to provide effective noise-canceling, the latency of the anti-noise signal with respect to the reference source from the microphone also must be maintained at a minimal delay. Complex filtering and feedback systems typically introduce significant delay and are typically implemented as finite-impulse response (FIR) filters. Infinite-impulse response (IIR) filters have reduced power consumption and complexity, but their design and control is non-trivial and are subject to instabilities with minor variations of coefficients. Therefore, IIR filters are typically not used in ANC implementations.
Therefore, it would be advantageous to provide a low power audio processing system for a personal audio device that effectively cancels ambient noise, while adapting to changes in the acoustic environment of the device, including earspeaker fit and/or device positioning.
Reduced complexity/power of an adaptive noise-canceling system that adapts to changes in the acoustic environment of a personal audio device may be accomplished in systems and their methods of operation.
The adaptive noise-canceling system generates an anti-noise signal from a noise reference signal with a feed-forward filter that filters the noise reference signal to produce the anti-noise signal. The feed-forward filter has a first response controlled by a set of first coefficients. The adaptive noise-canceling system includes a measurement subsystem for measuring a characteristic of an acoustic environment of the adaptive noise-canceling system, a classifier for classifying the characteristic of the acoustic environment by analyzing an output of the measurement subsystem, and a controller that provides the set of first coefficients to the feed-forward filter in conformity with an output of the classifier. The controller may include a look-up table for providing sets of values of the first coefficients to the feed-forward filter in conformity with an indication provided from the classifier and corresponding to a classification of the characteristic of the acoustic environment of the adaptive noise-canceling system, so that the set of first coefficients is selected from a collection of sets of coefficients.
The summary above is provided for brief explanation and does not restrict the scope of the Claims. The description below sets forth example embodiments according to this disclosure. Further embodiments and implementations will be apparent to those having ordinary skill in the art. Persons having ordinary skill in the art will recognize that various equivalent techniques may be applied in lieu of, or in conjunction with, the embodiments discussed below, and all such equivalents are encompassed by the present disclosure.
The present disclosure encompasses adaptive noise-canceling (ANC) systems that generate an anti-noise signal from a noise reference signal with a feed-forward filter that filters the noise reference signal to produce the anti-noise signal. The feed-forward filter may have a first response controlled by a set of first coefficients. The adaptive noise-canceling system may include a measurement subsystem for measuring a characteristic of an acoustic environment of the adaptive noise-canceling system, a classifier for classifying the characteristic of the acoustic environment by analyzing an output of the measurement subsystem, and a controller that provides the set of first coefficients to the feed-forward filter in conformity with an output of the classifier. The controller may include a look-up table for providing sets of values of the first coefficients to the feed-forward filter in conformity with an indication provided from the classifier and corresponding to a classification of the characteristic of the acoustic environment of the adaptive noise-canceling system, so that the set of first coefficients is selected from a collection of sets of coefficients. The measurement subsystem may be an adaptive filter that models a secondary acoustic path extending from the output acoustic transducer of the ANC system through an error microphone that measures the output of the output acoustic transducer and ambient noise proximate the output acoustic transducer, so that the classifier classifies the acoustic environment of a user of a personal audio device, such as a mobile telephone, which is generally determined by the head shape and characteristics of one or more ear canals of the user, as well as the fit of earphones or position of a mobile telephone with respect to the ear of the user.
Referring now to
Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and systems that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R may be provided for measuring the ambient acoustic environment and positioned away from a typical position of a user's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, may be provided in order to further improve ANC operation by providing a measure of the ambient audio combined with the audio reproduced by speaker SPKR close to an ear 3 of the user, when wireless telephone 10 is in proximity to ear 3. A circuit 12 within wireless telephone 10 may include an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near-speech microphone NS, and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 14 containing the wireless telephone transceiver. In some embodiments of the disclosure, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit. In the depicted embodiments and other embodiments, the circuits and techniques disclosed herein may be implemented partially or fully in software and/or firmware embodied in computer-readable storage media and executable by a processor circuit or other processing device such as a microcontroller.
In general, the ANC techniques disclosed herein measure ambient acoustic events and noise (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on error microphone E and/or reference microphone R. The ANC processing circuits of illustrated wireless telephone 10 generate an anti-noise signal generated from the output of error microphone E and/or reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events present at error microphone E, although continuous and exact estimation of the required anti-noise signal is not a requirement of the disclosure. In particular, compensation for an acoustic path P that extends from reference microphone R to error microphone E may be performed adaptively and/or may be selected as a feed-forward filter response that is adapted to a particular user by measuring an acoustic environment of wireless telephone 10 that gives an indication of a “class” of user characteristics which permits selection of an appropriate response for the feed-forward filter. In feed-forward ANC systems, the feed-forward filter compensates for acoustic path P, combined with removing effects of an electro-acoustic path S that represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment, i.e., including the fit and head/ear characteristics of the user. Electro-acoustic path S is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, in particular, when wireless telephone 10 is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near-speech microphone N, other systems that do not include separate error and reference microphones may implement the above-described techniques. Alternatively, near-speech microphone N may be used to perform the function of the reference microphone R in the above-described system. Also, in personal audio devices designed only for audio playback, near-speech microphone N will generally not be included, and the near-speech signal paths in the circuits described in further detail below may be omitted without changing the scope of the disclosure.
The techniques disclosed herein may also be applied in purely noise-canceling systems that do not reproduce a playback signal or conversation using the output transducer, i.e., those systems that only reproduce an anti-noise signal, as long as the measurement of user characteristics may be obtained for classification, e.g., using a microphone and test intermittent signal, or using other sensing techniques for performing the measurement of ear fit and/or ear/head characteristics. As used in this disclosure, the terms “headphone” and “speaker” refer to any acoustic transducer intended to be mechanically held in place proximate to a user's ear canal and include, without limitation, earphones, earbuds, and other similar devices. As more specific examples, “earbuds” or “headphones” may refer to intra-concha earphones, supra-concha earphones and supra-aural earphones. Further, the techniques disclosed herein are applicable to other forms of acoustic noise canceling, and the term “transducer” includes headphone or speaker type transducers, but also other vibration generators such as piezo-electric transducers, magnetic vibrators such as motors, and the like. The term “sensor” includes microphones, but also includes vibration sensors such as piezo-electric films, and the like.
Referring now to
Referring now to
Referring now to
The coefficients in lookup table 42 may be custom-designed, or may be produced by any of the off-line design processes described in co-pending U.S. patent application Ser. No. 17/468,990 filed on Sep. 8, 2021 and entitled “ACTIVE NOISE CANCELLATION SYSTEM USING INFINITE IMPULSE RESPONSE FILTERING”, the disclosure of which is incorporated herein by reference. The sets of coefficients represent a reduced set of potential responses selectable for IIR Filter 40, which correspond to nominal users having different head and ear canal characteristics, i.e., to different classes of users, distinguished by those characteristics. As mentioned above, the input to classifier 46 may constitute a representation of a measured secondary acoustic path (S) response, which may be in terms of specific poles and zeros in the response of secondary path S, specific amplitudes and/or phases of the response at particular frequencies of interest, or other information that can specify the nominal user characteristics and phone position or earbud fit, as “features” of the measurement provided by measurement subsystem 44. Classifier 46 further reduces the representation to select the particular nominal user/class that is provided as an input to lookup table 42 to select the response of IIR filter 40, or an initial response in examples that provide for further adaptation of IIR filter 40.
Referring now to
Referring again additionally to
Referring now to
The coefficients provided by SE coefficient estimation block 62 to filter SE[z] 60 are also provided to a feature transformation block 52 that performs the above-described transformation of features that describe secondary path response S, i.e., the SE coefficients, or feature transformation block 52 may first decompose the coefficients into other descriptors such as poles/zeros or a map of amplitude/phase for different frequencies of interest, before transforming the descriptors into a reduced feature space. A similarity measure block 54 compares the transformed features with a set of nominal values stored in a memory 53 and provides the resultant indication to a master switching control block 58, which determines whether the SE path has changed sufficiently to require an update, and if so, provides a new index to lookup table 42 to select a response for IIR filter 40, based on the output of similarity measure block 54, if a similarity score exceeds a threshold value. The update process within master switching control block 58 detects changes in secondary path S by comparing an updated value of SE(z) using the similarity measure. If the updated SE(z) is sufficiently different over a validation time period, then the updated SE(z) is compared to the nominal SE(z) sets stored in memory 53 and if the similarity is low for all of the stored sets, the updated SE(z) is rejected as an invalid estimate and the coefficient set provided from lookup table 42 is not changed. Any similarity measures such as Euclidean distance, dot-product, correlation coefficient, and other similar measures of “fit” can be used to quantify the similarity between any of the transformed elements of the estimated secondary path response and transformed feature vector provided from a priori transformations of secondary path data. A smoothing block 43A smooths the values provided from lookup table 42 as updates are made, to reduce artifacts and instabilities that might otherwise be caused by switching coefficient sets.
Referring now to
Referring now to
As mentioned above, portions of the disclosed processes may be carried out by the execution of a collection of program instructions forming a computer program product stored on a non-volatile memory, but that also exist outside of the non-volatile memory in tangible forms of storage forming a computer-readable storage medium. The computer-readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. Specific examples of the computer-readable storage medium include the following: a hard disk, semiconductor volatile and non-volatile memory devices, a portable compact disc read-only memory (CD-ROM) or a digital versatile disk (DVD), a memory stick, a floppy disk or other suitable storage device not specifically enumerated. A computer-readable storage medium, as used herein, is not to be construed as being transitory signals, such as transmission line or radio waves or electrical signals transmitted through a wire. It is understood that blocks of the block diagrams described above may be implemented by computer-readable program instructions executed by a digital signal processor (DSP) or other processor that executes computer-readable program instructions. These computer readable program instructions may also be stored in other storage forms as mentioned above and may be downloaded into a non-volatile memory for execution therefrom. However, the collection of instructions stored on media other than system non-volatile memory described above also form a computer program product that is an article of manufacture including instructions which implement aspects of the functions/actions specified in the block diagram block or blocks.
In summary, this disclosure shows and describes adaptive noise-canceling circuits, systems and methods of operation of the systems and circuits that generates an anti-noise signal from a noise reference signal. The adaptive noise-canceling systems may include a feed-forward filter for filtering the noise reference signal to produce the anti-noise signal, and the feed-forward filter may have a first response controlled by a set of first coefficients. The adaptive noise-canceling systems may include a measurement subsystem for measuring a characteristic of an acoustic environment of the adaptive noise-canceling system, a classifier for classifying the characteristic of the acoustic environment of the adaptive noise-canceling system by analyzing an output of the measurement subsystem, and a controller for providing the set of first coefficients to the feed-forward filter in conformity with an output of the classifier.
In some example embodiments, the feed-forward filter may be an infinite impulse response (IIR) filter and the characteristic of the acoustic environment may include a fit of a headset that generates an acoustic output including the anti-noise signal. In some example embodiments, the controller may include a look-up table for providing sets of values of the first coefficients to the feed-forward filter in conformity with an indication provided from the classifier and corresponding to a classification of the characteristic of the acoustic environment of the adaptive noise-canceling system, so that the set of first coefficients is selected from a collection of sets of coefficients. In some example embodiments, the measurement subsystem may include an adaptive filter for measuring the characteristic of the acoustic environment and providing a second response descriptive of the characteristic of the acoustic environment of the system, and the classifier may generate the indication from a classification applied to the second response of the adaptive filter. The classifier may apply a linear discriminant analysis or may apply a singular value discrimination analysis to the response of the adaptive filter to generate the indication provided to the look-up table. In some example embodiments, the controller may further perform smoothing on the first coefficients in response to a change in the output of the classifier causing an update of the first coefficients. In some example embodiments, wherein the feed-forward filter may include a fixed first portion of the feed-forward filter for providing a fixed first partial response and an adaptive second portion of the feed-forward filter responsive to the set of first coefficients, and the fixed portion and the adaptive portion of the feed-forward filter may either be coupled either in series or in parallel between an input that receives the noise reference signal and an output of the adaptive noise-canceling system.
In some example embodiments, the adaptive noise-canceling system may further include a reference input electroacoustic transducer for generating the noise reference signal according to noise present in the acoustic environment of the system and an output electroacoustic transducer for generating an acoustic output including the anti-noise signal from a transducer input signal in the acoustic environment of the adaptive noise-canceling system. The adaptive noise-canceling system may further include an error input electroacoustic transducer for generating an error signal according to the acoustic output from the output electroacoustic transducer and ambient noise, and the adaptive filter may be responsive to the error signal to provide the second response describing the characteristic of the acoustic environment as a second response modeling a secondary acoustic path from the output of the output electroacoustic transducer to the error input electroacoustic transducer. In some example embodiments, the adaptive noise-canceling system may include a convergence evaluator for determining whether or not the second response provided by the adaptive filter is in a stable condition, and the classifier may the second response of the adaptive filter in response to the convergence evaluator determining that the second response provided by the adaptive filter is in a stable condition. In some example embodiments, the classifier may transform the second response modeling the secondary acoustic path to a lower-dimensional subspace of parameters, such that the controller may generate the set of first coefficients from the parameters.
In some example embodiments, the adaptive noise-canceling system may further include a source of audio information for reproduction by the output electroacoustic transducer and a first combiner that combines the program audio with the anti-noise signal to provide the transducer input signal. In some example embodiments, the adaptive noise-canceling system may further include a second combiner that removes the program audio from the output of the adaptive filter to generate the error signal, such that the classifier may classify the second coefficients of the response of the adaptive filter modeling the secondary acoustic path from the acoustic output of the output electroacoustic transducer to an output of the error input electroacoustic transducer and may apply the classification to predict a required first response of the feed-forward filter.
In some example embodiments, the look-up table may include a first look-up table that receives coefficients of the second response descriptive of the acoustic environment of the system as a first indication as an input and provides a second indication corresponding to one of multiple type classifications for the characteristic of the acoustic environment of the system as an output, and a second look-up table that receives the second indication from the first look-up table and provides the first coefficients to the feed-forward filter in conformity with the second indication. In some example embodiments, the adaptive noise-canceling system may include a residual noise evaluator that provides a third indication that indicates an effectiveness of the first response of the feed-forward filter in causing cancelation of ambient noise, and the second indication may be further adjusted in conformity with the third indication to provide the first coefficients to the feed-forward filter. The residual noise evaluator may compare an energy of the error signal to an energy of the noise reference signal to generate the third indication.
It should be understood, especially by those having ordinary skill in the art with the benefit of this disclosure, that the various operations described herein, particularly in connection with the figures, may be implemented by other circuitry or other hardware components. The order in which each operation of a given method is performed may be changed, and various elements of the systems illustrated herein may be added, reordered, combined, omitted, modified, etc. It is intended that this disclosure embrace all such modifications and changes and, accordingly, the above description should be regarded in an illustrative rather than a restrictive sense. Similarly, although this disclosure makes reference to specific embodiments, certain modifications and changes may be made to those embodiments without departing from the scope and coverage of this disclosure. Moreover, any benefits, advantages, or solutions to problems that are described herein with regard to specific embodiments are not intended to be construed as a critical, required, or essential feature or element.
While the disclosure has shown and described particular embodiments of the techniques disclosed herein, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the disclosure. For example, the disclosed system may be used to cancel vibration or other non-audio frequency noise.
Number | Name | Date | Kind |
---|---|---|---|
8645444 | Clemow et al. | Feb 2014 | B2 |
8718291 | Alves et al. | May 2014 | B2 |
8908877 | Milani et al. | Dec 2014 | B2 |
9106989 | Li et al. | Aug 2015 | B2 |
9224382 | Clemow | Dec 2015 | B2 |
9711130 | Hendrix et al. | Jul 2017 | B2 |
10431198 | Magrath et al. | Oct 2019 | B2 |
20100061564 | Clemow et al. | Mar 2010 | A1 |
20180061391 | Ibrahim | Mar 2018 | A1 |
20240007802 | Guo | Jan 2024 | A1 |
Number | Date | Country |
---|---|---|
2455828 | Jun 2009 | GB |
Entry |
---|
U.S. Patent Application: “Active Noise Cancellation System Using Infinite Impulse Response Filtering”, U.S. Appl. No. 17/468,990, filed Sep. 8, 2021. (32 pgs. In pdf). |
U.S. Patent Application: “Adaptive Noise-Canceling With Dynamic Filter Selection Based on Multiple Noise Sensor Signal Phase Differences”, U.S. Appl. No. 17/875,364, filed Jul. 27, 2022. (42 pgs. in pdf). |
Number | Date | Country | |
---|---|---|---|
20240013765 A1 | Jan 2024 | US |