Power management of adaptive noise cancellation (ANC) in a personal audio device

Information

  • Patent Grant
  • 9230532
  • Patent Number
    9,230,532
  • Date Filed
    Tuesday, March 12, 2013
    11 years ago
  • Date Issued
    Tuesday, January 5, 2016
    8 years ago
Abstract
A personal audio device, such as a wireless telephone, includes an adaptive noise canceling (ANC) circuit that adaptively generates an anti-noise signal from an output of a microphone that measures ambient audio. The anti-noise signal is combined with source audio to provide an output for a speaker. The anti-noise signal causes cancellation of ambient audio sounds that appear at the microphone. A processing circuit estimates a level of background noise from the microphone output and sets a power conservation mode of the personal audio device in response to detecting that the background noise level is lower than a predetermined threshold.
Description
BACKGROUND OF THE INVENTION

1. Field of the Invention


The present invention relates generally to personal audio devices such as headphones that include adaptive noise cancellation (ANC), and, more specifically, to power management in an ANC system.


2. Background of the Invention


Wireless telephones, such as mobile/cellular telephones, cordless telephones, and other consumer audio devices, such as MP3 players, are in widespread use. Performance of such devices with respect to intelligibility can be improved by providing adaptive noise canceling (ANC) using a reference microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events.


Since personal devices such as those described above are generally battery-powered, power management of features within the device are needed in order to extend battery life. Further, reduction of power consumption of electronic devices is desirable in general. Therefore, it would be desirable to provide a personal audio device, including a wireless telephone, which provides noise cancellation in which the noise cancellation features are power-managed.


SUMMARY OF THE INVENTION

The above-stated objectives of providing power management of noise cancellation features in a personal audio device is accomplished in a personal audio system, a method of operation, and an integrated circuit.


The personal audio device includes an output transducer for reproducing an audio signal that includes both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer. The personal audio device also includes the integrated circuit to provide adaptive noise canceling (ANC) functionality. The method is a method of operation of the personal audio system and integrated circuit. A microphone is mounted on the device housing to provide a microphone signal indicative of the ambient audio sounds. The personal audio system further includes an ANC processing circuit for adaptively generating the anti-noise signal from the microphone signal using an adaptive filter, such that the anti-noise signal causes substantial cancellation of the ambient audio sounds. The ANC processing circuit further estimates a background noise level from the microphone signal and sets a power conservation mode of the personal audio device in response to detecting that the background noise level is lower than a predetermined threshold.


The foregoing and other objectives, features, and advantages of the invention will be apparent from the following, more particular, description of the preferred embodiment of the invention, as illustrated in the accompanying drawings.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is an illustration of an exemplary wireless telephone 10.



FIG. 2 is a block diagram of circuits within wireless telephone 10.



FIG. 3 is a block diagram depicting signal processing circuits and functional blocks of an exemplary circuit that can be used to implement ANC circuit 30 of CODEC integrated circuit 20 of FIG. 2.



FIG. 4 is a block diagram depicting an example of details of exemplary background noise estimator 35 and power manager 39 within ANC circuit 30 of FIG. 3.



FIG. 5 is a signal waveform diagram illustrating operation of background noise estimator 35 of FIG. 4.



FIG. 6 is a block diagram depicting signal processing circuits and functional blocks within CODEC integrated circuit 20.





DESCRIPTION OF ILLUSTRATIVE EMBODIMENT

Noise-canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone, are disclosed. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates a signal that is injected into the speaker (or other transducer) output to cancel ambient acoustic events. The ANC circuit also estimates the background noise level, and when the background noise level is below a threshold, the ANC circuit sets a power conservation mode of the personal audio device, conserving energy when ANC operation is not required.



FIG. 1 shows an exemplary wireless telephone 10 in proximity to a human ear 5. Illustrated wireless telephone 10 is an example of a device in which techniques illustrated herein may be employed, but it is understood that not all of the elements or configurations embodied in illustrated wireless telephone 10, or in the circuits depicted in subsequent illustrations, are required. Wireless telephone 10 includes a transducer, such as speaker SPKR, that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, near-end speech, sources from web-pages or other network communications received by wireless telephone 10 and audio indications such as battery low and other system event notifications. A near-speech microphone NS is provided to capture near-end speech, which is transmitted from wireless telephone 10 to the other conversation participant(s).


Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment and is positioned away from the typical position of a user/talker's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio signal reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS, and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other implementations, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.


In general, the ANC techniques disclosed herein measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events present at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z). Electro-acoustic path S(z) represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment. Electro-acoustic path S(z) is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone 10 is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near speech microphone NS, other systems that do not include separate error and reference microphones can implement the above-described techniques. Alternatively, near speech microphone NS can be used to perform the function of the reference microphone R in the above-described system. Finally, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below can be omitted.


Referring now to FIG. 2, circuits within wireless telephone 10 are shown in a block diagram. CODEC integrated circuit 20 includes an analog-to-digital converter (ADC) 21A for receiving the reference microphone signal and generating a digital representation ref of the reference microphone signal, an ADC 21B for receiving the error microphone signal and generating a digital representation err of the error microphone signal, and an ADC 21C for receiving the near speech microphone signal and generating a digital representation of near speech microphone signal ns. CODEC IC 20 generates an output for driving speaker SPKR or headphones from an amplifier A1, which amplifies the output of a digital-to-analog converter (DAC) 23 that receives the output of a combiner 26. Combiner 26 combines audio signals is from internal audio sources 24, the anti-noise signal anti-noise generated by an ANC circuit 30, which by convention has the same polarity as the noise in reference microphone signal ref and is therefore subtracted by combiner 26. Additionally, combiner 26 also combines a portion of near speech signal ns so that the user of wireless telephone 10 hears their own voice in proper relation to downlink speech ds, which is received from a radio frequency (RF) integrated circuit 22. In the exemplary circuit, downlink speech ds is provided to ANC circuit 30. The downlink speech ds and internal audio is are provided to combiner 26 to provide source audio (ds+ia), so that source audio (ds+ia) may be presented to estimate acoustic path S(z) with a secondary path adaptive filter within ANC circuit 30. Near speech signal ns is also provided to RF integrated circuit 22 and is transmitted as uplink speech to the service provider via antenna ANT. ANC circuit 30 includes features to measure the ambient background noise, and determine when a low-power or power-down mode may be set for at least a portion of ANC circuit 30. Further, ANC circuit 30 provides a control signal power down that may be used to signal to other circuits within personal audio device 10 that ANC circuit 30 has determined that ANC operation is not needed. For example, control signal power down might be used to control an operational state of ADC 21B that provides error microphone signal err, during times that reference microphone signal ref indicates that the background noise level is low and ANC operation is halted.


Referring now to FIG. 3, details of ANC circuit 30 are shown. An adaptive filter 32 receives reference microphone signal ref and under ideal circumstances, adapts its transfer function W(z) to be P(z)/S(z) to generate anti-noise signal anti-noise, which is provided to an output combiner that combines the anti-noise signal with the audio to be reproduced by speaker SPKR, as exemplified by combiner 26 of FIG. 2. The coefficients of adaptive filter 32 are controlled by a W coefficient control block 31 that uses a correlation of two signals to determine the response of adaptive filter 32, which generally minimizes the error, in a least-mean squares sense, between those components of reference microphone signal ref present in error microphone signal err. The signals processed by W coefficient control block 31 are reference microphone signal ref shaped by a copy of an estimate of the response of path S(z) (i.e., response SECOPY(z)) provided by a filter 34B and another signal that includes error microphone signal err. By transforming reference microphone signal ref with a copy of the estimate of the response of path S(z), response SECOPY(z), and minimizing error microphone signal err after removing components of error microphone signal err due to playback of source audio, adaptive filter 32 adapts to the desired response of P(z)/S(z).


In addition to error microphone signal err, the other signal processed along with the output of filter 34B by W coefficient control block 31 includes an inverted amount of the source audio (ds+ia), which is processed by a filter 34A having response SE(z), of which response SECOPY(z) is a copy. Filter 34B is not an adaptive filter, per se, but has an adjustable response that is tuned to match the response of adaptive filter 34A, so that the response of filter 34B tracks the adapting of adaptive filter 34A. To implement the above, adaptive filter 34A has coefficients controlled by an SE coefficient control block 33. Adaptive filter 34A processes source audio (ds+ia), to provide a signal representing the expected source audio delivered to error microphone E. Adaptive filter 34A is thereby adapted to generate a signal from source audio (ds+ia), that when subtracted from error microphone signal err, forms an error signal e containing the content of error microphone signal err that is not due to source audio (ds+ia). A combiner 36 removes the filtered source audio (ds+ia) from error microphone signal err to generate error signal e. By removing an amount of source audio that has been filtered by response SE(z), adaptive filter 32 is prevented from adapting to the relatively large amount of source audio present in error microphone signal err.


Within ANC circuit 30, a background noise estimator 35 determines a value corresponding to a background noise level present in reference microphone signal ref. Alternatively other microphone signals could be used as input to background noise estimator 35, such as the outputs of near speech microphone ns or error microphone err. However, reference microphone ref will generally not be occluded by a listener's ear as will error microphone err, and will have less near speech content than near speech microphone ns, and as will be seen below, the background noise level estimate should not include near speech components. A near speech detector 37, which may be the voice activity detector (VAD) used for other purposes within wireless telephone 10, indicates to background noise estimator 35 when near speech is present. Similarly, a wind/scratch detector 38 indicates to background noise estimator 35 when wind or other mechanical noise is present at wireless telephone 10. Wind/scratch detector 38 computes the time derivative of the sum Σ|Wn(z)| of the magnitudes of the coefficients Wn(z) that shape the response of adaptive filter 32, which is an indication of the variation overall gain of the response of adaptive filter 32. Large variations in sum Σ|Wn(z)| indicate that mechanical noise such as that produced by wind incident on reference microphone R or varying mechanical contact (e.g., scratching) on the housing of wireless telephone 10, or other conditions such as an adaptation step size that is too large and causes unstable operation has been used in the system. Wind/scratch detector 38 then compares the time derivative of sum Σ|Wn(z)| to a threshold to determine when mechanical noise is present, and provides an indication of the presence of mechanical noise to background noise estimator 35 while the mechanical noise condition exists. While wind/scratch detector 38 provides one example of wind/scratch measurement, other alternative techniques for detecting wind and/or mechanical noise could be used to provide such an indication to background noise estimator 35. Background noise estimator 35 provides an indication to a power manager 39 of the amount of background noise present in reference microphone signal and power manager generates one or more control signals to control the power-management state of circuits within wireless telephone 10, for example control signal power down as described above. Another power-saving state can be supported, for example, by an optional control signal SE enable that causes a portion of the circuits power-managed by control signal power down to remain enabled.


Referring now to FIG. 4, details of an exemplary background noise level estimator 35 and power manager 39 are shown, which detail an algorithm that is implemented within wireless telephone 10 to estimate background noise. Background noise level estimator 35 includes a noise power computation (Σx2) block 51 that computes a measure of the ongoing (instantaneous) noise power of reference microphone signal ref. The output of noise power computation block 51 provides an input to a smoothing function block 52, which in the example circuit applies an exponential smoothing to the noise power. The rate of the smoothing is controlled by control signal(s) rate provided by a control logic 54 that selects from different exponential smoothing coefficients applied by smoothing function block 52 according to indications wind/scratch and near speech, provided from wind/scratch detector 38 and near speech detector 37 of FIG. 3, respectively. A minima detection block 56 detects the minimum value of the smoothed instantaneous power of reference microphone signal ref over a predetermined time interval, which is programmable in order to control the criteria for eliminating non-stationary noise sources in reference microphone signal ref. The output of minima detection block 56 is biased by combiner 57 with a bias value selected by control logic 54 in accordance with the predetermined time interval and smoothing factors/rate being applied to the output of power computation block 51. The output of combiner 57 is used as an estimate of the background noise present in reference microphone signal ref, which is then provided to power manager 39. Power manager 39 compares the background noise estimate to turn-on threshold and a turn-off threshold, operations which are symbolized by comparators k2 and k1, respectively. A control logic 50 determines whether to de-assert indication power down if indication power down is asserted, according to whether the background noise exceeds the turn-on threshold, and whether to assert indication power down if indication power down is de-asserted, according to whether the background noise exceeds the turn-off threshold. The turn-on threshold is generally set to a value between 3 dB and 10 dB greater than the turn-off threshold, in order to provide a suitable amount of hysteresis for the power management of circuits within personal audio device that are power managed by indication power down. Another comparator k3 can be optionally provided to implement an intermediate level of power management of the ANC circuits. In the depicted example, a threshold value between the power up and power down threshold is used to inform control logic 50 that the background noise estimate is between the turn-on threshold and the turn-off threshold and above a “turn-on SE threshold” that causes control logic 50 to assert control signal SE enable, while maintaining control signal power down in the power down state. Table I below illustrates an exemplary set of power conservation modes.












TABLE I





power down
SE enable
SE Circuits
W Circuits







0
1
Power-up/Enabled
Power-up/Enabled


1
1
Power-up/Enabled
Power-down/Disabled


1
0
Power-down/Disabled
Power-down/Disabled









Referring now to FIG. 5, a waveform diagram illustrating the operation of background noise level estimator 35 is shown. A smoothed reference microphone power 60 is shown as a value that is rapidly changing over time with respect to the actual background noise power estimate, which is yielded by the value of a minimum power on each interval 62. The predetermined interval used to filter non-stationary sources of noise can be seen as the width of the smallest steps in waveform minimum power on interval 62, and as mentioned above, can be adjusted in order to control the criteria used to filter non-stationary noise source contributions from the background noise estimate.


Referring now to FIG. 6, a block diagram of an ANC system is shown for implementing ANC techniques as depicted in FIG. 3, and having a processing circuit 40 as may be implemented within CODEC integrated circuit 20 of FIG. 2. Processing circuit 40 includes a processor core 42 coupled to a memory 44 in which are stored program instructions comprising a computer-program product that may implement some or all of the above-described ANC techniques, as well as other signal processing. Optionally, a dedicated digital signal processing (DSP) logic 46 may be provided to implement a portion of, or alternatively all of, the ANC signal processing provided by processing circuit 40. In the illustrated example processor core 42 provides control signal power down to DSP logic 46, so that the logic implementing filters or other DSP circuits can be shut down when ANC operation is not needed. Further, the state of control signal power down can alternatively, or in combination, be used to control the operation of processor core 42 so that power is conserved. For example, processor core 42 could be halted if the background noise level estimate and comparison is performed entirely in discrete circuits, or the program code executed by processor core 42 may periodically enter a sleep mode, intermittently resuming operation to measure the background noise level in order to update the state of control signal power down. Processing circuit 40 also includes ADCs 21A-21C, for receiving inputs from reference microphone R, error microphone E and near speech microphone NS, respectively. In alternative embodiments in which one or more of reference microphone R, error microphone E and near speech microphone NS have digital outputs, the corresponding ones of ADCs 21A-21C are omitted and the digital microphone signal(s) are interfaced directly to processing circuit 40. DAC 23 and amplifier A1 are also provided by processing circuit 40 for providing the speaker output signal, including anti-noise as described above. The speaker output signal may be a digital output signal for provision to a module that reproduces the digital output signal acoustically.


While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the invention.

Claims
  • 1. A personal audio device, comprising: a personal audio device housing;a transducer mounted on the housing for reproducing an audio signal including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer;at least one microphone mounted on the housing for providing at least one microphone signal indicative of the ambient audio sounds; anda processing circuit that generates the anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal, and wherein the processing circuit further estimates a background noise level from the at least one microphone signal and sets a power conservation mode of the personal audio device in conformity with a magnitude of the estimated background noise level, wherein the processing circuit estimates the background noise level from a minimum value of noise sources within a time interval having a predetermined duration using a noise power measurement algorithm that measures the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal.
  • 2. The personal audio device of claim 1, wherein the processing circuit further sets a full power mode of the personal audio device in response to detecting that the background noise level is greater than a predetermined threshold.
  • 3. The personal audio device of claim 2, wherein the processing circuit further sets a lower-power operating mode of the personal audio device in response to detecting that the background noise level is less than a second value, wherein the second value is greater than the predetermined threshold by a difference in the range of 3 decibels to 10 decibels.
  • 4. The personal audio device of claim 1, wherein the predetermined duration is adjustable to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.
  • 5. The personal audio device of claim 1, wherein the processing circuit filters the minimum value of the noise sources provided by the noise power measurement algorithm with a smoothing function to control a rate of change of the estimate of the background noise level used to detect whether or not to set the power conservation mode.
  • 6. The personal audio device of claim 5, wherein the processing circuit implements a scratch or wind noise detection algorithm, and wherein the processing circuit adjusts the smoothing function to reduce the rate of change of the smoothing function in response to detecting scratch or wind noise, whereby the estimate of the background noise remains accurate in the presence of scratch or wind noise.
  • 7. The personal audio device of claim 5, wherein the processing circuit implements a near speech detection algorithm, and wherein the processing circuit adjusts the smoothing function to reduce the rate of change of the smoothing function in response to detecting of near speech, whereby the estimate of the background noise remains accurate in the presence of near speech.
  • 8. The personal audio device of claim 5, wherein the smoothing function is an exponential smoothing function.
  • 9. The personal audio device of claim 1, wherein the processing circuit compares the background noise level to multiple thresholds and sets one of multiple power conservation modes of the personal audio device in response to a result of the comparisons.
  • 10. A method of countering effects of ambient audio sounds by a personal audio device, the method comprising: adaptively generating an anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal;combining the anti-noise signal with source audio;providing a result of the combining to a transducer;measuring the ambient audio sounds with at least one microphone;estimating a background noise level from a minimum value of noise sources within a time interval having a predetermined duration by measuring the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal; andsetting a power conservation mode of the personal audio device in conformity with a magnitude of the estimated background noise level.
  • 11. The method of claim 10, wherein the setting a power conservation mode further comprises: detecting that the background noise level is greater than a predetermined threshold; andsetting a full power mode of the personal audio device in response to detecting that the background noise level is greater than the predetermined threshold.
  • 12. The method of claim 11, wherein the setting a power conservation mode further sets a lower-power operating mode of the personal audio device in response to detecting that the background noise level is less than a second value, wherein the second value is greater than the predetermined threshold by a difference in the range of 3 decibels to 10 decibels.
  • 13. The method of claim 10, wherein the estimating further comprises adjusting the predetermined duration to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.
  • 14. The method of claim 10, wherein the estimating further comprises filtering the minimum value of the noise sources provided by the noise power measurement algorithm with a smoothing function to control a rate of change of the estimate of the background noise level used to detect whether or not to set the power conservation mode.
  • 15. The method of claim 14, further comprising: detecting scratch or wind noise detection; andadjusting the smoothing function to reduce the rate of change of the smoothing function in response to the detecting scratch or wind noise, whereby the estimate of the background noise remains accurate in the presence of scratch or wind noise.
  • 16. The method of claim 14, further comprising: detecting near speech; andadjusting the smoothing function to reduce the rate of change of the smoothing function in response to detecting near speech, whereby the estimate of the background noise remains accurate in the presence of near speech.
  • 17. The method of claim 14, wherein the smoothing function is an exponential smoothing function.
  • 18. The method of claim 10, further comprising comparing the background noise level to multiple thresholds, and wherein the setting sets one of multiple power conservation modes of the personal audio device in response to a result of the comparing.
  • 19. An integrated circuit for implementing at least a portion of a personal audio device, comprising: an output for providing an output signal to an output transducer including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer;at least one microphone input for receiving at least one microphone signal indicative of the ambient audio sounds; anda processing circuit that adaptively generates the anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal, and wherein the processing circuit further estimates a background noise level from the at least one microphone signal and sets a power conservation mode of the personal audio device in conformity with a magnitude of the estimated background noise level, wherein the processing circuit estimates the background noise level from a minimum value of noise sources within a time interval having a predetermined duration using a noise power measurement algorithm that measures the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal.
  • 20. The integrated circuit of claim 19, wherein the the processing circuit further sets a full power mode of the personal audio device in response to detecting that the background noise level is greater than a predetermined threshold.
  • 21. The integrated circuit of claim 20, wherein the processing circuit further sets a lower-power operating mode of the personal audio device in response to detecting that the background noise level is less than a second value, wherein the second value is greater than the predetermined threshold by a difference in the range of 3 decibels to 10 decibels.
  • 22. The integrated circuit of claim 19, wherein the predetermined duration is adjustable to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.
  • 23. The integrated circuit of claim 19, wherein the processing circuit filters the minimum value of the noise sources provided by the noise power measurement algorithm with a smoothing function to control a rate of change of the estimate of the background noise level used to detect whether or not to set the power conservation mode.
  • 24. The integrated circuit of claim 23, wherein the processing circuit implements a scratch or wind noise detection algorithm, and wherein the processing circuit adjusts the smoothing function to reduce the rate of change of the smoothing function in response to detecting scratch or wind noise, whereby the estimate of the background noise remains accurate in the presence of scratch or wind noise.
  • 25. The integrated circuit of claim 23, wherein the processing circuit implements a near speech detection algorithm, and wherein the processing circuit adjusts the smoothing function to reduce the rate of change of the smoothing function in response to detecting of near speech, whereby the estimate of the background noise remains accurate in the presence of near speech.
  • 26. The integrated circuit of claim 23, wherein the smoothing function is an exponential smoothing function.
  • 27. The integrated circuit of claim 19, wherein the processing circuit compares the background noise level to multiple threshold and sets one of multiple power conservation modes of the personal audio device in response to a result of the comparisons.
US Referenced Citations (197)
Number Name Date Kind
5251263 Andrea et al. Oct 1993 A
5278913 Delfosse et al. Jan 1994 A
5321759 Yuan Jun 1994 A
5337365 Hamabe et al. Aug 1994 A
5359662 Yuan et al. Oct 1994 A
5410605 Sawada et al. Apr 1995 A
5425105 Lo et al. Jun 1995 A
5445517 Kondou et al. Aug 1995 A
5465413 Enge et al. Nov 1995 A
5548681 Gleaves et al. Aug 1996 A
5586190 Trantow et al. Dec 1996 A
5640450 Watanabe Jun 1997 A
5699437 Finn Dec 1997 A
5706344 Finn Jan 1998 A
5740256 Castello Da Costa et al. Apr 1998 A
5768124 Stothers et al. Jun 1998 A
5815582 Claybaugh et al. Sep 1998 A
5832095 Daniels Nov 1998 A
5946391 Dragwidge et al. Aug 1999 A
5991418 Kuo Nov 1999 A
6041126 Terai et al. Mar 2000 A
6118878 Jones Sep 2000 A
6219427 Kates et al. Apr 2001 B1
6278786 McIntosh Aug 2001 B1
6282176 Hemkumar Aug 2001 B1
6418228 Terai et al. Jul 2002 B1
6434246 Kates et al. Aug 2002 B1
6434247 Kates et al. Aug 2002 B1
6522746 Marchok et al. Feb 2003 B1
6683960 Fujii et al. Jan 2004 B1
6766292 Chandran Jul 2004 B1
6768795 Feltstrom et al. Jul 2004 B2
6850617 Weigand Feb 2005 B1
6940982 Watkins Sep 2005 B1
7058463 Ruha et al. Jun 2006 B1
7103188 Jones Sep 2006 B1
7181030 Rasmussen et al. Feb 2007 B2
7330739 Somayajula Feb 2008 B2
7365669 Melanson Apr 2008 B1
7680456 Muhammad et al. Mar 2010 B2
7742790 Konchitsky et al. Jun 2010 B2
7817808 Konchitsky et al. Oct 2010 B2
8019050 Mactavish et al. Sep 2011 B2
8249262 Chua et al. Aug 2012 B2
8290537 Lee et al. Oct 2012 B2
8325934 Kuo Dec 2012 B2
8379884 Horibe et al. Feb 2013 B2
8401200 Tiscareno et al. Mar 2013 B2
8442251 Jensen et al. May 2013 B2
8804974 Melanson Aug 2014 B1
8908877 Abdollahzadeh Milani et al. Dec 2014 B2
20010053228 Jones Dec 2001 A1
20020003887 Zhang et al. Jan 2002 A1
20030063759 Brennan et al. Apr 2003 A1
20030072439 Gupta Apr 2003 A1
20030185403 Sibbald Oct 2003 A1
20040047464 Yu et al. Mar 2004 A1
20040120535 Woods Jun 2004 A1
20040165736 Hetherington et al. Aug 2004 A1
20040167777 Hetherington et al. Aug 2004 A1
20040202333 Csermak et al. Oct 2004 A1
20040240677 Onishi et al. Dec 2004 A1
20040242160 Ichikawa et al. Dec 2004 A1
20040264706 Ray et al. Dec 2004 A1
20050004796 Trump et al. Jan 2005 A1
20050018862 Fisher Jan 2005 A1
20050117754 Sakawaki Jun 2005 A1
20050207585 Christoph Sep 2005 A1
20050240401 Ebenezer Oct 2005 A1
20060035593 Leeds Feb 2006 A1
20060055910 Lee Mar 2006 A1
20060069556 Nadjar et al. Mar 2006 A1
20060153400 Fujita et al. Jul 2006 A1
20070030989 Kates Feb 2007 A1
20070033029 Sakawaki Feb 2007 A1
20070038441 Inoue et al. Feb 2007 A1
20070047742 Taenzer et al. Mar 2007 A1
20070053524 Haulick et al. Mar 2007 A1
20070076896 Hosaka et al. Apr 2007 A1
20070154031 Avendano et al. Jul 2007 A1
20070258597 Rasmussen et al. Nov 2007 A1
20070297620 Choy Dec 2007 A1
20080019548 Avendano Jan 2008 A1
20080101589 Horowitz et al. May 2008 A1
20080107281 Togami et al. May 2008 A1
20080144853 Sommerfeldt et al. Jun 2008 A1
20080177532 Greiss et al. Jul 2008 A1
20080181422 Christoph Jul 2008 A1
20080226098 Haulick et al. Sep 2008 A1
20080240413 Mohammad et al. Oct 2008 A1
20080240455 Inoue et al. Oct 2008 A1
20080240457 Inoue et al. Oct 2008 A1
20090012783 Klein Jan 2009 A1
20090034748 Sibbald Feb 2009 A1
20090041260 Jorgensen et al. Feb 2009 A1
20090046867 Clemow Feb 2009 A1
20090060222 Jeong et al. Mar 2009 A1
20090080670 Solbeck et al. Mar 2009 A1
20090086990 Christoph Apr 2009 A1
20090175466 Elko et al. Jul 2009 A1
20090196429 Ramakrishnan et al. Aug 2009 A1
20090220107 Every et al. Sep 2009 A1
20090238369 Ramakrishnan et al. Sep 2009 A1
20090245529 Asada et al. Oct 2009 A1
20090254340 Sun et al. Oct 2009 A1
20090290718 Kahn et al. Nov 2009 A1
20090296965 Kojima Dec 2009 A1
20090304200 Kim et al. Dec 2009 A1
20090311979 Husted et al. Dec 2009 A1
20100014683 Maeda et al. Jan 2010 A1
20100014685 Wurm Jan 2010 A1
20100061564 Clemow et al. Mar 2010 A1
20100069114 Lee et al. Mar 2010 A1
20100082339 Konchitsky et al. Apr 2010 A1
20100098263 Pan et al. Apr 2010 A1
20100098265 Pan et al. Apr 2010 A1
20100124335 Shridhar et al. May 2010 A1
20100124336 Shridhar et al. May 2010 A1
20100124337 Wertz et al. May 2010 A1
20100131269 Park et al. May 2010 A1
20100142715 Goldstein et al. Jun 2010 A1
20100150367 Mizuno Jun 2010 A1
20100158330 Guissin et al. Jun 2010 A1
20100166203 Peissig et al. Jul 2010 A1
20100195838 Bright Aug 2010 A1
20100195844 Christoph et al. Aug 2010 A1
20100207317 Iwami et al. Aug 2010 A1
20100246855 Chen Sep 2010 A1
20100266137 Sibbald et al. Oct 2010 A1
20100272276 Carreras et al. Oct 2010 A1
20100272283 Carreras et al. Oct 2010 A1
20100274564 Bakalos et al. Oct 2010 A1
20100284546 DeBrunner et al. Nov 2010 A1
20100291891 Ridgers et al. Nov 2010 A1
20100296666 Lin Nov 2010 A1
20100296668 Lee et al. Nov 2010 A1
20100310086 Magrath et al. Dec 2010 A1
20100322430 Isberg Dec 2010 A1
20110007907 Park et al. Jan 2011 A1
20110106533 Yu May 2011 A1
20110129098 Delano et al. Jun 2011 A1
20110130176 Magrath et al. Jun 2011 A1
20110142247 Fellers et al. Jun 2011 A1
20110144984 Konchitsky Jun 2011 A1
20110158419 Theverapperuma et al. Jun 2011 A1
20110206214 Christoph et al. Aug 2011 A1
20110222698 Asao et al. Sep 2011 A1
20110249826 Van Leest Oct 2011 A1
20110288860 Schevciw et al. Nov 2011 A1
20110293103 Park et al. Dec 2011 A1
20110299695 Nicholson Dec 2011 A1
20110305347 Wurm Dec 2011 A1
20110317848 Ivanov et al. Dec 2011 A1
20120135787 Kusunoki et al. May 2012 A1
20120140917 Nicholson et al. Jun 2012 A1
20120140942 Loeda Jun 2012 A1
20120140943 Hendrix et al. Jun 2012 A1
20120148062 Scarlett et al. Jun 2012 A1
20120155666 Nair Jun 2012 A1
20120170766 Alves et al. Jul 2012 A1
20120215519 Park et al. Aug 2012 A1
20120250873 Bakalos et al. Oct 2012 A1
20120259626 Li et al. Oct 2012 A1
20120263317 Shin et al. Oct 2012 A1
20120300958 Klemmensen Nov 2012 A1
20120300960 Mackay et al. Nov 2012 A1
20120308021 Kwatra et al. Dec 2012 A1
20120308024 Alderson et al. Dec 2012 A1
20120308025 Hendrix et al. Dec 2012 A1
20120308026 Kamath et al. Dec 2012 A1
20120308027 Kwatra Dec 2012 A1
20120308028 Kwatra et al. Dec 2012 A1
20120310640 Kwatra et al. Dec 2012 A1
20130010982 Elko et al. Jan 2013 A1
20130083939 Fellers et al. Apr 2013 A1
20130243198 Van Rumpt Sep 2013 A1
20130243225 Yokota Sep 2013 A1
20130272539 Kim et al. Oct 2013 A1
20130287218 Alderson et al. Oct 2013 A1
20130287219 Hendrix et al. Oct 2013 A1
20130301842 Hendrix et al. Nov 2013 A1
20130301846 Alderson et al. Nov 2013 A1
20130301847 Alderson et al. Nov 2013 A1
20130301848 Zhou et al. Nov 2013 A1
20130301849 Alderson et al. Nov 2013 A1
20130343556 Bright Dec 2013 A1
20130343571 Rayala et al. Dec 2013 A1
20140044275 Goldstein et al. Feb 2014 A1
20140050332 Nielsen et al. Feb 2014 A1
20140072134 Po et al. Mar 2014 A1
20140086425 Jensen et al. Mar 2014 A1
20140177851 Kitazawa et al. Jun 2014 A1
20140211953 Alderson et al. Jul 2014 A1
20140270222 Hendrix et al. Sep 2014 A1
20140270223 Li et al. Sep 2014 A1
20140270224 Zhou et al. Sep 2014 A1
20150092953 Abdollahzadeh Milani et al. Apr 2015 A1
Foreign Referenced Citations (24)
Number Date Country
102011013343 Sep 2012 DE
1880699 Jan 2008 EP
1947642 Jul 2008 EP
2133866 Dec 2009 EP
2216774 Aug 2010 EP
2237573 Oct 2010 EP
2395500 Dec 2011 EP
2395501 Dec 2011 EP
2401744 Nov 2004 GB
2455821 Jun 2009 GB
2455824 Jun 2009 GB
2455828 Jun 2009 GB
2484722 Apr 2012 GB
H06-186985 Jul 1994 JP
WO 9911045 Mar 1999 WO
WO 03015074 Feb 2003 WO
WO 2003015275 Feb 2003 WO
WO 2004009007 Jan 2004 WO
WO 2004017303 Feb 2004 WO
WO 2007007916 Jan 2007 WO
WO 2007113487 Nov 2007 WO
WO 2010117714 Oct 2010 WO
WO 2012134874 Oct 2012 WO
WO 2015038255 Mar 2015 WO
Non-Patent Literature Citations (69)
Entry
Campbell, Mikey, “Apple looking into self-adjusting earbud headphones with noise cancellation tech”, Apple Insider, Jul. 4, 2013, pp. 1-10 (10 pages in pdf), downloaded on May 14, 2014 from http://appleinsider.com/articles/13/07/04/apple-looking-into-self-adjusting-earbud-headphones-with-noise-cancellation-tech.
Jin, et al. “A simultaneous equation method-based online secondary path modeling algorithm for active noise control”, Journal of Sound and Vibration, Apr. 25, 2007, pp. 455-474, vol. 303, No. 3-5, London, GB.
Erkelens, et al., “Tracking of Nonstationary Noise Based on Data-Driven Recursive Noise Power Estimation”, IEEE Transactions on Audio Speech and Language Processing, Aug. 2008, pp. 1112-1123, vol. 16, No. 6, Piscataway, NJ, US.
Rao, et al., “A Novel Two State Single Channel Speech Enhancement Technique”, India Conference (INDICON) 2011 Annual IEEE, IEEE, Dec. 2011, 6 pages (pp. 1-6 in pdf), Piscataway, NJ, US.
Rangachari, et al., “A noise-estimation algorithm for highly non-stationary environments”, Speech Communication, Feb. 2006, pp. 220-231, vol. 48, No. 2. Elsevier Science Publishers.
U.S. Appl. No. 13/968,007, filed Aug. 15, 2013, Hendrix, et al.
U.S. Appl. No. 14/029,159, filed Sep. 17, 2013, Li, et al.
U.S. Appl. No. 14/062,951, filed Oct. 25, 2013, Zhou, et al.
U.S. Appl. No. 14/197,814, filed Mar. 5, 2014, Kaller, et al.
U.S. Appl. No. 14/210,537, filed Mar. 14, 2014, Abdollahzadeh Milani, et al.
U.S. Appl. No. 14/210,589, filed Mar. 14, 2014, Abdollahzadeh Milani, et al.
Black, John W., “An Application of Side-Tone in Subjective Tests of Microphones and Headsets”, Project Report No. NM 001 064.01.20, Research Report of the U.S. Naval School of Aviation Medicine, Feb. 1, 1954, 12 pages (pp. 1-12 in pdf), Pensacola, FL, US.
Peters, Robert W., “The Effect of High-Pass and Low-Pass Filtering of Side-Tone Upon Speaker Intelligibility”, Project Report No. NM 001 064.01.25, Research Report of the U.S. Naval School of Aviation Medicine, Aug. 16, 1954, 13 pages (pp. 1-13 in pdf), Pensacola, FL, US.
Lane, et al., “Voice Level: Autophonic Scale, Perceived Loudness, and the Effects of Sidetone”, The Journal of the Acoustical Society of America, Feb. 1961, pp. 160-167, vol. 33, No. 2., Cambridge, MA, US.
Liu, et al., “Compensatory Responses to Loudness-shifted Voice Feedback During Production of Mandarin Speech”, Journal of the Acoustical Society of America, Oct. 2007, pp. 2405-2412, vol. 122, No. 4.
Paepcke, et al., “Yelling in the Hall: Using Sidetone to Address a Problem with Mobile Remote Presence Systems”, Symposium on User Interface Software and Technology, Oct. 16-19, 2011, 10 pages (pp. 1-10 in pdf), Santa Barbara, CA, US.
Therrien, et al., “Sensory Attenuation of Self-Produced Feedback: The Lombard Effect Revisited”, PLOS ONE, Nov. 2012, pp. 1-7, vol. 7, Issue 11, e49370, Ontario, Canada.
Parkins, et al., “Narrowband and broadband active control in an enclosure using the acoustic energy density”, J. Acoust. Soc. Am. Jul. 2000, pp. 192-203, vol. 108, issue 1, US.
Feng, et al.., “A broadband self-tuning active noise equaliser”, Signal Processing, Oct 1, 1997, pp. 251-256, vol. 62, No. 2, Elsevier Science Publishers B.V. Amsterdam, NL.
Zhang, et al., “A Robust Online Secondary Path Modeling Method with Auxiliary Noise Power Scheduling Strategy and Norm Constraint Manipulation”, IEEE Transactions on Speech and Audio Processing, IEEE Service Center, Jan. 1, 2003, pp. 45-53, vol. 11, No. 1, NY.
Lopez-Gaudana, et al., “A hybrid active noise cancelling with secondary path modeling”, 51st Midwest Symposium on Circuits and Systems, MWSCAS 2008, Aug. 10-13, 2008, pp. 277-280, IEEE, Knoxville, TN.
U.S. Appl. No. 13/686,353, filed Nov. 27, 2012, Hendrix, et al.
U.S. Appl. No. 13/795,160, filed Mar. 12, 2013, Hendrix, et al.
U.S. Appl. No. 13/692,367, filed Dec. 3, 2012, Alderson, et al.
U.S. Appl. No. 13/722,119, filed Dec. 20, 2012, Hendrix, et al.
U.S. Appl. No. 13/727,718, filed Dec. 27, 2012, Alderson et al.
U.S. Appl. No. 13/784,018, filed Mar. 4, 2013, Alderson, et al.
U.S. Appl. No. 13/787,906, filed Mar. 7, 2013, Alderson, et al.
U.S. Appl. No. 13/729,141, filed Dec. 28, 2012, Zhou, et al.
U.S. Appl. No. 13/794,979, filed Mar. 12, 2013, Alderson, et al.
Pfann, et al., “LMS Adaptive Filtering with Delta-Sigma Modulated Input Signals,” IEEE Signal Processing Letters, Apr. 1998, pp. 95-97, vol. 5, No. 4, IEEE Press, Piscataway, NJ.
Toochinda, et al. “A Single-Input Two-Output Feedback Formulation for ANC Problems,” Proceedings of the 2001 American Control Conference, Jun. 2001, pp. 923-928, vol. 2, Arlington, VA.
Kuo, et al., “Active Noise Control: A Tutorial Review,” Proceedings of the IEEE, Jun. 1999, pp. 943-973, vol. 87, No. 6, IEEE Press, Piscataway, NJ.
Johns, et al., “Continuous-Time LMS Adaptive Recursive Filters,” IEEE Transactions on Circuits and Systems, Jul. 1991, pp. 769-778, vol. 38, No. 7, IEEE Press, Piscataway, NJ.
Shoval, et al., “Comparison of DC Offset Effects in Four LMS Adaptive Algorithms,” IEEE Transactions on Circuits and Systems II: Analog and Digital Processing, Mar. 1995, pp. 176-185, vol. 42, Issue 3, IEEE Press, Piscataway, NJ.
Mali, Dilip, “Comparison of DC Offset Effects on LMS Algorithm and its Derivatives,” International Journal of Recent Trends in Engineering, May 2009, pp. 323-328, vol. 1, No. 1, Academy Publisher.
Kates, James M., “Principles of Digital Dynamic Range Compression,” Trends in Amplification, Spring 2005, pp. 45-76, vol. 9, No. 2, Sage Publications.
Gao, et al., “Adaptive Linearization of a Loudspeaker,” IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr. 14-17, 1991, pp. 3589-3592, Toronto, Ontario, CA.
Silva, et al., “Convex Combination of Adaptive Filters With Different Tracking Capabilities,” IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr. 15-20, 2007, pp. III 925-928, vol. 3, Honolulu, HI, USA.
Akhtar, et al., “A Method for Online Secondary Path Modeling in Active Noise Control Systems,” IEEE International Symposium on Circuits and Systems, May 23-26, 2005, pp. 264-267, vol. 1, Kobe, Japan.
Davari, et al., “A New Online Secondary Path Modeling Method for Feedforward Active Noise Control Systems,” IEEE International Conference on Industrial Technology, Apr. 21-24, 2008, pp. 1-6, Chengdu, China.
Lan, et al., “An Active Noise Control System Using Online Secondary Path Modeling With Reduced Auxiliary Noise,” IEEE Signal Processing Letters, Jan. 2002, pp. 16-18, vol. 9, Issue 1, IEEE Press, Piscataway, NJ.
Liu, et al., “Analysis of Online Secondary Path Modeling With Auxiliary Noise Scaled by Residual Noise Signal,” IEEE Transactions on Audio, Speech and Language Processing, Nov. 2010, pp. 1978-1993, vol. 18, Issue 8, IEEE Press, Piscataway, NJ.
U.S. Appl. No. 14/228,322, filed Mar. 28, 2014, Alderson, et al.
U.S. Appl. No. 13/762,504, filed Feb. 8, 2013, Abdollahzadeh Milani, et al.
U.S. Appl. No. 13/721,832, filed Dec. 20, 2102, Lu, et al.
U.S. Appl. No. 13/724,656, filed Dec. 21, 2012, Lu, et al.
U.S. Appl. No. 14/252,235, filed Apr. 14, 2014, Lu, et al.
U.S. Appl. No. 13/968,013, filed Aug. 15, 2013, Abdollahzadeh Milani, et al.
U.S. Appl. No. 13/924,935, filed, Jun. 24, 2013, Hellman.
U.S. Appl. No. 13/896,526, filed May 17, 2013, Naderi.
U.S. Appl. No. 14/101,955, filed Dec. 10, 2013, Alderson.
U.S. Appl. No. 14/101,777, filed Dec. 10, 2013, Alderson et al.
Abdollahzadeh Milani, et al., “On Maximum Achievable Noise Reduction in ANC Systems”,2010 IEEE International Conference on Acoustics Speech and Signal Processing, Mar. 14-19, 2010, pp. 349-352, Dallas, TX, US.
Cohen, Israel, “Noise Spectrum Estimation in Adverse Environments: Improved Minima Controlled Recursive Averaging”, IEEE Transactions on Speech and Audio Processing, Sep. 2003, pp. 1-11, vol. 11, Issue 5, Piscataway, NJ, US.
Ryan, et al., “Optimum Near-Field Performance of Microphone Arrays Subject to a Far-Field Beampattern Constraint”, J. Acoust. Soc. Am., Nov. 2000, pp. 2248-2255, 108 (5), Pt. 1, Ottawa, Ontario, Canada.
Cohen, et al., “Noise Estimation by Minima Controlled Recursive Averaging for Robust Speech Enhancement”, IEEE Signal Processing Letters, Jan. 2002, pp. 12-15, vol. 9, No. 1, Piscataway, NJ, US.
Martin, Rainer, “Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics”, IEEE Transactions on Speech and Audio Processing, Jul. 2001, pp. 504-512, vol. 9, No. 5, Piscataway, NJ, US.
Martin, Rainer, “Spectral Subtraction Based on Minimum Statistics”, Signal Processing VII Theories and Applications, Proceedings of EUSIPCO-94, 7th European Signal Processing Conference, Sep. 13-16, 1994, pp. 1182-1185, vol. III, Edinburgh, Scotland, U.K.
Booij, et al., “Virtual sensors for local, three dimensional, broadband multiple-channel active noise control and the effects on the quiet zones”, Proceedings of the International Conference on Noise and Vibration Engineering, ISMA 2010, Sep. 20-22, 2010, pp. 151-166, Leuven.
Kuo, et al., “Residual noise shaping technique for active noise control systems”, J. Acoust. Soc. Am. 95 (3), Mar. 1994, pp. 1665-1668.
Lopez-Caudana, Edgar Omar, “Active Noise Cancellation: The Unwanted Signal and the Hybrid Solution”, Adaptive Filtering Applications, Dr. Lino Garcia (Ed.), Jul. 2011, pp. 49-84, ISBN: 978-953-307-306-4, InTech.
Senderowicz, et al., “Low-Voltage Double-Sampled Delta-Sigma Converters”, IEEE Journal on Solid-State State Circuits, Dec. 1997, pp. 1907-1919, vol. 32, No. 12, Piscataway, NJ.
Hurst, et al., “An improved double sampling scheme for switched-capacitor delta-sigma modulators”, 1992 IEEE Int. Symp. on Circuits and Systems, May 10-13, 1992, vol. 3, pp. 1179-1182, San Diego, CA.
U.S. Appl. No. 14/734,321, filed Jun. 9, 2015, Alderson, et al.
U.S. Appl. No. 14/578,567, filed Dec. 22, 2014, Kwatra, et al.
Widrow, B., et al., Adaptive Noise Cancelling; Principles and Applications, Proceedings of the IEEE, Dec. 1975, pp. 1692-1716, vol. 63, No. 13, IEEE, New York, NY, US.
Morgan, et al., A Delayless Subband Adaptive Filter Architecture, IEEE Transactions on Signal Processing, IEEE Service Center, Aug. 1995, pp. 1819-1829, vol. 43, No. 8, New York, NY, US.
U.S. Appl. No. 14/656,124, filed Mar. 12, 2015, Hendrix, et al.
Provisional Applications (1)
Number Date Country
61701187 Sep 2012 US