1. Field of the Invention
The present invention relates generally to personal audio devices such as wireless telephones that include adaptive noise cancellation (ANC), and more specifically, to control of adaptation of ANC adaptive responses in a personal audio device when tones, such as downlink ringtones, are present in the source audio signal.
2. Background of the Invention
Wireless telephones, such as mobile/cellular telephones, cordless telephones, and other consumer audio devices, such as mp3 players, are in widespread use. Performance of such devices with respect to intelligibility can be improved by providing noise canceling using a microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events.
Noise canceling operation can be improved by measuring the transducer output of a device at the transducer to determine the effectiveness of the noise canceling using an error microphone. The measured output of the transducer is ideally the source audio, e.g., downlink audio in a telephone and/or playback audio in either a dedicated audio player or a telephone, since the noise canceling signal(s) are ideally canceled by the ambient noise at the location of the transducer. To remove the source audio from the error microphone signal, the secondary path from the transducer through the error microphone can be estimated and used to filter the source audio to the correct phase and amplitude for subtraction from the error microphone signal. However, when tones such as remote ringtones are present in the downlink audio signal, the secondary path adaptive filter will attempt to adapt to the tone, rather than maintaining a broadband characteristic that will model the secondary path properly when downlink speech is present.
Therefore, it would be desirable to provide a personal audio device, including wireless telephones, that provides noise cancellation using a secondary path estimate to measure the output of the transducer and an adaptive filter that generates the anti-noise signal, in which improper operation due to tones in the downlink audio can be avoided, and in which tones can be reliably detected in the downlink audio signal.
The above stated objective of providing a personal audio device providing noise cancelling including a secondary path estimate that avoids improper operation due to tones in the downlink audio, is accomplished in a personal audio device, a method of operation, and an integrated circuit.
The personal audio device includes a housing, with a transducer mounted on the housing for reproducing an audio signal that includes both source audio for providing to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer. A reference microphone is mounted on the housing to provide a reference microphone signal indicative of the ambient audio sounds. The personal audio device further includes an adaptive noise-canceling (ANC) processing circuit within the housing for adaptively generating an anti-noise signal from the reference microphone signal such that the anti-noise signal causes substantial cancellation of the ambient audio sounds. An error microphone is included for controlling the adaptation of the anti-noise signal to cancel the ambient audio sounds and for compensating for the electro-acoustical path from the output of the processing circuit through the transducer. The ANC processing circuit detects tones in the source audio and takes action on the adaptation of a secondary path adaptive filter that estimates the response of the secondary path and another adaptive filter that generates the anti-noise signal so that the overall ANC operation remains stable when the tones occur.
In another feature, a tone detector of the ANC processing circuit has adaptable parameters that provide for continued prevention of improper operation after tones occur in the source audio by waiting until non-tone source audio is present after the tones and then sequencing adaptation of the secondary path adaptive filter and then the other adaptive filter that generates the anti-noise signal.
The foregoing and other objectives, features, and advantages of the invention will be apparent from the following, more particular, description of the preferred embodiment of the invention, as illustrated in the accompanying drawings.
Noise canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone, are disclosed. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates a signal that is injected into the speaker (or other transducer) output to cancel ambient acoustic events. A reference microphone is provided to measure the ambient acoustic environment, and an error microphone is included to measure the ambient audio and transducer output at the transducer, thus giving an indication of the effectiveness of the noise cancelation. A secondary path estimating adaptive filter is used to remove the playback audio from the error microphone signal, in order to generate an error signal. However, tones in the source audio reproduced by the personal audio device, e.g., ringtones present in the downlink audio during initiation of a telephone conversation or other tones in the background of a telephone conversation, will cause improper adaptation of the secondary path adaptive filter. Further, after the tones have ended, during recovery from an improperly adapted state, unless the secondary path estimating adaptive filter has the proper response, the remainder of the ANC system may not adapt properly, or may become unstable. The exemplary personal audio devices, method and circuits shown below sequence adaptation of the secondary path estimating adaptive filter and the remainder of the ANC system to avoid instabilities and to adapt the ANC system to the proper response. Further, the magnitude of the leakage of the source audio into the reference microphone can be measured or estimated, and action taken on the adaptation of the ANC system and recovery from such a condition after the source audio has ended or decreased in volume such that stable operation can be expected.
Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment and is positioned away from the typical position of a user/talker's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio signal reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS, and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other embodiments of the invention, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.
In general, the ANC techniques disclosed herein measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events present at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z). Electro-acoustic path S(z) represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment. Electro-acoustic path S(z) is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone 10 is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near speech microphone NS, other systems that do not include separate error and reference microphones can implement the above-described techniques. Alternatively, near speech microphone NS can be used to perform the function of the reference microphone R in the above-described system. Finally, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below can be omitted.
Referring now to
To implement the above, adaptive filter 34A has coefficients controlled by SE coefficient control block 33, which processes the source audio (ds+ia) and error microphone signal err after removal, by a combiner 36, of the above-described filtered downlink audio signal ds and internal audio ia, that has been filtered by adaptive filter 34A to represent the expected source audio delivered to error microphone E. Adaptive filter 34A is thereby adapted to generate an error signal e from downlink audio signal ds and internal audio ia, that when subtracted from error microphone signal err, contains the content of error microphone signal err that is not due to source audio (ds+ia). However, if downlink audio signal ds and internal audio ia are both absent, e.g., at the beginning of a telephone call, or have very low amplitude, SE coefficient control block 33 will not have sufficient input to estimate acoustic path S(z). Therefore, in ANC circuit 30, a source audio detector 35A detects whether sufficient source audio (ds+ia) is present, and updates the secondary path estimate if sufficient source audio (ds+ia) is present. Source audio detector 35A may be replaced by a speech presence signal if a speech presence signal is available from a digital source of the downlink audio signal ds, or a playback active signal provided from media playback control circuits.
Control circuit 39 receives inputs from source audio detector 35A, which include a Tone indicator that indicates when a dominant tone signal is present in downlink audio signal ds and a Source Level indication reflecting the detected level of the overall source audio (ds+ia). Control circuit 39 also receives an input from an ambient audio detector 35B that provides an indication of the detected level of reference microphone signal ref. Control circuit 39 may receive an indication vol of the volume setting of the personal audio device. Control circuit 39 also receives a stability indication Wstable from W coefficient control 31, which is generally de-asserted when a stability measure Σ|Wk(z)Δt, which is the rate of change of the sum of the coefficients of response W(z), is greater than a threshold, but alternatively, stability indication Wstable may be based on fewer than all of the coefficients of response W(z) that determine the response of adaptive filter 32. Further, control circuit 39 generates control signal haltW to control adaptation of W coefficient control 31 and generates control signal haltSE to control adaptation of SE coefficient control 33. Exemplary algorithms for sequencing of the adapting of response W(z) and secondary path estimate SE(z) are discussed in further detail below with reference to
Within source audio detector 35A, a tone detection algorithm determines when a tone is present in source audio (ds+ia), an example of which is illustrated in
The processing algorithm then proceeds to decision 79 whether or not a tone has been detected, and if the hangover count is not greater than zero (decision 79), indicating that a tone has not yet been detected by decision 73, or that the hangover count has expired after a tone has been detected, the tone flag is reset indicating that no tone is present and a previous tone flag is also reset (step 80). The hangover count is a count that provides for maintaining the tone flag in a set condition (e.g., tone flag=“1”) after detection of a tone has ceased, in order to avoid resuming adaptation of the ANC system too early, e.g., when another tone is likely to occur and cause response SE(z) to adapt improperly. The value of the hangover count is implementation specific, but should be sufficient to avoid the above improper adaptation condition. Processing then repeats from step 70 if the telephone call is not ended at decision 87. However, it the hangover count is greater than zero (decision 79), then the tone flag is set (to a value of “1”) (step 81) and the hangover count is decreased (step 82), causing the system to treat the current source audio as a tone while the hangover count is non-zero. If the previous tone flag is not set, (e.g., the tone flag has a value of “0”) (decision 83), then the tone count is incremented and the previous tone flag is set (to a value of “1”) (step 84). Otherwise, if the tone flag is set (result “No” at decision 83), then the processing algorithm proceeds directly to decision 85. Then, if the tone count exceeds a predetermined reset count (decision 85), which is the number of tones after which response SE(z) should be set to a known state, response SE(z) is reset and the tone count is also reset (step 86). Until the call is over (decision 87), the algorithm of steps 70-86 is repeated. Otherwise, the algorithm ends.
The exemplary circuits and methods illustrated herein provide proper operation of the ANC system by reducing the impact of remote tones on response SE(z) of secondary path adaptive filter 34A, which consequently reduces the impact of the tones on response SECOPY(z) of filter 34B and response W(z) of adaptive filter 32. In the example shown in
At time t7, control signal halt SE is asserted and control signal haltW is de-asserted, to transition from adapting SE(z) to adapting response W(z). At time t8, source audio is again detected, and control signal haltW is asserted to halt the adaptation of response W(z). Control signal halt SE is then de-asserted, since a non-tone downlink audio signal is generally a good training signal for response SE(z). At time t9, the level indication has decreased below the threshold and response W(z) is again permitted to adapt by de-asserting control signal haltW and adaptation of response SE(z) is halted by asserting control signal haltSE, which continues until time t10, when response W(z) has been adapting for a maximum time period Tmaxw.
Within source audio detector 35A, another tone detection algorithm that determines when a tone is present in source audio (ds+ia), is illustrated in
In the example shown in
Referring now to
While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing, as well as other changes in form and details may be made therein without departing from the spirit and scope of the invention.
This U.S. Patent Application claims priority under 35 U.S.C. 119(e) to U.S. Provisional Patent Application Ser. No. 61/701,187 filed on Sep. 14, 2012 and to U.S. Provisional Patent Application Ser. No. 61/645,333 filed on May 10, 2012.
Number | Date | Country | |
---|---|---|---|
61645333 | May 2012 | US | |
61701187 | Sep 2012 | US |