This disclosure is directed to acoustic processing, and, more specifically, to a reconfigurable acoustic processor that is capable of running in real-time or near real-time.
In general, noise that is present in a listening environment nearly always compromises the experience of listening to audio through headphones. For instance, in an airplane cabin, noise from the airplane produces unwanted acoustic waves, i.e., noise, that travel to the listener's ears, in addition to the audio program. Other examples include computer and air-conditioning noise of an office or house, vehicle and passenger noise in public or private transportation, or other noisy environments.
In an effort to reduce the amount of noise received by the listener, two major styles of noise reduction have been developed, passive noise reduction and active noise cancellation. Passive noise reduction refers to a reduction in noise caused by placing a physical barrier, which are commonly headphones or earplugs, between the ear cavity and the noisy outside environment. The amount of noise reduced depends on the quality of the barrier. In general, noise-reduction headphones having more mass provide higher passive noise reduction. Large, heavy headphones may be uncomfortable to wear for extended periods, however. For a given headphone, passive noise reduction works better to reduce the higher frequency noise, while low frequencies may still pass through a passive noise reduction system.
Active noise reduction systems, also called active noise cancellation (ANC), refers to the reduction of noise achieved by playing an anti-noise signal through headphone speakers. The anti-noise signal is generated as an approximation of the negative of the noise signal that would be in the ear cavity in absence of ANC. The noise signal is then neutralized when combined with the anti-noise signal.
In a general noise cancellation process, one or more sensors (e.g. microphones) monitor ambient noise or noise in the earcups of headphones in real-time, then the system generates the anti-noise signal from the ambient or residual noise. The anti-noise signal may be generated differently depending on factors such as physical shape and size of the ANC system, (e.g., headphones, etc.), frequency response of the sensor and a transducer, e.g. speaker, latency of the transducer at various frequencies, sensitivity of the sensor, and placement of the transducers and sensors, for example. The variations in the above factors between different sensors and transducers (e.g., headphones) and even between the two ear cups of the same headphone system mean that optimal filter design for generating anti-noise also vary.
Latency in processing an anti-noise signal prevents Active Noise Cancellation systems from operating efficiently. For instance, digitizing the sensor signals and processing the signal at rates common in audio processing, such as 44.1 KHz or 48 KHz introduces large latency. Because performance of an acoustic processor, such as an ANC, depends on the ability to detect noise and produce the anti-noise signal soon enough in time to cancel the noise, a large latency is detrimental to acoustic noise cancellation processing.
Embodiments of the invention address this and other limitations of the prior art.
Embodiments of the invention are directed to a digital acoustic processor, such as a Reconfigurable Acoustic Processor (RAP) for use in audio systems that use digitized sensor inputs.
There are three major types of Active Noise Cancellation (ANC), which are distinguished based on sensor, or microphone placement within the system. In feed-forward ANC, the sensor senses ambient noise but does not appreciably sense the signal produced by a transducer, such as a speaker. Such a system is illustrated in
In feedback ANC, the sensor is placed in a position to sense the total audio signal present in the ear cavity. In other words, the sensor senses the sum of both the ambient noise as well as the audio played back by the transducer. Such a system is illustrated in
A combined feed-forward and feedback ANC system uses two or more sensors, the first position for sensors being in the feed-forward path as illustrated in
Whereas existing systems used fixed topologies and filters, embodiments of the invention use a selectable system to cover many different applications, as described in detail below.
Typical audio processing rates are 44.1 KHz or 48 KHz, which is based on the frequency range of typical human hearing. At these sample rates, the sampling time period is around 20 μs. The digitizing and the filtering in ANC systems invariably take multiple samples. At these rates, the resulting delay is in the order of hundreds of microseconds. Because any delay in processing degrades generation of the anti-noise signal, this significantly lowers ANC performance. This usually manifests itself as limiting the maximum noise frequency that may be cancelled.
The analog portion 102 does not require a clock, and typically signals in this portion are generally continuous, analog, signals. For example a transducer or speaker 110 may produce an analog audio signal such as from headphones or other speakers. A sensor, such as a digital microphone 112 automatically generates a digital output from an analog input signal, while a standard analog sensor, such as microphone 114, may be combined with an ADC 124 to generate a digital signal from the analog sensor 114. A sensor 116, such as a microphone, may be placed in the feedback position, and coupled to an ADC 126. The ADCs 124, 126 may use sigma-delta processing, for example. In other embodiments the ADCs 124, 126 may be of Pulse Code Modulation (PCM) or Successive Approximation Register (SAR) type. A single sensor 112, 114, 116 may be used for multiple purposes, such as sampling ambient noise while also serving as an input microphone for a telephone, for example. One or more filters 128 may be present to filter outputs from the ADCs 124, 126, but are not required in all embodiments.
A Digital Signal Processor (DSP) 130 or other audio source operates in the digital portion 106 and at a frequency of a standard audio sample rate. Typically the operating frequency of the digital portion 106 of the audio system 100 may be 44.1 or 48 KHz.
The operating frequency of the digital portion 104, conversely, may operate from a low of approximately 50 KHz to a rate of approximately 100 MHz, and preferably within a range such as 2-100 MHz. In some embodiments the digital portion 104 may operate at 50 KHz, 96 KHz, within a range of hundreds of KHz, at frequencies in the low MHz range, such as 1-6, in the 10 s of MHz range, such as 10-20 MHz, up to approximately 100 MHz. In embodiments of the invention, each of the components of the particular domain operates at the frequency of the domain. For example, with reference to
An interpolator 140 converts audio signals from the DSP 130, for example operating at 48 KHz, to audio signals operating at 3 MHz or 6 MHz as an input signal to the RAP 150. In reverse, a decimator 144, which need not be present in all audio systems 100, converts signals from the RAP 150 at, for instance 3 or 6 MHz, to the operating frequency of the digital portion 106. The resulting latency of the RAP 150 is extremely low, for example less than 2.5 μs, and preferably less than 0.5 μs, because the RAP 150 processes signals at the same rate as they are generated by the sensors, or microphones 112, 114, 116, whether or not the sensors are digital microphones or whether the sensor signals are converted by the ADCs 124, 126 to digital signals.
As described in more detail below, the RAP 150 controls acoustic signals, for example emitted from the transducer 110, in real time. As described above, the RAP 150 is structured to operate on raw sensor samples from the microphones 112, 114, and/or 116 without any intermediate processing, like a decimation filter or other sample rate converters. This allows responding to microphone signals with zero or near zero computational delay in the RAP 150, which enables implementation of real-time audio processing algorithms. The effect of using real-time sensor sampling is that delay from the decimation filter of previous systems is eliminated, which in turn dramatically increases the responsiveness of the control loop.
The sample rate of the digital portion 104 may be varied according to a sample rate of the digital sensor 112, or the ADC 124 coupled to the analog sensor 114. There is a linear tradeoff between the sample rate and the amount of processing that may be processed per sample.
Connected to each bi-quad filter chain BQ0-BQ6 are gain units, M0-M6, respectively, with an additional gain unit M7, the purpose of which is described below. The gain units M0-M7 are programmable, in that the amount of gain produced between their inputs and outputs is controllable. Output of particular bi-quad filter chains BQ0-BQ6 may be controlled by its coupled gain unit M0-M6. Setting the gain of any of the gain units M0-M6 to zero effectively turns off that particular circuit branch. It is not strictly necessary to maintain a one-to-one relationship between bi-quad filter chains and gain units, but maintaining that relationship provides flexibility for setting up the RAP. The RAP 250 of
By programming particular filter coefficients in the bi-quad filter chains BQ0-BQ6 and particular gain values in the gain units M0-M6, different audio applications may be performed in the RAP 250, such as audio noise cancellation, as described below.
Also coupled to the RAP 250 may include inputs from digital sensors, 212, 214, which may be microphones, a decimator 218, and an interpolator 220. Either or both of the sensor inputs 212, 214 may be created by having an analog microphone coupled to an ADC. The decimator 218 and interpolator 220 operate as described with reference to
In operation, the RAP 250 accepts input from the sensor 212 at bi-quad filter chains BQ0 and BQ3, and accepts input from the sensor 214 at bi-quad filter chains BQ1 and BQ5. An audio signal is accepted at the bi-quad filter chains BQ2 and BQ6. In some embodiments, an audio signal is not strictly necessary. For example, in noise cancellation headphones for hunters or industry, no audio signal may be present.
The gain unit M7 may be used as a controllable gain for the processed audio signal before its final combination in a combiner A2 with the unprocessed audio signal from the interpolator 220. The gain unit M7 may be controlled to increase its gain gradually, so that noise cancelation or other processing may be added to the unprocessed audio signal gradually, to eliminate pops or other fast changes in the output audio signal, which may be uncomfortable for a listener.
Adders or combiners A0, A1, and A2 combine intermediate signal outputs from the bi-quad filter chains, as illustrated in
In one embodiment, the RAP 350 operates at 49.152 MHz, which is a standard rate for audio processing. The input sample rate is typically 3.072 Msps, and the filter portion may also operate at the same rate.
A straightforward example of operation of the RAP 250 is a simple audio processor, without using input from either of the sensors 212, 214. In such an example, the gain unit M7 is set to 0, i.e., turned off, while the audio signal from the interpolator is filtered by the bi-quad filter chain BQ6. Controlling the gain unit M6 controls an output signal level of the filtered audio signal, which is sent to the transducer 210, which may be a speaker, or other transducer output.
In a more complex example, the RAP 250 may be configured as a feed-forward/feedback ANC, having the same functionality as the feed-forward and feed-back ANC circuit illustrated in
By configuring the RAP 250, and particularly the gain units M0-M7 and bi-quad filter chains BQ1-BQ6, the RAP may be configured to perform most any type of audio processing. For instance, the RAP 250 may be configured as an ANC processor for active noise cancellation headphones, in either feedback, feed-forward, or combined feed-forward feedback configurations. The RAP 250 may be used for active noise cancellation in phone handsets by using input from the handset microphone and producing audio output for one or more speakers in the handset. The RAP 250 may further enhance an input audio signal while simultaneously performing noise cancellation. The RAP 250 may also be used for ambient sound enhancement by accepting an ambient sound at one of the microphone inputs, modifying it through one or more bi-quad filter chains, setting an appropriate gain level, then outputting the modified ambient signal.
In practice, the RAP 250 of
By using such programmable techniques, filters may be chosen to enhance, rather than reduce certain sounds or noises. For instance, instead of bi-quad chain filter parameters chosen for their ability to reduce sounds sensed by a particular microphone, as described above, parameters may be chosen that enhance particular sounds. For example, a person may be using noise cancellation headphones in a noisy work environment with a variety of rumbling machinery, but still wants to be able to speak to a co-worker without removing the noise reducing headphones. Using the adaptive filter coefficients, when microphones detected noise in the vocal band, different parameters may be automatically loaded to the RAP system that enhanced the voice of the co-worker. Thus the listener would have noise-canceling headphones that adaptively enhanced particular sounds. Sounds such as voices, audio television signals, and traffic, for example, may be enhanced. When such sounds went away, for example the co-worker stopped speaking, the standard filtering coefficients could again be dynamically loaded into the filters of the RAP system.
Embodiments of the invention may be incorporated into integrated circuits such as sound processing circuits, or other audio circuitry. In turn, the integrated circuits may be used in audio devices such as headphones, mobile phones, portable computing devices, sound bars, audio docks, amplifiers, speakers, etc.
Having described and illustrated the principles of the invention with reference to illustrated embodiments, it will be recognized that the illustrated embodiments may be modified in arrangement and detail without departing from such principles, and may be combined in any desired manner. And although the foregoing discussion has focused on particular embodiments, other configurations are contemplated.
In particular, even though expressions such as “according to an embodiment of the invention” or the like are used herein, these phrases are meant to generally reference embodiment possibilities, and are not intended to limit the invention to particular embodiment configurations. As used herein, these terms may reference the same or different embodiments that are combinable into other embodiments.
Consequently, in view of the wide variety of permutations to the embodiments described herein, this detailed description and accompanying material is intended to be illustrative only, and should not be taken as limiting the scope of the invention.
This application is a continuation of International Application PCT/US15/53187, entitled ACOUSTIC PROCESSOR HAVING LOW LATENCY, filed Sep. 30, 2015, which claims the benefit of U.S. Provisional Patent Application 62/057,481, entitled ACOUSTIC PROCESSOR HAVING LOW LATENCY, filed Sep. 30, 2014, the contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
62057481 | Sep 2014 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2015/053187 | Sep 2015 | US |
Child | 15294556 | US |