The field of representative embodiments of this disclosure relates to audio signal processing methods and circuits that suppress audibility of artifacts due to changes in an audio processing channel by taking advantage of temporal masking properties of an audio signal being reproduced by the audio processing channel.
Audio processing systems designed to operate from battery power frequently include selectable operating modes, including selectable audio paths. For example, an audio amplification system for a mobile device may include a low-noise operating mode corresponding to a first audio path that is used for reproduction of low-amplitude signals, while a power-efficient second audio path reproduces high-amplitude signals. Audio systems in general may have selectable sample rates, selectable gains and other selectable characteristics. Changes in the operating mode, gain changes, sample rate changes, and other configuration changes may cause audible artifacts, e.g., “pops” or “clicks” when configuration changes are selected.
When changes are made to an audio reproduction channel while the channel is not actually being used, the output of the channel may be muted. However, the above-mentioned configuration changes are frequently required during reproduction of an audio signal, and the changes may cause shifts in DC offset or gain that cannot be masked by muting. In particular, in systems including adaptive noise-cancelling (ANC), the program audio may be absent, but the audio channel is reproducing an anti-noise signal, that while ideally inaudible due to the signal canceling ambient noise, will cause artifacts when the gain or DC offset of the audio channel changes.
Therefore, it would be advantageous to provide an audio processing system that suppresses artifacts due to changes in an audio processing channel, including audio processing channels that are used in ANC applications.
Reduced audible artifacts due to changes in an audio channel element may be accomplished in systems and their methods of operation.
The systems are audio processing systems that reproduce an audio input signal and produce an audio output signal with an audio processing channel. The audio processing channel has an adjustable or selectable element that, responsive to a control signal, changes a characteristic of the audio processing channel, which generates a transient in the audio output signal. The systems include a signal level detector for measuring a signal level of the audio input signal and a controller that, responsive to an output of the signal level detector, determines a masking time interval available from the audio output signal due to signal content in the audio input signal. The controller generates the control signal to change the characteristic of the audio processing channel so that at least a portion of the transient occurs in the masking time interval.
The summary above is provided for brief explanation and does not restrict the scope of the Claims. The description below sets forth example embodiments according to this disclosure. Further embodiments and implementations will be apparent to those having ordinary skill in the art. Persons having ordinary skill in the art will recognize that various equivalent techniques may be applied in lieu of, or in conjunction with, the embodiments discussed below, and all such equivalents are encompassed by the present disclosure.
The present disclosure encompasses audio processing systems having an audio channel that has a changeable element and that generates audible transients when the element is changed. Audibility of the change is suppressed by synchronizing the change within a temporal masking interval that is determined in accordance with the output of a signal level detector. The changeable element may be a signal path, gain, coefficient selection, or an on-line calibration interval within the audio processing system, and a controller may synchronize selection of the signal path to occur within a detected available temporal masking interval. Masking of audio artifacts by a signal having greater energy in regions of the frequency spectrum in which the artifacts have energy, i.e., direct masking, occurs spontaneously and is not something that may generally be arranged for artifacts due to the above-listed system changes, unless the acoustic output of the reproduced audio program is known to be at a sufficiently high level to make the change. Temporal masking is a technique that takes advantage of portions of a program having greater energy in the needed regions of the frequency spectrum, but is “temporal” in the sense that masking is possible both before and after a high energy portion of the program. The systems described below provide temporal masking by observing program audio signal levels and determining the appropriate time to allow artifact-generating system changes to occur. While the audio processing systems in the examples described below may provide an output to an electroacoustic output transducer, the techniques disclosed herein are applicable to audio input systems, as well, for example audio preamplifier systems designed to receive microphone inputs may also benefit from synchronizing changes in their audio path, e.g., input gain adjustments during time intervals adjacent to high amplitude portions of the input signal.
Referring now to
A second audio signal path Path2 in system 10 is selected by path switching control 15 when signal level detector 14 indicates that output signal Out has low amplitude. Equalization is applied by a path equalizer (EQ) 13B, predistortion is applied by pre-distortion processing block 16, and differential output signal Out is provided to speaker SPKR from a current-output digital-to-analog converter (IDAC) 19, when audio signal path Path2 is selected for operation by path switching control block 15, enabling IDAC 19 and disabling digital PWMs 18A, 18B. Path switching control 15 may also enable/disable path EQs 13A, 13B and portions of pre-distortion block 16, according to the selected audio path. Specific control signals have been omitted for clarity of illustration. Path switching control block 15 may postpone a change in path selection until masking window determination block indicates that masking is available. An output resistor Ro sets the output impedance presented to speaker SPKR when audio signal path Path2 is selected for operation. Additional system changes that system control 12 may make to the system configuration include changes to the pre-distortion polynomials applied to the signals in one or both of audio paths Path1, Path2, and changes to the equalization applied to the signals in audio paths Path1, Path2 by path EQs 13A, 13B. An environmental monitor 17 measures system characteristics such as power supply voltage and temperature, in order to inform adjustment of characteristics such as pre-distortion and equalization. Any of the above-described system characteristic changes, and other possible configuration or operating parameter changes made in system 10 that may generate artifacts, may be postponed by system control block 12 until masking window determination block 20 determines that sufficient masking is present.
Referring now to
Referring now to
zν=13.0 tan−10.76f:f<1.5 kHz and
zν=8.7+14.21 log10f:f>1.5 kHz,
where zv is the Bark equivalent of frequency fv. The slope of masking threshold amplitude profile 32 on the low frequency side of zv is 27 dB/Bark and the slope of masking threshold amplitude profile 32 on the high frequency side of zv is −(24+230/fv−0.2Lv) dB/Bark where Lv is the amplitude (dB) of masking tone 34. A “maskee” signal 36 has an amplitude that is less than masking threshold amplitude profile 32 by an amplitude margin 38, which indicates that “maskee” will not be audible if masking tone 34 is present. As long as an artifact component within the range of masking threshold amplitude profile 32 has a lower amplitude than masking threshold amplitude profile 32, then that artifact component will be masked by masking tone 34, and any artifact components having amplitudes exceeding masking threshold amplitude profile 32 may be audible, unless the artifact occurs just before or after a high amplitude program audio event that provides temporal masking as described in further detail below. Example system 10 as described above, leverages the detection of a presence of potential masking sources, such as masking tone 34, in the program audio provided to digital input IN for simultaneous masking of frequency components of artifacts generated by system configuration changes, as described above, as well as other, temporal masking effects as described in further detail below.
Referring now to
As mentioned above, portions of the disclosed processes may be carried out by the execution of a collection of program instructions forming a computer program product stored on a non-volatile memory, but that also exist outside of the non-volatile memory in tangible forms of storage forming a computer-readable storage medium. The computer-readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. Specific examples of the computer-readable storage medium include the following: a hard disk, semiconductor volatile and non-volatile memory devices, a portable compact disc read-only memory (CD-ROM) or a digital versatile disk (DVD), a memory stick, a floppy disk or other suitable storage device not specifically enumerated. A computer-readable storage medium, as used herein, is not to be construed as being transitory signals, such as transmission line or radio waves or electrical signals transmitted through a wire. It is understood that blocks of the block diagrams described above may be implemented by computer-readable program instructions. These computer readable program instructions may also be stored in other storage forms as mentioned above and may be downloaded into a non-volatile memory for execution therefrom. However, the collection of instructions stored on media other than system non-volatile memory described above also form a computer program product that is an article of manufacture including instructions which implement aspects of the functions/actions specified in the block diagram block or blocks.
In summary, this disclosure shows and describes audio processing circuits, systems and methods of operation of the systems and circuits that reproduce an audio input signal. The audio processing system may include an audio processing channel having an input for receiving an audio input signal and producing an audio output signal. The audio processing channel may have an adjustable or selectable element that changes a characteristic of the audio processing channel that generates a transient in the audio output signal. The adjustable or selectable element may be responsive to a control signal to change the characteristic. The audio processing system may include a signal level detector for measuring a signal level of the audio input signal and a controller responsive to an output of the signal level detector to determine a masking time interval available from the audio output signal due to signal content in the audio input signal and that generates the control signal to change the characteristic of the audio processing channel so that at least a portion of the transient occurs in the masking time interval.
In some example embodiments, the masking time interval may be a time interval commenced in response to a drop in the signal level measured by the signal level detector from a prior greater signal level interval to a present lesser signal level interval, so that an amplitude of the transient due to the change in the characteristic of the audio processing channel may be reduced due to the change in the characteristic of the audio processing channel being applied within the present lesser signal level interval, while temporal masking due to the prior greater signal level interval may provide increased masking capability. In some example embodiments, a delay of a delay path through the audio processing channel may be greater than a response delay of the signal level detector so that a subsequent signal level may be measured by the signal level detector. The masking time interval may be a time interval commenced in response to an increase in the signal level measured by the signal level detector from a present lesser signal level interval to a subsequent greater signal level interval, so that an amplitude of the transient due to the change in the characteristic of the audio processing channel may be reduced due to the change in the characteristic of the audio processing channel being applied within the present lesser signal level interval, while temporal masking due to the subsequent greater signal level interval may provide increased masking capability. In some example embodiments, the audio processing system includes a zero-cross detector for detecting zero-crossings of the audio input signal, and the controller may further synchronize the control signal with the zero-crossings of the audio input signal to minimize the magnitude of the transient.
In some example embodiments, the audio processing channel includes a plurality of audio signal amplification paths, and the adjustable or selectable element may be a selector that selects from among the plurality of audio signal amplification paths. The transient may be due to selection between differing ones of the audio signal amplification paths. In some example embodiments, the controller may receive a mode switch command indicating a change in operating mode of the audio processing system, so that a present operating mode corresponds to selection of a first one of the plurality of audio signal amplification paths, and so that a commanded operating mode corresponds to a second one of the plurality of audio signal amplification paths. The controller may postpone selecting the commanded operating mode until the masking interval is available.
In some example embodiments, the signal level detector may include multiple filters having corresponding differing audio passbands and corresponding envelope detectors for detecting levels of the audio input signal in the differing audio passbands. The controller may determine the temporal masking interval from outputs of the envelope detectors indicating that sufficient masking will be available in the audio output signal in the differing audio passbands to mask the transient. In some example embodiments, the controller may determine a rate of change of the output of the signal level detector and may determine a duration of a prospective masking interval from the rate of change of the output of the signal level detector and the output of the signal level detector directly, so that the prospective masking interval may be determined to be an available masking interval when the duration exceeds a threshold duration corresponding to a minimum masking interval for the at least a portion of the transient to be masked. In some example embodiments, the controller may determine that the prospective masking interval is an available masking interval when a predicted signal level of the audio output signal exceeds a threshold level at an end of the prospective masking interval. In some example embodiments, the controller may detect peaks in the output of the signal level detector and predict one or more subsequent peaks based on timing of the detected peaks. The controller may synchronize initiation of one or more masking time intervals at one or more predetermined times after the one or more subsequent peaks.
It should be understood, especially by those having ordinary skill in the art with the benefit of this disclosure, that the various operations described herein, particularly in connection with the figures, may be implemented by other circuitry or other hardware components. The order in which each operation of a given method is performed may be changed, and various elements of the systems illustrated herein may be added, reordered, combined, omitted, modified, etc. It is intended that this disclosure embrace all such modifications and changes and, accordingly, the above description should be regarded in an illustrative rather than a restrictive sense. Similarly, although this disclosure makes reference to specific embodiments, certain modifications and changes may be made to those embodiments without departing from the scope and coverage of this disclosure. Moreover, any benefits, advantages, or solutions to problems that are described herein with regard to specific embodiments are not intended to be construed as a critical, required, or essential feature or element.
While the disclosure has shown and described particular embodiments of the techniques disclosed herein, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the disclosure. For example, the disclosed system may be used to mask other artifacts in an audio system, such as an audio microphone signal preamplifier.
The present Application Claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application 63/156,088 filed on Mar. 3, 2021, the disclosure of which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
7627481 | Kuo | Dec 2009 | B1 |
10043527 | Gurijala | Aug 2018 | B1 |
10044323 | He et al. | Aug 2018 | B1 |
20090144054 | Sudhakar | Jun 2009 | A1 |
20150092967 | Fitz | Apr 2015 | A1 |
20200059214 | Perrott | Feb 2020 | A1 |
20210012763 | Wurtz | Jan 2021 | A1 |
20220284877 | He | Sep 2022 | A1 |
20230103164 | Leuenberger | Mar 2023 | A1 |
Number | Date | Country | |
---|---|---|---|
20220284877 A1 | Sep 2022 | US |
Number | Date | Country | |
---|---|---|---|
63156088 | Mar 2021 | US |