System for increasing perceived loudness of speakers

Information

  • Patent Grant
  • 10299040
  • Patent Number
    10,299,040
  • Date Filed
    Monday, November 13, 2017
    6 years ago
  • Date Issued
    Tuesday, May 21, 2019
    5 years ago
Abstract
A system can be provided for increasing loudness of an audio signal to present a perceived loudness to a listener that is greater than a loudness provided natively by a loudspeaker. The system can include one or more of the following: a frequency suppressor, a loudness adjuster, an equalizer, and a distortion control module. The frequency suppressor can increase headroom in the audio signal by filtering out low and/or high frequencies. The loudness adjuster can calculate a loudness of the audio signal and apply a gain to the audio signal to increase the loudness. The equalizer can further increase headroom by attenuating portions of a passband of the loudspeaker's frequency response. The distortion control module can induce partial harmonic distortion in the audio signal to further increase loudness.
Description
INCORPORATION BY REFERENCE TO ANY RELATED APPLICATIONS

Any and all applications, if any, for which a foreign or domestic priority claim is identified in the Application Data Sheet of the present application are hereby incorporated by reference under 37 CFR 1.57.


BACKGROUND

Physical size restrictions of portable media devices often force the size of the loudspeakers in such devices to be quite small. Small speaker drivers suffer from low output levels and generally cannot reproduce the entire audible frequency range. As amplitudes are increased, distortion is introduced and more battery power is consumed. The noisy environments in which these devices are typically used only contribute to the problem.


Existing solutions to combat the low levels emanating from these devices tend to involve the addition of hardware such as external speakers. These solutions work counter to the idea of portability by either increasing the bulk of a device that has been carefully designed to be small or by creating a greater number of gadgets to be carried around by consumers.


SUMMARY

In certain embodiments, a system is provided for increasing loudness of an audio signal to present a perceived loudness to a listener that is greater than a loudness provided natively by a loudspeaker. The system can include one or more of the following: a frequency suppressor, a loudness adjuster, an equalizer, and a distortion control module. The frequency suppressor can increase headroom in the audio signal by filtering out low and/or high frequencies. The loudness adjuster can calculate a loudness of the audio signal and apply a gain to the audio signal to increase the loudness. The equalizer can further increase headroom by attenuating portions of a passband of the loudspeaker's frequency response. The distortion control module can induce partial harmonic distortion in the audio signal to further increase loudness.


In certain embodiments, a system for increasing a loudness of an audio signal includes a frequency suppressor having one or more filters that can increase headroom in an electronic audio signal by filtering low and high frequencies of the electronic audio signal to produce a first filtered audio signal, where the low and high frequencies are substantially unreproducible by the speaker. The system can further include a loudness adjuster having a loudness analyzer that can calculate with one or more processors a loudness of the first filtered audio signal at least in part by processing the first filtered audio signal with one or more loudness filters that can approximate a human hearing system. The loudness analyzer can further compare the calculated loudness with a loudness reference level. The loudness adjuster can further include a gain control module that can compute one or more gains to be applied to the first filtered audio signal and to apply the one or more gains to the first filtered audio signal to produce an amplified audio signal. This computing of the one or more gains can be based at least partly on a difference between the calculated loudness and the loudness reference level. The system can further include a distortion control module that can induce partial harmonic distortion in the first filtered audio signal by at least mapping one or more samples of the first filtered audio signal to one or more values stored in a sum-of-sines table. The sum-of-sines table can be generated from a sum of lower-order harmonics.


In certain embodiments, a method of increasing perceived loudness of an audio signal can include receiving an electronic audio signal and processing the electronic audio signal with a frequency suppressor using one or more processors. The frequency suppressor can filter one or both of low frequencies and high frequencies of the electronic audio signal to produce a filtered audio signal, such that the filtered audio signal has increased headroom. The method can further include estimating a loudness of the filtered audio signal at least in part by processing the filtered audio signal with one or more loudness filters that can approximate a human hearing system to produce an estimated loudness of the audio signal. The method can further include computing one or more gains to be applied to the filtered audio signal based at least in part on the estimated loudness. Moreover, the method can include increasing loudness of the filtered audio signal by applying the one or more gains to the filtered audio signal.


In certain embodiments, a system for increasing a loudness of an audio signal includes a frequency suppressor having one or more filters that can increase headroom in an electronic audio signal by filtering one or both of low frequencies and high frequencies of the electronic audio signal to produce a filtered audio signal having a greater headroom than the electronic audio signal. The system can also include a loudness adjuster having a loudness analyzer that can estimate with one or more processors a loudness of the filtered audio signal and compare the calculated loudness with a loudness reference level. The loudness adjuster can also have a gain control module that can compute one or more gains based at least partly on a difference between the calculated loudness and the loudness reference level and to increase a loudness of the filtered audio signal by applying the one or more gains to the filtered audio signal to produce an amplified audio signal.


In certain embodiments, a computer-readable storage medium can be provided that has instructions stored thereon that cause one or more processors to perform a method of increasing perceived loudness of an audio signal. The method can include receiving an electronic audio signal and estimating a loudness of the electronic audio signal at least in part by processing the electronic audio signal with one or more loudness filters that can approximate a human hearing system to produce an estimated loudness of the audio signal. The method can also include computing one or more gains to be applied to the electronic audio signal based at least in part on the estimated loudness. The method can further include increasing perceived loudness of the electronic audio signal by applying the one or more gains to the electronic audio signal to produce an amplified audio signal. Moreover, the method can include increasing signal energy by inducing partial saturation in the amplified audio signal, wherein the inducing can include applying to the amplified audio signal a nonlinear transformation derived from a combination of harmonics.


In certain embodiments, a method of reducing clipping in an audio signal can include receiving an input audio signal, providing a sum-of-sines data structure having values generated from a sum of lower order harmonics, and using the sum-of-sines data structure with one or more processors to map the input audio signal to an output audio signal, such that at least some of the lower-order harmonics are added to the input audio signal. As a result, in certain embodiments at least a portion of the output audio signal has a greater energy than the input audio signal.


In certain embodiments, a method of increasing loudness of an audio signal can include receiving an electronic audio signal and processing the electronic audio signal with a frequency suppressor using one or more processors. The frequency suppressor can filter one or both of low and high frequencies of the electronic audio signal to produce a filtered audio signal, such that the filtered audio signal has increased headroom over the electronic audio signal. In certain embodiments, the frequency suppressor is not a crossover filter. The method can also include deriving one or more gains to apply to the filtered audio signal based at least in part on the increased headroom and applying one or more gains to the filtered audio signal to increase a loudness of the audio signal.


In certain embodiments, a method of increasing loudness of an audio signal includes receiving an electronic audio signal and providing an equalization filter having a frequency response that can attenuate passband areas of the electronic audio signal. The passband areas can correspond to areas of a frequency response of a speaker that are less reproducible by a loudspeaker. The method can also include applying the equalization filter to the electronic audio signal using one or more processors to increase headroom in the electronic audio signal. Moreover, the method can include using the increased headroom in the electronic audio signal to increase loudness of the electronic audio signal.


For purposes of summarizing the disclosure, certain aspects, advantages and novel features of the inventions have been described herein. It is to be understood that not necessarily all such advantages may be achieved in accordance with any particular embodiment of the inventions disclosed herein. Thus, the inventions disclosed herein may be embodied or carried out in a manner that achieves or optimizes one advantage or group of advantages as taught herein without necessarily achieving other advantages as may be taught or suggested herein.





BRIEF DESCRIPTION OF THE DRAWINGS

Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. The drawings are provided to illustrate embodiments of the inventions described herein and not to limit the scope thereof.



FIG. 1 illustrates an embodiment of a system for increasing the perceived loudness of audio signals;



FIG. 2 illustrates an embodiment of a frequency suppressor of the system of FIG. 1;



FIG. 3 illustrates example frequency spectrums of audio signals before and after frequency suppression by the frequency suppressor;



FIG. 4 illustrates example time domain representations of the audio signals of FIG. 3;



FIG. 5 illustrates an embodiment of a loudness adjuster of the system of FIG. 1;



FIG. 6 illustrates a chart showing example equal loudness curves;



FIG. 7 illustrates example frequency spectrums of audio signals having increased gain based on loudness adjustment of the loudness adjuster;



FIG. 8 illustrates example time domain representations of the audio signals of FIG. 7;



FIG. 9 illustrates an example equalizer of the system of FIG. 1;



FIG. 10 illustrates an example distortion control module of the system of FIG. 1;



FIG. 11 illustrates an example time domain representation of a sine wave;



FIG. 12 illustrates an example frequency spectrum of the sine wave of FIG. 11;



FIG. 13 illustrates an example time domain representation of a clipped sine wave;



FIG. 14 illustrates an example frequency spectrum of the clipped sine wave of FIG. 13;



FIG. 15 illustrates an example frequency spectrum having a reduced number of harmonics compared to the clipped sine wave spectrum of FIG. 14;



FIG. 16 illustrates an example time domain representation of a partially saturated wave corresponding to the spectrum of FIG. 15;



FIG. 17 illustrates an embodiment of a sum-of-sines mapping function; and



FIG. 18 illustrates an example time domain representation of an audio signal and a distortion controlled version of the signal.





DETAILED DESCRIPTION

I. Introduction


Mobile phones and other similar-sized devices tend to have small speakers that are limited in the volume of sound they produce. In the presence of background noise, it can therefore be difficult to hear a conversation, music, and other audio on a mobile phone.


This disclosure describes systems and methods for increasing the perceived loudness of speakers. These systems and methods can be used to cause speakers to sound louder than may be achieved by merely increasing volume. In certain embodiments, headroom of an audio signal is increased to prepare the audio signal to be adjusted for loudness. Headroom can be increased by filtering out frequencies the speaker cannot reproduce so that additional amplification levels may be available for the signal. The audio signal may then be analyzed according to one or more perceptual loudness curves to determine how loud the audio signal may be perceived. In cases where the perceived loudness may be lower, the gain of at least portions of the audio signal may be increased.


To further increase the loudness of the audio signal, in certain embodiments a distortion control process may be used. The distortion control process may add extra energy to the audio signal by inducing selected distortion. Distortion control may be performed in certain embodiments by mapping the audio signal to an output signal that has additional harmonics but fewer harmonics than a fully-saturated signal.


II. System Overview



FIG. 1 illustrates an embodiment of a loudness adjustment system 100 for adjusting the perceived loudness of audio signals. The loudness adjustment system 100 may be implemented in any audio system or processor-based system, such as a mobile phone, personal digital assistant (PDA), music player (e.g., MP3 players), television, or in any computing device, such as a laptop, desktop, tablet, or the like. Advantageously, in certain embodiments, the loudness adjustment system 100 may cause speakers to sound louder than may be achieved by merely increasing volume.


The depicted embodiment of the loudness adjustment system 100 includes a frequency suppressor 110, a loudness adjuster 120, an equalizer 130, and a distortion control module 140. Each of these components may be implemented in a machine having hardware and/or software. For example, these components may be implemented in one or more processors.


The frequency suppressor 110 receives an audio input signal and can filter out or suppress certain frequencies of the audio input signal. Low and high frequency signals, for example, are un-reproducible or less-reproducible by many small or low-quality speakers. If low or high frequency sounds are provided to such a speaker, the speaker might still attempt to reproduce the sounds even though the sounds would be inaudible. The unnecessary movement of the speaker in attempting to reproduce these frequencies can create distortion.


Thus, the frequency suppressor 110 in certain embodiments removes or attenuates certain of these less-reproducible frequencies. By filtering out less-reproducible frequencies, the frequency suppressor 110 may reduce distortion and also increase the headroom of the audio signal. The headroom of the audio signal can include a difference between a peak value of the audio signal and a saturation point of the audio signal. In a digital audio system, the saturation point might be 0 dB. In some embodiments, the frequency suppressor 110 does not increase headroom but does reduce the energy in the less-reproducible frequencies, allowing energy to be applied by the loudness adjuster 120 to the more reproducible frequencies.


The frequency suppressor 110 may include one or more filters (see, e.g., FIG. 2) to facilitate the removal of low and/or high frequencies. The cutoff frequencies of the filters and other filter characteristics may be speaker dependent, as different speakers may be able to reproduce different frequencies. The cutoff frequencies can be selected for various speakers by experimentation. For instance, a test signal may be supplied to a speaker, and audible frequencies may be detected in the frequency response. Thus, the frequency suppressor 110 may be customized for a particular speaker or speakers. The frequency suppressor 110 may also dynamically adjust the filters based on what type of speaker is used with the loudness adjustment system 100.


In certain embodiments, the frequency suppressor 110 may be used to filter out frequencies that are reproducible to provide additional headroom. The frequency suppressor 110 may perform this filtering even with speakers that are able to reproduce most frequencies. The increased headroom may allow greater loudness adjustment with a tradeoff in potentially less fidelity. This tradeoff may be acceptable in certain audio applications, such as in mobile phone applications.


Once the frequency suppressor 110 has filtered out certain frequencies from the audio input signal, the loudness adjuster 120 can use the newly added digital headroom to increase the loudness of the signal. Loudness can be an attribute of the human auditory system that allows for classification of sounds on a scale from quiet to loud. Perceived loudness may vary with frequency, unlike sound pressure levels measured in decibels (dB) (see FIG. 6). The loudness adjuster 120 in certain embodiments uses a psychoacoustic model of the human auditory system to determine a loudness of the filtered audio signal and to increase this loudness.


The loudness adjuster 120 may use perceived loudness information to apply one or more gains that can raise the level (e.g., the average level) of the reproducible frequency region in the filtered signal. In certain embodiments, the loudness adjuster of 120 uses certain of the loudness adjustment techniques described in U.S. patent application Ser. No. 12/340,364, filed Dec. 19, 2008, entitled “System for Adjusting Perceived Loudness of Audio Signals” (hereinafter “the '364 application”), the disclosure of which is hereby incorporated by reference in its entirety. More details on these techniques described in the '364 application are incorporated specifically by reference below.


In alternative embodiments, the loudness adjuster 120 may apply a gain to the filtered signal without determining perceived loudness. This gain may be about the same as the amount of headroom obtained by the frequency suppressor 110. The gain may also be more or less than the value of the headroom.


The loudness adjuster 120 provides an amplified signal to the equalizer 130. The equalizer 130 may be a parametric equalizer or the like that includes one or more filters for compensating or attempting to compensate for imperfections in the frequency response of the speaker. Because most speakers do not exhibit an ideal flat frequency response for all audible frequencies, the equalizer 130 can flatten peaks or valleys in the frequency response of the speaker in order to make the speaker act as though it had a more ideal response.


In some embodiments, parameters of the one or more filters of the equalizer 130, such as center frequency, roll-off, gain, and the like, can be selected by experimentation. For instance, a test signal may be supplied to the speaker, and peaks and valleys may be detected in the frequency response. The filter parameters may be selected so as to compensate for the peaks and valleys. The equalizer 130 filter may include multiple bands each having possibly different gains, for example, that are the inverse of the peaks and/or valleys, in order to produce a flatter response. The equalizer 130 may be able to dynamically select filter parameters based at least partly on the type of speaker used with the loudness adjustment system 100. Then, when the loudness adjuster 120 supplies an amplified audio signal to the equalizer 130, the equalizer 130 can apply the one or more filters created during the speaker testing phase.


In certain embodiments, the distortion control module 140 further increases the energy in the audio signal to cause the signal to sound louder. The distortion control module 140 may increase the signal energy by increasing the amplitude of certain portions of the audio signal and by applying selected distortion to certain portions of the audio signal. The distortion control module 140 can provide selected distortion by inducing harmonics in the audio signal. In certain embodiments, however, the distortion control module 140 induces fewer harmonics in the audio signal than are present in a fully-saturated or clipped signal. Thus, in certain embodiments, the distortion control module 140 uses a form of soft clipping to increase signal energy.


In one embodiment, the distortion control module 140 maps input samples to output samples using a mapping table or the like. The distortion control module 140 may map the signal linearly or approximately linearly for samples that are relatively lower in amplitude, such as samples that are not close to a peak value (e.g., 0 dB). The linear mapping can increase the amplitude of these samples. For samples that are close to the peak value, the distortion control module 140 may map the samples nonlinearly to induce some, but not full, harmonic distortion.


As a result, in certain embodiments, the distortion control module 140 can transform the audio signal into a louder audio signal with some but not excessive distortion. The tradeoff in some distortion versus greater loudness may be appreciated by some listeners. For example, when a listener uses a phone with a small speaker, the distortion control module 140 may cause a voice conversation to sound louder with little or no reduction in audio quality.


The distortion control module 140 may also be used to reduce or soften clipping in signals that are already saturated. Saturation or clipping might be caused by the equalizer 130 and/or the loudness adjuster 120, for instance. The distortion control module 140 may soften the clipping to reduce at least some of the distortion, while also preserving at least some of the increased signal energy provided by the loudness adjuster 120 and/or equalizer 130.


The features described above with respect to FIG. 1 may be varied in some embodiments. For instance, the equalizer 130 may be used to further reduce valleys in a speaker's frequency response instead of compensating for the valleys. Valleys in a speaker's response can indicate frequency regions that are less reproducible by a speaker. To save additional energy and/or headroom, the equalizer 130 can attenuate the valleys further. As a result, the speaker may produce little or no energy for those frequencies. Further, the equalizer 130 may be placed between the frequency suppressor 110 and the loudness adjuster 120 instead of after the loudness adjuster 120. Thus, the energy saved by the equalizer can be used by the loudness adjuster 120 to increase the loudness of other, more reproducible frequencies of the audio signal. The resulting output signal may have less audio fidelity but may sound louder, which could be useful for phone applications, among others.


In alternative embodiments, the equalizer 130 might be removed entirely from the loudness adjustment system 100. Similarly, any one of the components shown might not be included in a specific implementation. The loudness adjuster 120, for example, could be replaced with an overall gain that can be based at least partly on the amount of energy saved by the frequency suppressor 110 and/or equalizer 130. Moreover, in some instances, the loudness adjuster 120 and/or the distortion control module 140 may be replaced with a limiter or dynamic range compressor. Many other configurations may also be used.


Example implementations for each of the depicted components of the loudness adjustment system 100 will now be described in greater detail.


III. Frequency Suppression


Referring to FIG. 2, an example embodiment of a frequency suppressor 210 is shown. The frequency suppressor 210 may include all the features described above with respect to the frequency suppressor 110. The frequency suppressor 210 may be implemented in hardware and/or software.


Advantageously, in certain embodiments, the frequency suppressor 210 removes or reduces certain less-reproducible frequencies of an input signal 202, thereby increasing headroom and decreasing distortion in the input signal. Thus, in certain embodiments, the frequency suppressor 210 transforms data representing a physical audio signal into data representing another physical audio signal with increased headroom. In addition, another potential advantage of frequency suppression in certain embodiments is that an analog amplifier that provides an amplified signal to a speaker may not be driven as hard.


The frequency suppressor 210 includes filters 212, 214 for suppressing or reducing frequency content of an input signal 202. In the depicted embodiment, these filters 212, 214 include a high pass filter 212 and a low pass filter 214. The high pass filter 212 attenuates lower frequencies of the input signal 202, while the low pass filter 214 attenuates higher frequencies of the input signal 202 to produce an output signal 226. The order of the two filters 212, 214 may be reversed. Moreover, a band pass filter may be used in place of the two filters 212, 214 shown.


A filter controller 222 can dynamically adjust the cutoff frequencies, order, and other parameters of the filters 212, 214 based at least partly on speaker data obtained from a data repository 224. The data repository 224 may include one or more tables of filter parameters that correspond to different speakers. This data may be obtained by testing various speakers. A speaker can be tested by applying a pink noise signal or the like to the speaker and then measuring the output of the speaker using a microphone. The resulting frequency response can then be analyzed to determine which cutoff frequency, filter order, and/or other filter parameters could be effective in reducing less-reproducible frequencies.


The filter controller 222 can therefore select the appropriate cutoff frequencies, filter orders, and other parameters from the speaker data based at least partly on the type of speaker used with the frequency suppressor 210. Information about the type of speaker used may be supplied to the filter controller 222 by a manufacturer of a device that incorporates the frequency suppressor 210. A user interface could be provided with the loudness adjustment system 100, for example, that allows a manufacturer or user to tune various parameters of the frequency suppressor 210 and other components in the loudness adjustment system 100. In alternative embodiments, the filters 212, 214 are hardcoded with specific cutoff frequencies and/or filter orders and the filter controller 222 is not included with the frequency suppressor 210.


In certain embodiments, the frequency suppressor 210 is not a crossover filter. Whereas crossover filters are often used to split an audio signal into separate frequency bands that can be handled by different loudspeakers, the frequency suppressor 210 is used in certain embodiments to filter an audio signal that will be provided to a single loudspeaker. When driving a single speaker, currently-available devices may not remove the less reproducible frequencies from the audio signal. However, the frequency suppressor 210 advantageously removes these frequencies and/or other frequencies in certain embodiments and thereby increases headroom over currently-available single-speaker implementations. Moreover, crossover filters are typically used as the last (or nearly last) audio stage in an audio system, often providing a filtered signal directly to the loudspeakers. In contrast, in certain embodiments, the frequency suppressor 210 is a much earlier stage in an audio system, e.g., as shown in FIG. 1.



FIGS. 3 and 4 illustrate example plots 300, 400 of input and output signals of a frequency suppressor, such as the frequency suppressor 110 or 210. Referring to FIG. 3, an example plot 300 of an input signal frequency spectrum 302 and an output signal frequency spectrum 304 are shown. The input signal frequency spectrum 302 includes energy in the lower frequencies 302a and higher frequencies 302b that may not be reproducible by a given speaker. The less-reproducible low and high frequencies 302a, 302b have been attenuated in the output frequency spectrum 304 by the frequency suppressor 110 or 210. Removing or attenuating this energy can increase headroom for the output signal.


Time domain representations of these signals are shown in FIG. 4. In the plot 400 of FIG. 4, an input signal 402 corresponds to the input signal spectrum 302, and an output signal 404 corresponds to the output signal spectrum 304. As can be seen, a peak level 406 and average level of the input signal 402 have been reduced to the peak level 408 and average level in the output signal 404. This additional headroom leaves more room to increase the volume of the reproducible spectrum of the output signal 404.


IV. Loudness Adjustment


Using the additional headroom provided by the frequency suppressor 110 or 210, the loudness of an audio signal can be increased. FIG. 5 illustrates a more detailed example of a loudness adjuster 520, which may have all of the features of the loudness adjuster 120 described above. The loudness adjuster 520 may be implemented in hardware and/or software. Advantageously, in certain embodiments, the loudness adjuster 520 can apply one or more gains to an audio signal that increase the perceived loudness of the signal to a listener. Thus, in certain embodiments, the loudness adjuster 520 transforms data representing a physical audio signal into data representing another physical audio signal with increased loudness.


The human hearing system is often most sensitive to mid-range frequencies (for example, 250 Hz-5000 Hz). When two sounds, such as a bass sound and a midrange sound, are played at the same level or sound pressure level (SPL) as measured in decibels (dB SPL), the listener can perceive the midrange sound to be louder. A chart 600 in FIG. 6 illustrates example equal loudness curves 602 that demonstrate how a low frequency (20 Hz) might need an additional 50 dB SPL in order for someone to perceive it as being equally loud relative to a midrange frequency of 300 Hz. The fact that a very low frequency tone may not sound as loud to someone as a mid or even high frequency tone means that a midrange signal such as 300 Hz can have a greater effect in perceiving something is loud than a 20 Hz signal. Thus, in some implementations, the loudness adjuster 520 emphasizes mid-range frequencies to increase a perception of loudness.


Referring again to FIG. 5, the output signal 226 of the frequency suppressor can be provided as an input signal 502 to the loudness adjuster 520. The depicted embodiment of the loudness adjuster 520 includes a loudness analyzer 514 and a gain control module 516. The loudness analyzer 514 can estimate loudness of the input signal 502. In certain embodiments, the loudness analyzer 514 uses a nonlinear multiband model of the human hearing system to analyze the loudness characteristics of the audio input signal 502. This model can simulate the filter bank behavior of the human peripheral auditory system at least in part by applying one or more loudness filters to the input signal 202. In an embodiment, the loudness analyzer 514 can use some or all of the loudness calculation techniques described in paragraphs [0069] through [0083] of the '364 application, which paragraphs are specifically incorporated by reference herein in their entirety. For example, the loudness analyzer 514 may approximate one or more gammatone filters and use a power law function to estimate loudness.


The loudness analyzer 514 can operate on sample blocks of the input signal 502. The loudness analyzer 514 can estimate a loudness for each sample block. The loudness analyzer 514 can compare the estimated loudness of the sample block with a reference loudness level. The reference loudness level may be a peak allowable loudness level, which may be 0 dB in some digital systems. If the estimated loudness differs from the reference loudness level, the loudness analyzer 514 can output the level difference between the estimated loudness and the reference level. The gain control module 516 can use this level difference to apply one or more gains to the audio input signal 502, e.g., via a multiplication block 524. In some embodiments, the gain control module 516 can use some or all of the gain control techniques described in paragraphs [0084] through [0091] of the '364 application, which are specifically incorporated by reference herein in their entirety. For example, the gain control module 516 can dynamically generate gain coefficients based on changing loudness levels and can smooth the gain coefficients to avoid abrupt changes in gain.


Thus, in certain embodiments, the loudness adjuster 520 estimates loudness and calculates one or more gains as a function of frequency. The loudness adjuster 520 may then apply the one or more gains to each sample in the sample block. Thus, the gains may be applied in the time domain. In alternative embodiments, the loudness adjuster 520 can partition the input signal 502 into frequency bands and apply different gains to various frequency bands. In still other embodiments, the loudness adjuster 520 may apply a gain to the input signal 502 that is about the same value as the increase in headroom provided by the frequency suppressor 110 or 210.


Additional features may be included in the loudness adjuster 520 for reducing computing resource usage. For example, the preprocessing module described in the '364 application may be provided in some embodiments. Paragraphs [0030] and [0040] through [0044], which describe embodiments of the preprocessing module, are hereby specifically incorporated by reference herein in their entirety. Likewise, other modifications and features may be provided.


When the gain or gains are applied by the gain control module 516, the overall average level of the reproducible frequency region can be raised certain dBs. Alternatively, portions of the reproducible frequency region may be raised at different levels than other portions. In FIG. 7, a plot 700 shows an example boosted reproducible region 706 of a frequency spectrum 704 compared with the original frequency spectrum 302 of FIG. 3. FIG. 8 illustrates a plot 800 showing example time domain representations of the audio signals of FIG. 7. In FIG. 8, the original signal 402 is shown above the loudness-adjusted signal 810. It can be seen that a peak level 812 of the loudness-adjusted signal 812 has returned to match the original signal's 402 peak level 406, but the average level of the signal has increased. Thus, a listener's perception of loudness can increase.


V. Equalization



FIG. 9 illustrates an example equalizer 930, which may have all of the features of the equalizer 130 described above. The equalizer 930 may be implemented in hardware and/or software. Advantageously, in certain embodiments, the equalizer 930 can apply one or more gains to an audio signal that compensate or attempt to compensate for imperfections in the frequency response of a speaker. Alternatively, the equalizer 930 can apply one or more gains that further attenuate valleys in the frequency response of a speaker.


The equalizer 930 may be a parametric equalizer or the like that includes one or more equalization filters 912. In one implementation, the equalization filter 912 can apply one or more filters to an input signal 902 received from the loudness adjuster 120 or 520, which can flatten peaks or valleys in the frequency response of the speaker. As a result, the filter 912 can apply gains that increase and/or attenuate portions of the input signal's 902 frequency spectrum. The filters 912 may apply gains to the valleys, for instance, that raise the valleys to the levels of the peaks.


The one or more equalization filters 912 may include one or more band pass filters, implemented, for example, using biquad Infinite Impulse Response (IIR) filters or the like. The one or more equalization filters 912 might instead include one or more of the equalization filters described in U.S. Publication No. 2008/0240467, filed Mar. 7, 2008, titled “Frequency-Warped Audio Equalizer,” the disclosure of which is hereby incorporated by reference in its entirety. Other types of equalization filters may also be used.


A parameter selector 914 can provide filter parameters, such as gain coefficients, center frequencies, and the like, for the one or more equalization filters 912 based at least partly on speaker data stored in a data repository 916. In some embodiments, these speaker parameters can be selected by experimentation. For instance, a test signal may be supplied to a speaker, and frequencies and magnitudes of peaks and valleys may be detected in the frequency response. The filter parameters may be selected so as to compensate for the peaks and valleys. The parameter selector 914 may select gains at selected center frequencies, for example, that are the inverse of the peaks and/or valleys, in order to produce a flatter response.


The parameter selector 914 may be able to dynamically select filter parameters based at least partly on the type of speaker used. Information about the type of speaker used may be supplied to the parameter selector 914 by a manufacturer of a device that incorporates the equalizer 930. In alternative embodiments, the equalization filter 912 is hardcoded with specific filter parameters, and the parameter selector 914 is not included with the equalizer 930.


In alternative embodiments, the equalizer 930 may instead be used to further attenuate valleys in a speaker's frequency response instead of increasing a gain of the valleys. For example, the equalizer 930 may attenuate frequencies in a passband range of the speaker's frequency response. Attenuating the valleys can allow additional energy and/or headroom to be obtained. As a result, the speaker may produce little or no energy for those frequencies. The parameter selector 914 may, for instance, select gains at selected center frequencies of the valleys that attenuate the valleys. The one or more equalization filters 912 may instead be hardcoded with the appropriate gains. The energy saved by the equalizer 930 can be used by the loudness adjuster 120 to increase the loudness of other, more reproducible frequencies of the audio signal. The resulting output signal may have less audio fidelity but may sound louder, which can be a desirable outcome for some audio signals such as ringtones, voice, and the like.


Moreover, in some implementations the equalizer 930 attenuates one or more peaks in the speaker's frequency response instead of or in addition to attenuating valleys. Attenuating one or more peaks can also increase headroom.


VI. Distortion Control



FIG. 10 illustrates a more detailed embodiment of a distortion control module 1040, which may have all of the features of the distortion control module 140 described above. The distortion control module 1040 may be implemented in hardware and/or software. In certain embodiments, the distortion control module 1040 can induce selected distortion in the audio signal to increase signal energy and hence loudness. This selected distortion may be a controlled distortion that adds fewer harmonics than are present in fully-saturated signals.


As described above, the distortion control module 1040 may induce selected distortion at least in part by mapping input samples into output samples. The distortion control module 1040 can perform this mapping by using samples of the input signal 1002 as indices into a sum-of-sines table 1014 or tables. The sum-of-sines table 1014 can include values that are generated by summing harmonically-related sine waves.


To illustrate, if the input signal 702 has a sample with a value m, the distortion control module 1040 can map the input sample to an output sample at an index m in the sum-of-sines table 1014. If the sample of the input signal 1002 falls between index values of the table 1014, the distortion control module 1040 can interpolate an index value. Using interpolation can allow the size of the sum-of-sines table 1014 to be reduced in order to save memory. However, the sum-of-sines table 1014 may be designed to be large enough so as to avoid the use of interpolation in certain embodiments. The distortion control module 1040 can use the mapped output value of the sum-of-sines table 1014 as an output sample for the output signal 1022.


The sum-of-sines table 1014 may be implemented as any data structure, such as an array, matrix, or the like. The table 1014 can be generated to include an arbitrary number of harmonic sine waves, including odd harmonics, even harmonics, or a combination of both. In certain embodiments, odd harmonics provide good distortion control for voice audio signals. Even harmonics may be used in other implementations and may be good for reducing clipping in music signals. Either odd or even harmonics may be used for mixed voice and music signals. However, these are merely illustrative examples, and either odd or even harmonics or both could be used for any application.


When more sine waves are used to generate the table 1014, the potential increase in signal energy and distortion is greater, and vice versa. As using a large number of sine waves could result in significant harmonic distortion, in certain embodiments, a relatively small number of lower-frequency sine waves are beneficially used to construct the sum-of-sines table 1014.


For instance, the table 1014 can be constructed from the sum of two or three harmonically-related sine waves, four sine waves, five sine waves, or more. Multiple sum-of-sines tables 1014 may be stored in a memory and may be used by the distortion control module 1040 for different purposes. For example, a sum-of-sines table 1014 with more harmonics might be used for voice signals while a table 1014 with fewer harmonics might be used for music to create less distortion.


The distortion control module 1040 may also provide a user interface that provides a distortion control for a user to adjust the amount of signal energy increase and/or distortion. For example, a graphical slider, knob, or the like may be provided, or the user may be able to press a physical or soft button to adjust the amount of energy increase or distortion applied. Increasing the distortion control could cause a table with more harmonics to be used, and vice versa.


An example process for generating a sum-of-sines table 1014 will now be described, using three odd-harmonically related sine waves. In this example, the sum-of-sines table 1014 can be generated by populating a first table of a selected size with values of one period of a sine wave (e.g., from 0 radians to 2pi). Populating a table of size N (N being an integer) may include dividing one period of the sine wave into N values and assigning the N values to the N slots in the table. This first sine wave table can represent the fundamental or first harmonic.


A second table of the same size as the first table may be populated with three periods of a sine wave in a similar fashion, by dividing the three sine periods into N values. The values in the second table may represent the third harmonic of the first sine wave. Similarly, a third table of the same size as the first two may be populated with five periods of a sine wave, representing the fifth harmonic. The values in the first, second, and third tables may be scaled as desired. For instance, the values in the second table may be scaled lower to be lower in magnitude than those in the first table, and values in the third table may be scaled to include lower values than the second table.


Because the three tables are the same size in certain embodiments (e.g., have the same number of N entries), the values in corresponding indices of the three tables may be added together to create a new sum-of-sines table 1014 that includes the sum of the first, third, and fifth harmonics. Thus, if one were to plot the values in the sum-of-sines table 1014, in certain embodiments, an approximation of one period of the summed waves would be shown. The more sine waves that are used, in certain embodiments, the closer this plotted wave would look like a square wave. In various embodiments, other sum-of-sines tables with different harmonics may be constructed in a similar fashion to that described for three odd harmonics. Alternatively, portions of sine wave periods may be used, rather than full periods, to construct the sum-of-sines table 1014.


As the distortion control module 1040 maps samples from the input 1002 signal into the sum-of-sines table 1014, the frequency of the harmonics in the table 1014 may depend on the table lookup rate, which in turn can depend on the frequency of the input signal. This frequency dependence results in certain embodiments from the table-lookup operation being performed by the distortion control module 1040 at or near the same rate as the frequency of the input signal 1002.


To illustrate, for a simple sine wave input signal 1002 having a given frequency, the distortion control module 1040 could perform the mapping operation at the same frequency. The resulting harmonics would have particular frequencies that depend on the frequency of the sine wave. Doubling the frequency of the sine wave could therefore double the frequency of the harmonics. For input signals 1002 that include multiple frequencies superimposed, the mapping by the distortion control module 1040 could result in a superposition of harmonics.



FIGS. 11 through 17 illustrate examples of distortion and sum of sines waves. For reference, FIG. 11 illustrates an example time domain plot 1100 of a sine wave 1102. A peak level 1104 of the sine wave 1102 without clipping is shown. The peak level 1104 of the sine wave 1102 is at 0 db, which can be a peak possible digital level in some embodiments. FIG. 12 illustrates an example plot 1200 showing a frequency spectrum 1202 of the sine wave 1102 of FIG. 11. As it is a sinusoid, one frequency is represented.


In certain embodiments, increasing the amplitude of the sine wave 1102 beyond the peak level can result in hard clipping. Hard clipping of a sinusoid 1302 is shown in a plot 1300 of FIG. 13. The clipped sinusoid 1302 includes clipped portions 1304, which are saturated at the peak level. Examples of harmonics 1404 of the clipped sine wave 1302 can be seen in the frequency domain representation 1402 shown in FIG. 14. As shown, the harmonics 1404 can extend as high as the sampling frequency (about 22 kHz in the example FIGURE shown). Certain of the harmonics 1406 are also aliased, causing further distortion.


To avoid the full distortion of hard clipping while still allowing an increase in volume, the distortion control module 1040 can use a composite wave of lower-frequency harmonics, as described above. An example set of harmonics of such a wave is illustrated in FIG. 15, which includes an example frequency response plot 1500 of a composite wave that may be generated in response to a 400 Hz input sine wave. The spectrum in the plot 1500 includes fewer harmonics 1502 than in the full clipping scenario of FIG. 14. In the depicted embodiment, five harmonics 1502 have been generated. The highest harmonic 1502 is at a lower frequency than the high frequency harmonics 1404 of FIG. 14. Aliased harmonics 1406 are also not present in this embodiment.


The example embodiment shown includes harmonics 1502 at about 400 Hz, 1200 Hz, 2000 Hz, 2800 Hz, and 3600 Hz. These harmonics 1502 are odd harmonics 1502, which include the first 1504, third 1506, fifth 1508, seventh 1510, and ninth harmonic 1512. The first harmonic 1504 has an amplitude of about 0 dB, which in certain embodiments, is a highest possible digital amplitude. Successive harmonics 1502 have lower amplitudes as the frequency increases. In an embodiment, the amplitude of the harmonics 1502 decreases monotonically. These amplitudes may vary in other embodiments.


The result of the controlled distortion provided by lower frequency harmonics can be a rounded and more natural sounding waveform with a higher signal energy or higher average signal energy. An example time domain plot 1600 of a wave 1602 illustrating a sine wave mapped to the harmonics 1504 of FIG. 15 is shown in FIG. 16. The example wave 1602 shown has partially clipped portions 1606 and rounded portions 1608. Comparison between the wave 1602 and the hard clipped wave 1302 shows that the wave 1602 is more rounded than the hard clipped wave 1302. In addition, portions 1604 of the wave 1602 are linear or approximately linear. The curved portions 1608 begin curving at about −3 dB from the clipped portions 1606.



FIG. 17 illustrates an example plot 1700 that depicts an embodiment of a sum-of-sines mapping function 1710. The sum-of-sines mapping function 1710 shown may be plotted by plotting values in a sum-of-sines table, such as the table 1014 described above. The sum-of-sines mapping function 1710 includes one quarter of a period of a sum-of-sines wave. One quarter of a sum-of-sines wave may be used instead of a full wave for an optimization, which will be described below.


Input signal values are depicted on the x-axis, which include positive amplitude values ranging from 0 to 1. Similarly, output signal values are depicted on the y-axis and also include amplitude values ranging from 0 to 1. Negative amplitude values will be described below. When the distortion control module 140 or 1040 maps an input sample to an output sample, in certain embodiments the input sample is mapped to a point on the mapping function 1710. The mapped output sample may have a greater or lower value than the input sample, depending on where the input sample is mapped.


For clarity, the sum-of-sines mapping function 1710 is shown as a continuous function. However, when implemented in a digital system, the mapping function 1710 may be discrete. In addition, as described above, the mapping function 1710 may not be defined for all input signal values. Thus, the distortion control module 140 or 1040 may interpolate output signal values, for example, between the two nearest points on the mapping function 1710.


A phantom line 1720 is shown for reference, which corresponds to the line y=x. If input samples were to be mapped according to the phantom line 1720, the output samples would be the same as the input samples. The mapping function 1710 includes a linear or approximately linear mapping region 1712 and a nonlinear or approximately nonlinear mapping region 1714. As input sample values falling in the linear mapping region 1712 increase in value, the corresponding output samples in the linear mapping region 1712 increase linearly or substantially linearly. Certain input sample values falling in the nonlinear region 1714 increase nonlinearly or substantially nonlinearly, having varying levels of increase 1714.


Most values of the mapping function 1710 are greater than the phantom line 1720, such that most input samples may be mapped to greater values. However, in region 1716 of the nonlinear mapping region 1714, the values of the mapping function 1710 are less than or equal to the phantom line 1720. In this region 1716, input samples are mapped to lower values. Thus, for example, hard-clipped samples (e.g., having a value of 1.0 or close to 1.0) may be reduced in value.


As mentioned above, the mapping function 1710 includes one quarter of a sum-of-sines wave instead of a full wave. Using a quarter wave (or even half wave) can enable the size of the sum-of-sines table 1014 to be reduced, thereby saving memory. For negative input signal values (e.g., on a scale of (1−,0) or the like), the distortion control module 140, 1040 may reverse the mapping function 1710 across the x-axis and invert the mapping function 1710 across the y-axis. Thereafter, the distortion control module 140, 1040 can apply the mapping function 1710 to the input samples. Alternatively, negative values can be inverted and normalized to the [0, 1] range. Then the mapping function 1710 may be applied, and the resulting output samples can be negated to recover the negative values.


In alternative embodiments, the mapping function 1710 shown may look different depending, for example, on the number of harmonics used to generate the sum-of-sines table 1014. For instance, the linear mapping region 1712 may have a greater or lesser slope. The nonlinear mapping region 1714 may be shaped differently; for example, it may have fewer peaks. Likewise, the region 1716 may be lower or greater in amplitude.


In certain embodiments, the ranges of the x and/or y axis may differ from the [0, 1] ranges described above. Decreasing the x-axis range to [0,a], where a is less than 1, can increase amplification of at least part of the input signal. Conversely, increasing the x-axis range from [0,b], where b is greater than 1, can decrease amplification of at least part of the input signal. Using a value of b that is greater than 1 can beneficially reduce clipping in some embodiments. Similarly, the y axis may be changed to [0,c], where c is less than or greater than 1.



FIG. 18 illustrates a plot 1800 of an example time domain representation of an audio signal 1812 before distortion control is applied. In addition, FIG. 18 shows an example time domain representation of the same audio signal 1814 after distortion control is applied. Approximately 6 dB of additional gain has been introduced into this waveform by using an example implementation of distortion control.


Distortion control may be used for other applications. For example, distortion control may be used to increase bass volume with reduced distortion. Distortion control may also be used in frequency spreading applications. Moreover, distortion control may be used to synthesize instrument sounds or other sounds, for example, by selecting various harmonics to create a desired timbre of an instrument.


VII. Conclusion


Depending on the embodiment, certain acts, events, or functions of any of the algorithms described herein can be performed in a different sequence, may be added, merged, or left out all together (e.g., not all described acts or events are necessary for the practice of the algorithm). Moreover, in certain embodiments, acts or events may be performed concurrently, e.g., through multi-threaded processing, interrupt processing, or multiple processors or processor cores, rather than sequentially.


The various illustrative logical blocks, modules, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. The described functionality may be implemented in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosure.


The various illustrative logical blocks and modules described in connection with the embodiments disclosed herein may be implemented or performed by a machine, such as a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be a processor, controller, microcontroller, or state machine, combinations of the same, or the like. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.


The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of computer-readable storage medium known in the art. An exemplary storage medium can be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.


Conditional language used herein, such as, among others, “can,” “could,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or states. Thus, such conditional language is not generally intended to imply that features, elements and/or states are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or states are included or are to be performed in any particular embodiment.


While the above detailed description has shown, described, and pointed out novel features as applied to various embodiments, it will be understood that various omissions, substitutions, and changes in the form and details of the devices or algorithms illustrated may be made without departing from the spirit of the disclosure. As will be recognized, certain embodiments of the inventions described herein may be embodied within a form that does not provide all of the features and benefits set forth herein, as some features may be used or practiced separately from others. The scope of certain inventions disclosed herein is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims
  • 1. A method of limiting an audio signal, the method comprising: under control of a hardware processor, receiving an input audio signal;applying a limiter to the input audio signal to produce a limited audio signal; andapplying a clipping reduction to the limited audio signal to increase signal energy in the limited audio signal compared to the input audio signal, the clipping reduction comprising mapping the limited audio signal into a data structure to produce an output signal, the data structure comprising values representing a sum of sine waves; andoutputting the output signal to a speaker.
  • 2. The method of claim 1, wherein said applying the clipping reduction further comprises mapping a value of the input audio signal m, m being an integer, to an output sample at an index m in the sum-of-sines table.
  • 3. The method of claim 1, wherein said applying the clipping reduction further comprises interpolating between two samples in the sum-of-sines table.
  • 4. The method of claim 1, wherein the values of the sum-of-sines table comprise a sum of odd harmonics.
  • 5. The method of claim 1, wherein the values of the sum-of-sines table comprise a sum of even harmonics.
  • 6. The method of claim 1, wherein the values of the sum-of-sines table comprise a sum of two harmonically-related sine waves, three harmonically-related sine waves, four harmonically-related sine waves, or five harmonically-related sine waves.
  • 7. The method of claim 1, wherein the sum-of-sines table is one of a plurality of sum-of-sines tables.
  • 8. The method of claim 7, further comprising selecting the sum-of-sines table from the plurality of sum-of-sines tables prior to said applying, said selecting based upon whether the input audio signal includes a voice signal.
  • 9. The method of claim 8, wherein when the input audio signal includes a voice signal, said selecting comprises selecting one of the plurality of sum-of-sines tables created from fewer harmonics than other of the plurality of sum-of-sines tables created from more harmonics.
  • 10. The method of claim 1, wherein the sum of sine waves are sums of portions of sine waves.
  • 11. A system limiting an audio signal, the system comprising: a limiter that receives an input audio signal and that produces a limited audio signal from the input audio signal; anda distortion control module that uses a hardware processor to: apply a clipping reduction to the limited audio signal to increase signal energy in the limited audio signal compared to the input audio signal, by at least mapping the limited audio signal into a data structure to produce an output signal, the data structure comprising values representing a sum of portions of sine waves; andoutput the output signal to a speaker.
  • 12. The system of claim 11, wherein the portions of sine waves are quarter sine waves.
  • 13. The system of claim 11, wherein said mapping comprises applying a mapping function, and wherein said applying the mapping function comprises first reversing the mapping function across an x-axis and inverting the mapping function across a y-axis for negative values of the limited audio signal.
  • 14. The system of claim 11, further comprising a user interface that provides a distortion control for a user to adjust the amount of said clipping reduction.
  • 15. The system of claim 11, wherein the portions of sine waves comprise harmonics at about 400 Hz, about 1200 Hz, about 2000 Hz, about 2800 Hz, and about 3600 Hz.
  • 16. The system of claim 11, wherein the portions of sine waves comprise a first harmonic, a third harmonic, a fifth harmonic, a seventh harmonic, and a ninth harmonic.
  • 17. The system of claim 11, wherein the portions of sine waves comprise harmonics, which decrease in amplitude monotonically.
US Referenced Citations (222)
Number Name Date Kind
3101446 Glomb et al. Aug 1963 A
3127477 David, Jr. et al. Mar 1964 A
3665345 Dolby May 1972 A
3828280 Dolby Aug 1974 A
3845416 Dolby Oct 1974 A
3846719 Dolby Nov 1974 A
3903485 Dolby Sep 1975 A
3967219 Dolby Jun 1976 A
4074083 Berkovitz et al. Feb 1978 A
4355383 Dolby Oct 1982 A
4490691 Dolby Dec 1984 A
4700361 Todd et al. Oct 1987 A
4739514 Short et al. Apr 1988 A
4882758 Uekawa et al. Nov 1989 A
4887299 Cummins et al. Dec 1989 A
5027410 Williamson et al. Jun 1991 A
5172358 Kimura Dec 1992 A
5175769 Hejna, Jr. et al. Dec 1992 A
5237559 Murphy et al. Aug 1993 A
5255324 Brewer et al. Oct 1993 A
5278912 Waldhauer Jan 1994 A
5363147 Joseph et al. Nov 1994 A
5402500 Sims, Jr. Mar 1995 A
5471527 Ho et al. Nov 1995 A
5500902 Stockham, Jr. et al. Mar 1996 A
5530760 Paisley Jun 1996 A
5537479 Kreisel et al. Jul 1996 A
5544140 Seagrave et al. Aug 1996 A
5579404 Fielder et al. Nov 1996 A
5583962 Davis et al. Dec 1996 A
5615270 Miller et al. Mar 1997 A
5623577 Fielder Apr 1997 A
5631714 Saadoun May 1997 A
5632003 Davidson et al. May 1997 A
5632005 Davis et al. May 1997 A
5633981 Davis May 1997 A
5659466 Norris et al. Aug 1997 A
5677987 Seki et al. Oct 1997 A
5663727 Vokac Dec 1997 A
5710752 Seagrave et al. Jan 1998 A
5727119 Davidson et al. Mar 1998 A
5742689 Tucker et al. Apr 1998 A
5757465 Seagrave et al. May 1998 A
5812969 Barber, Jr. et al. Sep 1998 A
5848171 Stockham, Jr. et al. Dec 1998 A
5862228 Davis Jan 1999 A
5873065 Akagiri et al. Feb 1999 A
5896358 Endoh et al. Apr 1999 A
5909664 Davis et al. Jun 1999 A
5930373 Shashoua et al. Jul 1999 A
5966689 McCree Oct 1999 A
6002776 Bhadkamkar et al. Dec 1999 A
6016295 Endoh et al. Jan 2000 A
6021386 Davis et al. Feb 2000 A
6041295 Hinderks Mar 2000 A
6064962 Oshikiri et al. May 2000 A
6084974 Niimi Jul 2000 A
6088461 Lin et al. Jul 2000 A
6108431 Bachler Aug 2000 A
6148085 Jung Nov 2000 A
6185309 Attias Feb 2001 B1
6211940 Seagrave et al. Apr 2001 B1
6240388 Fukuchi May 2001 B1
6263371 Geagan, III et al. Jul 2001 B1
6301555 Hinderks Oct 2001 B2
6311155 Vaudrey et al. Oct 2001 B1
6327366 Uvacek et al. Dec 2001 B1
6332119 Hinderks Dec 2001 B1
6351733 Saunders et al. Feb 2002 B1
6370255 Schaub et al. Apr 2002 B1
6430533 Kolluru et al. Aug 2002 B1
6442278 Vaudrey et al. Aug 2002 B1
6442281 Sato et al. Aug 2002 B2
6446037 Fielder et al. Sep 2002 B1
6473731 Hinderks Oct 2002 B2
6498822 Tanaka Dec 2002 B1
6529605 Christoph Mar 2003 B1
6606388 Townsend et al. Aug 2003 B1
6624873 Callahan, Jr. et al. Sep 2003 B1
6639989 Zacharov et al. Oct 2003 B1
6650755 Vaudrey et al. Nov 2003 B2
6651041 Juric Nov 2003 B1
6664913 Craven et al. Dec 2003 B1
6704711 Gustafsson et al. Mar 2004 B2
6760448 Gundry Jul 2004 B1
6766176 Gupta et al. Jul 2004 B1
6768801 Wagner et al. Jul 2004 B1
6784812 Craven et al. Aug 2004 B2
6891482 Craven et al. May 2005 B2
6920223 Fosgate Jul 2005 B1
6970567 Gundry et al. Nov 2005 B1
6980933 Cheng et al. Dec 2005 B2
6993480 Klayman Jan 2006 B1
7058188 Allred Jun 2006 B1
7072477 Kincaid Jul 2006 B1
7072831 Etter Jul 2006 B1
7116789 Layton et al. Oct 2006 B2
7152032 Suzuki et al. Dec 2006 B2
7280664 Fosgate et al. Oct 2007 B2
7283954 Crockett et al. Oct 2007 B2
7349841 Furuta et al. Mar 2008 B2
7395211 Watson et al. Jul 2008 B2
7418394 Cowdery Aug 2008 B2
7424423 Bazzi et al. Sep 2008 B2
7448061 Richards et al. Nov 2008 B2
7454331 Vinton et al. Nov 2008 B2
7461002 Crockett et al. Dec 2008 B2
7508947 Smithers Mar 2009 B2
7533346 Mcgrath et al. May 2009 B2
7536021 Dickins et al. May 2009 B2
7539319 Dickins et al. May 2009 B2
7551745 Gundry et al. Jun 2009 B2
7583331 Whitehead Sep 2009 B2
7610205 Crockett Oct 2009 B2
7617109 Smithers et al. Nov 2009 B2
7711123 Crockett May 2010 B2
7751572 Villemoes et al. Jul 2010 B2
7756274 Layton et al. Jul 2010 B2
7784938 Richards Aug 2010 B2
7925038 Taenzer et al. Apr 2011 B2
7965848 Villemoes et al. Jun 2011 B2
7973878 Whitehead Jul 2011 B2
8032385 Smithers et al. Oct 2011 B2
RE42935 Cheng et al. Nov 2011 E
8085941 Taenzer Dec 2011 B2
8090120 Seefeldt Jan 2012 B2
8144881 Crockett et al. Mar 2012 B2
8204742 Yang et al. Jun 2012 B2
8315398 Katsianos Dec 2012 B2
8538042 Yang Sep 2013 B2
8907822 Helmrich Dec 2014 B2
9236842 Katsianos Jan 2016 B2
9820044 Yang Nov 2017 B2
20010027393 Touimi et al. Oct 2001 A1
20020013698 Vaudrey et al. Jan 2002 A1
20020040295 Saunders et al. Apr 2002 A1
20020076072 Cornelisse Jun 2002 A1
20020097882 Greenberg et al. Jul 2002 A1
20020146137 Kuhnel et al. Oct 2002 A1
20020147595 Baumgarte Oct 2002 A1
20030002683 Vaudrey et al. Jan 2003 A1
20030035549 Bizjak Feb 2003 A1
20040024591 Boillot et al. Feb 2004 A1
20040042617 Beerends et al. Mar 2004 A1
20040042622 Saito Mar 2004 A1
20040044525 Vinton et al. Mar 2004 A1
20040057586 Licht Mar 2004 A1
20040071284 Abutalebi et al. Apr 2004 A1
20040076302 Christoph Apr 2004 A1
20040078200 Alves Apr 2004 A1
20040122662 Crockett et al. Jun 2004 A1
20040148159 Crockett et al. Jul 2004 A1
20040165730 Crockett et al. Aug 2004 A1
20040172240 Crockett et al. Sep 2004 A1
20040184537 Geiger et al. Sep 2004 A1
20040190740 Chalupper et al. Sep 2004 A1
20050065781 Tell et al. Mar 2005 A1
20050069162 Haykin et al. Mar 2005 A1
20050075864 Kim Apr 2005 A1
20050246170 Vignoli et al. Nov 2005 A1
20060002572 Smithers et al. Jan 2006 A1
20060129256 Melanson et al. Jun 2006 A1
20060130637 Crewbouw Jun 2006 A1
20070025480 Tackin et al. Feb 2007 A1
20070027943 Jensen et al. Feb 2007 A1
20070056064 Roose et al. Mar 2007 P1
20070092089 Seefeldt et al. Apr 2007 A1
20070118363 Sasaki et al. May 2007 A1
20070134635 Hardy et al. Jun 2007 A1
20070268461 Whitehead Nov 2007 A1
20070291959 Seefeldt Dec 2007 A1
20080022009 Yuen et al. Jan 2008 A1
20080170721 Sun et al. Jul 2008 A1
20080228473 Kinoshita Sep 2008 A1
20080232612 Tourwe Sep 2008 A1
20080249772 Martynovich et al. Oct 2008 A1
20080284677 Whitehead et al. Nov 2008 A1
20090063159 Crockett Mar 2009 A1
20090067644 Crockett et al. Mar 2009 A1
20090112579 Li et al. Apr 2009 A1
20090161883 Katsianos Jun 2009 A1
20090220109 Crockett et al. Sep 2009 A1
20090271185 Smithers et al. Oct 2009 A1
20090304190 Seefeldt et al. Dec 2009 A1
20090322800 Atkins Dec 2009 A1
20100042407 Crockett Feb 2010 A1
20100049346 Boustead et al. Feb 2010 A1
20100060857 Richards et al. Mar 2010 A1
20100066976 Richards et al. Mar 2010 A1
20100067108 Richards et al. Mar 2010 A1
20100067709 Seefeldt Mar 2010 A1
20100073769 Richards et al. Mar 2010 A1
20100076769 Yu Mar 2010 A1
20100083344 Schildbach et al. Apr 2010 A1
20100106507 Muesch Apr 2010 A1
20100121634 Muesch May 2010 A1
20100174540 Seefeldt Jul 2010 A1
20100177903 Vinton et al. Jul 2010 A1
20100179808 Brown Jul 2010 A1
20100185439 Crockett Jul 2010 A1
20100198378 Smithers et al. Aug 2010 A1
20100202632 Seefeldt et al. Aug 2010 A1
20100250258 Smithers et al. Sep 2010 A1
20110022402 Engdegard et al. Jan 2011 A1
20110022589 Bauer et al. Jan 2011 A1
20110054887 Muesch Mar 2011 A1
20110125507 Yu May 2011 A1
20110137662 Mcgrath et al. Jun 2011 A1
20110153050 Bauer et al. Jun 2011 A1
20110188704 Radhakrishnan et al. Aug 2011 A1
20110208528 Schildbach et al. Aug 2011 A1
20110219097 Crockett et al. Sep 2011 A1
20110221864 Filippini et al. Sep 2011 A1
20110222835 Dougherty et al. Sep 2011 A1
20110227898 Whitehead Sep 2011 A1
20110243338 Brown Oct 2011 A1
20110274281 Brown et al. Nov 2011 A1
20110311062 Seefeldt et al. Dec 2011 A1
20120008800 Goerke Jan 2012 A1
20120039490 Smithers Feb 2012 A1
20120046772 Dickins Feb 2012 A1
20120063121 Atkins Mar 2012 A1
Foreign Referenced Citations (105)
Number Date Country
2005299410 May 2006 AU
2007243586 Nov 2007 AU
2007309691 May 2008 AU
2008266847 Dec 2008 AU
PI0518278-6 Nov 2008 BR
PI0709877-4 Jul 2011 BR
PI0711063-4 Aug 2011 BR
2581810 May 2006 CA
1910816 Feb 2007 CN
200580036760.7 Oct 2007 CN
200780011056.5 Apr 2009 CN
200780011710.2 Apr 2009 CN
200780014742.8 May 2009 CN
200780038594.3 Sep 2009 CN
200780049200.4 Nov 2009 CN
200780040917.2 Dec 2009 CN
200880008969.6 Mar 2010 CN
200880024506.9 Jun 2010 CN
200880024525.1 Jul 2010 CN
43 35 739 May 1994 DE
10323126 Aug 2003 DE
0 661 905 Mar 1995 EP
05818505.9 Jul 2007 EP
1 850 328 Oct 2007 EP
1987586 May 2008 EP
2082480 May 2008 EP
2122828 Jul 2008 EP
07753095.4 Dec 2008 EP
07754779.2 Jan 2009 EP
08768564.0 Mar 2010 EP
08780173.4 Mar 2010 EP
10184647.5 Dec 2010 EP
08780174.2 Nov 2011 EP
282 0573 Aug 2002 FR
2327835 Feb 1999 GB
09112054.9 Dec 2009 HK
10107878.0 May 2010 HK
09106026.6 Jul 2011 HK
6-334459 Dec 1994 JP
7-122953 May 1995 JP
H11 509712 Aug 1999 JP
2002-507291 Mar 2002 JP
2006-524968 Nov 2006 JP
2007 104407 Apr 2007 JP
2007 522706 Aug 2007 JP
2007-539070 May 2008 JP
2009-504190 Sep 2009 JP
2009-504219 Sep 2009 JP
2009-507694 Oct 2009 JP
2009-533304 Mar 2010 JP
2009-535268 Mar 2010 JP
2009-544836 May 2010 JP
2009-553658 Jun 2010 JP
2010-517000 Oct 2010 JP
2010-516999 Dec 2010 JP
2011-025711 Aug 2011 JP
10-2009-7016247 Sep 2009 KR
10-2009-7019501 Feb 2010 KR
10-2008-7029070 Jun 2011 KR
2007005027 Jun 2007 MX
2008013753 Mar 2009 MX
2009004175 Apr 2009 MX
PI 20084037 Mar 2007 MY
PI 20091346 Aug 2011 MY
PI 20093743 Aug 2011 MY
2008143336 May 2010 RU
2008146747 Jun 2010 RU
2009118955 Nov 2010 RU
2009135056 Mar 2011 RU
2010105052 Aug 2011 RU
2010105057 Aug 2011 RU
200702926-7 Oct 2005 SG
200807478-3 Mar 2007 SG
200902133-8 Sep 2007 SG
200906211-8 Jun 2008 SG
94138593 Jul 2006 TW
96111810 Apr 2007 TW
96111338 Jan 2008 TW
96108528 Feb 2008 TW
96136545 Jul 2008 TW
96139833 Jul 2008 TW
96148397 Sep 2008 TW
97122852 Mar 2009 TW
97126352 Mar 2009 TW
97126643 Apr 2009 TW
99112159 Feb 2011 TW
99113664 Feb 2011 TW
99113477 Jul 2011 TW
1-2009-01972 Apr 2010 VN
1-2008-02889 Apr 2011 VN
1-2009-01011 Jun 2011 VN
WO 9725834 Jul 1997 WO
WO 9742789 Nov 1997 WO
WO 9901863 Jan 1999 WO
WO 0131632 May 2001 WO
WO 2003090208 Oct 2003 WO
WO 2004019656 Mar 2004 WO
WO 2004021332 Mar 2004 WO
WO 2004073178 Aug 2004 WO
WO 2004098053 Nov 2004 WO
WO 2004111994 Dec 2004 WO
WO 2005086139 Sep 2005 WO
WO 2006019719 Feb 2006 WO
WO 2006047600 May 2006 WO
WO 2006113047 Oct 2006 WO
Non-Patent Literature Citations (44)
Entry
Advanced Television Systems Committee Inc., ATSC Recommended Practice: Techniques for Establishing and Maintaining Audio Loudness for Digital Television, May 25, 2011.
Anderton, Craig, “DC Offset: The Case of the Missing Headroom” Harmony Central. http://www.harmonycentral.com/docs/DOC-1082, Apr. 19, 2010.
Australian Broadcasting Authority (ABA) Investigation into Loudness of Advertisements (Jul. 2002).
Digital Entertainment, Perceptual Loudness Management for Broadcast Applications, White Paper, 18 pages, Jun. 2010.
Extended Search Report issued in European application No. 08868264.6 dated Sep. 12, 2012.
Extended European Search Report issued in Application No. 09848326.6 dated Jan. 8, 2014.
Extended European Search Report issued in Application No. EP 09 84 9335 dated Dec. 8, 2015.
Glasberg et al., A Model of Loudness Applicable to Time-Varying Sounds (Journal of the Audio Engineering Society, Audio Engineering Society, New York, vol. 50, May 2002, pp. 331-342).
Hauenstein M., A Computationally Efficient Algorithm for Calculating Loudness Patterns of Narrowband Speech (Acoustics, Speech and Signal Processing, 1997 ICASSP-97 IEEE International Conference on Munich, Germany Apr. 21-24, 1997, Los Alamitos, CA, IEEE Comput. Soc., US, Apr. 21, 1997, pp. 1311-1314).
Hu et al. “A Perceptually Motivated Approach for Speech Enhancement”, IEEE Transactions on Speech and Audio Processing, vol. 11(5), Sep. 2003.
Immerseel et al., Digital Implementation of Linear Gammatone Filters: Comparison of Design Methods, (2003; 4(3):59-64, Acoustics Research Letters Online).
International Preliminary Report on Patentability issued in application No. PCT/US2009/053437 dated Feb. 14, 2012.
International Search Report and Written Opinion in PCT/US2009/053437, dated Oct. 2, 2009.
International Search Report and Written Opinion in PCT/US2009/056850, dated Nov. 2, 2009.
International Search Report for International Application No. PCT/US2008/087791, dated Feb. 24, 2009.
International Search Report and Written Opinion issued in Application No. PCT/US2012/048378 dated Jan. 24, 2014.
ISO226: 2003 (E) Acoustics—Normal Equal Loudness Level Contours.
ITU-R Radio Sector of ITU, Recommendation ITU-R BS.1770-2, Algorithms to Measure Audio Programme Loudness and True-Peak Audio Level, 24 pages, Mar. 2011.
Japanese Office Action dated Feb. 26, 2013, Japanese Application No. 2012-524683.
Khalil C. Haddad, et al., Design of Digital Linear-Phase FIR Crossover Systems for Loudspeakers by the Method of Vector Space Projections, Nov. 1999, vol. 47, No. 11, pp. 3058-3066.
Lin, L., et al. Auditory Filter Bank Design using Masking Curves (7th European Conference on Speech Communication and Technology, Sep. 2001).
Lund, Control of Loudness in Digital TV, (2006 NAB BEC Proceedings, pp. 57-65).
Moore, et al., A Model for the Prediction of Thresholds, Loudness and Partial Loudness (Journal of the Audio Engineering Society, Audio Engineering Society, New York, vol. 45, No. 4, Apr. 1997, pp. 224-240).
Office Action issued in Chinese Application No. 200880121963.X dated Aug. 14, 2013.
Office Action issued in Chinese Application No. 200880121963 dated Apr. 30, 2014.
Office Action issued in Chinese Application No. 200980160873.6 dated Oct. 23, 2013.
Office Action issued in corresponding Japanese Application No. 2012-524683 dated Feb. 26, 2014.
Office Action issued in corresponding Japanese Application No. 2010-539900 dated Jun. 12, 2012.
Office Action issued by the Korean Intellectual Property Office in Application No. 10-2012-7008874 dated Aug. 13, 2015.
Office Action issued by the Korean Intellectual Property Office in Application No. 10-2012-7004284 dated Apr. 18, 2016.
Office Action issued by the Japanese Patent Office in Application No. 2014-523980 dated Aug. 16, 2016.
P1 Audio Processor, White Paper, May 2003, Safe Sound Audio 2003.
Poers, The Loudness Rollercoaster, Jünger Loudness Control Devices, 2 pages, http://junger-audio.com/technology/the-loudness-rollercoaster/ (2008).
Recommendation ITU-R BS.1770, Algorithms to measure audio programme loudness and true-peak audio level, pp. 1-19, 2006.
Roger Derry, PC Audio Editing with Adobe Audition 2.0 Broadcast, desktop and CD audio production, First edition 2006, Eisever Ltd.
Schottstaedt, SCM Repositories—SND Revision 1.2, Jul. 21, 2007, SourceForge, Inc.
SCM Repositories—SND Revision 1.2, Jul. 21, 2007, SourceForge, Inc.
Seefeldt, et al., A New Objective Measure of Perceived Loudness, (Audio Engineering Society, Convention Paper 6236, 117th Convention, San Francisco, CA. Oct. 28-31, 2004).
Skovenborg et al., Evaluation of Designs for Loudness-Matching Experiments (2004, Poznan, Poland).
Skovenborg et al., Evaluation of Different Loudness Models with Music and Speech Material (2004, 117th Convention of the Audio Engineering Society, San Francisco, CA USA).
Stevens, Calculations of the Loudness of Complex Noise (Journal of the Acoustical Society of America 1956.
Zwicker et al., Psychoacoustics: Facts and Models (Springer-Verlag, Chapter 8, “Loudness,” pp. 203-238, Berlin Heidelberg, 1990, 1999).
Zwicker, Psychological and Methodical Basis of Loudness (Acoustica, 1958).
Examination Report dated Feb. 7, 2018, in European application No. EP 098493356.6, in 5 pages.
Related Publications (1)
Number Date Country
20180070176 A1 Mar 2018 US
Divisions (1)
Number Date Country
Parent 12539380 Aug 2009 US
Child 14010405 US
Continuations (1)
Number Date Country
Parent 14010405 Aug 2013 US
Child 15811353 US