Patent Application
20070121966
None.
None.
The boom in digital electronics has increased the accessibility of digital audio products such as audio CDs and MP3 music files. Given the accessibility of audio products, users can now listen to a wide assortment of music. Because users have greater access to a wide range of music, users have become more sophisticated in their listening preference. As such, users are highly sensitive to their music quality. In particular, the users are highly sensitive to their sound quality. One particular concern for a user is the changing of a volume level while listening to a song.
Conventional audio players attempt to solve the problem by using various intensity metrics to guide level control. Because these audio players use intensity methods for measuring the signal, these audio players inaccurately normalize due to the failure of the audio players to consider perceptual issues. In other words, because these players use an analytic power or amplitude measurement, although sometimes frequency weighted or band limited, substantial perceptual error still exists.
Accordingly, a volume normalization device should allow for perceptual volume normalization while reducing distortion or errors in the resulting sound as perceived by a listener.
In an embodiment, the volume normalization device should measure perceptual loudness of a signal rather than intensity. The volume normalization device should use a psychoacoustic derived approximate loudness measure to determine loudness. The volume normalization device should also equalize the loudness of different audio sources via an audio compressor.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
The present invention is described in detail below with reference to the attached drawings figures, wherein:
Embodiments of the present invention are directed to a method and system for equalizing the loudness of audio sources. In an embodiment, the invention measures the perceptual loudness level of an audio signal from one or more audio sources. In such an embodiment, the invention also adjusts, dynamically or statically, the loudness level of the audio signal using the perceptual loudness level. The audio signal corresponding to the music selections can be reproduced such that the perceived loudness to a listener is normalized throughout an entire music track or among all the music tracks that corresponds to a music selection stored on an audio source.
Intensity generally includes a measurement of voltage, current, sound pressure level, or other measurement characteristics that calculates the actual power or amplitude of the signal. Intensity generally does not include perceptual issues. Loudness generally includes the internal perception of an audio signal, in terms of how loud it is actually perceived. Loudness, especially across audio with different frequency content and bandwidth, generally does not track intensity very well.
In the embodiment of the system shown in
Loudness Control Components
In an embodiment, the input processing tools 202 receive an audio signal generated from one or more audio sources. The audio sources can have multiple music selections with multiple musical tracks associated with each music selection. The perceptual loudness level-measuring module 204 calculates the perceptual loudness level that corresponds to the audio signal. The loudness level-adjusting module 206 adjusts the loudness level of the audio signal based on the measured perceptual loudness level. As a result, the audio compression module 208 further processes the audio signal. After the audio signal is compressed, the audio signal is reproduced corresponding to a music selection at a desired perceived loudness level to a listener.
Techniques for performing these functions are further described below in conjunction with the description of the audio play list compilation application.
Loudness Equalization Method
At a step 404, the perceptual loudness level of the audio signal is adjusted using the perceptual loudness level. Preferably, the perceptual loudness level is a target loudness level determined by a listener.
At a step 406, the audio signal is reproduced corresponding to at least one music selection at a desired perceptual loudness level. In an embodiment, the variation of the perceived loudness of the audio signal to a listener is substantially reduced throughout a track corresponding to the music selections. In another embodiment, the peak perceived loudness of the audio signal to a listener is the same among all the tracks corresponding to the music selections.
Furthermore, according to an embodiment, additional steps for measuring the perceptual loudness level may include generating a Hann window; taking a Fast Fourier Transform (FFT) of a half-overlapped, windowed signal, mapping the power spectrum to the bark spectrum; spreading the energy in the bark spectrum; calculating the partial perceptual loudness values corresponding to the audio signal; aggregating the partial perceptual loudness values corresponding to the audio signal; and comparing the aggregated partial perceptual loudness values to the target loudness level. Additionally, other psychometrically determined scales may be used such as “Equivalent Rectangular Bandwidth”.
In another embodiment, additional steps for measuring the perceptual loudness level may include receiving a music track having one or more portions; selecting a target loudness corresponding to the music track; and assigning the target loudness to each portion. In such an embodiment, the step for adjusting the perceptual loudness level may also include normalizing each portion by a normalization factor to reach the target loudness. In an alternate embodiment, the step for adjusting the perceptual loudness level may also include normalizing the loudness of the music track using a normalization factor to reach the target loudness. Preferably, the normalization factor can be determined based on either peak or average loudness corresponding to each portion. Alternatively, the normalization factor can be determined by a maximum loudness corresponding to the music track.
In still another embodiment, the step for adjusting the loudness level of an audio signal may include determining the appropriate gain level using the comparison results of the aggregated partial perceptual loudness values with the target loudness level for inputting the audio signal into an audio compressor.
In another embodiment, additional steps for compiling an audio play list may include identifying a second music selection if the second music selection has a perceptual loudness level that is equal to the measured perceptual loudness of the first music selection; rejecting the second music selection if the second music selection has a perceptual loudness level that is not equal to the measured perceptual loudness of the first music selection; and detecting the energy level corresponding to the music selection.
In some instances the aforementioned steps could be performed in an order other than that specified above. The description is not intended to be limiting with respect to the order of the steps.
One Pass and Two Pass Applications
In an embodiment, the invention provides a method for equalizing the loudness of an audio source. The method includes measuring the perceptual loudness level of an audio signal corresponding to a music track from an audio source, adjusting the perceptual loudness level of the audio signal; and reproducing the audio signal at the adjusted loudness level to a listener.
Preferably, the audio source includes audio CDs, WMA files, MP3 files, and other forms of audio storage or streaming. The audio source can be played in any device that is capable of playing audio content. Once the audio source is played in audio source playing device, an audio signal is generated corresponding to a music track stored on the audio source. The audio signal is inputted into the loudness control device 31 via input processing tools 202. At the loudness control device 31, the perceptual loudness level of the audio signal is measured.
For measuring the perceptual loudness level of an audio signal, a series of operations take place by the loudness control module 200. The perceptual loudness level-measuring module 204 uses a Hann window. A Hann window (H(n)) can be defined for these purposes as being H(n)=0.5−0.5*cosine(2*pi(n+0.5)/N), where N is the length of the window. Alternatively, other analysis windows may be used such as Blackmun window, Kaiser window, Hamming window, or any analysis window known in the art. In one embodiment, the Hann window is applied to the audio data using a ½ overlap (i.e. calculate a new loudness value every N/2 samples for an N sample window). The length may include 512 samples for most normal audio sampling rates. For example, N can be determined by dividing the sample rate by 100, and then taking that result and finding the smallest power of two that is larger than that result. Next, the data is modified by a fast Fourier Transform, and the power spectrum is calculated. Thereafter, the energy across each bark is summed. This allows the energy to spread upwards between barks, and the values from the same bark of multiple channels (if present) to sum together. Preferably, the value is compressed with a power law of 1/3.5 in order to provide partial loudness values, and then the partial loudness values are summed to yield the loudness of the given block of data centered in the Hann window. Alternatively, other mathematical operations can be used to generate the loudness. After the Hann window is generated, a bark scale mapping is performed.
In one embodiment, the bark scale mapping may be achieved by calculating the energy at each point in the positive frequency piece of the above-mentioned FFT, and then summing the energies across each bark, calculating the energy Bark by Bark. Using this calculation, the energy is calculated in each bark. Next, an elementary spreading function is generated by convolving a simple filter with the bark spectrum. Additionally, this embodiment avoids a full convolution of the FFT spectra. Alternatively, other mathematical operations can be used to create a bark scale mapping. Additionally, while the use of the internationally standardized Bark scale is used here, it is possible to use an “ERB” (equivalent rectangular bandwidth) or other scales that correspond to the filter configuration of the ear and obtain similar, and useful results.
For calculating the partial loudness values, the energy values are raised to the proper fractional power and the total loudness is summed across all the barks. After the partial loudness values, the aggregated partial perceptual loudness values are compared to the desired target loudness level. Thereafter, the appropriate gain level is determined using the comparison results of the aggregated partial perceptual loudness values with the target loudness level. In one embodiment, appropriate gain level is determined by calculating the ratio of the desired loudness to the actual loudness, raising the results of ratio calculation to the inverse power/2, and providing those results as the desired gain input to the audio compression module 208. Alternatively, other mathematical operations can be used to calculate the appropriate gain level.
The loudness level-adjusting module 206 adjusts the loudness level of the audio signal based on results of the perceptual loudness level-measuring module 204. In one embodiment, the loudness adjustment to the audio signal may be a volume normalization of a single music track corresponding to a music selection. In other words, reproducing the audio signal, or playing a musical track, can have the same volume level entirely throughout the track. In such an embodiment, the music track is divided into portions. The portions are scanned separately to generate a normalization factor. During the scanning of a portion, a previously scanned portion may be played. This embodiment may also be referred to as a one pass method.
In another embodiment, the loudness adjustment to the audio signal may be a volume normalization of all of the music tracks corresponding to a music selection. In other words, reproducing the audio signal, or playing multiple musical tracks, can have the same volume level entirely throughout all the tracks of a music selection. In such an embodiment, the entire music track is scanned to generate a normalization factor for the entire music track. After this step, the music track may be played. This embodiment may also be referred to as a two pass method.
After the loudness level of the audio signal has been adjusted, the audio signal is inputted to the audio compression module 208. At the audio compression module 208, the audio signal is compressed and modified to implement the appropriate gain level for achieving the desired loudness level. The audio compression module 208 may include a Digital Signal Processor (DSP) module. The DSP module includes any processor that is capable of processing a signal and providing computations.
In still another embodiment, the invention provides a method for compiling an audio play list with similar loudness levels. In this embodiment, a first music selection is selected from multiple audio sources. Next, a perceptual loudness level of an audio signal is measured corresponding to the first music selection. Thereafter, the contents of a music selection list are searched for a second music selection using the measured perceptual loudness level of the first music selection. As a result, a second music selection is inserted into an audio play list. Preferably, the second music selection has a perceptual loudness level that is similar to the measured perceptual loudness level of the first music selection.
In some instances the aforementioned steps could be performed in an order other than that specified above. The description is not intended to be limiting with respect to the order of the steps.
In another embodiment, an additional step for compiling an audio play list may include identifying a second music selection if the second music selection has a perceptual loudness level that is similar to the measured perceptual loudness of the first music selection. In an alternate embodiment, an additional step for compiling an audio play list may include rejecting the second music selection if the second music selection has a perceptual loudness level that is not similar to the measured perceptual loudness of the first music selection; and detecting the energy level corresponding to the music selection. Using the preferred loudness model, and typical values for input, the calculated loudness ranges from 0 to 2500 in arbitrary units. The amount of similarity may depend on the overall loudness, the listeners' preferences, and other considerations such as time of day, the type of listening device such as a headphone or speaker, or other variables.
The invention is described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microcontroller-based, microprocessor-based, or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
