This disclosure relates to systems and methods for sound system design and simulation. As used herein, design system and simulation system are used interchangeably and refer to systems that allow a user to build a model of at least a portion of a venue, arrange sound system components around or within the venue, and calculate one or more measures characterizing an audio signal generated by the sound system components. The design system or simulation system may also simulate the audio signal generated by the sound system components thereby allowing the user to hear the audio simulation.
A sound system design/simulation system provides a more realistic simulation of an existing venue by matching a measured reverberation characteristic of the existing venue and adjusting one or more acoustic parameters characterizing the model such that a predicted reverberation characteristic substantially matches the measured reverberation characteristic.
An embodiment of the present invention is directed to an audio simulation method comprising: providing an audio simulation system including a model manager, an audio engine, and an audio player; receiving at least one measured reverberation time; and matching a predicted reverberation time to the at least one measured reverberation time. In an aspect, the predicted reverberation time is within 0.5 seconds of the measured reverberation time. In another aspect, the predicted reverberation time is within 0.1 seconds of the measured reverberation time. In another aspect, an absolute value of a difference between the predicted reverberation time and the measured reverberation time is less than about 0.05 seconds. In another aspect, the step of matching further comprises adjusting a material characteristic such that the predicted reverberation time matches the at least one measured reverberation time. In a further aspect, the material characteristic is an absorption coefficient of a material. In a further aspect, the absorption coefficient of a material is adjusted according to a prioritized list of materials, each material in the prioritized list characterized by an index. In another aspect, the index is proportional to a product of a surface area of the material and a reflection coefficient of the material.
Another embodiment of the present invention is directed to an audio simulation system comprising: a user interface configured to receive at least one measured reverberation time of a venue; an audio engine configured to predict a reverberation time of the venue based on at least one absorption coefficient of a material associated with a surface of the venue; means for adjusting the at least one absorption coefficient such that the predicted reverberation time matches the at least one measured reverberation time; and an audio player generating at least two acoustic signals simulating an audio program played in the venue, the simulated audio program based on the at least one absorption coefficient.
Another embodiment of the present invention is directed to a computer-readable medium storing computer-executable instructions for performing a method comprising: providing an audio simulation system including a model manager, an audio engine, and an audio player; receiving at least one measured reverberation time of a venue; and adjusting an absorption coefficient of a material associated with a surface of the venue such that a predicted reverberation time based on the adjusted absorption coefficient matches the at least one measured reverberation time.
The audio engine 130 estimates one or more sound qualities or sound measures of the venue based on the acoustic model of the venue managed by the model manager 120 and the placement of the audio components. The audio engine 130 may estimate the direct and/or indirect sound field coverage at any location in the venue and may generate one or more sound measures characterizing the modeled venue using methods and measures known in the acoustic arts.
The audio player 140 generates at least two acoustic signals that preferably give the user a realistic simulation of the designed sound system in the actual venue. The user may select an audio program that the audio player uses as a source input for generating the at least two acoustic signals that simulate what a listener in the venue would hear. The at least two acoustic signals may be generated by the audio player by filtering the selected audio program according to the predicted direct and reverberant characteristics of the modeled venue predicted by the audio engine. The audio player 140 allows the designer to hear how an audio program would sound in the venue, preferably before construction of the venue begins. This allows the designer to make changes to the selection of materials and/or surfaces during the initial design phase of the venue where changes can be implemented at low cost relative to the cost of retrofitting these same changes after construction of the venue. The auralization of the modeled venue provided by the audio player also enables the client and designer to hear the effects of different sound systems in the venue and allows the client to justify, for example, a more expensive sound system when there is an audible difference between sound systems. An example of an audio player is described in U.S. Pat. No. 5,812,676 issued Sep. 22, 1998, herein incorporated by reference in its entirety.
Examples of interactive sound system design systems are described in co-pending U.S. patent application Ser. No. 10/964,421 filed Oct. 13, 2004, herein incorporated by reference in its entirety. Procedures and methods used by the audio engine to calculate coverage, speech intelligibility, etc., may be found in, for example, K. Jacob et al., “Accurate Prediction of Speech Intelligibility without the Use of In-Room Measurements,” J. Audio Eng. Soc., Vol. 39, No. 4, pp. 232-242 (April, 1991) and are herein incorporated by reference in their entirety. Auralization methods implemented by the audio player may be found in, for example, M. Kleiner et al., “Auralization: Experiments in Acoustical CAD,” Audio Engineering Society Preprint #2990, September, 1990 and is herein incorporated by reference in its entirety.
The modeling window 220, detail window 230, and the data window 240 simultaneously present different aspects of the design project to the user and are linked such that data changed in one window is automatically reflected in changes in the other windows. Each window can display different views characterizing an aspect of the project. The user can select a specific view by selecting a tab control associated with the specific view.
The Direct, Direct+Reverb, and Speech tabs estimate and display coverage patterns for the direct field, the direct+reverb field, and a speech intelligibility field. The coverage area may be selected by the user. The coverage patterns are preferably overlaid over a portion of the displayed model. The coverage patterns may be color-coded to indicate high and low areas of coverage or the uniformity of coverage. The direct field is estimated based on the SPL at a location generated by the direct signal from each of the speakers in the modeled venue. The direct+reverb field is estimated based on the SPL at a location generated by both the direct signal and the reflected signals from each of the speakers in the modeled venue. A statistical model of reverberation may be used to model the higher order reflections and may be incorporated into the estimated direct+reverb field. The speech intelligibility field displays the speech transmission index (STI) over the portion of the displayed model. The STI is described in K. D. Jacob et al., “Accurate Prediction of Speech Intelligibility without the Use of In-Room Measurements,” J. Audio Eng. Soc., Vol. 39, No. 4, pp 232-242 (April, 1991), Houtgast, T. and Steeneken, H. J. M. “Evaluation of Speech Transmission Channels by Using Artificial Signals” Acoustica, Vol. 25, pp 355-367 (1971), “Predicting Speech Intelligibility in Rooms from the Modulation Transfer Function. I. General Room Acoustics,” Acoustica, Vol. 46, pp 60-72 (1980) and the international standard “Sound System Equipment—Part 16: Objective Rating of Speech Intelligibility by Speech Transmission Index, IEC 60268-16, which are each incorporated herein in their entirety.
When the Simulation tab is selected, the detail window display one or more input controls that allow the user to specify a value or select from a list of values for a simulation parameter. Examples of simulation parameter include a frequency or frequency range encompassed by the coverage map, a resolution characterizing the granularity of the coverage map, and a bandwidth displayed in the coverage map. The user may also specify one or more surfaces in the model for display of the acoustic prediction data.
The Surfaces, Loudspeakers, and Listeners tab allows the user to view the properties of the surfaces, loudspeakers, and listeners, respectively, placed in the model and allows the user to quickly change one or more parameters characterizing a surface, loudspeaker or listener. The Properties tab allows the user to quickly view, edit, and modify a parameter characterizing an element such as a surface or loudspeaker in the model. A user may select an element in the modeling window and have the parameter values associated with that element displayed in the detail window. Any change made by the user in the detail window is reflected in an updated coverage map, for example, in the modeling window.
When selected, the EQ tab enables the user to specify an equalization curve for one or more selected loudspeakers. Each loudspeaker may have a different equalization curve assigned to the loudspeaker.
In
A user may select a pin shown in
The user can select the proper delays by displaying in the data window the direct arrivals in the time response plot. The user can select a pin representing one of the direct arrivals to identify the source of the selected direct arrival in the modeling window, which displays the path of the selected direct arrival from one of the loudspeakers in the model. The user can then adjust the delay of the identified loudspeaker in the detail window such than the first direct arrival the listener hears is from the loudspeaker closest to the audio source.
The concurrent display of both the model and coverage field in the modeling window, a response characteristic such as time response in the data window, and a property characteristic such as loudspeaker parameters in the detail window enables the user to quickly identify a potential problem, try various fixes, see the result of these fixes, and select the desired fix.
Removing objectionable time arrivals is another example where the concurrent display of the model, response, and property characteristics enables the user to quickly identify and correct a potential problem. Generally, arrivals that arrive more than 100 ms after the direct arrival and are more than 10 dB above the reverberant field may be noticed by the listener and may be unpleasant to the listener. The user can select an objectionable time arrival from the time response plot in the data window and see the path in the modeling window to identify the loudspeaker and surfaces associated with the selected path. The user can select one of the surfaces associated with the selected path and modify or change the material associated with the selected surface in the detail window and see the effect in the data window. The user may re-orient the loudspeaker by selecting the loudspeaker tab in the detail window and entering the changes in the detail window or the user may move the loudspeaker to a new location by dragging and dropping the loudspeaker in the modeling window.
As
In many situations, the modeled venue may already exist and measured reverberation times for the existing venue may be available to the modeler. In such situations, the modeler may enter the measured reverberation times for the existing venue into the simulation system and have the system automatically adjust the model to match the measured reverberation times. The adjusted model generates a simulation that more closely matches what the user would experience in the existing venue and allows the user to make a more precise evaluation of the modeled sound system.
The reverberation characteristics of a venue may be viewed as having three regimes: an early reflections period, an early reverberant field period, and a late decaying tail period. The reverberant characteristics of the early reflections period are generally determined by characteristics such as the locations of audio sources, geometry of the venue, acoustic absorption of the venue surfaces, and the location of the listener. The reverberant characteristics of the early reverberant field period are generally determined by characteristics such as the scattering surfaces of the venue. The reverberant characteristics of the late decaying tail period are substantially determined by a reverberation time, RT, characterizing an exponential decay. An example of a reverberation time characteristic is the RT60 time, which is the time it takes the reverberation in the late decaying tail period to decay by 60 db. Other measures of the reverberation characteristic of the late decaying tail period may be used following the teachings described herein. The reverberation time, RT60, may be estimated from the absorption coefficient and area of each surface characterizing the venue using, for example, the Sabine equation.
The inventors have discovered that a listener is typically more sensitive to the reverberant characteristics of the late decaying tail period than the reverberant characteristics of the early reflections or early reverberant field periods. Matching a predicted reverberation time to a measured reverberation time gives the listener a more realistic simulation of the venue. Matching of the predicted reverberation time to the measured reverberation time may be accomplished by adjusting the acoustic absorption coefficient, hereinafter referred to as the absorption coefficient, of one or more surfaces of the modeled venue. The absorption coefficient is adjusted such that the predicted reverberation time value for the late decaying tail period matches the measured reverberation time value of the venue such that the difference between the predicted reverberation time value and measured reverberation time value is barely perceived, if at all, by the listener.
The absorption coefficient of a material may be frequency dependent. The audio spectrum is preferably discretized into one or more frequency bands and a predicted reverberation time value for each band is estimated using the absorption coefficient values corresponding to the associated band. Adjusting the absorption coefficients of the materials in the venue to match the reverberation time values also affects the reverberation characteristics of the early reflections and/or early reverberant field periods. The inventors have discovered, however, that adjustments to the absorption coefficient of the materials may be done such that the differences in the reverberation characteristics of the early reflections and early reverberant field periods arising from the adjustments are typically not noticeable by the listener.
In some embodiments, adjustments to the absorption coefficients are determined by a prioritized list of materials that are ranked according to a surface-area-weighted reflection coefficient. For example, the materials may be ranked according to an index, ε(i,j)=A(i)(1−α(i,j)), where ε(i,j) is the index for the i-th surface in the j-th frequency band, A(i) is the surface area of the i-th surface, α(i,j) is the absorption coefficient for the i-th surface in the j-th frequency band, and (1−α(i,j)) is a reflection coefficient for the i-th surface in the j-th frequency band. The modeled venue may contain one or more surfaces associated with the same material and to rank the materials, the total surface area associated with each material is used to calculate the index, ε.
If a diffuse sound field is assumed, the surface area associated with the m-th material is the sum of surface areas associated with the m-th material. If a ray tracing method is used to predict a portion of the reverberation, the surface area associated with the m-th material is weighted according to the number of ray impingements on the m-th surface and is given by the equation:
where A(m) is the total surface area associated with the m-th material, Atot is the total surface area of the venue, n(i) is the number of impingements on the i-th surface and the sum is taken over all surfaces associated with the m-th material, and ntot is the total number of ray impingements.
Adjustments to the absorption coefficient of the materials on the prioritized list are made according to the index of each material. The material with the largest index is adjusted first and if the adjustment to that material is sufficient to match the predicted reverberation time value to the measured reverberation time value, the remaining materials on the prioritized list are not adjusted. The magnitude of the adjustment may be limited by a pre-determined maximum adjustment value, MAV. If the material with the largest index is adjusted by the MAV and the reverberation time values still do not match, the material with the next largest index is adjusted up to its MAV and if the reverberation time values still do not match, the material with the next largest index is adjusted and so on until all the materials in the prioritized list have been adjusted by their respective MAV. If all the materials in the prioritized list have been adjusted by the MAV and the RT values still do not match, the system may alert the user to the mismatch and ask the user to allow an increase in the MAV. In some embodiments, the MAV is selected to limit a change in the sound pressure level of a sound wave reflected by the surface. The MAV may be determined by the equation:
MAV=(1−10MaxDelta/10)(1−α(i,j)) (2)
where MaxDelta is maximum change in the SPL of the reflected wave and α(i,j) is the absorption coefficient for the i-th surface in the j-th frequency band. MaxDelta may be set to a value in a closed range of 0.01 to 2 dB, preferably in a closed range of 0.1 to 1 dB, and more preferably in a closed range of 0.25 to 1 dB. The adjusted absorption coefficient may be clipped to ensure that the absorption coefficient is within the closed range of zero to one.
A ranking based on the index described above enables the system to use the smallest adjustment to the absorption coefficient to match the reverberation time values while reducing the effects on the early reflections and early reverberant field periods arising from the adjustment to the absorption coefficient. Selecting a material having the largest surface area generally has the greatest effect on the reverberation time but also tends to affect the early reflection patterns from the material's surfaces. The change in the early reflection patterns may be reduced by selecting a surface with the lowest absorption coefficient or equivalently the highest reflection coefficient.
Use of the prioritized list is not required, however, and other methods of adjusting the absorption coefficients may be used as long as the alterations generated in the early reflections and early reverberant field periods caused by the reverberation time matching are not perceptible by the user.
Within each band, the predicted reverberation time for that band is compared to the measured reverberation time for that band. The reverberation times are considered matched if the absolute value of the difference between the predicted reverberation time and the measured reverberation time is less than or equal to a pre-defined value. In other words, the reverberation times are considered matched when the predicted reverberation time is within a pre-defined value of the measured reverberation time. The process proceeds to the next frequency band, as indicated in step 720. The pre-defined value may be a user-defined value or a system-defined constant based on, for example, psycho-acoustic data. The pre-defined value may be selected such that the difference between the predicted and measured reverberation times is not perceptible by a listener. For example, the pre-defined value may be less than 0.5 seconds, preferably less than 0.1 seconds, and more preferably less than or equal to about 0.05 seconds.
If the difference between the predicted and measured reverberation time values is greater than the pre-defined value, the absorption coefficient, α, of one or more materials may be adjusted such that the predicted reverberation time value matches the measured reverberation time value, as indicated in step 740. In some embodiments, the magnitude of an adjustment, δα, may be limited by a pre-defined maximum adjustment value, MAV, to limit the change to a material's α and to apportion the required adjustment over all the materials, if necessary. If the maximum allowed adjustment to the first material is not sufficient to match reverberation time values, the α of the second material is adjusted, and so on until the α of all the materials have been adjusted by its MAV, as indicated in step 730.
A new predicted reverberation time value is estimated based on the adjusted α of the materials in 750. The predicted reverberation time value is given by Sabine's equation:
where RT(j) is the predicted reverberation time for the j-th frequency band, V is the volume in cubic meters, A(i) is the surface area, in square meters, of the i-th surface, α(i,j) is the absorption coefficient of the i-th surface of the j-th frequency band, A′ is the surface area, in square meters, of the selected surface, and δα′(j) is the change in absorption coefficient in the j-th frequency band of the material associated with the selected surface. Absorption coefficients may be modified to account for various occupancy levels of the modeled venue. For example, an absorption coefficient for a floor surface where the audience may sit may be modified depending on whether the surface is partially or fully covered by the audience or is empty.
If the new reverberation time value still does not match the measured reverberation time value after all the materials have been adjusted by their maximum allowed adjustment, the remaining difference is displayed to the user, and the user is presented with an option to repeat the process shown in
When the user selects the next button in window 800, the wizard displays a list of materials associated with the surfaces in the modeled venue as shown, for example, in
When the user selects the next button in
Embodiments of the systems and methods described above comprise computer components and computer-implemented steps that will be apparent to those skilled in the art. For example, it should be understood by one of skill in the art that portions of the audio engine, model manager, user interface, and audio player may be implemented as computer-implemented steps stored as computer-executable instructions on a computer-readable medium such as, for example, floppy disks, hard disks, optical disks, Flash ROMS, nonvolatile ROM, flash drives, and RAM. Furthermore, it should be understood by one of skill in the art that the computer-executable instructions may be executed on a variety of processors such as, for example, microprocessors, digital signal processors, gate arrays, etc. For ease of exposition, not every step or element of the systems and methods described above is described herein as part of a computer system, but those skilled in the art will recognize that each step or element may have a corresponding computer system or software component. Such computer system and/or software components are therefore enabled by describing their corresponding steps or elements (that is, their functionality), and are within the scope of the present invention.
Having thus described at least illustrative embodiments of the invention, various modifications and improvements will readily occur to those skilled in the art and are intended to be within the scope of the invention. Accordingly, the foregoing description is by way of example only and is not intended as limiting. The invention is limited only as defined in the following claims and the equivalents thereto.
This application is a divisional patent application of U.S. patent application Ser. No. 11/954,539 which was filed on Dec. 12, 2007.
Number | Name | Date | Kind |
---|---|---|---|
3111186 | Schroeder | Nov 1963 | A |
4649564 | Barnett | Mar 1987 | A |
5424487 | Shioda | Jun 1995 | A |
5818944 | Takamiya et al. | Oct 1998 | A |
7688678 | Larsen et al. | Mar 2010 | B2 |
8041046 | Ohta et al. | Oct 2011 | B2 |
20060045283 | Lin et al. | Mar 2006 | A1 |
20060115095 | Giesbrecht et al. | Jun 2006 | A1 |
Number | Date | Country |
---|---|---|
3-194599 | Aug 1991 | JP |
H06161477 | Jun 1994 | JP |
H07168587 | Jul 1995 | JP |
2000284788 | Oct 2000 | JP |
2002123262 | Apr 2002 | JP |
2003105893 | Apr 2003 | JP |
2004085665 | Mar 2004 | JP |
2005321661 | Nov 2005 | JP |
2006119640 | May 2006 | JP |
2007003989 | Jan 2007 | JP |
Entry |
---|
European Office Action dated Mar. 27, 2015 for European Application No. 08 859 469.2-1901. |
Japanese Office Action dated Nov. 27, 2012 for Japanese Application No. 2010-538002. |
Machine Translation of Japanese Patent Application No. 2002123262. |
Number | Date | Country | |
---|---|---|---|
20120183151 A1 | Jul 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11954539 | Dec 2007 | US |
Child | 13434906 | US |