1. Technical Field of the Invention
The present invention relates to a level adjustment method, a level adjustment program, and an audio processing apparatus suitably used for a 5.1 channel sound system.
2. Prior Art
An audio processing apparatus such as a mixer is provided with effects such as a compressor that applies a specified signal processing to audio signals. Here, the compressor detects an input signal level and, if the detected level exceeds a specified value (threshold Th), attenuates the level for an excess portion to compress the dynamic range. The details are disclosed in Japanese Patent Application Laid-Open Publication No. 8-122366. In addition, there is provided a stereo compressor that detects one level from either or both of a left signal L and a right signal R, and controls the L and R levels based on the detected level.
On the other hand, there is provided a 5.1 channel mixer, making it possible to appropriately mix a plurality of input signals and generate a multi-channel signal.
However, the conventional stereo compressor can cooperatively process two channels at the most. Therefore, it is difficult to appropriately process multi-channel signals for use with the 5.1 channel sound system and the like.
The present invention has been made in consideration of the foregoing. It is therefore an object of the present invention to provide a level adjustment method, a level adjustment program, and an audio processing apparatus capable of appropriately selecting signals from multi-channel signals for processing.
In one aspect of the invention, a level adjustment method is applicable to an audio processing apparatus having a plurality of amplifiers corresponding to three or more of input channels of an audio signal for amplifying signal levels of the respective input channels. The level adjustment method comprises a group arrangement process of arranging the plurality of the input channels into one or more group, and a group control process of controlling each group such as to decrease an amplification rate of all the amplifiers corresponding to the input channels belonging to the same group as a maximal one of the signal levels of the input channels belonging to the same group increases.
Typically, the group arrangement process is applied to an audio signal of a surround system having at least six input channels including a left channel, a right channel, a left surround channel, a right surround channel, a center channel and an LFE channel. In such a case, the group arrangement process arranges all of the left channel, the right channel, the left surround channel, the right surround channel, the center channel and the LFE channel into one group. Otherwise, the group arrangement process arranges the input channels into a first group including the left channel, the right channel, the left surround channel, the right surround channel and the center channel, and a second group including the LFE channel. Otherwise, the group arrangement process arranges the input channels into a first group including the left channel, the right channel and the center channel, a second group including the left surround channel and the right surround channel, and a third group including the LFE channel. Otherwise, the group arrangement process arranges the input channels into a first group including the left channel and the right channel, a second group including the left surround channel and the right surround channel, a third group including the LFE channel, and a fourth group including the center channel.
Practically, the level adjustment method further comprises a band separation process of separating the respective input channels into a plurality of frequency bands, so that the group arrangement process and the group control process are applied to a respective one of the frequency bands.
Practically, the group control process comprises a detection process of detecting the maximal one of the signal levels of the input channels belonging to the same group, and an adjustment process of adjusting the amplification rate of all the amplifiers involved in the same group according to the detected maximal signal level such as to decrease the amplification rate as the maximal signal level increases. In such a case, the detection process further comprises a sample and hold process of successively sampling absolute values of the signal level of each input channel for a predetermined period and holding a greatest one of the sampled absolute values, so that the sampled and held greatest absolute value represents the signal level of the input channel. Further, the detection process detects a maximal one of the respective greatest absolute values sampled and held for the respective input channels of the same group, thereby determining the maximal signal level.
Practically, the adjustment process checks whether the maximal signal level of each of the groups exceeds a predetermined threshold level, and, when the maximal signal level of the group exceeds the threshold level, decreases the amplification rate of the group according to the excess amount. In such a case, the adjustment process smoothens a transition of the amplification rate around the threshold level according to a predetermined knee parameter.
Practically, the group control process includes a response control process that controls a response of the adjusting of the amplification rate relative to the detecting of the maximal signal revel according to predetermined attack and release parameters.
In another aspect of the invention, an audio processing apparatus comprises a plurality of amplifiers corresponding to three or more of input channels of an audio signal for amplifying signal levels of the respective input channels, a group arrangement section for arranging the plurality of the input channels into one or more group, and a group control section for controlling each group such as to decrease an amplification rate of all the amplifiers corresponding to the input channels belonging to the same group as a maximal one of the signal levels of the input channels belonging to the same group increases.
In a further aspect of the invention, a level adjustment program is provided for use in an audio processing apparatus having a processor and a plurality of amplifiers corresponding to three or more of input channels of an audio signal for amplifying signal levels of the respective input channels, the level adjustment program being executable by the processor for causing the audio processing apparatus to perform a group arrangement process of arranging the plurality of the input channels into one or more group, and a group control process of controlling each group such as to decrease an amplification rate of all the amplifiers corresponding to the input channels belonging to the same group as a maximal one of the signal levels of the input channels belonging to the same group increases.
In a still further aspect of the invention, a graphic user interface is installed in an audio processing apparatus having a plurality of amplifiers corresponding to three or more of input channels of an audio signal for amplifying signal levels of the respective input channels. The graphic user interface is designed for assisting the audio processing apparatus in performing a level adjustment method comprising a group arrangement process of arranging the plurality of the input channels into one or more group, and a group control process of controlling each group such as to decrease an amplification rate of all the amplifiers corresponding to the input channels belonging to the same group as a maximal one of the signal levels of the input channels belonging to the same group increases. The graphic user interface provides a visual symbol prompting the user to select desired grouping of the input channels at the group arrangement process, and another visual symbol prompting the user to input parameters effective to determine how the amplification rate is decreased according to the maximal signal level during the group control process. Typically, the parameters include a threshold parameter and a knee parameter, such that the group control process decreases the amplification rate when the maximal signal level exceeds a threshold level determined by the threshold parameter, and smoothens a transition of the amplification rate around the threshold level according to the knee parameter.
a) and 3(b) are a configuration diagram showing an algorithm of a signal processing section, CPU, and the like.
a) through 8(d) show a configuration of a gain determination section.
1. Hardware Configuration According to an Embodiment
(1) Digital Mixer
In
The reference numeral 530 represents an operation device comprising a pointing device, a switch, and the like for selecting various input/output devices and setting various parameters. The reference numeral 540 denotes an electric fader that functions as an attenuator. When an operator or user operates the electric fader 540, the operated position is set as a parameter. The electric fader 540 is driven electrically and automatically determines the fader position in accordance with the parameter information. One electric fader may be assigned to a plurality of input channels that are simultaneously attenuated for the same amount. The reference numeral 550 represents a display unit that displays various information such as effects, parameters, and the like to the operator. The display unit 550 uses a setup screen in cooperation with the pointing device as a graphic user interface (GUI) to configure various parameters.
The reference numeral 560 represents a miscellaneous I/O section that comprises a USB port, a MIDI interface, and the like and is connected to other audio processing apparatuses. The reference numeral 570 represents a CPU that controls the other parts such as the signal processing section 510. The reference numeral 580 represents a flash memory that is ROM capable of electrical writing and erasure. The flash memory 580 stores programs, parameters, and the like for controlling the CPU 570. The reference numeral 590 represents RAM used as a work memory for the CPU 570.
(2) Connection Example
The waveform I/O section 520 is connected to an external input/output apparatuses for input or output of analog or digital audio signals. With reference to
In
Here, the 5.1 channel sound system comprises speaker systems of left channel (L), right channel (R), left surround (LS), right surround (RS), center channel (C), and low frequency effect (LFE). The 5.1 channel sound system may be provided with a rear center speaker to form an extended 6.1 channel sound system.
The reference numeral 730 represents a 24-track recorder to record musical sounds for materials. The reference numeral 735 represents an 8-track master recorder to record mixed audio signals. The reference numeral 740 represents a DVD to generate 5.1 channel compliant audio signals. The reference numeral 750 represents an external effector to add various effects to input signals. The multi-channel system is capable of treating analog and digital input/output.
2. Algorithm Configuration According to the Embodiment
(1) Overall Configuration
With reference to
In
When the signal processing section 510 and the waveform I/O section 520 handle 5.1 channel signals, six channels are assigned to audio signals in correspondence with six speakers (L, R, LS, RS, C, and LFE). In the following description, these six channels are collectively referred to as a “multi-channel”.
The reference numeral 830 represents an input patch section that receives signals from the analog input section 810 and the digital input section 820 in accordance with specifications of the operation device 530 etc., and allocates these signals to any channels in an input channel section 840. The input channel section 840 comprises 96 input channels, each of which is assigned with the gate, equalizer, delay, and fader functions by default. When a 5.1 channel signal is to be input, any six of the 96 input channels are allocated for processing the six components (L, R, LS, RS, C, and LFE) of the 5.1 channel signal to be input.
The following describes the configuration corresponding to each channel in the input channel section 840.
In
An output signal from the input channel is selectively output to any of 12 MIX buses and 12 AUX buses. Each MIX bus mixes an input signal. The mixed signal is supplied to a corresponding MIX output channel in an MIX output channel section 870. An output from the MIX output channel section 870 is used for an auditorium, for example. An AUX output channel section 880 provides 12 channels for the 12 MIX buses 850 and 12 channels for the 12 AUX buses 860. When the MIX buses are used for 5.1 channel mixing, any six of the 12 MIX buses are assigned for mixing the six system components (L, R, LS, RS, C, and LFE) of the 5.1 channel system. The six MIX output channels corresponding to the six buses process the mixed 5.1 channel signal. Like the MIX buses, the AUX buses can be used for the 5.1 channel mixing.
Further, the algorithm provides a plurality of effect resources that can be used as system effects or insertion effects. Just one effect resource can be used to implement an ordinary effect. A plurality of effect resources can be used to provide a complicated effect. Using one effect resource, it is possible to insert various effects, i.e., insertion effects, such as a compressor into the input channel, the MIX output channel, and the AUX output channel. The input channel section 840 can be selectively inserted with effect modules between the default functions such as the gate section 831 and the fader section 834 (
As indicated with a solid line in
Now back to
It is possible to insert a plurality of system effects 920 between the output patch section 890 and the input patch section 830 by using the effect resources. For example, the following describes how to provide the system effect for stereo input and stereo output. Two MIX buses are used for stereo mixing. At the same time, two AUX buses are used for stereo mixing of a signal to be supplied to the system effect. A stereo signal output from the system effect is input to the two MIX buses that mix a plurality of input channels. It is possible to apply the system effect to signals for these channels with different effect depths. In this case, the system effect 920 provides an effect that may or may not differ from an effect provided by the insertion effect.
(2) Algorithm Configuration of a Compressor 5.1
The audio processing apparatus can be supplied with such effects as: the reverb effect that generates an echo; the chorus effect that changes a sound from a single sound source as if sounds were simultaneously generated from a plurality of sound sources; and the tremolo effect that finely and regularly repeats a single sound or a plurality of sounds. With reference to
The reference numeral 200 represents a band split filter for the left channel that has a function of splitting or dividing an input signal IL of the left channel into a high-band signal ILH, a medium-band signal ILM, and a low-band signal ILL. Likewise, the reference numeral 210 represents a band split filter for the right channel, 220 that for the left surround, 230 that for the right surround, 240 that for the center channel, and 250 that for the low band. When each channel signal is split into high, medium, and low bands and then is compressed, it is possible to prevent the signals for all bands as a whole from being attenuated due to a signal belonging to the band emphasized by the equalizer, for example.
The reference numeral 100 denotes a high-band compressor unit that processes the high-band signals ILH, IRH, ILSH, IRSH, ICH, and ILFEH separated by the band split filter, attenuates the levels of these signals, and generates output signals OLH, ORH, OLSH, ORSH, OCH, and OLFEH. The details will be described later. Likewise, the reference numeral 110 denotes a medium-band compressor unit that processes the medium-band signals ILM, IRM, ILSM, IRSM, ICM, and ILFEM, attenuates the levels of these signals, and generates output signals OLM, ORM, OLSM, ORSM, OCM, and OLFEM. The reference numeral 120 denotes a low-band compressor unit that processes the low-band signals ILL, IRL, ILSL, IRSL, ICL, and ILFEL, attenuates the levels of these signals, and generates output signals OLL, ORL, OLSL, ORSL, OCL, and OLFEL.
The reference numeral 300 represents a left-channel mixer unit that mixes the left-channel signals OLH, OLM, and OLL of the respective bands fed from the high-band compressor unit 100, the medium-band compressor unit 110, and the low-band compressor unit 120, and generates an output signal OL. Likewise, the reference numeral 310 represents a right-channel mixer unit that mixes the right-channel signals ORH, ORM, and ORL for the corresponding bands and generates an output signal OR. The reference numeral 320 represents a left-surround mixer unit that mixes the left-surround signals OLSH, OLSM, and OLSL for the corresponding bands and generates an output signal ORS. The reference numeral 330 represents a right-surround mixer unit that mixes the right-surround signals ORSH, ORSM, and ORSL for the corresponding bands and generates an output signal ORS. The reference numeral 340 represents a center-channel mixer unit that mixes the center-channel signals OCH, OCM, and OCL for the corresponding bands and generates an output signal OC. The reference numeral 350 represents a low-band channel mixer unit that mixes the LFE channel signals OLFEH, OLFEM, and OLFEL for the corresponding bands and generates an output signal OLFE.
(3) Algorithm Configuration of the Compressor
Referring now to
In
Referring now to
The gain determination section groups a plurality of signals from the multi-channel into one or more of groups and determines a multiplier signal to be input to each multiplier. Here, a KEY_LINK parameter is specified to select one or more of four grouping types as follows. Accordingly, the gain determination section is also available in four types of configurations in accordance with grouping types of KEY_LINK.
The “KEY_LINK1” selects all 5.1 channel signals (L+R+LS+RS+C+LFE) as one group. “KEY_LINK2” selects five signals (L+R+LS+RS+C) associated with the localization as one group. The low-band component LFE is separated. This parameter is used to prevent volumes of the five signals from being compressed due to compression of the low-band component. “KEY_LINK3” groups not only the low-band component LFE, but also three forward signals (L+R+C) and two backward signals (LS+RS). When there are only reverberation components backward, for example, it is possible to make the forward signals and the backward signals independent from each other to prevent an effect of the reverberation components. “KEY_LINK4” further groups two forward channels (L+R) and two backward channels (LS+RS) and isolates the forward center channel (C). In the movies, for example, lines spoken by an actor or an actress are usually inserted into the center channel. This parameter is used to prevent the gain of the lines from being affected by the music, etc.
a) shows a configuration of a gain determination section 50a for “KEY_LINK1” that selects all the six signals of the multi-channel as one group.
In
As described above, the group control process comprises a detection process of detecting the maximal one of the signal levels of the input channels belonging to the same group, and an adjustment process of adjusting the amplification rate of all the amplifiers involved in the same group according to the detected maximal signal level such as to decrease the amplification rate as the maximal signal level increases. In such a case, the group control process further comprises a sample and hold process of successively sampling absolute values of the signal level of each input channel for a predetermined period and holding a greatest one of the sampled absolute values, so that the sampled and held greatest absolute value represents the signal level of the input channel. Further, the detection process detects a maximal one of the respective greatest absolute values sampled and held for the respective input channels of the same group, thereby determining the maximal signal level.
b) shows a configuration of a gain determination section 50b for “KEY_LINK2”. In this case, the gain determination section comprises a gain determination section 51 to select five signals ILH, IRH, ILSH, IRSH, and ICH and a gain determination section 52 to select the ILFEH signal. The gain determination section 51 detects the maximum signal level value from these five signals, determines a common multiplier signal according to this maximum value, and assigns appropriate values to the multiplier signals GLH, GRH, GLSH, GRSH, and GCH. The gain determination section 52 detects the maximum signal level value for the low-band signal ILFEH to determine the multiplier signal GLFEH.
c) shows a configuration of a gain determination section 50c for “KEY_LINK3”. In this case, the gain determination section 50c comprises a gain determination section 53 to select three signals ILH, IRH, and ICH, a gain determination section 54 to select signals ILSH and IRSH, and a gain determination section 55 to select the signal ILFEH. The gain determination section 53 detects the maximum signal level value from the three signals ILH, IRH, and ICH, determines a common multiplier signal according to this detected value, and assigns appropriate values to the multiplier signals GLH, GRH, and GCH. The input signals ILSH and IRSH determine a common signal for the multiplier signals GLSH and GRSH. The input signal ILFEH determines a value for the multiplier signal GLFEH.
d) shows a configuration of a gain determination section 50d for “KEY_LINK4”. In this case, the gain determination section 50d comprises a gain determination section 56 to select the two signals ILH and IRH, a gain determination section 57 to select the signal ICH, a gain determination section 58 to select the signals ILSH and IRSH, and a gain determination section 59 to select the signal ILFEH. The gain determination section 56 detects the maximum signal level value from the two signals ILH and IRH, determines a common multiplier signal according to this detected value, and assigns appropriate values to the multiplier signals GLH and GRH. The other signals ILSH and IRSH determine a common value for the multiplier signals GLSH and GRSH. The signal ICH determines a value for the multiplier signal GCH. The signal ILFEH determines a value for the multiplier signal GLFEH.
3. Operations of the Embodiment
(1) Parameter Settings
When a user performs specified operations to select the effect “compressor 5.1” and instructs the edition of the effect, a display 550 presents a screen as shown in
The reference numeral 1010 represents a KEY_LINK key that selects one of “KEY_LINK1” to “KEY_LINK4” according to the KEY_LINK parameter. On the display screen, selecting “KEY_LINK1” displays “5.1”. Selecting “KEY_LINK2” displays “5.0”. Selecting “KEY_LINK3” displays “3+2”. Selecting “KEY_LINK4” displays “2+2”. The compressor selects an input signal for determining a multiplier signal from the multi-channel. The reference numeral 1110 represents an attenuation ratio meter, in which an attenuation ratio (=gain=multiplier signal) is indicated for respective frequency bands of a group consisting of one or two channel selected from L+R, LS+RS, C and LFE. In the attenuation ratio meter shown in
The reference numeral 1020 denotes a LOW_GAIN key, 1030 a MID_GAIN key, and 1040 a HI_GAIN key that specify level values for the low-band, medium-band, and high-band components, respectively. The reference numeral 1050 denotes a RATIO key that specifies an attenuation ratio within the range from 1:1 to 20:1 when an input level exceeds the threshold Th of the compressor. The reference numeral 1060 denotes a KNEE key that relieves a steep gain change near the compressor threshold Th into a gentle or smooth characteristic. The relieving level varies at six grades. The reference numeral 1070 denotes a SOLO key that mutes all sounds except those for the low, medium, or low band enabled. Since only one band becomes audible, it is possible to adjust parameters for the corresponding band without an effect of signals from the other bands. The reference numeral 1080 denotes an ATTACK time key that specifies a value within the range from 0 to 120 msec. The reference numeral 1090 denotes a RELEASE time key that specifies the release time RELEASE.
(2) Audio Signal Synthesis
First, the operation device 530 and the like are used to specify parameters such as the key link KEY_LINK, the threshold Th, the RATIO, the level values LOW_GAIN, MID_GAIN, and HI_GAIN for the corresponding frequency bands, the attack time ATTACK, and the release time RELEASE. When the signals are input, gains for respective frequency bands are determined by the gain determination sections 50, 51, and so on corresponding to the input channels selected by the key link. When KEY_LINK1 is selected for high-frequency components, for example, the absolute value and maximum value detection unit 60 peak-holds the maximum value of the input signals within a specified time period. The peak-held value is the maximum value of signal levels (envelopes) of the six input signals. If the peak-held value is smaller than the threshold value Th defined by the operation device 530, the gain control unit 70 assigns the level value HI_GAIN unchanged as the normal gain NRG as shown in
At this time, a time difference occurs until detection of the maximum value for the input signals. Accordingly, the delay units 20, 21, 22, 23, 24, and 25 delay the time until the input signal is supplied to the multipliers 10, 11, 12, 13, 14, and 15. On the other hand, the attack release control unit 80 adjusts a rise and a fall of the maximum value for the detected input signal. After the input signal level exceeds the threshold value Th, the attack time ATTACK determines a response until the beginning of compression and is set to the range from several tens of microseconds to approximately 100 milliseconds. After the input signal level goes below the threshold Th, the release time RELEASE determines the time to release the compression and resume the normal gain, and is set to the range from several milliseconds to approximately several seconds.
As described above, a graphic user interface is installed in an audio processing apparatus having a plurality of amplifiers corresponding to three or more of input channels of an audio signal for amplifying signal levels of the respective input channels. The graphic user interface is designed for assisting the audio processing apparatus in performing a level adjustment method comprising a group arrangement process of arranging the plurality of the input channels into one or more group, and a group control process of controlling each group such as to decrease an amplification rate of all the amplifiers corresponding to the input channels belonging to the same group as a maximal one of the signal levels of the input channels belonging to the same group increases. The graphic user interface provides a visual symbol prompting the user to select desired grouping of the input channels at the group arrangement process, and another visual symbol prompting the user to input parameters effective to determine how the amplification rate is decreased according to the maximal signal level during the group control process. Typically, the parameters include a threshold parameter and a knee parameter, such that the group control process decreases the amplification rate when the maximal signal level exceeds a threshold level determined by the threshold parameter, and smoothens a transition of the amplification rate around the threshold level according to the knee parameter.
3. Modifications
The present invention is not limited to the above-mentioned embodiment and may be embodied in various modifications as follows which are all included in the category of the present invention.
As mentioned above, the present invention can appropriately group multi-channel signals to adjust signal levels.
Number | Date | Country | Kind |
---|---|---|---|
2002-199506 | Jul 2002 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5054077 | Suzuki | Oct 1991 | A |
5204969 | Capps et al. | Apr 1993 | A |
5617480 | Ballard et al. | Apr 1997 | A |
5680464 | Iwamatsu | Oct 1997 | A |
5848171 | Stockham et al. | Dec 1998 | A |
6084974 | Niimi | Jul 2000 | A |
6442278 | Vaudrey et al. | Aug 2002 | B1 |
6501717 | Yamazaki | Dec 2002 | B1 |
6650755 | Vaudrey et al. | Nov 2003 | B2 |
7190292 | Bizjak | Mar 2007 | B2 |
7212640 | Bizjak | May 2007 | B2 |
7363096 | Wiser et al. | Apr 2008 | B2 |
20020131611 | Hoover et al. | Sep 2002 | A1 |
Number | Date | Country |
---|---|---|
2 264 598 | Sep 1993 | GB |
2264598 | Sep 1993 | GB |
04081100 | Mar 1992 | JP |
05-244700 | Sep 1993 | JP |
05244700 | Sep 1993 | JP |
2000-004396 | Jan 2000 | JP |
2001-023800 | Jan 2001 | JP |
2001-218291 | Aug 2001 | JP |
2001218291 | Aug 2001 | JP |
Number | Date | Country | |
---|---|---|---|
20040008851 A1 | Jan 2004 | US |