1. Technical Field of the Invention
The present invention relates to a technology for imparting a stringed instrument's resonance effect to an audio signal.
2. Description of the Related Art
Some stringed instruments such as guitars are equipped with a pickup which uses a piezoelectric element to output vibration propagated from a string as an electrical signal. The electrical signal is amplified and output through a speaker, allowing the user to listen to the guitar's sound at an amplified volume. However, the sound, which is output as the electrical signal generated through the piezoelectric element, includes almost none of the resonance components generated by the body or the like of the guitar. Accordingly, sound reproduced from the electrical signal gives the listener a different impression from sound generated by playing an acoustic guitar or the like.
Japanese Patent Application Publication No. 2005-24997 describes a technology in which convolution operation is performed on the electrical signal through a Finite Impulse Response (FIR) filter to add a resonant sound of the body to the signal.
In the technology described in Japanese Patent Application Publication No. 2005-24997, when convolution operation is performed so as to reproduce a resonant sound of the body of a guitar of a certain model, the generated sound is heard as if the resonant sound of the body is added to the sound, unlike when convolution operation is not performed. However, the generated resonant sound is heard as being totally different from a resonant sound of the body of a guitar of a specific model, which the user desires to reproduce. This difference becomes more noticeable when convolution operation is performed on an electrical signal output from a guitar of a different model from a guitar of a model whose resonant sound the user desires to reproduce.
The invention has been made in view of the above circumstances and it is an object of the invention to improve accuracy of reproduction of a resonant sound of a body of a different stringed instrument from a stringed instrument, to which a string is attached, when convolution operation has been performed to add the resonant sound of the body of the different stringed instrument to an electrical signal representing vibration propagated from the string attached to the stringed instrument.
To achieve the above object, the invention provides a signal processing device comprising: a signal acquisition unit that acquires a signal corresponding to a vibration propagated from a string attached to a stringed instrument from an output element that outputs the signal corresponding to the vibration; and a signal processing unit including a filter that performs convolution operation using a filter coefficient set in the filter, the signal processing unit applying the convolution operation to the acquired signal through the filter and outputting a processed signal, wherein the filter is set with the filter coefficient corresponding to a transfer function which has a frequency response developing a plurality of peak waveforms corresponding to resonance of a body of another stringed instrument different from the stringed instrument within a specific frequency range and which allows components of the peak waveforms to decay more rapidly than a component of a fundamental sound in the vibration of the string in the processed signal.
In a preferred embodiment, the signal processing unit has another filter which performs convolution operation using a filter coefficient set in said another filter, and applies the convolution operations to the acquired signal using both the filters thereby outputting the processed signal, said another filter being set with the filter coefficient effective to suppress signals other than vibration components of the string in the acquired signal.
Preferably, said another filter is set with the filter coefficient corresponding to an inverse function of a transfer function of the vibration observed while the vibration is generated by the string and outputted as the signal from the output element, thereby enabling said another filter to suppress signals other than the vibration components of the string.
In another preferred embodiment, the signal processing device further comprises: an information acquisition unit that acquires first information associated with an inverse function of a transfer function of the vibration observed while the vibration is generated by the string and outputted as the signal from the output element, and that acquires second information associated with a transfer function of a sound which is generated by a string of another stringed instrument different from the stringed instrument and which is received after undergoing resonance of said another stringed instrument, and a setting unit that calculates a transfer function based on the first information and the second information acquired by the information acquisition unit and sets a filter coefficient corresponding to the calculated transfer function in the filter, the calculated transfer function having a frequency response developing a plurality of peak waveforms corresponding to resonance of the body of said another stringed instrument different from the stringed instrument appears within a specific frequency range, and allowing components of the peak waveforms to decay more rapidly than a component of a fundamental sound in the vibration of the string in the processed signal.
The invention also provides a signal processing device comprising: a signal acquisition unit that acquires a signal corresponding to a vibration propagated from a string attached to a stringed instrument from an output element that outputs the signal corresponding to the vibration; a signal processing unit including a filter that performs convolution operation using a filter coefficient set in the filter, the signal processing unit applying the convolution operation to the acquired signal through the filter, and outputting a processed signal; an information acquisition unit that acquires first information associated with an inverse function of a transfer function of the vibration observed while the vibration is generated by the string and outputted as the signal from the output element, and that acquires second information associated with a transfer function of a sound observed while the sound is generated by a string of another stringed instrument different from the stringed instrument and received after undergoing resonance of said another stringed instrument; and a setting unit that calculates a transfer function based on the first information and the second information acquired by the information acquisition unit and sets a filter coefficient corresponding to the calculated transfer function in the filter, the transfer function allowing the signal processing unit to output the processed signal reproducing a sound that has undergone resonance of said stringed instrument.
In a preferred embodiment, the signal processing device further comprises a storage unit that stores the first information, wherein the information acquisition unit acquires the first information from the storage unit.
The invention also provides a signal processing device comprising: a signal acquisition unit that acquires a signal corresponding to a vibration propagated from a string attached to a stringed instrument from an output element that outputs the signal corresponding to the vibration; a signal processing unit including one filter that performs convolution operation using a filter coefficient set in said one filter and another filter that is set with a filter coefficient effective to suppress signals other than vibration components of the string in the acquired signal, the signal processing unit applying the convolution operation to the acquired signal through both said one filter and said another filter and outputting a processed signal; an information acquisition unit that acquires information associated with a transfer function of a sound observed while the sound is generated by a string of another stringed instrument different from the stringed instrument and received after undergoing resonance of said another stringed instrument; and a setting unit that sets a filter coefficient corresponding to the transfer function acquired by the information acquisition unit in said one filter.
In a preferred embodiment, said another filter is set with a filter coefficient corresponding to an inverse function of a transfer function of a vibration observed while the vibration is generated by the string and outputted as the signal from the output element, thereby allowing said another filter to suppress signals other than the vibration components of the string.
The invention also provides a stringed instrument comprising: a string; an output element that outputs a signal corresponding to a vibration propagated from the string; and the signal processing device according to the invention.
According to the invention, it is possible to improve accuracy of reproduction of a resonant sound of a body of a different stringed instrument from a stringed instrument, to which a string is attached, when convolution operation has been performed to add the resonant sound of the body of the different stringed instrument to an electrical signal representing vibration propagated from the string attached to the stringed instrument.
a) to 7(c) illustrate change of the frequency distribution with respect to time when a first string (E) of an acoustic guitar is plucked;
a) to 8(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the acoustic guitar is plucked;
a) to 9(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the guitar is plucked in the case where convolution operation is not performed;
a) to 10(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the guitar is plucked in the case where convolution operation is performed; and
[Exterior Configuration]
The guitar 1 includes a terminal through which an audio signal Sout output from the signal processing device 10 is provided to an external device. The terminal is connected to a sound emitter 100 including a speaker, an amplifier, and the like through a shielded line or the like. Through this connection, the guitar 1 provides the audio signal Sout to the sound emitter 100 to emit a corresponding sound.
The pickup 3 is an output unit that includes a piezoelectric element and converts vibration of a string 2, which has propagated to the pickup 3, into an electrical signal (hereinafter referred to as an “audio signal Sin”) through the piezoelectric element.
The manipulation unit 5 includes a rotary switch, a manipulation button, and the like and outputs, upon receiving a signal corresponding to user manipulation on the manipulation unit 5, information indicating details of the manipulation. The manipulation unit 5 may also include a display for displaying a menu screen or the like.
The interface 6 is connected to an external device and exchanges information with the external device. For example, the interface 6 includes a slot into which a recording medium including a nonvolatile memory is inserted and reads data stored in the inserted recording medium and outputs the read data to the signal processing device 10. The interface 6 may be connected to another device through wireless or wired communication.
The signal processing device 10 acquires the audio signal Sin output from the pickup and information output from the manipulation unit 5 and the interface 6. A configuration of the signal processing device 10 is described below with reference to
[Configuration of Signal Processing Device 10]
The acquisition unit 11 acquires an audio signal Sin output from the pickup 3 and converts the audio signal Sin from analog to digital and outputs the resulting audio data Sd to the equalizer 12 and the filter unit 13.
Each of the equalizers 12-1 and 12-2 is a parametric equalizer, a graphic equalizer, or the like, and functions to perform an equalization process according to setting data. The equalizer 12-1 performs an equalization process on the audio data Sd and outputs audio data Se. The equalizer 12-2 performs an equalization process on audio data Sf output from the filter unit 13 according to setting data so as to output audio data Sfe. The setting data of the equalizers 12-1 and 12-2 is set based on user manipulation of the manipulation unit 5.
The filter unit 13 includes an FIR filter A 131 and an FIR filter B 132. The filter unit 13 is a signal processing unit that performs convolution operation on the received audio data Sd sequentially through the FIR filter A 131 and the FIR filter B 132 using filter coefficients set in the FIR filter A 131 and the FIR filter B 132 and outputs audio data Sf. Here, the filter unit 13 may perform convolution processes through both the FIR filter A 131 and the FIR filter B 132 in reverse order. That is, the FIR filter B 132 may first perform a convolution process on the audio data and the FIR filter A 131 may then perform a convolution process on the resulting signal. Although the FIR filter has been described as an example, it is possible to use a different filter, provided that transfer functions described below can be realized.
Filter coefficients of the FIR filter A 131 and the FIR filter B 132 are set through the setting unit 14.
The setting unit 14 reads and acquires information associated with a transfer function with reference to setting information stored in the storage unit 15 and sets filter coefficients corresponding to the transfer function in the FIR filter A 131 and the FIR filter B 132 of the filter unit 13. In this manner, the setting unit 14 functions as both an information acquisition unit that acquires information associated with a transfer function and a setting unit that sets filter coefficients. The setting information is described below with reference to
The transfer function registered in association with the model “G0” is an inverse function Php(t)−1 of a transfer function Php(t) of a sound generated from the string 2 of the guitar 1 until the sound is output as an audio signal Sin from the pickup 3. Namely, Php(t)−1 is an inverse function of a transfer function Php(t) of the vibration observed while the vibration is generated by the string 2 and outputted as the signal Sin from the output element 3. This transfer function Php(t) is calculated, for example, by striking the bridge part of the guitar 1 with an impulse hammer and analyzing an audio signal Sin output from the pickup 3 as an impulse response. The transfer function may be calculated using not only the calculation method employing an impulse hammer but also any other known calculation method. Information associated with the transfer function Php(t) rather than information associated with the inverse function Php(t)−1 may also be registered in the setting information. In this case, the setting unit 14 converts the transfer function Php(t) to the inverse function.
Each of the transfer functions registered in association with the models “G1” to “G5” is a transfer function Bhm(t) of a sound generated from a string of a guitar of a corresponding model until the sound is received by a predetermined sound receiving point after undergoing resonance of the body or the like of the guitar. Namely, Bhm(t) is a transfer function of a sound observed while the sound is generated by a string of another stringed instrument different from the stringed instrument 1 and received by a microphone after undergoing resonance of said another stringed instrument. Although the transfer functions of the models “G1”, “G2”, . . . , and “G5” are denoted by “Bhm(t)_1”, “Bhm(t)_2”, . . . , and “Bhm(t)_5”, each may also be denoted simply by “Bhm(t)”. Each of the transfer functions “G1” to “G5” is calculated, for example, by striking the bridge part of a guitar of the corresponding model with an impulse hammer and analyzing a sound, which is received by a microphone positioned at a predetermined receiving point such as a specific distance in front of the guitar, as an impulse response. The transfer function Bhm(t) may be calculated using not only the calculation method employing an impulse hammer but also any other known calculation method as described above.
The above is a description of details of the setting information.
The setting unit 14 reads the transfer function Php(t)−1 corresponding to the model “G0” with reference to the setting information and sets filter coefficients corresponding to the transfer function Php(t)−1 in the FIR filter A 131. In this example, the filter coefficients that are set in the FIR filter A 131 are determined to be those corresponding to the transfer function Php(t)−1. Thus, the setting unit 14 need not perform setting of the filter coefficients in the FIR filter A 131 since the filter coefficients are preset in the FIR filter A 131.
Setting of the filter coefficients in the FIR filter A 131 allows the FIR filter A 131 to output audio data, in which signal components other than vibration components of the string 2 are suppressed, by performing convolution operation on the input audio data Sd. Signal components other than vibration components of the string 2 are the result of, for example, the electrical characteristics of the pickup 3, the structure of the body 4 of the guitar 1 to which the string 2 is attached, and the like. Therefore, when ideal filter coefficients are set in the FIR filter A 131, audio data output from the FIR filter A 131 includes vibration components of the string 2 extracted from the audio data Sd. Namely, the FIR filter A 131 convolutes the input audio data Sd with the inverse function Php(t)−1 so as to suppress signals other than the vibration components of the string 2.
The setting unit 14 reads a transfer function Bhm(t) corresponding to a model specified by the user through manipulation of the manipulation unit 5 with reference to the setting information and sets filter coefficients corresponding to the read transfer function Bhm(t) in the FIR filter B 132.
Setting of the filter coefficients in the FIR filter B 132 allows the FIR filter B 132 to output audio data Sf, to which resonance components of a guitar of the specified model have been imparted, by performing convolution operation on audio data input to the FIR filter B 132. Namely, the FIR filter B 132 convolutes the input audio data Sd with the transfer function Bhm(t) to provide the output audio data Sf developing a plurality of peak waveforms corresponding to resonance of the body of another stringed instrument different from the stringed instrument 1 within a specific frequency range.
The audio data input to the FIR filter B 132 includes extracted vibration components of the string 2 attached to the guitar 1 as described above. Accordingly, the audio data Sf is obtained by imparting resonance of the guitar of the model specified by the user to the vibration of the string 2 attached to the guitar 1 rather than to sound of the audio signal Sin (audio data Sd) output from the pickup 3. Therefore, it is possible to improve accuracy of reproduction of the resonant sound of the body or the like of the guitar of the specified model, compared to when convolution operation is merely performed on the audio signal Sin (audio data Sd) output from the pickup 3.
Setting the filter coefficients in the FIR filter A 131 and the FIR filter B 132 as described above allows the filter unit 13 to have a transfer function of Php(t)−·Bhm(t)(=IRpm(t)). The transfer function IRpm(t) represents, for example, characteristics shown in
As shown in
The transfer function IRpm(t) changes with time such that the signal (i.e., the audio data Sf) obtained by performing corresponding convolution operation has characteristics as shown in
As described above, the transfer function IRpm(t) changes with time such that the audio data Sf that the filter unit 13 outputs by performing convolution operation using the transfer function IRpm(t) has the characteristics shown in
Namely, the FIR filter B 132 convolutes the input audio data Sd with the transfer function Bhm(t) to impart the frequency response as depicted by the spectrum a to the output audio data Sf developing a plurality of peak waveforms f1 and f2 corresponding to resonance of the body of another stringed instrument different from the stringed instrument 1 within a specific frequency range. Further, the FIR filter A 131 convolutes the input audio data Sd with the inverse function Php(t)−1 so as to impart the frequency response as depicted by the spectrum b to the output audio data Sf.
Referring back to
The output unit 16 acquires the audio data Se and the audio data Sfe, converts each of the audio data Se and the audio data Sef from digital to analog, amplifies the two analog audio signals by respective amplification factors (i.e., gains) set for the audio data Se and the audio data Sef, adds the amplified audio signals, and then outputs the resulting signal as an audio signal Sout to the terminal of the guitar 1. Thus, the output unit 16 provides the audio signal Sout to the sound emitter 100 connected to the terminal.
The amplification factors are set as the user specifies by manipulating the manipulation unit 5. Here, when one of the audio data Se and the audio data Sef is set to be excluded from the audio signal Sout, the output unit 16 may set the amplification factor of the audio signal produced through conversion of the audio data to “0”. In addition, components provided in a path for performing processes on the audio data may be set to be disabled.
The above is a description of the configuration of the signal processing device 10.
The guitar 1 of the embodiment of the invention can output the audio signal Sout after adding resonant sound of the body or the like of a guitar of a different model to the audio signal Sout by performing convolution operation on the audio signal Sin output from the pickup 3 through the filter unit 13 in the above manner. Here, it is possible to improve accuracy of reproduction of the resonance of the body of the guitar of the different model since the transfer function of the filter unit 13 has a frequency response, in which peaks f1 and f2 corresponding to resonance of the body in the guitar of the different model appear, and the components of the peaks f1 and f2 decay more rapidly than the component of a fundamental sound of the vibration of the string 2 in the signal obtained through convolution operation using the transfer function.
In addition, it is possible to further improve accuracy of reproduction of the resonant sound of the body or the like of the guitar of the different model, compared to when convolution operation is performed simply on the audio signal Sin (audio data Sd) output from the pickup 3, since the transfer function of the filter unit 13 is determined using the inverse function of the transfer function of a vibration generated from the string 2 of the guitar 1 until the vibration is output as the audio signal Sin from the pickup 3.
[Frequency Distribution Comparison]
A frequency distribution when a first string (E) of an actual acoustic guitar is plucked and a frequency distribution when a first string (E) of the guitar 1 is plucked (with and without convolution operation through the filter unit 13) are compared in the following description. First, the case of the acoustic guitar is described with reference to
a) to 7(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the acoustic guitar is plucked. This frequency distribution is a frequency distribution of an audio signal that a microphone produces by receiving sound of the acoustic guitar. A frequency axis, a time axis, and a signal level axis are shown in each of
a) illustrates the entire frequency distribution of the audio signal produced by receiving sound of the acoustic guitar.
a) to 8(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the acoustic guitar is plucked.
As shown in
Next, the difference of the frequency distribution when the first string (E) of the guitar 1 is plucked in the case where convolution operation is performed through the filter unit 13 and in the case where convolution operation is not performed through the filter unit 13 is described with reference to
a) to 9(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the guitar 1 is plucked in the case where convolution operation is not performed. This frequency distribution is a frequency distribution of an audio signal Sin (audio data Sd) output from the pickup 3 of the guitar 1.
a) to 10(c) illustrate change of the frequency distribution with respect to time when the first string (E) of the guitar 1 is plucked in the case where convolution operation is performed. This frequency distribution is a frequency distribution of the audio data Sf output from the filter unit 13 of the guitar 1.
Performing convolution operation on the audio signal Sin through the filter unit 13 in this manner results in the addition of a resonance component as shown in
<Modifications>
Although the embodiment of the invention has been described above, the invention can provide various other modifications as described below.
[Modification 1]
Although the filter unit 13 includes the FIR filter A 131 and the FIR filter B 132 that are connected in series in the above embodiment, the filter unit 13 may also be constructed as a single FIR filter or the like. In this case, the setting unit 14 may calculate the composite transfer function IRpm(t) based on both the transfer function Php(t)−1 and the transfer function Bhm(t) and may set filter coefficients corresponding to the composite transfer function IRpm(t) in the filter unit 13.
In this case, the content of the setting information stored in the storage unit 15 may be different from that of the above embodiment as shown in
[Modification 2]
Although the transfer functions Bhm(t) and IRpm(t) are set so as to satisfy conditions that the peaks f1 and f2 appear in the transfer functions Bhm(t) and IRpm(t), and the components of the peaks f1 and f2 decay more rapidly than the frequency components of vibration of the string 2 in the signal obtained through convolution operation, these conditions need not necessarily be satisfied.
Also in this case, it is possible to perform convolution operation through the FIR filter B 132 on a signal corresponding to extracted vibration components of the string 2 of the guitar 1 due to presence of the transfer function Php(1)−1 set in the FIR filter A 131, and therefore it is possible to further improve accuracy of reproduction of acoustic effects of resonance even when the resonance to be imparted is not body resonance. This makes it possible to reproduce acoustic effects of a stringed instrument whose resonance does not have the frequency response having peaks f1 and f2.
[Modification 3]
Although the signal processing device 10 is a part of the guitar 1 in the above embodiment, the signal processing device 10 need not be a part of the guitar 1. In this case, the signal processing device 10 may include an input terminal for acquiring the audio signal Sin and components corresponding to the manipulation unit 5 and the interface 6. The setting information stored in the storage unit 15 may also register information associated with transfer functions Php(t)−1 in association with guitars of a plurality of models.
In this configuration, the user specifies a model of a guitar, which provides the audio signal Sin to the signal processing device 10, by manipulating the manipulation unit 5. Accordingly, the setting unit 14 sets filter coefficients corresponding to a transfer function Php(t)−1 of the specified model in the FIR filter A 131. As illustrated in the above embodiment, when the user specifies a model of a guitar having resonance that the user desires to reproduce, the setting unit 14 sets filter coefficients corresponding to the transfer function Bhm(t) of the specified model in the FIR filter B 132.
Accordingly, the user can play various guitars using the signal processing device 10 so that it is possible to output a sound reproducing the resonance of a guitar of a model different from the guitar 1.
[Modification 4]
Although the guitar 1 has been described as an example of a stringed instrument in the above embodiment, the stringed instrument need not be a plucking stringed instrument such as the guitar. The stringed instrument may be any type which uses a string as a sound source, for example, a bowed instrument such as a violin and a keyboard instrument such as a piano. The stringed instrument may include an output means that converts a vibration propagated from a string into an electrical signal and outputs the electrical signal, similar to the pickup 3.
Any of a variety of stringed instruments other than the guitar may be applied as the stringed instrument whose resonant sound the user desires to reproduce. A transfer function Bhm(t) for the stringed instrument, which the user desires to apply, may be previously calculated using the calculation method described in the above embodiment.
In this modification, the signal processing device 10 can output an audio signal Sout of sound having a resonant sound similar to the resonant sound of a cello while the user plays a violin by acquiring an audio signal Sin output as the user plays the violin and performing convolution operation through the filter unit 13 using a transfer function for reproducing the resonance of the body of the cello. In addition, even when the violin is a stringed instrument such as an electric violin that does not have a body, it is possible to reproduce body resonance of a stringed instrument having a body. Here, it is possible to further improve accuracy of reproduction of the resonant sound by performing convolution operation using filter coefficients corresponding to a transfer function including the transfer function Php(t)−1.
Number | Date | Country | Kind |
---|---|---|---|
2010-063307 | Mar 2010 | JP | national |