The present invention relates to a musical sound generating device, a control method for the musical sound generating device, a storage unit, and an electronic musical instrument.
Conventionally, devices have been proposed that synthesize musical sound by modeling the sound-producing principles of musical instruments (hereafter, referred to as “modeling sound sources”) (the related art disclosed in Patent Document 1, for example). In this conventional technology, the disclosed musical sound synthesizing device synthesizes the musical sound of a wind instrument. An input device specifies any of a plurality of fingerings corresponding to the same pitch in accordance with an operation performed by a user. A variable control unit sets variables such that the variables change in accordance with the fingering specified by the input device. A musical sound synthesizing unit synthesizes a musical sound in accordance with the variables by utilizing a physical model that simulates the sound produced by the wind instrument.
Patent Document 1: Japanese Patent Application Laid-Open Publication No. 2009-258238
In the above-described conventional technology, the pipe body part of a wind instrument is modeled. However, the mouthpiece or the like of single reed wind instruments also has distinct acoustic characteristics, and therefore it is possible to consider implementing the mouthpiece as a mouthpiece device by modeling the mouthpiece section. Conventionally, however, there is no known technique for suitably modelling a mouthpiece.
The present invention makes it possible to provide a musical instrument generating device that suitably models the shape of a mouthpiece, a control method for the musical instrument generating device, a storage medium, and an electronic instrument. Accordingly, the present invention is directed to a scheme that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.
Additional or separate features and advantages of the invention will be set forth in the descriptions that follow and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, in one aspect, the present disclosure provides a musical sound generating device, including: one or more operating units having sensors that detect operations of a performer; a processor communicating with the one or more operating units, wherein the processor is configured to perform the following: determine a reflection coefficient of a progressive wave and a regressive wave using a mouthpiece model that models a mouthpiece as a three-dimensional shape having one end at which the mouthpiece is to be held in a mouth of the performer being smaller than another end, the progressive wave progressing through the modeled mouthpiece from the one end to the another end and the regressive wave regressing through the modeled mouthpiece from the another end to the one end, the reflection coefficient being determined by determined a wave impedance for the progressive wave and determining a wave impedance for the regressive wave; and generate a musical sound signal on the basis of the determined reflection coefficient and an operation of the performer sensed by the one or more operating units, and outputs the musical sound signal to a sound generator for sound production.
In another aspect, the present disclosure provides a method of generating a musical sound by a musical sound generating device having a processor and a sound generator that is connected to the processor, the method comprising causing the processor to perform the following: determine a reflection coefficient of a progressive wave and a regressive wave using a mouthpiece model that models a mouthpiece as a three-dimensional shape having one end at which the mouthpiece is held in a mouth of a performer being smaller than another end, the progressive wave progressing through the mouthpiece model from the one end to the another end and the regressive wave regressing through the mouthpiece model from the another end to the one end, the reflection coefficient being determined by determining a wave impedance for the progressive wave and a wave impedance for a second wave impedance of the regressive wave; generate a musical sound signal on the basis of the determined reflection coefficient; and output the musical sound signal to the sound generator for sound production.
In another aspect, the present disclosure provides a non-transitory storage medium having stored therein instructions executable by a processor in a musical sound generating device, the instructions causing the processor to perform the following: determine a reflection coefficient of a progressive wave and a regressive wave using a mouthpiece model that models a mouthpiece as a three-dimensional shape having one end at which the mouthpiece is held in a mouth of a performer being smaller than another end, the progressive wave progressing through the mouthpiece model from the one end to the another end and the regressive wave regressing through the mouthpiece model from the another end to the one end, the reflection coefficient being determined by determining a wave impedance for the progressive wave and a wave impedance for a second wave impedance of the regressive wave; generate a musical sound signal on the basis of the determined reflection coefficient; and output the musical sound signal to a sound generator in the musical sound generating device for sound production.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory, and are intended to provide further explanation of the invention as claimed.
Hereafter, one embodiment for realizing the present invention will be described in detail while referring to the drawings.
First, the bore section 102, which plays a central role in the physical modelling of the electronic musical instrument 100, includes a delay line section 104. The delay line section 104 executes delay line processing in which propagation of a progressive wave and a regressive wave of sound inside a pipe of a musical instrument such as a wind instrument is modeled using a combination of delay processing operations realized using digital signal processing. The delay line section 104 includes a plurality of delay processing units 105a that cause a progressive wave that propagates from the mouthpiece section 101 toward the bell section 103 to be sequentially delayed by delay amounts determined by Z−m0, Z−m1, . . . , Z−mN, (“Z” is the transfer function of a z transform), respectively, and a plurality of delay processing units 105b that cause a regressive wave that propagates from the bell section 103 toward the mouthpiece section 101 to be sequentially delayed by delay amounts determined by Z−m0, Z−m1, . . . , Z−mN, respectively. Here, N is an arbitrary natural number. In addition, the delay line section 104 includes the #0, #1, . . . , #N−1 finger hole modeling units 106, which are provided at delay positions #0, #1, . . . , #N−1, respectively defined as positions between Z−m0 and Z−m1, between Z−m1 and Z−m2, . . . , and between Z−mN−1 and Z−mN for both progressive waves and regressive waves. The finger hole modelling units 106 execute finger hole modeling processing in which parameters relating to finger holes are selected and the behavior of sound waves in finger hole parts of the acoustic wind instrument 10 is modeled by performing digital signal processing on the basis of a sensor input value 111, which is supplied as pitch specifying information from a sensor 110 functioning as a pitch specifying switch, which may be one or more operating units having sensors to sense operations of the performer. As a result, the finger hole modeling units 106 each output part of the above-described progressive wave and regressive wave as #0, #1, . . . , #N−1 finger hole emission sounds 118. These #0, #1, . . . , #N−1 finger hole emission sounds 118 are mixed to form musical sound via an adder 109.
The mouthpiece section 101 includes an oscillation exciting unit 107. The oscillation exciting unit 107 calculates a progressive wave input signal 114 on the basis of prescribed performance input information 112, which is supplied as part of input information 110 from a sensor (not shown) (for example, a breath sensor) that detects blowing input (strength of breath, embouchure (shape of mouth), etc.) made by a performer, and on the basis of a regressive wave output signal 113 from the delay line section 104 of the bore section 102. The oscillation exciting unit 107 further causes the calculated progressive wave input signal 114 to be input to the delay line section 104.
The bell section 103 includes an emission unit 108 and a mixing unit 109. On the basis of a progressive wave output signal 115 from the delay line section 104, the emission unit 108 outputs an emission signal 117 that simulates emission from the bell section 103, and calculates a regressive wave input signal 116 and then causes the regressive wave input signal 116 to be input to the delay line section 104.
The mixing unit 109 mixes the emission signal 117 output from the emission unit 108 with the finger hole emission sounds 118 that are output from the #0, #1, . . . , #N−1 finger hole modeling units 106 and that simulate the emission of sound waves from the respective finger hole parts, and then outputs a final musical sound signal 119.
Hereafter, an operation of one embodiment of the electronic musical instrument 100 will be described.
However, modeling schemes of the mouthpiece section 101, as illustrated in
mÿ+D{dot over (y)}+ky=−Ar{pin−pb−}−Fin (1)
The reed vibration calculating unit 401 solves the equation of motion represented by formula 1 above.
Next, a reflection coefficient calculating unit 402 in
A reflection calculating unit 403 causes the model of the reed 502 (
The modeling performed in the reflection coefficient calculating unit 402 in
A pressure wave p(x, t) of a spherical wave is expressed by the following formula 2 using a complex exponential function expression.
Here, p+ and p− respectively represent a progressive pressure and a regressive pressure, x represents a position in an advancing direction from the leading end of the cone-shaped reed 502, t represents time, A and B respectively represent the amplitude of a progressive wave and the amplitude of a regressive wave, ω represents the angular frequency, and k=ω/c represents the wavenumber (c is the speed of sound). When a volume flow rate is expressed as u(x, t), there is a relationship between p and u expressed by the following formula 3 based on Newton's laws of motion.
Here, ρ represents the density of air and S(x) represents the surface area of a wavefront at a position x. After obtaining u from formula 2 and formula 3, the following formula 4 is obtained. Here, u+ and u− respectively represent a progressive flow amount and a regressive flow amount.
Therefore, the wave impedance of a spherical wave with respect to a progressive wave is calculated from the following formula 5.
In addition, the wave impedance of a spherical wave with respect to a regressive wave is calculated from the following formula 6. Here, the * at the top right of the right hand side of formula 6 indicates the complex conjugate.
The reflection coefficient at the boundary between the mouth and the mouthpiece 501 can be modeled by using an impedance Zmp calculated using formula 5 or formula 6.
θ is written as θ(y), which means that θ changes in accordance with y. If the reed opening degree y of the reed 502 is known, θ(y) is also determined, and the distance x to the leading end of the mouthpiece 501 (leading end of cone part) can be calculated.
When y=0, x=0. In addition, although not possible in practice, the following formula 8 holds true.
Let Smo represent the cross-sectional area of the inside of the mouth 701. Then the characteristic impedance Zmo of the inside of the mouth 701 (cylinder) is expressed by the following formula 9.
The reflectance Rm when a regressive pressure wave in the mouthpiece interior 503 is reflected at the boundary between the mouth 701 and the mouthpiece 501 is expressed by the following formula 10.
Therefore, based on formulas 5, 9, and 10, the reflectance Rm is expressed by the following formula 11.
In formula 11, S(x) represents the wavefront surface area of a progressive wave and a regressive wave at the boundary between the mouth 701 and the mouthpiece 501. Formula 11 is a reflection coefficient that includes the imaginary unit j and is expressed as a complex number, and is a filter in the form of a calculation. The distance x up to the leading end of the mouthpiece 501 (leading end of cone part) illustrated in
The mouthpiece 501 is closed when the reed opening degree y=0, and therefore S(x)=0, and consequently the reflectance Rm=−1. This correctly expresses reflection at the apex of a cone. In addition, although not possible in practice, when y→ymo, S(x)→Smo, and based on formula 8, the following formula 12 holds true.
Thus, the following formula 13 holds true.
Formula 13 expresses that the mouth 701 and the mouthpiece 501 are connected in a continuous manner, and that reflection does not occur. Therefore, the calculation of the reflectance Rm using formula 11 in the modeling according to the present embodiment, which is performed by the reflection coefficient calculating unit 402 in
As another embodiment, the shape of the mouthpiece interior 503 (
p(x,t)={AHα+(x)+BHα−(x)}ejωt (14)
Here,
Hα+(x),Hα−(x)
is a Hankel function (Bessel function of the third kind), and the definition thereof is given by the following formula 15.
Hα±(x)=Jα(x)±jYα(x) (15)
Here,
Jα(x) PS is the Bessel function of the first kind, and
Yα(x)
is the Neumann function (Bessel function of the second kind), and the respective definitions thereof are given by the following formulas 16 and 17. Here, α is a constant, and Γ is a gamma function.
The reflection coefficient Rm in the case of modeling the mouthpiece interior as a cylindrical sector shape therefore can be obtained by calculating the wave impedances in the manner described above by applying formulas 14 to 17 in place of the above-listed formula 2. Since the Bessel function of the first kind is an infinite series, it is sufficient to perform an approximation calculation that can be handled by the calculation power of a sound source LSI (804 in
The example hardware illustrated in
The CPU 801 performs overall control of the electronic musical instrument 100. The ROM 802 stores a sound production control program. The RAM 803 temporarily stores data when the sound production control program is being executed.
The output of the breath sensor 805 is converted into a digital signal from an analog signal by the ADC 806, and is read by the CPU 801.
Each operation state of the pitch specifying switch 807 is read by the CPU 801 via the I/O 808. The pitch specifying switch may include one or more operating units having sensors to detect figure operations of the performer, for example.
The sound source LSI 804 realizes a function of generating the musical sound signal 119 in
The musical sound signal 119 output from the LSI 804 is converted into an analog signal from a digital signal and then amplified in the DAC/amplifier 809 via the CPU 801, and is then output as sound via the speaker 810. The DAC/amplifier 809 together with the speaker 810 therefore is a sound generator.
In the embodiments of the present invention, the sound source LSI 804 is implemented by a digital signal processor (DSP) for example, and calculation processing operations corresponding to the functions of the delay line section 104, the oscillation exciting unit 107, and the emission unit 108 in
Furthermore, the CPU 801 executes a control program (not shown) stored in the ROM 802 to determine the delay positions of the finger hole modelling units 106 (i.e., determine which finger hole modeling unit should be in the state of open or closed) that can best represent the pitch specified by pitch specifying information 111 (
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover modifications and variations that come within the scope of the appended claims and their equivalents. In particular, it is explicitly contemplated that any part or whole of any two or more of the embodiments and their modifications described above can be combined and regarded within the scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2016-190427 | Sep 2016 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5543580 | Masuda | Aug 1996 | A |
20070017352 | Masuda | Jan 2007 | A1 |
20080295669 | Hashimoto | Dec 2008 | A1 |
20080314226 | Shibata | Dec 2008 | A1 |
20090019999 | Onozawa | Jan 2009 | A1 |
20090020000 | Onozawa | Jan 2009 | A1 |
20090038463 | Fujii | Feb 2009 | A1 |
20140090547 | Udell, III | Apr 2014 | A1 |
Number | Date | Country |
---|---|---|
2009-258238 | Nov 2009 | JP |
Number | Date | Country | |
---|---|---|---|
20180090120 A1 | Mar 2018 | US |