Patent Grant
11527226
The present subject matter relates to an audio parameter adjustment apparatus, an audio parameter adjustment method and a non-transitory computer readable storing an audio parameter adjustment program for adjusting an audio parameter that is set for a part.
In an electronic musical apparatus that can play a plurality of parts, there is a technique for changing an audio parameter value of one part according to a change of an audio parameter value of another part. In a contents control device described in JP 2016-81045 A, a parameter value is calculated based on an envelope of an input audio waveform, and the parameter value is supplied to a tone generation circuit. Thus, according to an envelope of an audio waveform of a predetermined performance part out of a plurality of performance parts, the generation manner of a musical sound of another performance part can be automatically changed, for example.
However, in the contents control device of the above-mentioned JP 2016-81045 A, specialized knowledge and a complicated setting operation are required in order to appropriately set the relationship among the plurality of performance parts. It is not easy for an unskilled user to make such settings.
An object of the present subject matter is to provide an audio parameter adjustment apparatus, an audio parameter adjustment method and a non-transitory computer readable storing an audio parameter adjustment program for enabling the change of audio parameter values of a plurality of parts easily and effectively.
An audio parameter adjustment apparatus according to the present subject matter includes a reference part determiner that determines one part out of a plurality (three or more) of parts as a reference part, a subject part group determiner that determines a plurality of other parts except for the reference part out of the plurality of parts as a subject part group, an acquirer that acquires a change pattern of a value of a first audio parameter set for the reference part, and a changer that changes a value of a second audio parameter set for the subject part group according to the acquired change pattern.
The first audio parameter may be a volume, and the change pattern may be an envelope representing a temporal change in volume.
The audio parameter adjustment apparatus may further includes a receiver that receives selection of the second audio parameter, and a judge that judges whether a value of the selected second audio parameter is to be changed in regard to each part of the subject part group based on the selected second audio parameter and a changeability condition, wherein the changer may change the value of the second audio parameter according to the change pattern in regard to a part having the value of the second audio parameter that has been judged to be changed in the subject part group. The audio parameter adjustment apparatus may further include a setter that sets a change coefficient indicating a degree to which the second audio parameter is to be changed for a part having the value of the second audio parameter that has been judged to be changed based on the selected second audio parameter and a coefficient setting condition.
The reference part determiner may determine a part satisfying a determination condition out of the plurality of parts as the reference part. The determination condition may be that the value of the first audio parameter shifts between an upper range and a lower range a certain number of times or more in a certain period of time with a threshold value used as a boundary between the upper range and the lower range. The determination condition may be that an arpeggio is set.
An audio parameter adjustment method according to the present subject matter includes determining one part out of a plurality (three or more) of parts as a reference part, determining a plurality of other parts except for the reference part out of the plurality of parts as a subject part group, acquiring a change pattern of a value of a first audio parameter set for the reference part, and changing a value of a second audio parameter set for the subject part group according to the acquired change pattern.
The first audio parameter may be a volume, and the change pattern may be an envelope representing a temporal change in volume.
The audio parameter adjustment method may further include receiving selection of the second audio parameter, and judging whether a value of the selected second audio parameter is to be changed in regard to each part of the subject part group based on the selected second audio parameter and a changeability condition, wherein the changing a value of the second audio parameter may include changing the value of the second audio parameter according to the change pattern in regard to a part having the value of the second audio parameter that has been judged to be changed in the subject part group. The audio parameter adjustment method may further include setting a change coefficient indicating a degree to which the second audio parameter is to be changed for a part having the value of the second audio parameter that has been judged to be changed based on the selected second audio parameter and a coefficient setting condition.
The determining a reference part may include determining a part satisfying a determination condition out of the plurality of parts as the reference part. The determination condition may be that the value of the first audio parameter shifts between an upper range and a lower range a certain number of times or more in a certain period of time with a threshold value used as a boundary between the upper range and the lower range. The determination condition may be that an arpeggio is set.
A non-transitory computer readable medium storing an audio parameter adjustment program according to the present subject matter, the audio parameter adjustment program, when executed by a computer, causing the computer to determine one part out of a plurality (three or more) of parts as a reference part, determine a plurality of other parts except for the reference part out of the plurality of parts as a subject part group, acquire a change pattern of a value of a first audio parameter set for the reference part, and change a value of a second audio parameter set for the subject part group according to the acquired change pattern.
The first audio parameter may be a volume, and the change pattern may be an envelope representing a temporal change in volume.
The non-transitory computer readable medium storing the audio parameter adjustment program, when executed by a computer, the audio parameter adjustment program may further cause the computer to receive selection of the second audio parameter, judge whether a value of the selected second audio parameter is to be changed in regard to each part of the subject part group based on the selected second audio parameter and a changeability condition, wherein the changing a value of the second audio parameter may include changing the value of the second audio parameter according to the change pattern in regard to a part having the value of the second audio parameter that has been judged to be changed in the subject part group. The non-transitory computer readable medium storing the audio parameter adjustment program may further include setting a change coefficient indicating a degree to which the second audio parameter is to be changed for a part having the value of the second audio parameter that has been judged to be changed based on the selected second audio parameter and a coefficient setting condition.
The determining a reference part may include determining a part satisfying a determination condition out of the plurality of parts as the reference part. The determination condition may be that the value of the first audio parameter shifts between an upper range and a lower range a certain number of times or more in a certain period of time with a threshold value used as a boundary between the upper range and the lower range. The determination condition may be that an arpeggio is set.
Other features, elements, characteristics, and advantages of the present subject matter will become more apparent from the following description of preferred embodiments of the present subject matter with reference to the attached drawings.
An audio parameter adjustment apparatus, an audio parameter adjustment method and a non-transitory computer readable medium storing an audio parameter adjustment program according to embodiments of the present subject matter will be described below in detail with reference to the drawings.
[1] Configuration of Electronic Musical Apparatus
The electronic musical apparatus 1 includes a performance operating element 2, an input I/F (interface) 3, a setting operating element 4, a detection circuit 5, a display 6 and a display circuit 7. The performance operating element 2 includes a keyboard including a plurality of keys, for example. Further, the performance operating element 2 may include a pedal operator that is operated by the user with a foot (an expression pedal, a pedal switch or a damper pedal, for example), and a rotary operator (a rotary encoder, for example) or a slide operator (a linear encoder, for example). The performance operating element 2 is connected to a bus 19 via the input I/F 3, and performance data based on a performance operation of the user is input by the performance operating element 2.
The setting operating element 4 includes a switch that is operated in an on-off manner, a variable resistor that is operated in a rotational manner or a sliding manner, etc., and is connected the bus 19 through the detection circuit 5. The setting operating element 4 is used for switching of a tone color, adjustment of the volume, on-off of a power supply and various settings. The display 6 is connected to the bus 19 through the display circuit 7. Various information relating to a musical performance, settings and so on is displayed in the display 6. At least part of the display 6 and the setting operating element 4 may be constituted by a touch panel display.
The electronic musical apparatus 1 further includes a RAM (Random Access Memory) 9, a ROM (Read Only Memory) 10, a CPU (Central Processing Unit) 11, a timer 12, a storage device 13 and a communication I/F (interface) 14. The RAM 9, the ROM 10, the CPU 11, the storage device 13 and the communication I/F 14 are connected to the bus 19, and the timer 12 is connected to the CPU 11. External equipment such as an external storage device 15 may be connected to the bus 19 via a communication I/F 14. The RAM 9, the ROM 10 and the CPU 11 constitute a computer. Further, the RAM 9, the ROM 10, the CPU 11 and the storage device 13 constitute the audio parameter adjustment apparatus 100.
The RAM 9 is made of a volatile memory, for example, is used as a working area for the CPU 11 and temporarily stores various data. The ROM 10 is made of a non-volatile memory, for example, and stores a computer program such as a control program and the audio parameter adjustment program. The CPU 11 executes the audio parameter adjustment program stored in the ROM 10 on the RAM 9 to perform an audio parameter setting process and an audio parameter control process, mentioned below. The timer 12 provides clock information such as a current time to the CPU 11.
The storage device 13 includes a storage medium such as a hard disc, an optical disc, a magnetic disc or a memory card. Similarly to the storage device 13, the external storage device 15 includes a storage medium such as a hard disc, an optical disc, a magnetic disc or a memory card. The above-mentioned audio parameter adjustment program may be stored in the storage device 13 or the external storage device 15.
The audio parameter adjustment program may be supplied in the form of being stored in a recording medium which is readable by a computer, and installed in the ROM 10 or the storage device 13. Further, in a case where the communication I/F 14 is connected to a communication network, the audio parameter adjustment program delivered from a server connected to the communication network may be installed in the ROM 10 or the storage device 13.
The electronic musical apparatus 1 further includes a tone generator 16 and a sound system 18. The tone generator 16 is connected to the bus 19, and the sound system 18 is connected to the tone generator 16 and the bus 19. The tone generator 16 generates an audio signal based on performance data input from the performance operating element 2 or sequence data provided from the storage device 13 and gives acoustic effects to the audio signal. The acoustic effects include such as Reverb, Delay, Modulation, Distortion, Brilliance and Enhancement, for example. The sound system 18 includes a digital/analog (D/A) conversion circuit, an amplifier and a speaker. The sound system 18 generates a musical sound based on an audio signal provided by the tone generator 16.
[2] Functional Configuration of Audio Parameter Adjustment Apparatus
A plurality (three or more) of parts are set in the present embodiment. The plurality of parts includes a rhythm part and normal parts. For example, the tone color of a percussion instrument such as drums is assigned to the rhythm part, for example. The tone color of a musical instrument (a piano, a guitar and a bass or the like, for example) that can generate a plurality of pitches that form a melody or an accompaniment is assigned to the normal parts. The sound input from the outside through a microphone or the like (an input sound) may be assigned to an either part. Further, each part is classified into any of a manual performance part and an automatic performance part. In the manual performance part, the user operates the performance operating element 2 of
The reference part determiner 51 determines one of the plurality of parts as a reference part. The part, which the user has selected by operating the setting operating element 4, is determined as the reference part, for example. As described below, a determination condition for determining the reference part may be defined, and the reference part may be determined based on the determination condition. The subject part group determiner 52 determines the other plurality of parts except for the reference part out of the plurality of parts as a subject part group. Hereinafter, each of the plurality of parts included in the subject part group determined by the subject part group determiner 52 is referred to as a subject candidate part.
The acquirer 53 acquires a change pattern of a first audio parameter value set for the reference part. In the present example, the first audio parameter is the volume, and the change pattern is the envelope representing the temporal change of volume. The envelope representing the temporal change of volume is acquired from the audio signal of the reference part output from the tone generator 16, for example.
The receiver 54 receives selection of a second audio parameter to be set for the subject part group. For example, the user selects the second audio parameter by operating the setting operating element 4 of
The judge 55 judges whether a second audio parameter value is to be changed in regard to each subject candidate part of the subject part group determined by the subject part group determiner 52 (hereinafter referred to as changeability judgement). Hereinafter, the subject candidate part having the second audio parameter value that has been judged to be changed in the changeability judgement is referred to as a change subject part. The setter 56 sets a change coefficient indicating the degree to which the second audio parameter value is changed in regard to each change subject part. In the present example, a changeability condition for making the changeability judgement and a coefficient setting condition for setting a change coefficient are defined. The changeability condition and the coefficient setting condition may be fixed or may be changeable by the user. The judge 55 carries out the changeability judgement based on the changeability condition, and the setter 56 sets a change coefficient based on the coefficient setting condition. Details of the changeability condition and the coefficient setting condition will be described below.
The changer 57 changes the second audio parameter value of the subject part group according to the change pattern acquired by the acquirer 53. In the present example, the second audio parameter value of the change subject part of the subject part group is changed. In this case, the changer 57 controls the second audio parameter value of the change subject part by controlling the tone generator 16 of
[3] First and Second Audio Parameters
When musical performance is started, the acquirer 53 of
For example, the envelope representing the temporal change of the volume of the reference part is extracted as a change pattern, and the second audio parameter values (the volume, for example) of the subject part group are changed according to the envelope.
Here, the second audio parameter value cannot be changed effectively depending on the manner in which the first audio parameter value of the reference part is changed. For example, in a case where the frequency of change of the first audio parameter value is low, the frequency of change of the second audio parameter value is also low. Thus, musical appeal is likely to be poor.
As such, being a rhythm part may be defined as a determination condition of a reference part, for example. Generally, in the rhythm part, a plurality of sounds are successively arranged on a time axis, and each sound has relatively large attack and attenuation. Therefore, the volume of the rhythm part changes continuously or intermittently. Therefore, in a case where a rhythm part is determined as a reference part, the second audio parameter values of the subject part group are effectively changed according to the temporal change of volume of the reference part. Alternatively, the setting of an arpeggio may be defined as a determination condition. In a case where an arpeggio is set, the pitch of the corresponding part is successively changed according to a preset arpeggio pattern. Because a plurality of sounds are also successively arranged on the time axis in this case, the volume is likely to be changed continuously or intermittently. Therefore, in a case where the part with the setting of an arpeggio is determined as a reference part, the second audio parameter values of the subject part group are effectively changed according to the temporal change of volume of the reference part.
Further, it may be defined as a determination condition that the degree to which the first audio parameter value is changed meets a certain standard. For example, it may be defined as a determination condition that the volume shifts between an upper range and a lower range the certain number of times or more in every certain period of time with a threshold value used as a boundary. Because the volume of the reference part is also changed continuously or intermittently in this case, the second audio parameter values of the subject part group are effectively changed according to the temporal change of volume of the reference part.
In the present example, a collective setting screen for collectively setting the reference part and the subject candidate parts is displayed in the display 6 of
The part (part number) currently being selected as the reference part is displayed in the part display region R1. In the example of
In the parameter selection region R3, the second audio parameter can be selected. “Destination” represents the second audio parameter. In the example of
When the collective setting button SB is operated, the currently selected part (the part displayed in the part display region R1) is determined as the reference part, and the plurality of other parts are determined as the subject part group. Further, when the collective setting button SB is operated, the selection of the second audio parameter displayed in the parameter selection region R3 is received.
[4] Condition Table
Specific examples of the changeability condition and the coefficient setting condition will be described. In the present example, a condition table that defines the changeability condition and coefficient setting condition is used.
As for the PCM sound source, parameter names and change coefficients are separately defined for normal parts and a rhythm part. In a case where the PCM sound source is used, even when the value of “Cutoff,” “Resonance” or the like is changed for the rhythm part, the change is hardly perceptible aurally. As such, it is defined as the changeability condition that part of the selection subject parameter values is not to be changed for the rhythm part. In the condition table of
The judge 55 of
The setter 56 of
[5] Parameter Control Information
The storage device 13 of
The parameter control information pieces include a reference parameter, a control parameter and a change coefficient. In this case, the control parameter is controlled based on the reference parameter. The parameter assigned to any operator included in the performance operating element 2 of
In the example of
In the present embodiment, in a case where the reference part and the change subject parts are determined, the first audio parameter is stored as the reference parameter, and the second audio parameter is stored as the control parameter, in any of the setting storage regions of the change subject parts. Thus, the second audio parameter is controlled based on the first audio parameter.
[6] Audio Parameter Adjustment Method
An audio parameter setting process and an audio parameter control process using the audio parameter adjustment method according to the present embodiment will be described.
In the audio parameter setting process of
When the collective setting button SB is operated, the reference part determiner 51 determines the part that is being selected at that point in time as the reference part (step S3). Further, the subject part group determiner 52 determines all other parts except for the reference part as the subject part group (step S4). Further, the receiver 54 receives selection of the second audio parameter (step S5).
Next, based on the changeability condition defined by the condition table, the judge 55 carries out the changeability judgement about whether the second audio parameter value received in the step S5 is to be changed in regard to each subject candidate part included in the determined subject part group (step S6). Thus, the change subject part is determined.
Next, the setter 56 judges whether the parameter control information can be added in regard to each determined change subject part (step S7). Specifically, whether a setting storage region in which the parameter control information is not stored is present among the plurality of setting storage regions corresponding to the change subject parts is judged. In a case where the parameter control information is not stored in any of the setting storage regions, the setter 56 judges that the parameter control information can be added. In a case where the parameter control information is stored in all of the setting storage regions, the setter 56 judges that the parameter control information cannot be added.
In a case where the parameter control information cannot be added in regard to any of the change subject parts, the audio parameter setting process ends. In a case where the parameter control information can be added in regard to all of the change subject parts, the setter 56 acquires the set number of the setting storage region in which the parameter control information is to be stored in regard to each change subject part (step S8). For example, in a case where the parameter control information is stored in the setting storage regions of the set numbers “1” and “2” as shown in the example of
Next, the reference part determiner 51 collectively sets the first audio parameters in regard to all of the change subject parts (step S9). Specifically, the first audio parameter is stored as the reference parameter in the setting storage region having the set number acquired in the step S8 in regard to all of the change subject parts.
Next, the subject part group determiner 52 collectively sets the second audio parameters in regard to all of the change subject parts (step S10). Specifically, the second audio parameter received in the step S5 is stored as a control parameter in the setting storage region having the set number acquired in the step S8 in regard to all of the change subject parts.
Next, the setter 56 collectively sets the change coefficient in regard to all of the change subject parts based on the coefficient setting condition defined by the condition table (step S11). Specifically, the change coefficients corresponding to the second audio parameter set in the step S10 are acquired from the condition table in regard to all of the change subject parts. The acquired change coefficients are stored in the setting storage region having the set number acquired in the step S8. Thus, the audio parameter setting process ends.
The reference part may be suitably changeable. When the reference part is changed, the process of the steps S3 to S11 is repeated. Further, the part that is selectable as the reference part may be restricted. For example, only the rhythm part may be selectable as the reference part. Further, the part selected in the collective setting screen SP is not determined as the reference part, but the reference part may be determined based on the determination condition. Further, the second audio parameter may be suitably changeable. When the second audio parameter is changed, the process of the steps S5 to S11 is repeated.
In a case where the parameter control information cannot be added in regard to any of the change subject parts in the step S7, the audio parameter setting process does not end, but the parameter control information (the reference parameter, the control parameter and the change coefficient) may be set for the change subject part to which the parameter control information can be added.
In the audio parameter control process of
The acquirer 53 repeats the step S21 until the start of musical performance is detected. When the start of musical performance is detected, the acquirer 53 acquires the first audio parameter value set for the reference part (step S22). For example, the volume of the reference part is acquired from an audio signal output from the tone generator 16 of
Next, the changer 57 judges whether the stop of musical performance is detected (step S25). For example, the setting operating element 4 of
[7] Effects of Embodiment
In the audio parameter adjustment apparatus 100 according to the present embodiment, in a case where one of a plurality of parts is determined as a reference part, the plurality of other parts except for the reference part are determined as a subject part group. In this case, as for the plurality of other parts except for the reference part, it is not necessary to set the relationship with the reference part for each part, and the plurality of these parts can be collectively set as the subject part group. Further, second audio parameter values of the subject part group can be changed according to the change pattern of the first audio parameter value of the reference part. Thus, the audio parameter values of the plurality of parts can be changed easily and effectively.
Further, in the present embodiment, whether the second audio parameter value is to be changed in regard to each subject candidate part included in the subject part group is judged based on the selected second audio parameter and the changeability condition, and the second audio parameter of the subject part group is controlled based on the result of judgement. Thus, the second audio parameter values of the subject part group can be appropriately controlled according to a type of each subject candidate part, a tone generation format and the like.
Further, in the present embodiment, a change coefficient is set based on the second audio parameter and the coefficient setting condition for the subject candidate part (change subject part) having the second audio parameter value that has been judged to be changed. Thus, the second audio parameter value of each change subject part can be changed more effectively.
In the above-mentioned embodiment, the change subject part is determined from the subject part group based on the changeability condition, and the second audio parameter value of each change subject part is changed according to the change pattern of the first audio parameter value. However, the present subject matter is not limited to this. For example, the second audio parameter values of all of the subject candidate parts included in the subject part group may be changed according to the change pattern of the first audio parameter value. In that case, the judge 55 of
The first audio parameter is not limited to the volume of a reference part. For example, the pitch of the reference part may be used as the first audio parameter. Further, the parameter assigned to the pedal operator, the rotary operator or the slide operator of the performance operating element 2 may be used as the first audio parameter.
While the audio parameter selected by the user is selected as the second audio parameter in the above-mentioned embodiment, a predetermined audio parameter may be determined as the second audio parameter. In that case, the receiver 54 of
While each function element of
The audio parameter adjustment apparatus 100 may be applied to another electronic apparatus such as a personal computer, a smartphone or a tablet terminal.
While preferred embodiments of the present subject matter have been described above, it is to be understood that variations and modifications will be apparent to those skilled in the art without departing the scope and spirit of the present subject matter. The scope of the present subject matter, therefore, is to be determined solely by the following claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7812242 | Yamabata | Oct 2010 | B2 |
| 8110735 | Watanabe | Feb 2012 | B2 |
| 20030167907 | Annen | Sep 2003 | A1 |
| 20040177745 | Kayama | Sep 2004 | A1 |
| 20110196522 | Zakirov | Aug 2011 | A1 |
| 20120243711 | Fujita | Sep 2012 | A1 |
| 20170221464 | Ohta | Aug 2017 | A1 |
| 20190073988 | Ohta | Mar 2019 | A1 |
| 20200243056 | Oba | Jul 2020 | A1 |
| 20200372883 | Sasaki | Nov 2020 | A1 |
| 20210295810 | Sasaki | Sep 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 104583926 | Apr 2015 | CN |
| 2003-195868 | Jul 2003 | JP |
| 2003195868 | Jul 2003 | JP |
| 2004-258564 | Sep 2004 | JP |
| 2004258564 | Sep 2004 | JP |
| 2016-81045 | May 2016 | JP |
| 2016081045 | May 2016 | JP |
| Entry |
|---|
| International Search Report (PCT/ISA/210) issued in PCT Application No. PCT/JP2018/005094 dated May 15, 2018 with English translation (four (4) pages). |
| Japanese-language Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/JP2018/005094 dated May 15, 2018 (four (4) pages). |
| Japanese-language Office Action issued in Japanese Application No. 2019-571861 dated Aug. 31, 2021 with English translation (12 pages). |
| Number | Date | Country | |
|---|---|---|---|
| 20200372883 A1 | Nov 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2018/005094 | Feb 2018 | US |
| Child | 16991135 | US |
