Patent Application
20230099808
The present invention is related to musical education, and more particularly is related to the improvement of musical education through simplifying sheet music to accommodate a particular skill level. To that end, this invention also relates to music transcription and more specifically to methods and systems for automatic music transcription with simplification tailored to a user's level.
Learning to play an instrument can be challenging for beginners. Typically, when starting an endeavor such as learning an instrument, it is important to have high motivation, as the learning curve is very steep and it is hard to see results early on. One of the biggest barriers to entry is feeling like one's skills are inadequate to play their desired music. Most learners have an idea of what music they would like to play, but it may be out of technical reach. This can be for many reasons, including but not limited to the original music being too difficult and no versions are available at an easier level. This is a large deterrent to learning most skills and music is no exception.
Prior art sources for music education avoid this problem by requiring learners to play material that is naturally simpler, regardless of whether the learner likes the music or not. However, this can be unrewarding, and, therefore, a common cause that beginners quit playing music is because the simpler music is demotivating.
Ideally, a learner should be able to select any song of their choosing and gain valuable experience and knowledge from it, even if the original skill level required is higher than the learner's. To do this, a method is needed in the art to simplify chosen music into sheet music that is at an attainable level for the learner. It is important for the simplified music resulting from such a method to retain some resemblance to the original. Otherwise, the learner would not feel like they are playing the desired music, and the motivation would be less.
Known in the art are methods and systems, including software, for music transcription. For example, Wu et al. have described Polyphonic Music Transcription with Semantic Segmentation in an article published by the Institute of Electrical and Electronics Engineers (IEEE) in 2019. The authors leverage multi-object semantic segmentation techniques to solve the problem of multi-instrument transcription requiring joint recognition of instrument and pitch of every event in polyphonic music signals generated by one or more classes of music instruments.
Similarly, the Music and Culture Technology Lab provides a music transcription service, Omnizart, that may be used by others, such as educators. However, this program does not provide a transcription that is tailored to the level of the user.
Also known in the art are features in existing software to simplify a digital score. For example, some existing notation software, such as Finale by MakeMusic and Sibelius by Avid, include an option to simplify notation in areas such as tied notes or excessive rests. However, these prior art programs only simplify the aesthetics of sheet music, such as by removing redundancies in the visual product. These methods and programs do not provide simplification for any of the musical elements such as rhythm, score range, etc. Accordingly, needed in the art is a method and program that can automatically simplify music to the ability of the user.
Provided are systems and methods for transforming a digital score file into one or more of a plurality of levels of simplified visualization outputs. In some embodiments, such methods may be computer implemented. In one or more embodiments of a computer implemented method of the present invention, the method may include receiving at least one digital score file, receiving one or more inputs related to the plurality of simplification levels, and executing one or more executable instructions. The executed able instructions are located on at least one non-transitory memory. The executable instructions are configured to cause the processor to transcribe the digital score file into a digital score file transcription, execute one or more simplification instructions on said digital score file transcription, and generate one or more simplified visualization outputs.
In some embodiments, the one more executable instructions further include generating one or more simplified digital score files and then generating said one or more simplified digital score files. The simplification instructions may include at least one of rhythm simplification instructions and harmonic rhythm simplification instructions. They may further include one or more of song length simplification instructions, tempo adjustment simplification instructions, tie simplification instructions, and chord simplification instructions. The visualization may be musical notation related to one or more of melody, chord, lead sheet, or arrangement.
In another embodiment of a computer implemented method of the present invention, the method includes receiving at least one digital score file, one or more inputs related to the plurality of simplification levels, and one or more inputs related to a desired score type of the simplified visualization output. The method may further include execution, by a processor, of one or more song length simplification rules, one or more tempo adjustment rules, one or more tie simplification rules, and at least one of rhythm simplification rules and harmonic rhythm simplification rules. In addition, the method may include generating at least one simplified visualization output.
In some embodiments of such a method, the digital score file may be transcribed prior to executing any of said simplification rules and the simplification rules may be executed on the digital score transcription. The simplification steps may result in generating at least one simplified digital score file, which may then be used to generate the at least one simplified visualization output.
In another embodiment of the invention, a system is provided for transforming a digital score file into one or more of a plurality of levels of simplified visualization outputs. The system includes at least one display device, a non-transitory memory having instructions embedded thereon, and a processor in communication with the non-transitory memory and the at least one display device. The processor is configured to access the instructions to perform or direct steps. The steps performed or directed by the processor may include, but are not limited to, any step described herein. The steps include receiving at least one digital score file, receiving one or more inputs related to the plurality of simplification levels, and executing several rules. The rules include, but are not limited to, song length simplification rules, tempo adjustment simplification rules, tie simplification rules, and rhythm and/or harmonic rhythm simplification rules. The steps further include generating a least one simplified visualization output, which is displayed on the display device.
Embodiments of the present invention provide a system and method for improving musical education. Methods and systems of the invention use inputs and outputs to transform a digital score file into one or more simplified outputs for users of varying skill levels. This detailed description uses traditional Western music in the preferred and illustrated embodiments; however, the method and system of the present invention is applicable to all types of music. Other types of music to which this invention applies include, but are not limited to, the Carnatic music system, African music systems, and the Arab tone system.
Throughout the detailed description, several figures are referenced that are in chart format with rules inserted therein or with reference numerals inserted therein which are discussed in this detailed description, with the rules based on the level of simplification. In the charts, if a box is left blank, its rule is the rule for the level or level(s) below it for which a rule is presented (either in the chart or via reference numeral).
Certain aspects of Western music will be discussed herein to aid the reader in understanding the invention. As noted above, these aspects of Western music are provided as an example only. Music notation is the combination of musical instructions provided in a visual format to a user. Music notation includes several elements: Notes, which are also called musical notes or pitch, refer to the name assigned to specific musical pitches. For example, in Western music, specific frequencies are equated to letters within the musical alphabet: A, B, C, D, E, F, and G. In addition, in between some of these letters are additional notes notated by a sharp (#) or flat (b) symbol. There are seven letters used in Western music, but 12 notes total. As this invention is applicable to all types of music, including but not limited to Western music, the specific notes provided herein are exemplary only. An octave is a variation of a pitch class. One octave is a multiple of two of a specific frequency. For example, A4=440 Hz, which means that A5=880 Hz and A3=220 Hz.
Pulse refers to a steady, underlying beat that can be played with or against. The rate of a pulse is typically measured by beats per minute (bpm), although the invention is not limited to same. Meter is the measurement of the number of pulses between more or less regularly recurring accents. Tempo is the speed of a song. Tempo may be measured or notated by beats per minute (bpm).
A staff is a set of five lines that act as a matrix for pitch and rhythmic elements. This matrix provides the foundation for visualization of music. Specific notes are assigned to particular places on the staff. Ledger lines are single use lines that allow for differentiation of notes once they are outside of the staff. Also notated on the staff may be one or more rests. A rest is a space or silence in music. In Western music, typically rests have the same structure as a note and can be broken down such as a whole rest, half rest, quarter rest, eighth rest, sixteenth rest, and so on.
The above elements lead to rhythm, which is the systematic arrangement of sounds over time. A sound may include, but is not limited to, a note. With respect to musical rhythm, a hierarchal note system is used, which is subdivided into divisions of two. The largest note is a whole note, which is subdivided into two half notes, which can then be subdivided into four quarter notes, which can then be subdivided into eight eighth notes, which can be subdivided in sixteen sixteenth notes. Further subdivisions occur, but whole, half, quarter, eighth, and sixteenth notes are the most common.
As is known in the art, there are many instruments that exist today, and they all have specific pitch ranges. Because of this, different clefs are used to indicate which notes are represented by the lines and spaces on a musical staff. Placing a clef on a staff assigns a particular pitch to one of the five lines, which defines the pitches on the remaining lines and spaces. Common clefs include, but are not limited to, the treble clef, the bass clef, the alto clef, and the tenor clef. A percussion clef is also used, but it does not set pitches; rather it allows for different drum and percussion instruments to be assigned to each line or space. Sharps and flats may be indicated next to each note, or a particular key may be used to indicate that certain notes are sharp and/or flat throughout an entire piece.
A time signature may be used to specify how many beats are contained in each measure of a piece and which note value is equivalent to a beat. A time signature can be broken down into two components: the top number being how many beats per measure, and the bottom number being what type of note is the pulse or beat. An example may be three over four, wherein there are three (3) quarter notes (4) per measure. While the numerator of a time signature has no real limitations, the denominator is typically a note value, for example, a half note, a quarter note, an eighth note, etc. Time signatures allow for the organization of music into individual measures where one can see starts and ends of phrases, number measures for practice or reference, contextualize rhythms, and interpret how music should be felt.
One of these note values is assigned to the pulse to derive note length. Most commonly the quarter note is assigned to the pulse, meaning that each beat of the pulse is one quarter note. In that case, a quarter note is equal to one beat; a half note is two beats; a whole note is four beats; and an eighth note is one half of a beat; etc. The tempo dictates the speed of the song. In the most common example where quarter notes are assigned to the pulse, the number of beats per minute indicates how many quarter notes occur each minute.
Meter is the measurement of the number of pulses between more or less regularly recurring accents. There are two main types of meter: simple and compound. Simple meter, also called, duple meter, is when each beat is subdivided into two notes. A compound meter, or triple meter, is when each beat is subdivided into three notes.
Notes may be further modified by articulation. As is known in the art, common types of articulation include, but are not limited to: accent, femata, forza, glissando, legato, marcato, porato/mezzo-staccato, rinforzando, sforzando, staccatissimo, staccato, and tenuto.
The dynamics of a piece is the indication or variation in loudness between notes or phrases. Common forms of dynamics include, but are not limited to, crescendo, decrescendo, diminuendo, forte, fortepiano, fortissimo, mezzo forte, mezzo piano, piano, pianissimo. Moreover, music may include expression markings, which indicate how particular music should be played. Expression markings may be directed to a particular section, phrase, or even a single note.
Moving now to the present invention, provided are methods and systems of music simplification. In a first embodiment of a method and system 100 of the invention, steps are provided to transform a digital score file into a simplified visualization for a plurality of skill levels. Referring to
Referring now to
In the preferred embodiment of
Referring to
Accordingly, before executing the simplification rules, in preferred embodiments, the system checks the user instrument 112, the user level 114, and the score type 116 desired. As noted above, these inputs may be from a user or any other means. Depending on the score type 116, the system may execute one or more of four series of simplification rules. First, the melody 118 simplification rules may be executed to generate a simplified melody visualization. Next, the chord 120 simplification rules may be executed to generate a simplified chord visualization. Third, the lead sheet 122 rules may be executed to generate a simplified lead sheet visualization. Because the lead sheet 112 includes both melody and chord elements, one or more portions of the lead sheet 122 simplification rules may include the melody and/or chord simplification rules. In the preferred embodiment, the fourth option is arrangement 124 simplification rules which may be executed to provide arrangement sheet music.
After the system has received inputs related to simplification level 104, the system is ready to execute one or more simplification rules 106. If the score type is melody, in preferred embodiments, only the melody simplification rules will be executed. The execution of the melody simplification rules 118 may include one or more series of rules, including but not limited to song length simplification 126, tempo adjustment(s) 128, rhythm simplification 130 (preferably with ties first), range simplification 132, and/or fingerings and positions 134. All of these series of rules will be discussed in further detail below. After all melody 118 simplification rules 126, 128, 130, 132, 134 are executed, the system will generate a simplified MIDI file 176.
Alternatively, the score type may be chord 120, in which case a series of chord simplification rules are executed. Execution of the chord simplification rules 120 may include one or more series of rules, including but not limited to, song length simplification 136, tempo adjustments(s) 138, harmonic rhythm simplification (preferably with ties first) 140, chord simplification 142, and/or fingerings and positions 144. All of these series of rules will be discussed in further detail below. After all chord 120 simplification rules 136, 138, 140, 142, 144 are executed, the system will generate a simplified MIDI file 176.
Still referring to
Execution of the arrangement simplification 124 may include, but is not limited to song length simplification 160, tempo adjustment(s) 162, rhythm simplification (preferably with ties first) 164, range simplification 166, harmonic rhythm simplification 168, chord simplification 170, music generation 172, and/or fingers & positions 174. Because an arrangement generally includes all musical notation, elements of melody and chords are typically present. As such, the arrangement 124 simplification rules may include elements of the melody 118 and chord 120 simplification rules. In addition, the arrangement 124 simplification rules may include elements of the lead sheet 122 simplification rules, as the elements of a lead sheet are typically found on an arrangement. After all arrangement 124 simplification rules 160, 162, 164, 166, 168, 170, 172, 174 are executed, the system will generate a simplified MIDI file 176.
In preferred embodiments, the simplification rules generate a simplified digital score, which in the illustrated preferred embodiment is a simplified MIDI file 176. The system then generates notation simplification 178, which may be XML formatting in the preferred embodiment. The method and system then provide a visualization 180 of the simplified digital score to the user. The visualization 180 may be a transcription of the simplified digital score file. Accordingly, the result of the process is to transform the original digital score 102 file into a simplified visualization 108 for the user. The simplified visualization 108 is tailored to the skill level of the user.
In preferred embodiments, the simplification results in four primary levels of simplification, although some levels may be further subdivided. The four primary levels result from the length of the simplification, which will be discussed below. However, one of skill in the art will recognize that any number of simplification levels and sublevels may be employed.
Referring to
Referring to
As noted above, the system and method may include rules related to tied notes, such as in the rhythm and harmonic rhythm simplification series of simplification rules. See for example
Referring again to
The harmonic rhythm simplification rules of the preferred embodiment depend on the grouping length, such as a whole note, dotted half note, half note, dotted quarter note, quarter note, dotted eighth note eighth note, sixteenth note, and tuplets.
The simplification rules executed by the system may also include range simplification rules, 132, 152, 164. The range simplification rules of the preferred embodiment are shown in
Further, the simplification rules of the preferred embodiment include chord simplification rules 142, 156, 170. The chord simplification rules of the preferred embodiment are shown in
The arrangement simplification rules 124 may include a music generation step 172. The music generation step may generate music for instruments or parts that were not originally in the digital score file 110. Accordingly, it may provide a composition step. All categories of simplification rules — melody 118, chord 120, lead sheet 122, and arrangement 124 may include a fingerings and positions simplification step 134, 144, 158, 174. The fingerings and positions simplification step 134, 144, 158, 174 may provide guidance to the user with respect to suggested and/or necessary positions and/or fingers. For example, for fretted instruments, like guitar, it is likely that one can play the same note/pitch class on more than one position and/or string. For that reason, it is helpful to notate which position/string to play for the notes in the sheet music. Playing in a higher position (e.g. 7th fret) is typical as it allows the player the largest range for the most common notes. This requires more experience and more counting with the instrument, which can be difficult for beginners. On the other hand, playing in a lower position (e.g. 2nd fret) limits the range for the most common notes but is much easier to count. In some embodiments, such as the illustrated preferred embodiment, it is desirable to recommend the position best suited for the learner's skill level. When combined with range simplification, sheet music can become very achievable not just to read, but to play. Moreover, for most instruments, there is often more than one way to orient one's hands and fingers to play a particular musical passage. Providing fingerings for notes can help a learner play a passage not only easier, but healthier as well. Displaying fingerings frequently can be helpful to a beginner, and as they progress, can be displayed less frequently as to not obstruct the music. In preferred embodiments of the invention the digital score file 102 is a MIDI file 110. MIDI files allow the attachment of several types of information that can then be visualized as will be described later. In non-limiting examples, MIDI files can include information such as pitch, length, volume, etc. Fingering and/or position information, including but not limited to the examples discussed above, can be added to the MIDI file channels and then displayed when a visualization is generated.
As provided in
The generated visualization 180 will vary based on the instrument, which is preferably inputted 112 at the beginning of the method for processing by the system. Depending on the level of the user and the instrument, certain aspects of musical notation will be displayed or not displayed. Tables 5-8 show which elements are displayed in the visualization for each level in preferred embodiments.
Moreover,
An example of the output of the present invention will now be provided across several skill levels.
Lastly,
Although various representative embodiments of this invention have been described above with a certain degree of particularity, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from the spirit or scope of the inventive subject matter set forth in the specification and claims. Joinder references (e.g. attached, adhered, joined) are to be construed broadly and may include intermediate members between a connection of elements and relative movement between elements. As such, joinder references do not necessarily infer that two elements are directly connected and in fixed relation to each other. In some instances, in methodologies directly or indirectly set forth herein, various steps and operations are described in one possible order of operation, but those skilled in the art will recognize that steps and operations may be rearranged, replaced, or eliminated without necessarily departing from the spirit and scope of the present invention. It is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative only and not limiting. Changes in detail or structure may be made without departing from the spirit of the invention as defined in the appended claims.
Although the present invention has been described with reference to the embodiments outlined above, various alternatives, modifications, variations, improvements and/or substantial equivalents, whether known or that are or may be presently foreseen, may become apparent to those having at least ordinary skill in the art. Listing the steps of a method in a certain order does not constitute any limitation on the order of the steps of the method. Accordingly, the embodiments of the invention set forth above are intended to be illustrative, not limiting. Persons skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention. Therefore, the invention is intended to embrace all known or earlier developed alternatives, modifications, variations, improvements, and/or substantial equivalents.
| Number | Date | Country | |
|---|---|---|---|
| 63250321 | Sep 2021 | US |
