The present disclosure relates to music display, including but not limited to the display of electronic musical scores.
Individual musicians and musical ensembles such as orchestras, symphonies and school productions have traditionally relied on printed sheet music to guide them through their learning, rehearsals or performances. Printed sheet music is easy to play from, whether alone or in conjunction with a conductor. A large repertoire of printed sheet music needs corresponding physical storage space, and can present challenges in portability.
More recent approaches include sheet music displayed on portable electronic devices. Specialized sheet music display software is available for tablets and other devices using common mobile operating systems. Dedicated devices are also available for electronic sheet music display.
Such more recent approaches resolve some drawbacks of paper sheet music by providing the equivalent of an electronic repertoire of sheet music, or a digital songbook, addressing some issues relating to portability. However, these more recent approaches retain some limitations associated with printed sheet music, for example relating to the display or presentation of musical scores.
Improvements in the display of electronic musical scores are desirable.
Embodiments of the present disclosure will now be described, by way of example only, with reference to the attached Figures.
A method of distribution of digital musical scores for performance by a plurality of musicians, for example without a conductor. The method includes: receiving a musical score request from a user device; obtaining, via a musical score source, a set of musical score components of a musical part for a piece of music associated with the musical score request; obtaining a transmission delay value associated with a communication path; providing, from the musical score source and using the processor, at least one of the set of musical score components to the user device using a first distribution timing based on the obtained transmission delay value; and providing a set of corresponding musical score components of a different musical part for the piece of music to a different user device based on a different transmission delay, or delay value, associated with the different user device.
For the purpose of promoting an understanding of the principles of the disclosure, reference will now be made to the features illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the disclosure is thereby intended. Any alterations and further modifications, and any further applications of the principles of the disclosure as described herein are contemplated as would normally occur to one skilled in the art to which the disclosure relates. It will be apparent to those skilled in the relevant art that some features that are not relevant to the present disclosure may not be shown in the drawings for the sake of clarity.
At the outset, for ease of reference, certain terms used in this application and their meaning as used in this context are set forth below. To the extent a term used herein is not defined below, it should be given the broadest definition persons in the pertinent art have given that term as reflected in at least one printed publication or issued patent. Further, the present processes are not limited by the usage of the terms shown below, as all equivalents, synonyms, new developments and terms or processes that serve the same or a similar purpose are considered to be within the scope of the present disclosure.
The term “musical score” represents a visual representation of musical notation, used for performing a piece of music. Sheet music, whether in printed form or electronic form, is an example of a musical score. The musical score may be a scanned version of printed sheet music, or may be a native digital or electronic representation. Since embodiments of the present disclosure are directed to digital or electronic representations of musical scores, the term “musical score” is used interchangeably with electronic musical score, or digital musical score, and is understood to represent any electronic or digital representation of a musical score.
The term “musical score component” represents a digital or electronic component of a musical score. A musical score comprises a set of musical score components. For example, if the term musical score refers to the set of all “pages” of sheet music for a particular piece of music, then a musical score component refers to any subset of all of the pages of sheet music. In an example embodiment, a musical score component can be equivalent to a “page” of sheet music, as formatted for a device on which the musical score is to be displayed. In another embodiment, a musical score component can be a musically defined section of a piece of music, for example ranging anywhere from a note, beat, mark, or bar to a whole movement, or alternatively representing a phrase, verse or chorus.
The term “musical score request” represents a request for a musical score from a musical score source. The request can be by a user, or from a user device, or both. In an implementation, in response to input from a user, the musical score request is generated at a user device, such as a computing device including a processor. For example, a user can enter the name of a piece of music via an interface provided at the computing device, such as a tablet, and the computing device's processor generates and sends a corresponding musical score request. The musical score request can include information relating to a user's desired musical part, a user's skill level, or similar parameters. In one implementation, such parameters are entered by the user. In another implementation, such parameters are obtained based on a stored user profile.
The term “musical score source” represents a source, such as an electronic database, of musical scores. In an example implementation, the database includes a plurality of “musical parts” for each piece of music, with a separate musical part being provided for each of a plurality of instrumental parts and/or vocal parts, for example for the trumpet, bassoon, guitar, and/or for soprano, alto and bass voices. In an example implementation, the musical score source comprises a database storing different musical parts having different skill or difficulty levels; for example, for the same piece of music, the database can include an easy first violin part, a moderate skill first violin part, and a complex first violin part. The different musical parts for different instruments/voices and skill levels for the same piece of music can be stored in the musical score source in a musical score package.
The term “musician” represents any person who participates in the making or producing of music. As used herein, a musician can refer to a person having any degree of experience or skill, or lack thereof, from a child taking her first ever music lesson, to a person using home-made instruments including a wooden spoon and kitchen pans, to a beatboxing street artist, to an aspiring pop vocalist, to a professional orchestra member. A musician can participate in making or producing music by vocal or instrumental means, or both, or any other type of musical contribution to a musical performance or production. A musician can use any type of standard musical notation, such as notes on a staff, or alternate/non-standard musical notation or representation used to facilitate understanding or performance.
A method according to an embodiment of the present disclosure includes, at step 100, receiving, at a musical score source 200, a musical score request 214 from a user device 210 over a communication path 212 between the user device 210 and the musical score source 200. As shown in
At step 102, the method includes obtaining, via the musical score source 200, a set of musical score components of a musical part for a piece of music associated with the musical score request 214. For example, if a first user requested the violin part for the song Amazing Grace, then the musical score request 214 could include “violin” as an identifier of the requested musical part and “Amazing Grace” as the piece of music. In example embodiments, the musical score request includes further detail on the musical part, such as “first violin” or “second violin”, possibly adding skill level, such as “first violin, intermediate level”, or “second violin, advanced level”. In an example implementation, at step 102, a set of musical score components relating to the requested violin part for Amazing Grace would be obtained, where the set of musical score components could be some notes, bars or phrases of the musical score.
At step 104, the method includes obtaining a transmission delay value associated with the communication path 212. In an example embodiment, the obtained transmission delay value is used to inform how content will be provided to the requesting user device; this can be used to help coordinate providing the musical score components to multiple user devices, so that users can play together properly and while keeping proper time, for example even without a conductor. In an example embodiment, the delay compensator 204 obtains, or coordinates obtaining, the transmission delay value associated with the communication path.
In example embodiments, obtaining the first transmission delay value can comprise one or more of: obtaining a stored transmission delay value associated with the first communication path; obtaining a transmission delay value based on a delay measurement associated with the first communication path; obtaining a real-time transmission delay measurement associated with the first communication path; or measuring a transmission delay on the first communication path.
At step 106, the method includes providing, from the musical score source 200 and using a processor 202 associated with the musical score source 200, at least one of the set of musical score components to the user device 210. The step 106 is performed using a first distribution timing based on the obtained transmission delay value associated with the communication path 212. In an example embodiment, the delay compensator 204 applies, or coordinates application of, the first distribution timing to providing the musical score components to the user device.
At step 108, the method includes: providing, from the musical score source 200 and using the processor 202, a set of corresponding musical score components of a different musical part for the piece of music to a different user device. For example, the different musical part could be a saxophone part for the same musical piece Amazing Grace. In an example embodiment, as shown in
In an example embodiment in relation to
For example, the violin part is provided to device 210 based on a first transmission delay associated with communication path 212, and the saxophone part is provided to device 220 based on a second transmission delay associated with communication path 222. In that way, in an implementation of step 108, providing different sets of corresponding musical score components of different musical parts for the piece of music to associated different user devices is based on respective transmission delays associated with the communication path between the different user devices and the musical score source.
In an example embodiment, in step 108, providing the set of corresponding musical score components comprises providing at least one musical score component from the different musical part that corresponds with the at least one of the set of musical score components provided to the requesting user device. For example, if bars 20-34 of the violin part of Amazing Grace are provided to device 210, then bars 20-34 of the saxophone part are provided to device 220.
In an example embodiment, the set of corresponding musical score components are provided to the different user device substantially concurrently with respect to the at least one of the set of musical score components being provided to the requesting user device. For example, bars 20-34 of the saxophone part of Amazing Grace are provided to device 220 substantially concurrently with respect to bars 20-34 of the violin part being provided to device 210.
As shown in
In an example embodiment, at step 308, providing the at least one of a second set of musical score components is performed in response to a second musical score request, based on a second transmission delay associated with a second communication path between the second user device and the musical score source.
As mentioned earlier, the term musical score component represents a digital or electronic component of a musical score, where a musical score comprises a set of musical score components. In an example embodiment, providing at least one of the first set of musical score components to the first user device comprises streaming the at least one of the first set of musical score components to the first user device. Providing at least one of the first set of musical score components by streaming enables the system and method to provide the musical score components as needed, and facilitates coordination of the timing of the performance of the musical score components. Controlling how and when the musical score components are streamed makes it easier for embodiments of the present disclosure to coordinate performance timing for the users.
In an example embodiment, the first set of musical score components comprises a first set of sequential streaming portions. In such an example embodiment, the method further comprises determining a first user current performance position within the first set of sequential streaming portions, for example representing a current performance position within the entire set of musical score components for the musical piece. In such an example embodiment, streaming the at least one of the first set of musical score components to the first user device comprises providing selected streaming portions from among the first set of sequential streaming portions that are subsequent to the determined first user current performance position in the first musical part for the piece of music.
Consider an example embodiment, which occurs upon initialization or upon providing the very first set of musical score components of the piece of music. In such an example embodiment, determining the first user current performance position comprises setting the first user current performance position at the beginning of the first musical part for the piece of music in response to receiving the first musical score request. In another example embodiment, determining the first user current performance position comprises periodically querying the first user device associated with the first user to identify a currently displayed sequential streaming portion, or the sequential streaming portion to be displayed next.
In an embodiment, the first set of sequential streaming portions comprise musically-defined sections of the first musical part for the piece of music associated with the first musical score request. In a first example embodiment, the musically defined sections are selected from the group consisting of: introduction; verse; pre-chorus; chorus; bridge; solo; instrumental; and ending. In a second example embodiment, the musically defined sections are selected from the group consisting of: note; mark; bar; measure; and movement. In a third example embodiment, the musically defined sections are selected from the group consisting of: introduction; exposition; development; recapitulation; verse; chorus; refrain; conclusion, coda; outro; fadeout; bridge; and interlude.
Various other embodiments will be evident to the skilled person in the art, providing the ability to separate the sequential streaming portions into any type or granularity of musically-defined sections, based either on currently accepted or known musical notation conventions, or variations thereof, or on visually-defined sections, or sections defined based on display characteristics. In an embodiment, the first set of sequential streaming portions comprise pages of the first musical part for the piece of music associated with the first musical score request. In a first example embodiment, the pages are defined based on the format of the first musical part for the piece of music as stored in the musical score source. In a second example embodiment, the pages are defined based on the format of the first musical part for the piece of music as displayed at the first device.
While embodiments employing streaming are advantageous, there are instances in which the ability to stream may be unreliable, such as due to communications traffic, limitations of communications infrastructure, or excessive transmission delays associated with one or more communication paths.
Accordingly, in an embodiment, for example when streaming is unreliable, the method can include receiving and/or providing a transmission delay alarm condition. In an implementation, the transmission delay alarm condition is satisfied in advance of the transmission delay having an un-reversible negative effect on the ability to properly stream the set of musical score components. That way, action can be taken before the problem results in a noticeable excessive delay, or lack of coordination between different users performing the same musical piece, after having been provided with musical score components according to an embodiment of the present disclosure.
In an example embodiment, in response to a transmission delay alarm condition, the method concurrently provides the entire first musical part for the piece of music to the first user device in parallel with the streaming. That way, if the transmission delay adversely affects the streaming, the first user device can have downloaded or otherwise been provided with the entire first musical part for the piece of music, and use that offline version of the music until the streaming conditions are more favourable. After streaming conditions are more favourable, the transmission delay alarm condition can be cleared, and the musical score components can continue to be provided using streaming, for example to assist with coordinate performance timing for the users.
In an example embodiment, the transmission delay alarm condition occurs based on the obtained first transmission delay value exceeding an acceptable first transmission delay threshold. In a first example implementation, this occurs when the obtained first transmission delay value exceeds the acceptable first transmission delay threshold by a threshold amount, and can be triggered any time the obtained value exceeds the stored threshold. In a second example implementation, this occurs when the obtained first transmission delay value exceeds the acceptable transmission delay threshold for a threshold period of time. For example, if an acceptable transmission delay threshold is 50 and the obtained value is 45 for more than 5 microseconds, then the transmission delay alarm condition occurs. In another example, if an acceptable transmission delay threshold is 50 and the obtained value is 40 for more than 12 microseconds, then the transmission delay alarm condition occurs. Different variations of the relationship between the amount by which the obtained transmission delay exceeds the threshold, and for what length of time, can be used, either independently, or together in a set of transmission delay alarm conditions.
With respect to communication between the musical score source and the user devices, embodiments of the present disclosure can provide different implementations. In one embodiment, the communication can be performed using a public or private communication network or platform, such as using a cellular data network, or WiFi connectivity over the Internet or an intranet. In some cases, such communication networks introduce uncertainty with respect to transmission delay.
In another embodiment, direct point-to-point communication is used, rather than using a communication network of some kind. For example, in an embodiment, providing the musical score components to the first user device using the first distribution timing comprises transmitting the musical score components using direct point-to-point communication between a first transceiver associated with the musical score source and a second transceiver associated with the first user device. In an example embodiment, the musical score components are transmitted using direct point-to-point communication between the first and second transceivers independent of using a network, or without using a network, for example using direct 5G communication or direct Bluetooth communication.
It can be advantageous for the system and method to provide a central coordination of timing of distribution of the musical score components. For example, in an embodiment, the first musical part for the piece of music is provided to the first user device at substantially the same time as the second musical part for the piece of music is provided to the second user device. In another embodiment, the method includes coordinating timing of display of musical parts such that the first musical part for the piece of music is displayed at the first user device at substantially the same time as the second musical part for the piece of music is displayed at the second user device.
In another embodiment, the method further comprises coordinating timing of display of streaming portions such that the selected streaming portions from among the first set of sequential streaming portions are provided to the first user device based on the first user current performance position. This is performed at substantially the same time as corresponding streaming portions of the second musical part for the piece of music are provided to the second user device based on a second user performance position corresponding to the first user current performance position.
As mentioned earlier, different musical parts for different instruments/voices and skill levels for the same piece of music can be stored in the musical score source in a musical score package. The system and method can, in example embodiments, provide requested versions based on skill level and instrument. In an example embodiment, the method can include identifying a musical score package associated with the first musical score request, where the musical score package comprises a plurality of musical parts for the piece of music; each musical part is created for a particular musical skill level and a particular instrumentation. In such an implementation, obtaining the first set of musical score components of the first musical part for the piece of music is based on the first musical score request and on a user skill level and a user instrument.
In an example embodiment, the user skill level and an identification of the user instrument are determined based on first user profile parameters associated with the first musical score request. In an example embodiment, the first user profile parameters are obtained prior to receiving the first musical score request, such as based on a query from the musical score source to the first user device to obtain the first user profile parameters, such as a query for the instrument and skill level. In another example embodiment, the user skill level and an identification of the user instrument are included in the first musical score request. In a further example embodiment, the user skill level and an identification of the user instrument are obtained based on a user identifier associated with the musical score request, for example based on a username or login credential.
So, for example, if Leila Mann signs in to a first device (tablet) using her username, then when she sends a musical score request from the tablet, the user profile parameters of instrument=violin and skill level=advanced are included as part of that musical score request. If Leila later signs in to a second device (smartphone) using the same username, then even though the request is coming from the second device, the instrument and skill level associated with her username will be included as part of that second musical score request, and not necessarily based on information relating to the device itself.
The expert system 3 in the embodiment of
The compositors file 4 can be stored in a computer-readable memory and contains details of all those who have used the expert system to create new and modified pieces of music for the central database. The compository file 5 contains temporary versions of modified music, which await approval and/or authorisation to be placed in the central database. This temporary stage for modified versions of music, or newly composed pieces of music, allows for an interim audit process to ensure high quality versions of music in the central database. The term “compository” as used herein refers to a “composers' repository”.
The server 6 can be any computer which has been designated as the lead computer for a rehearsal or performance, whether there is only one computer participating, or many. This is the computer that downloads the desired version from the central database and controls the timing and distribution of each part to be played at a locally connected terminal. The terminal(s) 7 are any user devices, such as computers/smartphones; in an example embodiment, the terminal is connected in line of sight to the server 6 and set to operate in slave mode to the server 6 which acts as master or lead computer for the group present.
The application of this hologram technology linked to embodiments of the present disclosure enables living, and perhaps even deceased, conductors of orchestras/bands to be seen to be conducting whilst they are not actually present. This has potential to display the hologram of famous deceased conductors, provided that enough film footage of their past performances is available to convert to holograms. Major orchestras retain sheet music of performances with famous conductors, duly annotated for their specific requirements—these could be included in performances using embodiments of the present disclosure with hologram visualisations of the linked conductor, to reproduce a version of the piece true to the style and wishes of the original deceased conductor.
In a further example implementation, an embodiment of the present disclosure is configured to control lighting in the area of the players/singers. The system of an embodiment of the present disclosure interfaces with the lighting systems available in the music hall, and this enables the systems to direct any light beams onto soloists or sections of the band/orchestra when their part is taking a prominent place in the music. This enables a musical performance which allows the audience to follow those parts highlighted in the music by beams of light/“spots”—and these could be dimmed and brightened according to the volume of the music. Thus the whole experience of those who attend such performances can be improved and informed, according to taste, using embodiments of the present disclosure.
In another example implementation, those parents who have suffered years of their children's violin practice could also bring along their smartphones, and “tune in” to the parts now being exquisitely played by their loved ones, thus converting the first few years of their learning a stringed instrument or an oboe (or even the drums) from an excruciatingly painful experience to a heavenly sigh of relief.
In an example embodiment, the synchronizer 14 uses 5G communication speeds to control and anticipate the timing of master and slave terminals. In an example embodiment, the subsystem also maintains the backup facility needed to present “whole page” static parts at slave terminals in case of system overload or any other emergency which stops note-by-note, or other musical score component, presentation to any terminal(s). This has been described earlier in the description.
Embodiments have been described relating to methods of, and systems for, distribution of digital musical scores for performance by a plurality of musicians. In an example embodiment, the method includes: receiving a musical score request from a user device; obtaining, via a musical score source, a set of musical score components of a musical part for a piece of music associated with the musical score request; obtaining a transmission delay value associated with a communication path; providing, from the musical score source and using the processor, at least one of the set of musical score components to the user device using a first distribution timing based on the obtained transmission delay value; and providing a set of corresponding musical score components of a different musical part for the piece of music to a different user device based on a different transmission delay value associated with the different user device, such as to enable coordinated playback by users without a conductor.
In the preceding description, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the embodiments. However, it will be apparent to one skilled in the art that these specific details are not required. In other instances, well-known electrical structures and circuits are shown in block diagram form in order not to obscure the understanding. For example, specific details are not provided as to whether the embodiments described herein are implemented as a software routine, hardware circuit, firmware, or a combination thereof.
Embodiments of the disclosure can be represented as a computer program product stored in a machine-readable medium (also referred to as a computer-readable medium, a processor-readable medium, or a computer usable medium having a computer-readable program code embodied therein). The machine-readable medium can be any suitable tangible, non-transitory medium, including magnetic, optical, or electrical storage medium including a diskette, compact disk read only memory (CD-ROM), memory device (volatile or non-volatile), or similar storage mechanism. The machine-readable medium can contain various sets of instructions, code sequences, configuration information, or other data, which, when executed, cause a processor to perform steps in a method according to an embodiment of the disclosure. Those of ordinary skill in the art will appreciate that other instructions and operations necessary to implement the described implementations can also be stored on the machine-readable medium. The instructions stored on the machine-readable medium can be executed by a processor or other suitable processing device, and can interface with circuitry to perform the described tasks.
The above-described embodiments are intended to be examples only. Alterations, modifications and variations can be effected to the particular embodiments by those of skill in the art without departing from the scope, which is defined solely by the claims appended hereto.
Embodiments of the disclosure can be described with reference to the following numbered CLAUSES, with specific features laid out in the dependent clauses:
The subject patent application claims priority to and all the benefits of U.S. Provisional Patent Application Ser. No. 62/840,097 which was filed on 29 Apr. 2019, the disclosure of which is hereby incorporated by reference in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/061757 | 4/28/2020 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62840097 | Apr 2019 | US |