Patent Application
20160163297
The present invention relates to technology for computer-based composing.
Any creative process may be described as alternating a mutation process and a selection process to continuously produce improved versions.
The selection process determines if a new version is an improvement compared to the current version. An operator generally takes part in the selection process, and makes selections based on good taste. Good taste is generally not possible to automate. The mutation process may be divided into a modification process and a presentation process. In some creative fields, e.g. painting, the modification and presentation processes are united. In other fields, e.g. computer-based music, they may be separate.
An operator generally takes part in the modification process, by manually creating new, improved versions. The modification process may benefit from automation, e.g. by automatically and randomly mixing composition patterns.
The presentation process may be automated. During the modification process, the operator may define a set of abstract expansion directives, making it possible to make large presentation changes based on small modifications of expansion directives. The presentation of an interpretation of said directives may be automated, and presented to the selection process, e.g. the good taste of the operator.
The selection process, e.g. the operator, evaluates the presentation, accepts or rejects the new version, and encodes new modifications. A new presentation is produced and evaluated. This cycle continues until the operator is satisfied.
In manually created music, chord progressions, which is a known concept in the art, may be used as expansion directives. A presentation process, e.g. an instrumentalist, expands the chord progression into an improvised set of notes. Computer-based composing may provide more powerful directives than chord progressions.
Technology to assist musical composing has been developed that provides tools for creation and editing of songs. There are tools that provides automatic mutation, but the editing and selection of the expansion directives are generally limited to determining which set of patterns to use at different temporal locations.
U.S. Pat. No. 7,858,867, entitled Metadata-based song creation and editing, by Sherwani et al, uses a database to associate metadata with musical elements and receives a selection of metadata to produce lists of matching musical elements, from which a subset of musical elements is selected and presented.
U.S. Pat. No. 8,680,387, entitled Systems and method for composing music, by Gannon, uses a database of pre-recorded musical sequences to generate music.
U.S. Pat. No. 8,487,176, entitled Music and sound that varies from one playback to another, by Wieder, uses spawn events to indicate that alternative sequences of music at specific temporal intervals may be used for a variable performance. The alternative sequences are part of the final composition.
The present invention integrates patterns and pattern usage directives into a composition model, with no dependency on data outside the composition model. The present invention does not rely on weights based on the tags and opinions of a community of users. The patterns of the present invention are not associated with specific temporal locations. Thus they cannot be viewed as alternatives to foundation sound sequences, and they cannot overlay foundation sound sequences. The patterns of the present invention are created, edited and generally made redundant as a part of a composing process.
The preferred embodiment of the invention provides a method for composing or performing music. An operator defines a composition structure and encodes intent as events in a composition model. Some events encodes performance elements, e.g. notes and lyrics. Other events encode notational elements, e.g. chords, key and time signature. Yet other events encode abstract intent, e.g. genre, intensity and complexity. The operator encodes musical patterns in the composition model, using similar structures and events. The patterns may be used for generating temporary events. The generation of temporary events can be identified as an automated mutation process.
Embodiments of the invention produces a presentation based on the structure and the events of the composition model, and presents this presentation to an operator. Events encoding abstract intent may result in a random outcome, which may vary with each new produced presentation.
In one embodiment of the invention, an operator evaluates the produced presentation. This evaluation can be identified as a selection process. The operator modifies the structure and events of the composition model. The invention produces a new presentation, based on the modified composition model, and presents it to the operator. This cycle continues until the operator is satisfied with the end result.
In one embodiment, the produced presentation may be used for real-time performances, where the operator adjusts intent while the composition is generated and presented.
Embodiments of the invention may be used for arts other than music composing.
Embodiments of the invention also provides a method for organizing data.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The following description of various embodiments is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
An operator is an entity that issues instructions, using an interface module. In one embodiment, the operator is a user. In one embodiment, the operator is a computer executing computer-executable instructions.
The term ‘associated’ is used for direct or indirect relationships between components. In all figures, a stack of blocks, i.e. a block with another block partially hidden behind, represents one or more instances of the component indicated by the block.
An identifier is used for uniquely identifying a component among other components in the same category. In the preferred embodiment, an identifier consists of a sequence of Unicode characters, which is a known concept in the art.
A UUID is a unique sequence of hexadecimal digits. It may also contain inserted hyphen characters. A UUID is a known concept in the art.
In the preferred embodiment, the invention is used by an operator for creating a composition model, such as illustrated in
Intentions are used for describing categories of change. An operator may create custom intentions.
Exemplary intentions for the preferred embodiment are shown in Table 1.
There are sets of intentions not listed in Table 1 that represent similar but different categories of change. For instance, genre intentions include funk and blues. Function intentions include theme, solo and bridge. Phoneme intentions include various phonemes. Pattern intentions are used for describing the relative weights of individual patterns.
Referring to
In the preferred embodiment, each part 105 has a list of intentions 109 that are relevant to said part, e.g. note and lyrics. Some intentions that are relevant for one part may not be relevant for all parts. For instance, lyrics may be relevant for a ‘Vocal’ part, but not for a ‘Saxophone’ part.
In the preferred embodiment, each piece of equipment 106, 110 has a list of intentions 111, 112 that are relevant to that piece of equipment, e.g. wetness and duration.
An intention value is a value associated with an intention. The intention value may be associated with a specific beat. The intention value may be associated with a section or a pattern. The intention value may be associated with a part and/or a piece of equipment. For instance, a bpm value, which is an intention value associated with the bpm intention, at beat 10 of the third section may be 92. Intention values may be numerical, or they may use another representation of a more complex value.
The terms ‘composition’, ‘section’, ‘pattern’, ‘part’ and ‘equipment’ are described below.
In the preferred embodiment, a beat represents a temporal location in a composition, section, pattern or performance. In other embodiments, a beat may represent the index of a task in a sequence of tasks.
A beat may be encoded as a fraction.
A beat may be encoded as a numerical value.
In the preferred embodiment, a beat duration represents the size of a temporal interval. For instance, the beat duration between beats one and five is four. In other embodiments, a beat duration may represent the size of an interval of adjacent tasks.
A beat duration may be encoded as a fraction.
A beat duration may be encoded as a numerical value.
A measure has a start beat and a beat duration.
A time signature intention value is used for determining the beat duration of a measure at a provided beat. It is also used for determining the note value duration at said beat. For instance, if the time signature value at a provided beat is ‘3/4’, the beat duration of the measure at this beat is 3, and the note duration of each beat is one quarter note. The first measure may start at beat 1. The second measure may start at beat 4 and so on.
Some time signature values may correspond to special methods for calculating beats per measure. For instance, ‘12/8’ may use a measure duration of four beats, with three eighths notes per beat.
A tempo is a measurement of performance speed.
A tempo may be measured as beats per minute (bpm). This measures the number of beats that have passed per minute during a performance.
A tempo may change during the duration of the composition.
The tempo may be used for calculating the number of seconds since the performance start.
A pitch represents the base frequency of a sound. In the preferred embodiment, the pitch represents the number of semitones higher than the pitch CO, which is a known concept in the art.
A pitch may be encoded as a numerical value.
In
An event is associated with an intention. For instance, a chord event is associated with the chord intention. The intention associated with the event determines the type of values the event may contain. For instance, a chord event may not contain information about lyrics or notes.
In the preferred embodiment, an event may or may not have a beat duration. If the event has no beat duration, it is valid until a new event becomes active. For instance, a note event has a beat duration but a chord event is valid until the next chord event.
An event may contain a numerical value, like output audio volume or bpm. If the event contains a numerical value, the value may be stationary until next event, or change in some way until the next event, e.g. a linear or quadratic change.
An event may contain a text value, e.g. lyrics, an identifier or a file path.
An event may contain a text value that encodes a complex value, like an encoded guitar chord chart.
An event may contain combinations of intention values. In the preferred embodiment, note events may contain pitch, volume, pan and sustain. Chord events may contain pitch and chord color.
An event point 206 represents the occurrence of one or more events. Each of the said events are associated with the event point.
In the preferred embodiment, the event point is associated with a beat. The beat may be the beat duration since the beginning of a section, pattern or performance. An event point may contain a single event, e.g. a chord or key event, or multiple events, e.g. multiple note events at the same beat, in which case each note event may have a beat duration that differs from other note events of the event point.
All events of an event point have the same intention, which is called the intention of the event point.
An event list 205 is a list of event points. In the preferred embodiment, all event points in the list must be associated with different beats. In the preferred embodiment, the list is ordered. The order is based on the beats associated with the event points. All event points of an event list have the same intention. This intention is called the intention of the event list.
Events with a beat duration are associated with the beat of the associated beat point. Events without a beat duration are associated with each beat in a beat interval. Said beat interval starts with the beat associated with the event point associated with said event, and ends at the beat associated with the next event point, i.e. the event point in the event list associated with the least beat that is greater than the beat associated with the event point associated with said event. If there is no next event point, said beat interval ends at the end of the section or the pattern.
In the preferred embodiment, an event channel 201 is used for associating events 207 with combinations of an intention 202, a part 203 and a piece of equipment 204. The references to part and piece of equipment are not required for an event channel. An event channel contains an event list 205 with the associated events 207. The intention 202 of the event channel must be equal to the intention of the event list 205.
Referring to
Some or all of the combined intention values of a section may be called the behavior of the section.
A section may have a name, e.g. ‘Refrain’ or ‘Chorus’.
A section has a beat duration. A section may also have a number of precount (anacrusis) and postcount beats.
A section has a list of event channels 107.
Each combination of intention, part and equipment is unique for an event channel among event channel elements of an event channel list 107 of a section 102.
A pattern 103 may be used by an arranger to create temporary events. In the preferred embodiment, a pattern is normally associated with events for notes, time signatures, keys and/or chords, but a pattern may be associated with events which are associated with any intention, e.g. audio file events for recorded guitar riffs.
Like sections, patterns have a list of event channels 108. The events associated with these event channels represent the changes associated with the pattern. Each combination of intention, part and equipment is unique for an event channel among event channel elements of an event channel list 108 of a pattern 103.
A part is an actor in the composition, i.e. a component that contributes to the presentation of the composition. In the preferred embodiment, a part 105 is a separate voice or sound of a composition. In other embodiments, a part may be a performance effect, a motorized machine, a spotlight, a video source, or any other component contributing to the presentation.
In the preferred embodiment, a part generally has the name of its sound, like ‘Piano’ or ‘Acoustic Drums’, although it may have another name, like ‘Soprano’, ‘Tenor’ or ‘Bob’. In the preferred embodiment, a part has a list of intentions 109 which may be used for the part, e.g. ‘note’ and ‘lyrics’. Other parts of the same composition may not have the same set of intentions. For instance, ‘lyrics’ may be missing from a ‘Saxophone’ part.
In the preferred embodiment, a piece of equipment represents a performance effect, e.g. Reverb' or ‘Compressor’. In other embodiments, a piece of equipment may represent any actor in the composition which is not defined as a part. Normally, a piece of equipment modifies a signal which is produced by a part or another piece of equipment. In the preferred embodiment, a part has a list of its pieces of equipment 110.
If an event channel has no reference to a part and no reference to a piece of equipment, the event channel events applies to all parts and equipment during the duration of the section or pattern. These events may be called section events. Examples of section events include chord, key, bpm and time signature events.
If the event channel has a reference to a part but no reference to a piece of equipment, the event channel events applies to said part during the duration of the section or pattern. These events may be called part events. Examples of part events include lyrics and note events.
If the event channel has a reference to a piece of equipment but no reference to a part, the event channel events applies to said piece of equipment during the duration of the section or pattern. These events may be called master events. Examples of master events include master reverb wetness events.
If the event channel has both a reference to a part and a reference to a piece of equipment, the channel events applies to said piece of equipment during the duration of the section or pattern. In the preferred embodiment, said piece of equipment modifies a signal for said part. These events may be called equipment events. Examples of equipment events include guitar echo delay events.
A section may contain a list of sections that it depends on. The sections in the list are called subsections of the section that contains the list. The section that contains the list is called a supersection of the sections in the list. In the preferred embodiment, a section with subsections has a behavior which is completely defined in the subsections.
In the preferred embodiment, a composition represents a musical composition or a song. In other embodiments, a composition may represent any collection of ordered changes, e.g. a sequence of tasks or steps.
In the preferred embodiment, a composition 101 is a supersection, and it has a number of subsections, corresponding to the sections 102 of the composition model.
A composition may also have a list of patterns 103.
A composition may also have a list of intentions 104.
A composition also has a list of parts 105.
A composition may also have a list of pieces of equipment 106.
All section events are contained in the event channels 107 of the sections.
All pattern events are contained in the event channels 108 of the patterns.
For instance, to find the chord events of a section without subsections, you retrieve from the event channel list of said section an event channel associated with the chord intention. The chord events apply to all parts and pieces of equipment, so said event channel will not be associated with any part or any equipment. Said event channel 201 has an event list 205, which contains the chord events 207.
To find the note events of a specific part for a supersection, e.g. a composition, you collect from the event channel list of each subsection of the supersection the event channels with an association with the note intention, an association with the specific part and no association with any equipment. This will result in a collection of at most one event channel per subsection. Collect the events of the event list of each collected event channel.
In the preferred embodiment, each section begins where the previous section ends. Thus, the beats associated with the events must be adjusted for preceding sections. For each subsection, calculate the sum of the beat durations of all subsections preceding said subsection, and associate each of the collected events associated with said subsection with a beat which equals the beat associated with said event increased by the calculated sum of preceding subsection beat durations.
In other embodiments, sections may encode different behavior during the same sequence, with intention values, e.g. an opacity value, directing how much each section influences a presentation.
An event channel 107, 108 may be part of the event channel lists of multiple sections and/or patterns, if the events of the event channel should be duplicated.
In the preferred embodiment, the list of intentions 104 of the composition 101 determines which intentions are allowed for an event channel which has no part or equipment, e.g. chord, key and time signature.
In the preferred embodiment, the list of intentions 109 of a part 105 determines which intentions are allowed for an event channel which is associated with said part but no equipment, e.g. note and lyrics.
In the preferred embodiment, the list of intentions 112 of a piece of equipment in the list of equipment 106 of a composition 101 determines which intentions are allowed for an event channel which is associated with said equipment but no part, e.g. master reverb wetness of a master reverb effect.
In the preferred embodiment, the list of intentions 111 of a piece of equipment in the list of equipment 110 of a part 105 determines which intentions are allowed for an event channel which is associated with said equipment and said part, e.g. echo delay of a delay effect that is used only for this part.
An operator uses said embodiment to define parts, equipment, sections, patterns and intentions 301. The operator defines event channels 302 and associates each event channel with a section or a pattern 303. The operator associates each event channel with an intention 304. The operator associates some event channels with parts and/or pieces of equipment 305. The operator defines the events 306, and associate each event with an event channel 307, e.g. by using event points and event lists. Each of said defined events contains its value. The order of said definitions and associations is not important. Some steps may be performed multiple times. The composition model now has an initial content, which is stored on a computer-readable media 308.
The invention may be used for generating a presentation, e.g. audio or images, based on the content of the composition model 309.
If the operator is satisfied with the presentation 310, the composition model is complete, and the presentation may be exported, e.g. as audio or as images, using musical notation known in the art.
If the operator is not satisfied 310, the operator modifies the composition model 311, and continues this cycle of modification 308-311 until the operator is satisfied 310.
Events that are associated with a section may be called section events. They will make the same contributions to a presentation every time.
Patterns are used for temporarily adding events to a section. These events may be called temporary events.
In the preferred embodiment, an event environment may be used for accessing events associated with a provided intention, a provided part, a provided piece of equipment and a provided beat.
In embodiments without an explicit event environment, any direct access to section events have the same effect, and should be considered identical to the use of an event environment.
In one embodiment, an event environment returns section events of a provided section, wherein the event channels associated with the events are associated with the provided intention, the provided part and the provided equipment.
In other embodiments, an event environment may return events determined by an operator during a performance.
In yet other embodiments, an event environment may return a combination of the previously described methods.
An arranger is a module which is used for adding temporary note events to a section. In one embodiment, the events may be stored in a composition model. In one embodiment, the events exist only during the generation of a presentation.
In one embodiment, each part is associated with a unique arranger. In other embodiments, several parts may share arrangers. This makes it possible for the arranger to enforce or prevent some behavior, e.g. parallel movements of notes for different parts.
In the preferred embodiment, section events will disable the creation of temporary events closer to itself than a minimum beat distance. In the preferred embodiment, the minimum beat distance is defined in the arranger module. In other embodiments, the minimum beat distance may be defined by the operator. As the operator creates more section events, the intervals available for temporary events become smaller. This implies that the use of patterns are increasingly limited. The patterns become obsolete if the whole duration of the composition is fully covered by section events.
In the preferred embodiment, the arranger uses the event environment to retrieve the environment note events, associated with the provided part, which are closest to the provided beat 402. If there are environment part note events closer to the provided beat than a minimum distance 403, the arranger finds the environment note events associated with the provided beat and part 409 and presents those note events 410.
Otherwise, the arranger creates temporary note events.
First, the arranger calculates the total pattern weights (TPW) 404. A method for calculating TPW is described below.
When the arranger has calculated the TPWs for each pattern at the provided beat, it must determine which pattern to use 405. In the preferred embodiments, patterns with no note events associated with the provided part cannot be selected.
The arranger may increase the TPW of the last pattern used, to create notes sequences with more consistency, or to use a musical theme.
The arranger may increase the TPW of a pattern with a specific chord, pitch, scale or rhythm may be preferred, e.g. if it matches environment values.
The arranger calculates the sum of all TPWs of all patterns and selects a pattern based on its TPW share.
When a pattern has been selected, its note events associated with the provided part and its pattern beat are selected 406. The pattern beat of a pattern is described below. The events may have to be adjusted. For instance, if both the pattern and the environment have chord events 407, the pattern notes may be transposed by the difference between the environment chord pitch and the pattern chord pitch 408. In addition to changing the pitch based on the chord pitches of the environment chord and the pattern chord, individual note events may be altered, based on the chord color differences. For instance, if the pattern chord color is minor and the environment chord color is major, any minor third note event of the pattern, compared to the chord pitch of the pattern chord, may be transposed to a major third, compared to the chord pitch of the environment chord. This method of transposition is known in the art.
The events are then presented 410. The pattern may have no events at the specific beat, in which case no events are presented.
First, the arranger calculates the pattern beat corresponding to the provided beat for the provided pattern 501. The pattern beat is restricted to the beat duration of said pattern. In the preferred embodiment, the first beat of a section corresponds to the first beat of all patterns. Increasing the section beat correspond to increasing the pattern beat of each pattern by the same amount. Each time the pattern beat reaches the beat duration of its pattern, which normally is less that the beat duration of the section, the pattern beat is reset to the first beat. If the time signature value of the event environment is different than the time signature value of the pattern, beats of the pattern may be repeated or removed. The arranger collects all pattern event channels of the event channel list 108 of the provided pattern, which have no part or a part that equals the provided part 502.
For each event channel in the collection, the arranger calculates a pattern event channel weight (PECW). To calculate PECW of a pattern event channel, the arranger retrieves environment events 503 associated with the provided beat, the part of the pattern event channel 203, and the intention of the pattern event channel 202. If no environment events are found, the arranger retrieves environment events associated with the provided beat and the intention of the pattern event channel, thus retrieving section events instead of part events. This makes it possible to control multiple parts with single events, while enabling individual parts overriding the event. The retrieved environment events, normally converted to a numerical value, may be called the environment intention value.
The arranger retrieves events from the pattern event channel that are associated with the pattern beat of the pattern 504. The pattern events, normally converted to a numerical value, may be called the pattern intention value.
The arranger calculates the PECW of the pattern event channel 505. The PECW may reflect how well the pattern intention value matches the environment intention value. For instance, if the pattern intention value for the intensity intention at the pattern beat is 1.0, an environment intensity value of 1.0 at the defined beat would result in a high PECW for the pattern event channel associated with the intensity intention, since the intensities of the pattern and the environment match each other. An environment intensity value of 0.0 would result in a low PECW for the event channel associated with the intensity intention. A total pattern weight (TPW) is calculated for each pattern, based on the PECW of each collected pattern channel 506.
In the preferred embodiment, each pattern has its own, special intention, called the pattern weight. It represents the relative weight of said pattern. This intention value may be used to alter the TPW of a pattern. A pattern weight of zero may be used for silencing a pattern completely. Exemplary user interfaces for viewing and modifying pattern weights are illustrated in
One obstacle for composing in general is that emotional attachment of an operator to a produced version of a composition often correlates with the time it has taken to produce the version. This attachment often blocks decisions to make major changes. An arranger enables an operator to make major changes in the presentation, using minor modifications of structures and events. This reduces attachment during the initial composing, when experimenting is most important.
In the preferred embodiment, the events created by an arranger are streaming, i.e. they are calculated only when they should be used. This means that environment events may be adjusted manually in real time, which is practical during a performance.
In other embodiments, the events of an arranger may be calculated for the whole composition at one time, which would make it easier to coordinate notes and themes for various parts and sections.
The events of an arranger may be a combination of streaming and full calculation, in which case long intervals are calculated when needed, and possibly recalculated when intention values change.
In one embodiment, arrangers may adjust the creation of temporary events based on special principles, e.g. by inserting or removing events so the result sounds like an arrangement by Mozart.
In one embodiment, components called musicians may be used for converting note events to audio data, e.g. by using sampled or synthesized sound.
In one embodiment, musicians may adjust the events based on special principles, e.g. by inserting, removing or modifying events so the result sounds like a performance by Jimi Hendrix.
In one embodiment, components called composers may be used for modifying or creating environment events.
In one embodiment, composers may adjust the events of the section event channels based on special principles, e.g. by inserting, removing or modifying events so the result sounds like a composition by Brahms.
In one embodiment, composers may be used for randomly creating structure and events of the composition model.
This detailed description describes the creation of note events. In some embodiments, arrangers, musicians and composers may be used for creating other types of events, e.g. for controlling electrical equipment or video streams.
Embodiments of the invention may be implemented with computer-executable instructions. The computer-executable instructions may be organized into one or more computer-executable components or modules. Generally, program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types. Aspects of the invention may be implemented with any number and organization of such components or modules. For example, aspects of the invention are not limited to the specific computer-executable instructions or the specific components or modules illustrated in the figures and described herein. Other embodiments of the invention may include different computer-executable instructions or components having more or less functionality than illustrated and described herein.
Examples of well known computing systems, environments, and/or configurations that may be suitable for use with aspects of the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, mobile telephones, tablet computers, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
Computer-readable media, which include both volatile and nonvolatile media, removable and non-removable media, may be any available medium that may be accessed by computer 601. By way of example and not limitation, computer-readable media comprise computer storage media and communication media. Computer storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Communication media typically embody computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and include any information delivery media. Those skilled in the art are familiar with the modulated data signal, which has one or more of its characteristics set or changed in such a manner as to encode information in the signal. Wired media, such as a wired network or direct-wired connection, and wireless media, such as acoustic, RF, infrared, and other wireless media, are examples of communication media. Combinations of any of the above are also included within the scope of computer-readable media.
The computer 601 may operate in a networked environment 606 using logical connections to one or more remote computers. Generally, the data processors of computer 605 are programmed by means of instructions stored at different times in the various computer-readable storage media of the computer 601. Although described in connection with an exemplary computing system environment, including computer 601, embodiments of the invention are operational with numerous other general purpose or special purpose computing system environments or configurations. The computing system environment is not intended to suggest any limitation as to the scope of use or functionality of any aspect of the invention. Moreover, the computing system environment should not be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment.
In operation, computer 601 executes computer-executable instructions such as those illustrated in the figures to implement aspects of the invention.
The memory area 607 stores the components of the composition model 608 (e.g., parts, sections, patterns, event channels, events and event values). In addition, the memory area 607 stores computer-executable components including an interface module 609, a storage module 612, an arranger module 613 and a presentation module 614. The general purpose computer 601 is accessible by an operator using an interface module 609. The interface module 609 may receive, from an operator, commands and instructions to update the composition model and/or to generate a presentation. In one embodiment, said operator is a human user 610. Said user 610 may enter commands and information into computer 601 through input devices or user interface selection devices such as a keyboard and/or a pointing device (e.g., a mouse, trackball, pen, touch pad or touch-sensitive screen). In one embodiment, said operator is a computer 611. Said computer 611 may be a remote computer, transmitting commands and instructions using a network connection 606. Said computer 611 may be identical to the main computer 601, executing instructions defined in a computer-executable component. The storage module 612 defines the plurality of components of the composition model. A method for defining components is described below. The arranger module 613 uses the components of the composition model defined by the storage module to create a plurality of note events. The presentation module 614 uses the plurality of composition model components, e.g. those defined by the storage module and the arranger module, and produces presentation data. Said presentation data may be audio data. Said presentation data may be MIDI data. Said presentation data may be graphical images representative of the composition model, using musical notation known in the art. The memory area 607 may store the produced presentation data. The presentation data may be sent to a speaker 602, sent to an instrument 604 or presented to an operator, e.g. using the interface module 609.
In one embodiment, computer 601 has one or more processors or processing units, one or more speakers 602, access to one or more external instruments 604 via a MIDI interface or analog audio interface, access to one or more microphones 603, and access to a memory area 607 or other computer-readable media. The computer 601 may replicate the sounds of instruments such as instruments 604 and render those sounds through the speakers 602 to create virtual instruments. Alternatively or in addition, the computer 601 may communicate with the instruments 604 to send data to the instruments 604 for rendering.
The memory area 607 stores the composition model. To do this, the computer 601 uses the computer-executable instructions of the storage module 612. In the preferred embodiment, the composition model is stored using a method for organizing data. In this detailed description, said method for organizing data will be referred to as ‘the storage method’, and the part of the memory area used for organizing data 608 will be referred to as ‘the storage’. The preferred embodiment organizes data in a database in the storage 608.
A global domain 1501 represents a set of information. A global domain has an identifier. In one embodiment, the identifier of a global domain may be ‘unizone.org’.
A source 1505 represents a user, a group, an application, a service or any other entity that may edit or access content in the storage. A source has an identifier. In the preferred embodiment, the identifier of a source is a UUID.
A value 1514 represents a piece of information.
A value may represent a boolean.
A value may represent an integer.
A value may represent a real number.
A value may represent a text.
A value may represent a file in a file storage system.
A value may represent an array of values.
A value may represent a mapping from values to values.
A value may represent the central node 1510 of a cluster.
A value may represent a structure of relations and other values. Nodes 1510, other than the central node of the cluster, are represented as structures.
A type 1503 represents a category of nodes 1510 or values 1514 with the same behavior. A type has an identifier. In one embodiment, the identifier of a type may be ‘org.unizone.world.Person’.
A package 1502 represents a set of types 1503. A package has an identifier. In one embodiment, the identifier of a package may be ‘org.unizone.world’.
A property 1504 represents a semantic meaning of an association between a node and a value. A property has an identifier. In one embodiment, the identifier of a property may be ‘org.unizone.world.Person.address’.
A property is associated with a type 1503.
The storage stores information as a network of small, connected sets of information. These information sets are called clusters 1509. This approach enables minor modifications to be saved incrementally by only saving data of modified clusters.
A sandbox 1506 represents is a set of clusters 1509. A sandbox has an identifier. In the preferred embodiment, the identifier of a sandbox is a UUID.
A source 1505 may have its own domain within a sandbox 1506. This domain is called a source domain 1507. This source domain may be identified by the identifier of said sandbox and the identifier of said source. A source domain represents a subset of the clusters associated with said sandbox.
Each cluster 1509 is associated with a domain. The domain may be a global domain 1501 or a source domain 1507. Each cluster has a central node 1510 from which all other information in the cluster can be reached.
The central node 1510 of a cluster 1509 may be associated with any number of types 1503 to make it easier to search for clusters with a certain behavior, but any node may have edges with properties belonging to any type. For instance, a node representing a person could have edges with properties associated with a customer, a location and a user at the same time. In a way, the storage method supports multiple inheritance, which is a known concept in the art. The central node of a cluster does not have to be associated with any type.
An edge 1513 represents the association between the central node 1510 of a cluster 1509 and a defined value 1514. The defined value 1514 is called the value of the edge. An edge is associated with a property 1504. The associated property describes the meaning of the association between the central node 1510 of the cluster 1509 and the value 1514.
Nodes in the cluster other than the central node may have properties as well. These nodes are stored as structured values, where the property and the target value of the relations of the node are encoded.
In the preferred embodiment, an integer uniquely identifies the central cluster node 1510 of a cluster 1509 within its domain. This integer may be called the cluster integer. Values 1514 associated with the central node 1510 of a cluster 1509 may be accessed using edges 1513.
In the preferred embodiment, a cluster associated with a global domain may be identified by the global domain identifier and the cluster integer. In the preferred embodiment, a cluster associated with a source domain may be identified by the sandbox identifier, the source identifier and the cluster integer.
A cluster state 1512 is used for storing one version of all edges 1513 of the central node 1510 of a cluster 1509.
In the preferred embodiment, a cluster state 1512 is associated with the time when it was created. This associated creation time may be used for removing old, inactive information, and for merging two sets of clusters.
In the preferred embodiment, a cluster state 1512 is associated with the source 1505 that created it. This allows for filtering information based on properties of the source, e.g. ignoring automatically generated content.
In the preferred embodiment, cluster states are associated with a text describing the changes compared with the previous trunk cluster state.
In the preferred embodiment, branches 1508 are used for keeping track of different sets of cluster states. Branches makes it possible to switch between different sets of clusters and edges, just by selecting which branch to use. A branch may have an identifier.
In the preferred embodiment, a cluster branch 1511 associates a cluster 1509 and a branch 1508 with a set of cluster states 1512. The cluster branch 1511 keeps track of the trunk cluster state. The trunk cluster state of a cluster 1509 for a given branch 1508 is the cluster state 1512 that is associated with the current edges of said cluster 1509.
Restoring an old cluster state 1512 of a cluster branch 1511 is done by changing the trunk cluster state of the cluster branch to the old cluster state.
Cluster states may have an indirect references to a branch, e.g. by using a hierarchy of branches, in which cluster states associated with a parent branch of a defined branch may be used if no cluster state is associated with the defined branch.
In other embodiments, there are no branches. The cluster states 1512, including the trunk cluster state, are then associated directly with the cluster 1509.
In the preferred embodiment, the following method may be used for adding edge information about a provided cluster 1509 to the storage, using a provided branch 1508:
The only altered storage value is the trunk cluster state of the cluster branch. Nothing is removed. All cluster states, edges and values are added before the trunk cluster state is altered. This limits the risk for storage corruption issues.
Cluster states which are not the trunk state of any cluster branch, and which have been created before a time limit, e.g. a week, may be removed from the storage using a garbage collection process. This allows an operator to undo individual cluster edits that are younger than the time limit.
In the preferred embodiment, all domains, including global domains 1501 and source domains 1507, have their own integer number series for cluster integers. This implies that each source 1505 is responsible for the numbering of its own clusters 1509 within each of its source domains 1507. This makes it possible to synchronize sandbox 1506 content across different memory areas without creating conflicting cluster integers.
The central node 1510 of a cluster 1509, associated with a source domain 1507, associated with a sandbox 1506 can be the value 1514 of an edge 1513 only if said edge is associated with the same sandbox 1506, via a cluster state 1512, a cluster 1509 and a source domain 1507. Thus, a cluster associated with a source domain can only be referenced from the same sandbox.
An edge 1513 may associate a node 1510 in one source domain 1507 with the central node 1510 of a cluster 1509 associated with any global domain 1501. Thus, a cluster associated with a global domain can be referenced from any cluster.
Since there may be no edges associating a node outside a sandbox to a node in said sandbox, removing said sandbox, including all its clusters, has no effect on the rest of the storage.
In one embodiment, a source 1505 may create a cluster state, associated with said source, and assign it as the trunk cluster state of a cluster branch belonging to cluster associated with a source domain associated with another source. Thus, multiple sources, e.g. users, may collaboratively edit the same cluster.
In one embodiment, any access to clusters, including creating clusters and associating clusters with new cluster states, may require source privileges, using an access control system.
In this description, global domains, packages, types, properties, sources, sandboxes, sandbox domains and branches are describes as separate categories of components. In embodiments of the invention, any number of these components may be clusters.
A negative aspect of this is an increased complexity, including a possibility of direct or indirect circular references. For instance, a cluster representing a source may be associated with a cluster state, whose creation source is said source cluster. Also, said source cluster may be associated with a source domain, which may be associated with a sandbox and said source cluster. This may create a problem with the order of component creation.
A positive aspect of this is that you can dynamically attach information to the components, using edges with properties, e.g. adding user information, such as username, personal details and pictures to a source cluster.
In the preferred embodiment of the invention, sources are clusters, while all other components listed above are separate component categories.
In the preferred embodiment, domains, sources, branches, packages, types and properties may be identified using identifiers. Clusters may be identified using identifiers and integers. This implies that most information about a subset of the storage model, e.g. all clusters of one sandbox, may be encoded as a text file. Some values, e.g. file content, may be excluded. Said encoded subset may be stored and/or shared. Said encoded subset may also be parsed and merged with another storage. Embodiments of the invention may be used for merging two sets of clusters, e.g. by for each cluster in one set determining if its trunk cluster state is more recently created than the trunk cluster state of the corresponding cluster in the other set.
In the preferred embodiment, the components of the composition model are closely related to components of the storage method. Composition components, e.g. sections, patterns and parts, are stored as clusters. Intentions are stored as properties. Relations between components are stored using edges or structured values. Event lists are stored as structured values.
In the preferred environment, the invention initiates a process that periodically and automatically stores modified composition model components in the storage. The storage method is part of the present invention. The storage method enables incremental updates of small clusters of information, instead of storing a complete composition model every time it is edited. The storage method also enables restoration of old versions of information. The storage method also enables switching between multiple, overlapping sets of information, using branches. All these features are valuable in the exploratory environment of creative composing, especially in an operating environment with limited resources, e.g. a mobile computer or a tablet computer.
Other embodiments may use other methods for storing the composition model. In other embodiments, the storage method may be used for other purposes than for storing composition models.
The order of these definitions and associations is not important. Some steps in the list of steps may be performed multiple times.
The preferred embodiment of the invention may be used for collecting clusters with a provided set of property values.
While aspects of the invention have been described in relation to musical concepts, embodiments of the invention may generally be applied to any concepts that organizes ordered changes, e.g. video, audio, film, scenography, stage lighting and equipment control.
This detailed description uses various terms, e.g. from graph theory. Modifications and variations of the terms are possible without departing from the scope of aspects of the invention as defined in the appended claims.
The order of execution or performance of the operations in embodiments of the invention illustrated and described herein is not essential, unless otherwise specified. That is, the operations may be performed in any order, unless otherwise specified, and embodiments of the invention may include additional or fewer operations than those disclosed herein. For example, it is contemplated that executing or performing a particular operation before, contemporaneously with, or after another operation is within the scope of aspects of the invention.
When introducing elements of aspects of the invention or the embodiments thereof, the articles “a,” “an,” “the,” and “said” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements.
Having described aspects of the invention in detail, it will be apparent that modifications and variations are possible without departing from the scope of aspects of the invention as defined in the appended claims. As various changes could be made in the above constructions, products, and methods without departing from the scope of aspects of the invention, it is intended that all matter contained in the above description and shown in the accompanying drawings shall be interpreted as illustrative and not in a limiting sense.
This application claims priority from U.S. Provisional Patent Application 61/913,610, filed 9 Dec. 2013, and titled Device and methods for composing music.
