Patent Application
20210335334
The current process for composing songs is entirely manual, requiring the composer to come up with all the elements of a song. The process tends to require a great deal of musical training and experience, and individuals without musical training generally cannot compose songs using the current manual methods. There is a lack of technological tools for allowing people with no musical experience to easily create original songs. For example, there do not exist tools for breaking down the composition process into smaller pieces that allow for composition by combining computer-suggested elements.
Conventional systems are deficient with respect to generating sets of suggested song lyrics according to varying levels of creativity as desired by an end user. Further, such conventional systems fail to offer the end user with selectable functionalities to continually control and modify song criteria upon which suggest song lyrics may be based.
Various embodiments of a Lyric Engine provide for significant improvements and advantages over such conventional systems with regard to generating suggested song lyrics and selecting suggested song lyrics based on one or more song criteria and types of lyric content and attributes selected by a user.
Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to a Lyric Engine. In various embodiments, The Lyric Engine receives, at a user interface, a selection of at least one song criteria. The Lyric Engine receives a first set of suggested song lyrics that correspond to the selected song criteria. The Lyric Engine presents, in the user interface, the first set of suggested song lyrics. The Lyric Engine receives, at the user interface, a selection of one or more of the suggested song lyrics in the first set. The Lyric Engine receives a second set of suggested song lyrics that correspond to the selected song criteria and the selected song lyrics. The Lyric Engine concurrently presents, in the user interface, the selected song lyrics and the second set of suggested song lyrics.
In some embodiments, the Lyric Engine provides a user interface through which a user initiate a song lyric editing session to draft and edit song lyrics. In some embodiments, the user initiates drafting of song lyrics by selecting one or more song criteria such as, a genre and/or a topic for a song. The Lyric Engine presents a user interface with a plurality of suggested song lyrics that correspond to the user's selected song criteria. The user may select from the suggested song lyrics and may further edit one or more portions of the selected song lyrics. The Lyric Engine updates the user interface with additional suggested song lyrics based on the song criteria and one or more actions of the user. For example, the user may submit a word with which subsequent song lyrics should rhyme. In response to the user's submission, the Lyric Engine presents an updated listing of suggested song lyrics that rhyme with the user's submitted word.
Various embodiments include a module(s) and/or one or more functionalities to redact privacy information/data, to encrypt information/data and to anonymize data to ensure the confidentiality and security of user and Lyric Engine information/data as well as compliance with data privacy law(s) and regulations in the United States and/or international jurisdictions.
According to some embodiments, respective sets of suggested song lyrics the first and second sets of suggested song lyrics are based at least in part on output of a neural network; Each suggested song lyric differs from any of the other suggested song lyrics the respective sets.
In some embodiments, the Lyric Engine presents the user's selected plurality of song lyrics in an editing field. The user may further select a subset of the selected plurality of song lyrics displayed by the Lyric Engine in the editing field. The Lyric Engine may receive an update set of suggested song lyrics, generated by a neural network, that correspond to the selected subset of song lyrics from the editing field.
In various embodiments, the Lyric Engine may receive one or more user edits to song lyrics selected by the user.
Further areas of applicability of the present disclosure will become apparent from the detailed description, the claims and the drawings. The detailed description and specific examples are intended for illustration only and are not intended to limit the scope of the disclosure.
The present disclosure will become better understood from the detailed description and the drawings, wherein:
In this specification, reference is made in detail to specific embodiments of the invention. Some of the embodiments or their aspects are illustrated in the drawings.
For clarity in explanation, the invention has been described with reference to specific embodiments, however it should be understood that the invention is not limited to the described embodiments. On the contrary, the invention covers alternatives, modifications, and equivalents as may be included within its scope as defined by any patent claims. The following embodiments of the invention are set forth without any loss of generality to, and without imposing limitations on, the claimed invention. In the following description, specific details are set forth in order to provide a thorough understanding of the present invention. The present invention may be practiced without some or all of these specific details. In addition, well known features may not have been described in detail to avoid unnecessarily obscuring the invention.
In addition, it should be understood that steps of the exemplary methods set forth in this exemplary patent can be performed in different orders than the order presented in this specification. Furthermore, some steps of the exemplary methods may be performed in parallel rather than being performed sequentially. Also, the steps of the exemplary methods may be performed in a network environment in which some steps are performed by different computers in the networked environment.
Some embodiments are implemented by a computer system. A computer system may include a processor, a memory, and a non-transitory computer-readable medium. The memory and non-transitory medium may store instructions for performing methods and steps described herein.
A diagram of exemplary network environment in which embodiments may operate is shown in
The exemplary environment 140 is illustrated with only two clients and one server for simplicity, though in practice there may be more or fewer clients and servers. The computers have been termed clients and servers, though clients can also play the role of servers and servers can also play the role of clients. In some embodiments, the clients 141, 142 may communicate with each other as well as the servers. Also, the server 150 may communicate with other servers.
The network 145 may be, for example, local area network (LAN), wide area network (WAN), telephone networks, wireless networks, intranets, the Internet, or combinations of networks. The server 150 may be connected to storage 152 over a connection medium 160, which may be a bus, crossbar, network, or other interconnect. Storage 152 may be implemented as a network of multiple storage devices, though it is illustrated as a single entity. Storage 152 may be a file system, disk, database, or other storage.
In an embodiment, the client 141 may perform the method 200 or other method herein and, as a result, store a file in the storage 152. This may be accomplished via communication over the network 145 between the client 141 and server 150. For example, the client may communicate a request to the server 150 to store a file with a specified name in the storage 152. The server 150 may respond to the request and store the file with the specified name in the storage 152. The file to be saved may exist on the client 141 or may already exist in the server's local storage 151. In another embodiment, the server 150 may respond to requests and store the file with a specified name in the storage 151. The file to be saved may exist on the client 141 or may exist in other storage accessible via the network such as storage 152, or even in storage on the client 142 (e.g., in a peer-to-peer system).
In accordance with the above discussion, embodiments can be used to store a file on local storage such as a disk or on a removable medium like a flash drive, CD-R, or DVD-R. Furthermore, embodiments may be used to store a file on an external storage device connected to a computer over a connection medium such as a bus, crossbar, network, or other interconnect. In addition, embodiments can be used to store a file on a remote server or on a storage device accessible to the remote server.
Furthermore, cloud computing is another example where files are often stored on remote servers or remote storage systems. Cloud computing refers to pooled network resources that can be quickly provisioned so as to allow for easy scalability. Cloud computing can be used to provide software-as-a-service, platform-as-a-service, infrastructure-as-a-service, and similar features. In a cloud computing environment, a user may store a file in the “cloud,” which means that the file is stored on a remote network resource though the actual hardware storing the file may be opaque to the user.
The User Selection module 104 of the system 100 may perform functionality as illustrated in
The Suggested Song Lyric Reception module 106 of the system 100 may perform functionality illustrated in
The Song Criteria Transmission module 108 of the system 100 may perform functionality illustrated in
The User Interface module 110 of the system 100 may display information, data and user interface options and functionalities based on functionality as illustrated in
While the databases 120, 122 and 124 are displayed separately, the databases and information maintained in a database may be combined together or further separated in a manner the promotes retrieval and storage efficiency and/or data security. It is understood that, in various embodiments, one or more of the modules 104, 106, 108, 110 may reside and be implemented on the user device 140. In addition, respective portions of one or more of the modules 104, 106, 108, 110 may reside and be implemented on the user device 140, while other portions of the same one or more modules 104, 106, 108, 110 may reside and be implemented remotely from the user device 140.
As shown in
The Lyric Engine running at computing device 160 may receive respective user selections at the user interface 144. For example, the user selections may indicate one or more types of song criteria. In addition, a user selection may be a selection of a request for a plurality of new suggested song lyrics to be received in an update set of suggested song lyrics.
The Lyric Engine detects respective user selections throughout a song lyric editing session and formats the detected user selections for transmission to the remote song lyric artificial intelligence system 130. The remote song lyric artificial intelligence system 130 generates output based on the detected user selections. According to various embodiments, such output represents suggested song lyrics and/or sets of suggested song lyrics that include content and attributes that correspond with certain user selections. The computing device 160 receives the output from the remote song lyric artificial intelligence system 130 and the Lyric Engine displays the output in the user interface 144.
According to various embodiments, the remote song lyric artificial intelligence system 130 may use and/or be trained according to any suitable machine learning training techniques such as, but not limited to, Artificial Neural Network, Deep Learning; a robust linear regression algorithm, such as Random Sample Consensus, Huber Regression, or Theil-Sen Estimator; a kernel based approach like a Support Vector Machine and Kernel Ridge Regression; a tree-based algorithm, such as Classification and Regression Tree, Random Forest, Extra Tree, Gradient Boost Machine, or Alternating Model Tree; Naïve Bayes Classifier; and other suitable machine learning algorithms. According to various embodiments, the artificial intelligence system 130 may be any type of expert system(s) or may include one or more types of expert systems. According to various embodiments, a database system that provides access to stored lyric portions that can be located and combined according to song/lyric rules may be implemented in place of the artificial intelligence system 130.
As shown in flowchart 200 of
The Lyric Engine receives a first set of suggested song lyrics that correspond to the selected song criteria (Act 220). For example, the first set of suggest song lyrics may be generated by and received from a remote neural network. The Lyric Engine presents, in the user interface, the first set of suggested song lyrics (Act 230).
The Lyric Engine receives, at the user interface, a selection of one or more of the suggested song lyrics in the first set (Act 240). For example, the Lyric Engine may detect the user selecting a plurality of suggested song lyrics. In addition, the Lyric Engine may receive user edits to the selected song lyrics.
The Lyric Engine receives a second set of suggested song lyrics that correspond to the selected song criteria and the selected song lyrics (Act 250). For example, the second set of suggest song lyrics may be generated by and received from the remote neural network based, at least in part, on recent activity and selections by the user that occurred after the Lyric Engine displayed the first set of suggested song lyrics. The Lyric Engine concurrently presents, in the user interface, the selected song lyrics and the second set of suggested song lyrics (Act 260). It is understood that various embodiments of the Lyric Engine may be implemented according to an iterative process of continually generating and displaying subsequent sets of suggested song lyrics based on continually updating song criteria or song criteria that has not been updated by the user.
As shown in
As shown in
As shown in
The suggested lyric portion 402 may further include a new suggestions functionality 412. A user may select the new suggestions functionality 412 and in response to the selection, the Lyric Engine may update the suggested letter portion 402 with one or more new, unique suggested song lyrics or an entirely new set of suggested song lyrics. It is understood that, in one or more embodiments, subsequent sets of suggested song lyrics may include one or more similar words and/or one or more similar phrases. For example, one or more words and/or one or more phrases in a set of suggested song lyrics may also be included in a subsequent set of suggested song lyrics.
As shown in
As shown in
As shown in
As shown in
As shown in
As shown in
As shown in
According to various embodiments, the Lyric Engine may detect the user selecting at the editing field 404 a portion of displayed selected song lyrics. Such selection may represent a portion of a selected song lyric and not all the words of that selected song lyric. For example, the Lyric Engine may receive a user selection of “won't be back” from a selected song their work 512-1. The Lyric Engine may update the song criteria based on the selected song lyric portion (i.e. “won't be back”) such that subsequent suggested song lyrics received by the Lyric Engine may correspond to content and attributes that are associated with the selected song lyric portion (i.e. “won't be back”). In various embodiments, a selected song lyric portion may be an entire sentence, one or more sentences and/or a plurality of disjointed sections from different sentences.
According to various embodiments, a rhyming word selected via the rhyming functionality 412 need not be any word currently displayed to the user. Rather, the user may conceive of the rhyming word and provided to the Lyric Engine as input to the rhyming functionality 412.
According to various embodiments, the user may provide input of a word(s) or a phrase representing a desired ending (or beginning) to a song lyric. The Lyric Engine may utilize the input as a song criteria for generating and providing one or more suggested song lyrics where each suggested song lyric is meant to be used as a word(s) or a phrase at the beginning (or ending) of a song lyric that ends with the user's provided input.
In various embodiments, the user may provide one or more sentences and/or words to be utilized as song criteria for subsequently generated sets of suggested song lyrics. For example, as shown in
It is understood that various embodiments are not limited to the generation of song lyrics. For example, one or more embodiments may be implemented for the generation of poetry phrases and/or groupings of sentences.
The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a server, a network router, a switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
The example computer system 700 includes a processing device 702, a main memory 704 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM (RDRAM), etc.), a static memory 706 (e.g., flash memory, static random access memory (SRAM), etc.), and a data storage device 718, which communicate with each other via a bus 730.
Processing device 702 represents one or more general-purpose processing devices such as a microprocessor, a central processing unit, or the like. More particularly, the processing device may be complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, or processor implementing other instruction sets, or processors implementing a combination of instruction sets. Processing device 702 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like. The processing device 702 is configured to execute instructions 726 for performing the operations and steps discussed herein.
The computer system 700 may further include a network interface device 708 to communicate over the network 720. The computer system 700 also may include a video display unit 710 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 712 (e.g., a keyboard), a cursor control device 714 (e.g., a mouse), a graphics processing unit 722, a signal generation device 716 (e.g., a speaker), graphics processing unit 722, video processing unit 728, and audio processing unit 732.
The data storage device 718 may include a machine-readable storage medium 724 (also known as a computer-readable medium) on which is stored one or more sets of instructions or software 726 embodying any one or more of the methodologies or functions described herein. The instructions 726 may also reside, completely or at least partially, within the main memory 704 and/or within the processing device 702 during execution thereof by the computer system 700, the main memory 704 and the processing device 702 also constituting machine-readable storage media.
In one implementation, the instructions 726 include instructions to implement functionality corresponding to the components of a device to perform the disclosure herein. While the machine-readable storage medium 724 is shown in an example implementation to be a single medium, the term “machine-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “machine-readable storage medium” shall also be taken to include any medium that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure. The term “machine-readable storage medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical media and magnetic media.
Some portions of the preceding detailed descriptions have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the ways used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the above discussion, it is appreciated that throughout the description, discussions utilizing terms such as “identifying” or “determining” or “executing” or “performing” or “collecting” or “creating” or “sending” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage devices.
The present disclosure also relates to an apparatus for performing the operations herein. This apparatus may be specially constructed for the intended purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (ROMs), random access memories (RAMS), EPROMs, EEPROMs, magnetic or optical cards, or any type of media suitable for storing electronic instructions, each coupled to a computer system bus.
Various general purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct a more specialized apparatus to perform the method. The structure for a variety of these systems will appear as set forth in the description above. In addition, the present disclosure is not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the disclosure as described herein.
The present disclosure may be provided as a computer program product, or software, that may include a machine-readable medium having stored thereon instructions, which may be used to program a computer system (or other electronic devices) to perform a process according to the present disclosure. A machine-readable medium includes any mechanism for storing information in a form readable by a machine (e.g., a computer). For example, a machine-readable (e.g., computer-readable) medium includes a machine (e.g., a computer) readable storage medium such as a read only memory (“ROM”), random access memory (“RAM”), magnetic disk storage media, optical storage media, flash memory devices, etc.
In the foregoing disclosure, implementations of the disclosure have been described with reference to specific example implementations thereof. It will be evident that various modifications may be made thereto without departing from the broader spirit and scope of implementations of the disclosure as set forth in the following claims. The disclosure and drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive sense.
This application is a Continuation-in-Part of U.S. application Ser. No. 17/278,655, filed on Mar. 22, 2021, which is a 35 U.S.C. § 371 national stage application of PCT International Application No. PCT/US2019/055934, filed on Oct. 11, 2019, which claims the benefit of U.S. Provisional Application No. 62/744,145, filed on Oct. 11, 2018, all of which are hereby incorporated by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17278655 | Mar 2021 | US |
| Child | 17232087 | US |
