Integrated visual learning system for electric guitar and similar instruments, to which the present invention refers, is within the field of musical instruments.
The integrated visual learning systems consist of; a) an integrated learning method in a mobile application b) a display device on the instrument fretboard c) an augmented reality device d) a feedback device, and finally e) a Bluetooth communication device and a battery recharging device.
The learning method is integrated in an application for mobile devices and contains the learning methodology and the knowledge that will be transmitted to the user to develop the ability to play the instrument. The display device on the instrument fretboard allows the user to view the information sent by means of the learning method using transparent resins. The augmented reality device is made up of augmented reality glasses that allow the user to be shown a virtual teacher as well as superimposed images that are sent by the learning method and finally the feedback device evaluates the precision with which the user executes the exercises given in the learning method.
The learning method, the display device on the instrument fretboard, the augmented reality device and the feedback device are connected by means of the Bluetooth communication device and together and combined form an integral visual learning system, which allows the user send from the mobile application the information of; notes, chords, scales and other knowledge necessary for learning the instrument, this information is displayed on the display device on the instrument fretboard so the user can identify where the notes are located and simultaneously the augmented reality device shows the user a virtual teacher and images with the position and shape of the fingers of his left/right hand to play the notes, chords and musical scales correctly and finally the feedback device identifies the notes/chords that the user played on the instrument and compares them with the notes/chord requested in the exercises contained in the learning method, to obtain the precision with which the user performed the exercises and guarantee that gradually improves until obtaining the required mastery at the different learning levels (FIG. 7). Finally, the system has a recharging device for a lithium ion battery, that powers the entire system.
BACKGROUND OF THE INVENTION
Currently, the learning process of a musical instrument such as the electric guitar and similar instruments is mainly based on the transmission of knowledge through teachers or, where appropriate, through books and methods that help develop the ability to play the instrument.
Noting that there is a digital evolution in many aspects of our daily lives, it was thought to develop an integral visual learning system for electric guitar and similar instruments. This system allows the user to accelerate the practical and theoretical learning to play the instrument, since it reduces the time for memorization and learning of notes, chords, musical scales and other theoretical information necessary to play the instrument, and this consequently promotes the process of self-taught learning.
Currently, some patent applications for devices that perform some specific function that could be related to the present invention are found in the state of the art, but are differentiated by the following:
- Patent application/Publication number U.S. Pat. No. 9,208,763B2 which refers to a device that provide feedback to the user by means of sensors that detect the force with which the strings are pressed and combined with a camera detects the position of the finger that touched the string to generate a comparison. The main difference of the present invention lies in that it is an integral system that combines various elements or devices that together guarantee user learning. On the other hand, the operation of the feedback device of the present invention is based on detecting the frequency and time of the note or notes that are executed by the user and comparing them with the practical exercises requested from the learning method contained in an application for mobile devices and with this to have an evaluation of the user when performing the exercises.
- Patent application/Publication number U.S. Pat. No. 9,679,548B1 that refers to a flexible electronic display that is attached to an electronic device that is bent in the form of an arc, this device contains a camera that detects movement and allows mapping the movement of the external strings corresponding to virtual strings and generates as output the movement of the virtual strings to produce a sound. As in the previous case, the present invention differs from this application, in that it is an integral system that combines various elements or devices and which aims to show the user all the necessary information (from beginner to master level) to develop the ability to play the instrument, the application mentioned in this paragraph aims to identify movement to generate sounds.
- Patent application/Publication number US20170125000A1 which refers to a method for controlling electronic string instruments, such as electronic midi guitars, video game guitars, and tablets representing virtual guitars. Similarly, the present invention differs from this application in that it is an integral system that combines several elements or devices. Some of the additional elements that the present invention has versus this application are, for example; a feedback device that allows evaluating the quality and precision of the user's execution, an augmented reality device that allows the user to show a virtual teacher and images superimposed with the instrument to position correctly the fingers of the hands and an integrated learning method in an application that contains the knowledge and practical exercises that the user must develop to obtain the ability to play the instrument correctly. Another important difference is that the method of the aforementioned application (US20170125000A1) focuses on teaching the chords of a song, while the method of the integral visual learning system for electric guitar and similar instruments referred to in this invention focuses on providing comprehensive knowledge segmented into four learning levels (beginner, intermediate, advanced and master) and containing practical and theoretical learning techniques, integrating the information of musical notes, triads, chords, scales, musical modes, harmony, melody, improvisation and practical exercises for each of the sections and subsections that are evaluated by the feedback device.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1—Display device on the instrument fretboard—Assembly view
FIG. 2—Matrix of transparent or colored resins embedded in the fretboard of the instrument—Top view, left side view and isometric view.
FIG. 3—Microcontroller and light emitting diode matrix—Top view and isometric view.
FIG. 4—Bluetooth communication device, feedback device and a battery recharging device—Isometric view.
FIG. 5—Bluetooth communication device assembly, feedback device, battery recharging device whit instrument body—Isometric view.
FIG. 6—Display device on the instrument fretboard example, to indicate the formation of a chord and a musical scale, with an instruction from the learning method.
FIG. 7—Elements of the integral visual learning system for the electric guitar and similar instruments. Example of interaction of all devices (display device on the instrument fretboard, augmented reality device, feedback device and integrated learning method in a mobile application).
DETAILED DESCRIPTION
The integral visual learning system for electric guitar and similar instruments to which the present invention refers consists of: a) a learning method integrated into an application for mobile devices, b) a display device on the instrument fretboard, c) an augmented reality device d) a feedback device and finally e) a Bluetooth communication device and a battery recharging device (FIG. 7).
The learning method integrated in an application for mobile devices contains all the theoretical and practical information that the user will obtain through different learning levels (beginner, intermediate, advanced and master). The main element of the learning method is to facilitate the users the visualization process, by visually showing them the information of notes, chords, scales and other information necessary for learning the instrument (through the display device on the instrument fretboard and augmented reality device). The next element of the learning method is the theoretical and practical exercises found in each of the 4 learning levels, in which the user receives theoretical information on each of the topics so that they can subsequently carry out the practical execution of the exercises. which in turn are evaluated by the feedback device. The learning method will require the user to complete a minimum of hours of practice and precision in order to unlock the following levels. The type of practical exercises contained in the method can be, for example:
- Execution and repetition of notes in different parts of the fretboard.
- Execution and repetition of chords and chord sequences.
- Execution and repetition of scales in different parts of the instrument fretboard, for example; major scale, minor scale, pentatonic scale, melodic minor scale, etc.
- Execution and repetition of fragments of scales in two, three or four strings, descending, ascending, left-right, right-left, etc.
- Execution and repetition of different techniques or ways of playing the instrument, for example; alternate picking, sweep picking, tapping, etc.
- Playback of music tracks on which the user can perform improvisation exercises with scales.
Additionally, the learning method integrated in an application for mobile devices allows the users to view a virtual teacher through the augmented reality device that guides them through the different lessons and exercises.
The display device on the instrument fretboard (FIG. 1 and FIG. 6) is composed of the following elements a) a microcontroller and auxiliary components b) a matrix of light emitting diodes and c) a matrix of transparent resins. The microcontroller (FIG. 3a) is connected by means of the Bluetooth communication device to the application that contains the learning method, said microcontroller has an embedded program whose function is to receive the instructions sent by the learning method and translate them, so that the information sent by the method, is displayed in the matrix of light-emitting diodes that is inside the instrument fretboard (FIG. 3b and FIG. 1) and this in turn illuminates the matrix of transparent resins (FIG. 2), this last matrix is placed at each of the intersections of each fret of the instrument with each of the strings of the instrument along 18 frets. In this way, the display device on the instrument fretboard, allows the users to visually see the information necessary for learning the instrument, such as; notes, chords, musical scales, etc.
- The matrix of transparent display resins are produced with methods known in the art in the following manner; Perforations are made in the fretboard of the instrument, with drill-type tools or numerical control machines in each of the fret vs. string intersections, then a transparent or colored liquid resin that hardens after 24 hours is placed and finally it is carried out a process of sanding and polishing the surface in such a way that the instrument arm (fretboard) is flat, but with the display resins inserted.
- The microcontroller and the matrix of light emitting diodes are mounted on a PCB (Printed Circuit Board) and is produced by methods and procedures known in the art as follows; first the diagram or schematics are designed with the electronic elements necessary for the desired operation, then the circuit is printed on PCB cards where the electronic components are assembled and soldered according to the electrical diagram designed to perform the function defined for each device.
The augmented reality device (FIG. 7) is made up of augmented reality glasses that are connected by means of the Bluetooth communication device to the application for mobile devices that contains the learning method and through which the instructions are sent and that unfold in augmented reality glasses. The augmented reality device allows the user to visualize a virtual teacher who provides theoretical information, as well as overlapping images with the instrument fretboard that align with the visual patterns shown by the display device on the instrument fretboard, to show the user how to position the fingers of the hand on the instrument fretboard and thus correctly play notes, form chords, musical scales and other knowledge necessary to learn to play the instrument (FIG. 6 and FIG. 7).
- The augmented reality device is produced with methods known in the art that are distributed by companies such as; Google, Epson (TEXA), Meta (Meta2), Apple (iGlass), as well as various softwares that allow you to program augmented reality systems; Argon (Augmented Reality Browser) ARToolKit (Augmented Reality Apps), ArUco (Augmented Reality Apps), Goblin XNA (30 user intefaces platform), Mixare (mix Augmented Reality Engine), DroidAR (Augmented Reality Framework for Android), etc.
The feedback device (FIG. 4b and FIG. 7) has as a function to recognize the frequency of the notes produced by the piezoelectric pickups to compare them with a database where the frequencies of all the notes and chords are defined and thus identify the note or notes that were played by the user. Piezoelectric pickups known in the art, are incorporated in instruments such as electric guitars, electro-acoustic guitars, electric basses and have the function of converting the mechanical waves produced by the vibration of the strings, into electrical signals with a certain frequency, said signal is used as input for the feedback device, which is connected by means of the Bluetooth communication device to the application that contains the learning method and in this way the feedback device can send the application the information of the notes that were executed by the user (precision and execution time) in order for the users to receive, through the application, feedback on their precision with which they executed the practical exercises established in the method and that this will allow them to improve the performance of their exercises and accumulate hours of practice to be able unlock the next levels.
- The feedback device is mounted on a PCB (Printed Circuit Board) and is produced by methods and procedures known in the art as follows; first the diagram or schematics are designed with the electronic elements necessary for the desired operation, subsequently, the circuit is printed on PCB cards where the electronic components are assembled and soldered according to the electrical diagram designed to perform the function defined for each device.
The Bluetooth communication device, (FIG. 4a) has a low-energy Bluetooth module and auxiliary components, which allows establishing communication to receive and send data between the display device on the instrument fretboard, the feedback device, the augmented reality device and the application for mobile devices that contains the learning method and finally the integral visual learning system for guitars and similar instruments has a charger device, (FIG. 4c) that contains a micro USB type connector to connect a USB type charger to the electrical current that recharges a rechargeable lithium ion battery, which in turn powers all the devices mentioned above that are incorporated inside the guitar or similar instrument.
- The Bluetooth communication and charger devices are mounted on a PCB (Printed Circuit Board) and are produced by methods and procedures known in the art as follows; first the diagram or schematics are designed with the electronic elements necessary for the desired operation, then the circuit is printed on PCB cards where the electronic components are assembled and soldered according to the electrical diagram designed to perform the function defined for each device.
In conclusion, the integral visual learning system for electric guitar and similar instruments to which the present invention refers, provides the users with a system to develop the ability to play the instrument in an accelerated and self-taught way, due to the facts that the users learn with a system that allows them to visualization notes, chords, musical scales, all the theoretical information and content is organized in different levels of learning, they receive real-time feedback and performance evaluation and all this through a digital, modern and fun concept for the users.
Having described the invention as above, the content of the following claims is requested as property.
Patent Application
20210049926
