The present invention relates to an interface for controlling musical instrument synthesizers. In one aspect, the present invention allows musicians familiar with stringed instruments to use their musical skill to control electronic music synthesizers.
According to one aspect of the invention, there is provided a synthesizer controller based on a guitar interface, but the invention is not limited to use with guitars and can be utilized in any other stringed instrument form-factor.
A typical stringed instrument has two means for activating and controlling sounds. The first means controls the loudness or onset of the tone, and the second means controls the pitch of the tone. In a conventional mechanical or electro-mechanical stringed instrument, this is accomplished by strumming, plucking or bowing the strings with one hand to provide the onset and loudness. The fingers of the other hand are used to terminate the string length to define the pitch of the note.
Two types of interfaces for electronic stringed instruments are generally known. The first is based on pitch detection using an electromagnetic, piezo-electric or optical pickup coupled to each string. The pickup converts the string vibrations into an electrical signal and a combination of hardware signal conditioning and software algorithms is then used to convert the electronic signal into information that can be transmitted to a music synthesizer. This may typically be a MIDI (Musical Instrument Digital Interface) device. This method, however, is characterized by a physical delay between the time that the string is plucked and the time that the resulting note is generated. The delay is due to the fact that a significant part of the electrical waveform must be analyzed before a result can be calculated and transmitted. In a normal guitar, the low E string is about 82.4 Hz, so a single cycle of this waveform is 12.1 ms. Typical systems need to acquire more than a single cycle before the pitch can be accurately determined, and this can result in delays that are not pleasing to musicians.
The second method is based on a set of switches in the instrument neck combined with a set of triggers. The switches in the neck are used to define the pitch of the note to be played. The triggers are plucked or strummed and are used to activate the onset of the note. The problem with this type of system is that the switches in the neck are not very guitar-like for musicians familiar with conventional guitars as well as being expensive to implement.
In accordance with one aspect of the invention, there is provided an electronic musical instrument for producing musical notes comprising: an onset signal sensor for sensing the initiation of a note played on the musical instrument; and an electronic fingerboard for determining pitch of the note sensed by the sensor, the electronic fingerboard comprising a first layer of film, a second layer of film and a spacer member between the first and second layers of film, the first and second layers being movable relative to each other between a first inactive position in which the first and second layers are separate from each other along their respective lengths and a second active position in which the first and second layers are in contact with each other at a user selected point along their respective lengths, the pitch being determined by the resistance between the first and second layers at the user selected point.
Preferably, the onset signal sensor comprises a piezo-electric sensor, or an optical sensor.
In one embodiment, the musical instrument is a guitar; the fingerboard is mounted on an elongate neck; frets are formed transversely on the neck; elongate structures corresponding to guitar strings are configured on the neck; and a first layer, second layer and spacer member are formed below each of the elongate structures.
Preferably, the first layer is a conductive strip, and the second layer is a resistive strip. The conductive strip may be comprised of silver ink with carbon overlay for durability and the resistive strip may be comprised of carbon. In one form, the conductive strip is on top, the resistive strip is below the conductive strip and the spacer member is formed therebetween. In one embodiment, the conductive strip is comprised of two electrodes which interlock with each other.
In one aspect, the elongates structures corresponding to guitar strings comprise linear raised ribs on the on the fingerboard. Quantized mode, legato mode, or absolute mode may be utilized to determine the pitch of the note.
Preferably, the user selected point provides a controllable resistance representing pitch of the note according to the location of the point on the fingerboard. The onset signal sensor may be triggered by plucking a string on the musical instrument.
Preferably, a microprocessor is provided for sequentially reading and processing signals from the signal sensor and the electronic fingerboard respectively to determine when a note is played, as well as the volume and pitch of the note. The microprocessor may send data on the note played to a MIDI interface, or to an internal wavetable synthesizer.
Preferably, the first and second layers have a terminal at one end thereof and voltage at the terminal is determined by the user selected point. The voltage at the terminal may be proportional to the user selected point along the first and second layers, at which point the first and second layers are shorted together.
In one aspect, the first and second layers comprise a force sensing resistor whereby the resistance will vary as pressure on the user selected point changes, the higher the pressure on the user selected point causing more area contact between the first and second layers. Further, the measurement of a played note may be repeated a programmed number of times to determine an accurate pitch of played note.
In one embodiment, the fingerboard comprises multiple conductive electrode planes, each plane for detecting the pitch of a note at one or more predetermined locations on the fingerboard. Two alternating electrode planes, each of the two planes being responsive to the user selected point when located at alternating frets of the fingerboard, may be provided.
According to another aspect of the invention, there is provided an electronic musical instrument for producing musical notes comprising: an electronic fingerboard for determining pitch of the note, the electronic fingerboard comprising a first layer of film, a second layer of film and a spacer member between the first and second layers of film, the first and second layers being movable relative to each other between a first inactive position in which the first and second layers are separate from each other along their respective lengths and a second active position in which the first and second layers are in contact with each other at a user selected point along their respective lengths, the pitch being determined by the resistance between the first and second layers at the user selected point.
According to another aspect of the invention, there is provided a method of playing an electronic musical instrument which produces musical notes, the method comprising: activating an onset signal sensor for sensing the initiation of a note played on the musical instrument; and applying pressure to one or more user selected points on an electronic fingerboard which determines the pitch of the note sensed by the sensor, the electronic fingerboard comprising a first layer of film, a second layer of film and a spacer member between the first and second layers of film, the first and second layers being moved relative to each other between a first inactive position in which the first and second layers are separate from each other along their respective lengths and a second active position in which the first and second layers are in contact with each other at the user selected point along their respective lengths, the pitch being determined by the resistance between the first and second layers at the user selected point.
In accordance with one aspect of the present invention, the system of the invention is an improvement to and based upon the principles of the second type of interface described above using separate sensors for pitch and onset. The onset can be realized in many different ways using magnetic, piezo-electric, hall-effect, optical or other sensors. The pitch control means of the invention, instead of using a multitude of switches in the neck, utilizes technology which can generally be described as that adapted from the principles used in computer touch-screens using resistive technology. In one embodiment of the invention, resistive sensors are used to simulate the strings. The resistance generated by the sensors is proportional to the position along the length of the sensor at which it is activated by the user. The resistive sensors are read by an analog-to-digital converter that is controlled by a micro controller such that when the player presses on the sensor, the termination length determines the resistance read so that the represented note can be activated.
This system of the invention provides, in one form thereof, a mechanism that is familiar to guitar players and musicians skilled in playing any stringed instrument. Additionally, the resistive fingerboard of the invention can be enhanced with linear raised surfaces to provide tactile feedback giving the sensors on the instrument neck a similar feel to a conventional stringed instrument. The raised surfaces can be implemented or otherwise formed on the instrument with, as examples only, printing techniques, or by adding plastic ribs along the length of the sensors, or by embossing the raised shape on the sensor material, or adding an embossed overlay layer. The raised surfaces can be included to simulate the feel of the strings as well as the feel of the frets as necessary.
The system of the invention may have has the following benefits:
(1) Pitch Detection Method
The device of the present invention does not suffer from the inherent delay of pitch detection algorithms. The resistance value of the string sensor can be read instantaneously by the controlling microprocessor.
(2) Switch Method
This switch interface is not familiar to musicians who are trained to use stringed instruments. Pressing switches is a foreign experience and requires re-training. Therefore, one aspect of the present invention may provide a similar or familiar playing experience to that of conventional stringed instruments. Furthermore, there are cost benefits of the system of the invention, since it is simpler and efficient thus potentially costing less than that for a multi-switch system. Also the ability to provide mechanical ribs or rails emulates very closely a regular stringed instrument such as a guitar and therefore provides similar tactile feedback to a string for the player.
Another aspect of the present invention is that it may use a constant current source to excite the sensors resulting in a linear response from the sensors without the requirement for providing an electrical connection to both sides of the resistive strip. There are preferably only two conductors in the sensor, namely, the conductive strip and the resistive strip. The signal is measured directly at the termination of the resistive strip. This allows for a much simpler construction of the resistive sensor. The system is also preferably configured so that the conductive silver strip is physically located above a carbon strip. The conductive strip is connected to ground potential and thus also provides some shielding to reduce noise pickup in the system.
An instrument configured and constructed in accordance with the present invention is generally played much like a conventional guitar. Notes are fingered on the neck of the guitar and the string triggers can be plucked or strummed using common guitar playing techniques.
Several modes of operation of the present invention controlled by the micro controller may also be provided that can be used to enhance the musical performance. Representative examples of such modes are described below.
In quantized mode, the pitch is determined when the string trigger is activated. The pitch of the initial note transmitted is quantized to the closest real note (F step) value. If the user then slides his finger along the fingerboard the adjacent note (½ step) corresponding to the new finger position will sound.
In legato mode, the pitch is determined when the string trigger is activated. The pitch of the initial note transmitted is quantized to the closest real note (½ step) value as in quantized mode. If the user then slides his finger along the fingerboard, the system will use pitch bend commands to modify the pitch of the note proportionally to the new position on the fingerboard relative to the initial onset position. This mode provides a mechanism of control similar to guitar pitch bend in which the strings are bent. This allows smooth transitions in note pitch value as well as the ability for the user to implement pitch vibrato by rocking his finger back and forth causing slight pitch modulations. This is not available in switch based systems.
In absolute mode, the pitch is determined when the string trigger is activated. The pitch of the initial note transmitted is sent according to the note+pitch bend matching the actual position of the finger on the fingerboard. This mode is more like a fretless instrument where the note sounding always corresponds to the absolute position on the fingerboard. Vibrato modulations as in the legato mode are also possible in absolute mode. This is not available in switch based systems.
The fingerboard layout shown in
In one preferred embodiment of the invention, the fret spacing for stringed musical instruments may be determined to create evenly spaced musical half-steps along the length of the neck. The distance between frets uses the just musical scale which is proportional to the 12th root of 2. This requirement results in frets at the top of the neck being very wide or further apart and frets at the bottom of the neck being narrower or closer together.
In this design, there is no requirement for any particular fret spacing and it can be entirely controlled by the system software. In accordance with the present invention, fret spacing can be custom designed and configured so as to provide optimal comfort for the player as well as a familiar change from wider to narrower fret spacing.
Uniform spacing is also possible using the invention, but this may be quite uncomfortable for guitar players, partly because of the familiarity with traditional instrument spacing and partly because there is a natural tendency for the musician's hand to rotate as it moves along the length of the neck simply due to the mechanics of the human body. The present invention therefore provides for a spacing that is more ergonomic and “comfortable”, and allows good access to all notes over the full scale of the neck.
In one embodiment of the invention, the difference between standard fret spacing and a constant fret spacing may be split using an equation developed for this purpose.
With reference to
In
The measurement for pressure is done by treating the device as a force sensing resistor. Point E is floated by the electronics and the measurement is done between electrodes C and D. This resistance will vary as the pressure of the user's finger causes more of the area of the electrodes to come into contact with the carbon electrode or strip E.
With referenced to
One preferred response produced by the invention when changing from rest (no touch) to activated (touched) is that the measurement is instantaneous. In real situations, the measured value may vary slightly at the onset or release of the mechanism. Usually a simple quality measurement can be obtained by repeating the measurement and counting the number of repeated samples that fall within a pre-defined range. When the number of repeats is greater than a preset threshold, the measurement is determined to be valid. If the number of repeats could be made arbitrarily long, the system would always be accurate. For practical reasons the number of repeated samples must be limited so that the system responds in a timely fashion.
Error conditions may occur when the user does not keep constant pressure on the fingerboard. There are a few cases when this is particularly apparent:
(a) When a musician is holding a multi-note chord. Towards the end of the chord, the musician will start to reduce pressure on the fingerboard in a non-controlled manner.
(b) If a musician is playing very soft subtle notes, he may not apply good consistent pressure to the fingerboard.
Under these conditions the system may report an error, usually a lower measurement value than expected based on the fret position.
If an event is not executed by the player with precision, during the transitions as the fingerboard makes and breaks contact there can be measurements that are read as lower values than the desired value. This error is usually small, and typically is of a value that is within the range of −1 half-step (i.e. one fret lower).
To maintain a quick response to fingerboard changes, it may not be possible to increase the number of measurements for too long a period of time, so some other method of determining this error condition is needed.
One solution to this situation is to configure the conductive electrode as multiple planes, effectively separating areas of the neck. For this example two separate planes are used as illustrated in
The system can thus correct for these errors. For example, if one is scanning even frets and the resistance is reporting an odd fret (say 3rd fret), it is recognized that this is an error and can safely substitute the measurement and note value that corresponds to the correct fret position (4th fret) for the onset of the note. The value can further be monitored by the system software as the value is corrected after the initial instability.
Note that this method can be extended for even further precision by 3, 4 or any other number of ground planes that are practical for the embodiment.
The system of the present invention is preferably based on conventional membrane switch manufacturing processes and simply has two layers (one conductor, one resistor) that are separated with an adhesive spacer. The spacer not only holds them together, but provides a consistent separation between the conductors allowing them to be activated when pressure is applied. There are no return or bridging conductors needed. All the signals are detected from the return end of the assembly.
In one form of the present invention, pressure is determined using the same set of conductors that are used to determine pitch. As such, the invention can be cost effective and thus designed for high-volume mass production. The system of the present invention can also provide individual pressure readings per string. It also uses the force sensing resistor pattern so as not to need an additional layer for pressure.
In one aspect, the invention describes an interface to MIDI synthesizer (using a conventional MIDI din jack, or USB interface to PC) or to a built in synthesizer.
The force sensing resistor pattern used in accordance with one aspect of the invention in the string sensor provides pressure sensitivity and also provides separate pressure per string. Other constructions only allow for a single pressure reading. Further, the construction of the present invention uses, in one embodiment, a separate embossed fingerboard overlaid on the switch mechanism.
The present invention is generally simple, and may use ink screening processes on two separate substrates that are assembled using an adhesive spacer. There are no “intervening conductor strips” that need to be folded, or any connecting portions. Each conductive or resistive strip is simply terminated in a connector at one end of the fingerboard where all measurements are made. As such, the present invention does not use a folded band and has signal returns at a single end of the sensor.
In one form, the invention uses piezo sensors and short strings for trigger inputs. Using a multiplexer is a standard electronic method and depends only on the hardware embodiment, namely, availability of analog to digital converter channels on the specific hardware chosen.
The invention provides for a pressure sensor based on the force sensing resistor pattern as described above. This does not require any additional layers or materials. A separate layer is used for the string tactile feeling. This may be less expensive and easier to manufacture. In one embodiment, the invention utilizes a polycarbonate overlay that is embossed with both the fret and string features. The “string-like” feel is improved with the implementation of fret features.
This application claims the benefit of U.S. Provisional Patent Applications Nos. 60/976,413 filed Sep. 29, 2007 and 61/011,259 filed Jan. 16, 2008, both of which are incorporated by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
60976413 | Sep 2007 | US | |
61011259 | Jan 2008 | US |