Priority filing of U.S. Provisional Patent No. 61/413,683 filed Nov. 15, 2010 is claimed. Said provisional patent application is hereby incorporated by reference in its entirety into the present disclosure.
For today's experienced musician, an expression pedal such as a wah-wah, volume, (or others that use a rocking type mechanism controlled by the foot), are as common as the music from the 60's where many of these effects were born. Conventional use of the foot or feet by any member of the musician family of artists, in addition to the population of pedal or pad type users (in various industries, activities, games or sports) is well defined. For the musician population, this includes operation of variable electronic controls such as an expression-type pedal used by guitarists, physical type pedals used by percussionists, sustain or organ pedals used by keyboardists, and so on. Other existing uses of the feet include control of one or more pedals activated by on/off switches typically found in a guitarist's pedal board.
These conventional pedals are quite simple to operate between songs, however, for many musicians and especially new users, it can be difficult to coordinate these foot motions while playing an instrument such as an electric guitar due to cognitive overload, especially during complex solos, and most difficult when using a rocking type expression pedal. Instead, the use of foot pressure as the control method has shown to be more natural as an expression of the music rhythm, and can be modulated simply by bending the knees, shifting weight, or stomping the foot. This feature alone opens the pedal market for this invention to the more novice musicians, and offers the user improved balance over a pedal that is fixed in one location. Furthermore, the control profile from pressure of a stomping foot can ramp up and down through the range of control very quickly, which is a motion nearly impossible to duplicate through the use of a conventional expression pedal. This fast attack capability creates the control technique that can be compared to the fast profile of an auto-wah, but now with the ability to control gradually on demand and the motion becomes a part of the performance. As with most music industry pedals, this approach separates the pedal control function from playing the guitar, unlike several recent inventions that integrate the control function with the hands or movement of the guitar only to further complicate operation. These hand-mounted audio effect controllers create conditions where effect modulation interferes with finger picking or strumming. So it is one object of this invention that it is easier to modulate audio effects for both the experienced musician and new users alike over any other existing system.
Another key object of this invention is to provide a method that allows users the freedom of movement about the stage. Conventional musician pedal effects require the performer to stand in one location on stage. Some musicians, for example, Kirk from the band Metallica, use several expression pedals located at different locations on stage for creating the same wah-wah effect offering him different stage positions to engage with the audience. Alternatively, to obtain more freedom of movement, the foot controller in this invention uses a motion sensing device, such as an accelerometer, to monitor foot movement patterns as the method of activating or deactivating audio effects. Because it is critical to ensure this accurate on/off control, foot movement pattern recognition may include use of the foot pressure sensor as well as the ability for the user to select from a set of desired foot movement patterns or even create their own. As there are potentially hundreds of foot movement patterns possible, several specific patterns are disclosed that focus on similarity to conventional controls that allow for ease of learning, ability to distinguish patterns to prevent false triggers, and ease of use by taking advantage of natural body movements. And when using this embodiment to simulate conventional stomp switch audio effects, this same freedom of movement about the stage makes it even easier than a stomp switch because the performer need not look for the pedal. Simply tap the toe of the foot, for example, and the pre-armed pedals are toggled. And for keyboardists who kick the classic sustain pedal out of proper position, this invention again solves this problem so the musician can ignore it and focus on the keyboard or audience. Simply assign or map the controller to any one or more of these MIDI channels or parameters. It's the pedal that goes wherever you go.
During the active state, the foot controller monitors foot pressure and a radio transmits this data to a Base Unit for variable modulation of one or more audio effects either internal to the Base Unit or externally to other audio effects. This way, commands can operated across more than one audio effect and the foot controller can be used to either modulate or activate/deactivate the armed effect or multiple armed effects simultaneously as desired by the user.
A tactile element of this invention, such as a vibration motor, provides user feedback regarding the activation or deactivation process. When combined with pressure modulation control, and made a part of the footwear, there is no longer a need to look for the pedal during a performance thereby allowing the musician to focus more on the instrument or audience.
Many musicians use more than one type of expression pedal, so having one pedal to control all audio effects reduces the overall equipment and setup time needed for a performance. And because the pedal is part of a shoe or insole, then any type of pedal board enclosure would be capable of housing the Base Unit where some expression pedals won't fit. For the professional musician, for example Slash's performance during the 2010 Super Bowl where all the effects were off-stage except his one expression pedal, for the first time they could enjoy a stage that is free from any effects hardware completely.
Even new audio effects can be made available to the live performer, instead of relying on conventional sound crew for mixing. For example, a wide stance of the feet combined with a side to side weight shifting of the performer makes for a natural panning control method that would normally be difficult to synchronize by a second person; again this new control method is based on foot pressure.
In another embodiment, a wireless relay transceiver provides additional range for the performer, and further simplifies the musician's overall setup because it combines conventional wireless instruments with the foot controller using a single Base Unit, whereas, a wireless audio effects controller and a wireless instrument would normally require two Base Units, one for each. This integrated approach has the benefit of reducing power requirements for the foot controller, extends the RF range, and reduces the overall cost for the musician as compared to two systems.
This invention also includes a unique set of criteria for defining new uses for this foot controller invention, including examples where these criteria apply. In the music industry, the original idea was born. On a wider scale, unique criteria for determining the language of foot motion becomes an even more powerful application of this concept in fields such as gaming, manufacturing, medical, sports, or any industry.
The main control element in this invention uses a sensor ( ) capable of sensing variable pressure and is controlled by changes in foot pressure. The sensed pressure is used to wirelessly control one or more parameters of virtually any audio effect. Various locations of this sensor are disclosed, including within the footwear of various styles, in or attached to a removable insole, or even externally attached through quick or more permanent means.
The accelerometer ( ) element monitors foot movement patterns and is analyzed by a microprocessor to provide Master On/Off control. Pressure sensor data in the analysis can help in distinguishing intended control from natural foot movements such as foot tapping, walking, jumping and so on, or to cancel the Master On/Off control command.
The pressure sensing device such as a Force-Sensing Resistor (FSR) or other type pressure sensors, together with the accelerometer are monitored by a microprocessor device in a manner such that foot pressure corresponds to a measurable change in pressure that is read by the microprocessor ( ). This pressure sensor is periodically and frequently sampled by the microprocessor, and the sampled values are transmitted wirelessly, in real-time, to a remote Base Unit for decoding and control of the audio effect, instrument, or MIDI command. Signal conditioning and analysis may be performed either prior to RF transmission in the foot controller or after RF transmission occurs in the Base Unit, or both, for efficiency reasons. Additional functions of the Base Unit that allow for flexibility of use cases will be described, including capability to also send data back to the foot controller for internet updates, modal configuration settings, wake-up signals, user alerts, and so on.
Monitoring the pressure sensing device in this way will result in a smooth reading of pressure change to simulate pedal angle, pedal pressure, parameter knob rotation, or to act as a selection switch related to audio effects or instruments through foot motions disclosed. However, there are undesirable characteristics of an FSR and other sensor types and enclosures, as well as variability from one musician to another (such as the fit of the footwear, user weight, or user habits), that may require calibration to be described in further detail.
The Base Unit is located remotely with all the other effect boxes, integrated with a multi-effects controller, or in systems such as a musician rack. One of the main functions of the Base Unit is to decode the radio transmission to produce a voltage or digital value that corresponds to foot pressure. This signal is then used to either control a digital potentiometer or other voltage or current control type circuit for the desired control of the audio effect. The digital potentiometer offers other options such as to electrically replace worn out potentiometers in older but highly valued pedals.
In another embodiment, the pressure control signal is also used to adjust parameters on external effect boxes either through the use of an external control voltage signal or digital signal, and may include a wireless network between the foot controller and pedals together with their associated parameters. The external audio effect boxes would also have a footswitch or foot sensing device such as capacitive sensor to detect applied surface pressure, and an indicator light for status of the applied control or for status of an armed or disarmed state. Arming means that the desired control parameter of any audio effect is capable of being controlled by a master On/Off control signal generated by user's foot movement pattern. This approach allows for control of multiple effects either independently or simultaneously from one control master signal, and could further be configured for secondary arming capability to modulate a second or any one of a set of audio effect parameters within any audio effects box.
For a more integrated embodiment that makes use of other wireless needs for many musician or vocalists, the foot controller wirelessly communicates with a wireless repeater or Relay Body Pack worn by the performer, which relays this information wirelessly in addition to the audio signals generated by the musician. This embodiment thereby reduces the total number of wireless receivers for both systems from two to one, plus it has the advantage in that the foot controller requires less RF power due to its close proximity to the Relay Body Pack, and is not subjected to as much signal loss due to what would be normally seen without using the Relay Body Pack (as in the case of the performer walking behind objects on stage). The audio effect could also be integrated into the Relay Body Pack so that the resulting audio signal is already modulated before being sent Base Unit, and the Relay Body Pack could manage foot signal conditioning, where power is more abundant than what is practical in the foot controller.
Short vibrations within the shoe from a vibrating motor ( ) provides user feedback for either confirmation of a user control action or to help distinguish user foot commands through independent foot movements of a multi-stage control pattern.
A different embodiment uses the same controller electronics for control of virtual hand-held instruments such as a maraca, tambourine, triangle, cowbell, drums, or any instrument normally used by the hand or hands. The foot embodiment could also be used to operate hand instruments or modulation, and likewise, the hand embodiment could be employed to control foot or feet type instruments or modulation. In the hand-held version the purpose of the sensors would be interchanged so that the pressure sensor would be used to activate or deactivate the audio effect while the accelerometer would be used as the source to convert hand motion to shaker type instrument control. The electronics module within the foot controller could also be made to also fit into the shaker assembly for a dual purpose device.
Finally, the insole embodiment can be mirrored for a left shoe versus the right shoe ( ). In this assembly, a matching blank soul (with limited or no electronics) would be provided so that the left and right shoes would have the same feel. There is optionally a dual soul embodiment that utilizes both left and right foot controllers either independently for separate control use cases or in unison for combining left and right foot motion and pressure data to offer a wider range of control capability over a single sole system.
Sole (1) of
In
Considering other methods of sensing pressure, an electro-mechanical approach may be advantageous. For example, in another embodiment, a resistive gel could suspend a conductive material and change resistance with pressure. As the gel is depressed, its height is changed offering a shorter path for electrons to flow through the medium thereby reducing electrical resistance. This method also offers added comfort for the user. A more rigid but flexible material such as rubber could offer the same properties, and would interface with the electronics using a array of contacts normally used in conventional FSRs. Additional electro-mechanical sensor designs may be suitable due to the low accuracy needed for foot modulation, however other novel methods do not negate the key claim regarding use of a sensor to measure foot pressure for said purpose of control.
In other embodiments, dual pressure sensors could also be employed to monitor the differential pressure between the heel and the toes as an alternate method of control, or could be used to provide more variety of control. For example, a pressure sensor toward the heel could modulate one audio effect or instrument, while a second sensor toward the ball of the foot or toe area could control another. In some circumstances, the pressure sensor toward the heel offers an easier method of providing a control signal such as rhythm, however, the preferred embodiment positions the sensor toward the ball of the foot, or any area of the foot capable of measuring foot pressure when pressure is applied on the ball of the foot and may include the arch area or any location within the footwear that corresponds to foot pressure. As an alternative in another embodiment, with the pressure sensor positioned to detect heel pressure, a reverse function acts as the equivalent to applied pressure forward of the heel. For example, when pressure is applied to the ball of the foot, the heel will experience a loss in pressure and vice versa, assuming there is no additional shift in weight between the left and right feet. This heel location has some advantages over areas toward the front of the shoe because the footwear can be made more rigid and therefore the sensor connection is potentially more reliable.
Use of pressure sensing for modulation of audio effects by itself would likely require the user to enable or disable the audio effect, and the most basic method would be to use existing methods such as an external footswitch or through coordination of a stage crew member. Since the audio effect would clearly benefit from On/Off control at any time and from any location on stage during a song or performance, then it only offers the advantage of using the natural bouncing (bending at the knees) or weight shifting from one foot to the other as the control method as compared to conventional pedals used today by musicians. Even in this basic configuration, it has been shown to be easier to control for the beginner, however, this solution would require constant RF transmission when turned on, thereby demanding more power consumption, as opposed to using RF transmission only when modulation control is needed.
An alternate embodiment would employ one or more external pressure control devices, or a wired sensing pad on the ground. However, this system by itself requires the user to be near the musician's pedal board unless the On/Off control is performed by a separate person, or if the on/off switch device and pressure sensor were made fully mobile for the performer.
One basic embodiment uses an additional pressure sensor or a mechanical switch contained within module 13 of
For the more covert embodiment, the On/Off control technology could be concealed within the footwear. For example, a Flex resistor sensor and a Pressure sensor could be used in combination. The On/Off control would be effectively toggled when the musician raises the heel with the ball of the foot on the ground (causing a Flex resistor change) with foot pressure applied for a brief period to the pressure sensor. This combined motion is meant to simulate the user pressing a more conventional foot switch and therefore might be easier to learn or use. However, this only provides one method for user control, and lab tests show that user foot movement signatures or user habits introduce the potential for false triggers.
For the more casual performer, a barefoot version is introduced that attaches with straps or other securing type devices to secure the controller to the bottom of the foot. For musicians wearing sandals, a relief slot or side tabs of this device aids in a secure alignment with the sandal. High variation in footwear clearly suggests the need for a modular approach to the electronics that can be mounted within the various footwear styles or into various insole sizes or custom designs.
The goal of the On/Off control method is to use simple, easy to learn, but unique movements that are similar in motion as what is normally used to operate today's standard footswitches or pedals. However, better ergonomic or natural motions could improve the user interface experience. Therefore a more versatile method that provides the desired mobility of the user eliminates the Flex sensor and employs an accelerometer (5) or any device capable of measuring acceleration, orientation, or movement, and used in combination with the pressure sensing device (2).
Vibrator motor (6) of
Referring to
In yet another embodiment that uses the Relay Body Pack (35), it may be advantageous to use a low power sole transmitter and a Relay Body Pack (35) such that the Relay Body Pack (35) acts a as a radio repeater to amplify the control signal (without audio) to the Base Unit. This use case may be necessary for practical application to provide acceptable battery life of the sole transmitter for the basic system described earlier. This is included as an additional embodiment because there may be a potential market for a Relay Body Pack (35) system for those users already in possession of a wireless audio system and only wish to add this sole control capability to their existing gear, or if the practical performance of a direct radio transmission to the Base Unit is unacceptable in their stage and RF noise environment. It is further possible that the musician prefers cable-wired audio to the stage electronics or audio amplifier, and only wants to add the sole or foot control system to gain other audio effect control benefits offered by this invention. In this embodiment, the control signal would be processed on a simple, in-line device or Relay Body Pack (35) connection between the instrument and the cable that's connected to their pedal board or amplifier.
This control out signal can also be accomplished via a MIDI interface connector (50) to control other sounds as desired. When configured by software, the pressure sensor can be configured to act as trigger for generating MIDI commands to provide the ability to generate instrument sounds such as a drum beat or the many MIDI voices commonly available. Other connections in
In another embodiment,
A similar embodiment allows for input of the wired control signal into a multi-effect console where it is optionally applied to the desired effect or effects in the same manner described earlier or through the use of a menu system.
In yet another similar embodiment, all Base Unit electronics could be integrated within a multi-effects console to be assigned or activated by either a footswitch or remotely by foot controller activation methods from the idle state as described earlier. In addition, an optional multi-pole switch or a software menu system could include specific assignment of the sole control and further be assigned as a custom composite mix of audio effects in the system's memory for quick stage access. With all of these multi-effect console options described, this embodiment simply adds the foot controller capability of this invention to existing console type systems and features that already exist through either remote wire control or integration of the Base Unit as one compact unit, either on the stage floor, rack, or offstage.
Another embodiment considers the overall design of the footwear such that comfort is not compromised in any way. By making use of the heel space, toe space, the shoe covering, or any other areas of the shoe, boot or sandal, the overall design could be made permanent with the added potential for replaceable components (for example a heel section containing a majority of the electronics that is reused when the shoe is worn). For the sole insert or other embodiments, wear components of the assembly such as the encasement, sensor, electronics module, motor, or battery could all be designed for either user or field replacement by the user or a qualified technician so as to greatly extend the life of the product.
In preliminary testing when using the foot controller as described in this invention to generate MIDI commands for generating a sound, it became apparent that consistent shaking type control is difficult when using the feet. Further, attempts to use peak acceleration (for example, at the instant of contact of the heel with the floor) on only alternate up/down cyclic motions of the heel (to allow for reproduction of the sound produced when the tambourine is hit against the other hand) proved difficult to physically coordinate consistently with the foot. As a result, an improved method of sensing this motion is to mount the electronics (radio, battery, MPU, and accelerometer) inside a ball as a hand held device. This would more closely resemble use of the instrument when shaken with the hand instead of the foot. The other advantage of using a ball is lower cost as compared to footwear. Additional mass of the ball (through the use of heavier materials such as hard rubber or fillers within the molded product, or by making it larger) could allow for even more control for the desired act of shaking in a smooth and regular cyclic motion.
By considering the fact the this invention is actually a pedal that is with the user at all times, this invention can also be applied to other fields, industries, games, or even sports. The key criteria in identifying suitable application are as follows: 1) A pedal that is difficult to locate because of darkness or other environments that make it difficult to locate, 2) A pedal that needs to be used without taking your eyes off the task at hand, 3) A pedal that needs to be used even if the user moves their feet from location to location, 4) A controllable output or sensing that lends itself more to the feet than other conventional controls (such as a gas or brake pedal), 5) A pedal that requires fast monitoring of motion by the user (safety response). Other fundamental criteria could exist, but these are the critical factors used to decide useful application of a foot controller. Another example that satisfies criteria #3 could be used by a surfer such that the pressure on the foot or toe area (no matter where the foot is located on the surfboard) could wirelessly control the rudder (and degree of steering capability) for added control and sharper turns as needed—this same control system could help stabilize the board for a student surfer by turning the rudder toward the unbalanced direction left or right.
With any of the embodiments described herein, analog radio systems could be employed in place of digital. However analog systems are inferior in both reception quality and would likely require added radios within the Relay Body Pack (35) and the Base Unit (20) for integrated systems because of this technology's inability to encode the separate audio signal and the control signal into a single AM transmission. Therefore, digital transmission would be the preferred embodiment. Also, it is assumed that all of these systems use FM type radio modulation as opposed to AM, however, it is possible to achieve similar but lower quality results when using AM. Therefore, FM is the preferred method for all embodiments described in this patent.
These methods of audio effect control, all based on foot pressure and motion, virtually eliminate the need for any pedal type controllers and therefore simplifies the overall system with increased portability. It reduces the amount of gear and space required on stage, and allows for control of multiple effects as selected by the performer which, until now, have not been possible when using independent boxes for each audio effect. Finally, this invention provides the added freedom for the performer to move about the stage while modulating a given audio effect or effects; this introduces a new capability for the performer by integrating their movements with various audio effects as compared to standing still at a fixed location while pressing a pedal.
Consider the following as one out of many possible examples where the overall performance is enhanced. Imagine an audio effect that controls the musician's audio volume from the left side of the stage to the right. The performer could control this left/right panning effect with the sole of the shoe by shifting their weight back and forth while singing or playing an instrument, and all the while keeping the effect in complete sync with the audio rhythm that they produce. Even a professional sound Engineer off-stage would not be able to control the panning as well as the performer themselves. Another audio effect such as an echo delay could respond to the performer's jumping or even running action. In these scenario, as well as numerous others, the combined motion of the performer, when synchronize with the audio, results in a greater stage performance and presence that audiences demand.
As an example of a more versatile embodiment, the foot controller system could be incorporated into a gaming system such as Guitar Hero™ to further simulate the rock star. Training could also be implemented for teaching the use of audio effects when played with musical instruments.
Number | Name | Date | Kind |
---|---|---|---|
4481854 | Dugas | Nov 1984 | A |
4630520 | Bonanno | Dec 1986 | A |
4702141 | Bonanno | Oct 1987 | A |
4852443 | Duncan et al. | Aug 1989 | A |
5105711 | Barnard | Apr 1992 | A |
5147969 | Hiyoshi et al. | Sep 1992 | A |
5245128 | Araiza | Sep 1993 | A |
5323650 | Fullen et al. | Jun 1994 | A |
5471405 | Marsh | Nov 1995 | A |
5475214 | DeFranco et al. | Dec 1995 | A |
5576507 | LaMarra | Nov 1996 | A |
5714706 | Nakada et al. | Feb 1998 | A |
5765300 | Kianka | Jun 1998 | A |
5864083 | Caren | Jan 1999 | A |
5945911 | Healy et al. | Aug 1999 | A |
6410835 | Suzuki et al. | Jun 2002 | B2 |
6441294 | Seli | Aug 2002 | B1 |
6570078 | Ludwig | May 2003 | B2 |
6838610 | de Moraes | Jan 2005 | B2 |
6861582 | Street | Mar 2005 | B2 |
7169998 | Kondo et al. | Jan 2007 | B2 |
7186270 | Elkins | Mar 2007 | B2 |
7191644 | Haselhurst et al. | Mar 2007 | B2 |
7339107 | Remignanti | Mar 2008 | B2 |
7426873 | Kholwadwala et al. | Sep 2008 | B1 |
7528318 | Nishitani et al. | May 2009 | B2 |
7541536 | Daniel | Jun 2009 | B2 |
7569762 | Baum et al. | Aug 2009 | B2 |
7587937 | Haselhurst et al. | Sep 2009 | B2 |
7667129 | Chidlaw et al. | Feb 2010 | B2 |
7771320 | Riley et al. | Aug 2010 | B2 |
7908774 | Mirza et al. | Mar 2011 | B2 |
20030196542 | Harrison, Jr. | Oct 2003 | A1 |
20040044804 | MacFarlane et al. | Mar 2004 | A1 |
20050056142 | Mapleston et al. | Mar 2005 | A1 |
20060278068 | Nielsen et al. | Dec 2006 | A1 |
20070000374 | Clark et al. | Jan 2007 | A1 |
20070169615 | Chidlaw et al. | Jul 2007 | A1 |
20070182545 | Baum et al. | Aug 2007 | A1 |
20070234880 | Adams et al. | Oct 2007 | A1 |
20070240560 | Plamondon | Oct 2007 | A1 |
20070245886 | Adams et al. | Oct 2007 | A1 |
20080258921 | Woo et al. | Oct 2008 | A1 |
20080318679 | Tran et al. | Dec 2008 | A1 |
20100063779 | Schrock et al. | Mar 2010 | A1 |
20100115799 | Welter et al. | May 2010 | A1 |
20110045907 | Villa et al. | Feb 2011 | A1 |
Number | Date | Country | |
---|---|---|---|
20130118340 A1 | May 2013 | US |