Patent Grant
9984668
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. Trademarks are the property of their respective owners.
Effects processors, also called by various names such as pedals or stomp boxes, are commonly used by musicians, especially electric guitarists, bass players and increasingly by vocalists, to modify the sound from their guitar, bass or voice before amplification or within an amplifier's effects loop. Such effects processors can be based on analog or digital signal processing.
Certain illustrative embodiments illustrating organization and method of operation, together with objects and advantages may be best understood by reference to the detailed description that follows taken in conjunction with the accompanying drawings in which:
While this invention is susceptible of embodiment in many different forms, there is shown in the drawings and will herein be described in detail specific embodiments, with the understanding that the present disclosure of such embodiments is to be considered as an example of the principles and not intended to limit the invention to the specific embodiments shown and described. In the description below, like reference numerals are used to describe the same, similar or corresponding parts in the several views of the drawings.
The terms “a” or “an”, as used herein, are defined as one or more than one. The term “plurality”, as used herein, is defined as two or more than two. The term “another”, as used herein, is defined as at least a second or more. The terms “including” and/or “having”, as used herein, are defined as comprising (i.e., open language). The term “coupled”, as used herein, is defined as connected, although not necessarily directly, and not necessarily mechanically. The term “program” or “computer program” or similar terms, as used herein, is defined as a sequence of instructions designed for execution on a one or more computers or a computer system (including systems that use one or more programmable digital signal processors of any suitable architecture). A “program”, or “computer program”, may include a subroutine, a function, a digital filter, a digital signal generator, a procedure, an object method, an object implementation, in an executable application, an applet, a servlet, a source code, an object code, a script, an application, an “App”, a program module, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system. Such programs may rely on data or other program parameters used to alter the operation of the program. A “memory” is any type of electronic storage device such as RAM or ROM or EEROM or disc storage and the term memory encompasses storage devices in any suitable configuration including removable and expandable memory devices.
Reference throughout this document to “one embodiment”, “certain embodiments”, “an embodiment”, “an example” “an implementation”, “certain implementations” or similar terms means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. The term “exemplary” is intended to mean an example and not necessarily a preferred or required example. Thus, the appearances of such phrases or in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments without limitation.
The term “or” as used herein is to be interpreted as an inclusive or (non-exclusive or) meaning any one or any combination. Therefore, “A, B or C” means “any of the following: A; B; C; A and B; A and C; B and C; A, B and C”. An exception to this definition will occur only when a combination of elements, functions, steps or acts are in some way inherently mutually exclusive.
A “musical instrument effects processor” or simply “effects processor” is a device that is used to electronically alter the sound of voice or musical instrument along an electrical chain from the instrument through an amplification or reproduction system. Such devices are also commonly referred to as “stomp boxes”, “pedals”, or simply “effects”. These terms will be used interchangeably herein, and are further intended to include rack mounted equivalents and multiple effect processors that can store and operate to produce multiple serial or parallel effects or “patches” without limitation. Classic examples include distortion and overdrive units, reverb units, delay units, preamplifiers, equalizers, fuzz boxes, flangers, wah wah pedals, compressors, volume pedals, and multi-function pedals. The term “effect” can also be used herein to mean the actual change in sound caused by the effect processor. Many classic effect processor devices utilize analog technology but many such devices are now commonly produced using digital signal processors (DSP) as defined below. While many analog effects have become “gold standards” in the music industry in terms of their particular audio characteristics, the ability to process in the digital domain can have many advantages over processing signals in the analog domain, and as more powerful processing at higher sampling rates is used, the quality of the sound produced by digital processors is now rivaling and in many respects surpassing that of many classic analog pedals. Such pedals are most popular with electric guitarists and electric bass guitarists, but can be used with other instruments and even with vocals.
In the present discussion, the effect processor is depicted as operating in a monaural mode, but those skilled in the art will appreciate that implementations that utilize stereo or other multiple channel effects are also possible and contemplated hereby, with the illustration being simplified by depicting only a single channel. Additionally, the present description depicts one or more digital signal processors operating to carry out the digital effects. The term “digital signal processor” is intended to mean both plural and singular and includes not only commercially available or proprietary DSP circuits, but also any circuit configured to process a signal in a manner that can be programmed to cause musical effects including devices that carry out digital filtering, signal generation, pitch shifting, time stretching, time compression, amplitude compression, envelope processing, phase shifting, pitch detection, pitch correction, signal synthesis, signal alteration, (effects) etc. without limitation. Such effects have been programmed and commercialized by various manufacturers under product or company names such as DigiTech™, Zoom™, TC Electronic™, Line 6™, Vox™, Boss™, Roland™, Electro Harmonix™ and others.
A “hand held computer” is intended to mean a smartphone such as Apple Computer Corporation's IPhone® or other smartphone such as those that operate on the Google's Android® operating system or other operating system, or a tablet computer such as Apple Computer Corporation's IPad® or other tablet computers such as those based on Google's Android operating system, or other small computerized devices that can be readily held in the hand and carried about. While preferred devices as described herein utilize such hand-held computers, other implementations can utilize self contained effects devices or can operate in cooperation with personal computers. Use of the term “tablet” or “smartphone” the like as a specific example herein is not intended to be anything other than a shorthand nomenclature for the full array of such devices and is thus not intended to be limiting over other devices that can serve in a similar capacity for purposes of realizing implementations consistent with the present teachings.
In the marketplace, several manufacturers such as some of those noted above are at this writing providing digital effects processors based on one or more DSPs that can be programmed or personalized with downloadable data and/or programs and/or “patches” (downloadable to the digital effects processor) to create a desired effect or modify or establish the personality of a particular effect. Such effects are based upon several commercially available DSP circuits such as the proprietary AudioDNA2™ processor or various commercially available DSPs from manufacturers such as Freescale or Texas Instruments to name but a few. Some products utilize COSM™ (composite object sound modeling) while others use other technologies to achieve the desired digital signal processing effects. Several different architectures are used within available DSPs including, but not limited to reduced instruction set computer (RISC) processors, Harvard architecture, modified Harvard architecture, Von Newman, and combinations of the above.
Notably, in the marketplace a DigiTech™ product known and commercially avialable as IStomp™ (Trademarks of Harman International) utilizes Apple Computer products such as the IPad® or IPhone® that run an App called Stomp Shop™ as an intermediary for purchase, configuring to some degree (i.e. color of an LED on the stomp box) and download of various effect personalities that can then be loaded into the IStomp generic musical instrument effects processor. The iStomp then takes on a digital rendition of the effect of a particular stomp box whose digital equivalent program is downloaded thereto in order to assume a changeable personality.
Often such digital musical instrument effect processors are based upon digital simulation of classic analog devices or upon preset effect configurations representing a particular artist and/or song. In other cases, the effect being provided by the musical instrument effect processor is simply a digital rendition of commonly available effects such as distortion, overdrive, fuzz, phaser, flanger, echo, reverb, chorus, amplification, envelope processing, etc. that is designed specifically for a particular effect processor. In accord with certain implementations consistent with the present teachings, entirely new effects can be readily created by a musician without need for programming knowledge. Such effects can be generated, by way of example and not limitation, by capturing a sample of an audio sound using the microphone already forming a part of a smartphone (or tablet or the like) (or in other implementations part of the stomp box or connectable thereto, or as a separate input to the hand held computer or stomp box). An App, for example, residing within the smartphone then processes the captured sample of audio to extract any basic (or more complex) characteristics of the audio sample. Such characteristics might include frequency spectrum relative to a fundamental, in one example, or an actual sample in another example. These characteristics can then be downloaded to a musical instrument effects processor (stompbox) for use in “coloring” the sound of a musical instrument connected to an audio system through the effects processor. This can be accomplished in configurations where the smartphone or tablet or the like is used only as a conveyance to the effects processor and then decoupled, or in which the smartphone or tablet or the like remains connected to the effects processor and operates in any suitable manner in cooperation with the effects processor. Other variations are also disclosed.
In one simple example, a frequency analysis can be used to extract the fundamental frequency of a sample of audio, and the relative amplitude and phase of the harmonic components of the sample of audio can also be captured. A representation of this information can be ported to a stompbox's digital signal processor so that the stompbox can modify an incoming instrument signal with some (any) attribute of the originally captured sample of audio in order to color the instrument signal. At the stompbox, the fundamental frequency of the sampled signal can be mapped to that of the input signal (e.g., using technology similar to that used in DSPs for pitch shifting) so as to generate harmonic content relative to the input signal that resembles that of the sample of the audio signal. In this manner, the output of the effects processor resembles the sound of the captured signal. In one example, the processing, at least in part, can involve use of a look-up table that maps input amplitude to output amplitude as but one example of processing.
For example if the sound that is captured and sampled is that of a human voice singing a single note, the output signal can be manipulated using digital signal processing to have certain characteristics resembling the voice that is sampled (e.g, matching of certain harmonic content). While it is possible, with intensive and accurate enough analysis of the input audio sample, to produce an output of the effects processor that will very closely resemble the characteristics of the input audio sample, reaching this level of accuracy may require more complex signal analysis than those used to produce simpler effects processing. While each is possible, it is also possible to achieve interesting, amusing, unique, musical and useful effects without the present teachings being constrained to any standard of near perfection in modeling of the input sound, and nothing herein is intended to imply that near perfect modeling of the signal that is sampled is required for certain implementations so long as a characteristic of the signal that is sampled is used to modify the input signal, e.g., from an instrument such as a guitar.
In another example, generation of a particular set of harmonics to an input signal can be used to relatively accurately capture the essence of a sound. For example, if a sound has a spectrum of a square wave, this can be produced from a sine wave input by generation of a known set of harmonics with a particular phase and amplitude relationship to the primary frequency components of an input signal, so that if the sound contains those harmonics, the effects processor output may be a close approximation without need for the analysis to be overly complex. This processing is similar to that currently used to produce distortion and fuzz effects in certain DSP based stomp boxes.
Other sounds that have distinctive attack, decay and amplitude envelope or phase envelope properties may suggest that accurate replication may be more complex and utilize more sophisticated signal analysis. Such is also contemplated within the scope of the present teachings.
In another simple example as will be discussed further, the tablet or similar device can be used to capture a sample (either using an internal or connected microphone, or by editing a sound file or using another microphone input) that is loaded as a sound sample to the musical instrument effects processor. Once this sample is stored, it can be pitch shifted and played back at the pitch of an incoming instrument signal when a new note is detected or an attack that is generally associated with plucking or sounding a new note is detected. The playback can be a single repetition of the sample, stretched or compressed versions of the sample, repeating copies of the sample or continuously repeating copies that are strung together or stretched without interruption. The playback can either be a direct playback without volume manipulation, or the volume (amplitude) can track an amplitude envelope of the amplitude of the input signal being converted, for example. Echo and reverb effects can also be produced by use of delayed playback of the samples or outputs with decaying amplitude. Those skilled in the art will envision many variations upon consideration of the present teachings.
While the present discussion in certain embodiments focuses on use of conversion to the frequency domain to process the sampled audio and generate a characterization of the spectrum of the audio sample to color the audio at the effects processor, those skilled in the art will recognize that other types of analysis can also be utilized (e.g., time domain analysis, wavelet domain analysis or combinations of the above. Those skilled in the art will appreciate that time domain manipulation of the audio signals is often more readily realized in the time domain and nothing discussed herein is intended to exclude such time domain analysis.).
In various implementations, the musical instrument effects processor can be configured to modify electrical representations of input audio signals by playback of the at least the portion of the audio sample, or by pitch shifting the digital copy of the captured sample of the audio sound, or by generation of harmonics of a fundamental frequency of the input signal, or by detecting a pitch of the input audio signal and modifying the input audio signal using pitch shifted versions of the captured sample of the audio sound. In other implementations, the musical instrument effects processor can be configured to modify electrical representations of input audio signals by filtering the electrical representation of the input audio signals at a pitch shifted version of a spectrum derived from the captured sample of the audio sound. For example, the input sample can be analyzed with a FFT to determine spectral content and digital filter weighting factors can be derived from this spectrum for use in digital filtering in the effects processor. Many variations will occur to those skilled in the art upon consideration of the present teachings, and these variations can be achieved without need for a musician to directly program a DSP.
In certain illustrative examples, the processing carried out is done in the frequency domain. However, in many instances, manipulation of an audio signal is much faster and more easily realized in the time or wave domain. Hence, although certain of the present examples are depicted in the frequency domain, those skilled in the art will appreciate that any extraction of DSP parameters are consistent with the present teachings without regard for how those DSP parameters are extracted from the audio used as an input sound as will be depicted below. That is, the present teachings are not limited to use of frequency domain signal processing as depicted in the illustrated examples.
Turning now to
Stomp box effects processor 116 is depicted as having a set of variable controls 124 that act as potentiometers (e.g., controlling volume, tone, bass, treble, gain, intensity of effect, blend with unprocessed input, truncation of harmonics, number of repeats, decay properties, etc.) or effect controls such as switches as well as one or more (one shown) switches 128 which may be used to actuate and de-actuate (e.g., with either true bypassing or with buffering) an effect and may also be a multi-function switch which can be used to establish a tap tempo for effects that allow the user to dynamically alter a rhythm of an effect such as an echo or slap-back or other effect with a speed parameter. Other user interface controls such as an LED or other light that depicts a mode of operation, touchpad controls, switches, knobs or other switch and control configurations can be used to establish a desired user interface as desired. The stomp box 116 can be connected to a musical instrument such as a guitar 132 (or microphone or other musical instrument) whose output signal serves as an input to the stomp box 116 and passes through stomp box 116 for processing into an output signal that then proceeds eventually to an amplifier 136 for reproduction. It is noted that multiple such effects processors 116 may be configured in series or parallel as desired for a particular sound. In other implementations, the user may prefer to connect stomp box 116 into an effects loop if one is provided by the amplifier; and in many instances multiple effects processors may be connected in series either as a single multi-effects processor or as multiple stomp boxes.
Smartphone 104 (or tablet, etc.) can carry out any of several operations as contemplated by certain implementations consistent with the present teachings. In a first example implementation, the process depicted in
The stored sample of sound 108, as processed by FFT 152 can further be used at 160 to extract the non-fundamental frequencies in the spectrum of the stored sound. These non-fundamental components are additive to the fundamental (with appropriate correction for phase shifts) to the fundamental in order to characterize the stored digitized version of the input sound 108. Once the relative magnitudes and phases of the various harmonics and other frequency components of the fundamental are characterized by the FFT analysis as is generally described above, a set of parameters for use in processing by one or more digital signal processors DSPs residing within the effects processor 116 can be extracted at 164 from the FFT analysis and these parameters can be stored at 168 (e.g., to a library of effects either at the effects processor 116, the smartphone 104 or in a storage device that can be accessed by the effects processor to change its personality) which can be named or assigned metadata or an icon or all of the above for later retrieval and loading into the effects processor 116. In one example, these parameters can be the information that is required by the processor 116 to carry out pitch shifting, filtering, an inverse FFT at a pitch shifted frequency corresponding to an input signal or other function to the processor 116.
Once stored by the App residing on smartphone 104, this set of parameters can be retrieved and downloaded at 172 by user interaction from a user interface provided by the App residing within the smartphone 104 to the effect processor 116. Those skilled in the art will appreciate that while not explicitly shown, the effects processor 116 can blend the signal from the instrument 132 in “dry” form with the processed signal in “wet” form together in any proportion (e.g., under user control) in order to provide additional shaping of the effect or preservation of a component of the original signal from the instrument 132 at the effect processor output. Moreover, the wet form can be modified so as to track a time domain amplitude envelope of the dry signal. Other controls can be provided for truncation of frequency components, tone control, output level, or other variations will occur to those skilled in the art upon consideration of the present teachings.
The above process of generation of the DSP parameters is depicted in the frequency domain utilizing a FFT to extract frequency characteristics and a phase analysis can be carried out in cooperation with the FFT analysis in order to determine the phase relationship between the fundamental and non-fundamental frequencies if desired. When these DSP parameters are loaded into the effect processor 116, the input signal from instrument 132 is automatically shaped in order to produce an output sound. In this example the output sound can have a spectrum with component characteristics resembling the spectrum of the sound 108 as described. In one example, this can be accomplished using an inverse FFT to regenerate signals at a frequency obtained by analysis of the input signal from instrument 132 to obtain its fundamental frequency and then generate an inverse FFT at a pitch shifted frequency corresponding to a fundamental of the input signal from instrument 132. Similarly pitch shifted versions of other harmonics of the input signal from instrument 132 can also be similarly altered. In addition, controls 124 can be configured to carry out various functions including truncation of the number of harmonics added or processed, blend with dry signal, output level, tone, etc. Other variations are also possible so long as some (any) characteristic obtained from the sampled sound 108 is used to modify the signal from instrument 132 in any manner. In the present discussion, the speed of calculation of an FFT or inverse FFT can be enhanced by truncation of certain components such as by omission of the higher order components in certain implementations if desired as previously mentioned.
Those skilled in the art will also appreciate upon consideration of the present teachings that the effects processor 116 may be embedded within either the guitar 132 or other musical instrument (including a microphone for vocal applications) or within the amplifier 136, with suitable access by the user to activate and deactivate and control the effect.
This process is depicted in block diagram form in
In one non-limiting example, the DSP parameters may define the spectral content of the input sample, which can then be replicated at a pitch shifted frequency with a matching attack and decay envelope. Other variations are also possible.
As noted above, the DSP parameters are downloaded (if the embodiment calls for downloading or porting) to the effects processor 116. The process from the perspective of the effects processor is generally depicted in
It should be noted that certain implementations described herein utilize the processor within the smartphone 106 or similar device to carry out an analysis and generation of DSP parameters, it is also possible to port a digital version of the audio sample of sound 108 to the musical instrument effects processor 116 where the audio sample can be analyzed and DSP processing parameters can be derived from the sample using the processing power of the musical instrument effects processor 116. Other data including program instructions for execution by the DSP may be ported from smartphone 106 to the processor 116 so that the processor 116 understands how to analyze and produce DSP parameters and/or use the parameters once generated. Many variations are contemplated and it is to be emphasized that the actual pre-processing in preparation for near real time manipulation of the signal from instrument 132 can be carried out on the smartphone 106, processor 116 or a remote processor via a network such as the Internet without limitation.
The process described above using an illustration of the frequency spectrum of an input signal that can be analyzed to produce an effect at effects processor is depicted in the frequency domain in
In
Referring now to
It is further noted that in this example, the wired interconnection between the smartphone 104 and the musical instrument effects processor has been depicted as a wireless connection 330 such as a BlueTooth™ or infrared wireless connection or near field communication connection or any other suitable wireless connection. Any such mechanism for interconnection can be used with any embodiment consistent with the present teachings. So, in certain implementations, a hand held computer has a set of parameters for use by a musical instrument effects processor. A wired or wireless interface can be used to communicate the parameters to the musical instrument effects processor.
A simple illustration of one process consistent with that depicted in
Referring now to
The process depicted above in
When a signal is received from instrument 132 as an input signal at 380, the input signal is analyzed to determine if its “attack” is to be interpreted as a new note (e.g., plucking of a pick or change in fundamental frequency) at 384. If so, a new note has been identified at 388 and the process proceeds to 392 where the stored sample is pitch shifted to a note compatible with the input signal's fundamental frequency. At 396, the pitch shifted sample is played back until a new note is identified at 384 and 388. The playback can be at constant amplitude, or the sample's amplitude can be varied to follow an amplitude or other envelope of the original input signal, or can be made to swell or decay in any suitable manner that can be envisioned by those skilled in the art upon consideration of the present teachings.
Referring now to
With reference to
In one example implementation depicted in the flow chart portion at the rightmost side of
An example of a smartphone 104 (or similar device) as used in connection with certain illustrative embodiments is depicted in
On instruction from the user via user interface 516, the appropriate programming and DSP parameters stored in memory and storage device 518 can be transferred via any suitable data interface 530 in the manner previously described using any suitable protocol. In the case that device 104 is a smartphone it will further include other circuitry such as wireless telephone circuitry 534 operating in conjunction with a radio frequency antenna 538. In the case of a tablet computer or the like, other support circuitry not shown may be present and configured in any suitable manner in order to operate as a tablet computer, e-reader or the like.
The musical instrument effect processor 116, in one illustrative example implementation is depicted in
Depending upon the architecture of the DSP(s) the memory may be configured in a variety of ways and as depicted utilizes one portion of memory/storage 570 for programming and the other portion of memory 574 as data memory/storage (as is typical of Harvard architecture), but other configurations can also be used depending upon the DSP hardware configuration. Any suitable configuration of hardware can be arranged to provide the DSP memory, and such memory can include removable memory for changes in personality of the effects processor 116.
Also depicted is a processor or microcontroller 580 which may be configured as a part of the DSP(s) 550 or as a separate processor that oversees operation of the musical instrument effect processor 116. Processor 580 may utilize its own memory/storage or area of memory/storage depicted separately for convenience as 584. The musical instrument effect processor 116 has a user interface 588 previously depicted as having switches and potentiometers such as 124 and 128, but which may also include other controls such as displays, light emitting diodes or other controls as will be appreciated by those skilled in the art in light of the present teachings. In the architecture depicted in
While not explicitly shown for ease of illustration, when an effect processor 116 is disengaged from the signal chain, it generally provides a path for the dry signal that can either be a true bypass that actually bypasses all circuitry, or uses a buffer amplifier with a gain approximating one with, for example, a low impedance output to drive subsequent effects in the signal chain. Those skilled in the art will appreciate that these elements or similar would be included in such an effects processor 116.
Many variations are possible in implementing the present teachings. Several are generally depicted in
Another variation is depicted in
In an analogous implementation, the effect processor can form a part of a vocal microphone that is used by a singer and can be used to engage an effect during a performance at will without having to be located at a particular point on a stage for access to a control or without having to rely on a sound technician to engage or disengage an effect at a particular time.
One or more switches 608 may be provided to either turn the microphone on or off, or when the microphone is used in a manner discussed later, the microphone may contain its own effects processor such that the effects processor is cut in or out by use of a switch such as 608. In the example shown, switch 608 forms a part of the microphone housing and is intended to be but one depiction of one or more switches or other controls.
In another illustrative example as depicted in
The above alternative examples give rise to the processes depicted in
A second alternative implementation is depicted in the example flow chart 730 of
It will be appreciated by one skilled in the art upon consideration of the present teachings that the musical instrument effects processor 116 can be implemented as a part of the musical instrument amplifier 136 or as a part of the musical instrument such as guitar 132 or any other musical instrument. In this manner, the effect can be turned on or off by use of a switch either mounted on the guitar or other instrument 132 or coupled thereto; a switch coupled to, forming a part of or connected to the musical instrument amplifier 136, or embedded within a microphone housing of a microphone such as 606 without limitation. In addition, while the effects discussed herein can be generated as a result of capture of a sound as discussed extensively, this does not preclude the effects processor 116 from being utilized to generate other effects. For example, an effects processor such as 116 can be embedded within microphone 606 (e.g., a pitch corrector, a reverb effect, or a harmony generator) that can be switched on by the user at will by use of a simple electromechanical switch or by use of any suitable sort of remote controller. While such a microphone might have a form factor resembling that of microphone 606, the depiction in
When the microphone contains its own effects processor, the present teachings are not intended to limit such an effects processor to a digital signal processing based effects processor since analog effects can be implemented within a microphone housing and switched on or off at will. This is especially easy to realize in microphones that utilize phantom power that is supplied externally to the microphone or when the microphone is a wireless microphone that utilizes a battery to power the microphone, which can also power the effect. Moreover, the microphone housing for a wireless microphone can be considered to include a transmitter housing normally used in conjunction with such microphone (e.g., a transmitter that is attached to a belt or the like.) Similarly, the DSP based effects processor 116 can incorporate analog signal processing along with the DSP if desired without limitation.
Now consider the example of a microphone having an embedded DSP, one example of which is depicted in
When a vocal performer is performing, often the performer is dancing or otherwise moving about the stage. If a vocal effect is to be turned on or off, it may require that the vocal performer position himself or herself at a stage position that enables access to a switch for an effect, thereby limiting the choreography. Otherwise, the performer will often have to depend upon a sound technician to make the switch—limiting the ability to improvise with both vocals and with choreography. By placing the control within the easy reach by integration with the microphone housing (or an attached transmitter in the case of a wireless microphone) the vocal performer can take full control of the performance both from a choreography perspective and an effect enable/disable perspective. While the present illustration depicts a hand-held microphone, for purposes of this discussion, in the case of a wireless microphone having a transceiver that is worn on the body, the DSP and associated circuitry could be situated equivalently within a housing for the transmitter, and any user interface can either directly form a part of the transmitter housing or may be connected to the transmitter in a manner that permits the user to make the switching (e.g., by placing the switching on the hand held microphone or by providing separate switching that can be easily accessed by the performer).
Referring to
Referring now to
Referring now to
In each implementation depicted above, the concept of capturing a sound 108 using the microphone can be implemented and the processing to produce DSP parameters can be either carried out at the DSP or by various communication mechanisms with either a smart phone, a tablet or other hand held computer, or via a server on the Internet or using any of the other techniques described. Moreover, the DSP can also accept programming to carry out more conventional effects such as harmonization, pitch correction, equalization, reverb, echo, etc. that can be separately programmed in any suitable manner without limitation.
It will be appreciated that amplifier 810 may not be necessary in some implementations, but provides a broader range of amplitudes from the cartridge from which the digitized version of the audio can be processed. Similarly, it will be evident that if a digital output is desired, there is no need for the D/A converter 820, but it can either be used when needed or not included at all depending upon the application. Many other variations will occur to those skilled in the art upon consideration of the present teachings including omission of either the interface 842 or the flash memory card 846 or both if one wishes to produce a microphone with one or more predefined special effects, or use the techniques discussed above to create an effect from a sound 108 captured by the microphone. Many other variations are possible.
Referring now to
The processing that follows is intended as an illustrative example of the effects parameters that a user might be able to select from in order to customize the effect desired. Other variations are possible, with the present example serving merely as an illustration. The user selects an effect from the menu at 910 and if effect A is selected, the process proceeds to 912 where the intensity of the effect can be varied. At 916 a blending of the effect with a dry signal is selected and an effects number or name (or song name) to be displayed on a microphone display for ready reference is selected at 920. At 924, the desired effect is downloaded to the microphone's flash memory and the results can be tested at 928. The process returns for refinement or for use of the microphone at 932.
If on the other hand, an echo effect is desired and B is selected, a user might select a number of echos at 936, a repetition rate at 940 and a decay rate at 942 before passing control to 916 for processing as previously described.
If C is selected, a pitch shifting function might be selected in order to shift the vocalist's pitch or contribute a harmonic to the pitch or pitch correct based on a standard (for example). In this case, at 946 pitch shifting characteristics can be set (e.g., pitch standard such as A—440 hz, key or mode of a harmony, etc.) and then delay characteristics for harmonies might be selected at 950 before passing control to 916 for further processing as previously described. These examples A, B and C are provided as merely illustrative of one technique for loading and manipulating various effects, but others will occur to those skilled in the art upon consideration of the present teaching, and these examples are not intended to be limiting in any manner.
It is to be carefully noted that several techniques have been illustrated that depict various mechanisms for capturing a sample of sound and using that sound sample as a pattern (e.g., in the frequency or time domain) to color or otherwise modify an input signal from a musical instrument. However, these examples are only intended to be illustrative of the many things that can be done using digital signal processing to extract features from a sound and modify a musical instrument (or voice) using a characteristic extracted from that initial sound. The possibilities of how the initially captured sound can be used to generate DSP parameters to modify an input to the musical instrument effects processor and produce an output therefrom are limitless. Each such method of analysis of the original sound for purposes of later modifying an incoming instrument signal can be arranged as its own freestanding App for use by the smartphone, tablet, etc. Many such variations will occur to those skilled in the art upon consideration of the present teachings.
Thus, a device consistent with certain implementations discussed herein have a microphone that is configured to receive audio signals and create an electrical representation of the audio signal. An analog to digital converter converts the electrical representation of the audio signal into a digitized sample of the audio signal. A processor is adapted to perform an analysis of the digitized sample of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom. The processor is configured to carry out a process that creates a set of digital signal processing parameters that, when loaded into one or more digital signal processors, process an input signal by altering the input signal using the digital signal processing parameters. An interface is configured to transport the digital signal processing parameters to a musical instrument effects processor.
In certain implementations, the digital signal processing parameters are arranged to cause generation of non-fundamental frequencies associated with a fundamental frequency of an input signal in the effects processor. In certain implementations, the processor is further configured to identify a fundamental frequency of the digitized sample of the audio signal. In certain implementations, the processor is further configured to identify a relative level of non-fundamental frequencies of the digitized sample of the audio signal. In certain implementations, the device is embodied in at least one of a tablet computer and a smartphone.
In certain implementations, the processor is accessed by the device via a network connection or the processor may reside in the musical instrument effects processor. In certain implementations, the digital signal processing parameters are arranged to cause generation of non-fundamental frequencies associated with a fundamental frequency of an input signal in the effects processor. In certain implementations, the digital signal processing parameters are arranged to cause the electrical representations of input audio signals to be modified by playback of the at least the portion of the sample of the audio signal. In certain implementations, the digital signal processing parameters are arranged to cause the electrical representations of input audio signals to be augmented by a pitch shifted version of the digital copy of the sample of the audio signal. In certain implementations, the digital signal processing parameters are arranged to cause the electrical representations of input audio signals to be modified by generation of harmonics of a fundamental frequency of the input signal. In certain implementations, the digital signal processing parameters are arranged to cause the electrical representations of input audio signals to be modified by detecting a pitch of the input audio signal and modifying the input audio signal using pitch shifted versions of the sample of the audio signal. In certain implementations, the digital signal processing parameters are arranged to cause the electrical representations of input audio signals to be filtered at a pitch shifted version of a spectrum derived from the sample of the audio signal.
A method of creating an electronic audio effect involves capturing a sample of an audible sound; analyzing the sample of audible sound to extract at least one characteristic of the audible sound; and porting the at least one extracted characteristic of the audible sound to a digital signal processor residing in a musical instrument effects processor via a data interface so as to configure the musical instrument effects processor to modify electrical representations of input audio signals using the extracted characteristics to create the electronic audio effect.
In certain implementations, at least one extracted characteristic comprises a digital copy of at least a portion of the sample of audio. In certain implementations, the musical instrument effects processor is configured to modify electrical representations of input audio signals by playback of the at least the portion of the audio sample. In certain implementations, the musical instrument effects processor is configured to modify electrical representations of input audio signals by pitch shifting the digital copy of the captured sample of the audio sound. In certain implementations, the musical instrument effects processor is configured to modify electrical representations of input audio signals by generation of harmonics of a fundamental frequency of the input signal. In certain implementations, the musical instrument effects processor is configured to modify electrical representations of input audio signals by detecting a pitch of the input audio signal and modifying the input audio signal using pitch shifted versions of the captured sample of the audio sound. In certain implementations, the musical instrument effects processor is configured to modify electrical representations of input audio signals filtering the electrical representation of the input audio signals at a pitch shifted version of a spectrum derived from the captured sample of the audio sound.
Another device has a microphone that is configured to receive audio signals and create an electrical representation of the audio signal. An analog to digital converter converts the electrical representation of the audio signal into a digitized sample of the audio signal. A processor is adapted to perform an analysis of the digitized sample of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom. The processor is configured to carry out a process that: identifies a fundamental frequency of the digitized sample of the audio signal, identifies a relative level of non-fundamental frequencies of the digitized sample of the audio signal, and creates a set of digital signal processing parameters that, when loaded into a digital signal processor, process an input signal by generation of relative non-fundamental frequencies associated with a fundamental frequencies of the input signal. An interface is configured to transport the digital signal processing parameters to a musical instrument effects processor.
A musical instrument effects processor consistent with certain implementations has an interface that is configured to receive digital signal processing parameters from a hand-held computer. The digital signal processing parameters are derived from audio information captured by a microphone forming a part of the hand-held computer. One or more digital signal processors are provided along with an audio input to the musical instrument effects processor configured to receive audio signals from a musical instrument. The one or more digital signal processors are configured to modify signals received at the audio input to produce audio output signals. An audio output coupled to the one or more digital signal processors that is configured to provide the audio output signals as an output.
In certain implementations, the digital signal processing parameters comprise a digital copy of at least a portion of the sample of audio. In certain implementations, the processing comprises pitch shifting the digital copy of the sample of audio. In certain implementations, the processing comprises generation of harmonics of a fundamental frequency of the input signal. In certain implementations, the processing comprises detecting a pitch of the input signal and modifying the input signal using pitch shifted versions of a signal produced using the stored digital signal processing parameters.
Another device consistent with the present teachings has a microphone or other input that is configured to receive audio signals and create an electrical representation of the audio signal. A signal processor is adapted to perform an analysis of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom. An interface is configured to transport the digital signal processor parameters to a musical instrument effects processor.
In certain implementations, the digital signal processing parameters comprise a digital copy of at least a portion of the sample of audio. In certain implementations, the processing comprises pitch shifting the digital copy of the sample of audio. In certain implementations, the processing comprises generation of harmonics of a fundamental frequency of the input signal. In certain implementations, the processing comprises detecting a pitch of the input signal and modifying the input signal using pitch shifted versions of a signal produced using the stored digital signal processing parameters.
A method consistent with certain of the present teachings involves capturing a sample of audio at a hand held computer device; generating stored digital signal processing parameters from the sample of audio; storing the digital signal processing parameters; and processing an input signal from an electrical musical instrument using a digital signal processor that modifies the input signal using the stored digital signal processing parameters.
In certain implementations, the digital signal processing parameters are transferred from the hand held computer device to a musical instrument effect processor that carries out the processing via an interface, and where the interface comprises a wireless interface. In certain implementations, the digital signal processing parameters comprise a digital copy of at least a portion of the sample of audio. In certain implementations, the processing comprises pitch shifting the digital copy of the sample of audio. In certain implementations, the processing comprises generation of harmonics of a fundamental frequency of the input signal. In certain implementations, the processing comprises detecting a pitch of the input signal and modifying the input signal using pitch shifted versions of a signal produced using the stored digital signal processing parameters.
Another method consistent with certain of the present teachings involves capturing a sample of audio at either a hand held computer device such as a tablet, smartphone or even by a microphone forming a part of or connected to an effects processor; generating stored digital signal processing parameters from the sample of audio, where this generating can be carried out at the hand held computer device, tablet, smartphone, effects processor or even via a remote connected server connected to either the effects processor or to the hand held device (tablet, smartphone, etc.); storing the digital signal processing parameters at the effects processor; and processing an input signal from an electrical musical instrument using a digital signal processor that modifies the input signal using the stored digital signal processing parameters.
Another method involves capturing an audio sound at a hand held computing device; extracting a characteristic from the audio sound; and programming one or more digital signal processors in a musical instrument effects processor to modify an input signal to the musical instrument effects processor using the extracted characteristic.
In certain implementations, the digital signal processing parameters are transferred from the hand held computer device to a musical instrument effect processor that carries out the processing via an interface, and where the interface comprises a wireless interface. In certain implementations, the characteristic comprises a digital representation of a least a sample of the audio sound. In certain implementations, the programming includes instructions that cause pitch shifting the digital copy of the sample of audio. In certain implementations, the programming comprises processing comprises instructions to generate harmonics of a fundamental frequency of the input signal. In certain implementations, the programming comprises instructions that detect a pitch of the input signal and modify the input signal using pitch shifted versions of a signal produced using the stored digital signal processing parameters.
A non-transitory computer readable storage device storing instructions that when executed on one or more programmed processors carry out a process that receives a digital representation of an audio signal received by a microphone forming a part of a portable computing device; performs an analysis of the digitized sample of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom; and configures an interface to transport the digital signal processing parameters to a musical instrument effects processor.
In certain implementations, a fundamental frequency of the digitized sample of the audio signal is obtained, for example using an FFT. In certain implementations, a relative level of non-fundamental frequencies of the digitized sample of the audio signal is identified. In certain implementations, the one or more processors to create a set of digital signal processing parameters that, when loaded into a digital signal processor, process an input signal by generation of relative non-fundamental frequencies associated with a fundamental frequency of the input signal, for example using an inverse FFT that is pitch shifted. In certain implementations, a pitch shifted version of the digital representation of the audio signal is created.
A device has a microphone or other input that is configured to receive audio signals and create an electrical representation of the audio signal. An analog to digital converter converts the electrical representation of the audio signal into a digitized sample of the audio signal. A programmed processor is adapted to perform an analysis of the digitized sample of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom. The signal processor is configured to carry out a process that: identifies a fundamental frequency of the digitized sample of the audio signal, identifies a relative level of non-fundamental frequency components of the digitized sample of the audio signal, and creates a set of digital signal processing parameters that, when loaded into a digital signal processor, process an input signal by generation of relative non-fundamental frequencies associated with a fundamental frequencies of the input signal. An interface that is configured to transport the digital signal processing parameters to a musical instrument effects processor.
In certain implementations, the DSP parameters may not need to be ported external to the device if the device carries out the DSP processing itself. In any of the disclosed implementations, device or method, the various data interfaces can be wired or wireless interfaces.
Another device has a microphone or input that is configured to receive audio signals and create an electrical representation of the audio signal. An interface is configured to transport the electrical representation of the audio signal (e.g., in digitized form) to a musical instrument effects processor. A signal processor (e.g., in the effects processor) is adapted to perform an analysis of the audio signal to extract signal characteristics of the audio signal and to generate digital signal processor parameters therefrom. These DSP parameters can then be used to modify an input signal to the musical instrument effects processor and produce an output therefrom.
In certain implementations consistent herewith, a microphone has a microphone housing containing a microphone element. An effects processor resides within the microphone housing. A switch or other user interface element is configured to turn an effect generated by the effects processor on and off under user control to permit the user to enable and disable the effect carried out on sounds entering the microphone. The switch is coupled operatively to the microphone, for example by being attached to the microphone housing or to a housing for a transmitter in a wireless microphone.
A method in accord with certain implementations involves capturing an audio sound at a hand held computing device; extracting a characteristic from the audio sound; and programming one or more digital signal processors in a musical instrument effects processor to modify an input signal to the musical instrument effects processor using the extracted characteristic.
A method consistent with certain implementations involves capturing an audio sound at a microphone; extracting a characteristic from the audio sound; and programming one or more digital signal processors in a musical instrument effects processor to modify an input signal to the musical instrument effects processor using the extracted characteristic, where the digital signal processor resides in one of: a housing for the microphone, a part of a musical instrument such as a guitar or bass guitar, or a musical instrument amplifier.
In certain implementations, a hand held computer has a set of parameters for use by a musical instrument effects processor. A wireless interface can be used to communicate the parameters to the musical instrument effects processor.
In certain implementations, a signal processor is provided within a microphone housing (which includes a housing for a wireless transmitter if any associated with the microphone). A user interface permits a user of the microphone to engage or disengage a DSP that produces special audio effects residing in the microphone housing at will. In certain implementations, a flash memory card can store multiple special effects programming and DSP parameters. In certain implementations, the microphone has a user interface permitting display and/or selection from among plural special effects. The microphone can be wired or wireless. The microphone may also have a wired or wireless interface (e.g., BlueTooth or USB connection for loading special effects programming and parameters.
Many variations are possible without departing from the present teachings. For example, while certain implementations contemplate use of a microphone within a smart phone or tablet, a discrete microphone can also be used to capture a sound, or a recorded or stored sound sample can be used directly. The processing to produce DSP parameters can be generated at any suitable processor including that of the effects processor 116, the smartphone or tablet 104 or a network or Internet connected processor or processors. Any use of the sampled audio to manipulate the input audio from instrument 132 is contemplated, and both wet and dry signals can be blended as desired. Many other implementations will occur to those skilled in the art upon consideration of the present teachings.
Those skilled in the art will appreciate, upon consideration of the above teachings, that the program operations and processes and associated data used to implement certain of the embodiments described above can be implemented using disc storage as well as other forms of storage devices including, but not limited to non-transitory storage media such as for example Read Only Memory (ROM) devices, Random Access Memory (RAM) devices, network memory devices, optical storage elements, magnetic storage elements, magneto-optical storage elements, flash memory, core memory and/or other equivalent volatile and non-volatile storage technologies without departing from certain embodiments of the present invention. The term “non-transitory” is intended only to exclude propagating signals and waves. All alternative storage devices should be considered equivalents regardless of how they are arranged or partitioned.
Certain example embodiments described herein, are or may be implemented using one or more programmed processors including digital signal processors and microcontrollers executing programming instructions that are broadly described above in flow chart form that can be stored on any suitable electronic or computer readable storage medium. However, those skilled in the art will appreciate, upon consideration of the present teaching, that the processes described above can be implemented in any number of variations and in many suitable programming languages without departing from embodiments of the present invention. For example, the order of certain operations carried out can often be varied, the location of production of the DSP parameters can vary from a tablet, smartphone, hand held computer, remote computer/server accessed via the Internet or at the musical effects instrument processor itself without limitation. Additional operations can be added or operations can be deleted without departing from certain embodiments of the invention. Error trapping, time outs, etc. can be added and/or enhanced and variations can be made in user interface and information presentation without departing from certain embodiments of the present invention. Such variations are contemplated and considered equivalent.
While certain illustrative embodiments have been described, it is evident that many alternatives, modifications, permutations and variations will become apparent to those skilled in the art in light of the foregoing description.
This application is a continuation application of allowed U.S. patent application Ser. No. 15/067,303 filed Mar. 11, 2016 which is a continuation of Issued U.S. patent application Ser. No. 14/014,638 filed Aug. 30, 2013 (now U.S. Pat. No. 9,318,086) which is related to and claims priority benefit of U.S. Provisional Patent Application 61/698,041 filed Sep. 7, 2012 and U.S. Provisional Patent Application 61/701,170 filed Sep. 14, 2012, each of which is hereby incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5262586 | Oba | Nov 1993 | A |
| 5422956 | Wheaton | Jun 1995 | A |
| 5739452 | Nagata | Apr 1998 | A |
| 5792971 | Timis | Aug 1998 | A |
| 5973252 | Hildebrand | Oct 1999 | A |
| 6259015 | Takahashi | Jul 2001 | B1 |
| 9318086 | Miller | Apr 2016 | B1 |
| 20020005111 | Ludwig | Jan 2002 | A1 |
| 20040016338 | Dobies | Jan 2004 | A1 |
| 20040099128 | Ludwig | May 2004 | A1 |
| 20060130637 | Crebouw | Jun 2006 | A1 |
| 20070175318 | Izumisawa | Aug 2007 | A1 |
| 20070191976 | Ruokangas | Aug 2007 | A1 |
| 20070237344 | Oster | Oct 2007 | A1 |
| 20080156178 | Georges | Jul 2008 | A1 |
| 20080254824 | Moraes | Oct 2008 | A1 |
| 20120180618 | Rutledge | Jul 2012 | A1 |
| 20120297959 | Serletic | Nov 2012 | A1 |
| 20130000464 | Kirsch | Jan 2013 | A1 |
| 20130112065 | Rutledge | May 2013 | A1 |
| 20130182861 | Kapp | Jul 2013 | A1 |
| 20140000440 | Georges | Jan 2014 | A1 |
| 20140109751 | Hilderman | Apr 2014 | A1 |
| 20140169795 | Clough | Jun 2014 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15067303 | Mar 2016 | US |
| Child | 15728577 | US |
