Patent Grant
7663052
This disclosure relates to electronic devices, and particularly to electronic devices that generate audio.
Musical Instrument Digital Interface (MIDI) is a format for the creation, communication, and playback of audio sounds, such as music, speech, tones, alerts, and the like. A device that supports the MIDI format may store sets of audio information that can be used to create various “voices.” Each voice may correspond to a particular sound, such as a musical note by a particular instrument. For example, a first voice may correspond to a middle C as played by a piano, a second voice may correspond to a middle C as played by a trombone, and a third voice may correspond to a D# as played by a trombone. In order to replicate the sounds of different instruments, a MIDI-compliant device may include a set of information for voices that specify various audio characteristics associated with the sounds, such as the behavior of a low-frequency oscillator, effects such as vibrato, and a number of other audio characteristics that can affect the perception of sound. Almost any sound can be defined, conveyed in a MIDI file, and reproduced by a device that supports the MIDI format.
A device that supports the MIDI format may produce a musical note (or other sound) when an event occurs that indicates that the device should start producing the note. Similarly, the device stops producing the musical note when an event occurs that indicates that the device should stop producing the note. An entire musical composition may be coded in accordance with the MIDI format by specifying events that indicate when certain voices should start and stop and various effects on the voices. In this way, the musical composition may be stored and transmitted in a compact file format according to the MIDI format.
The MIDI format is supported in a wide variety of devices. For example, wireless communication devices, such as radiotelephones, may support MIDI files for downloadable sounds such as ringtones or other audio output. Digital music players, such as the “iPod” devices sold by Apple Computer, Inc and the “Zune” devices sold by Microsoft Corp. may also support MIDI file formats. Other devices that support the MIDI format may include various music synthesizers such as keyboards, sequencers, voice encoders (vocoders), and rhythm machines. In addition, a wide variety of devices may also support playback of MIDI files or tracks, including wireless mobile devices, direct two-way communication devices (sometimes called walkie-talkies), network telephones, personal computers, desktop and laptop computers, workstations, satellite radio devices, intercom devices, radio broadcasting devices, hand-held gaming devices, circuit boards installed in devices, information kiosks, video game consoles, various computerized toys for children, on-board computers used in automobiles, watercraft and aircraft, and a wide variety of other devices.
In general, this disclosure describes techniques for generating a digital waveform for a Musical Instrument Digital Interface (MIDI) voice using a set of machine-code instructions that is specialized for the generation of digital waveforms for MIDI voices. For example, a processor may execute a software program that causes generation of a digital waveform for a MIDI voice. The instructions of the software program may be machine code instructions of an instruction set that is specialized for the generation of digital waveforms according to the MIDI format.
In one aspect, a method comprises executing in parallel sets of machine-code instructions with processing elements to generate digital waveforms for MIDI voices present in a MIDI frame. Machine-code instructions in the sets of machine-code instructions are instances of machine-code instructions defined in an instruction set that is specialized for generation of digital waveforms for MIDI voices. The method also comprises aggregating the digital waveforms for the MIDI voices to generate an overall digital waveform for the MIDI frame. In addition, the method comprises outputting the overall digital waveform.
In another aspect, a device comprises a set of program memory units that store sets of machine-code instructions. Machine code instructions in the sets of machine code instructions are instances of machine-code instructions defined in an instruction set that is specialized for generation of digital waveforms for MIDI voices. The device also comprises a set of processing elements that execute, in parallel, the sets of machine-code instructions to generate digital waveforms for MIDI voices in a MIDI frame. In addition, the device comprises a summing buffer that aggregates the digital waveforms for the MIDI voice to generate an overall digital waveform for the MIDI frame.
In another aspect, a computer-readable medium comprises instructions that cause a programmable processor to cause a set of processing elements to execute in parallel sets of machine-code instructions with processing elements to generate digital waveforms for MIDI voices present in a MIDI frame. Machine-code instructions in the sets of machine-code instructions are instances of machine-code instructions defined in an instruction set that is specialized for generation of digital waveforms for MIDI voices. In addition, the computer-readable medium comprises instructions that cause the processor to cause a summing buffer to aggregate the digital waveforms for the MIDI voices to generate an overall digital waveform for the MIDI frame. The computer-readable medium also comprises instructions for causing the processor to cause the summing buffer to output the overall digital waveform.
In another aspect, a device comprises means for storing sets of machine code instructions. Machine-code instructions in the sets of machine-code instructions are instances of machine-code instructions defined in an instruction set that is specialized for generation of digital waveforms for MIDI voices. The device also comprises means for executing, in parallel, the sets of machine-code instructions to generate digital waveforms for MIDI voices. In addition, the device comprises means for aggregating the digital waveforms for the MIDI voices to generate an overall digital waveform for the MIDI frame. The device also comprises means for outputting the overall digital waveform.
Various details of this disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims.
This disclosure describes techniques of generating a digital waveform for a Musical Instrument Digital Interface (MIDI) voice using a set of machine-code instructions that is specialized for the generation of digital waveforms for MIDI voices. For example, a processor may execute a software program that generates a digital waveform for a MIDI voice. The instructions of the software program may be machine code instructions from an instruction set that is specialized for the generation of digital waveforms for MIDI voices.
The various components illustrated in
As illustrated in the example of
Audio device 4 also includes a processor 8 that may read data from and write data to audio storage unit 6. Furthermore, processor 8 may read data from and write data to a Random Access Memory (RAM) unit 10. For example, processor 8 may read a portion of a MIDI file from audio storage module 6 and write that portion of the MIDI file to RAM unit 10. Processor 8 may comprise a general purpose microprocessor, such as an Intel Pentium 4 processor, an embedded microprocessor conforming to an ARM architecture by ARM Holdings of Cherry Hinton, UK, or other type of general purpose processor. RAM unit 10 may comprise one or more static or dynamic RAM units.
After processor 8 reads a MIDI file, processor 8 may parse MIDI files and schedule MIDI events associated with the MIDI files. For example, for each MIDI frame, processor 8 may read one or more MIDI files and may extract MIDI events from the MIDI files. Based on the MIDI instructions, processor 8 may schedule the MIDI events for processing by DSP 12. After scheduling the MIDI events, processor 8 may provide the scheduling to RAM unit 10 or DSP 12 so that DSP 12 can process the events. Alternatively, processor 8 may execute the scheduling by dispatching the MIDI events to DSP 12 in the time-synchronized manner. DSP 12 may service the scheduled events in a synchronized manner, as specified by timing parameters in the MIDI files. The MIDI events may include channel voice messages that are used to send musical performance information. Channel voice messages may include instruction to turn a particular MIDI voice on or off, change polyphonic key pressure, channel pressure, pitch bend change, control change messages, aftertouch effects, breath-control effects, program changes, pitch bend effects, pan left or right, sustain pedal, main volume, sostenuto, and other channel voice messages. In addition, the MIDI events may include channel mode messages that affect the way a MIDI device responds to MIDI data. Furthermore, the MIDI events may include system messages such as system common messages that are intended for all receivers in a MIDI system, system real-time messages that are used for synchronization between clock-based MIDI components, and other system-related messages. The MIDI events may also be MIDI show control messages (e.g., lighting effect cues, slide projection cues, machinery effect cues, pyrotechnical cues, and other effect cues).
When DSP 12 receives MIDI instructions from processor 8, DSP 12 may process the MIDI instructions to generate a continuous pulse-code modulation (PCM) signal. The PCM signal is a digital representation of an analog signal in which a waveform is represented by digital samples at regular intervals. DSP 12 may output this PCM signal to a Digital to Analog Converter (DAC) 14. DAC 14 may convert this digital waveform into an analog signal. A drive circuit 18 may use the analog signal to drive speakers 19A and 19B for output of physical sound to a user. The disclosure refers to speakers 19A and 19B collectively as “speakers 19.” Audio device 4 may include one or more additional components (not shown) including filters, pre-amplifiers, amplifiers, and other types of components that prepare the analog signal for eventual output by speakers 19. In this way, audio device 4 may generate sounds in accordance with a MIDI file.
In order to generate a digital waveform, DSP 12 may use a MIDI hardware unit 18 that generates a digital waveform for an individual MIDI frame. Each MIDI frame may correspond to 10 milliseconds, or another time interval. When a MIDI frame corresponds to 10 milliseconds, and the digital waveform is sampled at 48 kHz (i.e., 48,000 samples per second), there are 480 samples in each MIDI frame. MIDI hardware unit 18 may be implemented as a hardware component of audio device 4. For example, MIDI hardware unit 18 may be a chipset embedded into a circuit board of audio device 4. To use MIDI hardware unit 18, DSP 12 may first determine whether MIDI hardware unit 18 is idle. MIDI hardware unit 18 may be idle after MIDI hardware unit 18 finishes generating a digital waveform for a MIDI frame. DSP 12 may then generate a list of voice indicators that indicate MIDI voices present in the MIDI frame. After DSP 12 generates the list of voice indicators, DSP 12 may set one or more registers in MIDI hardware unit 18. DSP 12 may use direct memory exchange (DME) to set these registers. DME is a procedure that transfers data from one memory unit to another memory unit while a processor is performing other operations. After DSP 12 sets the registers, DSP 12 may instruct MIDI hardware unit 18 to begin generating the digital waveform for the MIDI frame. As explained in detail below, MIDI hardware unit 18 may generate the digital waveform for the MIDI frame by generating a digital waveform for each of the MIDI voice in the list of voice indicators and aggregating these digital waveforms into the waveform for the MIDI voice. When MIDI hardware unit 18 finishes generating the digital waveform for the MIDI frame, MIDI hardware unit 18 may send an interrupt to DSP 12. Upon receiving the interrupt from MIDI hardware unit 18, DSP 12 may send a DME request for the digital waveform to MIDI hardware unit 18. When MIDI hardware unit 18 receives the request, MIDI hardware unit 18 may send the digital waveform to DSP 12.
To generate the list of voice indicators that indicate MIDI voices present in a MIDI frame, DSP 12 may determine which of the MIDI voices has at least a minimum level of acoustical significance in the MIDI frame. The level of acoustical significance of a MIDI voice in a MIDI frame may be a function of the importance of that MIDI voice to the overall sound perceived by a human listener of the MIDI frame.
To generate a digital waveform for a MIDI voice, MIDI hardware unit 18 may access at least some voice parameters in a voice parameter set that defines the MIDI voice. A set of voice parameters may define a MIDI voice by specifying information necessary to generate a digital waveform for a MIDI voice and/or by specifying where such information may be located. For example, a set of MIDI voice parameters may specify a level of resonance, pitch reverberation, volume, and other acoustic characteristics. In addition, a set of MIDI voice parameters includes a pointer to an address of location in RAM unit 10 that contains a base waveform of the voice. The digital waveform for the MIDI frame may be the aggregation of the digital waveforms of the MIDI voices. For example, the digital waveform for the MIDI frame may be the sum of the digital waveforms of the MIDI voices.
As will be discussed in detail below, MIDI hardware unit 18 may provide several advantages. For instance, MIDI hardware unit 18 may include several features that result in efficient generation of digital waveforms. As a result of this efficient generation of digital waveforms, audio device 4 may be able to produce higher quality sound, consume less power, or otherwise improve upon conventional techniques for playback of MIDI files. Moreover, because MIDI hardware unit 18 may efficiently generate digital waveforms, MIDI hardware unit 18 may be able to generate digital waveforms for more MIDI voices within a fixed amount of time. The presence of such additional MIDI voices may improve the quality of a sound perceived by a human listener.
In addition, MIDI hardware unit 18 may include a coordination module 32. Coordination module 32 coordinates data flows within MIDI hardware unit 18. When MIDI hardware unit 18 receives an instruction from DSP 12 to begin generating a digital signal for a MIDI frame, coordination module 32 may load a list of voice indicators generated by DSP 12 from RAM unit 10 into a linked list memory unit 42 in MIDI hardware unit 18. Each voice indicator in the list indicates a MIDI voice that has acoustical significance during the current MIDI frame. Each voice indicator in the list of voice indicators may specify a memory location in RAM unit 10 that stores a voice parameter set that defines a MIDI voice. For example, each voice indicator may include a memory address of a particular voice parameter set or an index value from which coordination module 32 may derive a memory address of a particular voice parameter set.
After coordination module 32 loads the list of voice indicators into linked list memory unit 42, coordination module 32 may identify one of processing elements 34A through 34N to generate a digital waveform for one of the MIDI voices indicated by a voice indicator in the list of voice indicators stored in linked list memory 42. Processing elements 34A through 34N are collectively referred to herein as “processing elements 34.” Processing elements 34 may generate digital waveforms for MIDI voices in parallel with one another.
Each of processing elements 34 may be associated with one of voice parameter set (VPS) RAM units 46A through 46N. This disclosure may collectively refer to VPS RAM units 46A through 46N as “VPS RAM units 46.” VPS RAM units 46 may be registers that store voice parameters that are used by processing elements 34. When coordination module 32 identifies one of processing elements 34 to generate a digital waveform for a MIDI voice, coordination module 32 may store voice parameters of a voice parameter set of the MIDI voice into the one of VPS RAM units 46 associated with the identified processing element. In addition, coordination module 32 may store voice parameters of the voice parameter set into a waveform fetch unit/low-frequency oscillator (WFU/LFO) memory unit 39.
After loading the voice parameters into the VPS RAM unit and WFU/LFO memory unit 39, coordination module 32 may instruct the processing element to begin generate a digital waveform for the MIDI voice. Each of processing elements 34 may be associated with one of program memory units 44A through 44N (collectively, “program memory units 44”). Each of program memory units 44 stores a set of program instructions. To generate a digital waveform for a MIDI voice, the processing element may execute the set of program instructions stored in the one of program memory units 44 associated with the processing element. These program instructions may cause the processing element to retrieve a set of voice parameters from the one of VPS memory units 46 associated with the processing element. In addition, the program instructions may cause the processing element to send a request to a waveform fetch unit (WFU) 36 for a waveform specified in the voice parameters by a pointer to a base waveform sample for the voice. Each of processing elements 34 may use WFU 36. In response to the request from one of processing elements 34, WFU 36 may return one or more waveform samples to the requesting processing element. Because a waveform may be phase shifted within a sample, e.g., by up to one cycle of the waveform, WFU 36 may return two samples in order to compensate for the phase shifting using interpolation. Furthermore, because a stereo signal consists of two separate waveforms, WFU 36 may return up to four samples. The last sample returned by WFU 36 may be a fractional phase which may be used for interpolation. WFU 36 may use a cache memory 48 to fetch base waveforms faster.
After WFU 36 returns audio samples to one of processing elements 34, the respective processing element may execute additional program instructions. Such additional instructions may include requesting samples of an asymmetric triangular waveform from a low frequency oscillator (LFO) 38 in MIDI hardware unit 18. By multiplying a waveform returned by WFU 36 with a triangular wave returned by LFO 38, the processing element may manipulate various acoustic characteristics of the waveform. For example, multiplying a waveform by a triangular wave may result in a waveform that sounds more like a desired instrument. Other instructions may cause the processing element to loop the waveform a specific number of times, adjust the amplitude of the waveform, add reverberation, add a vibrato effect, or provide other acoustic effects. In this way, the processing element may generate a waveform for a voice that lasts one MIDI frame. Eventually, the processing element may encounter an exit instruction. When the processing element encounters an exit instruction, the processing element may provide the generated waveform to a summing buffer 40. Alternatively, the processing element may store each sample of the generated digital waveform into summing buffer 40 as the processing element generates such samples.
When summing buffer 40 receives a waveform from one of processing elements 34, the summing buffer aggregates the waveform to an overall waveform for a MIDI frame. For example, summing buffer 40 may initially store a flat waveform (i.e., a waveform where all digital samples are zero.) When summing buffer 40 receives a waveform from one of processing elements 34, summing buffer 40 may add each digital sample of the waveform to respective samples of the waveform stored in summing buffer 40. In this way, summing buffer 40 generates and stores an overall waveform for a MIDI frame.
Eventually, coordination module 32 may determine that processing elements 34 have completed generate a digital waveform for all of the voices indicated in the list in linked list memory 42 and have provided those digital waveforms to summing buffer 40. At this point, summing buffer 40 may contain a completed digital waveform for the entire current MIDI frame. When coordination module 32 makes this determination, coordination module 32 may send an interrupt to DSP 12. In response to the interrupt, DSP 12 may send a request via direct memory exchange (DME) to receive the content of summing buffer 40.
After loading the MIDI file into RAM unit 10, processor 8 may parse MIDI instructions from the MIDI file in RAM unit 10 (52). Processor 8 may then schedule the MIDI events and deliver the MIDI events to DSP 12 according to this schedule (54). In response to the MIDI events, DSP 12, in coordination with MIDI hardware unit 18, may output a continuous digital waveform in real time (56). That is, the digital waveform outputted by DSP 12 is not segmented into discrete MIDI frames. DSP 12 provides the continuous digital waveform to DAC 14 (58). DAC 14 converts individual digital samples in the digital waveform into electrical voltages (60). DAC 14 may be implemented using a variety of different digital-to analog conversion technologies. For example, DAC 14 may be implemented as a pulse width modulator, an oversampling DAC, a weighted binary DAC, an R-2R ladder DAC, a thermometer coded DAC, a segmented DAC, or another type of digital to analog converter.
After DAC 14 converts the digital waveform into an analog audio signal, DAC 14 may provide the analog audio signal to drive circuit 16 (62). Drive circuit 16 may use the analog signal to drive speakers 19 (64). Speakers 19 may be electromechanical transducers that convert the electrical analog signal into physical sound. When speakers 19 produce the sound, a user of audio device 4 may hear the sound and respond appropriately. For example, if audio device 4 is a mobile telephone, the user may answer a phone call when speakers 19 produce a ring tone sound.
On the other hand, if DSP 12 determines that the MIDI event is not an instruction to update a parameter of a MIDI voice (“NO” of 72), DSP 12 may generate a list of voice indicators (75). Each of the voice indicators in the linked list indicates a MIDI voice for the MIDI frame by specifying a memory location in RAM unit 10 that stores a voice parameter set that defines the MIDI voice. Because MIDI hardware unit 18 may generate a digital waveform for MIDI voices subject to limited time restrictions, it might not be possible for MIDI hardware unit 18 to generate a digital waveform for all MIDI voices specified by MIDI instructions for a MIDI frame. Consequently, the MIDI voices indicated by the voice indicators in the linked list are those MIDI voices that have a greatest acoustical significance during the MIDI frame. The list of voice indicators may be a linked list. That is, each voice indicator in the list may be associated with a pointer to a memory address of a next voice indicator in the list, except for a last voice indicator in the list.
In order to ensure that MIDI hardware unit 18 only generates digital waveforms for the most significant MIDI voices, DSP 12 may use one or more heuristic algorithms to identify the most acoustically significant voices. For example, DSP 12 may identify those voices that have the highest average volume, those voices that form necessary harmonies, or other acoustic characteristics. DSP 12 may generate the list of voice indicators such that the most acoustically significant voice is first in the list, the second most acoustically significant voice is second in the list, and so on. In addition, DSP 12 may remove from the list any voices that are not active in the MIDI frame.
After generating the list of voice indicators, DSP 12 may determine whether MIDI hardware unit 18 is idle (76). MIDI hardware unit 18 may be idle before generating a digital waveform for a first MIDI frame of a MIDI file or after completing the generation of a digital waveform for a MIDI frame. If MIDI hardware unit 18 is not idle (“NO” of 76), DSP 12 may wait one or more clock cycles and then again determine whether MIDI hardware unit 18 is idle (76).
If MIDI hardware unit 18 is idle (“YES” of 76), DSP 12 may load a set of instructions into program RAM units 44 in MIDI hardware unit 18 (78). For example, DSP 12 may determine whether instructions have already been loaded into program RAM units 44. If instructions have not already been loaded into program RAM units 44, DSP 12 may transfer such instructions into program RAM units 44 using direct memory exchange (DME). Alternatively, if instructions have already been loaded into program RAM units 44, DSP 12 may skip this step.
After DSP 12 has loaded the program instructions into program RAM units 44, DSP 12 may activate MIDI hardware unit 18 (80). For example, DSP 12 may activate MIDI hardware unit 18 by updating a register in MIDI hardware unit 18 or by sending a control signal to MIDI hardware unit 18. After activating MIDI hardware unit 18, DSP 12 may wait until DSP 12 receives an interrupt from MIDI hardware unit 18 (82). While waiting for the interrupt, DSP 12 may process and output a digital waveform for a previous MIDI frame. In addition, DSP 12 may also generate a list of voice indicators for a next MIDI frame. Upon receiving the interrupt, an interrupt service register in DSP 12 may set up a DME request to transfer the digital waveform for a MIDI frame from summing buffer 40 in MIDI hardware unit 18 (84). In order to avoid long periods of hardware idling when the digital waveform in summing buffer 40 is being transferred, the direct memory exchange request may transfer the digital waveform from summing buffer 40 in thirty-two 32-bit word blocks. The data integrity of the digital waveform may be maintained by a locking mechanism in summing buffer 40 that prevents processing elements 34 from over-writing data in summing buffer 40. Because this locking mechanism may be released block-by-block, the direct memory exchange transfer may proceed in parallel to hardware execution.
After DSP 12 receives the audio sample for a MIDI frame from MIDI hardware unit 18, DSP 12 may buffer the digital waveform until DSP 12 has completely outputted to DAC 14 a digital waveform for a MIDI frame that precedes the digital waveform for the MIDI frame received from MIDI hardware unit 18 (86). After DSP 12 has completely outputted the digital waveform for the previous MIDI frame, DSP 12 may output the digital waveform received from MIDI hardware unit 18 for the current MIDI frame (88).
After loading the linked list of voice indicators, coordination module 32 may determine whether coordination module 32 has received a signal from one of processing elements 34 that indicates that the processing element has finished generating a digital waveform for a MIDI voice (106). When coordination module 32 has not received a signal from one of processing elements 34 that indicates that a processing element has finished generating a digital waveform for a MIDI voice (“NO” of 106), processing element 34 may loop back and wait for such a signal (106). When coordination module 32 receives a signal from one of processing elements 34 indicating that the processing element has finished generating a digital waveform a MIDI voice (“YES” of 106), coordination module 32 may write to RAM unit 10 one or more parameters of the voice parameter set stored in the one of VPS RAM units 46 associated with the processing element and in WFU/LFO memory 39 that may have been altered by the processing element, waveform fetch unit 36, or LFO 38 (108). For example, while generating a waveform for a MIDI voice, processing element 34A may alter certain parameters of the voice parameter set in VPS memory 46A. In this case, for instance, processing element 34A may update a voice parameter for the voice to indicate a volume level of the voice at the end of a MIDI frame. By writing the updated voice parameters back to RAM unit 10, a given processing element may start generating a digital waveform for the MIDI voice in the next MIDI frame at a volume level that is the same as a volume level at which the current MIDI frame ended. Other writable parameters may include left-right balance, overall phase shift, phase shift of a triangular waveform produced by LFO 38, or other acoustic characteristics.
After coordination module writes the parameters back to RAM unit 10, coordination module 32 may determine whether processing elements 34 have generated digital waveforms for each MIDI voice indicated by a voice indicator in the list (110). For example, coordination module 32 may maintain a pointer that indicates a current voice indicator in the linked list of voice indicators. Initially, this pointer may indicate a first voice indicator in the linked list. If processing elements 34 have generated a digital waveform for each of the MIDI voices indicated in the list (“YES” of 110), coordination module 32 may assert an interrupt to DSP 12 to indicate that an overall digital waveform for the MIDI frame is complete (112).
On the other hand, if processing elements 34 have not generated a digital waveform for each of the MIDI voices indicated by voice indicators in the list (“NO” of 110), coordination module 32 may identify one of processing elements 34 that is idle (114). If all of processing elements 34 are not idle (i.e, are busy), coordination module 32 may wait until one of processing elements 34 is idle. After identifying one of processing elements 34 that is idle, coordination module 32 may load parameters of the voice parameter set indicated by the current voice indicator into the one of VPS RAM units 44 associated with the idle processing element (112). Coordination module 32 might only load those parameters of the voice parameter set that are relevant to the processing element into the VPS RAM unit. In addition, coordination module 32 may load parameters of the voice parameter set that are relevant to WFU 36 and LFO 38 into WFU/LFO RAM unit 39 (118). Coordination module 32 may then enable the idle processing element to start generating a digital waveform for the MIDI voice (120). Next, coordination module 32 may update the current voice indicator to the next voice indicator in the list and loop back to determine again whether coordination module 32 has received a signal indicating that one of processing elements 34 has completed generating a digital waveform for the MIDI voice (106).
RAM unit 10 may contain a set of voice parameter sets 146. Each voice parameter set in RAM unit 10 may be a block of contiguous memory locations that specify values of voice parameters in a voice parameter set. A memory address of a memory location of a first voice parameter may serve as a memory address for the voice parameter set.
Before DSP 12 receives a first MIDI event of a MIDI file, list 142 might not contain any voice indicators. To reflect the fact that list 142 does not contain any voice indicators, the value of list base pointer 140 may be a null memory address and a value in number of voice indicators register 144 may specify the number zero. At the start of a first MIDI frame of a MIDI file, processor 8 may provide to coordination module 32 a set of MIDI events that occur during the MIDI frame. For example, processor 8 may provide to DSP 12 MIDI events to turn voices on, MIDI events to turn voices off, MIDI events associated with aftertouch effects, and to produce other such effects. To process the MIDI events, a list generator module 156 in DSP 12 may generate linked list 142 in linked list memory 42. In general, list generator module 156 does not completely generate list 142 during each MIDI frame. Rather list generator module 156 may reuse the voice indicators already present in list 142.
To generate linked list 142, list generator module 156 may determine whether list 142 already includes a voice indicator that specifies a memory address of one of voice parameter sets 146 for each MIDI voice specified in the set of MIDI events provided by DSP 12. If list generator module 156 determines that list 142 includes a voice indicator of one of the MIDI voices, list generator module 156 may remove the voice indicator from list 142. After removing the voice indicator from list 142, list generator module 156 may add the voice indicator back into list 142. When list generator module 156 adds the voice indicator back into list 142, list generator module 156 may start at the first voice indicator in the list and determine whether the MIDI voice indicated by the removed voice indicator is more acoustically significant than the voice indicated by the first voice indicator in list 142. In other words, list generator module 156 may determine which voice is more important to the sound. List generator module 156 may apply one or more heuristic algorithms to determine whether the MIDI voice specified in the MIDI event or the MIDI voice specified by the first voice indicator is more acoustically significant. For example, list generator module 156 may determine which of the two MIDI voices has the loudest average volume during the current MIDI frame. Other psychoacoustical techniques may be applied to determine acoustical significance. If the MIDI voice indicated by the removed voice indicator is more significant than the voice indicated by the first voice indicator in list 142, list generator module 156 may add the removed voice indicator to the top of the list.
When list generator module 156 adds the removed voice indicator to the top of the list, list generator module 156 may change the value of list base pointer to be equal to the memory address of the removed voice indicator. If the MIDI voice indicated by the removed voice indicator is not more significant than the MIDI voice indicated by the first voice indicator, list generator module 156 continues down list 142 until list generator module 156 identifies a MIDI voice indicated by one of the voice indicators in list 142 that is less significant than the MIDI voice indicated by the removed voice indicator. When list generator module 156 identifies such a MIDI voice, list generator module 156 may insert the removed voice indicator into list 142 above (i.e., in front of) the voice indicator for the identified MIDI voice. If the MIDI voice indicated by the removed voice indicator is less acoustically significant than all other MIDI voices indicated by the voice indicators in list 142, list generator module 156 adds the removed voice indicator to the end of list 142. List generator module 156 may perform this process for each MIDI voice in the set of MIDI events.
If list generator module 156 determines that list 142 does not include a voice indicator for a MIDI voice associated with a MIDI event, list generator module 156 may create a new voice indicator in linked list memory 42 for the MIDI voice. After creating the new voice indicator, list generator module 156 may insert the new voice indicator into list 142 in the manner described above for the removed voice indicator. In this way, list generator module 156 may generate a linked list in which the voice indicators in the linked list are arranged in a sequence according to acoustical significance of the MIDI voices indicated by the voice indicators in the list. As one example, list generator module 156 may generate a list of voice indicators that indicate MIDI voices from the most significant voice to the least significant voice in a MIDI frame.
In the example of
If the value in number of voice indicators register 144 exceeds a maximum number of voice indicators, list generator module 156 may deallocate memory associated with a voice indicator in list 142 that indicates a least significant MIDI voice. If voice indicators in list 142 are arranged from most significant to least significant, list generator module 156 may identify the voice indicator in list 142 that indicates a least significant MIDI voice by following the chain of next voice indicator memory addresses until list generator module 156 identifies a voice indicator that includes a next voice indicator memory address that specifies a null memory address. After deallocating the memory associated with a last voice indicator, list generator module 156 may decrement the value in number of voice indicators register 144 by one.
After list generator module 156 generates list 142, list generator module 156 may provide the values of list base pointer 140 and number of voice indicators 144 to coordination module. Coordination module 32 may include registers (not shown) to hold these values of list base pointer 140 and number of voice indicators 144. Coordination module 32 use these values to access list 142 and to assign MIDI voices indicated by voice indicators in list 142 to processing elements 32. For example, when list generator module 156 finishes generating list 142, coordination module 32 may use the value of list base pointer 140 provided by list generator module 156 to load list 142 into linked list memory 42. Coordination module 32 may then identify one of processing elements 34 that is idle. Coordination module 32 may then obtain a memory address of a memory location in RAM unit 10 that stores a voice parameter set that defines a MIDI voice indicated by a voice indicator in list 142 at the memory location specified by a pointer in coordination module 32 that indicates a current voice indicator. Coordination module 32 may then use the obtained memory address to store at least some voice parameters in the voice parameter set into the one of VPS RAM units 46 associated with the idle processing element. After storing the voice parameter set in the VPS RAM unit, coordination module 32 may send a signal to the processing element to begin generating a waveform for the voice. Coordination module 32 may continue this until processing elements 34 have generated waveforms for each voice indicated by voice indicators in list 142.
The use by DSP 12 and coordination module 32 of a linked list of voice indicators may present several advantages. For example, because DSP 12 sorts and rearranges a linked list of voice indicators that indicate voice parameter sets, it is not necessary to sort and rearrange the actual voice parameter sets in RAM unit 10. A voice indicator may be significantly smaller than a voice parameter set. As a result, DSP 12 moves (i.e., writes and reads) less data to and from RAM unit 10. Therefore, DSP 12 may require less bandwidth on a bus from coordination module 32 to RAM unit 10 than if DSP 12 sorted and rearranged the voice parameter sets. Furthermore, because DSP 12 moves less data to and from RAM unit 10, DSP 12 may consume less power than if DSP 12 moved actual voice parameter sets. Also, the use of a linked list of voice indicators may permit DSP 12 to provide voice parameter sets to processing elements 34 in an arbitrary order. Providing voice parameter sets to processing elements 34 in an arbitrary order may be useful in certain types of audio processing.
In addition, the use of a linked list of indicators may have applicability in contexts other than identifiers of MIDI voice set parameters. For example, the indicators may indicate preprogrammed digital filters rather than sets of MIDI voice parameters. Each preprogrammed digital filter may provide the five coefficients for a bi-quadratic filter. A bi-quadratic filter is a two-pole, two-zero digital filter that filters out frequencies that are further away from the poles. Bi-quadratic filters may be used to program audio equalizers. Like MIDI voices, a first digital filter may be more or less significant than a second digital filter. Therefore, a module that applies digital filters may use a sorted linked list of indicators to digital filter parameters to efficiently apply a set of digital filters. For example, a module of audio device 4 may apply filters to a digital waveform after DSP 12 generates the digital waveform.
On the other hand, if the set of MIDI events is not empty (“NO” of 162), list generator module 156 may remove an event from the set of MIDI events (166). The removed event is referred to herein as the “current event” and a MIDI voice or MIDI voices associated with the current event are referred to herein as the “current voice.” After list generator module 156 removes the current event from the set of MIDI events, list generator module 156 may determine whether the value of list base pointer 140 is a null address (168). If the value of list base pointer 140 is not a null address (“NO” of 168), list generator module 156 may insert a voice indicator for the current voice into list 142.
If the value of list base pointer 140 specifies a null address (“YES” of 168), list generator module 156 may allocate a contiguous block of memory in linked list memory 42 for a voice indicator for the current voice (170). After allocating the block of memory, list generator module 156 may store a memory address of the block of memory in list base pointer 140 (172). List generator module 156 may then increment the value in number of voice indicators register 144 by one (174). In addition, list generator module 156 may initialize the voice indicator for the current voice (176). To initialize the voice indicator, list generator module 156 may set the next voice indicator pointer of the voice indicator to null and set the voice parameter set pointer of the voice indicator to the memory address in voice parameter sets 146 of the voice parameter set of the current voice. After initializing the voice indicator, list generator module 156 may loop back and again determine whether the set of MIDI events is empty (162).
Initially, list generator module 156 may set the value of current voice indicator pointer 148 to the value of list base pointer 140 (180). Next, list generator module 156 may set the value of previous voice indicator pointer 152 to null (182). After setting the value of previous voice indicator pointer 152 to null, list generator module 156 may determine whether a voice parameter pointer of the current voice indicator (i.e., the voice indicator having a memory address equal to the memory address in current voice indicator pointer 148) equals a memory address of the voice parameter set of the voice of the current event (184).
If list generator module 156 determines that the voice parameter pointer of the current voice indicator equals the memory address of the voice parameter set (“YES” of 184), list generator module 156 may determine whether the value of previous voice indicator pointer 152 is a null address (186). If list generator module 156 determines that the value of previous voice indicator pointer 152 is not a null address (“NO” of 186), list generator module 156 may set a next voice indicator pointer of the previous voice indicator (i.e., the indicator having a memory address equal to the memory address in previous voice indicator pointer 152) to the value of the next voice indicator pointer of the current voice indicator (188). After setting the next voice indicator pointer of the previous voice indicator, list generator module 156 may set the value of event voice indicator pointer 150 to the value of current voice indicator pointer 148 (190). List generator module 156 may also set the value of event voice indicator pointer 150 to the value of current voice indicator pointer 148 when the value of previous voice indicator pointer 152 is null (“YES” of 186). In this way, list generator module 156 does not attempt to set a next voice indicator pointer of a voice indicator at a null memory address. After list generator module 156 sets the value of event voice indicator pointer 148, list generator module 156 may set the value of current voice indicator pointer 148 to the value of list base pointer 140 (192). List generator module 156 may then use the example operation illustrated in
If list generator module 156 determines that the voice parameter set of the current voice indicator does not equal the memory address of the voice parameter set (“NO” of 184), list generator module 156 may determine whether the value of the next voice indicator pointer of the current voice indicator is null (194). In other words, list generator module 156 may determine whether the current voice indicator is the last voice indicator in list 142. If list generator module 156 determines that the value of the next voice indicator pointer of the current voice indicator is not null (“NO” of 194), list generator module 156 may set the value of previous voice indicator pointer 152 to the value of current voice indicator pointer 148 (196). List generator module 156 may then set the value of current voice indicator pointer 148 to the value of the next voice indicator pointer in the current voice indicator (198). In this way, list generator module 156 may advance the current voice indicator to the next voice indicator in list 142. List generator module 156 may then loop back and again determine whether the voice parameter set pointer of the new current voice indicator equals the address of the voice parameter set of the current voice (184).
On the other hand, if list generator module 156 determines that the next voice indicator pointer of the current voice indicator is null (“YES” of 194), list generator module 156 has reached the end of list 142 without locating a voice indicator for the current voice. For this reason, list generator module 156 may create to new voice indicator for the current voice. To create a new voice indicator for the current voice, list generator module 156 may allocate memory in linked list memory 42 for a new voice indicator (200). List generator module 156 may then set the value of event voice indicator pointer 148 to the memory address of the new voice indicator (202). The new voice indicator is now the event voice indicator. Next, list generator module 156 may increment the value of number of voice indicators register 144 by one (204). After incrementing the value of number of voice indicators register 144, list generator module 156 may set the voice parameter set pointer of the event voice indicator to contain the memory address of the voice parameter set of the current voice (206). List generator module 156 may then set the value of current voice indicator pointer 148 to the value of list base pointer 140 (192) and may then insert the event voice indicator into list 142 according to the example operation illustrated in
Initially, list generator module 156 in DSP 12 may retrieve a voice parameter set from RAM unit 10 indicated by the event voice indicator (210). List generator module 156 may then retrieve a voice parameter set from RAM unit 10 indicated by the current voice indicator (212). After retrieving both voice parameter sets, list generator module 156 may determine the relative acoustical significance of the MIDI voices, based on values in the voice parameter sets (214).
If the MIDI voice indicated by the event voice indicator is more significant than the MIDI voice indicated by the current voice indicator (“YES” of 214), list generator module 156 may set the next-voice indicator in the event voice indicator to the value of current voice indicator pointer 148 (216). After setting the next-voice indicator, list generator module 156 may determine whether the value of current voice indicator pointer 148 equals the value of list base pointer 140 (218). In other words, list generator module 156 may determine whether the current voice indicator is the first voice indicator in list 142. If the value of current voice indicator pointer 148 equals the value of list base pointer 140 (“YES” of 218), list generator module 156 may set the value of list base pointer 140 to the value of event voice indicator pointer 150 (220). In this way, the event voice indicator becomes the first voice indicator in list 142. Otherwise, if the value of current voice indicator pointer 148 does not equal the value of list base pointer 140 (“NO” of 218), list generator module 156 may set the value of the next-voice indicator pointer in the previous voice indicator to the value of event voice indicator pointer 150 (222). In this way, list generator module 156 may link the event voice indicator into list 142.
On the other hand, if the MIDI voice indicated by the event voice indicator is not more significant than the MIDI voice indicated by the current voice indicator (“NO” of 214), list generator module 156 may determine whether the value of the next-voice indicator pointer in the current voice indicator is null (224). If the value of the next-voice indicator pointer is null, then the current voice indicator is the last voice indicator in list 142. If the value of the next-voice indicator pointer in the current voice indicator is null (“YES” of 224), list generator module 156 may set the value of the next-voice indicator pointer in the current voice indicator to the value of event voice indicator pointer 150 (226). In this way, list generator module 156 may add the event voice indicator to the end of list 142 when the voice indicated by the event voice indicator is the least significant voice in list 142.
However, if the next-voice indicator pointer in the current voice indicator is not null (“NO” of 224), the current voice indicator is not the last voice indicator in list 142. For this reason, list generator module 156 may set the value of previous voice indicator 152 to the value of current voice indicator pointer 148 (228). Then, list generator module 156 may set the value of current voice indicator pointer 148 to the value of the next-voice indicator pointer in the current voice indicator (230). After setting the value of current voice indicator pointer 148, list generator module 156 may loop back to again retrieve a voice parameter set indicated by the current voice indicator (212).
Initially, list generator module 156 in DSP 12 may determine whether the value of number of voice indicators register 144 is greater than a maximum number of voice indicators in list 142 (240). If the value in number of voice indicators register 144 is not greater than the maximum number of voice indicators (“NO” of 240), there may be no need to remove any voice indicators from list 142. However, in some examples, list generator module 156 may scan through list 142 and remove voice indicators for voices that are not currently active or that have not been active within a given time.
If value in number of voice indicators register 144 is greater than the maximum number of voice indicators (“YES” of 240), list generator module 156 may set the value of current voice indicator pointer 148 to the value of list base pointer 140 (242). Next, list generator module 156 may set the value of previous voice indicator pointer 152 to null (244). At this point, list generator module 156 may determine whether the value of the next-voice indicator pointer of the current voice indicator is null (i.e., whether the current voice indicator is the last voice indicator in list 142) (248). If the value of the next-voice indicator pointer of the current voice indicator is not null (“NO” of 248), list generator module 156 may set the value of previous voice indicator pointer 152 to the value of current voice indicator pointer 148 (250). List generator module 156 may then set the value of current voice indicator pointer 148 to the value of the next-voice indicator pointer of the current voice indicator (252). Next, list generator module 156 may loop back to again determine whether the value of the next-voice indicator pointer of the new current voice indicator equals null (248).
If the value of the next-voice indicator pointer of the current voice indicator equals null (“YES” of 248), the current voice indicator is the last voice indicator in list 142. List generator module 156 may then remove the last voice indicator from list 142. To remove the last voice indicator from list 142, list generator module 156 may set the next-voice indicator pointer of the previous voice indicator to null (254). Next, coordination module 32 deallocates the memory in linked list memory 42 for the current voice indicator (256). Coordination module 32 may then decrement the value in number of voice indicators register 144 (258). After decrementing the value in number of voice indicators register 144, list generator module 156 may loop back to again determine whether the value in number of voice indicators register 144 is greater than the maximum allowed number of voice indicators (240).
Furthermore, in the example of
When DSP 12 or coordination module 32 needs to access a voice parameter set in block of voice parameter sets 262, DSP 12 or coordination module 32 may first multiply an index value of the voice parameter set in block 260 by the value contained in a set size register 268. The value contained in set size register 268 may equal the number of addressable locations in RAM unit 10 that a single voice parameter set occupies. DSP 12 or coordination module 32 may then add the value of a set base pointer register 266. The value contained in set base pointer register 266 may equal the memory address of the first voice parameter set in block 262. Thus, by multiplying an index of a voice parameter set by the size of a voice pointer set and then adding the memory address of the first voice parameter set, DSP 12 or coordination module 32 may derive the first memory address of the voice parameter set in block 262.
DSP 12 may control the voice indicators in list 142 of
The example data structure illustrated in
As illustrated in the example of
Control unit 280 may comprise a set of circuits that read instructions and that output control signals that control processing element 34A based on the instructions. Control unit 280 may include a program counter 290 that stores a memory address of a current instruction, a first loop counter 304 that stores a counter for a first program loop performed by processing element 34, and a second loop counter 306 that stores a counter for a second program loop performed by processing element 34. ALU 282 may comprise circuits that perform various arithmetic operations on values stored in various ones of registers 286. ALU 282 may be specialized to perform arithmetic operations that have special utility for the generation of digital waveforms for MIDI voices. Registers 286 may be a set of eight 32-bit registers that may hold signed or unsigned values. Multiplexer 284, based on control signals outputted by control unit 280, may direct output from ALU 282, interface read FIFO 292, interface FIFO 296, interface FIFO 298, and interface FIFO 302 to specific ones of registers 286.
Processing element 34A may use a set of program instructions that are specialized to generate digital waveforms for MIDI voices. In other words, the set of program instructions used in processing element 34A may include program instructions not found in generalized instruction sets such as a Reduced Instruction Set Computer (RISC) instruction set or a complex instruction set architecture instruction set such as an x86 instruction set. Furthermore, the set of program instruction used in processing element 34A may exclude some program instructions found in generalized instruction sets.
Program instructions used by processing element 34A may be classified as arithmetic logic unit (ALU) instructions, load/store instructions, and control instructions. Each class of program instructions used by processing element 34A may be a different length. For example, ALU instructions may be twenty bits long, load/store instructions may be eighteen bits long, and control instructions may be sixteen bits long.
ALU instructions are instructions that cause control unit 280 to output control signals to ALU 282. In one exemplary format, each ALU instruction may be twenty bits long. For example, bits 19:18 of an ALU instruction are reserved, bits 17:14 contain an ALU instruction identifier, bits 13:11 contain an identifier of a first one of registers 286, bits 10:8 contain an identifier of a second one of registers 286, bits 7:5 contain an number of bits to shift or an identifier of a third one of registers 286, bits 4:2 contain an identifier of a destination one of registers 286; and bits 1:0 contain ALU control bits. The ALU control bits may be abbreviated herein as “ACC.” As will be discussed in greater detail below, ALU control bits control the operation of an ALU instruction.
The set of ALU instructions used by processing element 34A may include the following instructions:
Before performing the operations in the EGCOMP instruction associated with a mode, ALU 282 first calculates the mode. For example, ALU 282 may calculate the mode using the following equation:
Mode=vps.ControlWord((ACC*8+second_loop_counter(1:0)*2+1): (ACC*8+second_loop_counter(1:0)*2))
In other words, the value of “mode” equals two bits in the control word of the current voice parameter set. The index of the more significant one of those two bits may be determined by performing the following steps:
The index of the less significant one of the two bits of the control word may be determined by performing the same steps except without adding the number one in the third step. For example, the control word may equal 0x0000807 (i.e., 0b0000 0000 0000 0000 0100 0000 0111). Furthermore, the value of ACC may be 0b0001 and the value of the second loop counter may be 0b0001. In this example, the index of the more significant bit of the control word is 0b00001011 (i.e., the number eleven in decimal) and the index of the less significant bit of the control word is 0b00001010 (i.e., the number ten in decimal). In the previous sentence, the bits of the index values that are underlined represent bits from the ACC and the bits of the index values that are italicized represent bits from the second loop counter. Therefore, the mode is 01 (i.e., the number one in decimal) because the values 0 and 1 are at locations 11 and 10, respectively, of the control word. Because the mode is 01, ALU 282 performs an unsigned multiplication of the value in Rx and the value in Ry, shifts the product left by the amount specified in shift, and then outputs the most significant thirty-two (32) bits of the shifted product.
Envelope generation is a method of modeling volume or modulation qualities of individual musical notes. Each musical note may have several phases. For example, a musical note may have a delay phase, an attack phase, a hold phase, a decay phase, a sustain phase, and a release phase. The delay phase may define an amount of time prior to the onset of the attack phase. During the attack phase, a volume or modulation level is increased to a peak level. During the hold phase, the volume or modulation level is maintained at the peak level. During the decay phase, the volume or modulation level is decreased to a sustain level. During the sustain level, the volume or modulation level is maintained at a sustain level. During the release phase, the volume or modulation level decreases to zero. Furthermore, changes in the volume or module level may be linear or exponential. The length of an envelope generation phase may be defined in terms of sub-frames. The term “sub-frame” may refer to one-fourth of a MIDI frame. For example, if a MIDI frame is 10 milliseconds, a sub-frame is 2.5 milliseconds. For example, an attack phase of a MIDI voice may last one sub-frame, a decay phase of the MIDI voice may last one sub-frame, and a sustain phase of a MIDI voice may last two sub-frames.
The EGCOMP instruction performs operations to perform envelope generation. For example, an addition operation (i.e., mode 00) may correspond to a linear ramp up (e.g., during the attack phase) or down (i.e., during the decay or release phase) of the volume or modulation level during a sub-frame. A multiplication operation (i.e. mode 01) may correspond to an exponential ramp up or ramp down (i.e., during the decay or release phase) of the volume or modulation level during a sub-frame. The assignment operations (i.e., modes 10 and 11) may correspond to a sustain of the volume or modulation intensity during a sub-frame. In the control word, bits 1:0 may indicate which EGCOMP mode to use in a first sub-frame for volume; bits 3:2 may indicate which EGCOMP mode to use in a second sub-frame for volume; bits 5:4 may indicate which EGCOMP mode to use in a third sub-frame for volume; bits 7:6 may indicate which EGCOMP mode to use in a fourth sub-frame for volume; bits 9:8 may indicate which EGCOMP mode to use in a first sub-frame for modulation; bits 11:10 may indicate which EGCOMP mode to use in a second sub-frame for modulation; bits 13:12 may indicate which EGCOMP mode to use in a third sub-frame for modulation; and bits 15:14 may indicate which EGCOMP mode to use in a fourth sub-frame for modulation.
Load/store instructions are instructions to read or write information from or to one of several modules external to processing element 34A. When control unit 280 encounters a load/store instruction, control unit 280 blocks until the load/store instruction is complete. In one exemplary format, each load/store instruction is eighteen bits long. For example, bits 17:16 of a load/store instruction are reserved, bits 15:13 contain an load/store instruction identifier, bits 12:6 contain a load source or a store destination address, bits 5:3 contain an identifier of a first one of registers 286, and bits 2:0 contain an identifier of a second one of registers 286.
The set of load/store instructions used by processing element 34A may include the following instructions:
As discussed above, LFO 38 may generate one or more precise triangular digital waveforms. For each one of processing elements 34, LFO 38 may provide four output values: a modulate pitch value, a modulate gain value, a modulate frequency corner value, and a vibrato pitch value. Each of these output values may represent a variation on the triangular digital waveform.
When control unit 280 reads the LOADLFO instruction, control unit 280 may output to LFO 38 control signals that represent the “lfo_id” parameter. The control signals that represent the “lfo_id” parameter may instruct LFO 38 to send a value in one of the output values to interface FIFO 296 in processing element 34A. For example, if control unit 280 sends control signals that represent the value 01 for the “lfo_id”, LFO 38 may send the value of the modulation gain output value. In addition, control unit 280 may output control signals to multiplexer 284 to direct output from interface FIFO 296 to the register Rz in registers 286.
Furthermore, when control unit 280 reads the LOADLFO instruction, control unit 280 may output control signals to LFO 38 that represent the “lfo_update” parameter. The control signals that represent the “lfo_update” parameter instruct LFO 38 how to update the output values. When LFO 38 receives the control signals that represent the “lfo_update” parameter, LFO 38 may select an operation to perform based on the set of voice parameters of the MIDI voice that processing element 34A is currently processing. For example, LFO 38 may use a control word of the voice parameter set to determine whether LFO 38 is in a “delay” state or a “generate” state.
To determine whether LFO 38 is in a “delay” state or a “generate” state, LFO 38 may access bits of a control word of the voice parameter set stored in VPS RAM 46A. For example, bits 23:16 of the control word may determine whether an LFO is in a “generate” mode or a “delay” state. In the “generate” state, LFO 38 may multiply a parameter for pitch. In the “delay” state, LFO 38 does not multiply the parameter for pitch. For instance, bit 16 of the control word may indicate whether the modulate mode of LFO 38 is in delay or generate state for the first sub-frame of the current MIDI frame; bit 17 may indicate whether the modulate mode LFO 38 is in delay or generate state for the second sub-frame of the current MIDI frame; bit 18 may indicate whether the modulate mode LFO 38 is in delay or generate state for the third sub-frame of the current MIDI frame; bit 19 may indicate whether the modulate mode LFO 38 is in delay or generate state for the fourth sub-frame of the current MIDI frame.
In addition, bit 20 of the control word may indicate whether the vibrato mode of LFO 38 is in a delay or generate state for a first sub-frame of the current MIDI frame; bit 21 of the control word may indicate whether the vibrato mode of LFO 38 is in a delay or generate state for a second sub-frame of the current MIDI frame; bit 22 of the control word may indicate whether the vibrato mode of LFO 38 is in a delay or generate state for a third sub-frame of the current MIDI frame; and bit 23 of the control word may indicate whether the vibrato mode of LFO 38 is in a delay or generate state for a fourth sub-frame of the current MIDI frame;
After selecting the operation (i.e., whether to execute in the “delay” mode or the “generate” mode), LFO 38 may perform the selected operation. If LFO 38 is in a delay state, LFO 38 may store a bias value for the mode of LFO identified by the “lfo_id” parameter into an output register of LFO 38 for the mode. On the other hand, if LFO 38 is in a generate state, LFO 38 may first determine whether the value of the “lfo_update” parameter equals 2 or 3. If the value of “lfo_update” equals 2 or 3, LFO 38 may update LFO phase or update LFO values and phase. If the value of the “lfo_update” parameter equals 2 or 3, LFO 38 may update a phase of the LFO by adding an LFO ratio to the current phase of the LFO. Next, LFO 38 may determine whether the value of the “lfo_update” parameter equals 1 or 3. If the value of “lfo_update” equals 1 or 3, LFO 38 may calculate an updated value for LFO output register identified by the “lfo_id” parameter by multiplying a current sample in LFO 38 by a gain and adding a bias value.
The following example pseudo-code may summarize the operation of the LOADLFO instruction:
This example pseudo-code is not meant to represent software instructions performed by processing element 34A and LFO 38. Rather, this pseudo-code may describe operations performed in the hardware of processing elements 34A and LFO 38.
Control instructions are instructions to control the behavior of control unit 280. In one exemplary format, each control instruction is sixteen bits long. For example, bits 15:13 contain a control instruction identifier, bits 12:4 contain a memory address, and bits 3:0 contain a mask for the control.
The set of control instructions used by processing element 34A may include the following instructions:
Before processing element 34A begins generating a digital waveform for a MIDI voice, coordination module 32 may send a reset signal to control unit 280. When control unit 280 receives the reset signal from coordination module 32, control unit 280 may reset the values of first loop counter 304, second loop counter 306, and program counter 290 to their initial values. For example, control unit 280 may set the values of first loop counter 304, second loop counter 306, and program counter 290 to zero.
Subsequently, coordination module 32 may send an enable signal to control unit 280 to instruct processing element 34A to begin generating a digital waveform for the MIDI voice described in VPS RAM unit 46A. When control unit 280 receives the enable signal, processing element 34 may begin executing a series of program instructions (i.e., a program) stored in consecutive memory locations in program RAM unit 44A. Each of the program instructions in program RAM unit 44A may be instances of instructions in the set of instructions described above.
In general, the program executed by processing element 34A may consist of a first loop and a second loop nested within the first loop. During each cycle of the first loop, processing element 34A may perform the entire second loop until the second loop terminates. When the second loop terminates, processing element 34A may have derived a symbol for one sample of a waveform for the MIDI voice. When the first loop terminates, processing element 34A has derived each symbol for each sample of the waveform for a MIDI voice for an entire MIDI frame. For example, the following series of instructions in the above example instruction set may outline a basic structure of a program executed by processing element 34A:
In this example series of instructions, words preceded by a double forward slash represent one or more instructions to perform the operation described. Furthermore, in this example, CTRL_NOP operations follow the LOOP1ENDD and LOOP2ENDD instructions because control unit 280 may have already begun execution of the instruction that follows a LOOP1ENDD or a LOOP2ENDD instruction before control unit 280 uses the updated memory address in program counter 290 to access a location in program RAM 34A that contains the respective LOOP1BEGIN or LOOP2BEGIN instructions. In other words control unit 280 may have already added the instruction following a loop end instruction to a processing pipeline.
To execute the program in program RAM unit 44A, control unit 280 may send a request to program RAM unit 44A to read a memory location in program RAM unit 44A having the memory address stored in program counter 290. In response to the request, program RAM unit 44A may send to control unit 280 the content of the memory location in program RAM unit 44A having the memory address stored in program counter 290.
The content of the requested memory location may be a forty-bit word that includes two program instructions that processing element 34A may execute in parallel. For example, one memory location in program RAM unit 44A may include one of:
After receiving the content of the memory location, control unit 280 may decode and apply the instructions specified in the content of the memory location. Control unit 280 may decode and apply each of the instructions atomically. In other words, once control unit 280 begins executing an instruction, control unit 280 does not change any data that is used or effected by the instruction until control unit 280 finishes executing the instruction. Furthermore, in some examples, control unit 280 may decode and apply in parallel both instructions in a word received from program RAM unit 44A. Once control unit 280 has executed the instructions in a word, control unit 280 may increment program counter 290 and request the content of the memory location in program RAM unit 44A identified by the incremented program counter.
The use of a specialized instruction set for processing elements 34 may provide one or more advantages. For example, various audio processing operations are performed to generate digital waveforms. In a first approach, the audio processing operations may be implemented in hardware. For instance, an application-specific integrated circuit (ASIC) could be designed to implement these operations. However, implementing these operations in hardware prevents the re-use of such hardware for other purposes. That is, once an ASIC designed to implement these operations has been installed in a device, the ASIC generally cannot be changed to perform different operations. In a second approach, a processor that uses a general-purpose instruction set may perform the audio processing operations. However, the use of such a processor may be wasteful. For instance, a processor that uses a general-purpose instruction set may include circuitry to decode instructions that are never used in the generation of digital waveforms. The use of a specialized instruction set may resolve the weaknesses of these two approaches. For example, the use of a specialized instruction set may allow updates a program that uses the instructions to generate the digital waveforms. At the same time, the use of a specialized instruction set may allow a chip designer to keep the implementation of the processor simple.
Furthermore, the use of specialized instructions, such as EGCOMP and LOADLFO, that perform different functions based on values in a voice parameter set may provide one or more additional advantages. For example, because EGCOMP and LOADLFO are implemented as single instructions, there is no need for conditional jumps or branches to execute these instructions. Because EGCOMP and LOADLFO do not include conditional jumps or branches, there is no need to update the program counter during these conditional jumps or branches. Furthermore, because EGCOMP and LOADLFO are implemented as single instructions, there is no need to load separate instructions to perform the operations of EGCOMP and LOADLFO. For example, case 1 of the EGCOMP instruction requires a multiplication operation. However, because EGCOMP is a single instruction, there is no need to load a separate multiplication operation from program memory. Because EGCOMP and LOADLFO do not require multiple loads from program memory, EGCOMP and LOADLFO may be perform in fewer clock cycles than if EGCOMP and LOADLFO had been implemented as sets of separate instructions.
In another example, the use of specialized instructions that perform different functions based on values of a voice parameter set may be advantageous because programs using such instructions may be more compact. For instance, it may require ten separate instructions to implement the operation performed by one EGCOMP instruction. A more compact program may be easier for a programmer to read. In addition, a more compact program may occupy less space in program memory. Because a more compact program may occupy less space in program memory, program memory may be smaller. A smaller program memory may be less expensive to implement and may conserve space on a chipset.
Initially, control unit 280 in processing element 34A may receive a control signal from coordination module 32 to reset the values of internal registers in order to prepare to generate a new digital waveform for a MIDI voice (320). When control unit 280 receives the reset signal, control unit 280 may reset the values of first loop counter 304, second loop counter 306, program counter 290, and registers 286 to zero.
Next, control unit 280 may receive an instruction from coordination module 32 to start generating a digital waveform for the MIDI voice having parameters in VPS RAM unit 46A (322). After control unit 280 receives an instruction from coordination module 32 to start generating a digital waveform for the MIDI voice, control unit 280 may read a program instruction from program memory 44A (324). Control unit 280 may then determine whether the program instruction is a “Loop End” instruction (326). If the instruction is a “Loop End” instruction (“YES” of 326), control unit 280 may decrement a loop count value in a register in processing element 34A (328). On the other hand, if the instruction is not a “Loop End” instruction (“NO” of 326), control unit 280 may determine whether the instruction is an “EXIT” instruction (330). If the instruction is an “EXIT” instruction (“YES” of 330), control unit 280 may output a control signal that informs coordination module 32 that processing element 34A has finished generating a digital waveform for the MIDI voice (332). If the instruction is not an “EXIT” instruction (“NO” of 330), control unit 280 may output control signals or change the value of program counter 290 to cause the performance the instruction (334).
In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media. A storage media may be any available media that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
Various examples have been described. These and other examples are within the scope of the following claims.
This application claims priority to U.S. Provisional Application No. 60/896,402, filed on Mar. 22, 2007.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5604324 | Kubota | Feb 1997 | A |
| 5696343 | Nakata | Dec 1997 | A |
| 6034314 | Koike | Mar 2000 | A |
| 6055619 | North | Apr 2000 | A |
| 6140566 | Tamura | Oct 2000 | A |
| 6509519 | Tamura | Jan 2003 | B2 |
| 6740804 | Shimizu et al. | May 2004 | B2 |
| 7099462 | Porter | Aug 2006 | B2 |
| 20020121181 | Fay et al. | Sep 2002 | A1 |
| 20040069129 | Ludwig | Apr 2004 | A1 |
| 20050210276 | Taruguchi | Sep 2005 | A1 |
| 20060180010 | Nakazono | Aug 2006 | A1 |
| 20060278065 | Ramstein | Dec 2006 | A1 |
| Number | Date | Country |
|---|---|---|
| 0722162 | Jul 1996 | EP |
| 1517296 | Mar 2005 | EP |
| Number | Date | Country | |
|---|---|---|---|
| 20080235494 A1 | Sep 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60896402 | Mar 2007 | US |
