The present invention relates generally to improvements in parallel processing. More particularly, the present invention addresses methods and apparatus for efficient implementation of vocoders in parallel DSPs. In a presently preferred embodiment, these techniques are employed in conjunction with the BOPS® Manifold Array (ManArray™) processing architecture.
In the present world, the telephone is a ubiquitous way to communicate. Besides the original telephone configuration now there are cellular phones, satellite phones, and the like. In order to increase throughput of the telephone communication network, vocoders are typically used. A vocoder compresses the voice using some model for a voice producing mechanism. A compressed or encoded voice is transmitted over a communication system and needs to be decompressed or decoded on the other end. The nature of most voice communication applications requires the encoding and decoding of voice to be done in real time, which is usually performed by digital signal processors (DSPs) running a vocoder.
A family of vocoders, such as vocoders for use in connection with G.723, G.726/727, G.729 standards, as well as others, have been designed and standardized for telephone communication in accordance with the International Telecommunications Union (ITU) Recommendations. See, for example, R. Salami, C. Laflamme, B. Besette, and J-P. Adoul, ITU-T G.729Annex A: Reduced Complexity 8 kb/s CS-ACELP Codec for Digital Simultaneous Voice and Data, IEEE Communications Magazine, September 1997, pp. 56-63 which is incorporated by reference herein in its entirety. These vocoders process a continuous stream of digitized audio information by frames, where a frame typically contains 10 to 20 ms of audio samples. See, for example, the reference cited above, as well as, J. Du, G. Warner, E. Vallow, and T. Hollenbach, Using DSP16000 for GSM EFR Speech Coding, IEEE Signal Processing Magazine, March 2000, pp. 16-26 which is incorporated by reference in its entirety. These vocoders employ very sophisticated DSP algorithms involving computation of correlations, filters, polynomial roots and so on. A block diagram of a G.729a encoder 10 is shown in
The G.729a vocoder is based on the code-excited linear-prediction (CELP) coding model described in the Salami et al. publication cited above. The encoder operates on speech frames of 10 ms corresponding to 80 samples at a sampling rate of 8000 samples per second. For every 10 ms frame, with a look-ahead of 5 ms, the speech signal is analyzed to extract the parameters of the CELP model such as linear-prediction filter coefficients, adaptive and fixed-codebook indices and gains. Then, the parameters, which take up only 80 bits compared to the original voice samples which take up 80*16 bits, are transmitted. At the decoder, these parameters are used to retrieve the excitation and synthesis filter parameters. The original speech is reconstructed by filtering this excitation through the short-term synthesis filter based on a 10th order linear prediction (LP) filter. A long-term, or pitch synthesis filter is implemented using the so-called adaptive-codebook approach. After computing the reconstructed speech, it is further enhanced by a post-filter.
A well known implementation of a G.729a vocoder, for example, takes on average about 50,000 cycles per channel per frame. See for example, S. Berger, Implement a Single Chip, Multichannel VoIP DSP Engine, Electronic Design, May 15, 2000, pp. 101-106. As a result, processing multiple voice channels at the same time, which is usually necessary at communication switches, requires great computational power. The traditional way to meet this requirement are by increasing the DSP clock frequency or the number of DSPs with multiple DSPs operating in parallel, each DSP has to be able to operate independently to handle conditional jumps, data dependency, and the like. As the DSPs do not operate in synchronism, there is a high overhead for multiple clocks, control circuitry and the like. In both cases, increased power, higher manufacturing costs, and the like result.
It will be shown in the present invention that a high performance vocoder implementation can be designed for parallel DSPs such as BOPS® ManArray™ family with many advantages over the typical prior art approaches discussed above. Among its other advantages, the parallelization of vocoders using the BOPS® ManArray™ architecture results in an increase in the number of communication channels per DSP.
The ManArray™ DSP architecture as programmed herein provides a unique possibility to process the voice communication channels in parallel instead of in sequence. Details of the ManArray™ 2×2 architecture are shown in
Thus, if a DSP in accordance with this invention has N parallel PEs, it is capable of processing N channels of voice communication at a time in parallel. To achieve this end, according to one aspect of the present invention, the following steps have been taken:
These and other advantages and aspects of the present invention will be apparent from the drawings and the Detailed Description including the Tables which follow below.
Further details of a presently preferred ManArray core, architecture, and instructions for use in conjunction with the present invention are found in
U.S. patent application Ser. No. 08/885,310 filed Jun. 30, 1997, now U.S. Pat. No. 6,023,753,
U.S. patent application Ser. No. 08/949,122 filed Oct. 10, 1997, now U.S. Pat. No. 6,167,502,
U.S. patent application Ser. No. 09/169,255 filed Oct. 9, 1998,
U.S. patent application Ser. No. 09/169,256 filed Oct. 9, 1998, now U.S. Pat. No. 6,167,501,
U.S. patent application Ser. No. 09/169,072 filed Oct. 9, 1998,
U.S. patent application Ser. No. 09/187,539 filed Nov. 6, 1998, now U.S. Pat. No. 6,151,668,
U.S. patent application Ser. No. 09/205,558 filed Dec. 4, 1998, now U.S. Pat. No. 6,173,389,
U.S. patent application Ser. No. 09/215,081 filed Dec. 18, 1998, now U.S. Pat. No. 6,101,592,
U.S. patent application Ser. No. 09/228,374 filed Jan. 12, 1999 now U.S. Pat. No. 6,216,223,
U.S. patent application Ser. No. 09/238,446 filed Jan. 28, 1999,
U.S. patent application Ser. No. 09/267,570 filed Mar. 12, 1999,
U.S. patent application Ser. No. 09/337,839 filed Jun. 22, 1999,
U.S. patent application Ser. No. 09/350,191 filed Jul. 9, 1999,
U.S. patent application Ser. No. 09/422,015 filed Oct. 21, 1999,
U.S. patent application Ser. No. 09/432,705 filed Nov. 2, 1999,
U.S. patent application Ser. No. 09/471,217 filed Dec. 23, 1999,
U.S. patent application Ser. No. 09/472,372 filed Dec. 23, 1999,
U.S. patent application Ser. No. 09/596,103 filed Jun. 16, 2000,
U.S. patent application Ser. No. 09/598,567 filed Jun. 21, 2000,
U.S. patent application Ser. No. 09/598,564 filed Jun. 21, 2000,
U.S. patent application Ser. No. 09/598,566 filed Jun. 21, 2000,
U.S. patent application Ser. No. 09/598,084 filed Jun. 21, 2000,
U.S. patent application Ser. No. 09/599,980 filed Jun. 22, 2000,
U.S. patent application Ser. No. 09/791,940 filed Feb. 23, 2001,
U.S. patent application Ser. No. 09/792,819 filed Feb. 23, 2001,
U.S. patent application Ser. No. 09/792,256 filed Feb. 23, 2001, as well as,
Provisional Application Ser. No. 60/113,637 filed Dec. 23, 1998,
Provisional Application Ser. No. 60/113,555 filed Dec. 23, 1998,
Provisional Application Ser. No. 60/139,946 filed Jun. 18, 1999,
Provisional Application Ser. No. 60/140,245 filed Jun. 21, 1999,
Provisional Application Ser. No. 60/140,163 filed Jun. 21, 1999,
Provisional Application Ser. No. 60/140,162 filed Jun. 21, 1999,
Provisional Application Ser. No. 60/140,244 filed Jun. 21, 1999,
Provisional Application Ser. No. 60/140,325 filed Jun. 21, 1999,
Provisional Application Ser. No. 60/140,425 filed Jun. 22, 1999,
Provisional Application Ser. No. 60/165,337 filed Nov. 12, 1999,
Provisional Application Ser. No. 60/171,911 filed Dec. 23, 1999,
Provisional Application Ser. No. 60/184,668 filed Feb. 24, 2000,
Provisional Application Ser. No. 60/184,529 filed Feb. 24, 2000,
Provisional Application Ser. No. 60/184,560 filed Feb. 24, 2000,
Provisional Application Ser. No. 60/203,629 filed May 12, 2000,
Provisional Application Ser. No. 60/241,940 filed Oct. 20, 2000,
Provisional Application Ser. No. 60/251,072 filed Dec. 4, 2000,
Provisional Application Ser. No. 60/281,523 filed Apr. 4, 2001,
Provisional Application Ser. No. 60/283,582 filed Apr. 27, 2001,
Provisional Application Ser. No. 60/288,965 filed May 4, 2001,
Provisional Application Ser. No. 60/298,696 filed Jun. 15, 2001,
Provisional Application Ser. No. 60/298,695 filed Jun. 15, 2001, and
Provisional Application Ser. No. 60/298,624 filed Jun. 15, 2001, all of which are assigned to the assignee of the present invention and incorporated by reference herein in their entirety.
Turning to specific aspects of the present invention,
In a presently preferred embodiment of the present invention, a ManArray™ 2×2 iVLIW single instruction multiple data stream (SIMD) processor 100 shown in
In this exemplary system, common elements are used throughout to simplify the explanation, though actual implementations are not so limited. For example, the execution units 131 in the combined SP/PE0101 can be separated into a set of execution units optimized for the control function, for example, fixed point execution units, and the PE0 as well as the other PEs 151, 153 and 155 can be optimized for a floating point application. For the purposes of this description, it is assumed that the execution units 131 are of the same type in the SP/PE0 and the other PEs. In a similar manner, SP/PE0 and the other PEs use a five instruction slot iVLIW architecture which contains a very long instruction word memory (VIM) memory 109 and an instruction decode and VIM controller function unit 107 which receives instructions as dispatched from the SP/PE0's I-Fetch unit 103 and generates the VIM addresses-and-control signals 108 required to access the iVLIWs stored in the VIM. These iVLIWs are identified by the letters SLAMD in VIM 109. The loading of the iVLIWs is described in further detail in U.S. patent application Ser. No. 09/187,539 entitled “Methods and Apparatus for Efficient Synchronous MIMD Operations with iVLIW PE-to-PE Communication”. Also contained in the SP/PE0 and the other PEs is a common PE configurable register file 127 which is described in further detail in U.S. patent application Ser. No. 09/169,255 entitled “Methods and Apparatus for Dynamic Instruction Controlled Reconfiguration Register File with Extended Precision”.
Due to the combined nature of the SP/PE0, the data memory interface controller 125 must handle the data processing needs of both the SP controller, with SP data in memory 121, and PE0, with PE0 data in memory 123. The SP/PE0 controller 125 also is the source of the data that is sent over the 32-bit broadcast data bus 126. The other PEs 151, 153, and 155 contain common physical data memory units 123′, 123″, and 123′″ though the data stored in them is generally different as required by the local processing done on each PE. The interface to these PE data memories is also a common design in PEs 1, 2, and 3 and indicated by PE local memory and data bus interface logic 157, 157′ and 157″. Interconnecting the PEs for data transfer communications is the cluster switch 171 more completely described in U.S. patent application Ser. No. 08/885,310 entitled “Manifold Array Processor”, U.S. application Ser. No. 09/949,122 entitled “Methods and Apparatus for Manifold Array Processing”, and U.S. application Ser. No. 09/169,256 entitled “Methods and Apparatus for ManArray PE-to-PE Switch Control”. The interface to a host processor, other peripheral devices, and/or external memory can be done in many ways. The primary mechanism shown for completeness is contained in a direct memory access (DMA) control unit 181 that provides a scalable ManArray data bus 183 that connects to devices and interface units external to the ManArray core. The DMA control unit 181 provides the data flow and bus arbitration mechanisms needed for these external devices to interface to the ManArray core memories via the multiplexed bus interface represented by line 185. A high level view of a ManArray Control Bus (MCB) 191 is also shown.
Turning now to specific details of the ManArray™ architecture and instruction syntax as adapted by the present invention, this approach advantageously provides a variety of benefits. Specialized ManArray™ instructions and the capability of this architecture and syntax to use an extended precision representation of numbers (up to 64 bits) make it possible to design a vocoder so that the processing of one data-frame always takes the same number of cycles.
The adaptive nature of vocoders makes the voice processing data dependent in prior art vocoder processing. For example, in the Autocorr function, there is a processing block that shifts down input data and repeats computation of the zeroeth correlation coefficient until the correlation coefficient stops overflow the 32-bit format. Thus, the number of repetitions is dependent on the input data. In the ACELP_Code_A function, the number of filter coefficients to be updated equals either (T0−L_SUBFR) if the computed value of T0<L_SUBFR or 0 otherwise. Thus processing is data dependent varying depending upon the value of T0. In the Pitch_fr3_fast function, the fractional pitch search −⅓ and +⅓ is not performed if the computed value of T0>84 for the first sub-frame in the frame. Again, processing is clearly data dependent. Therefore, processing of a particular frame of speech requires a different number of arithmetical operations depending on the frame data which determine what kind of conditions have been or have not been triggered in the current and, generally, the previous sub-frame.
The following example taken from the function Az_lsp (which is part of LP analysis, quantization, interpolation in
ITU Standard Code
is changed under the present invention to the following:
Usage of the for-loop makes the process free of conditional parts, and usage of the if-else structure synchronizes execution of this code for different input data.
The following example taken from the function Autocorr (part of LP analysis, quantization, interpolation in
ITU Standard Code
may be advantageously implemented in the following way in a ManArray™ DSP:
In the latter implementation, two ManArray™ features are highly advantageous. The first one is the capability to use 64-bit representations of numbers (Word64) both for storage and computation. The other one is the availability of specialized instructions such as a bit-level instruction to determine the highest bit that is on in a binary representation of a number (N=norm((Word64)sum)). Utilizing and adapting these features, the above implementation always requires the same number of cycles. Incidentally, this approach is more efficient because it makes possible the elimination of an exhaustive and non-deterministic do { . . . } while (Overflow !=0) loop.
Thus, implementation of the first two changes makes it possible to create a control code common for all PEs. In other words, all loops start and end at the same time, a new function is called synchronously for all PEs, etc. Redesigned vocoder control structure and the availability of multiple processing elements (PEs) in the ManArray™ DSP architecture make possible the processing of several different voice channels in parallel.
Parallelization of vocoder processing for a DSP having N processing elements has several advantages, namely:
An implementation of the G729a vocoder takes about 86,000 cycles utilizing a ManArray 1×2 configuration for processing two voice channels in parallel. Thus, the effective number of cycles needed for processing of one channel is 43,000, which is a highly efficient implementation. The implementation is easily scalable for a larger number of PEs, and in the 2×2 ManArray configuration the effective number of cycles per channel would be about 21,500.
Further details of a presently preferred implementation of a G.729A reduced complexity of 8 kbit/s CS-ACELP Speech Codec follow below. Sequential code follows as Table I and iVLIW code follows as Table II.
In one embodiment of the present invention, the ANSI-c Source Code, Version 1.1, September 1996 of Annex A to ITU-T Recommendation G.729, G.729A, was implemented on the BOPS, Inc. Manta co-processor core. G.729A is a reduced complexity 8 kilobits per second (kbps) speech coder that uses conjugate structure algebraic-code-exited linear-prediction (CS-ACELP) developed for multimedia simultaneous voice and data applications. The coder assumes 16-bit linear PCM input.
The Manta co-processor core combines four high-performance 32-bit processing elements (PE0, 1,2,3) with a high performance 32-bit sequence processor (SP). A high-performance DMA, buses and scalable memory bandwidth also complement the core. Each PE has five execution units: a MAU, an ALU, a DSU, and LU and an SU. The ALU, MAU and DSU on each PE support both fixed-point and single-precision floating-point operations. The SP, which is merged with PE0, has it's own five execution units: an MAU, an ALU, a DSU, an LU, and an SU. The SP also includes a program flow control unit (PCFU), which performs instruction address generation and fetching, provides branch control, and handles interrupt processing.
Each SP and each PE on the Manta use an indirect very long instruction word (iVLIW™) architecture. The iVLIW design allows the programmer to create optimized instructions for specific applications. Using simple 32-bit instruction paths, the programmer can create a cache of application-optimized VLIWs in each PE. Using the same 32-bit paths, these iVLIWs are triggered for execution by a single instruction, issued across the array. Each iVLIW is composed by loading and concatenating five 32-bit simplex instructions in each PE's iVLIW instruction memory (VIM). Each of the five individual instruction slots can be enabled and disabled independently. The ManArray programmer can selectively mask PEs in order to maximize the usage of available parallelism. PE masking allows a programmer to selectively operate any PE. A PE is masked when its corresponding PE mask bit in SP SCR1 is set. When a PE is masked, it still receives instructions, but it does not change its internal register state. All instructions check the PE mask bits during the decode phase of the pipeline.
The prior art CS-ACELP coder is based on code excited linear-prediction (CELP) coding model discussed in greater detail above. A block diagram for an exemplary G.729A encoder 10 is shown in
The overall Manta program set-up in accordance with one embodiment of the present invention is summarized as follows.
Table 600 of
While the present invention has been disclosed in a presently preferred context, it will be recognized that the present invention may be variously embodied consistent with the disclosure and the claims which follow below.
This application is a continuation of U.S. Ser. No. 10/013,908 filed Oct. 19, 2001, and claims the benefit of U.S. Provisional Application Ser. No. 60/241,940 filed Oct. 20, 2000, which are incorporated herein in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
4992933 | Taylor | Feb 1991 | A |
5784532 | McDonough et al. | Jul 1998 | A |
5893066 | Hong | Apr 1999 | A |
5966528 | Wilkinson et al. | Oct 1999 | A |
5978838 | Mohamed et al. | Nov 1999 | A |
6073100 | Goodridge, Jr. | Jun 2000 | A |
6425054 | Nguyen | Jul 2002 | B1 |
7003450 | Sadri et al. | Feb 2006 | B2 |
Number | Date | Country | |
---|---|---|---|
20060100865 A1 | May 2006 | US |
Number | Date | Country | |
---|---|---|---|
60241940 | Oct 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10013908 | Oct 2001 | US |
Child | 11312176 | US |