Patent Application
20100281234
This invention relates to data processing, and more particularly to apparatus and methods for increasing the processing efficiency of vector processors.
Signal and media processing (also referred to herein as “data processing”) is pervasive in today's electronic devices. This is true for cell phones, media players, personal digital assistants, gaming devices, personal computers, home gateway devices, and a host of other devices. From video, image, or audio processing, to telecommunications processing, many of these devices must perform several if not all of these tasks, often at the same time.
For example, a typical “smart” cell phone may require functionality to demodulate, decrypt, and decode incoming telecommunications signals, and encode, encrypt, and modulate outgoing telecommunication signals. If the smart phone also functions as an audio/video player, the smart phone may require functionality to decode and process the audio/video data. Similarly, if the smart phone includes a camera, the device may require functionality to process and store the resulting image data. Other functionality may be required for gaming, wired or wireless network connectivity, general-purpose computing, and the like. The device may be required to perform many if not all of these tasks simultaneously.
Similarly, a “home gateway” device may provide basic services such as broadband connectivity, Internet connection sharing, and/or firewall security. The home gateway may also perform bridging/routing and protocol and address translation between external broadband networks and internal home networks. The home gateway may also provide functionality for applications such as voice and/or video over IP, audio/video streaming, audio/video recording, online gaming, wired or wireless network connectivity, home automation, VPN connectivity, security surveillance, or the like. In certain cases, home gateway devices may enable consumers to remotely access their home networks and control various devices over the Internet.
Depending on the device, many of the tasks it performs may be processing-intensive and require some specialized hardware or software. In some cases, devices may utilize a host of different components to provide some or all of these functions. For example, a device may utilize certain chips or components to perform modulation and demodulation, while utilizing other chips or components to perform video encoding and processing. Other chips or components may be required to process images generated by a camera. This may require wiring together and integrating a significant amount of hardware and software.
Currently, there is no unified architecture or platform that can efficiently perform many or all of these functions, or at least be programmed to perform many or all of these functions. Thus, what is needed is a unified platform or architecture that can efficiently perform tasks such as data modulation, demodulation, encryption, decryption, encoding, decoding, transcoding, processing, analysis, or the like, for applications such as video, audio, telecommunications, and the like. Further needed is a unified platform or architecture that can be easily programmed to perform any or all of these tasks, possibly simultaneously. Such a platform or architecture would be highly useful in home gateways or other integrated devices, such as mobile phones, PDAs, video/audio players, gaming devices, or the like.
In order that the advantages of the invention will be readily understood, a more particular description of the invention briefly described above will be rendered by reference to specific examples illustrated in the appended drawings. Understanding that these drawings depict only typical examples of the invention and are not therefore to be considered limiting of its scope, the invention will be described and explained with additional specificity and detail through use of the accompanying drawings, in which:
The present invention provides an apparatus and method for increasing the efficiency of a vector processor that overcome various shortcomings of the prior art. The features and advantages of the present invention will become more fully apparent from the following description and appended claims, or may be learned by practice of the invention as set forth hereinafter.
In a first embodiment, a method in accordance with the invention includes providing a processor configured to execute instructions. The method may further include providing a first set of registers in the processor to store first data and first instructions associated with a first thread, and providing a second set of registers in the processor to store second data and second instructions associated with a second thread. The method may further include transmitting the first data and first instructions associated with the first thread to the first set of registers, and executing the first instructions in order to process the first data. The method may further include transmitting the second data and second instructions to the second set of registers while executing the first instructions and processing the first data. As will be explained in more detail hereafter, by executing the instructions from the first thread while the instructions from the second thread are in transit, the efficiency of the processor may be improved significantly.
In selected embodiments, the processor is one of an array of processors. In selected embodiments, the array of processors is a vector processor. Similarly, in selected embodiments, the processor may execute the first instructions during a first cycle and the second instructions during the next cycle. In this way, the clock rate of the first thread and the clock rate of the second thread may be a fraction (e.g., ½) of the overall clock rate of the processor.
In another embodiment, an apparatus in accordance with the invention includes a processor configured to execute instructions. A first set of registers may be provided in the processor to store first data and first instructions associated with a first thread. A second set of registers may be provided in the processor to store second data and second instructions associated with a second thread. The processor may be configured to receive the first data and first instructions associated with the first thread in the first set of registers. The processor may be configured to execute the first instructions in order to process the first data. Similarly, the processor may be further configured to execute the first instructions and process the first data while the second data and second instructions are in transit to the second set of registers.
It will be readily understood that the components of the present invention, as generally described and illustrated in the Figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the embodiments of the apparatus and methods of the present invention, as represented in the Figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention.
Many of the functional units described in this specification are shown as modules (or functional blocks) in order to emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom VLSI circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
Modules may also be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose of the module.
Indeed, a module of executable code could be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data may be identified and illustrated herein within modules, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, specific details may be provided, such as examples of programming, software modules, user selections, or the like, to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods or components. In other instances, well-known structures, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
The illustrated embodiments of the invention will be best understood by reference to the drawings, wherein like parts are designated by like numerals throughout. The following description is intended only by way of example, and simply illustrates certain selected embodiments of apparatus and methods that are consistent with the invention as claimed herein.
Referring to
In certain embodiments, the data processing architecture 100 may include one or more groups 102, each containing one or more clusters of processing elements (as will be explained in association with
The data processing architecture 100 may also be configured to perform certain tasks (e.g., demodulation, decryption, decoding) simultaneously. For example, certain groups and/or clusters within each group may be configured for demodulation while others may be configured for decryption or decoding. In other cases, different clusters may be configured to perform different steps of the same task, such as performing different steps in a pipeline for encoding or decoding video data. For example, where the data processing architecture 100 is used for video processing, one cluster may be used to perform motion compensation, while another cluster is used for deblocking, and so forth. How the process is partitioned across the clusters is a design choice that may differ for different applications. In any case, the data processing architecture 100 may provide a unified platform for performing various tasks or processes without the need for supporting hardware.
In certain embodiments, the data processing architecture 100 may include one or more processors 104, memory 106, memory controllers 108, interfaces 110, 112 (such as PCI interfaces 110 and/or USB interfaces 112), and sensor interfaces 114. A bus 116, such as a crossbar switch 116, may be used to connect the components together. A crossbar switch 116 may be useful in that it provides a scalable interconnect that can mitigate possible throughput and contention issues.
In operation, data, such as video data, may be streamed through the interfaces 110, 112 into a data buffer memory 106. This data may, in turn, be streamed from the data buffer memory 106 to group memories 206 (as shown in
In selected embodiments, a host processor 104 (e.g., a MIPS processor 104) may control and manage the operations of each of the components 102, 108, 110, 112, 114 and act as a supervisor for the data processing architecture 100. The host processor 104 may also program each of the components 102, 108, 110, 112 with a particular application (video processing, audio processing, telecommunications processing, modem processing, etc.) before data processing begins.
In selected embodiments, a sensor interface 114 may interface with various sensors (e.g., IRDA sensors) which may receive commands from various control devices (e.g., remote controls). The host processor 104 may receive the commands from the sensor interface 114 and take appropriate action. For example, if the data processing architecture 100 is configured to decode television channels and the host processor 104 receives a command to begin decoding a particular television channel, the processor 104 may determine what the current loads of each of the groups 102 are and determine where to start a new process. For example, the host processor 104 may decide to distribute this new process over multiple groups 102, keep the process within a single group 102, or distribute it across all of the groups 102. In this way, the host processor 104 may perform load-balancing between the groups 102 and determine where particular processes are to be performed within the data processing architecture 100.
Referring to
Referring to
The VPC 302 may have associated therewith a scalar ALU 306 which may perform scalar computations, perform control-related functions, and manage the operation of the VPU array 300. For example, the scalar ALU 306 may reconfigure the processing elements by modifying the groups that the processing elements belong to or designating how the processing elements should handle instructions based on the group they belong to.
The cluster 200 may also include a data memory 308 storing vectors having a defined number (e.g., sixteen) of elements. In certain embodiments, the number of elements in each vector may be equal to the number of processing elements in the VPU array 300, allowing each processing element within the array 300 to operate on a different vector element in parallel. Similarly, in selected embodiments, each vector element may include a defined number (e.g., sixteen) of bits. For example, where each vector includes sixteen elements and each element includes sixteen bits, each vector would include 256 bits. The number of bits in each element may be equal to the width (e.g., sixteen bits) of the data path between the data memory 308 and each processing element. It follows that if the data path between the data memory 308 and each processing element is 16-bits wide, the data ports (i.e., the read and write ports) to the data memory 308 may be 256-bits wide (16 bits for each of the 16 processing elements). These numbers are presented only by way of example are not intended to be limiting.
In selected embodiments, the cluster 200 may include an address generation unit 310 to generate real addresses when reading data from the data memory 308 or writing data back to the data memory 308. In selected embodiments, the address generation unit 310 may generate addresses in response to read/write requests from either the VPC 302 or connection manager 312 in a way that is transparent to the VPC 302 and connection manager 312. The cluster 200 may include a connection manager 312, communicating with the bus 202, whose primary responsibility is to transfer data into and out of the cluster data memory 308 to/from the bus 202.
In selected embodiments, instructions fetched from the instruction memory 304 may include a multiple-slot instruction (e.g., a three-slot instruction). For example, where a three-slot instruction is used, up to two instructions may be sent to each processing element and up to one instruction may be sent to the scalar ALU 306. Instructions sent to the scalar ALU 306 may, for example, be used to change the grouping of processing elements, change how each group of processing elements should handle a particular instruction, or change the configuration of a permutation engine 318. In certain embodiments, the processing elements within the VPU array 300 may be considered parallel-semantic, variable-length VLIW (Very Long Instruction Word) processors, where the packet length is at least two instructions. Thus, in certain embodiments, the processing elements in the VPU array 300 may execute at least two instructions in parallel in a single clock cycle.
In certain embodiments, the cluster 200 may further include a parameter memory 314 to store parameters of various types. For example, the parameter memory 314 may store a processing element (PE) mapping to designate which group each processing element belongs to. The parameters may also include an instruction modifier designating how each group of processing elements should handle a particular instruction. In selected embodiments, the instruction modifier may designate how to modify at least one operand of the instruction, such as a source operand, destination operand, or the like.
In selected embodiments, the cluster 200 may be configured to execute multiple threads simultaneously in an interleaved fashion. In certain embodiments, the cluster 200 may have a certain number (e.g., two) of active threads and a certain number (e.g., two) of dormant threads resident on the cluster 200 at any given time. Once an active thread has finished executing, a cluster scheduler 316 may determine the next thread to execute. In selected embodiments, the cluster scheduler 316 may use a Petri net or other tree structure to determine the next thread to execute, and to ensure that any necessary conditions are satisfied prior to executing a new thread. In certain embodiments, the group processor 204 (shown in
Because a cluster 200 may execute and finish threads very rapidly, it is important that threads can be scheduled in an efficient manner. In certain embodiments, an interrupt may be generated each time a thread has finished executing so that a new thread may be initiated and executed. Where threads are relatively short, the interrupt rate may become so high that thread scheduling has the potential to undesirably reduce the processing efficiency of the cluster 200. Thus, apparatus and methods are needed to improve scheduling efficiency and ensure that scheduling does not create bottlenecks in the system. To address this concern, in selected embodiments, the cluster scheduler 316 may be implemented in hardware as opposed to software. This may significantly increase the speed of the cluster scheduler 316 and ensure that new threads are dispatched in an expeditious manner. Nevertheless, in certain cases, the cluster hardware scheduler 316 may be bypassed and scheduling may be managed by other components (e.g., the group processor 204).
In certain embodiments, the cluster 200 may include permutation engine 318 to realign data that it read from or written to the data memory 308. The permutation engine 318 may be programmable to allow data to a reshuffled in a desired order before or after it is processed by the VPU array 300. In certain embodiments, the programming for the permutation engine 318 may be stored in the parameter memory 314. The permutation engine 318 may permute data having a width (e.g., 256 bits) corresponding to the width of the data path between the data memory 308 and the VPU array 300. In certain embodiments, the permutation engine 318 may be configured to permute data with a desired level of granularity. For example, the permutation engine 318 may reshuffle data on a byte-by-byte or element-by-element basis or other desired level of granularity. Using this technique, the elements within a vector may be reshuffled as they are transmitted to or from the VPU array 300.
Referring to
In selected embodiments, the processing elements may include exchange registers 402a-h to transfer data between the processing elements. This may allow the processing elements to communicate with neighboring processing elements without the need to save the data to data memory 308 and then reload the data into internal registers 500. This may significantly increase the versatility of the VPU array 300 and increase the efficiency of the cluster 200 when performing various operations. For example, a first processing element 400 could perform a mathematic computation to produce a result. This result could be passed to an adjacent processing element 400 for use in a computation. All this can be done without the need to save and load the result from data memory 308.
For example, in selected embodiments, an exchange register 402a may have a read port that is coupled to PE00 and a write port that is coupled to PE01, allowing data to be transferred from PE01 to PE00. Similarly, an exchange register 402b may have a read port that is coupled to PE01 and a write port that is coupled to PE00, allowing data to be transferred from PE00 to PE01. This enables two-way communication between adjacent processing elements PE00 and PE01.
Similarly, for those processing elements on the edge of the array 300, the processing elements may be configured for “wrap-around” communication. For example, in selected embodiments, an exchange register 402c may have a write port that is coupled to PE00 and a read port that is coupled to PE03, allowing data to be transferred from PE00 to PE03. Similarly, an exchange register 402d may have a write port that is coupled to PE03 and a read port that is coupled to PE00, allowing data to be transferred from PE03 to PE00. Similarly, exchange registers 402e, 402f may enable two-way data transfer between processing elements PE00 and PE30 and exchange registers 402g, 402h may enable two-way data transfer between processing elements PE00 and PE10.
In certain embodiments, the cluster 200 may be configured such that data may be loaded from the data memory 308 directly into the exchange registers 402 of the VPU array 300, and stored from the exchange registers 402 directly into the data memory 308. The cluster 200 may also be configured such that data may be loaded from the data memory 308 into internal general-purpose registers and exchange registers 402 of the VPU array 300 simultaneously.
Referring to
Referring to
Instructions may be read from the cluster instruction memory 304 during the I1 stage and aligned during the I2 and PG stages. In addition to initial decoding of the instruction, control instructions may also be executed during the D1 and D2 stages. During the EA (effective address) generation stage, the AGU 310 may calculate physical addresses for accesses to the data memory 308 and also distribute address and control signals to the processing elements 400 in the array 300. The EA stage may also be used as the execution stage of the scalar ALU 306. The data memory 308 may be read during the RF stage and data that is loaded from or stored in the data memory 308 may be valid on the load and store busses during the E1 stage. The vector arithmetic logic performed by the processing elements 400 may be performed during the E1 and E2 stages and the result may be written back during the WB stage either to the processing element registers or to the data memory 308.
The interleaved multi-threading process described herein allows two separate threads to run through the same pipeline 700 in alternate cycles. The single pipeline 700 effectively executes two separate threads simultaneously so there is no perceivable loss in instruction throughput and logically it appears that there are two separate VPU arrays 300, each running at half the clock frequency. One major advantage of this implementation is that it reduces the amount of bypassing logic required in order to minimize pipeline bubbles. Bypasses may be implemented to forward results/data from the end of the E2 stage to the end of the subsequent RF stage (as indicated by the arrows). This allows the result of an arithmetic instruction to be used as a source operand by the next instruction in the same thread as illustrated in
The interleaved multi-threading process illustrated in
In general, the interleaved multi-threaded architecture disclosed herein allows an instruction of a thread to take N cycles, where N is the number of interleaved threads. This configuration allows the result of an instruction to be received in time by the next instruction of the same thread without stalling. This allows for a simpler design for deeper pipelines that run at higher frequencies. In general, the delay of an operation or instruction is a function of the logic gates required to perform the operation and the wiring delays between the gates. The interleaved multi-threaded architecture allows useful work to be performed on another thread during the delay.
The example provided herein describing two interleaved threads is not intended to limit the number of threads that can be executed in an interleaved fashion. The claims are intended to encompass interleaved architectures using two or more threads. That is, any architecture using two or more threads will include a minimum of two threads, as recited in the claims.
Referring to
Referring to
In selected embodiments, the modification module 1014 may include an instruction modifier 1004 to designate how each group should handle an instruction 1006. Like the PE map 1002, this instruction modifier 1004 may, in certain embodiments, be stored in a register 1016 that may be read by each processing element in the array 300. For example, consider a VPU array 300 where the PE map 1002 designates that the first two columns of processing elements belong to “group 0” and the second two columns of processing elements belong to “group 1.” An instruction modifier 1004 may designate that group 0 should handle an ADD instruction as an ADD instruction, while group 1 should handle the ADD instruction as a SUB instruction. This will allow each group to handle the ADD instruction differently. Although the ADD instruction is used in this example, this feature may be used for a host of different instructions.
In certain embodiments, the instruction modifier 1004 may also be configured to modify a source operand 1008 and/or a destination operand 1010 of an instruction 1006. For example, if an ADD instruction is designed to add the contents of a first source register (R1) to the contents of a second source register (R2) and to store the result in a third destination register (R3), the instruction modifier 1004 may be used to modify any or all of these source and/or destination operands. For example, the instruction modifier 1004 for a group may modify the above-described instruction such that a processing element will use the source operand in the register (R5) instead of R1 and will save the destination operand in the destination register (R8) instead of R3. In this way, different processing elements may use different source and/or destination operands 1008, 1010 depending on the group they belong to.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
