This application claims priority from European patent application number 10163205.7, filed May 19, 2010, which is hereby incorporated herein by reference in its entirety.
Aspects of the present invention relate to the design of processors and a processor instruction scheduler as a design automation tool.
State of the art processors comprise a large number of units such as cores, processing units or accelerators. Often so-called execution units are used to execute special instructions. Out-of-order superscalar processors use inherent instruction level parallelism to do the speculative and parallel execution of multiple instructions each cycle on multiple execution units in order to improve the instruction throughput. Such out-of-order processors typically have an instruction sequencing unit (ISU) for scheduling the execution of an instruction on the multiple execution units as part of the processor each cycle. In addition the ISU takes care by a so-called commit process that speculative execution results will become architected state according to the order of the program code stream. Area, power and timing constraints put constraints on the ISU instruction scheduling heuristics. For example, the instruction queue with its associated rename and dependency checking will have a certain queue depth. Queues are often split based on execution units and so on, limiting the number of instructions in the code stream that the ISU is able to take into account for scheduling the instruction onto multiple execution units. Hence, the order in which instructions are sent to the ISU matters.
A wrong ordering of the processor instructions in the code stream can lead to some units running empty while others are overloaded and the instructions queued up for the overloaded units are blocking processor instructions that could be executed on other units. In some cases the available processor registers limit the number of processor instructions that can be handled by the processor simultaneously. All these variables differ between processor families or even between different generations of the same processor family. General purpose compilers cannot be expected to produce optimized code for each situation as they need to be able to compile large software packages in an acceptable time.
Another issue is that during the definition of the processor architecture, basic decisions have to be made about the units and instructions:
For example, in K. Atasu et al “Optimizing Instruction-set Extensible Processors under Data Bandwidth Constraints”, Proc. of the Conference on Design, Automation and Test in Europe, pp. 588-593, 2007, which is hereby incorporated herein by reference in its entirety, the use of linear programming to identify custom instructions is described. Here groups of processor instructions are identified that can be combined to be executed by hardware accelerators.
The alternatives in the design of a processor are usually tested with a code stream that may not be in the optimal order for the given configuration. The respective work flow is shown in
While it is very time consuming to re-order the code stream for each alternative manually, there is also no guarantee that optimal performance is reached. Also for critical loops in software, their corresponding machine code will be manually rewritten in case of performance problems for existing processors. This requires in depth knowledge of the processor hardware implementation, for example of the instruction scheduling in the processor. Some compilers also offer to automatically instrument the code stream such that profiling information is generated during the execution of the code stream, which is used to gather statistics. This allows the compiler to use the data from the statistics for optimizations in subsequent compilation runs when generating a code stream.
According to one embodiment of the present invention, a method, a corresponding computer program and computer program product to select from at least two different designs of a processor with at least two execution pipes and at least two registers are provided, wherein the designs comprise data for processor instruction latency and execution pipes, and wherein a code stream of processor instructions with corresponding register selections is provided for each design respectively, the method comprising, for instance, for each design generating an optimized code stream by reordering the corresponding code stream such that an optimum value for at least one design parameter is achieved without affecting the operation results of the respective code stream; and selecting a design with the best optimum value for the respective optimized code stream.
According to another embodiment of the present invention, a processor instruction scheduler comprising an optimization engine is provided, the scheduler comprising means to generate an optimization model for the optimization engine from a design of a processor and data representing optimization goals and constraints and a code stream, wherein the processor has at least two execution pipes and at least two registers, and wherein the design comprises data for processor instruction latency and execution pipes, and wherein the code stream comprises processor instructions with corresponding register selections; and reordering means to generate an optimized code stream from the code stream with the optimal solution provided by the optimization engine for the optimization model by reordering the code stream, such that optimum values for the optimization goals under the given constraints are achieved without affecting the operation results of the code stream.
According to an aspect of the invention, the state of the art work flow of
As shown in
This model of the processor architecture and the code stream I2 will be used by the optimization engine 30 for a mathematical model including, for instance:
The mathematical model is described in an optimization programming language and an appropriate solver is used to generate a solution. In one example, a solution includes valid values for the decision variables that satisfy all of the constraints and minimize or maximize the target function. If such solution exists, it is an optimal solution.
Optionally, the scheduler SCHED may also use profiling information 35, which was generated by actual runs of the code stream I2 on a processor. The library LIB comprises a detailed description of the processor instruction set for each processor design. It states which processor instruction is allowed to be executed on which execution unit of the processor. The execution units typically have different latencies from instruction issue to the write back of the results of the instruction processing.
For one embodiment of the invention, the code stream I2 includes instructions with multiple source registers and one target register. Processor instructions have one target register even though the number of input registers may vary. There are different classes of instructions that can use different registers to pull the operands from and write the result back to. The processor comprises at least two execution units for the processing of the instructions. Each of the execution units has an execution pipeline for the instructions to be processed.
The code stream I2 and the processor design information contained in the library LIB are specific for a certain processor instruction set.
The code stream 40 includes four different instruction types: “sigma”, “vsel”, “pm” and “add”. The example library 45 contains the corresponding latency and execution pipes in its library information. For example, the “vsel” instruction has a latency of 3 processor cycles and can only use execution pipe p1 of the processor, whereas the other instructions can use also execution pipe p0.
instruction 1 and 2 are assigned in parallel to p0 and p1 respectively;
instructions 2 to 5 are assigned in sequence to p1, while no instruction is assigned to p0;
instructions 6 and 7 are assigned in parallel to p1 and p0 respectively;
no instructions are assigned to either p0 and p1;
instructions 8 and 9 are assigned in parallel to p1 and p0 respectively;
instruction 10 is assigned to p0, while no instruction is assigned to p1;
no instructions are assigned to either p0 and p1;
instruction 11 is assigned to p0, while no instruction is assigned to p1;
no instructions are assigned to either p0 and p1;
instruction 12 is assigned to p0, while no instruction is assigned to p1.
A parallel execution requires a second execution pipe. This is shown for the code stream 60 in
In one embodiment of the invention, the optimization engine 30 is the IBM LOG CP product, which uses a so-called optimization programming language (OPL). A mathematical optimization program written in OPL defines decision variables that:
Next the constraints that limit the choice of the decision variables are defined such that:
Finally, the target function to be optimized is specified. Examples are:
Each processor instruction in a code stream is modeled as an interval with a start and an end time. For each processor instruction all the dependent instructions in the code stream are determined that use the result of the instruction as an input and a “spanning interval” is defined by the start point of the instruction and the end point being the maximum of the end points of all the dependent instructions. Constraints (e) and (f) are modeled by
The optimization engine 30 will then assign values to the decision variables (a, b, c) that satisfy constraints (d to h) and provide an improved or even optimal value for the given target function (i or j or k). This allows the scheduler SCHED to generate an optimized code stream 13 for a given code stream I2. The processor instructions in the code stream I2 are assigned to the execution units of the processor such that overlaps in the register usage are avoided. The determined solution is then put into a linear sequence of processor instructions again in order to form the optimized code stream 13.
The following OPL code skeleton illustrates an implementation for the optimization model that is processed by the optimization engine 30:
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
As will be appreciated by one skilled in the art, the present invention may be embodied as a system, method or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium.
Any combination of one or more computer usable or computer readable medium(s) may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Number | Date | Country | Kind |
---|---|---|---|
10163205.7 | May 2010 | EP | regional |