Patent Grant
7392489
1. Field of the Invention
The present invention relates to processors. In one example, the present invention relates to improving mechanisms and techniques for implementing application specific processors.
2. Description of the Prior Art
A number of benefits have spurred efforts towards developing more easily customizable devices. Designers often have difficulty implementing devices with resource, speed, and cost characteristics that match needs and requirements. On one end of the spectrum, a designer can implement an application specific integrated circuit (ASIC) that has substantial processing efficiency and small marginal costs on a per unit basis. However, drawbacks include substantial design costs as well as significant risks that a redesign may be needed. A designer can also select an application specific standard product (ASSP) that provides the processing power of an ASIC but is available as an off-the-shelf component. However ASSPs are typically only available for relatively generic purposes. Some ASICs and ASSPs include some programmability, however the programmability may not be sufficient for customizing the device for a particular use.
Programmable chips can also be selected. Programmable chips can be relatively easily customized for particular uses, however the marginal costs on a per unit basis may be more significant and some processing power may be sacrificed. Furthermore, implementing programmable devices is often not straightforward. In many instances, a non-optimal design is often selected because of ease of implementation. The non-optimal design may require more logic resources than necessary and therefore require a more expensive programmable chip. Tools used to simplify implementation, such as tools that convert high level language code to hardware description language files, also often do not take advantage of the specific hardware architectures.
Designers can also select devices with both hard coded logic and programmable logic, but the hard coded logic may be inefficiently used.
Mechanisms for implementing devices in a cost effective and resource efficient manner are limited. Consequently, there are continued efforts to provide devices that overcome at least some of the drawbacks noted above. It is therefore desirable to provide improved methods and apparatus for implementing devices.
Methods and apparatus are provided for efficiently implementing an application specific processor. An application specific processor includes a data path and a control path. A control path is implemented using processor components to increase resource efficiency. Both the data path and the control path can be implemented using function units that are selected, parameterized, and interconnected. A tool uses the selected function units and interconnection information to provide data for implementing the application specific processor. Missing function units or interconnections can be identified and corrected.
In one embodiment, a technique for implementing a custom processor is provided. Multiple function units for implementing an application specific processor are received. The multiple function units can be selected and parameterized by a user. Some examples of function units include registers, memory, counters, multiply accumulate blocks, input channels, output channels, and shifters. Interconnection information for connecting the function units is also received. A hardware description for instantiating the function units and connecting the function units is generated.
In another embodiment, a system for implementing an application specific processor is provided. The system includes an interface and a processor. The interface receives function units for implementing an application specific processor. The function units can be selected and parameterized by a user. The interface also receives interconnection information for connecting the multiple function units. A processor is operable to generate a hardware description for instantiating the function units and connecting the function units.
These and other features and advantages of the present invention will be presented in more detail in the following specification of the invention and the accompanying figures, which illustrate by way of example the principles of the invention.
The invention may best be understood by reference to the following description taken in conjunction with the accompanying drawings, which illustrate specific embodiments of the present invention.
Reference will now be made in detail to some specific embodiments of the invention including the best modes contemplated by the inventors for carrying out the invention. Examples of these specific embodiments are illustrated in the accompanying drawings. While the invention is described in conjunction with these specific embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. On the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims.
For example, the techniques of the present invention will be described in the context of particular processors and devices. However, it should be noted that the techniques of the present invention can be applied to a variety of types of processors and devices and associated software. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The present invention may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order not to unnecessarily obscure the present invention. Techniques and mechanisms are also often associated with certain processes and components that are optional, unless noted otherwise. Optional processes and components may sometimes be removed or introduced into particular process flows or devices without affecting the operation of the present invention.
Furthermore, techniques and mechanisms of the present invention will sometimes be described in singular form for clarity. However, it should be noted that some embodiments can include multiple iterations of a technique or multiple instantiations of a mechanism unless noted otherwise. For example, a processor is used in a variety of contexts. However, it will be appreciated that multiple processors can also be used while remaining within the scope of the present invention.
Implementing a device using a hardware description language such as VHDL or Verilog is a time-consuming and arduous process. Although hardware description languages allow a designer to describe an optimal implementation for a device, that implementation may not be produced even by a skilled designer. Often, a suboptimal implementation is chosen because it is easier to describe or correctly implement. Consequently, a variety of tools and programs have been developed to improve the hardware design process.
Some tools allow programs written in high-level languages such as C and C++ to be compiled into HDL and implemented on a device. Any programming language allowing functional description of processes that does not require knowledge of the underlying hardware is referred to herein as a high-level language. However, these tools are often inefficient because they cannot define specialized functional blocks for particular devices or topologies. That is, the hardware description generated is often highly generic and may not be well suited for a particular device. In many instances, these tools can only use simple arithmetic logic units (ALUs), load/store blocks, and register files found in conventional devices. Furthermore, the process of automatically translating a generic description into a hardware configuration is often difficult.
Some other tools implement devices using components that are infrequently used. For example, the device may be used to implement an algorithm such as a Fast Fourier Transform (FFT). A Fast Fourier Transform can be conceptually divided into data path functionality and control path functionality. In many instances, the control path functionality is infrequently used as state changes only occur periodically. Nonetheless, control path functionality and data path functionality are often implemented using dedicated circuitry. Control functionality may be implemented using counters and indices that compute values such as mean and max data values. The control path and the data path are often closely coupled and sometimes difficult to separate. The control path is implemented to maximize efficiency and to allow the generation of state information as soon as possible. Resources are devoted to implementing control path functionality even though the bulk of the processing occurs in the data path. Tools often implement hardware devices inefficiently.
Consequently, the techniques and mechanisms of the present invention provide tools to allow a designer to implement an efficient custom processor. Various function units such as registers, memory, counters, multiply accumulate blocks, input channels, output channels, shifters, etc. can be selected and parameterized from a library. The designer can then identify how the function units are interconnected. Components for implementing a custom processor are referred to herein as function units. For example, using the techniques of the present invention, the output of a multiply accumulate block can be coupled to the input of a barrel shifter. The data path can be coded as a set of function units. According to various embodiments, the control path is coded as a program using a single arithmetic logic unit (ALU) to carry out state computations. The infrequently accessed state information is collected in memory. By using a single ALU and a memory to carry out all state computations, hardware resources can be conserved. Although implementing the control path as a program using an ALU and memory can mean that some state transitions that used to be calculated in a single cycle now take multiple cycles, the techniques of the present invention recognize that this trade-off is beneficial because of the amount of hardware resources conserved.
A tool can be used to automatically identify or generate function units to use as building blocks for a device having a controller implemented as a processor. Information identifying connections between function units can be received from a user and missing or incorrect interconnections can be rerouted or created. The techniques and mechanisms of the present invention allow a high-level description of the device to be implemented in a targeted and resource efficient manner.
In many implementations, both the state machine 101 and data path 141 can be implemented using native HDL. The HDL implemented state machine 101 is able to execute a very large number of state transitions in a small amount of time. In fact, the state machine 101 is often able to compute state transitions far more frequently than the data path 141 needs for operation. In some examples, well over 90 percent of the activity occurs in the data path while the state machine 101 is often left idle, since a next state transition 115 is calculated infrequently. Functional units used to calculate state transitions include comparators, arithmetic operators, and other selection operators and may also include memory implemented as registers storing pieces of data. Few if any of the components used to compute the next state are reused. In some examples, during 90 percent of the execution time, only a small subset of the state machine or controller circuitry is used.
This creates a great deal of inefficiency as the state machine components 101 are optimized to run as efficiently as the data path 141. The techniques of the present invention recognize that control circuitry as a finite state machine can be implemented in a slightly less efficient manner while allowing the conservation of a large amount of resources.
With almost all the state information in memory, access to memory is typically performed sequentially with only one variable read or update per clock cycle. Access matches an arithmetic logic unit that performs a single computation per clock cycle. Using memory to hold state information means that some state transitions that used to be performed in a single cycle now take multiple cycles. However, given that the device with a processor 171 typically spends 90 percent of its time in a single state and the remaining time is spent in non performance critical tasks such as state transitions, performance is typically not significantly affected. In many implementations, controller logic implemented as a processor 171 uses fewer logic resources than a controller implemented as a finite state machine.
According to various embodiments, a controller implemented as a processor is computationally complete and can compute any function subject to memory constraints.
If extra program memory is needed, memory can be increased by a factor of two or four with only minimal impact on the size of the controller. Since controller logic is typically infrequently used, negligible impact on system performance results. In one example, when two functions are applied in series, a single piece of hardware can be implemented to perform both functions. Implementing the functions using a processor as a controller makes composing the two functions on a single device relatively straightforward.
By using a program as a controller, changes to the algorithm can be implemented by simply reprogramming the controller without affecting the data path. Any programmable control path coupled to a data path that includes a program for controlling data path operation is referred to herein as a controller implemented as a processor. A controller implemented as a processor typically includes memory, an arithmetic logic unit, a program counter, and a program. It should be noted that a controller implemented as a processor may often be closely coupled to a data path.
According to various embodiments, the data path and the control path associated with a device can be implemented using a set of parameterizable function units. Function units may be available in a library and preoptimized to allow interconnection by a user. Function units can include processing function units, storage function units, infrastructure function units, and input output function units. In some examples, processing function units include arithmetic units, shifters, modulo counters, multiply accumulate blocks, complex multipliers, single integer multipliers, value combiners, and part selectors. Storage function units include registers and memory. Infrastructure function units include constant values, immediate fields, program counters, exit blocks, and uncommitted function units that can have ports and function specified by a user. In one example, uncommitted function units can have ports and functions specified by user supplied an Extensible Markup Language (XML) file. Input output function units can include general purpose output, general purpose input, bus masters, input channels, and output channels. Other types of function units including interface function units are possible as well.
In many examples, the function units operate on the transport triggered basis. Data inputs and/or outputs are registered. Associated with some of the ports are enables or triggers which indicate that a new input value is being fed to the unit or read from it. The act of transporting data to or from the function unit triggers operation. The triggers 303 are typically derived from the program, although triggers can also be generated by other blocks. Some function units have an additional control port 305 that can provide additional control information. The value can be applied to the port at the same time the function unit is triggered. For example, an add/subtract unit may be triggered by moving data to its input 311. Applying a control signal at the same time will cause it to subtract rather than add.
Using a triggered architecture simplifies creation of a programmable pipeline. An alternative design uses a clock triggered architecture which performs an operation on each clock cycle. However, clocking makes implementing operations harder as input and output scheduling would become more complicated.
According to various embodiments, the application specific processor builder 507 receives function units from functional unit library 505 and high-level code 501 converted to parallel assembly 503. Function units and associated interconnections between function units can be specified within program files or databases or other user interfaces. For example, to declare a function unit, the following format can be used:
Values such as immediates and literals can be supplied as follows:
Interconnections can be specified as follows:
Some additional information can be given to the application specific processor builder about how to generate the processor as follows:
The program can be specified as move operations. For example, parallel move operations can be performed in parallel:
mov unitA.port1, unitX.port
∥ mov unitB.port, unity.port4
∥ mov unitC.port5, unity.port4
A jump or branch instruction can be implemented by moving a new value to the program counter as follows:
mov programCounter.nextInstruction, immediate.START_OF_LOOP
Immediate values can be specified using a set or control command as follows:
set immediate—5.value, 0xFFFE
∥ mov output0.d, immediate—5.value
mov output1.d, immediate—5.value
ctrl fp_alu.rounding_mode, 4
After receiving function unit information and program information, the application specific processor builder 507 can provide a variety of outputs. According to various embodiments, the application specific processor builder 507 generates a processor using a hardware description language file 511. The description instantiates function units and interconnects the function units. The builder extracts hardware description language implementations of each function unit type used in the processor from a function unit library 505. Module generators may also be run at this stage to generate implementations. A program is also encoded to provide program file 515. According to various embodiments, the builder constructs an instruction word for the processor that includes any immediate fields used, multiplexer select lines, function unit triggers, and other control signals. The program is analyzed and encoded using the instruction word. The program can also be compressed to reduce the size of memory required to store the program.
However, by compressing the program, a decoder would have to be provided. Having a decoder may restrict the ways in which a processor can be used. Using the hardware descriptor language file 511 and the program file 515, a device 513 can be implemented. The builder 507 can also generate a test bench 519 to allow for automated testing of the device. A visualization 521 can be generated to provide a graphical representation of function units in the connections between them. In some examples, a high-level language model 523 is generated to allow modeling of the program. A VHDL trace generation file 525 is provided to allow the creation of a trace file when the program is executed by the processor running in the hardware description language simulator. A component definition 517 can also be used to describe the device as a component for use on a system on a programmable chip. This allows the application specific processor to be implemented as a stand-alone device or as a component within a larger device.
For example, based on the interconnection information, it may be inferred that a function unit required has not yet been declared. If the function unit is missing at 605, an error can be reported at 611. In some examples, no error reporting is needed. According to various embodiments, a new function unit is created at 613. A substitute for the missing function unit can then be selected at 615. In one example, the new function unit is created and selected automatically after a user is prompted for function unit information. It should be noted that in some examples, a new function unit is not needed and a substitute can be selected from a function unit library. In one example, a substitute may be selected from a slightly modified function unit in a function unit library. At 617, is determined if interconnection information is missing. For example, if inputs or outputs are left unconnected, missing interconnections can be inferred. An error can be reported at 621 and/or a new path or added route can be created at 623. At 625, the hardware description language file is generated. In some instances, no missing information is detected.
In one example, an input stage 701 often allows selection and parameterization of function units to be used on an electronic device. In some examples, function units and interconnection information are used to implement an application specific processor on a system on a programmable chip. The system on a programmable chip also includes other components provided to an input stage. Other components include intellectual property functions, megafunctions, and intellectual property cores. The input stage 701 may be a graphical user interface using wizards for allowing efficient or convenient entry of information. The input stage may also be a text interface or a program reading a data file such as a spreadsheet, database table, or schematic to acquire selection information. The input stage 701 produces an output containing information about the various modules selected.
In typical implementations, the generator program 705 can identify the selections and generate a logic description with information for implementing the application specific processor. According to various embodiments, the generator program 705 also provides information to a synthesis tool 707 to allow HDL files to be automatically synthesized. In some examples, a logic description is provided directly by a designer. Some of the available synthesis tools are Leonardo Spectrum, available from Mentor Graphics Corporation of Wilsonville, Oreg. and Synplify available from Synplicity Corporation of Sunnyvale, Calif. The HDL files may contain technology specific code readable only by a synthesis tool. The HDL files at this point may also be passed to a simulation tool.
As will be appreciated by one of skill in the art, the input stage 701, generator program 705, and synthesis tool 707 can be separate programs. The interface between the separate programs can be a database file, a log, or simply messages transmitted between the programs. For example, instead of writing a file to storage, the input stage 701 can send messages directly to the generator program 705 to allow the generator program to create a logic description. Similarly, the generator program can provide information directly to the synthesis tool instead of writing HDL files. Similarly, input stage 701, generator program 705, and synthesis tool 707 can be integrated into a single program.
A user may select various modules and an integrated program can then take the user selections and output a logic description in the form of a synthesized netlist without intermediate files. Any mechanism for depicting the logic to be implemented on an electronic device is referred to herein as a logic description. According to various embodiments, a logic description is an HDL file such as a VHDL, Abel, AHDL, or Verilog file. A logic description may be in various stages of processing between the user selection of components and parameters to the final configuration of the device. According to other embodiments, a logic description is a synthesized netlist such as an Electronic Design Interchange Format Input File (EDF file). An EDF file is one example of a synthesized netlist file that can be output by the synthesis tool 707.
A synthesis tool 707 can take HDL files and output EDF files. Tools for synthesis allow the implementation of the logic design on an electronic device. Some of the available synthesis tools are Leonardo Spectrum, available from Mentor Graphics Corporation of Wilsonville, Oreg. and Synplify available from Synplicity Corporation of Sunnyvale, Calif. Various synthesized netlist formats will be appreciated by one of skill in the art.
A verification stage 713 typically follows the synthesis stage 707. The verification stage checks the accuracy of the design to ensure that an intermediate or final design realizes the expected requirements. A verification stage typically includes simulation tools and timing analysis tools. Tools for simulation allow the application of inputs and the observation of outputs without having to implement a physical device. Simulation tools provide designers with cost effective and efficient mechanisms for both functional and timing verification of a design. Functional verification involves the circuit's logical operation independent of timing considerations. Parameters such as gate delays are disregarded.
Timing verification involves the analysis of the design's operation with timing delays. Setup, hold, and other timing requirements for sequential devices such as flip-flops are confirmed. Some available simulation tools include Synopsys VCS, VSS, and Scirocco, available from Synopsys Corporation of Sunnyvale, Calif. and Cadence NC-Verilog and NC-VHDL available from Cadence Design Systems of San Jose, Calif. After the verification stage 713, the synthesized netlist file can be provided to physical design tools 719 including place and route and configuration tools. A place and route tool typically locates logic cells on specific logic elements of a target hardware device and connects wires between the inputs and outputs of the various logic elements in accordance with logic required to implement an electronic design. The device can also be physically tested at 723.
For programmable logic devices, a programmable logic configuration stage can take the output of the place and route tool to program the logic device with the user selected and parameterized modules. According to various embodiments, the place and route tool and the logic configuration stage are provided in the Quartus Development Tool, available from Altera Corporation of San Jose, Calif. As will be appreciated by one of skill in the art, a variety of synthesis, place and route, and programmable logic configuration tools can be tested using various techniques of the present invention.
As noted above, different stages and programs can be integrated in a variety of manners. According to one embodiment, the input stage 701, the generator program 705, the synthesis tool 707, the verification tools 713, and physical design tools 719 are integrated into a single program. The various stages are automatically run and transparent to a user. The program can receive the user selected modules, generate a logic description depicting logic for implementing the various selected modules, and implement the electronic device. As will be appreciated by one of skill in the art, HDL files and EDF files are mere examples of a logic description. Other file formats as well as internal program representations are other examples of a logic description.
Both of these memory devices may include any suitable type of the computer-readable media described above. A mass storage device 808 is also coupled bi-directionally to CPU 802 and provides additional data storage capacity and may include any of the computer-readable media described above. The mass storage device 808 may be used to store programs, data and the like and is typically a secondary storage medium such as a hard disk that is slower than memory. The mass storage device 808 can be used to hold a library or database of prepackaged logic or intellectual property functions, as well as information on generating particular configurations. It will be appreciated that the information retained within the mass storage device 808, may, in appropriate cases, be incorporated in standard fashion as part of memory 806 as virtual memory. A specific mass storage device such as a CD-ROM 814 may also pass data uni-directionally to the CPU.
CPU 802 is also coupled to an interface 810 that includes one or more input/output devices such as such as video monitors, track balls, mice, keyboards, microphones, touch-sensitive displays, transducer card readers, magnetic or paper tape readers, tablets, styluses, voice or handwriting recognizers, or other well-known input devices such as, of course, other computers. Finally, CPU 802 optionally may be coupled to a computer or telecommunications network using a network connection as shown generally at 812. With such a network connection, it is contemplated that the CPU might receive information from the network, or might output information to the network in the course of performing the above-described method steps. It should be noted that the system 800 may also be associated with devices for transferring completed designs onto a programmable chip. The above-described devices and materials will be familiar to those of skill in the computer hardware and software arts.
The hardware elements described above may be configured (usually temporarily) to act as multiple software modules for performing the operations of this invention. For example, instructions for running a generator program, input stage (e.g., a wizard), and/or compiler may be stored on mass storage device 808 or 814 and executed on CPU 808 in conjunction with primary memory 806.
Although many of the components and processes are described above in the singular for convenience, it will be appreciated by one of skill in the art that multiple components and repeated processes can also be used to practice the techniques of the present invention.
While the invention has been particularly shown and described with reference to specific embodiments thereof, it will be understood by those skilled in the art that changes in the form and details of the disclosed embodiments may be made without departing from the spirit or scope of the invention. For example, the embodiments described above may be implemented using firmware, software, or hardware. Moreover, embodiments of the present invention may be employed with a variety of different file formats, languages, and communication protocols and should not be restricted to the ones mentioned above. Therefore, the scope of the invention should be determined with reference to the appended claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5867400 | El-Ghoroury et al. | Feb 1999 | A |
| 6341094 | Auracher | Jan 2002 | B1 |
| 6708144 | Merryman et al. | Mar 2004 | B1 |
| 6829754 | Yu et al. | Dec 2004 | B1 |
| 6907592 | Dante | Jun 2005 | B1 |
| 7117015 | Scheinert et al. | Oct 2006 | B2 |
| 20020133784 | Gupta et al. | Sep 2002 | A1 |
| 20030200538 | Ebeling et al. | Oct 2003 | A1 |
| 20040204097 | Scheinert et al. | Oct 2004 | A1 |
| 20040250231 | Killian et al. | Dec 2004 | A1 |
| 20050068943 | Scheinert et al. | Mar 2005 | A1 |
| 20050138586 | Hoppe et al. | Jun 2005 | A1 |
| 20050251647 | Taylor | Nov 2005 | A1 |
| 20070054668 | Scheinert et al. | Mar 2007 | A1 |
