System and method for configuring an instrument to perform measurement functions utilizing conversion of graphical programs into hardware implementations

Abstract

A computer-implemented system and method for generating a hardware implementation of graphical code. The method may operate to configure an instrument to perform measurement functions, wherein the instrument includes a programmable hardware element. The method comprises first creating a graphical program, wherein the graphical program may implement a measurement function. A portion of the graphical program may be converted into a hardware implementation on a programmable hardware element, and a portion may optionally be compiled into machine code for execution by a CPU. The programmable hardware element is thus configured utilizing a hardware description and implements a hardware implementation of at least a portion of the graphical program.

Description

FIELD OF THE INVENTION

The present invention relates to graphical programming, and in particular to a system and method for converting a graphical program into a hardware implementation. The present invention further relates to a system and method for configuring an instrument or device, such as an image acquisition or machine vision device, a motion control device, or a programmable logic controller, to perform measurement functions, wherein the instrument or device includes a programmable hardware element

DESCRIPTION OF THE RELATED ART

Traditionally, high level text-based programming languages have been used by programmers in writing applications programs. Many different high level programming languages exist, including BASIC, C, FORTRAN, Pascal, COBOL, ADA, APL, etc. Programs written in these high level languages are translated to the machine language level by translators known as compilers or interpreters. The high level programming languages in this level, as well as the assembly language level, are referred to as text-based programming environments.

Increasingly computers are required to be used and programmed by those who are not highly trained in computer programming techniques. When traditional text-based programming environments are used, the user's programming skills and ability to interact with the computer system often become a limiting factor in the achievement of optimal utilization of the computer system.

There are numerous subtle complexities which a user must master before he can efficiently program a computer system in a text-based environment. The task of programming a computer system to model or implement a process often is further complicated by the fact that a sequence of mathematical formulas, mathematical steps or other procedures customarily used to conceptually model a process often does not closely correspond to the traditional text-based programming techniques used to program a computer system to model such a process. In other words, the requirement that a user program in a text-based programming environment places a level of abstraction between the user's conceptualization of the solution and the implementation of a method that accomplishes this solution in a computer program. Thus, a user often must substantially master different skills in order to both conceptually model a system and then to program a computer to model that system. Since a user often is not fully proficient in techniques for programming a computer system in a text-based environment to implement his model, the efficiency with which the computer system can be utilized to perform such modeling often is reduced.

Examples of fields in which computer systems are employed to interact with physical systems are the fields of instrumentation, process control, industrial automation, and simulation. Computer measurement and control of devices such as instruments or industrial automation hardware has become increasingly desirable in view of the increasing complexity and variety of instruments and devices available for use. However, due to the wide variety of possible testing and control situations and environments, and also the wide array of instruments or devices available, it is often necessary for a user to develop a custom program to control a desired system.

As discussed above, computer programs used to control such systems traditionally had to be written in text-based programming languages such as, for example, assembly language, C, FORTRAN, BASIC, etc. Traditional users of these systems, however, often were not highly trained in programming techniques and, in addition, text-based programming languages were not sufficiently intuitive to allow users to use these languages without training. Therefore, implementation of such systems frequently required the involvement of a programmer to write software for control and analysis of instrumentation or industrial automation data. Thus, development and maintenance of the software elements in these systems often proved to be difficult.

U.S. Pat. Nos. 4,901,221; 4,914,568; 5,291,587; 5,301,301; and 5,301,336; among others, to Kodosky et al disclose a graphical system and method for modeling a process, i.e., a graphical programming environment which enables a user to easily and intuitively model a process. The graphical programming environment disclosed in Kodosky et al can be considered a higher and more intuitive way in which to interact with a computer. A graphically based programming environment can be represented at a level above text-based high level programming languages such as C, Basic, Java, etc.

The method disclosed in Kodosky et al allows a user to construct a diagram using a block diagram editor. The block diagram may include a plurality of interconnected icons such that the diagram created graphically displays a procedure or method for accomplishing a certain result, such as manipulating one or more input variables and/or producing one or more output variables. In response to the user constructing a diagram or graphical program using the block diagram editor, data structures may be automatically constructed which characterize an execution procedure which corresponds to the displayed procedure. The graphical program may be compiled or interpreted by a computer.

Therefore, Kodosky et al teaches a graphical programming environment wherein a user places or manipulates icons and interconnects or “wires up” the icons in a block diagram using a block diagram editor to create a graphical “program.” A graphical program for performing an instrumentation, measurement or automation function, such as measuring a Unit Under Test (UUT) or device, controlling or modeling instruments, controlling or measuring a system or process, or for modeling or simulating devices, may be referred to as a virtual instrument (VI). Thus, a user can create a computer program solely by using a graphically based programming environment. This graphically based programming environment may be used for creating virtual instrumentation systems, modeling processes, control, simulation, and numerical analysis, as well as for any type of general programming.

A graphical program may have a graphical user interface. For example, in creating a graphical program, a user may create a front panel or user interface panel. The front panel may include various graphical user interface elements or front panel objects, such as user interface controls and/or indicators, that represent or display the respective input and output that will be used by the graphical program or VI, and may include other icons which represent devices being controlled. The front panel may be comprised in a single window of user interface elements, or may comprise a plurality of individual windows each having one or more user interface elements, wherein the individual windows may optionally be tiled together. When the controls and indicators are created in the front panel, corresponding icons or terminals may be automatically created in the block diagram by the block diagram editor. Alternatively, the user can place terminal icons in the block diagram which may cause the display of corresponding front panel objects in the front panel, either at edit time or later at run time. As another example, the front panel may comprise front panel objects, e.g., the GUI, embedded in the block diagram.

During creation of the block diagram portion of the graphical program, the user may select various function nodes or icons that accomplish his desired result and connect the function nodes together. For example, the function nodes may be connected in one or more of a data flow, control flow, and/or execution flow format. The function nodes may also be connected in a “signal flow” format, which is a subset of data flow. The function nodes may be connected between the terminals of the various user interface elements, e.g., between the respective controls and indicators. Thus the user may create or assemble a graphical program, referred to as a block diagram, graphically representing the desired process. The assembled graphical program may be represented in the memory of the computer system as data structures and/or program instructions. The assembled graphical program, i.e., these data structures, may then be compiled or interpreted to produce machine language that accomplishes the desired method or process as shown in the block diagram.

Input data to a graphical program may be received from any of various sources, such as from a device, unit under test, a process being measured or controlled, another computer program, or from a file. Also, a user may input data to a graphical program or virtual instrument using a graphical user interface, e.g., a front panel as described above. The input data may propagate through the data flow block diagram or graphical program and appear as changes on the output indicators. In an instrumentation application, the front panel can be analogized to the front panel of an instrument. In an industrial automation application the front panel can be analogized to the MMI (Man Machine Interface) of a device. The user may adjust the controls on the front panel to affect the input and view the output on the respective indicators. Alternatively, the front panel may be used merely to view the input and output, or just the output, and the input may not be interactively manipulable by the user during program execution.

Thus, graphical programming has become a powerful tool available to programmers. Graphical programming environments such as the National Instruments LabVIEW product have become very popular. Tools such as LabVIEW have greatly increased the productivity of programmers, and increasing numbers of programmers are using graphical programming environments to develop their software applications. In particular, graphical programming tools are being used for test and measurement, data acquisition, process control, man machine interface (MMI), supervisory control and data acquisition (SCADA) applications, simulation, image processing/machine vision applications, and motion control, among others.

A primary goal of graphical programming, including virtual instrumentation, is to provide the user the maximum amount of flexibility to create his/her own applications and/or define his/her own instrument functionality. In this regard, it is desirable to extend the level at which the user is able to program a device, e.g., extend the level at which a user of instrumentation or industrial automation hardware is able to program an instrument. The evolution of the levels at which the user has been able to program an instrument is essentially as follows.

1. User level software (LabVIEW, LabWindows CVI, Visual Basic, etc.)

2. Kernel level software

3. Auxiliary kernel level software (a second kernel running along side the main OS, e.g., InTime, VentureCom, etc.)

4. Embedded kernel level software

5. Hardware level software (FPGA—the present patent application)

In general, going down the above list, the user is able to create software applications which provide a more deterministic real-time response. Currently, most programming development tools for instrumentation or industrial automation provide an interface at level 1 above. In general, most users are unable and/or not allowed to program at the kernel level or auxiliary kernel level. The user level software typically takes the form of software tools that can be used to create software which operates at levels 1 and/or 4.

Current instrumentation solutions at level 5 primarily exist as vendor-defined solutions, i.e., vendor created modules. However, it would be highly desirable to provide the user with the ability to develop user level software which operates at the hardware level. More particularly, it would be desirable to provide the user with the ability to develop high level software, such as graphical programs, which can then be readily converted into hardware level functionality. This would provide the user with the dual benefits of being able to program device functionality at the highest level possible (text-based or graphical programs), while also providing the ability to have the created program operate directly in hardware for increased speed and efficiency.

SUMMARY OF THE INVENTION

One embodiment of the present invention comprises a computer-implemented system and method for automatically generating hardware level functionality, e.g., configured programmable hardware such as FPGAs or CPLDs, in response to a graphical program created by a user. This provides the user the ability to develop or define desired functionality using graphical programming techniques, while enabling the resulting program to operate directly in hardware. The computer-implemented system and method may be used for configuring an instrument to perform a measurement function, wherein the instrument includes the programmable hardware element.

The user may first create a graphical program which performs or represents the desired functionality. The graphical program may comprise a block diagram which includes a plurality of interconnected nodes which visually indicate functionality of the graphical program. The plurality of nodes may be interconnected in one or more of a data flow, control flow, or execution flow format. The graphical program may include a single diagram or a hierarchy of subprograms or sub-diagrams. In one embodiment, the user may place various constructs in portions of the graphical program to aid in conversion of these portions into hardware form. As the user creates or assembles the graphical program on the display, data structures and/or software code may be automatically created and stored in memory corresponding to the graphical program being created. In a measurement or instrumentation application, the graphical program may implement a measurement function.

The user may then select an option to convert the graphical program into executable form, wherein at least a portion of the graphical program is converted into a hardware implementation. In one embodiment, the block diagram portion of the graphical program is converted into a hardware configuration that may be downloaded onto the programmable hardware element comprised on the instrument or measurement device. If the graphical program includes a user interface portion, then the user interface portion may not be converted into a hardware configuration, but rather may be compiled for execution by a processor.

The user may optionally select which portions of a graphical program, e.g., which diagrams (or sub-VIs), are to be translated into hardware form, either during creation of the graphical program or when selecting the option to convert the graphical program into executable form. Thus the user can select a first portion of the graphical program, e.g., a first one or more diagrams which require real time execution, to be downloaded onto the programmable hardware element, and may select other diagrams which do not require real time execution to be executed by a processor. Alternatively, the selection of portions of the graphical program to be compiled for execution by the CPU or to be provided for hardware implementation may be automatically performed by the system.

The portion of the graphical program selected for hardware implementation may first be converted to a an abstract hardware graph, also referred to as a VDiagram tree. More specifically, the data structures corresponding to the graphical program may be converted into the abstract hardware graph or VDiagram tree. Thus in one embodiment the conversion may not be a one-step process of generating a hardware description directly from graphical program internal data structures, but rather may involve the VDiagram intermediate format. The VDiagram tree may comprise data structures representing the functional objects of the graphical program and the data flow, control flow or execution flow between them. VDiagrams are described in detail below.

The VDiagram tree may be parsed by a back end program module which generates a specific hardware description from the tree, such as a VHDL or EDIF hardware description. The hardware description may then converted into a hardware netlist. Netlists for various types of hardware devices may be created from a hardware description (e.g., FPGA-specific netlists, CPLD-specific netlists, etc.). As used herein, the term “netlist” comprises various intermediate hardware-specific description formats comprising information regarding the particular hardware elements required to implement a hardware design and the relationship among those elements. For example, the back end may generate a VHDL file containing a hardware description of the graphical program. An FPGA-specific netlist may then be created from the VHDL file, wherein the netlist comprises information regarding the various FPGA components (and the logical relationship among those components) necessary to implement the hardware design described in the VHDL file.

The process of converting a hardware description such as a VHDL file into a netlist may be performed by readily available synthesis tools, as is well known in the art. The netlist may then be compiled into a hardware program file (also called a software bit stream) which may be used to program a programmable logic device (PLD) or programmable hardware element such as an FPGA or a CPLD, or other types of (re)configurable hardware devices. In one embodiment, the hardware description is converted into an FPGA program file.

The step of compiling the resulting netlist into a PLD program file may use a library of pre-compiled function blocks to aid in the compilation, as well as hardware target specific information. The library of pre-compiled function blocks may include netlist libraries for programmatic structures, such as for/next loops, while/do loops, case structures, and sequence structures, among others. This allows the user to program with high-level programming constructs, such as iteration, looping, and case structures, while allowing the resulting program to execute directly in hardware.

The resulting bit stream may then be transferred to a PLD or other (re)configurable hardware device such as an FPGA to produce a programmed hardware device equivalent to the graphical program or block diagram.

One embodiment of the invention comprises a general purpose computer system which includes a CPU and memory, and an interface card or device coupled to the computer system which includes a programmable hardware element or logic, such as an FPGA. The computer system may include a graphical programming system which is used to develop the graphical program. The computer system may also include software which is operable to convert the graphical program into an abstract hardware graph, and then convert the abstract hardware graph into a hardware description. The computer system further may include a synthesis tool which is used to compile the hardware description into a netlist, as well as other tools for converting the netlist into a PLD program file for uploading into the PLD. The computer system may further include a library of pre-compiled function blocks which are used by the synthesis tool to aid in creating the netlist.

As described above, in one embodiment, a user creates a graphical program and then the system and method of the present invention may operate to convert at least a portion of the graphical program into a hardware description. The hardware description may then be converted to a hardware program which executes on a PLD. The present system and method thus extends the traditional model of software development to include the possibility of running at least a portion (or all) of a graphical program on hardware, instead of running the entire graphical program on the general-purpose processor.

However, it is noted that the use of the present invention is not limited to the creation of application programs as described above. One embodiment comprises a system and method to create an abstract hardware graph from a graphical program. Various back end programs may be called to generate disparate types of hardware descriptions from the abstract hardware graph. These hardware descriptions may be used for purposes other than creating a bit stream for programming a PLD. For example, a hardware description may be used in the process of creating and printing a traditional circuit board which may be produced in mass quantities.

It is also noted that various back end programs may be called to generate software source code, such as C language code, from the abstract hardware graph. As described in detail below, the abstract hardware graph (VDiagram tree) generated by the present method may contain information regarding the execution order and data flow of the graphical program. This information may be used to establish a procedural order in a traditional programming language. Also, since the execution order for portions of a graphical program may be inherently parallel, the system and method described herein are well-suited for creating a program in a text-based parallel programming language.

In one embodiment, during or after the user creates the graphical program, the method may then estimate and optionally display one or more of the size and cost of a hardware implementation of the graphical program. In one embodiment, for example where the graphical program implements a measurement function, the graphical program manipulates one or more hardware resources of the instrument. Examples of hardware resources include A/D converters, D/A converters, timers, counters, clocks, memories, pixel processors, etc. In this embodiment, creating the graphical program includes displaying an indication of usage, or the status of usage, of the one or more hardware resources during creation of the graphical program.

In another embodiment, the user may insert a probe at a location in the graphical program, wherein the probe is operable to display data generated at the location during execution of the graphical program. In this embodiment, the programmable hardware element includes the probe element for implementing probing in the programmable hardware element. It is noted that non real-time clock cycle observations are possible in current FPGA's, such as Xilinx FPGAs, without external/explicit hooks. However, explicit probes/probe interfaces on the program of the FPGA allow external visibility and real-time performance.

In one embodiment, the target device including the programmable hardware element or reconfigurable hardware (or PLD) being programmed comprises an instrument or measurement device. The instrument or measurement device may be a “stand-alone” instrument, or a measurement device or card coupled to or comprised in a computer system. Example instruments or measurement devices include a data acquisition device or card, a GPIB interface card or GPIB instrument, a VXI interface card or VXI instrument card, a PXI card or device, an image processing (or machine vision) device or card, a smart camera, a smart sensor, a computer-based instrument device or card such as an oscilloscope or multimeter device, a motion control device or card, a traditional instrument such as a stand-alone oscilloscope or multimeter, or other measurement or sensing device. The target device including the reconfigurable hardware or PLD being programmed may also comprise an automation or control device, such as a programmable logic controller, a fieldbus card or device, a CAN (Controller Area Network) device or card, a distributed data acquisition device or module, or other type of automation or control device. The target device being programmed may comprise an instrument or device connected to the computer, such as through a serial connection. It is noted that the target instrument or device being programmed, which includes a programmable hardware element or other (re)configurable hardware element, can take any of various forms, as desired.

In the above embodiments, the user may create a graphical program or block diagram which implements a measurement function. For example, where the target device is a computer-based reconfigurable instrument, the measurement function may incorporate oscilloscope functionality to perform a desired measurement. Where the target device is am image acquisition device or smart camera, the measurement function may comprise an image processing or machine vision function that processes an image. Where the target device is a motion control device, the function may comprise a motion control algorithm specified by the user to control a motion device to move an object.

The method may then generate a hardware description based on at least a portion of the graphical program, wherein the hardware description describes a hardware implementation of the at least a portion of the graphical program. The programmable hardware element is then configured in the instrument or device utilizing the hardware description, wherein after configuration the programmable hardware element implements a hardware implementation of the at least a portion of the graphical program. After the hardware element has been configured, the system may be executed. During execution, the instrument may acquire a signal from an external source, and the programmable hardware element in the instrument may execute to perform the measurement function on the signal.

As one example, where the instrument is an image acquisition device or smart camera, the programmable hardware element in the image acquisition device or smart camera can be configured to perform an image processing (or machine vision) function. In this example embodiment, a graphical program may first be created, either by the user or automatically from another representation, such as a prototype. The graphical program may implement an image processing or machine vision function. The graphical program may include a user interface portion and a block diagram portion. A hardware description may then be generated based on the block diagram portion of the graphical program, wherein the hardware description describes a hardware implementation of the block diagram portion of the graphical program. The programmable hardware element in the image acquisition device or smart camera may then be configured utilizing the hardware description. After configuration, the programmable hardware element implements a hardware implementation of the block diagram portion of the graphical program.

During execution, a camera associated with the image acquisition device, or comprised in the smart camera, may acquire an image of an object. For example, the image acquisition device or smart camera may be used in a machine vision inspection application, or a manufacturing assembly application. The programmable hardware element in the image acquisition device or smart camera may then receive the acquired image of the object. The programmable hardware element in the image acquisition device or smart camera may then execute to perform the image processing function (or machine vision function) on the image. The results of this image processing may then be used to make a decision in a machine vision inspection application or may be used to perform an operation in a manufacturing assembly application.

During execution of the programmable hardware element in the image acquisition device or smart camera, the user interface portion may be presented on a display. A user or operator may use the displayed user interface portion to view or control the image processing function (or machine vision function).

Thus the method may operate to configure an instrument, measurement device, or control device to perform measurement functions, wherein the instrument includes a programmable hardware element.

As another example, where the instrument or device is a motion control device, the programmable hardware element in the motion control device can be configured to perform a motion function. In this example embodiment, a graphical program may first be created, either by the user or automatically from another representation, such as a prototype. The graphical program may implement a motion function, i.e., the graphical program may describe a motion sequence. The graphical program may include a user interface portion and a block diagram portion. A hardware description may then be generated based on the block diagram portion of the graphical program, wherein the hardware description describes a hardware implementation of the block diagram portion of the graphical program. The programmable hardware element in the motion control device may then be configured utilizing the hardware description. After configuration, the programmable hardware element implements a hardware implementation of the block diagram portion of the graphical program.

The motion control device may be used in a machine vision inspection application to move an object being inspected or to move a camera. The motion control device may also be used in a manufacturing assembly application to move a part or object being assembled, or may be used in a robotics application, among others. During the respective application, the programmable hardware element in the motion control device may then execute to move the motion control device accordingly.

During execution of the programmable hardware element in the motion control device, the user interface portion may be presented on a display. A user or operator may use the displayed user interface portion to view or control the motion control function.

Thus the method may operate to configure an instrument (which includes various types of measurement devices and/or control devices) to perform measurement functions, wherein the instrument includes a programmable hardware element.

BRIEF DESCRIPTION OF THE DRAWINGS

A better understanding of the present invention can be obtained when the following detailed description of the preferred embodiment is considered in conjunction with the following drawings, in which:

FIG. 1A illustrates an instrumentation control system according to one embodiment of the invention;

FIG. 1B illustrates an industrial automation system according to one embodiment of the invention;

FIG. 2 illustrates a computer system coupled to a smart camera according to one embodiment of the invention;

FIGS. 3A and 3B illustrate image processing systems according to embodiments of the invention;

FIG. 4 is a block diagram of the computer system of FIGS. 1A and 1B ;

FIGS. 5A , 5 B and 5 C are block diagrams illustrating an interface card or device configured with a programmable hardware element according to various embodiments of the present invention;

FIG. 5D is a block diagram illustrating a smart camera configured with a programmable hardware element according to an embodiment of the present invention;

FIG. 6 is a flowchart diagram illustrating configuration of an instrument according to one embodiment of the invention;

FIG. 6A is a flowchart diagram illustrating configuration of an image acquisition device or smart camera according to one embodiment of the invention;

FIG. 7 illustrates the conversion of a graphical program to hardware and software implementations;

FIG. 8 illustrates the generation of various types of hardware and software descriptions from a VDiagram tree;

FIG. 9 illustrates the conversion of a graphical program into a hardware description and the use of the hardware description to program an FPGA;

FIG. 10 illustrates the conversion of a graphical program into a software source code description and the compilation and linkage of the source code;

FIG. 11 is a flowchart diagram illustrating operation of one embodiment of the invention, including compiling a first portion of the graphical program into machine language and converting a second portion of the graphical program into a hardware implementation;

FIG. 12 is a more detailed flowchart diagram illustrating creation of a graphical program according to the preferred embodiment;

FIG. 13 is a graphical representation of a VDiagram and the relationship among its elements;

FIG. 14 is an example VDiagram hierarchy illustrating the relationship of a parent VDiagram, child VDiagram, and srnholder for a simple graphical program;

FIG. 15 is a flowchart diagram illustrating the process of building a VDiagram tree for a graphical program;

FIG. 16 is a simple graphical program used as an example of building a VDiagram;

FIG. 17 is a more detailed flowchart diagram illustrating the step adding VDiagram information for each object in a graphical program;

FIG. 18 is a block diagram representing a VDiagram for the example program of FIG. 16 ;

FIG. 19 is an example graphical program containing a while loop structure;

FIGS. 20A and 20B are partial graphical programs illustrating aspects of the graphical program of FIG. 19 ;

FIG. 21 is a flowchart diagram illustrating how the flow of data from a parent VDiagram to a child VDiagram is represented;

FIG. 22 is a block diagram illustrating the relationship among structure controllers, srnholders, and child VDiagrams;

FIG. 23 is a block diagram illustrating how a structure controller drives the enable ports for a VDiagram representing a while loop subframe;

FIG. 24 is an example program hierarchy in which the same global variable is read in one subprogram and written in another subprogram;

FIGS. 25 and 26 are block diagrams illustrating the hardware represented by VDiagrams for various subprograms of FIG. 24 ;

FIGS. 27 and 28 are block diagrams illustrating the ports, components, and connections added to VDiagrams for various subprograms of FIG. 24 ;

FIG. 29 is a block diagram illustrating the ports, signals, and components that are created to manage a global variable resource with two read and two write access points;

FIG. 30 is a flowchart diagram illustrating operation where the method exports an output terminal into a hardware description;

FIG. 31 is a flowchart diagram illustrating operation where the method exports an input terminal into a hardware description;

FIG. 32 is a flowchart diagram illustrating how a back end program may generate VHDL syntax from a VDiagram tree;

FIGS. 33 and 34 illustrate a simple example of operation of the present invention, wherein FIG. 33 illustrates a simple graphical program and FIG. 34 is a conceptual diagram of the hardware description of the graphical program of FIG. 33 ;

FIGS. 35-37 illustrate another example of operation of the present invention, wherein FIG. 35 illustrates a graphical program, FIG. 36 illustrates a tree of data structures created in response to the graphical program of FIG. 35 , and FIG. 37 is a conceptual diagram of the hardware description of the graphical program of FIG. 35 ;

FIGS. 38-39 illustrate a graphical program called example1.vi.

While the invention is susceptible to various modifications and alternative forms specific embodiments are shown by way of example in the drawings and will herein be described in detail. It should be understood however, that drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed. But on the contrary the invention is to cover all modifications, equivalents and alternative following within the spirit and scope of the present invention as defined by the appended claims.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Incorporation by Reference

The following U.S. Patents and patent applications are hereby incorporated by reference in their entirety as though fully and completely set forth herein.

U.S. Pat. No. 4,914,568 titled “Graphical System for Modeling a Process and Associated Method,” issued on Apr. 3, 1990.

U.S. Pat. No. 5,481,741 titled “Method and Apparatus for Providing Attribute Nodes in a Graphical Data Flow Environment”.

U.S. Pat. No. 6,219,628 titled “System and Method for Configuring an Instrument to Perform Measurement Functions Utilizing Conversion of Graphical Programs into Hardware Implementations”.

U.S. Pat. No. 6,173,438 titled “Embedded Graphical Programming System” filed Aug. 18, 1997, whose inventors are Jeffrey L. Kodosky, Darshan Shah, Samson DeKey, and Steve Rogers.

U.S. patent application Ser. No. 09/745,023 titled “System and Method for Programmatically Generating a Graphical Program in Response to Program Information,” filed Dec. 20, 2000.

U.S. patent application Ser. No. 09/595,003 titled “System and Method for Automatically Generating a Graphical Program to Implement a Prototype”, filed Jun. 13, 2000.

U.S. patent application Ser. No. 09/587,682 titled “System and Method for Automatically Generating a Graphical Program to Perform an Image Processing Algorithm”, filed on Jun. 5, 2000.

The LabVIEW and BridgeVIEW graphical programming manuals, including the “G Programming Reference Manual”, available from National Instruments Corporation, are also hereby incorporated by reference in their entirety.

FIGS. 1A , 1 B, 2 , 3 A and 3 B—Instrumentation and Industrial Automation Systems

The following describes embodiments of the present invention involved with performing test and/or measurement functions and/or controlling and/or modeling instrumentation or industrial automation hardware. However, it is noted that the present invention can be used to create hardware implementations of graphical programs for a plethora of applications and are not limited to instrumentation or industrial automation applications. In other words, the following description is exemplary only, and the present invention may be used in any of various types of systems. Thus, the system and method of the present invention is operable for automatically creating hardware implementations of graphical programs or graphical code for any of various types of applications, including the control of other types of devices such as multimedia devices, video devices, audio devices, telephony devices, Internet devices, etc., as well as general purpose software applications such as word processing, spreadsheets, network control, games, etc.

FIG. 1A illustrates an exemplary instrumentation control system 100 . The system 100 comprises a host computer 102 which connects to one or more instruments. The host computer 102 may comprise a CPU, a display screen, memory, and one or more input devices such as a mouse or keyboard as shown. The computer 102 may operate with the one or more instruments to analyze, measure or control a unit under test (UUT) or process 150 . Alternatively, the computer 102 may be used only to configure a programmable hardware element in one or more of the instruments to perform a measurement or control function. As used herein, the term “programmable hardware element” is intended to include various types of programmable hardware, reconfigurable hardware, programmable logic, or field-programmable devices (FPDs), such as one or more FPGAs (Field Programmable Gate Arrays), or one or more PLDs (Programmable Logic Devices), such as one or more Simple PLDs (SPLDs) or one or more Complex PLDs (CPLDs), or other types of programmable hardware.

The one or more instruments may include a GPIB instrument 112 and associated GPIB interface card 122 , a data acquisition board 114 and associated signal conditioning circuitry 124 , a VXI instrument 116 , a PXI instrument 118 , a video device or camera 132 and associated image acquisition (or machine vision) card 134 , a motion control device 136 and associated motion control interface card 138 , and/or one or more computer based instrument cards 142 , among other types of devices.

The GPIB instrument 112 may be coupled to the computer 102 via the GPIB interface card 122 provided by the computer 102 . In a similar manner, the video device 132 may be coupled to the computer 102 via the image acquisition card 134 , and the motion control device 136 may be coupled to the computer 102 through the motion control interface card 138 . The data acquisition board 114 may be coupled to the computer 102 , and may interface through signal conditioning circuitry 124 to the UUT. The signal conditioning circuitry 124 may comprise an SCXI (Signal Conditioning eXtensions for Instrumentation) chassis comprising one or more SCXI modules 126 .

The GPIB card 122 , the image acquisition card 134 , the motion control interface card 138 , and the DAQ card 114 are typically plugged in to an I/O slot in the computer 102 , such as a PCI bus slot, a PC Card slot, or an ISA, EISA or MicroChannel bus slot provided by the computer 102 . However, these cards 122 , 134 , 138 and 114 are shown external to computer 102 for illustrative purposes. These devices may also be connected to the computer 102 through a serial bus or through other means.

The VXI chassis or instrument 116 may be coupled to the computer 102 via a VXI bus, MXI bus, or other serial or parallel bus provided by the computer 102 . The computer 102 may include VXI interface logic, such as a VXI, MXI or GPIB interface card (not shown), which interfaces to the VXI chassis 116 . The PXI chassis or instrument may be coupled to the computer 102 through the computer's PCI bus.

A serial instrument (not shown) may also be coupled to the computer 102 through a serial port, such as an RS-232 port, USB (Universal Serial bus) or IEEE 1394 or 1394.2 bus, provided by the computer 102 . In typical instrumentation control systems an instrument will not be present of each interface type, and in fact many systems may only have one or more instruments of a single interface type, such as only GPIB instruments.

In the embodiment of FIG. 1A , one or more of the devices connected to the computer 102 include a programmable hardware element according to an embodiment of the present invention. For example, one or more of the GPIB card 122 , the DAQ card 114 , a VXI card in VXI chassis 116 , a PXI card in PXI chassis 118 , the image acquisition board 134 , the motion control board 138 , or a computer-based instrument 142 , include a programmable hardware element according to an embodiment of the present invention. Alternatively, or in addition, one or more of the GPIB instrument 112 , the VXI instrument 116 , the serial instrument, or another type of device include a programmable hardware element according to an embodiment of the present invention. The programmable hardware element may be configured to perform a measurement function. Where the programmable hardware element is comprised on a VXI or PXI card, the programmable hardware may also or instead be configured to control one or more other VXI or PXI cards, respectively, comprised in the respective chassis. In one embodiment, the programmable hardware comprises a field programmable gate array (FPGA).

The instruments may be coupled to a unit under test (UUT) or process 150 , or may be coupled to receive field signals, typically generated by transducers. The system 100 may be used in a data acquisition and control application, in a test and measurement application, an image processing or machine vision application, a process control application, a man-machine interface application, a simulation application, or a hardware-in-the-loop validation application.

FIG. 1B illustrates an exemplary industrial automation system 160 . The industrial automation system 160 is similar to the instrumentation or test and measurement system 100 shown in FIG. 1 A. Elements which are similar or identical to elements in FIG. 1A have the same reference numerals for convenience. The system 160 may comprise a computer 102 which connects to one or more devices or instruments. The computer 102 may comprise a CPU, a display screen, memory, and one or more input devices such as a mouse or keyboard as shown. The computer 102 may operate with the one or more devices to a process or device 150 to perform an automation function, such as MMI (Man Machine Interface), SCADA (Supervisory Control and Data Acquisition), portable or distributed data acquisition, process control, advanced analysis, or other control. Alternatively, the computer 102 may be used only to configure a programmable hardware element on one or more of the instruments or devices to perform a measurement, automation or control function.

The one or more devices may include a data acquisition board 114 and associated signal conditioning circuitry 124 , a PXI instrument 118 , a video device 132 and associated image acquisition card 134 , a motion control device 136 and associated motion control interface card 138 , a fieldbus device 170 and associated fieldbus interface card 172 , a PLC (Programmable Logic Controller) 176 , a serial instrument 182 and associated serial interface card 184 , or a distributed data acquisition system, such as the Fieldpoint system available from National Instruments, among other types of devices.

The DAQ card 114 , the PXI chassis 118 , the video device 132 , and the image acquisition card 136 may be connected to the computer 102 as described above. The serial instrument 182 may be coupled to the computer 102 through a serial interface card 184 , or through a serial port, such as an RS-232 port, provided by the computer 102 . The PLC 176 may couple to the computer 102 through a serial port, Ethernet port, or a proprietary interface. The fieldbus interface card 172 may be comprised in the computer 102 and may interface through a fieldbus network to one or more fieldbus devices. Each of the DAQ card 114 , the serial card 184 , the fieldbus card 172 , the image acquisition card 134 , and the motion control card 138 are typically plugged in to an I/O slot in the computer 102 as described above. However, these cards 114 , 184 , 172 , 134 , and 138 are shown external to computer 102 for illustrative purposes. In typical industrial automation systems a device will not be present of each interface type, and in fact many systems may only have one or more devices of a single interface type, such as only PLCs. The devices may be coupled to the device or process 150 .

In the embodiment of FIG. 1B , one or more of the devices connected to the computer 102 may include a programmable hardware element. For example, one or more of the data acquisition board 114 , the serial instrument 142 , the serial interface card 152 , the PLC 144 , or the fieldbus network card 156 may include a programmable hardware element according to an embodiment of the present invention. The programmable hardware may comprise a field programmable gate array (FPGA).

As used herein, the term “instrument” is intended to include any of the devices that are adapted to be connected to a computer system as shown in FIGS. 1A and 1B , traditional “stand-alone” instruments, as well as other types of measurement and control devices. The term “measurement function” may include any type of data acquisition, measurement or control function, such as that implemented by the instruments shown in FIGS. 1A and 1B . For example, the term “measurement function” includes acquisition and/or processing of an image. As described below, a graphical program may be created that implements a measurement function, and the programmable hardware element on an instrument may be configured with a hardware implementation of the graphical program. After the programmable hardware element on an instrument has been configured with a hardware implementation of a graphical program, the instrument may be operable to acquire a signal, and perform the measurement function on the acquired signal.

In the embodiments of FIGS. 1A and 1B above, the programmable hardware element may be comprised in a device which connects to the computer 102 over a network, such as the Internet. In one embodiment, the user operates to select a target device from a plurality of possible target devices for programming or configuration according to the present invention. Thus the user may create a graphical program on a computer and configure a programmable hardware element on a target device that is remotely located from the computer and coupled to the computer through a network.

Referring again to FIGS. 1A and 1B , the computer 102 may include a memory medium on which computer programs according to the present invention may be stored. As used herein, the term “memory medium” includes a non-volatile medium, e.g., a magnetic media or hard disk, or optical storage; a volatile medium, such as computer system memory, e.g., random access memory (RAM) such as DRAM, SRAM, EDO RAM, RAMBUS RAM, DR DRAM, etc.; or an installation medium, such as a CD-ROM or floppy disks 104 , on which the computer programs according to the present invention may be stored for loading into the computer system. The term “memory medium” may also include other types of memory or combinations thereof.

The memory medium may be comprised in the computer 102 where the programs are executed or may be located on a second computer which is coupled to the computer 102 through a network, such as a local area network (LAN), a wide area network (WAN), or the Internet. In this instance, the second computer operates to provide the program instructions through the network to the computer 102 for execution.

The software programs of the present invention are stored in a memory medium of the respective computer 102 , or in a memory medium of another computer, and executed by the CPU. The CPU executing code and data from the memory medium thus comprises a means for converting graphical programs into hardware implementations according to the steps described below.

The memory medium may store a graphical programming development system for developing graphical programs. The memory medium may also store one or more computer programs which are executable to convert at least a portion of a graphical program into a form for configuring or programming the programmable hardware element.

The instruments or devices in FIGS. 1A and 1B are controlled by or configured by graphical software programs, optionally a portion of which execute on the CPU of the computer 102 , and at least a portion of which are downloaded to the programmable hardware element on an instrument or device for hardware execution. The graphical software programs which perform data acquisition, analysis and/or presentation, e.g., for measurement, instrumentation control, industrial automation, or simulation, may be referred to as virtual instruments.

In the present application, the term “graphical program” or “block diagram” is intended to include a program comprising graphical code, e.g., two or more nodes or icons interconnected in one or more of a data flow, control flow, or execution flow format, wherein the interconnected nodes or icons may visually indicates the functionality of the program. Thus the terms “graphical program” or “block diagram” are each intended to include a program comprising a plurality of interconnected nodes or icons which visually indicates the functionality of the program. A graphical program may comprise a block diagram and may also include a user interface portion or front panel portion. The user interface portion may be contained in the block diagram or may be contained in one or more separate panels or windows. A graphical program may be created using any of various types of systems which are used to develop or create graphical code or graphical programs, including LabVIEW, DASYLab, and DiaDem from National Instruments, Visual Designer from Intelligent Instrumentation, Agilent VEE (Visual Engineering Environment), Snap-Master by HEM Data Corporation, SoftWIRE from Measurement Computing, ObjectBench by SES (Scientific and Engineering Software), Simulink from the MathWorks, WiT from Coreco, Vision Program Manager from PPT Vision, Hypersignal, VisiDAQ, VisSim, and Khoros, among others. In the preferred embodiment, the system uses the LabVIEW graphical programming system available from National Instruments.

Although in the preferred embodiment the graphical programs and programmable hardware are involved with measurement applications, including data acquisition/generation, analysis, and/or display, and for controlling or modeling instrumentation or industrial automation hardware, as noted above the present invention can be used to create hardware implementations of graphical programs for a plethora of applications and is not limited to measurement, instrumentation or industrial automation applications. In other words, FIGS. 1A and 1B are exemplary only, and the present invention may be used in any of various types of systems. Thus, the system and method is operable for automatically creating hardware implementations of graphical programs or graphical code for any of various types of applications, including general purpose software applications such as word processing, spreadsheets, network control, games, etc.

FIG. 2

FIG. 2 illustrates a computer system 102 coupled to a smart camera 190 . The smart camera is an example of an image acquisition device. As used herein, the term “image acquisition device” is intended to include any of various types of devices that are operable to acquire and/or store an image. An image acquisition device may also optionally be further operable to analyze or process the acquired or stored image. Examples of an image acquisition device include the image acquisition (or machine vision) card (also called a video capture board) 134 , a device external to a computer that operates similarly to the image acquisition card 134 , a smart camera, a robot having machine vision, and other similar types of devices.

As used herein, the terms “image processing” and “machine vision” are used interchangeably to refer to the processing of images to extract useful information from the image or determine characteristics of the image (or to determine characteristics of one or more objects displayed in the image). The term “image processing” is used herein to refer to both “image processing” and “machine vision”, to the extent these terms have different meanings. The term “image processing function” includes tools such as edge detection, blob analysis, pattern matching, and other image processing functions. The term “image processing function” may also include an operation or decision that is performed in response to the information extracted or characteristics determined from the image. The term “image processing function” is also intended to include an image processing (or machine vision) algorithm that combines a sequence of two or more image processing functions or tools and/or decision operations that process an image in a desired way or which implement an image processing or machine vision application, such as part inspection, automated assembly, etc.

The computer system 102 shown in FIG. 2 may include a memory medium as described above. As noted above, the memory medium may store a graphical programming development system for developing graphical programs. The graphical programming development system may be used to develop a graphical program that implements an image processing function. In this example, one or more of the nodes in the graphical program may implement or represent an image processing function.

The memory medium may also store one or more computer programs which are executable to convert at least a portion of a graphical program into a form for configuring or programming the programmable hardware or FPGA comprised in the smart camera 190 .

The smart camera 190 may include a programmable hardware element (programmable or reconfigurable hardware) according to an embodiment of the present invention, e.g., an FPGA. The programmable hardware element in the smart camera 190 may be configured with a graphical program that implements the image processing function. The smart camera 190 may also comprise a camera coupled to the programmable hardware element. The smart camera 190 may also include a memory (a memory medium) coupled to the camera that stores an acquired image. If the smart camera 190 includes an analog camera, the smart camera 190 may further include analog to digital (A/D) logic for converting analog image signals into a digital image for storage in the memory. The smart camera 190 may also optionally include timer/counter logic that may perform timing/counting operations, e.g., during operation of the programmable hardware element. An embodiment of the smart camera 190 is shown in FIG. 6 D.

FIGS. 3A and 3B

FIGS. 3A and 3B illustrate image processing or machine vision systems according to embodiments of the invention. The image processing system of FIG. 3A may comprise a computer 102 and a smart camera 190 , and may further include a motion control device 192 . The image processing system of FIG. 3B may comprise smart camera 190 and motion control device 190 , and may not include computer system 102 .

The smart camera 190 may include a digital camera that acquires a digital video signal which comprises an image, or a sequence of images, or other data desired to be acquired. The smart camera 190 may instead include an analog camera that acquires an analog video signal, and the smart camera 190 may further include A/D converters for converting the analog video signal into a digital image.

The smart camera 190 may include a programmable hardware element that has been configured with a hardware implementation corresponding to a graphical program. The programmable hardware element may be configured to perform an image processing function. Thus a graphical program may have been first created that performs the image processing function, and the graphical program may then have been converted into a hardware implementation that is programmed onto the programmable hardware element.

The digital video signal or digital image is provided to the programmable hardware element in the smart camera 190 , wherein the image processing function is performed.

In the embodiment of FIG. 3A , the programmable hardware element in the smart camera 190 may perform a portion or all of the image processing function, and the computer 102 may perform a portion of the image processing function. For example, the programmable hardware element in the smart camera 190 may perform the actual processing of the image to determine characteristics of the image, and the computer 102 may then perform an operation based on this result, such as rejecting a part from an assembly line. As another example, the programmable hardware element in the smart camera 190 may perform the processing of the image to determine characteristics of the image, and may also optionally perform an operation based on this result, and the computer system 102 may execute a user interface for the system, e.g., the computer system 102 may execute a user interface portion of a graphical program, wherein the block diagram of this graphical program was used to configure the programmable hardware element in the smart camera 190 .

In the embodiment of FIG. 3B , the programmable hardware element in the smart camera 190 may perform all of the desired image processing function, including optionally performing an operation based on determined characteristics of the image, and hence the computer system 102 is not necessary during operation.

In the embodiments of FIGS. 3A and 3B , the programmable hardware element in the smart camera 190 (or the computer system 102 in FIG. 3A ) may control the motion control device 192 . In an alternate embodiment, the motion control device 192 may also include a programmable hardware element that has been configured with a hardware implementation corresponding to a graphical program. The programmable hardware element may be configured to perform a motion control function. Thus a graphical program may have been first created that performs the motion control function, and the graphical program may then have been converted into a hardware implementation that is programmed onto the programmable hardware element in the motion control device 192 . Examples of motion control functions include moving a part or object to be imaged by a camera, rejecting a part on an assembly line, or placing or affixing components on a part being assembled, or a robotics application, among others.

FIG. 4 —Computer Block Diagram

FIG. 4 is an exemplary block diagram of the computer 102 of FIGS. 1A , 1 B, and 3 A. The elements of a computer not necessary to understand the operation of the present invention have been omitted for simplicity. The computer 102 may include at least one central processing unit (CPU) or processor 160 which is coupled to a processor or host bus 162 . The CPU 160 may be any of various types, including an x86 processor, a PowerPC processor, a CPU from the Motorola family of processors, a CPU from the SPARC family of RISC processors, as well as others. Main memory 166 is coupled to the host bus 162 by means of memory controller 164 . The main memory 166 stores a graphical programming system, and also stores software for converting at least a portion of a graphical program into a hardware implementation. This software will be discussed in more detail below. The main memory 166 may also store operating system software as well as the software for operation of the computer system, as well known to those skilled in the art.

The host bus 162 is coupled to an expansion or input/output bus 170 by means of a bus controller 168 or bus bridge logic. The expansion bus 170 is preferably the PCI (Peripheral Component Interconnect) expansion bus, although other bus types can be used. The expansion bus 170 may include slots for various devices, the examples shown being data acquisition board 114 , GPIB interface card 122 which provides a GPIB bus interface to the GPIB instrument 112 , and an image acquisition device 134 . The computer 102 may further comprises a video display subsystem 180 and hard drive 182 coupled to the expansion bus 170 .

One or more of the interface cards or devices (e.g., those shown in FIGS. 1A , 1 B and 2 ) may be coupled to or comprised in the computer 102 and may comprise a programmable hardware element, such as a field programmable gate array (FPGA). The computer 102 may also include a network interface for coupling to a network, wherein the target device or instrument containing the programmable hardware may be coupled to the network. Thus the computer 102 may be used for configuring programmable hardware in a target device over a network.

FIGS. 5 A- 5 D—Programmable Hardware Diagram

FIG. 5A is a block diagram illustrating a device, e.g., an interface card, configured with programmable hardware according to one embodiment. It is noted that FIG. 6A is exemplary only, and an interface card or device configured with programmable hardware according to the present invention may have various architectures or forms, as desired. For example, the device may be internal or external to the computer 102 , and may be connected to the computer through a network, such as the Internet. The interface card illustrated in FIG. 5A may be the DAQ interface card 114 shown in either of FIG. 1A , 1 B, or 4 , or may be the image acquisition device shown in FIG. 1A , 1 B, or 4 . However, as noted above, the programmable hardware may be included on any of the various devices shown in FIG. 1A or 1 B, or on other devices, as desired. Also, the programmable hardware illustrated in FIG. 5A is an FPGA, but the device may include another type of programmable hardware instead, such as a CPLD or other type of (re)configurable hardware. In FIGS. 5A-5C , the interface card is described as being DAQ card 114 .

As shown in FIG. 6A , the interface card 114 A may include an I/O connector 202 which is coupled for receiving signals. In the embodiments of FIGS. 1A and 1B , the I/O connector 202 presents analog and/or digital connections for receiving/providing analog or digital signals. The I/O connector 202 may be adapted for coupling to SCXI conditioning logic 124 and 126 , or may be adapted to be coupled directly to a unit under test 130 or process or system 160 .

The interface card 114 A may also include data acquisition (DAQ) logic 204 . As shown, the data acquisition logic 204 may comprise analog to digital (A/D) converters, digital to analog (D/A) converters, timer counters (TC) and signal conditioning (SC) logic as shown. The DAQ logic 204 may provide the data acquisition functionality of the DAQ card 114 . In one embodiment, the DAQ logic 204 comprises 4 A/D converters, 4 D/A converters, 23 digital I/Os, a RTSI connector, and a TIO. This extra hardware is useful for signal processing and motion control applications. The programmable hardware element or FPGA 206 can access these resources directly, thereby enabling creation of very powerful measurement, DSP and control applications, among others.

The interface card 114 A includes a programmable hardware element 206 . In one embodiment, the programmable hardware 206 comprises a field programmable gate array (FPGA) such as those available from Xilinx, Altera, etc. The programmable hardware element 206 may be coupled to the DAQ logic 204 and may also be coupled to the local bus interface 208 . Thus a graphical program can be created on the computer 102 , or on another computer in a networked system, and at least a portion of the graphical program can be converted into a hardware implementation form for execution in the FPGA 206 . The portion of the graphical program converted into a hardware implementation form is preferably a portion which requires fast and/or real-time execution

In the embodiment of FIG. 5A , the interface card 114 A may further include a dedicated on-board processor 212 and memory 214 . This enables a portion of the graphical program to be compiled into machine language for storage in the memory 214 and execution by the processor 212 . This is in addition to a portion of the graphical program being converted into a hardware implementation form in the FPGA 206 . Thus, in one embodiment, after a graphical program has been created, a portion of the graphical program may be compiled for execution on the embedded processor 212 and executes locally on the interface card 114 A via the processor 212 and memory 214 , and a second portion of the graphical program may be translated or converted into a hardware executable format and uploaded to the FPGA 206 for hardware implementation.

As one example, a first portion of a block diagram (that requires real time or fast execution) of a graphical program may be converted into a hardware executable format and downloaded to the FPGA 206 for hardware implementation, and a second portion of a block diagram (that may not require real time performance) may be stored in the memory 214 as program instructions and executed by the processor 212 , in either a compiled or interpreted manner. As another example, a portion or all of the block diagram portion of the graphical program may be converted into a hardware executable format and downloaded to the FPGA 206 for hardware implementation, and a user interface portion (or front panel portion) of the graphical program may be stored in the memory 214 as program instructions and executed by the processor 212 , in either a compiled or interpreted manner. Thus the portion of the graphical program which requires the most real time or deterministic performance may be executed directly in hardware for fast operation, and other parts of the block diagram, or the user interface portion, which may not require real time performance, may execute on the processor 212 . Where the processor executes the user interface portion, the processor may then send resulting signals to the video subsystem for display of the user interface on the computer display.

As shown, the interface card 114 A may further include bus interface logic 216 and a control/data bus 218 . In one embodiment, the interface card 114 A is a PCI bus-compliant interface card adapted for coupling to the PCI bus of the host computer 102 , or adapted for coupling to a PXI (PCI eXtensions for Instrumentation) bus. The bus interface logic 216 and the control/data bus 218 thus present a PCI or PXI interface.

The interface card 114 A may also include local bus interface logic 208 . In one embodiment, the local bus interface logic 208 may present a RTSI (Real Time System Integration) bus for routing timing and trigger signals between the interface card 114 A and one or more other devices or cards.

In one embodiment, the interface card 114 A also includes a non-volatile memory (not shown) coupled to the programmable hardware element 206 . The non-volatile memory may be operable to store the hardware description received from the host computer system to enable execution of the hardware description in the programmable hardware element 206 prior to or during booting of the computer system 102 .

In the embodiment of FIG. 5B , the processor 212 and memory 214 are not included on the interface card 114 B, and thus only the portion of the graphical program which is converted into hardware implementation form is uploaded to the FPGA 206 . Thus in the embodiment of FIG. 5B , any supervisory control portion of the graphical program which is necessary or desired to execute on a programmable processor in software may be executed by the host CPU in the computer system 102 , and is not executed locally by a processor on the interface card 114 B.

In the embodiment of FIG. 5C , the processor 212 is not included on the interface card 114 C, i.e., the interface card 114 C includes the FPGA 206 and the memory 214 . In this embodiment, the memory 214 may be used for storing FPGA state information.

FIG. 5D illustrates a block diagram of smart camera 190 . As shown, the smart camera 190 may include a programmable hardware element (programmable or reconfigurable hardware) 206 according to an embodiment of the present invention, e.g., an FPGA. The programmable hardware element 206 in the smart camera 190 may be configured with a graphical program that implements an image processing function. The smart camera 190 may also comprise a camera 282 coupled to the programmable hardware element 206 . The smart camera 190 may also include a memory (a memory medium) 284 coupled to the camera that stores an acquired image. The memory 284 may be designed to store a portion of an image, a whole image, or two or more images. The memory 284 may include a memory controller (not shown). If the smart camera 190 includes an analog camera, the smart camera 190 may further include analog to digital (A/D) logic (not shown) for converting analog image signals into a digital image for storage in the memory. The smart camera 190 may also optionally include timer/counter logic 286 that may perform timing/counting operations, e.g., during operation of the programmable hardware element. The smart camera 190 may also optionally include a non-volatile memory 288 . The smart camera 190 may also include a processor and memory in addition to the programmable hardware element.

FIG. 6 —Configuring an Instrument to Perform a Measurement Function

FIG. 6 illustrates a method for configuring an instrument to perform a measurement function. The method shown in FIG. 6 may be used to configure any of the instruments shown in FIGS. 1A and 1B to perform a measurement function. As shown, this method may operate as follows.

First, in step 262 a graphical program may be created on the computer system 102 (or on a different computer system). The graphical program may be created or assembled by the user arranging on a display a plurality of nodes or icons and then interconnecting the nodes to create the graphical program. In response to the user assembling the graphical program, data structures (and/or program instructions) may be created and stored which represent the graphical program. The nodes may be interconnected in one or more of a data flow, control flow, or execution flow format. The graphical program may thus comprise a plurality of interconnected nodes or icons which visually indicate the functionality of the program. As noted above, the graphical program may comprise a block diagram and may also include a user interface portion or front panel portion. Where the graphical program includes a user interface portion, the user may assemble the user interface on the display. As one example, the user may use the LabVIEW graphical programming development environment to create the graphical program.

In an alternate embodiment, the graphical program may be created in step 262 by the user creating or specifying a prototype, followed by automatic or programmatic creation of the graphical program from the prototype. This functionality is described in U.S. patent application Ser. No. 09/595,003 titled “System and Method for Automatically Generating a Graphical Program to Implement a Prototype”, incorporated by reference above. The graphical program may be created in other manners, either by the user or programmatically, as desired. The graphical program may implement a measurement function that is desired to be performed by the instrument.

In step 264 the instrument may be coupled to the computer system 102 . As noted above, the instrument may comprise a programmable hardware element. It is noted that the instrument or measurement device may be coupled to the computer system 102 before, during or after the graphical program is created.

In step 266 a hardware configuration based on the graphical program may be downloaded onto the programmable hardware element in the instrument to configure the programmable hardware element. The hardware configuration corresponds to a hardware implementation of the graphical program. Downloading the hardware configuration onto the programmable hardware element may comprise the following steps: generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; converting the hardware description into a net list; compiling the net list format into a hardware program file; and downloading the hardware program file to the programmable hardware element to configure the programmable hardware element. These operations are discussed in greater detail below.

After the downloading step is performed, the programmable hardware element is configured with a hardware implementation of the graphical program. At this point, the instrument may be used with the computer system 102 , or may be used separately from the computer system 102 . If the instrument is a card or board that is designed to be located in a slot of the computer 102 , the instrument card or board may optionally remain in the computer system 102 for use, or may be transferred to a different computer system. Alternatively, in step 268 the instrument may be optionally disconnected from the computer system 102 , and may possibly be deployed for operation. As another alternative, the method described above may be repetitively used to manufacture a plurality of instruments for later sale. In another embodiment, the method described above may be used to configure an instrument that has already been deployed, wherein the instrument is configured over a network, i.e., where the hardware configuration is downloaded onto the instrument over a network.

After the programmable hardware element in the instrument is configured with a hardware implementation of the graphical program, the instrument can be used in an application. Thus the instrument may acquire a signal in step 270 , e.g., from a UUT or system. The programmable hardware element in the instrument may then execute in step 272 to perform the measurement function on the signal.

While the programmable hardware element in the instrument executes to perform the measurement function on the acquired signal, if the graphical program includes a user interface portion, this user interface portion may optionally be presented on a display during this time in step 274 . The code corresponding to the user interface portion may be executed by a processor in the computer system 102 or by a processor on the instrument. The user interface portion may operate as a front panel for the instrument. The user may optionally provide user input to the user interface portion on the display to control the instrument while the programmable hardware element in the instrument executes to perform the measurement function on the signal.

FIG. 6 A—Configuring an Image Acquisition Device or Smart Camera to Perform an Image Processing Function

FIG. 6A is an exemplary embodiment illustrating a method for configuring an image acquisition device, such as smart camera 190 , to perform an image processing function. The method shown in FIG. 6A is an example of the method of FIG. 6 described above, wherein the method is described with reference to an image acquisition device or smart camera. As shown, this method may operate as follows.

First, in step 262 A a graphical program may be created on the computer system 102 (or on a different computer system). The graphical program may be created or assembled by the user arranging on a display a plurality of nodes or icons and then interconnecting the nodes to create the graphical program. In response to the user assembling the graphical program, data structures (and/or program instructions) may be created and stored which represent the graphical program. The nodes may be interconnected in one or more of a data flow, control flow, or execution flow format. The graphical program may thus comprise a plurality of interconnected nodes or icons which visually indicates the functionality of the program. As noted above, the graphical program may comprise a block diagram and may also include a user interface portion or front panel portion. Where the graphical program includes a user interface portion, the user may assemble the user interface on the display. As one example, the user may use the LabVIEW graphical programming development environment to create the graphical program.

In an alternate embodiment, the graphical program may be created in step 262 by the user creating or specifying a prototype, followed by automatic or programmatic creation of the graphical program from the prototype. This functionality is described in U.S. patent application Ser. No. 09/587,682 titled “System and Method for Automatically Generating a Graphical Program to Perform an Image Processing Algorithm”, incorporated by reference above. The graphical program may be created in other manners, either by the user or programmatically, as desired. In the present example where the instrument is an image acquisition device (e.g., smart camera 190 ), the graphical program may implement an image processing function.

In step 264 the image acquisition device (e.g., smart camera 190 ) may be coupled to the computer system 102 . As noted above, the smart camera 190 may comprise a camera and a programmable hardware element. It is noted that the image acquisition device may be connected to the computer system 102 before, during or after the graphical program is created.

In step 266 a hardware configuration based on the graphical program may be downloaded onto the programmable hardware element in the image acquisition device (e.g., smart camera 190 ) to configure the programmable hardware element. The hardware configuration corresponds to a hardware implementation of the graphical program. Downloading the hardware configuration onto the programmable hardware element may comprise the following steps: generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; converting the hardware description into a net list; compiling the net list format into a hardware program file; and downloading the hardware program file to the programmable hardware element to configure the programmable hardware element. These steps are discussed below.

After the downloading step is performed, the programmable hardware element is configured with a hardware implementation of the graphical program. At this point, in step 268 the image acquisition device (e.g., smart camera 190 ) may be optionally disconnected from the computer system 102 , and may possibly be deployed for operation. For example, in the case of smart camera 190 , the smart camera 190 may be disconnected from the computer system 102 and deployed in a vision application, such as a manufacturing vision inspection application, a manufacturing assembly application, or other vision application. If the image acquisition device is an image acquisition card or board that is designed to be located in a slot of the computer 102 , the image acquisition card or board may optionally remain in the computer system 102 for use, or may be transferred to a different computer system. Alternatively, the method described above may be repetitively used to manufacture a plurality of image acquisition devices (e.g., smart camera 190 ) for later sale. As another alternative, the method described above may be used to configure an image acquisition device that has already been deployed, wherein the image acquisition device is configured over a network, i.e., where the hardware configuration is downloaded onto the image acquisition device (or other instrument) over a network.

After the programmable hardware element in the image acquisition device (e.g., smart camera 190 ) is configured with a hardware implementation of the graphical program, the image acquisition device can be used in an application. Thus the image acquisition device or smart camera 190 may acquire an image of an object in step 270 , e.g., from a camera, or the camera in smart camera 190 may acquire the image. The programmable hardware element in the image acquisition device may then execute in step 272 to perform the image processing function on the image.

While the programmable hardware element in the image acquisition device executes to perform the image processing function on the image, if the graphical program includes a user interface portion, this user interface portion may optionally be presented on a display during this time in step 274 . The code corresponding to the user interface portion may be executed by a processor in the computer system 102 or by a processor on the image acquisition device. The user interface portion may operate as a front panel for the image acquisition device. The user may optionally provide user input to the user interface portion on the display to control the image acquisition device while the programmable hardware element in the image acquisition device executes to perform the image processing function on the image.

FIG. 7 —Block Diagram

FIG. 7 is a block diagram illustrating the conversion of a graphical program into hardware and software descriptions. The graphical program 300 comprises graphical code, such as interconnected function nodes or icons. The graphical code in the graphical program may use graphical data flow, graphical control flow and/or graphical execution flow constructs, as noted above. On the display, the graphical program is represented as interconnected icons or function nodes. In the memory of the computer system, the graphical program 300 may comprise data structures (or scripts or code) representing functional operations, data flow and/or control flow, and execution order. As the user assembles the graphical program on the display, e.g., by selecting, arranging, and connecting various icons or function nodes on the display, the data structures (or scripts or code) are automatically created and stored in memory.

The graphical program 300 may be created with various development tools. For example, the graphical program may be created using the following development systems: LabVIEW, BridgeVIEW, DASYLab, Visual Designer, HP VEE (Visual Engineering Environment), Snap-Master, GFS DiaDem, ObjectBench, Simulink, WiT, Vision Program Manager, Hypersignal, VisiDAQ, VisSim, Truly Visual, and Khoros, among others. In the preferred embodiment, graphical program 300 is a LabVIEW graphical program or virtual instrument (VI).

Programs of the present invention create the VDiagram tree 302 from the data structures of the graphical program 300 . The VDiagram tree 302 is an abstract hardware graph which represents at least a portion of the graphical program 300 . The graph is organized in a way that facilitates the generation of specific types of descriptions by back end programs of the present invention. In one embodiment, the graphical programming system automatically creates and stores a VDiagram tree 302 (abstract hardware graph) in response to a user's creation of a graphical program. In this instance, conversion from graphical program data structures to a VDiagram tree is not necessary.

A hardware description 304 may be generated from the abstract hardware graph 302 by a back end program. The hardware description 304 may be in various hardware description languages such as VHDL, EDIF, and Verilog. In the preferred embodiment, the hardware description 304 comprises one or more VHDL files. A hardware netlist 306 may be generated from the hardware description using various synthesis tools. As noted above, the term “netlist” comprises various intermediate hardware-specific description formats comprising information regarding the particular hardware elements required to implement a hardware design and the relationship among those elements. In the preferred embodiment, the hardware netlist 306 is an FPGA-specific netlist. The hardware netlist 306 is used to create or configure one or more functional hardware devices or hardware elements 308 which are configured to execute the portion of the graphical program 300 that is represented by the abstract hardware graph 302 .

Hardware element 308 may comprise any of various devices. For example, hardware 308 may comprise a programmable logic device (PLD) such as an FPGA or CPLD. However, hardware 308 may comprise other types of hardware devices, such as a traditional circuit board which is created using the hardware netlist 306 . In the preferred embodiment, hardware 308 is an interface card comprising an FPGA, wherein the interface card is comprised in the computer system where the graphical program 300 is created. The hardware 308 may also be comprised in an external device connected to the computer system where the graphical program 300 is created. The hardware 308 may be connected to the computer over an external serial or parallel bus, or over a network, such as the Internet.

As shown in FIG. 7 , software description source code 310 may also be generated from the abstract hardware graph 302 by a back end program. The source code 310 may be in various source code languages such as C, C++, Java, etc. Machine code 312 may be produced from the source code 310 using various source code compilers. Linked machine code 314 may be produced from the machine code 312 using various machine code linkers. The linked machine code 314 is executable to perform the operations of the portion of the graphical program 300 that is represented by the abstract hardware graph 302 .

FIG. 8 —Block Diagram

FIG. 8 is a block diagram illustrating the generation of various types of hardware and software descriptions from a VDiagram tree. As described for FIG. 7 , programs of the present invention create a VDiagram tree 302 from a graphical program 300 . The VDiagram tree 302 represents at least a portion of the graphical program 300 . Back end programs 330 generate hardware descriptions from the VDiagram tree 302 . Exemplary back end programs 330 A, 330 B, and 330 C are illustrated. Back end 330 A generates a VHDL hardware description comprising one or more VHDL files. Back end 330 B generates an EDIF hardware description comprising one or more EDIF files. Back end 330 C generates a C source code software description comprising one or more C files.

The number and type of back end programs that may be present are not limited. In the preferred embodiment, one or more back end programs may be called automatically as part of a process initiated by a user to generate hardware/software descriptions for the graphical program 300 . In another embodiment, the VDiagram tree 302 may be generated and saved to a file, and the user may call a back end program at a later time to generate a hardware/software description.

As described above for FIG. 7 , appropriate synthesis tools or compilers may be called to convert a hardware/software description into another format such as an FPGA-specific netlist or compiled machine code.

FIG. 9 —Block Diagram

FIG. 9 illustrates the exportation of at least a portion of a graphical program 300 into a hardware description and the use of the hardware description to program an FPGA. As described above for FIG. 7 , the VDiagram tree 302 comprises information representing the graphical program 300 , including the functional operations of the program. As described in detail below, the VDiagram tree comprises VDiagrams, each of which maintains a list of components. This list of components includes components which represent functional operations.

A back end program converts the VDiagram tree 302 to a hardware description 304 . Back end programs may implement the functionality of the components in the VDiagram component lists using constructs of their respective description languages. For example, a VHDL back end may create VHDL code to implement a component that performs a particular mathematical algorithm such as an exponential calculation. However, in the preferred embodiment, such functional components are simply referenced as library components.

FIG. 9 illustrates the preferred embodiment in which the VDiagram tree references one or more library components. One embodiment of the present invention comprises pre-compiled function blocks 342 which implement these library components for particular hardware devices such as FPGAs. Various FPGA netlist synthesis tools may be called to generate an FPGA netlist 340 from the hardware description 304 . These synthesis tools may incorporate the pre-compiled function blocks 342 into the FPGA netlist 340 . Also, as shown, the synthesis tools may utilize hardware target-specific information in creating the netlist. For example, the exact form that the FPGA netlist takes may depend on the particular type of FPGA that will use the netlist, since FPGAs differ in their available resources.

An FPGA bit stream program file 346 may be generated from the FPGA netlist 340 using readily available synthesis tools. This FPGA program file may be uploaded to an FPGA 348 . The FPGA 348 may be comprised in a hardware device such as an interface board. After being programmed with the program file 346 , the FPGA is able to execute the portion of the graphical program 300 that is exported to the hardware description 304 . If the entire graphical program is not exported to the hardware description, then a portion of the program may execute on the general purpose CPU of the computer system. This portion preferably comprises the supervisory control and display portion of the program. Details follow on how the execution of the FPGA portion is coordinated with the execution of the main CPU portion and how the external hardware resource requirements for the FPGA portion are managed.

FIG. 10 —Block Diagram

FIG. 10 illustrates the exportation of at least a portion of a graphical program 300 into a software source code description and the compilation and linkage of the source code. As shown, the graphical program data structures may be first converted to a VDiagram tree 302 and then to software description source code 310 .

As described above for FIG. 9 , in the preferred embodiment the VDiagram tree 302 references library components to represent various functional components of the graphical program. These library components may be implemented in libraries, class libraries, macro definitions, etc. 360 . As shown in FIG. 10 , these class libraries, etc. may be used to produce the machine code 312 from the source code 310 . Also, binary object libraries 362 may implement some functionality of the software description. These binary object libraries may be linked in with the machine code 312 is linked to produce the linked executable code 314 . Libraries 360 and 362 may also contain compiler-specific or platform-specific information necessary to produce executable code 314 . Linked code 314 may be executed to perform the operations of the portion of the graphical program that is exported to the software source code description 310 .

FIG. 11 —Conversion of a Graphical Program into a Hardware Implementations

FIG. 11 is a flowchart diagram illustrating operation of one embodiment of the present invention. One embodiment of the present invention comprises a computer-implemented method for generating hardware and/or software implementations of graphical programs or graphical code. It is noted that various of the steps in the flowchart can occur concurrently or in different orders.

One goal of the present invention is to provide a development environment that will seamlessly allow use of a graphical programming system to design applications for reconfigurable or programmable hardware. In the preferred embodiment where the graphical programming system is LabVIEW, the present invention allows LabVIEW users to design applications in LabVIEW for reconfigurable hardware.

Many applications, such as signal processing and real-time motion control, are easily implemented in a graphical programming language, such as the LabVIEW G language. However, in some instances traditional software compilation methods cannot produce an application that is fast enough to meet a user's needs. The present invention solves this problem by allowing a user to convert their graphical program, e.g., a G program, into application-specific hardware such as a programmed FPGA. The hardware maintains the exact functionality of the graphical program while running at speeds far exceeding that of traditional general-purpose processor platforms. The current implementation of the present invention is a desktop or embedded PC that contains an FPGA-based daughter card.

In one embodiment, the system appears as a conventional graphical programming system while providing a seamless interface to the reconfigurable hardware. For example, the preferred embodiment of the invention, referred to as “FPGA LabVIEW”, provides a seamless interface to an FPGA. FPGA LabVIEW appears from the outside to be exactly the same as the normal LabVIEW graphical program development system.

FIG. 11 illustrates the translation process from a graphical program to a hardware description that corresponds to the graphical program. A graphical programming application that is being targeted for a hardware implementation is designed in exactly the same way as an ordinary graphical programming application. As shown, in step 262 the user first creates a graphical program, also sometimes referred to as a block diagram. As described above, a design may be entered and debugged in the traditional software-based manner. In the preferred embodiment, the graphical program comprises a graphical data flow diagram which specifies functionality of the program to be performed. This graphical data flow diagram is preferably directly compilable into machine language code for execution on a computer system.

When the design is finalized, the user can instruct the system to compile the design for the FPGA hardware. Unfortunately, some graphical programming constructs may not be efficiently implemented in FPGA hardware. For example, file I/O is a task that is usually better left to the general-purpose host processor. The present system in one embodiment is capable of bisecting a design into hardware portions and software portions.

Steps 404 - 414 are an example implementation of step 266 of FIG. 3 .

In step 404 , the user may optionally select a first portion of the graphical program for conversion to a hardware implementation. This first portion of the graphical program which is desired for hardware implementation preferably comprises portions of the graphical program, e.g., particular subprograms, which require a fast or deterministic implementation and/or are desired to execute in a stand-alone hardware unit. In general, portions of the graphical program which are desired to have a faster or more deterministic execution are selected in step 404 and converted into the hardware implementation in steps 406 - 414 . A default case is that the entire block diagram portion of the graphical program is selected for hardware implementation.

In step 422 the remaining portions of the graphical program which were not selected in step 404 , if any, are compiled into machine code for execution on a CPU, such as the host processor in the computer 102 or the processor 212 comprised on the interface card 114 . The first portion of the program selected in step 404 preferably excludes program portions involving supervisory control and display. This enables the supervisory control and display portions to execute on the host CPU, which is optimal for these elements of the program.

In one embodiment, during creation of the graphical program in step 262 the user specifies portions, e.g. subprograms, which are to be exported to the hardware description format for conversion into a hardware implementation. In another embodiment the user selects which modules or subprograms to export to the hardware implementation at the time when the conversion process is initiated. In another embodiment, the entire graphical program is selected for conversion to a hardware implementation, and thus step 422 is not performed.

In step 406 the graphical program portion selected in step 404 is first processed to create an abstract hardware graph called a VDiagram tree which serves as an intermediate data structure. The VDiagram tree contains a complete hardware representation of the program, but is not specific to any hardware description language. For example, the VDiagram tree comprises data structures representing hardware signals that implement the data flow within the graphical program, as well as data structures representing hardware signals that are added to preserve the proper execution flow (enable signals).

In step 408 , a back end program is called to parse the VDiagram tree and generate a hardware description from it. The back end translates the information contained in the VDiagram tree into a specific hardware description language. For example, a VHDL back end may be called to generate a VHDL file or set of files describing the program. The hardware description comprises a high-level hardware description of function blocks, logic, inputs, and outputs which perform the operation indicated by the portion of the graphical program selected in step 404 .

Various types of back end programs may be present. Back end programs may generate software source code descriptions as well as hardware description language descriptions. For example, FIG. 8 illustrates a back end 330 A which uses the VDiagram tree to generate one or more VHDL files; back end 330 B which generates one or more EDIF files; and back end 330 C which generates one or more C files. These three back ends are representative only. Other back ends may generate other types of descriptions for the program. For example, a Verilog back end may generate a Verilog file for the program. Also, more than one back end may be called to generate different program descriptions. In the preferred embodiment, a VHDL back end generates a VHDL description which may then be compiled and used to program a programmable logic device such as an FPGA.

In step 410 the method operates to convert the hardware description into an FPGA-specific netlist. The netlist describes the components required to be present in the hardware as well as their interconnections. Conversion of the hardware description into the FPGA-specific netlist is preferably performed by any of various types of commercially available synthesis tools, such as those available from Xilinx, Altera, etc.

In one embodiment, the converting step 410 may utilize one or more pre-compiled function blocks from a library of pre-compiled function blocks 342 . Thus, for certain function blocks which are difficult to compile, or less efficient to compile, from a hardware description into a netlist format, the hardware description created in step 408 includes a reference to a pre-compiled function block from the library 342 . Alternatively, hardware implementations for all of the function blocks are included in the function library. The respective pre-compiled function blocks are simply inserted into the netlist in place of these references in step 410 . The preferred embodiment of the invention thus includes the library 342 of pre-compiled function blocks, also referred to as the component library, which are used in creating the netlist. The preferred embodiment also includes hardware target specific information 344 which is used by step 410 in converting the hardware description into a netlist which is specific to a certain type or class of FPGA.

In step 412 the method operates to compile the netlist into an FPGA program file, also referred to as a software bit stream. The FPGA program file is a file that can be readily uploaded to program an FPGA.

After the netlist has been compiled into an FPGA program file in step 412 , then in step 414 the method operates to transfer the FPGA program file to the FPGA, to produce a programmed hardware equivalent to the graphical program. Thus, upon completion of step 414 , the portion of a graphical program referenced in step 404 is comprised as a hardware implementation in an FPGA or other programmable hardware element.

In the preferred embodiment, the hardware description is passed transparently through the FPGA vendor's synthesis tools. Because the vendor's tools may take a considerable amount of time to process the design and generate a programming bitstream, it is recommended that this only be done after the design has been debugged using traditional software-compilation techniques.

As described above, the present invention may run on PC computers equipped with an FPGA-based expansion card on the PCI bus. Embodiments of the FPGA-based expansion card were described with reference to FIGS. 6A-6C . The graphical programming system uploads the programming bitstream generated by the FPGA vendor's design tools into the FPGA on this board. The FPGA then begins processing data, and the graphical programming system may coordinate data flow between the FPGA and the host CPU.

It is noted that various of the above steps can be combined and/or can be made to appear invisible to the user. For example, steps 410 and 412 can be combined into a single step, as can steps 404 - 410 . In the preferred embodiment, after the user creates the graphical program in step 402 , the user simply selects a hardware export option and indicates the hardware target or destination, causing steps 404 - 414 to be automatically performed.

FIG. 11 applies to the preferred embodiment in which the programmable hardware element is an FPGA. However, the same or similar steps may be applied to convert a graphical program into a hardware implementation for other types of programmable or (re)configurable hardware, such as a CPLD.

FIG. 12 —Creation of a Graphical Program

FIG. 12 is a more detailed flowchart diagram of step 262 of FIGS. 3 and 11 , illustrating creation of a graphical program according to one embodiment of the invention. As shown, in step 430 the user arranges on the screen a graphical program or block diagram. This includes the user placing and connecting, e.g., wiring, various icons or nodes on the display screen in order to configure a graphical program. More specifically, the user selects various function icons or other icons and places or drops the icons in a block diagram panel, and then connects or “wires up” the icons to assemble the graphical program. The user also preferably assembles a user interface, which may be referred to as a front panel, comprising controls and indicators which indicate or represent input/output to/from the graphical program. The graphical program is sometimes referred to as a virtual instrument (VI). The graphical program or VI will typically have a hierarchy of sub-graphical programs or sub-VIs.

In the preferred embodiment, the graphical programming system is the LabVIEW graphical programming system available from National Instruments. For more information on creating a graphical program in the LabVIEW graphical programming system, please refer to the LabVIEW system available from National Instruments as well as the above patent applications incorporated by reference.

In response to the user arranging on the screen a graphical program, the method operates in step 432 to develop and store a tree of data structures which represent the graphical program. Thus, as the user places and arranges on the screen function nodes, structure nodes, input/output terminals, and connections or wires, etc., the graphical programming system operates to develop and store a tree of data structures which represent the graphical program. More specifically, as the user assembles each individual node and wire, the graphical programming system may operate to develop and store a corresponding data structure in the tree of data structures which represents the individual portion of the graphical program that was assembled. Thus, steps 430 and 432 are an iterative process which is repetitively performed as the user creates the graphical program. In one embodiment, the graphical programming system automatically develops and stores VDiagram data structures in response to the user creating the graphical program.

In an alternate embodiment, as the user places, arranges and interconnects nodes on the display, scripts, DLLs, or other code may be created in memory.

In one embodiment, the user optionally places constructs in the graphical program which indicate respective portions of graphical code which are either to be compiled into machine code for execution by a CPU or converted to a hardware description for implementation in a programmable hardware device such as an FPGA.

FIGS. 13 and 14 —VDiagram Tree Structures

The VDiagram tree comprises data structures called VDiagrams. The root VDiagram contains information for the program items present in the top-level graphical program, such as wires, constants, etc. Any complex items such as sub-programs, functions, loop structures, etc. are represented as child VDiagrams. Parent VDiagrams have pointers to all their child VDiagrams so that a tree is formed for the program hierarchy. Each child VDiagram also has a pointer back to its parent.

The VDiagram code is preferably written in C++. The following pseudocode describes the contents of each VDiagram:

class VDiagram {
public:
VComponentList complist;
VSignalList signallist;
VAssignmentList assignlist;
VSubviList srnlist;
VSubviList subvilist;
VPortMap topportmap;
VResourceList resourcelist;
private:
int isSubvi;
VDiagram *owner;
VComponent *srnholder;
ObjID rootobj;
char *entityname;
};

FIG. 13 provides a graphical representation of a VDiagram and the relationship among its elements. Each of these elements is discussed below. Note that specific graphical program components and constructs are discussed below, such as wires, functions, sequence structures, case structures, loops, loop tunnels, shift registers, etc. For more information on these concepts, please see the above-referenced patents or the LabVIEW documentation available from National Instruments.

complist

The component list contains a list of components that appear in the graphical program. The VDiagram thus preserves some of the structure present in a graphical program so that it appears in the resulting hardware description. Components include functions such as adders, multipliers, and comparators. Components also include objects that represent higher-level programming constructs such as while loops and sequences. Components also include sub-programs. Components on the list are subdivided by type. In the preferred embodiment in which a VHDL description is generated from the VDiagram tree, components generally correspond exactly to entities in a VHDL file.

signallist

The signal list stores all of the wires for the VDiagram. This includes all of the wires that appear on the graphical program itself, as well as any hardware-specific wires that are added, such as the clock and reset signals. Each signal stores a list of the components that it attaches to.

assignlist

Signals can be divided into two groups: signals that are driven by components and signals that are driven by other signals. The assignment list contains objects that describe relations of the latter type. Examples include boolean expressions, multiplexers, and decoders. For example, if a component has multiple input signals, it will need to have an enable signal that is composed of an AND of the enable out signals corresponding to the inputs. The assignment list will contain an entry specifying this relationship.

srnlist

This list contains pointers to additional VDiagrams, each of which represents a subframe of a graphical program. A subframe is the area inside of a structural component such as a while loop, a sequence frame, a case structure, etc. The root object of a subframe is a self reference node (SRN) which encloses the entire subframe. See the descriptions below and the above-referenced documentation for more information.

subvilist

Similar to the srnlist, the subvilist contains pointers to additional VDiagrams. These VDiagrams represent subvi's (subprograms) instead of subframes. The distinction between subvi and subframe is made to help the VDiagram back ends keep the hardware description organized. For example, the VHDL back end may keep all of the subframes of a program together in the same file, but may place the VHDL generated for subprograms in separate files.

The root object of a subprogram is a self reference node (SRN) which encloses the entire subprogram. See the descriptions below for more information.

topportmap

The topportmap is a list of ports that describe the connections between a graphical subprogram or subframe and its parent. These connections include things like data tunnels (a connection between a program and a loop's subframe), global variable hardware register connections, and other hardware-specific signals such as clock and reset.

resourcelist

The resourcelist is a list that keeps track of where hardware resources like A/D converters, D/A converters, and global variables are being used in the VDiagram tree. Parent VDiagrams inherit resource information from their children. (The VDiagram tree is built in a depth-first manner.) At the top-level VDiagram, the consolidated resource information from all child VDiagrams is used to build the logic that connects external hardware resources to the components that use them.

isSubvi

This is an integer used to identify the type of the VDiagram. There are three possibilities: V_TOPLEVELVI, V_SUBVI, and V_SRNVI. The top-level VDiagram is flagged as V_TOPLEVELVI. Child VDiagrams are flagged as V_SUBVI if they correspond to a subprogram, or V_SRNVI if they correspond to a subframe. See the descriptions for subvilist and srnvilist for more information.

owner, srnholder

The owner pointer points back to the parent VDiagram. The srnholder pointer points back to the srnholder in the parent VDiagram's component list. FIG. 14 shows an example VDiagram hierarchy illustrating the relationship of a parent VDiagram, child VDiagram, and srnholder for a very simple graphical program containing a single subprogram. In this example, an srnholder appears in the parent VDiagram's component list. This srnholder points to the child VDiagram representing the subprogram. The parent VDiagram also contains an entry in its subvilist that points to the child VDiagram. As shown in FIG. 14 , a child VDiagram points to both its parent VDiagram and its parent srnholder.

rootobj

The rootobj pointer points to the root object that the VDiagram represents in the graphical program. In the preferred embodiment, the graphical program being converted to a hardware description is a LabVIEW VI. In this case the rootobj pointer would point to the root LabVIEW object for the VDiagram. The root object for a VDiagram may also be called a self reference node (SRN).

entityname

The entityname character string is a unique name for the VDiagram. There may be different naming conventions. For example, the top-level VDiagram may be named “toplevel,” and the child VDiagrams may be named by concatenating the hex value of the rootobj pointer with some other information about the graphical program, such as the project name or file name.

FIG. 15 —Building a VDiagram Tree

FIG. 15 is a flowchart diagram illustrating the basic process of building a VDiagram tree for a graphical program. FIG. 15 shows step 406 of FIG. 11 in more detail. In step 450 the VDiagram tree constructor function is called for the appropriate root object of the graphical program, i.e. the point in the graphical program where conversion into a hardware description should begin. If the entire graphical program is to be converted, the constructor function should be called for the top-level program root object. In the preferred embodiment this is a self reference node (SRN) for the top-level LabVIEW VI. It may be desirable to translate only a part of the graphical program into hardware. For example, to convert a subprogram into hardware, the root object pointer for the subprogram is passed to the VDiagram constructor function.

The VDiagram constructor function is also called for each element in the portion of the graphical program to be translated that should be represented by a separate VDiagram (e.g., subprograms and subframes for loops, sequences, etc.). The constructor function also takes pointer parameters for the VDiagram's owner and srnholder (described above) so that a VDiagram tree is built as shown in FIG. 16 . The VDiagram tree is built in a depth-first manner. One reason for this is that a VDiagram needs to consolidate resource information for itself and all of its child VDiagrams, so the child VDiagram resource information must be determined first.

In step 452 the VDiagram constructor function calls a message handler function to add information and data structures to the VDiagram for each object in the portion of the program referenced by the root object pointer passed to it. For example, VComponents, VSignals, VSigterms, etc. are added to the VDiagram to represent each element of the graphical program. The message handler that is called is specific to the type of object, e.g. constant, function, signal, programmatic structure, subprogram, etc. Each message handler function adds any additional hardware information to the VDiagram that is necessary to convert the object into a hardware design but is not represented in the original graphical program. For example, enable and reset signals are added for each component. Step 452 is discussed in more detail below in the description for FIG. 17 .

In step 454 the VDiagram constructor function adds routing information to the VDiagram for utilizing hardware resources such as A/D converters, global variable hardware registers, etc. Hardware resources require access to specific resources on the programmable logic device (PLD). For example, a hardware resource may require a connection to a specific pin on an FPGA. This PLD-specific information is available from the top-level VDiagram, but not from child VDiagrams. Thus, for child VDiagrams ports are added to the VDiagram's topportmap to route hardware-specific data through its parent VDiagram. At the top-level VDiagram, all hardware resource information is consolidated and logic is generated to interface with resources outside the PLD. More information on resources and arbitration follows in a later section.

In step 456 the VDiagram constructor function adds reverse pointers from each component to the signals connected to its ports. This is done primarily to aid in traversal of the VDiagram and is helpful to hardware description back ends.

In step 458 the resourcelist information for the VDiagram is consolidated with the parent VDiagram's resourcelist. Thus each VDiagram contains all the resource information necessary to implement itself and its children in hardware, and the top-level VDiagram is able to build the proper external interface logic.

FIGS. 16 - 18 : Graphical Program Example

FIG. 16 is a simple graphical program that is used here for an example of building a VDiagram. This program contains only three objects: a constant zero, a signal, and an incrementer function. The signal connects the output of the constant object to the input of the incrementer function. The incrementer function increments the integer value of the input by 1. In a real program there would be another signal connecting the output from the incrementer function to some other input port, but for simplicity it is not shown here. Depending on the particular embodiment, some other visible or invisible “object” is associated with the three objects shown in the diagram to group them together. In the case of a LabVIEW VI, this invisible object is called a self reference node (SRN). This grouping object is the same as the root object for the graphical program as described above.

The VDiagram is generated by calling the VDiagram constructor function with a pointer to the root object, null pointers for the owner and srnholder parameters, and a flag to indicate that it is a top-level VDiagram. As shown in FIG. 15 , the constructor first performs step 452 of calling a message handler function to add information and data structures to the VDiagram for each object in the graphical program.

FIG. 17 illustrates the steps performed by the method step 452 of FIG. 15 in more detail. Each type of object in a graphical program has a corresponding message handler function, and each message handler adds information and/or data structures to the VDiagram for representing the object in hardware. The message handler functions are called in a particular order. In step 470 any objects in the program that should be represented as child VDiagrams are processed. The VDiagram constructor function is called for objects such as subprograms and subframes (e.g., the inside of a while loop). Thus, VDiagram information is added in a depth-first manner. There are no objects on the example program of FIG. 16 which are represented as separate child VDiagrams.

In step 472 , message handlers are called for each of the simple objects present in the program such as constants, indicators for front panel displays, sequence local variables, etc. In the example program of FIG. 16 , the only object present of this type is the constant zero. The message handler function for a numeric constant adds information to the VDiagram necessary to instantiate the constant in hardware. A constant is represented in hardware as a signal with an unchanging value. Thus the message handler adds a new VSignal to the VDiagram's signallist. Flags are set in the VSignal data structure to signify that it is a constant signal with an initialization value of zero. At this point the VSignal representing the constant zero is not connected to anything else. For now it is simply created and stored in the signallist.

After the message handlers for all the simple objects are called in step 472 , message handlers are called in step 474 to add information and data structures representing the rest of the nodes in the graphical program to the VDiagram, such as functions. As described above, a graphical program is typically built by connecting “nodes” with “wires”. Each node object represents an operation such as function or subprogram, or a programmatic structure such as a loop, or a data source/target such as a constant or a global variable, etc. Each wire object represents a connection between node objects. Wires are also called signals.

In the example program of FIG. 16 there are two node objects connected by a wire. The information for the simple constant node object is added in step 472 . The only other node in the program is the incrementer function. The incrementer function message handler is called in step 474 . The message handler function for the incrementer function adds a VComponent to the VDiagram's complist. In the preferred embodiment, the VComponent contains information referencing a hardware library component that may be used to implement the functionality of the incrementer function in hardware. This reference to the library component may later be used by the back end that generates a particular hardware description from the VDiagram. For example, a VHDL back end may generate standard VHDL syntax for an entity declaration and component instantiation. The entries in the VDiagram's complist are sorted by type so that it is easy to declare components by type and instantiate them individually. In another embodiment, the back end may be configured to generate a hardware description that implements the functionality of the incrementer function using constructs of the back end's hardware description language (e.g., VHDL, EDIF, etc.) rather than referencing a library component.

After message handlers for all the other objects have been called, a message handler function is called for each wire (signal) in the graphical program. This order of generating node information before signal information is important. Since signals connect other objects, the information for the objects, such as their port numbers, must be available to the signal message handler.

Only one signal is present in the example graphical program: the wire that connects the constant to the incrementer function. Signals in the graphical program map directly to VSignals in a VDiagram. The message handler creates a new VSignal data structure and adds it to the signallist. As noted in the description above for the assignlist of a VDiagram, signals can be divided into two groups: signals that are driven by components and signals that are driven by other signals. The VSignal representing the wire in the example graphical program is driven by another signal, since the constant zero is implemented as a hardware signal. A VAssignment data structure is added to the VDiagram's assignlist to represent this relationship. A pointer is added from the VSignal representing the wire in the program to the VAssignment specifying the signal-driving relationship. Another pointer is added from the VAssignment to the VSignal representing the constant zero to denote the source of the driving signal in the VAssignment.

The VSignal representing the wire in the example program drives a component rather than another signal. This relationship is represented by adding a VSigterm to the VSignal. The VSigterm points to the input port of the incrementer function component. Additional VSigterms could be added for signals that drive more than one component.

Step 452 of FIG. 15 is complete after the message handler function has been called for each signal (step 476 of FIG. 17 ). As shown, step 454 may then add information to the VDiagram for implementing hardware-specific resources. This example will skip step 454 . Resources and arbitration are discussed in detail below.

In step 456 of FIG. 15 , reverse pointers are added from each VComponent to the VSignals connected to its ports. Each VSignal is checked to make sure that its VSigterms point to a valid port on a valid VComponent. If the VSigterm is valid, a return pointer is created from the VComponent port back to the VSignal. In the FIG. 16 example program, the VDiagram contains only one VSigterm, so only one return pointer is created in this step. This is a pointer from the input port of the incrementer function VComponent to the VSignal representing the wire on the graphical program.

In step 458 of FIG. 15 , the resourcelist information for the VDiagram is consolidated with the parent VDiagram's resourcelist. However, for this FIG. 16 example the VDiagram has no parent. The VDiagram tree contains only the top-level VDiagram. Thus, for the purposes of this example the VDiagram is complete after step 456 .

FIG. 18 is a block diagram representing the VDiagram constructed for the example program of FIG. 16 . As noted, this example omitted details regarding hardware resources. It also omitted a discussion of signals that are added to implement an enable chain among the objects. These aspects are discussed below. FIG. 18 illustrates the VDiagram data structures discussed above and the relationships among them. The hex numbers shown are example memory addresses for the structures.

FIGS. 19 - 21 : Data Flow Between VDiagrams

Data often flows across component boundaries in a graphical program. For example, wires in the main graphical program may go into a subprogram or vice versa, data may cross a loop boundary via a data tunnel, etc. This data flow is preserved in the data flow among VDiagrams in a VDiagram tree. FIGS. 19-21 illustrate data flow between VDiagrams.

FIG. 19 is a graphical program containing a while loop structure. As shown, a signal passes from the constant zero through a data tunnel into the while loop. As discussed above, programmatic structures such as while loops are represented as child VDiagrams of the parent VDiagram. FIG. 20A illustrates the graphical program from the point of view of the parent VDiagram. The parent VDiagram contains information representing the constant zero and the container object for the while loop. It views the while loop as a black box through which data enters via a data tunnel. FIG. 20B illustrates the graphical program from the point of view of the child VDiagram. The child VDiagram contains information representing the while loop subframe. Data enters the subframe via a data tunnel and flows to the incrementer function.

FIG. 21 is a flowchart diagram illustrating how the flow of data from a parent VDiagram to a child VDiagram is represented. As noted above, a VDiagram tree is constructed in a depth-first manner. The flowchart thus begins with what occurs for the child VDiagram. In step 480 a new VPort data structure is created and added to the child VDiagram's topportmap. In step 482 a new VSignal is created and added to the child VDiagram's signallist. This VSignal represents the wire that appears in the portion of the graphical program represented by the child VDiagram. For example, it may represent the wire of FIG. 20B that connects to the incrementer function. The VSignal is mapped to the VPort created in step 480 to signify that the signal enters the child VDiagram from an external source.

In step 484 the VSignal created in step 482 is connected to its destination. For example, in FIG. 20B the wire shown connects to the input port of the incrementer function. In this example, a VSigterm pointing to the input port of the VComponent representing the incrementer function is added to the VSignal. If the VSignal drives another signal instead of a component, a VAssignment is created in step 484 instead of a VSigterm.

In step 486 the VPort created in step 480 is added to the port map of the child VDiagram's srnholder. In step 488 the VPort is added to the complist of the parent VDiagram. The VPort created for the child VDiagram in step 480 is thus available to the parent VDiagram to use to send data into the child VDiagram.

In step 490 a new VSignal is created and added to the parent VDiagram's signallist. This VSignal data structure represents the wire on the graphical program that enters into the portion of the program represented by the child VDiagram. For example, it may represent the wire of FIG. 20A that originates from the output port of the constant zero object and enters the while loop subframe. A signal that crosses between VDiagram boundaries is thus represented as two separate VSignal data structures: one in the child VDiagram (created in step 482 ) and one in the parent VDiagram (created in step 490 ).

In step 492 the two VSignals created in steps 482 and 490 are connected. A VSigterm is added to the parent VDiagram's VSignal which points to the VPort that was added to the parent VDiagram's complist in step 488 . Thus the two VSignals are now joined via the VPort.

In step 494 the parent VDiagram's VSignal is mapped to its driving source. For the example program of FIG. 20 , this mapping is accomplished by creating a VAssignment specifying that the VSignal is driven by another VSignal which represents the constant zero.

The example above is for data flowing from a parent VDiagram into a child VDiagram. The VDiagram tree may represent data flowing from a child VDiagram to a parent VDiagram using a similar mechanism. Also, the example is for data crossing the boundary of a while loop. Data crossing other programmatic construct boundaries and subprogram boundaries may also be represented similarly in the VDiagram tree. For example instead of loop tunnels, a subprogram may have subprogram connectors connecting the subprogram to front panel controls and indicators. These front panel data control objects may be associated with ports on the subprogram connectors using VPorts as described above.

FIG. 22 —Case Structure Controller

As described previously, the subframes of complex programmatic structures such as while loops, for loops, and case structures are represented as child VDiagrams. An srnholder, which is a type of VComponent, is inserted into the parent VDiagram's complist. The srnholder VComponent points to the child VDiagram. The parent VDiagram also points to the child VDiagram. The child VDiagram also points back both to its srnholder and to its parent VDiagram. This relationship is illustrated in FIG. 14 . (One difference is that FIG. 14 indicates that the child VDiagram is a member of the parent VDiagram's subvilist. VDiagrams representing subprograms are members of the parent's subvilist. However, VDiagrams representing programmatic structure subframes are members of the parent VDiagram's srnlist instead.)

A parent VDiagram needs additional information besides an srnholder VComponent and a child VDiagram in order to convert programmatic structures into hardware. For example, a while loop also needs an iteration counter and a variable representing the continue condition; a for loop needs to run for a specified number of iterations; a case structure needs to decode its select input, etc. Additional information is added to a parent VDiagram to fulfill these requirements using a structure controller data structure. A structure controller is represented in the VDiagram as another VComponent in the parent VDiagram's complist.

The structure controller VComponent contains ports which connect to iteration count nodes, continue nodes, case select nodes, maximum iteration nodes, etc. The message handler functions which generate the VDiagram information for each type of programmatic structure generate the appropriate VPorts and VSignals to route the necessary input/output signals from these structure controller ports to the child VDiagrams.

FIG. 22 illustrates the relationship among structure controllers, srnholders, and child VDiagrams. The figure illustrates an example for a case structure with two cases (i.e., there are two possible subframes). As shown there is an srnholder for each child VDiagram representing a subframe. Each srnholder points to its corresponding child VDiagram, and each child VDiagram points back to its srnholder. The srnholders also have an associated srnholder pointer. These srnholder pointers are used for programmatic structures with multiple elements such as case structures and sequence structures. For these types of structures, the srnholder pointers of the srnholders are used to link together the srnholders, as shown in FIG. 22 . The structure controller points to the srnholder corresponding to the programmatic structure. For structures with more than one srnholder, the structure controller points to the first srnholder in the list, as shown in the figure.

FIG. 23 —Enable Chain Block Diagram

An order of execution is inherent in graphical programs. For example, the order in which two input signal parameters reach a two-integer adder function is not important, but it is important that both input parameters have reached the adder and are valid before the adder function performs the addition operation and the program continues execution using the output from the adder. Graphical program systems use mechanisms to ensure proper execution order. In order to faithfully duplicate a software program, hardware designs must also include such mechanisms. As a VDiagram tree is constructed, an enable chain is maintained for all components which ensures proper execution order and resolves hardware timing issues.

Three special VPorts are added to every VComponent in a VDiagram's complist. These ports are named enable_in, enable_out, and enable_clr. As noted above, objects in a graphical program such as programmatic structures and functions are implemented in the preferred embodiment using predefined hardware library components. These components are configured to respond to the enable_in and enable_dcr signals and generate the enable_out signal as described below. In another embodiment, the functionality of the structures and functions is specified in the hardware description generated by the back end rather than by referencing a library component. In this case, the description generated by the back end includes functionality for the enable_in, enable_out, and enable_clr signals.

The enable_in port receives an input signal signifying when the input data for a component is valid. Each component is responsible for monitoring the enable_in input. Each component delays the enable_in input for as many clock cycles as necessary to perform the computation and then drives the enable_out signal to indicate that the output from the component is valid. Enable_in and enable_out are level-triggered signals. Once enable_out is asserted for a component, it remains asserted until the enable_clr signal is asserted. When this occurs, the enable_out signal is deasserted.

The enable_in, enable_out, and enable_clr VPorts are added to the port maps of each VComponent by the message handler function for each component in step 452 of FIG. 15 . VSignal data structures are added to represent the signals connected to these ports. Each wire that appears in the graphical program is also associated with an enable signal. When the data carried by the wire is valid the associated enable signal is active high. For signals that drive components, the enable signal is connected to the enable_in port of the components. For a component that has multiple input signals, all of the enable signals associated with the input signals are AND'd together to drive the component's enable_in signal. This AND is represented in the VDiagram with a VAssignment, and the VComponent has a pointer to the VAssignment.

Enable_in, enable_out, and enable_clr ports are also added to the topportmap of each VDiagram. These ports are master enable ports for the entire VDiagram. The VDiagram's enable_in port is routed to the enable_in ports of all the VComponents in the VDiagram's complist. This master enable_in signal is AND'd together with the enable signals associated with any input signals the component has. Similarly, the master enable_out signal for the VDiagram is driven by ANDing together the enable_out signals for the VComponents. The VDiagram's master enable_clr signal is routed to the enable_clr ports for all of the VComponents.

The enable ports for child VDiagrams associated with while loops and for loops are driven by the corresponding structure controller. FIG. 23 illustrates how the structure controller drives the enable ports for a VDiagram representing a while loop subframe. The structure controller has its own master enable signals. It also sends enable signals based on the execution state (e.g., iteration count) to the master enable signals for the child VDiagram's srnholder. Although not shown in the figure, the master enable signals of the srnholder map directly to the master enable signals of the child VDiagram.

The enable chain for a case structure is slightly different. The case controller decodes its select input and asserts an enable_in signal for only one of its child VDiagrams. The case controller's subdiag_en output signal is a vector type, with one bit for each child VDiagram. The vector is one-hot encoded and each bit is routed to the enable_in of a specific child VDiagram. The subdiag_done input is a single-bit signal and is driven by the logical OR of all of its child VDiagram's enable_out outputs. The subdiag_clr signal is routed to all child VDiagrams.

Sequence structures are unique because they do not use a structure controller. Instead, a sequence is treated as a normal component and is fitted into the enable chain in the standard way. The only difference is that the srnholder for the first frame in the sequence receives all of the enable_in fan-in signals for the entire sequence. The srnholder for the last frame in the sequence produces the enable_out signal for all VComponents that depend on any output of the sequence. All intermediate sequence frame srnholders simply connect their enable_out outputs to the enable_in input of the next frame. This ensures that the frames of the sequence structure execute in hardware in exactly the same order as they would in software.

FIGS. 24 - 29 : Resources and Arbitration

Many programs that are converted into hardware require hardware resources external to the programmable logic device (PLD). Hardware resources include A/D converters and digital I/Os. Resources also include primitives that move data between the PLD and the CPU, such as global variable registers and DMA transfer primitives. A system is needed to represent the hardware resource requirements in a VDiagram tree. Often, the same resource is used in many places in the hierarchy of VDiagrams in the VDiagram tree. Therefore a system of arbitration is also needed to manage multiple simultaneous accesses to the same resource. This section describes the systems used to represent and arbitrate hardware resources in the VDiagram tree.

Interfacing external hardware resources with a PLD requires coordinating the external resources with resources of the PLD. For example, different external resources require a connection to specific pins on an FPGA. As examples, global variable registers need to access the external address and data bus, and A/D converters need access to the data and control signals for a specific A/D channel. Such specific resources are only available from the level of the root VDiagram. Thus, resources are only instantiated in the top-level VDiagram. As child VDiagrams are constructed, they consolidate their resource information with their parent VDiagrams so that the top-level VDiagram has all the information necessary to instantiate resources for the entire hardware description.

Each place where a specific resource is used in a VDiagram is called an access point. A resholder data structure (a type of VComponent) is added to the VDiagram's complist for each access point of a specific resource. Resholders can be of type read-only, write-only, or read-write. These resholders route the data and enable chain signals from each access point up through the parent VDiagram to the top-level VDiagram, where the individual requirements are arbitrated and fed into the child VDiagrams containing the resource-requiring VComponents.

Each VDiagram also has a resourcelist, which is a linked list of VResource objects. Each VResource represents a specific hardware resource. There may be many resholders for multiple access points for a single resource in a VDiagram, but the resource is represented only once in the resourcelist. Each VResource object maintains a list of read-type resholders and a list of write-type resholders.

FIG. 24 illustrates an example program hierarchy in which the same global variable is read in one subprogram and written in another subprogram. The process of building a VDiagram tree which requires external resources is described here for the example program hierarchy of FIG. 24 . This example will focus on the information added to the VDiagrams to represent the external resources. As shown in step 452 of FIG. 15 , the VDiagram constructor calls a message handler function to add information for each object to the VDiagram. As explained above, child VDiagrams are added to the VDiagram in a depth-first traversal order of the graphical program hierarchy. We thus start with subprogram number 2.

Subprogram number 2 reads global variable “a”. Thus, the message handler function that adds the information representing the global variable object to the VDiagram adds a read-type resholder to the VDiagram. The read-type resholder has a data output signal for the value that is read from the hardware resource (the global variable register in this case). The resholder also has the normal enable_in and enable_clr inputs and the enable_out output. In addition, it has two special ports called RES_RI and RES_RO. These abbreviations stand for “resource read input” and “resource read output”. The resholder bundles its normal inputs and outputs into a read group and a write group and connects these bundles to the RES_RI and RES_RO ports, respectively. Since this VDiagram is not the top-level VDiagram, ports are created on the VDiagram's topportmap to pass the resholder's RES_RI and RES_RO data up to the next level VDiagram. FIG. 25 illustrates the hardware represented by the VDiagram for subprogram 2.

After the global variable object's message handler function adds the read-type resholder for the read access point, it also adds a VResource object to the VDiagram's resource list. The address of the resholder is added to the VResource's list of readers. Since in this example there are no other access points for the global variable “a,” no other entries appear in the VResource's lists of resholders.

After the global variable object's message handler function completes, step 452 of FIG. 15 continues as expected, calling message handlers for the incrementer function and wire shown in subprogram 2. As shown in FIG. 15 , the next step 454 adds routing information for the resources to the VDiagram. VPorts are added to the topportmap of the VDiagram to pass the resource RES_RI and RES_RO signals between the VDiagram and its parent VDiagram. There is only one resource in the VDiagram's resourcelist and that resource only has one resholder. Thus, only two top-level ports are needed. After the two top-level resource VPorts are built, VSignals are added to connect the top-level VPorts to the RES_RI and RES_RO ports on the resholder VComponent.

As previously noted, VPorts of a child VDiagram are copied to the snnholder's port map. The port numbers assigned to the resource ports of the resholders are recorded. The parent VDiagram can use this information to route the resource signals through the appropriate ports in the srnholder to reach the appropriate resource access points.

Step 456 of FIG. 15 executes normally. This step does not need to do anything special to handle resources.

Step 458 of FIG. 15 consolidates the resource information in the VDiagram's resourcelist with the parent VDiagram's resourcelist. At this point, any access points in the portion of the program represented by the parent VDiagram have not yet been identified. However, the resource information for each child VDiagram is consolidated as step 458 is performed for each child VDiagram. Resource information for the parent VDiagram's own access points is added when the steps of FIG. 15 are carried out for the parent VDiagram.

The VResources of the child VDiagram that is constructed first are simply copied into the parents VDiagram's resourcelist. For other child VDiagrams, if the parent resourcelist already has a VResource with the same resource ID as the child's VResource, a complete copy is not performed. Instead, the linked list of resholder pointers in the child's VResource is merged into the linked list of the parent's VResource. As each child VDiagram is built and performs step 458 , the top-level VDiagram eventually ends up with the complete set of resource information for the entire VDiagram tree.

Once resource consolidation is finished, the VDiagram constructor for subprogram 2 returns. The depth-first traversal of the graphical program hierarchy continues with subprogram 4. The only major difference in the construction of VDiagrams for subprogram 2 and subprogram 4 is the type of resholder that is created. Since subprogram 4 writes to the global variable “a,” a write-type resholder is added to the VDiagram from subprogram 4 instead of a read-type resholder. FIG. 26 illustrates the hardware represented by the VDiagram for subprogram 4.

Steps 452 , 454 , 456 , and 458 are performed to build the VDiagram for subprogram 4 as described above for subprogram 2. Step 458 merges the VResource object for the global variable “a” into the resourcelist of the parent VDiagram (the VDiagram for subprogram 3). As described above, the write-type resholder for the write access point in subprogram 4 is contained in the VResource's list of write-type resholders.

The depth-first traversal continues with the construction of the VDiagram for subprogram 3. Since subprogram 3 does not have any access points, no new resource data structures are added. However, step 454 is slightly different for subprogram 3 than for subprograms 2 and 4. Because there are no access points for this VDiagram, the only resource information in the resourcelist is the global variable “a” VResource that was inherited from the VDiagram for subprogram 4. The VDiagram constructor function can determine that this VResource was inherited from a child VDiagram by checking the srnholder fields of the resholders in the VResource's linked lists. The srnholder field contains a pointer to the srnholder of the VDiagram from which the resholder was inherited. If the srnholder field is not null, then the resholder in question is a resholder of a child VDiagram. Thus in step 454 when routing information for the resource signals is added, the port map of the srnholder of the appropriate child VDiagram can be searched to find the correct ports to connect the resource signals to. (As noted above in the description for step 454 for subprogram 2, the port numbers assigned to the resource ports of resholders are recorded.) FIG. 27 illustrates the port connections added to the VDiagram for subprogram 3 (referred to as VDiagram 3) during step 454 of FIG. 15 . Note that ports from the port map of the srnholder for VDiagram 4 are reassigned to ports on the top-level portmap of VDiagram 3. In this example the port numbers do not change between VDiagram 4 and VDiagram 3. If VDiagram 3 had another srnholder exactly like the one for VDiagram 4, the resource ports from that srnholder would get mapped to other top-level port numbers on VDiagram 3, e.g., 0x80000002 and 0x80000003. Thus it is possible for a resource to change port numbers as it propagates up the VDiagram tree.

After generating the ports and signals to connect the srnholder for VDiagram 4 to the port map of VDiagram 3, step 454 of FIG. 15 updates the port number information for resholders whose port numbers were reassigned. (There were no reassignments in this case.) Also, the srnholder field is updated to point to the srnholder for VDiagram 3. This will enable the VDiagram constructor for the top-level VDiagram to determine that that resource was inherited from VDiagram 3.

The fields that hold the srnholder and portnumber pointers may get overwritten every time step 454 executes. It is not necessary to preserve this information. If the mapping for a resource at any particular level in the VDiagram tree needed to be determined, it would be possible to compare the fields for the VResource entry in a parent VDiagram with the fields for the VResource entry representing the same resource in a child VDiagram.

After step 454 of FIG. 15 completes for VDiagram 3, step 456 proceeds normally. Step 458 then copies the same resource information that was inherited from VDiagram 4 up to VDiagram 1. VDiagram 1 already has a VResource in its resourcelist for global variable “a” which was inherited from VDiagram 2. The information about the write-type resholder for VDiagram 4 is merged into the resholder list of the existing VResource.

The execution of the steps of FIG. 15 is a special case for VDiagram 1 because VDiagram 1 is the top-level VDiagram. Instead of routing resource ports from srnholders to the toplevel port map, the VDiagram constructor builds VComponents for the resources themselves and connects them to the srnholder ports that feed back to the resholders. In this example, a globreg component is created for the global variable register. The globreg register component is then connected to the external address and data bus ports. Next, the VDiagram constrctor determines whether any arbitrators are necessary to multiplex multiple access points of the same type. If there are zero read or write access points for a given VResource, then the read or write inputs to the resource VComponent are driven with all zeroes. If there is only one read access point then the read ports of the resource VComponent can be connected directly to the resource ports of the read-type resholder. Similarly, if there is only one write access point then the write ports of the resource VComponent can be connected directly to the resource ports of the write-type resholder. In the example program hierarchy of FIG. 24 , there is only one read access point and one write access point. Thus no arbitrators or zero-drivers are necessary in this example. FIG. 28 illustrates the ports, components, and connections that are generated by the VDiagram constructor for VDiagram 1 .

Step 454 for a top-level VDiagram determines the type of each resource and adds an appropriate library component reference to the VDiagram. If the component requires any special signals, such as an address decode signal, they are also added. For a global variable register, the address decode for the globreg is constructed using a VADecNode-type VAssignment. Addresses may be assigned to globregs based on the order in which they are built. For example, a variable that stores the next valid address may be incremented each time a globereg is built.

If there is more than one read or write access point for an individual resource, the top-level VDiagram constructor adds arbitrators to the top-level VDiagram to manage the multiple accesses. FIG. 29 illustrates the ports, signals, and components that are created to manage a global variable resource with two read and two write access points. Arbitrators have wide inputs and outputs on the resholder side and narrow inputs and outputs on the resource side. The wide inputs accommodate the array of data generated by concatenating the resource signals from multiple access points together.

The JOIN operators shown in the diagram are built using VALogicNodes with the operation parameter set to a value specifying that the signals should be concatenated. This produces an assignment statement signifying that the destination signal is driven by the concatenation of all of the input signals. The SPLIT operator is built using a VASliceNode. This produces an assignment statement signifying that the destination signal is driven by a specific bit range of the source signal.

Additional Information

The above explanation describes the basic system and method of the present invention. This section provides additional information regarding step 452 of FIG. 15 , in which message handler functions are called for each object in the portion of a program represented by a VDiagram. Different message handlers are called for different types of objects. As described above, these message handler functions add information and data structures to the VDiagram in order to represent the respective objects in hardware. The following information applies to message handler functions for particular types of objects.

DiagOSaveHWInfoMethod

This is the message handler function for the root object of the entire block diagram (graphical program). This is the first OSaveHWInfoMethod call generated in step 452 of FIG. 15 . This function does not add anything to the VDiagram. Instead, it generates more OSaveHWInfo calls for all of the nodes on the block diagram, and then all of the signals on the block diagram. This order is important. Signals cannot be properly processed until all of the components they connect to have been added to the VDiagram.

Note that specific graphical program components and constructs are discussed are discussed below, such as sequence structures, case structures, loops, loop tunnels, shift registers, etc. For more information on these concepts, please see the above-referenced patents or the LabVIEW documentation available from National Instruments.

SignalOSaveHWInfoMethod

This function creates a VSignal object to represent a signal appearing in a graphical program and inserts it into the VDiagram's signallist. Then, it builds a terminal list of VSigterm objects that point to VComponents. This terminal list is built using the information stored in the root object representing the signal in the graphical program. Information is also included in the VDiagram to build the enable chain as described above.

SignalOSaveHWInfoMethod determines the type of connection for all of the signal's terminals. There are three major types of connections:

1. SRN Connection

The signal attaches to an SRN object. This can be any of the following:

a) Front Panel Control or Indicator

These connections appear as ports on the VDiagram's topportmap. A VALogicNode assignment statement is generated to drive the signal with the signal attached to the port. No enable chain logic is generated because all front panel controls are valid when the subprogram is executed, and all components are automatically dependent on the subprogram's enable_in signal. Likewise, the subprogram is automatically dependent on all of its components' enable_out signals. Thus, signals that drive Front Panel Indicators do not generate any extra enable chain logic.

b) Tunnel, Right Shift Register, or Sequence Local

These connections appear as ports in exactly the same way that front panel controls and indicators do. No enable chain logic is generated for the same reasons as above. These connections are separate from the front panel controls and indicators because the front panel objects may be stored in the graphical program differently than tunnels, shift registers, and sequence locals.

c) Left Shift Register

A left shift register is a VComponent in the VDiagram's complist. A VSigterm is added to the signal to indicate that the signal is connected to the data port of the left shift register VComponent. The enable_out of the left shift register VComponent is used to drive the enable chain for this signal.

2. While, For, or Case Connection

The signal attaches to a programmatic structure component from the outside. Normally, this means a connection to a port on the loop srnholder. A VSigterm is added to the signal to indicate that the signal is connected to a specific port of the loop srnholder. If the signal drives a loop input, then the signal is considered to be an enable dependency for the loop. SignalOSaveHWInfoMethod calls AddEnvDependency on the loop's srnholder to add the current signal's enable signal to the srnholder's dependency list. If the signal is driven by a loop output, then the structure controller's enable_out is used as the enable for the signal. There are two special cases where additional logic needs to be created here:

a) If the signal drives the Maximum Iteration node of a For loop, the signal is routed to the For loop's srnholder and also to the structure controller for the For loop. Two VSigterms are added to the signal. This ensures that the maximum iteration value is accessible not only to the structure controller, but to the components inside the for loop as well.

b) If the signal drives the Case Select input of a Case structure, the signal is routed to each of the case's srnholders and also to the structure controller.

Multiple VSigterrms are added to the signal. This ensures that the select input is accessible to both the case structure controller and also the contents of every frame in the case structure.

3. A Normal Component Connection

In this case, the signal attaches to a normal component such as an adder or a multiplier. These components are VComponents in the VDiagram. A VSigterm is added to connect the signal to a specific port of the VComponent. If the signal drives one of the component's inputs, AddEnvDependency is called for that VComponent. If the signal is driven by one of the component's outputs, the VComponent's enable_out is used as the enable for the signal.

SRNOSaveHWInfoMethod

Self reference node (SRN) is the term used to signify the internal object maintained by the graphical program system which groups together the objects contained in a program, subprogram, or subframe. These include objects such as constants, shift registers, tunnels, sequence locals, wires, subprograms, programmatic structures, etc. This function does not add any objects to the VDiagram tree. Instead, it generates more OSaveHWInfo calls for the objects it contains.

FPTermOSaveHWInfoMethod

This function does not add any objects to the VDiagram tree. Instead, it generates a single OSaveHWInfo call to the front panel control or indicator object it points to.

FPDCOOSaveHWInfoMethod

This function is the target of the OSaveHWInfo call in FPTermOSaveHWInfoMethod. Front panel controls and indicators are represented as ports on the VDiagram's topportmap. This function adds a port for a front panel object to the VDiagram's topportmap only if it is wired to the connector object of the program. Unwired front panel objects are left floating. After the port is created, a VSignal of the appropriate width is attached to the port. Signals that attach to the front panel control or indicator then get attached to this new signal by SignalOSaveHWInfoMethod.

TermOSaveHWInfoMethod

This function is the target of the OSaveHWInfo calls made by SRNOSaveHWInfoMethod. This function does not add any objects to the VDiagram tree. Instead, it generates a single OSaveHWInfo call to the constant, shift register, tunnel, or sequence local that the terminal is associated with. This function translates OSaveHWInfo calls from terminals on an SRN's object list to the actual objects the terminals are attached to.

BDConstDCOOSaveHWInfoMethod

A constant is represented in the VDiagram tree as a VSignal of type V_CONST. A new VSignal is created with the appropriate initialization value and added to the VDiagram's signallist.

RSROSaveHWInfoMethod

This function processes a right shift register and all of its attached left shift registers. One left shift register VComponent is added to the VDiagram for each left shift register in the shift register chain. Signals are created to propagate the data along the shift register chain. VSigterms for these signals are created to link all of the left shift register VComponents together. If any of the left shift registers are initialized, ports are added to the VDiagram's toplevel portmap to send that data into the VDiagram. Then VSignals and VSigterms are created to attach the ports to the initialization inputs of each left shift register VComponent. If a signal is attached to the right shift register from outside the loop, a VDiagram port is created to pass the shift register data to the parent VDiagram. Otherwise, the right shift register is treated simply as an internal signal that drives the shift in data port of the first left shift register in the shift chain.

LSROSaveHWInfoMethod

Because RSROSaveHWInfoMethod builds all of the VComponents for the left shift registers, this function does not need to do anything.

SLocOSaveHWInfoMethod This function processes a sequence local. Sequence locals are treated as ports on the VDiagram's portmap. The same sequence object will get a SLocOSaveHWInfoMethod call for each frame in the sequence structure. It is important to not generate ports for the sequence local until the frame where the local is driven. SLocOSaveHWInfoMethod checks for this and will not add ports if the sequence local is not driven in the current VDiagram. In all sequence frames after the local is driven, a port will be created regardless of whether the local is read or not. Only ports are created in the function. SequenceOSaveHWInfoMethod will generate the VSignals that propagate the local between frames.

SeqTunOSaveHWInfoMethod

SelTunOSaveHWInfoMethod

LpTunOSaveHWInfoMethod

These three methods generate loop tunnels in similar ways. Loop tunnels are represented in hardware as ports on the VDiagram they belong to. Each of these functions generates a new VPort for the VDiagram's topportmap and attaches a new VSignal to that port. Any future signal that connects to the tunnel will either drive or be driven by this new VSignal by a VAssignment object. External multiplexers for Case output tunnels are not generated in this function. They are built in SelectOSaveHWInfoMethod. Sequence tunnels that are outputs only become ports on the VDiagram frame in which they are driven. Sequence input tunnels are turned into ports on all VDiagram frames.

CaseSelOSaveHWInfoMethod

This method processes the case select input node of a case structure. This node becomes an input port on each VDiagram belonging to the case. This allows the components inside the case frames to use the select input as a data source.

LMaxOSaveHWInfoMethod

This method processes the maximum iteration node of a For loop. This node becomes an input port on the VDiagram belonging to the For loop. This allows the components inside the loop to connect to the maximum iteration node. On the outside of the loop, the signal that drives this node attaches both to the new VDiagram port and also to the maximum iteration port on the For loop structure controller.

LCntOSaveHWInfoMethod

This method processes the iteration counter node for while loops and for loops. This node becomes an input port on the VDiagram corresponding to the loop subframe. On the outside of the loop, this port is driven by the loop structure controller's iteration count output.

LTstOSaveHWInfoMethod

This method processes the continue node for a While loop. This node becomes an output port on the VDiagram corresponding to the loop subframe. On the outside of the loop, this port drives the While loop structure controller's continue input.

PrimOSaveHWInfoMethod

This method processes functions, such as adders, comparators, data manipulation operators, type converts, etc. This function adds a new VComponent to the VDiagram's complist. Clock, reset, and enable chain ports are added to the new VComponent. Then, generic parameters and data ports are added to the new VComponent. The exact ports and generics that are added depend on the type of the function. Numeric functions have WIDTH and REPRESENTATION generic parameters. Comparison functions typically have WIDTH-based inputs, but only single-bit outputs. Other functions such as Split, Join, Scale, and Select have slightly more complicated generic parameters and data ports.

GRefOSaveHWInfoMethod

This method processes references to global variables. This function adds a new resholder VComponent to the VDiagram's complist. If the reference is a global variable read, a read-type resholder is created. A write-type resholder is created for global variable writes. Clock, reset, and enable chain ports are added to the resholder VComponent. A generic parameter for the data width is also added. Lastly, the function creates a new VResource object to represent this resource access point and adds it to the VDiagram's resourcelist. If a VResource already exists for the global variable, the new resholder is automatically consolidated into the existing VResource.

IUseOSaveHWInfoMethod

This method processes references to subprograms. A srnholder component is created and added to the VDiagram's complist. The srnholder is given clock, reset, and enable chain connections. Then, a new VDiagram object is constructed for the referenced subprogram. This new VDiagram is added to the current VDiagram's subvilist. Once the child VDiagram is built, its topportmap is copied into the srnholder's port map. This ensures that the subVDiagram and the srnholder have the same port map. IUseOSaveHWInfoMethod treats all subprograms as re-entrant and makes unique VDiagrams for each instance of a subprogram.

WhileLoopOSaveHWInfoMethod

This method processes While loops. A srnholder component is created for the While loop and added to the VDiagram's complist. Then, a new VDiagram object is constructed. The loop subframe is used as the root node for building the child VDiagram. The child VDiagram is added to the parent VDiagram's srnvilist. After the child VDiagram is built, its topportmap is copied into the srnholder's port map. This ensures that the subVDiagram and the srnholder have the same port map. The srnholder VComponent is given clock and reset signals. A While loop structure controller is created and added to the VDiagram's complist. The structure controller is given clock, reset, and enable chain signals. It is also given subdiagram enable signals (subdiag_en, subdiag_done, subdiag_clr), and these signals are given VSigterms to attach them to the loop srnholder. The structure controller points to the srnholder. The srnholder points to the subVDiagram.

ForLoopOSaveHWInfoMethod

This method processes For loops. It functions similarly to the WhileLoopOSaveHWInfo method. The For loop structure controller has a parameterized input width for the maximum iteration input so that the maximum iteration node can be driven by a signal of any integer type.

SequenceOSaveHWInfoMethod

This function builds srnholders and child VDiagrams for each frame in the sequence. These child VDiagrams are added to the parent VDiagram's subsrnlist. However, no structure controllers are built. The sequence frame srnholders are given clock, reset, and enable chain signals. As each sequence frame srnholder is built, the enable_out signal from the previous frame is set as an enable dependency for the current frame. This ensures that the sequence frames execute in sequence regardless of whether they share any data or not. After child VDiagrams are built for the sequence frames, SequenceOSaveHWInfoMethod processes sequence locals. Each sequence local appears as a port on one or more of the child VDiagrams. These ports are connected together with a VSignal. For each sequence local in a sequence, a VSignal of the appropriate width is created and added to the VDiagram's signallist. Then, VSigterms are created to attach the new signal to each of the frames the sequence local connects to.

SelectOSaveHWInfoMethod

Similarly to SequenceOSaveHWInfoMethod, this function builds srnholders and child VDiagrams for each frame in the case structure. These child VDiagrams are added to the parent VDiagram's subsrnlist. A structure controller is built. The case structure controller has parameterized ports for the width of its select input and the number of case frames it controls. The case controller is also given clock, reset, enable chain, and subdiag enable chain ports. The subdiagram enable signals are routed to the srnholders in a special way. The subdiag_en signal is a wide signal with one bit for each case frame. Frame 0 uses subdiag_en(0) as its enable_in. Frame 1 uses subdiag_en(1) as its enable_in, etc. Subdiag_clr is wired to the enable_clr input of all the srnholders. The enable_out outputs of all the srnholders are OR'd together using a VALogicNode assignment to drive the subdiag_done input of the case controller. SelectOSaveHWInfoMethod builds multiplexors for the case structure's output tunnels. Each output tunnel is driven by a VAMuxNode assignment. This ensures that only the outputs of the currently selected case frame can be used outside of the case structure. The case controller's subdiag_en signal is used as the select signal for all output multiplexors. When subdiag_en(0) is active high, each output tunnel multiplexor will select the outputs of case frame 0. When subdiag_en(1) is active high, each output tunnel multiplexor will select the outputs of case frame 1, etc. Each case output tunnel is driven by every case frame. Thus, SelectOSaveHWInfoMethod assumes that each multiplexor will have the same number of inputs. The hardware description syntax may be generated in such a way that implicitly causes the last frame in the case to become the default.

FIGS. 30 and 31 —Coordinating Data Flow with Host Processor

As described above, a portion of a graphical program may be converted to a hardware implementation, while another portion executes on the host CPU. In most cases, data will flow between these two program portions. FIGS. 30 and 31 illustrate how this data flow is coordinated through hardware resources. As noted above, external resources are only resolved in the top-level VDiagram. All access points to external resources in child VDiagrams are funneled up to the top-level VDiagram. Thus FIGS. 30 and 31 are only relevant to the top-level VDiagram.

FIG. 30 illustrates tying in an output signal with the host processor. In step 500 the VDiagram constructor determines whether the output signal connects to an object in the portion of the graphical program executing on the host CPU or to an object internal to the hardware portion of the program. As shown in step 506 , if the signal connects to an object within the hardware portion, then a VSigterm or VAssignment is created to represent this connection in the usual way as described above.

If the signal connects to the CPU portion of the program, then in step 502 the VDiagram constructor adds information to the VDiagram to represent a hardware read register that the signal can connect to. This hardware register receives the signal output as its data input, as shown in step 504 . It also uses the enable_out of the signal as its enable_in input, thus maintaining the proper execution order.

The CPU portion should also coordinate itself with the hardware portion. The graphical program system recognizes that the input for one of its components originates from the hardware portion, and reads the read register created in step 502 accordingly for the component's input. Thus the system works together to seamlessly enable hardware program execution.

FIG. 31 illustrates the process of FIG. 30 corresponding to an input signal from the CPU portion rather than an output signal to the CPU portion. If the signal is not from the host portion, then it is tied to the output node of an internal component in step 514 . If the signal is from the host portion, it is tied to a write register that the host portion writes to.

FIG. 32 —Generating VHDL from a VDiagram Tree

As previously noted, various back ends may parse the VDiagram tree and generate a hardware description from it. For example, the system may comprise a VHDL back end to generate a VHDL hardware description, an EDIF back end to generate an EDIF hardware description, an XBI back end to generate a Java hardware description, etc. FIG. 32 is a flowchart diagram illustrating how a back end may generate VHDL syntax for a VDiagram tree. In step 602 , the VHDL back end generates VHDL text for all child VDiagrams of the top-level VDiagram that correspond to subprograms. A VDiagram may have two types of child VDiagrams: child VDiagrams representing subprograms and child VDiagrams representing subframes of programmatic structures such as while loops, case structures, etc. These two types of child VDiagrams are maintained in separate lists in the VDiagram (the subvilist and the srnlist, respectively). In step 602 the child VDiagrams that correspond to subprograms are parsed and VHDL text is generated for them. The VHDL for each subprogram VDiagram is preferably placed in a separate file, but may also be generated into a single file.

In step 604 , the VHDL back end generates VHDL text for the child VDiagrams representing programmatic structure subframes. The VHDL code for each of these VDiagrams is generated into the same file so that local components such as sequence frames stay together.

Steps 602 and 604 generate the VHDL code for the top-level VDiagram's child VDiagrams. These steps occur before any VHDL code is generated for other components of the top-level VDiagram, such as signals or constants. Thus the back end traverses the VDiagram tree in a depth-first manner. For each child VDiagram, the steps of FIG. 32 are performed. If a VDiagram has no children, then steps 602 and 604 do nothing and execution continues with step 606 . The depth-first parse through the VDiagram tree ensures that the entity/architecture block pair for a child VDiagram is written to an output file before the entity/architecture block pair for a parent VDiagram. This order is a requirement of many VHDL compilers.

In step 606 the VHDL back end generates the VHDL library include statements.

In steps 608 - 616 the VHDL entity/architecture block pair for the VDiagram is generated. In step 608 the VHDL entity declarations for ports connecting the VDiagram to its parent are generated. In step 610 the VHDL entity declarations for components in the VDiagram's complist are generated. A message handler function is called for each type of component to generate these declarations. In step 612 the VHDL declarations for signals in the VDiagram's signallist is generated. In step 614 the VHDL component instantiations for components in the VDiagram's complist are generated. A message handler function is called for each type of component to generate these instantiations. In step 616 the VHDL assignment statements are generated.

Downloading a Hardware Implementation to the Programmable Logic

There are various possibilities or methods for downloading (or uploading) a hardware implementation to the programmable logic device. In one instance, the host CPU merely uploads the configuration to the programmable logic as described above. This could occur by the driver at boot up time or when the user presses the run button on the graphical program that was created. Alternatively, the host CPU provides the hardware implementation to a non-volatile memory comprised on the board, and during boot up of the board this hardware implementation is loaded from the non-volatile memory on the board into the programmable logic.

Thus the reconfigurable board can be designed so that the hardware diagram is written to non-volatile memory instead of directly to the FPGA. This allows a hardware implementation of a diagram to begin execution at power-on (long before the operating system has finished booting). In this case, the program preferably has top-level enable_in and abort signals which can be configured at compile time to either allow immediate execution or to require a supervisory program to enable hardware execution.

Default Configuration for Hardware Simulation

As discussed above, in one embodiment the system of the present invention comprises a computer system which includes or is coupled to a device, such as an add-in card. The device may perform a data acquisition/generation function, e.g., may be a data acquisition card. The DAQ card includes D/A and A/D converters as well as various other data acquisition logic, and includes a programmable logic device such as an FPGA which is operable to receive a hardware implementation created in response to a graphical program created on the computer system.

In one embodiment of the invention, the programmable logic or FPGA is operable to receive a default configuration, whereby the default configuration operates to configure the data acquisition board with a standard interface for execution of the graphical program in software. Thus, for example, the host CPU may upload a hardware implementation to the FPGA which programs the FPGA with a default configuration of a board to provide a desired interface for the board. This configuration would provide the host computer with direct access to the I/O of the board. This is useful, for example in hardware simulation, to allow the host CPU to execute the graphical program or diagram in software during algorithm development to determine feasibility and perform debugging etc. The graphical program behaves the same as it normally would in hardware, except the program runs slower due to software execution. However, software debugging tools available in the graphical programming system are available in order to more easily debug the program. This implementation also provides a faster compile time thus allowing a quicker turnaround for user bug fixes. Thus, it is anticipated that the user will upload a default configuration to the programmable logic and execute the graphical program being created in software one or more times to facilitate debugging. Once the graphical program has been constructed to a satisfactory performance, then the user may upload the actual hardware implementation of the graphical program to the programmable logic as described above.

As discussed above, there are various possibilities or methods for uploading a default configuration to the programmable logic. In one instance, the host CPU merely uploads the configuration to the programmable logic as described above. This could occur by the driver at boot up time or when the user presses the run button on the graphical program that was created. Alternatively, the host CPU provides the default configuration to a non-volatile memory comprised on the board, and during boot up of the board this default configuration is loaded from the non-volatile memory on the board into the programmable logic.

Estimation of the Size and Cost of a Hardware Implementation

In one embodiment of the invention, the graphical programming system includes a data structure which includes a listing of each of the elements or components comprised in the component library, as well as the corresponding cost of each component in terms of gates and time of execution. Thus, in this embodiment when a graphical program is created, the graphical programming system operates to reference the data structure to obtain the associated gate and time costs associated with each component being used from the component library in the graphical program being constructed. For example, the graphical programming system totals the amount of gates utilized with regard to each component being used in the graphical program being constructed, and then determines if the programmable logic or FPGA being used has sufficient capacity to implement that graphical program. Also, the graphical programming system can use this data structure to determine at or prior to compile time how fast the graphical program will execute in hardware, i.e., how fast the hardware implementation will execute in the FPGA.

Alternatively, the graphical programming system receives user input regarding desired execution time and utilizes the execution times of each of the elements to provide feedback to the user as to whether the graphical program satisfies the users requirements regarding time of execution.

In addition, in one embodiment the component library includes multiple versions of respective components. For example, the component library includes a fast multiplier that is large and a small multiplier that is slow. The graphical programming system can be configured to select the appropriate version of component based on how much of the FPGA is consumed by the rest of the diagram and based on the loop times indicated in the diagram, or other input from the user and/or information in the diagram. Thus, in one embodiment, the user inputs both the number of gates comprised in the programmable logic being used as well as the desired time of execution, and the graphical programming system automatically selects among various versions of components in the component library, e.g., a slower and less complex adder vs. a faster but more complex adder, in order to develop a hardware implementation which is suitable for the user's application.

In another embodiment, the user can select between parameter execution time vs. deployment size. In other words, the user may have the option to configure compilation time vs. optimization of the parameters above. Given the interactive and target customer of this system, compilation time may be an important parameter, wherein the user may choose to optimize compilation time over the parameters above.

Manipulation of Non-Reuseable Hardware Resources

When a user creates a graphical program which manipulates one or more hardware resources of a device, such as one or more hardware resources comprised on an add-in board, e.g., a data acquisition board, in general the hardware device or board will have a limited number of hardware resources or components that are useable by the graphical program. For example, a given data acquisition board may only have one analog input channel. At least a subset of these hardware resources may only be used once, i.e., are not re-useable, referred to as non-reusable components. Examples of hardware resources include A/D converters, D/A converters, timers, counters, clocks, input channels, output channels, filters, and other logic blocks.

In one embodiment of the invention, the non-reusable components comprised on the hardware being controlled appear on a palette during configuration or construction of the graphical program. More specifically, icons representing these non-reusable components or hardware resources appear on a palette during configuration or construction of the graphical program. The icons representing these non-reusable components disappear as they are used by the diagram to indicate to the user that these components have been used and thus cannot be reused. In one embodiment, the user simply drags these non-reusable component icons from the palette into the graphical program. Once these components are dragged from the palette into the graphical program, the component icon disappears from the palette, and thus the user knows that the component has been used in the graphical program and is thus not available for reuse.

Where two or more hardware resources or components are comprised on the board which can be used, a corresponding two or more components appear in the palette. In this instance, as each component is used in the graphical program, the corresponding picture in the palette disappears to alert the user as to the number of remaining hardware components which can be used. This provides a convenient mechanism for providing information to the user regarding the hardware components used and prevents reuse of a non-reusable component.

In some graphical programs, it is often convenient for a single graphical program to access a single hardware element from several locations in the graphical program or diagram. This would technically violate the single instance or non re-useability concept discussed above, whereby a non-reusable component can be used only once in a graphical program. However, where the user desires to access a single non-reusable hardware element in several places in a single graphical program, the user preferably constructs sequencing or implements sequencing in the graphical program which prevents this hardware element from being used simultaneously within the same graphical program. For example, in the LabVIEW program the user constructs sequencing using a sequence structure. In one embodiment, references to hardware elements in the graphical program provide a “handle” to the hardware which is provided to the graphical program which can be used in multiple locations within the graphical program. This reference or “handle” to the hardware can then be used to provide simultaneous accesses to a single device in the graphical program.

In general, there are three different ways a graphical program or diagram can be constructed to access unique hardware resources. In a first instance (a) a single reference to the hardware appears in the diagram as discussed above. In a second instance (b) multiple references to the hardware appear in the graphical program, but no two of these references occur simultaneously. For example, the user can figure these multiple references in different frames of a sequence structure. In a third instance (c) the graphical program includes multiple references to the hardware, and the way in which the graphical program is constructed indicates that these multiple references may be executed simultaneously.

In the preferred embodiment, the graphical programming system preferably detects which of the above cases exist and performs any necessary type of configuration to accommodate these situations. In the first instance of case (a), a single reference to the hardware appears in the graphical program, and thus the graphical programming system is not required to perform any special processing in generating the hardware implementation. In the second case (b) mentioned above, the graphical program, when converting the sequence structure to a hardware implementation, utilizes multiplexers to multiplex the control and data inputs to the hardware in question with the same signals to guarantee that simultaneous accesses are impossible, as indicated by the sequence structure. In case (c) above, the graphical programming system preferably automatically detects an instance where multiple references in the hardware appear, wherein they may be executed simultaneously, and configures the hardware implementation to prevent these multiple accesses, and thus thereby preventing possible erroneous operation. In this instance, the graphical programming system, during the conversion process to the hardware implementation, detects the multiple references to the hardware which can be executed simultaneously, and instantiates one or more multiplexers and a full arbitration circuit to control the multiplexers. The multiplexers are provided in the hardware implementation to prevent or avoid the possibility of simultaneous execution of these multiple references to the non-reusable hardware.

In cases (b) and (c), the hardware implementations use similar multiplexers. The difference between cases (b) and (c) is that in case (c) the hardware implementation includes a control circuit. In case (b) the control signals are the same control signals that control which frame of the sequence is executing, and in (c) the control signals come from an arbitration circuit. Also, in item (b), the multiplexers that configure and implement the sequence structure are set or defined at compile time. Alternatively, in case (c) the arbitration unit is not necessarily defined as far as ordering at compile time, but the order of execution is actually defined at run time.

Probe Insertion

In one embodiment, during creation of the graphical program, a user may insert one or more probes into the graphical program which operate to display data on the respective wire where the probe is located during execution of the graphical program. When the user inserts a probe in one or more locations in the graphical program, the programmable logic or hardware element is configured with an element, referred to generally as a probe element, to display the appropriate value during execution of the programmable logic, much the same way a probe placed in a graphical program is used to display a value during execution of the graphical program. Thus the probe element may provide a real-time view and observability into the programmable logic or FPGA. Examples of the probe element include a time stamp generation circuit a register, or other type of memory or circuit for implementing a probe function.

In one embodiment, when the user inserts a probe in one or more locations in the graphical program, the corresponding hardware implementation directs the use of a time stamp generation circuit. In other words, when the user inserts a graphical icon of a probe in one or more locations in the graphical program, the programmable logic is configured to include a time stamp generation circuit. The time stamp generation circuit may be used to produce a value for a memory in the programmable logic associated with the location in the graphical program where the probe was inserted. The time stamp generation circuit preferably produces a value for the memory when the value changes. More particularly, the time stamp generation circuit preferably produces a value/time pair value of a memory location at the time of transition when the value changes.

The time stamp generation circuit may be included inside the programmable logic or FPGA, or the time stamp generation circuit is configured in a separate chip or logic block included on the board which is coupled to the FPGA. This time stamp generation circuit allows the graphical programming system to insert probes into the hardware implementation of the graphical program or diagram. The time stamp generation circuit thus comprises a hardware implementation of the probe which was inserted in the software graphical program. This enables the hardware debugging environment to look and feel the same as it does in the graphical programming system. The time stamp generation circuit preferably provides its output on a pin of the programmable logic, e.g., the FPGA.

In an alternate embodiment, when the user inserts a probe in one or more locations in the graphical program, the corresponding hardware implementation directs the use of a register. In other words, when the user inserts a probe in one or more locations in the graphical program, the programmable logic is configured to include a register. The register may be used to store a value in the programmable logic associated with the location in the graphical program where the probe was inserted. The register is preferably memory-mapped, and thus may be readable through memory mapped I/O.

The probe value obtained from the programmable logic or FPGA during execution of the programmable logic may optionally be sent to the graphical user interface being executed and/or displayed by the host. Thus the probe value may be displayed on the display in the graphical program, much the way a probe value is displayed in a software-executed graphical program, e.g., LabVIEW.

In one embodiment, the system includes two compile modes referred to as debug and release. The debug mode may support the inclusion of probes, or the automatic insertion of probes by the system without user specification. After the product has been finalized, the probes may optionally be removed for release mode. The system may also include a “debug version” of the system or board with a larger FPGA and/or possibly extra support for the time stamping, etc., such as buffers, external memory, etc.

Data Path Optimization

In one embodiment, the graphical programming system is operable to detect graphical programs or diagrams that are streaming data to/from the host computer, and the graphical programming system inserts special circuits in the hardware implementation to handle DMA for high speed transfers without special consideration from the user. These circuits include FIFOs and circuits to generate DMA requests (DRQ) or the equivalent.

This method enables the graphical programming system to automatically generate a DMA circuit for the graphical program or diagram created by the user. In the usual case, all communication to the graphical program or diagram from the CPU passes through global variables. According to this embodiment, the diagram would include an icon which looks similar to a “write global” in the sense that it is a data sink. When the icon is executed, the icon would assert a DMA request (DRQ)that goes back to the DMA controller and triggers a DMA transfer. The FIFO and DRQ generation circuitry are built inside the FPGA when the DMA icon is used.

Occurrences

The LabVIEW graphical programming system includes an occurrence capability which allows a first function to “go to sleep” while waiting for a second function to produce a result. In this manner, the first function does not consume any CPU time while waiting for the second function. Three icons are provided with associated control software which implement the occurrence function. A Wait on Occurrence function icon is associated with the first function that is waiting on the result from the second function. A Set Occurrence function icon is typically associated with the second function icon and triggers an occurrence when the second function produces the desired result. A Generate Occurrence function icon is used to pass identifier values linking multiple sources and destinations having Set Occurrence and Wait on Occurrence function icons, respectively.

Occurrences share some of the properties of global variables in that their implementation depends greatly on whether they are “written” and “read” within a single environment (all in software, all in hardware, or crossing the software/hardware boundary). An occurrence that is set and detected within hardware involves set and detect occurrence components from the library. An occurrence that is set in hardware and detected by the host CPU can be mapped automatically to an interrupt. The graphical programming system, e.g., LabVIEW, would then generate the interrupt handling code to run on the host computer.

Automatic Generation of the Programmatic Interface

In one embodiment, the hardware implementation generated by the graphical programming system, can be configured to be controlled by other software environments or other protocols, e.g., C, C++, Java, Visual Basic, Visual C++, LabWindows CVI, other types of graphical programming systems, etc. In this embodiment, the graphical programming system can automatically generate a description of the hardware necessary including a register map, interrupt map, DMA abilities, etc. to enable other software environments to control the hardware implementation. For example, in the preferred embodiment using the LabVIEW Graphical Programming System from National Instruments Corporation, the graphical program constructed in LabVIEW is converted into a hardware implementation, wherein the hardware implementation also includes the above hardware information necessary to allow another software development environment to control or execute the hardware implementation.

Compensating for Poor Place and Route Results

As discussed above, the present invention preferably uses a third party tool which converts the netlist created from the graphical program into a hardware implementation or FPGA configuration. In one embodiment, if this third party tool reports that the maximum clock speed is less than expected by the graphical programming system, then the graphical programming system can optionally reduce the clock speed and adjust one or more counter values and timers to compensate for this new clock speed. This is preferably performed in cases where overall performance goals are still met.

This may be necessary in instances, for example, where the user has configured timing within the graphical programming system on the assumption of a certain clock speed, e.g., a timing loop which assumes a 20 MHz clock and a loop constructed based on this 20 MHz clock that loops for two milliseconds. In cases where the clock speed is less than expected, the hardware implementation may actually work differently than expected by the user due to this different clock speed. In this instance, the graphical programming system can automatically reduce the clock speed and adjust the counter values and respective timers to compensate for this new clock speed and thus provide the user with the performance that the user expected when he/she created the graphical program. This embodiment utilizes a configurable oscillator on the data acquisition board.

FIG. 33 —Simple Graphical Program Example

FIG. 33 illustrates a simple example of a graphical program. In FIG. 33 the graphical program includes three input terminals and one output terminal. The graphical program simply comprises a first 2-input Add function node which receives input from two inputs terminals, and a second 2-input Add function node which receives the output from the first Add function node and receives an output from the third input terminal. The second 2-input Add function node provides an output to output terminal as shown.

FIG. 34 —Hardware Result

FIG. 34 is a conceptual diagram of the resulting hardware after the graphical program example of FIG. 33 is converted into a hardware description. As shown, the hardware diagram includes three write registers 522 - 526 corresponding to each of the three input terminals. The data outputs of the first two write registers 522 and 524 are provided as inputs to a first two-input adder 532 , which corresponds to the first adder in the block diagram of FIG. 17 . The hardware description also involves creating an AND gate 534 which receives control outputs from each of the first two write registers 522 and 524 and provides a single output to the control input of the adder 532 . The purpose of the AND gate 534 is to prevent the adder 532 from executing until both inputs have been received.

The Adder 532 provides a data output to a second two-input Adder 542 , which corresponds to the second adder in the block diagram of FIG. 17 . The first Adder 532 also generates an enable out signal which is provided to an input of a second AND gate 536 . The other input of the AND gate 536 receives an output from the third write register 526 , corresponding to the third input terminal. The AND gate 536 provides an output to a control input of the second adder 542 . Thus, the AND gate 536 operates to ensure that the second adder 542 does not execute until all inputs have been received by the adder 542 . The second adder 542 provides a data output to a read register 546 associated with the output terminal. The second adder 542 also provides an enable out signal to the read register 546 , which notifies the read register 546 when valid data has been provided.

Thus, as shown, to create a hardware description for each of the input terminals, the flowchart diagram of FIG. 15 is executed, which operates to create a hardware description of a write register 522 , 524 , and 526 , each with data and control outputs. For each adder function node, a hardware description of an adder 532 or 542 is created, and an associated N input AND gate 534 or 536 is created, with inputs connected to the dependent inputs of the adder function node to ensure execution at the proper time. The flowchart diagram of FIG. 30 is executed for the output terminal of the graphical program, which operates to generate a hardware description of a read register with data and control inputs.

FIGS. 35 - 37 : Example of Converting a Graphical Program into a Hardware Implementation

FIGS. 35-37 comprise a more detailed example illustrating operation of the present invention.

FIG. 35 illustrates an example graphical program (a LabVIEW diagram) which is converted into an FPGA implementation using the present invention. As shown, the graphical program comprises a plurality of interconnected nodes comprised in a While loop. As shown, the While loop includes shift register icons, represented by the down and up arrows at the left and right edges, respectively, of the While loop. A 0 constant positioned outside of the While loop is connected to the down arrow of the shift register at the left edge of the While loop.

The While loop includes a timer icon representing or signifying timing for the While loop. The timer icon includes inputs for period and phase. As shown, the timer icon receives a constant of 1000 for the period and receives a constant of 0 for the phase. In an alternate embodiment, the While loop includes input terminals which are configured to receive timing information, such as period and phase.

FIG. 36 illustrates the LabVIEW data structures created in response to or representing the diagram or graphical program of FIG. 35 . The data structure diagram of FIG. 36 comprises a hierarchy of data structures corresponding to the diagram of FIG. 35 . As shown, the LabVIEW data structure representation includes a top level diagram which includes a single signal connecting the 0 constant to the left hand shift register of the While loop. Thus the top level diagram includes only the constant (0) and the While loop.

The While loop includes a sub-diagram which further includes left and right shift register terms, the continue flag of the While loop, a plurality of constants, a timer including period and phase inputs, global variables setpoint and gain, sub-VIs a/d read and d/a write, and various function icons, e.g., scale, add, subtract, and multiply. Further, each of the objects in the diagram have terminals, and signals connect between these terminals.

As described above, a VDiagram tree is constructed which represents the hardware components and the relationship among them required to convert the program into a hardware implementation. The VDiagram constructor is called for the “Diag” root object of the diagram, shown in FIG. 36 . The VDiagram constructor calls a message handler function for each of the objects shown in FIG. 36 . Once the VDiagram tree is built, a back end program is called to generate a hardware description using the information in the VDiagram tree.

FIG. 37 illustrates a circuit diagram representing the hardware description which is created in response to the data structures of FIG. 36 . The circuit diagram of FIG. 37 implements the graphical program of FIG. 35 . As shown, the CPU interface signals are bussed to the global variables. Although not shown in FIG. 37 , the CPU interface signals are also provided to the subprograms a/d read and d/a write.

The While loop is essentially abstracted to a control circuit which receives the period and phase, and includes an external enable directing the top level diagram to execute, which starts the loop. The loop then provides a diagram enable(diag_enab) signal to start the loop and waits for a diagram done (diag_done) signal to signify completion of the loop, or the period to expire. Based on the value of the Continue flag, the loop provides a subsequent diag_enab signal or determines that the loop has finished and provides a Done signal to the top level diagram. Although not shown in FIG. 37 , the loop control block also provides a diagram clear enable_out (diag_clear_enab_out) signal to every node in the sub-diagram of the While loop. Thus the loop control block outputs a diagram enable (diag_enab) signal that is fed to all of the starting nodes in the diagram within the While loop. The Done signals from these items are fed into an AND gate, whose output is provided to enable subsequent nodes.

The shift register includes a data in, a data out and an enable input which clocks the data in (din) to the data out (dout), and a load which clocks the initial value into the shift register.

Appendix A of U.S. patent application Ser. No. 09/499,503 titled System and Method for Configuring a Programmable Hardware Instrument to Perform Measurement Functions Utilizing Estimation of the Hardware Implementation and Management of Hardware Resources, filed on Feb. 7, 2000 is a VHDL description corresponding to the example of FIGS. 35-37 , wherein the VHDL description was created using an embodiment of the present invention.

Component Library

The preferred embodiment of the present invention includes a component library that is used to aid in converting various primitives or nodes in a graphical program into a hardware description, such as a VHDL source file. The following provides two examples of VHDL components in this component library, these being components for a While loop and a multiplier function.

1. While Loop Component

Appendix B is a source code listing that comprises a VHDL component referred to as whileloop.vhd that the present invention uses when a While loop appears on a graphical program or diagram. Whileloop.vhd shows how a While loop in a graphical program is mapped to a state machine in hardware. It is noted that other control structures such as a “For loop” are similar.

FIGS. 38-39 illustrate the block diagram of a graphical program called example1.vi.

Although the system and method of the present invention has been described in connection with the preferred embodiment, it is not intended to be limited to the specific form set forth herein, but on the contrary, it is intended to cover such alternatives, modifications, and equivalents, as can be reasonably included within the spirit and scope of the invention as defined by the appended claims.

Claims

1. A computer-implemented method for configuring an instrument to perform a measurement function, wherein the instrument includes a programmable hardware element, the method comprising:creating a graphical program, wherein the graphical program implements the measurement function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program; generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; configuring the programmable hardware element in the instrument utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the graphical program; the instrument acquiring a signal from an external source after said configuring; the programmable hardware element in the instrument executing to perform the measurement function on the signal.

2. The method of claim 1,wherein the instrument comprises an image acquisition device coupled to a camera; wherein the graphical program comprises an image processing function; wherein the instrument acquiring a signal from an external source comprises the camera acquiring an image of an object and the image acquisition device receiving and storing the image; wherein the image acquisition device comprises the programmable hardware element; wherein said executing comprises the programmable hardware element in the image acquisition device executing to perform the image processing function on the image.

3. The method of claim 2,wherein said executing further comprises: the programmable hardware element in the image acquisition device determining characteristics of the image after performing the image processing function; and the programmable hardware element in the image acquisition device performing an operation based on the determined characteristics of the image.

4. The method of claim 1,wherein the instrument comprises a smart camera; wherein the instrument acquiring a signal from an external source comprises the smart camera acquiring an image of an object and storing the image; and wherein the programmable hardware element in the smart camera executes to perform an image processing function on the image.

5. The method of claim 4,wherein said executing further comprises: the programmable hardware element in the smart camera determining characteristics of the image after performing the image processing function; and the programmable hardware element in the smart camera performing an operation based on the determined characteristics of the image.

6. The method of claim 1,wherein the instrument comprises a smart sensor; wherein the instrument acquiring a signal from an external source comprises the smart sensor acquiring the signal from the external source; and wherein the programmable hardware element in the smart sensor executes to perform the measurement function on the signal.

7. The method of claim 1, wherein the smart sensor is one of a temperature sensor, pressure sensor, camera, microphone, flow sensor, position sensor, velocity sensor, acceleration sensor, vibration sensor, electromagnetic sensor, optical sensor, radiation sensor, or environment sensor.

8. The method of claim 1,wherein the instrument comprises a fieldbus device; wherein the instrument acquiring a signal from an external source comprises the fieldbus device acquiring the signal from the external source; and wherein the programmable hardware element in the fieldbus device executes to perform the measurement function on the signal.

9. The method of claim 1,wherein the instrument comprises a programmable logic controller (PLC); wherein the instrument acquiring a signal from an external source comprises the PLC acquiring the signal from the external source; and wherein the programmable hardware element in the PLC executes to perform the measurement function on the signal.

10. The method of claim 1,wherein the instrument comprises a computer-based instrument, wherein the computer-based instrument is configured as a card inserted into a slot of a computer system; wherein the instrument acquiring a signal from an external source comprises the computer-based instrument acquiring the signal from the external source; and wherein the programmable hardware element in the computer-based instrument executes to perform the measurement function on the signal.

11. The method of claim 1,wherein the instrument comprises a reconfigurable measurement device, wherein the reconfigurable measurement device is configured as a card inserted into a slot of a computer system; wherein the instrument acquiring a signal from an external source comprises the reconfigurable measurement device acquiring the signal from the external source; and wherein the programmable hardware element in the reconfigurable measurement device executes to perform the measurement function on the signal.

12. The method of claim 1,wherein the graphical program includes a user interface portion; the method further comprising: presenting the user interface portion on a display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

13. The method of claim 12,wherein the user interface portion operates as a front panel for the instrument.

14. The method of claim 12, the method further comprising:receiving user input to the user interface portion on the display to control the instrument during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

15. The method of claim 12,wherein the user interface portion includes one or more user interface objects; wherein said generating includes incorporating a register in the hardware description for at least one of the user interface objects; wherein the programmable hardware element in the instrument executing to perform the measurement function on the signal includes accessing a register on the programmable hardware element to affect one of said user interface objects.

16. The method of claim 12, further comprising:compiling the user interface portion into executable code for execution by a processor and storing the executable code in a memory; the processor executing the executable code from the memory to present the user interface portion on the display.

17. The method of claim 16, wherein the instrument includes the processor and the memory;wherein the processor in the instrument executes the executable code from the memory to present the user interface portion on the display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

18. The method of claim 16, wherein the instrument is coupled to a computer system, wherein the computer system includes the processor and the memory;wherein the computer system executes the executable code from the memory to present the user interface portion on the display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

19. The method of claim 1, the method further comprising:performing analog to digital conversion on the signal after said acquiring and prior to said executing.

20. The method of claim 1, wherein the instrument further includes timer/counter logic, the method further comprising:the timer/counter logic performing one of timing/counting operations during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

21. The method of claim 1, wherein the programmable hardware element in the instrument executes to perform a process control function using the signal.

22. The method of claim 1, further comprising:converting the hardware description into a net list; and compiling the net list format into a hardware program file; wherein said configuring the programmable hardware element includes downloading the hardware program file to the programmable hardware element to configure the programmable hardware element.

23. The method of claim 22, wherein said converting the hardware description into a net list includes:utilizing at least one function block from a library of pre-compiled function blocks; and utilizing hardware target specific information.

24. The method of claim 1, wherein said creating the graphical program includes:arranging on the screen a plurality of nodes comprising the graphical program and interconnecting the plurality of nodes; creating and storing data structures which represent the graphical program in response to said arranging and said interconnecting; wherein said generating the hardware description comprises:traversing the data structures; converting the data structures into a hardware description format in response to said traversing.

25. The method of claim 1, wherein the graphical program includes a plurality of nodes;wherein said generating the hardware description comprises converting each of said nodes into a hardware description format.

26. The method of claim 25, wherein each of said nodes is converted into a hardware description format including an enable input, a clock signal input, and an enable output;wherein, for a respective node, said enable input receives an enable signal generated from enable out signals from one or more nodes which provide inputs to the respective node.

27. The method of claim 25, wherein the graphical program includes an input terminal;wherein, for said input terminal, said converting comprises: determining if data input to the input terminal is from a user interface portion executing on the computer system; creating a hardware description of a write register, wherein the write register includes one or more data outputs and at least control output.

28. The method of claim 25, wherein the graphical program includes a function node;wherein, for said function node, said converting comprises: determining inputs and outputs to/from the function node; generating a hardware description of logic which performs the function indicated by the function node; traversing input dependencies of the node; creating a hardware description of an AND gate, including listing connections of said input dependencies of the node to said AND gate.

29. The method of claim 25, wherein the graphical program includes a structure node;wherein, for said structure node, said converting comprises: determining inputs and outputs to/from the structure node; generating a hardware description of a control block which performs the control function indicated by the structure node; traversing input dependencies of the node; creating a hardware description of an AND gate, including listing connections of said input dependencies of the node to said AND gate.

30. The method of claim 25, wherein the graphical program includes an output terminal;wherein, for said output terminal, said converting comprises: determining if data output from the output terminal is to a user interface portion executing on the computer system; creating a hardware description of a read register, wherein the read register includes one or more data inputs and at least control input.

31. The method of claim 1, wherein the graphical program comprises a data flow diagram.

32. The method of claim 1, wherein a first portion of the graphical program is converted into a hardware description;the method further comprising: compiling a second portion of the graphical program into machine code for execution by the processor.

33. The method of claim 32, further comprising:executing the machine code to perform functionality indicated by the second portion of the graphical program; the programmable hardware element performing functionality indicated by the first portion of the graphical program; wherein said executing the machine code and the programmable hardware element performing functionality operate to perform functionality indicated by the graphical program.

34. The method of claim 1, wherein the instrument includes a non-volatile memory coupled to the programmable hardware element, the method further comprising:storing the hardware description into the non-volatile memory; wherein said configuring the programmable hardware element comprises transferring the hardware description from the non-volatile memory to the programmable hardware element to produce the programmable hardware element.

35. A computer-implemented method for configuring an instrument to perform a measurement function, wherein the instrument includes a programmable hardware element, the method comprising:creating a graphical program, wherein the graphical program implements the measurement function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program; generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; configuring the programmable hardware element in the instrument utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the graphical program; wherein the programmable hardware element in the instrument is operable to perform the measurement function on a received signal.

36. The method of claim 35,wherein the instrument is operable to acquire a signal from an external source after said configuring; wherein the programmable hardware element in the instrument is operable to perform the measurement function on the signal.

37. The method of claim 35,wherein the instrument comprises an image acquisition device coupled to a camera; wherein the camera is operable to acquire an image of an object, and wherein the programmable hardware element in the image acquisition device is operable to perform an image processing function on the image.

38. The method of claim 35,wherein the instrument comprises a smart camera; wherein the smart camera is operable to acquire an image of an object and store the image; and wherein the programmable hardware element in the smart camera is operable to perform an image processing function on the image.

39. The method of claim 35,wherein the instrument comprises a smart sensor; wherein the smart sensor is operable to acquire a signal from an external source; and wherein the programmable hardware element in the smart sensor is operable to perform the measurement function on the signal.

40. The method of claim 35, wherein the smart sensor is one of a temperature sensor, pressure sensor, camera, microphone, flow sensor, position sensor, velocity sensor, acceleration sensor, vibration sensor, electromagnetic sensor, optical sensor, radiation sensor, or environment sensor.

41. The method of claim 35,wherein the instrument comprises a fieldbus device; wherein the fieldbus device is operable to acquire the signal from the external source; and wherein the programmable hardware element in the fieldbus device is operable to perform the measurement function on the signal.

42. The method of claim 35,wherein the instrument comprises a programmable logic controller (PLC); wherein the PLC is operable to acquire the signal from the external source; and wherein the programmable hardware element in the PLC is operable to perform the measurement function on the signal.

43. The method of claim 35,wherein the instrument comprises a computer-based instrument, wherein the computer-based instrument is configured as a card inserted into a slot of a computer system; wherein the computer-based instrument is operable to acquire the signal from an external source; and wherein the programmable hardware element in the computer-based instrument is operable to perform the measurement function on the signal.

44. The method of claim 35,wherein the instrument comprises a reconfigurable measurement device, wherein the reconfigurable measurement device is configured as a card inserted into a slot of a computer system; wherein the reconfigurable measurement device is operable to acquire the signal from the external source; and wherein the programmable hardware element in the reconfigurable measurement device is operable to perform the measurement function on the signal.

45. A measurement system, comprising:a computer system comprising a processor, memory and a display; wherein the memory stores a graphical program, wherein the graphical program implements a measurement function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program; wherein the memory also stores a software program which is executable to generate a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and an instrument coupled to the computer system, wherein the instrument includes: an input for acquiring a signal from an external source; and a programmable hardware element coupled to the input, wherein the programmable hardware element in the instrument is configurable utilizing the hardware description, wherein after being configured the programmable hardware element implements a hardware implementation of the graphical program, wherein the programmable hardware element in the instrument is executable to perform the measurement function on an acquired signal.

46. The measurement system of claim 45,wherein the instrument is operable to acquire a signal from an external source after being configured; wherein the programmable hardware element in the instrument is operable to perform the measurement function on the signal.

47. The measurement system of claim 45,wherein the instrument comprises an image acquisition device coupled to a camera; wherein the camera is operable to acquire an image of an object, and wherein the programmable hardware element in the image acquisition device is operable to perform an image processing function on the image.

48. The measurement system of claim 45,wherein the instrument comprises a smart camera; wherein the smart camera is operable to acquire an image of an object and store the image; and wherein the programmable hardware element in the smart camera is operable to perform an image processing function on the image.

49. The measurement system of claim 45,wherein the instrument comprises a smart sensor; wherein the smart sensor is operable to acquire a signal from an external source; and wherein the programmable hardware element in the smart sensor is operable to perform the measurement function on the signal.

50. The measurement system of claim 45, wherein the smart sensor is one of a temperature sensor, pressure sensor, camera, microphone, flow sensor, position sensor, velocity sensor, acceleration sensor, vibration sensor, electromagnetic sensor, optical sensor, radiation sensor, or environment sensor.

51. The measurement system of claim 45,wherein the instrument comprises a fieldbus device; wherein the fieldbus device is operable to acquire the signal from the external source; and wherein the programmable hardware element in the fieldbus device is operable to perform the measurement function on the signal.

52. The measurement system of claim 45,wherein the instrument comprises a programmable logic controller (PLC); wherein the PLC is operable to acquire the signal from the external source; and wherein the programmable hardware element in the PLC is operable to perform the measurement function on the signal.

53. The measurement system of claim 45,wherein the instrument comprises a computer-based instrument, wherein the computer-based instrument is configured as a card inserted into a slot of a computer system; wherein the computer-based instrument is operable to acquire the signal from an external source; and wherein the programmable hardware element in the computer-based instrument is operable to perform the measurement function on the signal.

54. The measurement system of claim 45,wherein the instrument comprises a reconfigurable measurement device, wherein the reconfigurable measurement device is configured as a card inserted into a slot of a computer system; wherein the reconfigurable measurement device is operable to acquire the signal from the external source; and wherein the programmable hardware element in the reconfigurable measurement device is operable to perform the measurement function on the signal.

55. The measurement system of claim 45,wherein the graphical program includes a user interface portion; wherein the user interface portion is operable to be presented on a display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

56. The measurement system of claim 55,wherein the user interface portion operates as a front panel for the instrument;

57. The measurement system of claim 55,wherein the user interface portion is operable to receive user input to control the instrument while the programmable hardware element in the instrument executes to perform the measurement function on the signal.

58. The measurement system of claim 55,wherein the user interface portion includes one or more user interface objects; wherein, in generating a hardware description based on the graphical program, the software program is executable to incorporate a register in the hardware description for at least one of the user interface objects; wherein the programmable hardware element in the instrument is operable to access a register on the programmable hardware element to affect one of said user interface objects.

59. The measurement system of claim 55,wherein the user interface portion is operable to be compiled into executable code and stored in the memory for execution by the processor; wherein the processor is operable to execute the executable code from the memory to present the user interface portion on the display.

60. The measurement system of claim 55, wherein the instrument includes a second processor and a second memory;wherein the user interface portion is operable to be compiled into executable code and stored in the second memory in the instrument for execution by the second processor in the instrument; wherein the second processor in the instrument executes the executable code from the memory to present the user interface portion on the display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

61. The measurement system of claim 45, wherein the instrument further comprises:analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog signal to produce a digital signal.

62. The measurement system of claim 45, wherein the instrument further includes timer/counter logic;wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the instrument executes to perform the measurement function on the signal.

63. The measurement system of claim 45, wherein the programmable hardware element in the instrument executes to perform a process control function using the signal.

64. The measurement system of claim 45, wherein the software program stored in the memory of the computer system is further operable to convert the hardware description into a net list;wherein the computer system is operable to configure the programmable hardware element utilizing the net list.

65. The measurement system of claim 64, wherein the software program stored in the memory of the computer system is further operable to compile the net list format into a hardware program file; andwherein the computer system is operable to download the hardware program file to the programmable hardware element to configure the programmable hardware element.

66. The measurement system of claim 45, wherein the programmable hardware element comprises a field programmable gate array (FPGA).

67. The measurement system of claim 45, wherein the computer system includes a bus and also includes one or more expansion slots coupled to the bus adapted for receiving expansion cards;wherein the instrument comprises an expansion card inserted into an expansion slot of the bus.

68. The measurement system of claim 45, wherein the instrument is an external instrument coupled to the computer system.

69. The measurement system of claim 45, wherein the memory of the computer system stores a graphical programming system for creation of the graphical program;wherein the graphical programming system is executable to arrange on the screen a plurality of nodes comprising the graphical program and interconnect the plurality of nodes in response to user input; wherein the graphical programming system is further executable to create and store data structures which represent the graphical program in response to said arranging and said interconnecting; wherein the software program is executable to traverse the data structures and convert the data structures into a hardware description format in response to said traversing.

70. The measurement system of claim 45, wherein a first portion of the graphical program is converted into a hardware description;wherein the computer system is operable to compile a second portion of the graphical program into machine code for execution by the CPU.

71. The measurement system of claim 70,wherein the programmable hardware element is operable to perform functionality indicated by the first portion of the graphical program; wherein the computer system is operable to execute the machine code to perform functionality indicated by the second portion of the graphical program; wherein said executing the machine code and the programmable hardware element performing functionality operate to perform functionality indicated by the graphical program.

72. The measurement system of claim 45, wherein the instrument includes a non-volatile memory coupled to the programmable hardware element;wherein the non-volatile memory is operable to store the hardware description; wherein the non-volatile memory is operable to transfer the hardware description to the programmable hardware element to produce the programmable hardware element.

73. The measurement system of claim 45, wherein the instrument performs data acquisition/generation functions.

74. The measurement system of claim 45, wherein the instrument is a GPIB instrument.

75. The measurement system of claim 45, wherein the instrument is a VXI instrument.

76. The measurement system of claim 45, wherein the instrument is a serial instrument.

77. A measurement system, comprising:a computer system comprising a processor, memory and a display; wherein the memory stores a graphical program, wherein the graphical program implements a measurement function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program, wherein the graphical program also comprises a user interface portion; wherein the memory also stores a software program which is executable to generate a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and an instrument coupled to the computer system, wherein the instrument includes: an input for acquiring a signal from an external source; and a programmable hardware element coupled to the input, wherein the programmable hardware element in the instrument is configurable utilizing the hardware description, wherein after being configured the programmable hardware element implements a hardware implementation of the graphical program, wherein the programmable hardware element in the instrument is executable to perform the measurement function on an acquired signal; wherein the user interface portion of the graphical program is operable to be presented on a display during the programmable hardware element in the instrument executing to perform the measurement function on the signal.

78. The measurement system of claim 77,wherein the user interface portion is operable to receive user input to control the instrument while the programmable hardware element in the instrument executes to perform the measurement function on the signal.

79. The measurement system of claim 77,wherein the user interface portion is operable to be compiled into executable code and stored in the memory of the computer system for execution by the processor of the computer system; wherein the processor is operable to execute the executable code from the memory to present the user interface portion on the display.

80. The measurement system of claim 77,wherein the instrument includes a second processor and a second memory comprised in the instrument; wherein the user interface portion of the graphical program is operable to be compiled into executable code and stored in the second memory of the instrument; wherein the second processor in the instrument is operable to execute the executable code to present the user interface on the display while the programmable hardware element in the instrument executes to perform the measurement function on the signal.

81. The measurement system of claim 77,wherein the instrument comprises an image acquisition device coupled to a camera; wherein the camera is operable to acquire an image of an object, and wherein the programmable hardware element in the image acquisition device is operable to perform an image processing function on the image.

82. The measurement system of claim 77,wherein the instrument comprises a smart camera; wherein the smart camera is operable to acquire an image of an object and store the image; and wherein the programmable hardware element in the smart camera is operable to perform an image processing function on the image.

83. The measurement system of claim 77,wherein the instrument comprises a smart sensor; wherein the smart sensor is operable to acquire a signal from an external source; and wherein the programmable hardware element in the smart sensor is operable to perform the measurement function on the signal.

84. A measurement system, comprising:a computer system comprising a processor, memory and a display; wherein the memory stores a graphical program, wherein the graphical program implements a measurement function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program, wherein the graphical program also comprises a user interface portion; wherein the memory also stores a software program which is executable to generate a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and an instrument coupled to the computer system, wherein the instrument includes: an input for acquiring a signal from an external source; a processor; a memory coupled to the processor and the input; and a programmable hardware element coupled to the input, wherein the programmable hardware element in the instrument is configurable utilizing the hardware description, wherein after being configured the programmable hardware element implements a hardware implementation of the graphical program, wherein the programmable hardware element in the instrument is executable to perform the measurement function on an acquired signal; wherein the user interface portion of the graphical program is operable to be compiled into executable code and stored in the memory of the instrument; wherein the processor in the instrument is operable to execute the executable code to present the user interface on the display while the programmable hardware element in the instrument executes to pergorm the measurement function on the signal.

85. The measurement system of claim 84,wherein the instrument comprises an image acquisition device coupled to a camera; wherein the camera is operable to acquire an image of an object, and wherein the programmable hardware element in the image acquisition device is operabl to perform an image processing function on the image.

86. The measurement system of claim 84,wherein the instrument comprises a smart camera; wherein the smart camera is operable to acquire an image of an object and store the image; and wherein the programmable hardware element in the smart camera is operable to perform an image processing function on the image.

87. The measurement system of claim 84,wherein the instrument comprises a smart sensor; wherein the smart sensor is operanle to acquire a signal from an external source; and wherein the programmable hardware element in the smart sensor is operable to perform the measurement function on the signal.