Patent Application
20050015673
The present invention relates to type systems, and particularly, to a type system for type-checking heterogeneous program components.
A type system is a system used in programming languages to aid in the detection and prevention of run-time errors. A programming language is “typed” if it contains a set of types that are declared for objects such as variables, functions, etc., and these types are checked versus a set of rules during compilation of a program written in the language. If the source code written in the typed language violates one of the type rules, a compiler error is determined.
Typed intermediate languages for use in compilers have received significant study in the research community over the past few years. They enhance the reliability and robustness of compilers, as well as provide a systematic way to track and check information needed by garbage collectors. The idea is to have an intermediate representation that has types attached to it and that can be type-checked in a manner analogous to type-checking for source programs. However, a typed intermediate language is more difficult to implement because types that represent items made explicit during the compilation process are necessary.
A typed intermediate language is even more difficult to implement if it must represent a number of different high-level programming languages. The different languages not only have different primitive operations and types, but the high-level programming languages have different levels of typing. For instance, some languages, such as assembly languages, are generally untyped. In other words, they have no type system. Of the languages that are typed, some are strongly typed while others are more loosely typed. For instance, C++ is generally considered a loosely typed language, whereas ML or Pascal are considered strongly typed languages. Further, some languages that are loosely typed have smaller sub-sets of the language that allow for a majority of the code sections within a program to be strongly typed, while other code sections are loosely typed. For example, C# and Microsoft Intermediate Language used in .NET (MSIL) allow this. Therefore, a typed intermediate language used to represent any of these high-level languages must be able to represent different types strengths. Likewise, the type system of such a typed intermediate language must be able to implement different rules depending on characteristics of the code being type checked.
Another problem arises when a typed intermediate language is lowered throughout the process of compilation. The lowering of a language refers to the process of changing the form of a language from a higher level form, such as what a programmer would write, to a lower level, such as to an intermediate language. The language can then be further lowered from the intermediate language to levels closer to what a computer executes, such as machine-dependent native code. In order to type-check an intermediate language that is lowered to different levels during the compilation process, a different set of rules must be used for each representation.
Attempts to create typed intermediate languages often fall short of solving the problems discussed above. For instance, Cedilla Systems' Special J compiler uses a typed intermediate language. However, this compiler is specific to the Java source language and therefore did not need to process multiple languages that may, for instance, have non-type-safe code. Additionally, this compiler only uses one set of rules for type-checking and therefore could not be used for multiple levels of compilation. In the research community, typed intermediate languages often tend to be highly specific to the source language and difficult to engineer (and design the types) for the multiple stages of compilation.
A representation of types, type-checker, method and compiler are provided for checking consistency in various forms of an intermediate language. Specifically, the typed intermediate language is suitable for use in representing programs written in multiple (heterogeneous) source languages including typed and untyped languages, loosely and strongly typed languages, and languages with and without garbage collection. Additionally, the type-checker architecture is extensible to handle new languages with different types and primitive operations. The representation of types, type-checker, method and compiler include various aspects. The various aspects may be used separately and independently, or the various aspects may be used in various combinations and sub-combinations.
In one aspect, a type representation is provided that represents types in an intermediate language. A type representation, herein referred to as an unknown representation, indicates that an element of the intermediate language is associated with a type representation that is not known. Additionally, other types are provided to represent categories of types found in numerous programming languages.
In another aspect, a method of type-checking a code segment written in a programming language is provided using a rule set that contains rules for type-checking an unknown type. The unknown type allows for selectively retaining type information as the compilation process continues and allows multiple programming languages to be type-checked by the same type system.
In another aspect, a compiler system for type-checking an intermediate representation of source code in a compiler is provided which includes an unknown type, one or more rule sets with rules for using the unknown and other types, and a type-checker for applying the one or more rule sets to the elements of an intermediate representation.
These and other aspects will become apparent from the following detailed description, which makes references to the accompanying drawings.
A representation of types, type-checker, and compiler are provided for checking consistency in various forms of an intermediate language. The type-checker and compiler allow use of different types and type-checking rules, depending on the source language for a program component and/or the stage of compilation. For example, it may be desirable to have a high-level optimizer apply to programs written in a variety of languages. These languages may have different primitive types and primitive operations. One language may contain types and operations for complex arithmetic, for example, whereas another language may contain types and operations specific to computer graphics. By allowing the intermediate representation to be parameterized by different type systems, the optimizer can be used for languages with different primitive types and operations. Another example can include a program where certain components are written in a strongly-typed subset of a language and other components are written in the full language, which is not type-safe. It is desirable to have more error checking for the first set of components. This can be accomplished by using different type-checking rules for the different components. Yet another example is dropping type information during compilation. The type-checker and compiler can allow type information to be dropped at later stages, while forcing precise information to be maintained during earlier stages. This can be accomplished by using an unknown type in combination with different type-checking rules for different stages of compilation.
Thus, the compilation process consists of transforming the intermediate language instructions from one level of representation to another. For instance,
Statements 202-206 are an HIR representation of statement 200 that represents the same functionality, but does so in a format closer to that as would be understood by a computer and yet still architecture independent. Statement 202 uses an ‘ADD’ command to add a first and second variable and assigns the result to a first temporary variable t1. Statement 204 then uses another ‘ADD’ command to add t1 to the third variable and assigns the result to a second temporary variable t2. Statement 206 then assigns the value of t2 to the result variable z using an ‘ASSIGN’ instruction.
Statements 208-212 are a LIR of the intermediate language of the statements 202-206. Statement 208 uses an add instruction specific to the x86 architecture to add the values of two variables stored at specified registers and stores the result in a register assigned to a temporary variable t1. Statement 210 uses the add instruction specific to the x86 architecture to add the values of t1 and a third variable stored at the specified registers and stores the result in the specified register (EAX) assigned to t2. Statement 212 then uses a move instruction specific to the x86 architecture to move the value stored in EAX to the output variable z.
In order to implement type-checking, the typed intermediate language contains type representations expressed either explicitly or implicitly. An explicit type expression is declared directly in the representation. For example, the statement:
One embodiment of type representations for a typed intermediate language suitable for use with multiple programming languages at multiple levels of representation is shown in Appendix A. It should be noted that this is only an example of numerous possible embodiments.
Referring to Appendix A, a number of type representations are defined in a type class hierarchy such that type systems of various languages can be represented by the typed intermediate language. An abstract base class is defined as ‘Phx::Type’ for all types. The base class can contain, for instance, size information in ‘sizekind’ for the various types, such as actual, symbolic or unknown (or variable) types. The base class can also contain ‘typekind’ in order to designate type classification. Additionally, an external type can be provided as an abstract type that wraps an externally defined type in order to provide back mapping from the typed intermediate language to the original source code.
Below the base class, a class defined as ‘Phx::PtrType’ can represent pointer types. Various kinds of pointers can be defined as well. For instance, a managed, garbage collected pointer (points to a location within a garbage collected object), a managed, non-garbage collected pointer (points to a location within a non-garbage collected object), an unmanaged pointer (such as would be found in code written in C++, for instance), a reference pointer (points to the base of a garbage collected object), and null.
At the same level in the hierarchy, a class defined as ‘Phx::ContainerType’ can represent container types, such as types that contain internal members. The internal members can have fields, methods and other types. A class defined as ‘Phx::FuncType’ can represent function types, including any necessary calling conventions, lists of arguments and lists of return types. Also, a class defined as ‘Phx::UnmgdArrayType’ can represent unmanaged array types. Under ‘Phx::ContainerType’ in the hierarchy, four more classes can be defined. A class defined as ‘Phx::ClassType’ can represent class types, a class defined as ‘Phx::StructType’ can represent struct types, a class defined as ‘Phx::InterfaceType’ can represent interface types, and a class defined as ‘Phx::EnumType’ can represent enumerated types. Under ‘Phx::ClassType’ in the hierarchy, an additional class defined as ‘Phx::MgdArrayType’ can represent managed array types.
In the representations shown in Appendix A, a class ‘primtype’ is defined as a special instance of a struct type. ‘primtype’ can include various types such as int, float, unknown, void, condition code, unsigned int, xint, etc. These representations can be used in both a HIR or LIR of the typed intermediate language.
Additionally, target specific primitive types can be included in the type representation. Some languages have complex arithmetic types that can be handled efficiently if the type system is made aware of them. Take for instance an ‘MMX’ instruction. Such an instruction is one of a set of extra instructions built into some versions of x86 processors for supporting single instruction/multiple data operations on multimedia and communications data types. The type system can be customized to recognize and use these instructions with minimal alteration of the type representations.
The embodiment of the type representation of types shown in Appendix A also includes an “unknown” type, which can represent any type and optionally has a size associated with it. The size is the size of the machine representation of the value. An unknown type allows a compiler to drop type information in a controlled manner by changing the type information from a specific type to an unknown type. It allows the compiler to generate code that depends on the size of the value being manipulated, even when the type is unknown. Other types may use unknown types, so the unknown type also allows the representation of partial type information (where some but not all information is known).
For instance, assume a pointer to an int type. At some stage of lowering, it may be desirable to drop the type information, int. The unknown type allows the compiler to replace the int type with the unknown type. The type-checker then need not check that the pointer of interest is pointing to a correct type. It essentially takes the chance the value pointed to will be handed in such a manner as to not adversely affect the program functionality at runtime.
Another example of using an unknown type is for defining a type for a function. If a function with an argument of type pointer to unknown is called, where the argument previously had the type pointer to int, the compiler must trust that right type is being passed. The result of dereferencing the pointer may or may not be known to be an int; however, it will be used as an int. A more complex example is the introduction of an intermediate temporary variable during the conversion from high-level to low-level intermediate representation of a virtual function call. Virtual tables (vtables) are widely used to implement virtual calls in object-oriented languages. The first step in making a virtual function call in the low-level intermediate representation is to fetch the first field of an object of memory. The first field contains a pointer to a vtable. The result of fetch is then assigned to a temporary variable. Constructing the type of the temporary variable (a type that represents a pointer to a vtable, where the vtable may have many fields), may be complex and burdensome to represent. Instead, the compiler may simply assign the intermediate temporary variable “pointer to unknown.” Thus, the use of the unknown type simplifies latter stages of compilation where keeping detailed type information is unnecessary or may represent a significant burden to the compiler implementer.
The HIR, as explained with respect to
The intermediate language at each level of representation may be type-checked by type-checker 308. The type-checker 308 implements an algorithm or procedure for applying one or more rule sets 310 to each stage of the compilation process, and therefore to each representation of the intermediate language. The rule sets 310 are a set of rules designed for varying properties of languages, such as the source language, stage of compilation, what strength of typing, etc.
For example, assume source code 300 contains code authored in the C++ programming language. The C++ source code 300 is first translated into an HIR 302 of the typed intermediate language. If desired, at this point the type-checker 308 can interact with the HIR 302 in order to determine any number of properties. Such properties might include the stage of compilation (HIR), the type of source code present (C++), whether or not the language is typed (yes), whether it is loosely or strongly typed (loosely), etc. Based on the properties, the type-checker can select an appropriate set of rules. Once a rule set is selected, the type-checker type-checks the HIR according to that set of rules. Once the HIR is lowered to MIR or LIR, the properties will be accessed again and the same or a different set of rules may be appropriate.
In one embodiment, three sets of type-checking rules can be supplied to the type-checker. One set can correspond to “strong” type-checking, such as would be desirable to type-check C# or MSIL. Another set can correspond to “weak” type-checking, which would be a looser type-checking than the “strong” type-checking. For instance, the weak type-checking rule set could permit type casts. A type cast is when a variable of one type is made to act like another for a single use. For instance, a variable of type int can be made to act like a char (character). The following code uses a type cast to print the letter ‘P’.
Lastly, a set can correspond to “representation” checking. The “representation” checking can allow dropped type information in parts of the intermediate program representation, such as by using an unknown type, and can include rules that dictate when such type information can be dropped or when an unknown type can be substituted for another type. For instance, the result of a function that returns a value of type Void may be prohibited from being assigned to a variable of unknown type.
Additionally, more than one set of rules can be used at a single stage of compilation. For instance, assume the source code 300 contains a single language, but contains sections that are strongly typed and some sections that are loosely typed. The type-checker can use one set of rules for the HIR at certain strongly typed sections, and another set of rules for code sections that are loosely typed.
The type-checker 400 selects an appropriate rule set based on properties of the program module being type-checked and applies the selected rule set to the program module using an incorporated procedure or algorithm. For instance, type-checker 400 may select rule set 402 (representing a rule set for an HIR for languages with strong typing) in order to type-check program module 410 (representing a language with strong typing in a HIR). Subsequently, the type-checker 400 may then select rule set 408 (representing a rule set for an LIR) in order to type-check program module 412 (representing a language with strong typing in a LIR).
If it is a HIR or MIR, decision 504 is processed to determine if the original source code was loosely or strongly typed. If it was loosely typed, block 506 is processed to select a rule set corresponding to weak type-checking. If it was strongly typed, block 508 is processed to select a rule set corresponding to strong type-checking.
If it is an LIR, decision block 510 is processed to select a rule set corresponding to representation type-checking. It should be noted that
The rule sets of the type-checking system described are easily extended to entirely new languages, and also to new features of existing languages. For instance, should a new language be introduced, a new rule set is simply authored for the new language. Since the rule sets are separate from the type-checker or compiler system itself and are designed to accept the rule sets as separate entities, new rule sets for new languages can be distributed without having to re-distribute or update existing type-checking systems or compilers. Likewise, if a new feature is added to an existing language, such as adding XML support to C++ for instance, the rule set corresponding to C++ at the various stages of compilation can be easily reconfigured dynamically to handle the new feature. Again, no new core system need be updated or distributed.
The rule sets can also allow for constraints on types. For instance, whether sub-typing is allowed for a particular type when a class inherits from another may be a constraint described in the rules. Another constraint may be a boxed constraint, such as might be desired to indicate data can be converted into a virtual table containing the data. Others may include a size constraint, or a primitive type constraint indicating the necessity for identical types of primitives. Like any other part of the rule set, new constraints can be added as desired.
The set of rules used by the type-checker can be constructed through a programming interface to an application for authoring the rule sets. The application can construct the rules such that the rule set is represented in a hierarchy of type primitives with rules assigned to individual instructions of the typed intermediate language. The hierarchy can be provided in the form of a type graph that will explicitly express various elements of types relevant to a particular program module or compilation unit. The IR elements such as symbols and operations will be associated with elements of the type systems. The type graph nodes will describe the primitive and constructed types and their relationships such as components, nested types, function signatures, interface types, elements of hierarchy and other information such as source names and references to module/assembly external type elements.
An example of a simple type rule is as follows:
Assume for purpose of this example that I is a signed integer type, U is an unsigned integer type, X is either type of integer, F is float, and N is any of the above.
Representing the type primitives as hierarchies allows the rule sets to be altered easily. In the past, type rules have often been expressed programmatically using source code. For example, a type-checker may contain a large number of switch statements that implement the type-checker rules. Thus, changing a rule required modifying the source code for the type-checker. However, the hierarchical rule sets provide for much easier extensibility. Consider the previous rule for the ADD instruction. If a developer wanted to add a type, for instance C for a complex type, it can simply be added under the N type in the hierarchy as shown in
One method for checking an instruction in a type checking system against a type rule is shown in
A number of program modules may be stored in the drives and RAM 925, including an operating system 935, one or more application programs 936, other program modules 937, and program data 938. A user may enter commands and information into the personal computer 920 through a keyboard 940 and pointing device, such as a mouse 942. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 921 through a serial port interface 949 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port or a universal serial bus (USB). A monitor 947 or other type of display device is also connected to the system bus 923 via an interface, such as a display controller or video adapter 948. In addition to the monitor, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.
The personal computer 920 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 949. The remote computer 949 may be a server, a router, a peer device or other common network node, and typically includes many or all of the elements described relative to the personal computer 920, although only a memory storage device 950 has been illustrated in
When used in a LAN networking environment, the personal computer 920 is connected to the local network 951 through a network interface or adapter 953. When used in a WAN networking environment, the personal computer 920 typically includes a modem 954 or other means for establishing communications over the wide area network 952, such as the Internet. The modem 954, which may be internal or external, is connected to the system bus 923 via the serial port interface 946. In a networked environment, program modules depicted relative to the personal computer 920, or portions thereof, may be stored in the remote memory storage device. The network connections shown are merely examples and other means of establishing a communications link between the computers may be used.
Having illustrated and described the principles of the illustrated embodiments, it will be apparent to those skilled in the art that the embodiments can be modified in arrangement and detail without departing from such principles.
For instance, one embodiment herein describes one or more rule sets that can be supplied to a type-checker or compiler such that the compiler or type-checker chooses one or more of the rule sets to type-check a language based on the language and/or phase of compilation being type-checked. However, in the alternative, a single set of rules can be supplied to a type-checker or compiler such that the compiler or type-checker constructs one or more subsets of rules from the single set of rules, either statically or dynamically at runtime, based on the language and/or phase of compilation being type-checked.
In view of the many possible embodiments, it will be recognized that the illustrated embodiments include only examples and should not be taken as a limitation on the scope of the invention. Rather, the invention is defined by the following claims. We therefore claim as the invention all such embodiments that come within the scope of these claims.
