Information
-
Patent Application
-
20030200214
-
Publication Number
20030200214
-
Date Filed
April 14, 200321 years ago
-
Date Published
October 23, 200320 years ago
-
CPC
-
US Classifications
-
International Classifications
Abstract
Conflict checking for writing operations in an SQL database system is carried out for nested statements invoked by a parent statement. Each statement has an associated table access data structure defined at compile-time indicating the tables in the database that the statement accesses and the mode of access. At execution-time the table access data structure for each nested statement is accessed and the information is compared with a list of tables maintained for the parent statement to determine if there is a read/write or write/write conflict possible if the nested statement is executed. Where there is no conflict detected, the information from the table access data structure is copied to the list of tables.
Description
FIELD OF THE INVENTION
[0001] The present invention is directed to an improvement computing systems and in particular to an improvement in error detection and prevention in the execution of query statements in a database system.
BACKGROUND OF THE INVENTION
[0002] Relational Database Management Systems (RDBMSs) typically support the ability to have one or more query statements such as SQL (Structured Query Language) statements called from within the scope of execution of a parent query statement. With the support of such capabilities as the inclusion of SQL statements within User-Defined Functions (UDFs) and the calling of stored procedures (STPs) from within triggers, it is now possible for the execution of a parent query statement to result in the execution of one or more nested SQL statements.
[0003] A problem in database systems executing nested query statements is the detection and prevention of read/write and write/write conflicts (writing conflicts) that may occur between nested statements, and between nested statements and the parent statement itself. Such detection and prevention is necessary to ensure that the overall execution results of the parent and nested statements are consistent and deterministic.
[0004] A read/write conflict may occur when a SELECT statement and a DELETE statement are defined so that on execution they both act on the same table. An example of a write/write conflict is when on execution an INSERT statement and a DELETE statement act on the same table. When these conflicting actions occur within the processing of nested statements invoked by a single parent statement, it is advantageous to be able to detect and prevent these collisions. Without such detection, non-deterministic processing may result with potential resulting data sets with missing rows, incorrect results, or even infinite loops in processing.
[0005] In a database system that is implemented in a partitioned shared-nothing environment, the above problems are potentially compounded. In such a system, the nested query statements can be executing at any partition within the system and the conflicts between the nested statements can be different at each partition. In addition, the conflicting statements can be occurring at different nesting levels, relative to the original parent statement, when they collide at a partition.
[0006] One approach to avoiding such read/write and write/write (writing) conflicts is to first require routines that modify query data to be defined as such within the system. The definition of each routine includes information on what tables will be read and written by the routine. The query compiler can then set up the query access plan such that conflicts will not occur. A significant problem with this approach is that it may result in performance penalties for statements that do not, in fact, cause conflicts.
[0007] Another approach is to implement a runtime detection and prevention algorithm. During the time that a table is being modified, the database system ensures that the table cannot be accessed by a nested statement (in a trigger or UDF) or a runtime error will result. Because the nested statements are precluded from accessing the table during the time that it is modified, results of this approach are potentially affected by the access plan selected by the database system. Such an approach is also difficult to implement in a database system implemented in a partitioned, shared-nothing environment. In addition, the detection and prevention occurs only for the time during which a table is being accessed. However, protecting a table only while it is in use can make the behaviour of statements acting on that table non-deterministic. This form of conflict avoidance can be very inconvenient for the user as the user has no direct control over how the compiler chooses to process query statements and therefore the user cannot make the conflict checking predictable.
[0008] It is therefore desirable to provide detection and prevention of read/write and write/write conflicts in an query database system that permits access to data that will not cause a conflict and that is not subject to the access plans chosen by the database system.
SUMMARY OF THE INVENTION
[0009] According to an aspect of the present invention there is provided an improved method and system for the detection and prevention of read/write and write/write conflicts in a relational database system.
[0010] According to another aspect of the invention there is provided a method and system for defining a table access data structure for database control statements at compile time. At execution, conflict checking is carried out by comparing the information in the table access data structures for nested database control statements with information included in a list of tables maintained for each parent statement. Conflicts are determined based on the tables accessed, the mode of access, and the table access scope for the statements that are subject to the conflict check.
[0011] According to another aspect of the invention there is provided a computer program product for detection of writing conflicts for database control statements in a relational database system, the database control statements including a parent statement and a set of invoked nested statements, the program product including a computer usable medium tangibly embodying computer readable program code means including: code means for maintaining a set of statement table access information in association with each database control statement, code means for generating, at execution time, a set of cumulative table access information associated with the parent statement including information from the statement table access information for the parent statement, code means for, prior to execution of each statement in the set of nested statements, comparing the set of statement table access information for the nested statement with the set of cumulative table access information to determine whether a writing conflict will occur on execution of the nested statement, and code means for, if no writing conflict is determined for a specified nested statement, updating the set of cumulative table access information to include the set of statement table access information for the specified nested statement. According to another aspect of the invention there is provided the above computer program product in which the database control statements are SQL statements.
[0012] According to another aspect of the invention there is provided the above computer program product in which the relational database system is a compiled relational database system and in which the code means for maintaining a set of statement table access information further includes code means for generating the set of statement table access information at compile time.
[0013] According to another aspect of the invention there is provided the above computer program product in which the set of statement table access information for each database control statement includes the identity of tables to be accessed by the execution of the statement and the access mode of the table access.
[0014] According to another aspect of the invention there is provided the above computer program product in which each element of the set of cumulative table access information associated with the parent statement, includes information specifying a table, a table access scope and an access mode, each table access scope containing one or more database control statements, the set of cumulative table access information being initialized to include: the table and access mode information from the statement table access information for the parent statement, and information specifying the table access scope containing the parent statement.
[0015] According to another aspect of the invention there is provided a computer program product for detection of writing conflicts in a relational database system, the writing conflict detection being for database control statements including a parent statement and a set of invoked nested statements, the relative definition of the parent statement and each of the nested statements creating a set of table access scopes, each of the table access scopes containing one or more of the parent statement and the nested statements, the program product including a computer usable medium tangibly embodying computer readable program code means including: code means for maintaining a set of statement table access information in association with each database control statement, the table access information for each of the statements recording the identity of tables to be accessed by the execution of the statement and recording the access mode of the table access, code means for generating, at execution time, a set of cumulative table access information associated with the parent statement, each element in the set of cumulative table access information recording information specifying a table, a table access scope and an access mode, the set of cumulative table access information being initialized with the table and access mode information from the statement table access information for the parent statement, and information specifying the table access scope containing the parent statement code means for, prior to execution of each statement in the set of nested statements, comparing the table and the access mode information for a sequence of selected elements in the set of statement table access information for the nested statement with the table and access mode information for each element in the set of cumulative table access information, until either a writing conflict is determined for the nested statement by the comparison of a one of the selected elements or each element in the set of statement table access information for the nested statement has been compared with each element in the set of cumulative table access information for the parent statement, and code means for, if no writing conflict is determined for a specified nested statement, adding to the set of cumulative table access information: the information contained in each element in the set of statement table access information for the specified nested statement and information specifying the table access scope containing the specified nested statement.
[0016] According to another aspect of the invention there is provided the above computer program product in which the code means for comparing, for each nested statement, a selected element in the set of statement table access information with each element in the set of cumulative table access information to determine a writing conflict includes: code means for looking up the table information for the selected element in the set of cumulative table access information, and when there is a match with a located element in the set, in the case when the table access scope containing the nested statement matches the table access scope of the located element, determining there to be no conflict for the selected element, in the case when the table access scope containing the nested statement does not match the table access scope of the located element, and in the case when the access mode of the selected element and the access mode of the located element both correspond to the “read” value, determining there to be no conflict for the selected element and otherwise determining there to be a conflict for the selected element.
[0017] According to another aspect of the invention there is provided the above computer program product in which the identity of tables to be accessed by the execution of the statement is defined with reference to the each permanent table and each declared global temporary table accessed by the statement on its execution.
[0018] According to another aspect of the invention there is provided the above computer program product further including code means for deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
[0019] According to another aspect of the invention there is provided a computer-implemented method for detection of writing conflicts in a relational database system for database control statements including a parent statement and a set of invoked nested statements, the method including: maintaining a set of statement table access information in association with each database control statement, generating, at execution time, a set of cumulative table access information associated with the parent statement including information from the statement table access information for the parent statement, comparing, prior to execution of each statement in the set of nested statements, the set of statement table access information for the nested statement with the set of cumulative table access information to determine whether a writing conflict will occur on execution of the nested statement, and updating, in the case when no writing conflict is determined for a specified nested statement, the set of cumulative table access information to include the set of statement table access information for the specified nested statement
[0020] According to another aspect of the invention there is provided a computer-implemented method for detection of writing conflicts in a relational database system, the writing conflict detection being for database control statements including a parent statement and a set of invoked nested statements, the relative definition of the parent statement and each of the nested statements creating a set of table access scopes, each of the table access scopes containing one or more of the parent statement and the nested statements, the method including: maintaining a set of statement table access information in association with each database control statement, the table access information for each of the statements recording the identity of tables to be accessed by the execution of the statement and recording the access mode of the table access, generating, at execution time, a set of cumulative table access information associated with the parent statement, each element in the set of cumulative table access information recording information specifying a table, a table access scope and an access mode, the set of cumulative table access information being initialized with the table and access mode information from the statement table access information for the parent statement, and information specifying the table access scope containing the parent statement comparing, prior to execution of each statement in the set of nested statements, the table and the access mode information for selected elements in the set of statement table access information for the nested statement with the table and access mode information for each element in the set of cumulative table access information, until either a writing conflict is determined for the nested statement or each element in the set of statement table access information for the nested statement has been compared with each element in the set of cumulative table access information for the parent statement, and updating, if no writing conflict is determined for a specified nested statement, the set of cumulative table access information with information including: the information contained in each element in the set of statement table access information for the specified nested statement and information specifying the table access scope containing the specified nested statement.
[0021] According to another aspect of the invention there is provided the above method in which the step of comparing, for each nested statement, a selected element in the set of statement table access information with each element in the set of cumulative table access information to determine a writing conflict includes looking up the table information for the selected element in the set of cumulative table access information, and when there is a match with a located element in the set, in the case when the table access scope containing the nested statement matches the table access scope of the located element, determining there to be no conflict for the selected element, in the case when the table access scope containing the nested statement does not match the table access scope of the located element, and in the case when the access mode of the selected element and the access mode of the located element both correspond to the “read” value, determining there to be no conflict for the selected element and otherwise determining there to be a conflict for the selected element.
[0022] According to another aspect of the invention there is provided the above method further including deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
[0023] According to another aspect of the invention there is provided a computer-implemented method for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes, the method including: generating, at compile time, for each statement, a table access data structure associated with the statement, the table access data structure including an entry for tables accessed by the statement, each entry including a table identifier and an access mode identifier, generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables including a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement, before executing each statement in the set of nested statements, comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is declared or until each entry in the table access data structure has been compared with the entries in the list of tables, and if no conflict is declared, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
[0024] According to another aspect of the invention there is provided the above method in which the step of comparing, for each nested statement, a table access data structure entry to the entries in the list of tables to determine a conflict includes looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of tables entry, in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry, in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry, and in the case when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry and otherwise declaring there to be a conflict for the table access data structure entry.
[0025] According to another aspect of the invention there is provided the above method in which the table access data structure for each statement includes an entry corresponding to, and including the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement.
[0026] According to another aspect of the invention there is provided the above method further including: defining the set of table access scopes by generating a data structure representing a table access scope with an associated unique counter value for each application start of an SQL statement, each UDF or method invoked and each stored procedure invoked directly from a trigger.
[0027] According to another aspect of the invention there is provided the above method further including: deleting the list of tables on the completion of execution of the parent statement.
[0028] According to another aspect of the invention there is provided the above method in which the database system supports data partitions and inter-partition concurrency in a shared-nothing architecture, the list of tables being defined relative to the partition in which the method is carried out, the method further including: sending an event to the partition to indicate that the completion of execution of the parent statement has occurred and in which the step of deleting the list of tables is carried out after receipt of the event at the partition.
[0029] According to another aspect of the invention there is provided the above method further including: setting a detect conflict flag in association with the parent statement in the case when the parent statement contains an invocation of a UDF or method or when the parent statement invokes a stored procedure directly from a trigger and in which either the parent statement modifies SQL data or a routine invoked by the parent statement modifies SQL data.
[0030] According to another aspect of the invention there is provided the above method further including: declaring that there is no conflict in the case when the detect conflict flag is not set for the parent statement.
[0031] According to another aspect of the invention there is provided the above method further including: preventing execution of each nested statement for which a conflict is declared.
[0032] According to another aspect of the invention there is provided the a computer program product including a computer usable medium tangibly embodying computer readable program code means for implementation in an SQL database system, the computer readable program code means including code means for carrying out the steps of the above methods.
[0033] Advantages of the present invention include the provision of consistent, repeatable read/write and write/write conflict detection based on the tables accessed by a statement, not on the methods used to access these tables. A further advantage is a uniform, efficient processing approach to writing conflict detection in both non-partitioned and multiple partition, shared-nothing database environments. Further, nested SQL statements for the same parent SQL statement are treated equally at each partition and conflicts between such statements are detected at a local, partition level rather than at a global application level.
[0034] According to another aspect of the present invention there is provided a method for detecting writing conflicts in a database system for a database control statement, said database control statement comprising a parent statement and a nested statement, said method comprising if, prior to execution of said nested statement, table access information for said nested statement and cumulative table access information for said parent statement indicates that a writing conflict does not exist, executing said nested statement.
BRIEF DESCRIPTION OF THE DRAWINGS
[0035]
FIG. 1 is a block diagram illustrating table access information maintained in accordance with the preferred embodiment.
[0036]
FIG. 2 is a flowchart illustrating conflict detection steps in accordance with the preferred embodiment.
[0037] In the drawings, the preferred embodiment of the invention is illustrated by way of example. It is to be expressly understood that the description and drawings are only for the purpose of illustration and as an aid to understanding, and are not intended as a definition of the limits of the invention.
DETAILED DESCRIPTION
[0038]
FIG. 1 is a block diagram illustrating table access information maintained in an example defined in accordance with the preferred embodiment. The preferred embodiment is described with reference to a database system for SQL. However, as persons of ordinary skill in the art will appreciate query languages such as XQL, (XML Query Language), Xquery, XML-QL, SQL, etc can be employed. However, the embodiments described herein use SQL. Additionally, other database types (e.g. flatfile databases etc.) could also be employed. In FIG. 1, parent statement 10 represents the executable representation of an SQL statement. The preferred embodiment is implemented for a database system having a component for compiling SQL statements into an executable form (an SQL compiler). The executable representations of the SQL statements are run by the database system during an execution phase.
[0039] According to the preferred embodiment, a list of tables data structure is associated with certain SQL statements at runtime. FIG. 1 shows list of tables 12 associated with parent statement 10. As is shown in the figure, parent statement 10 has an identifier that uniquely identifies parent statement 10 in the database system (shown as ID=N). List of tables 12 is identifiable as being associated with parent statement 10 by retaining a copy of the parent statement's identifier (The example of FIG. 1 also shows nested statement 14. Nested statement 14 is a compiled representation of an SQL routine that is invoked by parent statement 10 during runtime.
[0040] At compile time (when the executable objects parent statement 10, nested statement 14 are defined) an additional set of information is recorded for each SQL statement by the SQL compiler. Information about all the permanent and declared global temporary tables accessed by the statement is collected by the SQL compiler and retained in association with the SQL statement being compiled. It will be apparent that no information is gathered for system temporary tables since such tables are not available for use outside the locally defined executable environment for the statement. The SQL compiler records information indicating whether a table is read, modified, or both. FIG. 1 shows this information as permanently associated with the SQL statement as part of the executable representation itself. For parent statement 10, table access data structure 16 is shown. For nested statement, FIG. 1 shows table access data structure 18. Both data structures 16, 18 are shown with records having table identifier (TableID) and table access mode (AccessMode) fields. As is described in further detail below, it is this information that is used to scan the current contents of list of tables 12 to see if executing a statement will result in a conflict.
[0041] A general outline of how writing conflicts are detected and prevented by the system of the preferred embodiment, with reference to the example of FIG. 1, is set out as follows:
[0042] a) For parent statement 10, a list of tables 12 is maintained. List of tables 10 contains entries that will reflect tables accessed by parent statement 10 and statements nested within the parent statement (nested statement 14, in the example of FIG. 1). Each entry also indicates a table access scope for the table (defined below) and the access mode for the table (whether the table is being read from or written to).
[0043] b) Before executing nested SQL statement 14, the tables accessed by that statement (as indicated by table access data structure 18) are compared against list of tables 12 (the list of tables for parent statement 10) to determine if there is a conflict.
[0044] i) If there is a conflict, an error state is defined and the database system prevents nested statement 14 from executing.
[0045] ii) If there is no conflict, the tables found in table access data structure 18 are added to list of tables 12 and nested statement 14 is indicated as ready for execution.
[0046] iii) When parent statement 10 has finished executing, list of table 12 (and, if they exist, similar lists of tables for any nested statements) is discarded (deleted).
[0047] In the preferred embodiment, conflicts are dependent on table access scope. A table access scope is a logical entity that is given an implementation representation in the system of the preferred embodiment. Statements are executed within a particular table access scope logical entity. A new table access scope is defined when any one of the following events takes place:
[0048] a) An application starts an SQL statement;
[0049] b) A UDF or method is invoked; or
[0050] c) A stored procedure is invoked directly from a trigger
[0051] On return from a UDF, method or stored procedure, or on application SQL statement end, the table access scope of the return point statement will be entered.
[0052] Within a single table access scope, a table may be both read and written and, by definition, a conflict cannot occur. However, if a table is accessed from two table access scopes, then a conflict may occur. In the preferred embodiment, the table access scope logical entity is represented as follows: for each parent statement that is executing, there will be a unique counter which starts at zero for each parent statement and is incremented for each new table access scope beneath the parent (root) statement; this new value is recognized as the table access scope ID for that table access scope and is used by all statements executing within that table access scope as their table access scope identifier.
[0053] The following gives a summary of conflicting and non-conflicting operations as recognized by the preferred embodiment. Non-conflicting operations are defined as follows:
[0054] a) Attempting to read or modify a table that is not being read or modified;
[0055] b) Attempting to read or modify a table that is being read or modified, but by a statement within the same table access scope; and
[0056] c) Attempting to read a table that is only being read by one or more different table access scopes.
[0057] Conflicting operations are defined as follows:
[0058] a) Attempting to read or modify a table that is being modified by a different table access scope; and
[0059] b) Attempting to modify a table that is being read by one or more different table access scopes.
[0060] The preferred embodiment permits these conditions to be identified and handled appropriately. The preferred embodiment carries out the processing for detection up front and therefore detects potential conflicts. The conflicts are indicated to be potential conflicts because conditional processing and timing differences can result in a conflict being avoided where the system of the preferred embodiment declares a conflict. This approach is followed to make conflict detection independent from the access plan chosen for the SQL statement by the database system.
[0061] The conflict identification process for a statement in accordance with the preferred embodiment is described with reference to FIG. 2. FIG. 2 is a flowchart showing the steps in determining if a conflict exists or not for a given statement:
[0062] a) The table access data structure for the statement is accessed to determine the next statement table identifier (“StmtTableID”) and the statement access mode (“StmtAccess”), as is shown in box 30 of FIG. 2;
[0063] b) A lookup is done for StmtTableID in the TableID column of the appropriate list of tables (decision box 32);
[0064] c) If no match is found and if there are more table identifiers in the table access data structure, then loop to the first step (decision boxes 32, 33);
[0065] d) If no match is found and there are no more table identifiers in the table access data structure then return no conflict (decision box 33, box 40);
[0066] e) If a match is found (decision box 32) then:
[0067] i) If the current table access scope ID (“Scope” in FIG. 2) is the same as the table access scope of the matching entry (“ListScope” in decision box 34 of FIG. 2) then determine if there are more table identifiers in the table access data structure, if there are none, there is no conflict, if there are, then loop to the first step (decision box 33, box 40).
[0068] ii. If the table access scope IDs are different (decision box 34), but if the requested operation (“StmtAccess”) and the matching entry's operation (“ListAccessMode”) are both READ (decision box 36), then determine if there are more table identifiers in the table access data structure, if there are none, there is no conflict, if there are, then loop to the first step (decision box 33, box 40); otherwise, return conflict (box 38).
[0069] As may be seen from the above, if a conflict is found for any table in the table access data structure for the statement, then the statement is failed with an error (this prevents execution of the statement). If all the tables in the table access data structure have no conflict, then the statement is allowed to continue and processing moves on to recording the table operations, as set out below.
[0070] In the preferred embodiment, a number of steps are taken to update the list of tables with the tables in the table access data structure. For each entry in the table access data structure associated with the statement:
[0071] 1. If Table ID is not in the list of tables, the list of tables is given a new entry containing TableID for the entry in the table access data structure, the table access scope for the statement and the access mode for the table from the table access data structure.
[0072] 2. If Table ID is in the list of tables, with matching table access scope, the entry in the list is updated to include both the existing operation as well as the new operation.
[0073] 3. If Table ID is in the list of tables with a different table access scope, the entry in the list of tables is updated to have a valuing showing multiple scopes as the table access scope. In this case, the operation must be a READ operation.
[0074] Although the above description indicates how conflict detection is carried out by the preferred embodiment, for many SQL statements the preferred embodiment is able to determine that the conflict checking steps are not necessary without requiring comparisons between the table access data structures and the list of tables. For example, if the statement invokes no routines containing SQL, then there is no possibility of a conflict, so performing conflict detection as described above introduces a performance penalty with no benefits. Similarly, if the statement is read-only, conflict detection is unnecessary. For the list of tables to be generated by the preferred embodiment, both of the following conditions must be satisfied:
[0075] a) There must be more than one table access scope for the statement (in other words, an invocation of a UDF, method, or stored procedure in a trigger must exist in the statement); and
[0076] b) Either the statement must be a modifying SQL data statement or a routine invoked by the statement must be defined as MODIFIES SQL DATA.
[0077] When both the above conditions become true, it will be necessary to enable conflict detection for the statement. In the preferred embodiment, the SQL compiler performs an analysis of each statement during compilation to determine if the statement meets the above criteria. As the statement is compiled the compiler keeps track of both conditions, if they are both true, a flag is set for the statement and is associated with the executable representation of the statement. This flag is then checked at runtime to determine if the statement needs to be subject to the conflict checking procedure described, or not.
[0078] The preferred embodiment may be implemented in a database system implemented in a parallel environment. The preferred embodiment may be implemented within an intra-partition parallel processing environment which permits two routines to each be executing a different nested statement simultaneously beneath a single parent statement. It is also possible for the preferred embodiment to be implemented within an inter-partition processing environment in which the same event may occur but on different machines, potentially in a shared-nothing implementation. To protect its integrity during concurrent access, the list of tables is protected by a latch. In order to allow different database agents to access the same list of tables, a database-unique identifier for the parent statement is associated with the list when it is created and this same identifier is sent with all processing requests underneath the parent statement (shown having the value N in FIG. 1). Each database agent will use this parent statement identifier to locate the one and only copy of the list of tables for that parent statement at each database partition.
[0079] To support parallel processing within an intra-partition parallel processing environment, the list of tables is kept in shared memory in the partition where it is available to all database agents working on the same parent statement or nested statements of the parent in the partition.
[0080] In a shared-nothing implementation for a partitioned database, each distinct partition uses its own list of tables for each active parent statement. Writing conflicts are only relevant to operations occurring within a particular partition, each the preferred embodiment in each partition performs read/write conflict detection independently of that in any other partition and each partition will have its own independent list of tables reflecting only those tables accessed by statements executing at that partition. If the list of tables does not exist at a database partition, then the execution of the first statement that results in performing read/write conflict contention at that partition will create the list of tables and this list will be used by all subsequent statements executing at the same partition for the same parent statement.
[0081] The execution of a parent statement with nested SQL statements in a shared-nothing partitioned database may result in different partitions being visited at different times by different branches of processing for the statement. For this reason, in the preferred embodiment a list of tables for a partition is maintained at the partition for the life of the parent statement to accommodate any subsequent visits. For this reason, in such an environment, when conflict checking has been invoked for a parent statement and the execution of the parent statement has been completed, it is necessary for the parent statement to send a message to each database partition involved in its processing to indicate that all lists of tables created at the partition can now be removed.
[0082] Although a preferred embodiment of the present invention has been described here in detail, it will be appreciated by those skilled in the art that other variations may be made. Such variations may be made without departing from the spirit of the invention or the scope of the appended claims.
Claims
- 1. A computer program product for detection of writing conflicts for database control statements in a relational database system, the database control statements comprising a parent statement and a set of invoked nested statements, the program product comprising a computer usable medium tangibly embodying computer readable program code means comprising:
code means for maintaining a set of statement table access information in association with each database control statement; code means for generating, at execution time, a set of cumulative table access information associated with the parent statement comprising information from the statement table access information for the parent statement; and code means for, prior to execution of each statement in the set of nested statements, comparing the set of statement table access information for the nested statement with the set of cumulative table access information to determine whether a writing conflict will occur on execution of the nested statement.
- 2. The computer program product of claim 1 further comprising code means for, when no writing conflict is determined for a specified nested statement, updating the set of cumulative table access information to include the set of statement table access information for the specified nested statement.
- 3. The computer program product of claim 1 in which the database control statements are SQL statements.
- 4. The computer program product of claim 1 in which the relational database system is a compiled relational database system and in which the code means for maintaining a set of statement table access information further comprises code means for generating the set of statement table access information at compile time.
- 5. The computer program product of claim 1, in which the set of statement table access information for each database control statement comprises the identity of tables to be accessed by the execution of the statement and the access mode of the said table access.
- 6. The computer program product of claim 4, in which each element of the set of cumulative table access information associated with the parent statement, comprises information specifying a table, a table access scope and an access mode, each table access scope containing one or more database control statements, the set of cumulative table access information being initialized to comprise:
the table and access mode information from the statement table access information for the parent statement; and information specifying the table access scope containing the parent statement.
- 7. A computer program product for detection of writing conflicts in a database system, the writing conflict detection being for database control statements comprising a parent statement and a set of invoked nested statements, the relative definition of the parent statement and each of the nested statements creating a set of table access scopes, each of the table access scopes containing one or more of the parent statement and the nested statements, the program product comprising a computer usable medium tangibly embodying computer readable program code means comprising:
code means for maintaining a set of statement table access information in association with each database control statement, the table access information for each of the said statements recording the identity of tables to be accessed by the execution of the statement and recording the access mode of the said table access; code means for generating, at execution time, a set of cumulative table access information associated with the parent statement, each element in the set of cumulative table access information recording information specifying a table, a table access scope and an access mode, the set of cumulative table access information being initialized with the table and access mode information from the statement table access information for the parent statement, and information specifying the table access scope containing the parent statement; code means for, prior to execution of each statement in the set of nested statements, comparing the table and the access mode information for a sequence of selected elements in the set of statement table access information for the nested statement with the table and access mode information for each element in the set of cumulative table access information, until either a writing conflict is determined for the nested statement by the comparison of a one of the selected elements or each element in the set of statement table access information for the nested statement has been compared with each element in the set of cumulative table access information for the parent statement; and code means for, when no writing conflict is determined for a specified nested statement, adding to the set of cumulative table access information:
i. the information contained in each element in the set of statement table access information for the specified nested statement; and ii. information specifying the table access scope containing the specified nested statement.
- 8. The computer program product of claim 6, in which the code means for comparing, for each nested statement, a selected element in the set of statement table access information with each element in the set of cumulative table access information to determine a writing conflict comprises:
code means for looking up the table information for the selected element in the set of cumulative table access information, and when there is a match with a located element in the said set, a. in the case when the table access scope containing the nested statement matches the table access scope of the located element, determining there to be no conflict for the selected element; and, b. in the case when the table access scope containing the nested statement does not match the table access scope of the located element,
i. and in the case when the access mode of the selected element and the access mode of the located element both correspond to the “read” value, determining there to be no conflict for the selected element; and ii. otherwise determining there to be a conflict for the selected element.
- 9. The computer program product of claim 6 in which the identity of tables to be accessed by the execution of the statement is defined with reference to the each permanent table and each declared global temporary table accessed by the statement on its execution.
- 10. The computer program product of claim 1 further comprising code means for deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
- 11. A computer-implemented method for detection of writing conflicts in a relational database system for database control statements comprising a parent statement and a set of invoked nested statements, the method comprising the steps of:
a. maintaining a set of statement table access information in association with each database control statement; b. generating, at execution time, a set of cumulative table access information associated with the parent statement comprising information from the statement table access information for the parent statement; and c. comparing, prior to execution of each statement in the set of nested statements, the set of statement table access information for the nested statement with the set of cumulative table access information to determine whether a writing conflict will occur on execution of the nested statement.
- 12. The method of claim 10 further comprising the step of:
d. updating, in the case when no writing conflict is determined for a specified nested statement, the set of cumulative table access information to include the set of statement table access information for the specified nested statement.
- 13. A computer-implemented method for detection of writing conflicts in a relational database system, the writing conflict detection being for database control statements comprising a parent statement and a set of invoked nested statements, the relative definition of the parent statement and each of the nested statements creating a set of table access scopes, each of the table access scopes containing one or more of the parent statement and the nested statements, the method comprising the steps of:
a. maintaining a set of statement table access information in association with each database control statement, the table access information for each of the said statements recording the identity of tables to be accessed by the execution of the statement and recording the access mode of the said table access; b. generating, at execution time, a set of cumulative table access information associated with the parent statement, each element in the set of cumulative table access information recording information specifying a table, a table access scope and an access mode, the set of cumulative table access information being initialized with the table and access mode information from the statement table access information for the parent statement, and information specifying the table access scope containing the parent statement; and c. comparing, prior to execution of each statement in the set of nested statements, the table and the access mode information for selected elements in the set of statement table access information for the nested statement with the table and access mode information for each element in the set of cumulative table access information, until either a writing conflict is determined for the nested statement or each element in the set of statement table access information for the nested statement has been compared with each element in the set of cumulative table access information for the parent statement.
- 14. The method of claim 11 further comprising the step of:
d. updating, when no writing conflict is determined for a specified nested statement, the set of cumulative table access information with information comprising:
i. the information contained in each element in the set of statement table access information for the specified nested statement; and ii. information specifying the table access scope containing the specified nested statement.
- 15. The method of claim 11, in which the step c. of comparing, for each nested statement, a selected element in the set of statement table access information with each element in the set of cumulative table access information to determine a writing conflict comprises:
c1. looking up the table information for the selected element in the set of cumulative table access information, and when there is a match with a located element in the said set,
a. in the case when the table access scope containing the nested statement matches the table access scope of the located element, determining there to be no conflict for the selected element; and, b. in the case when the table access scope containing the nested statement does not match the table access scope of the located element,
i. and in the case when the access mode of the selected element and the access mode of the located element both correspond to the “read”value, determining there to be no conflict for the selected element; and ii. otherwise determining there to be a conflict for the selected element.
- 16. The method of claim 10 further comprising the step of:
d. deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
- 17. A computer-implemented method for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes, the method comprising the steps of:
a. generating, at compile time, for each statement, a table access data structure associated with the statement, the table access data structure comprising an entry for tables accessed by the statement, each entry comprising a table identifier and an access mode identifier; b. generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and c. before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is declared or until each entry in the table access data structure has been compared with the entries in the list of tables; and ii. when no conflict is declared, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
- 18. The method of claim 14, in which the step c.i. of comparing, for each nested statement, a table access data structure entry to the entries in the list of tables to determine a conflict comprises looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of tables entry,
a. in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry; b. in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry,
i. and in the case when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry; and ii. otherwise declaring there to be a conflict for the table access data structure entry.
- 19. The method of claim 15 in which the table access data structure for each statement comprises an entry corresponding to, and comprising the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement.
- 20. The method of claim 14 further comprising the step of:
d. defining the set of table access scopes by generating a data structure representing a table access scope with an associated unique counter value for each application start of an SQL statement, each UDF or method invoked and each stored procedure invoked directly from a trigger.
- 21. The method of claim 14 in which the database system supports data partitions and intra-partition concurrency, the list of tables being globally accessible within a partition and comprising an associated latch, the method further comprising the step of:
d. associating the parent statement with a unique parent statement identifier and associating the list of tables with the same parent statement identifier.
- 22. The method of claim 14 further comprising the step of:
d. deleting the list of tables on the completion of execution of the parent statement.
- 23. The method of claim 19 in which the database system supports data partitions and inter-partition concurrency in a shared-nothing architecture, the list of tables being defined relative to the partition in which the method is carried out, the method further comprising the step of:
e. sending an event to the said partition to indicate that the completion of execution of the parent statement has occurred and in which the step of deleting the list of tables is carried out after receipt of the event at the said partition.
- 24. The method of claim 14 further comprising the step of:
d. setting a detect conflict flag in association with the parent statement in the case when the parent statement contains an invocation of a UDF or method or when the parent statement invokes a stored procedure directly from a trigger and in which either the parent statement modifies SQL data or a routine invoked by the parent statement modifies SQL data.
- 25. The method of claim 21 further comprising the step of:
e. declaring that there is no conflict in the case when the detect conflict flag is not set for the parent statement.
- 26. The method of claim 14 further comprising the step of:
d. preventing execution of each nested statement for which a conflict is declared.
- 27. A computer program product comprising a computer readable medium carrying program means for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes, on a computer system, the computer program product comprising:
code means for generating, at compile time, for each statement, a table access data structure associated with the statement, the table access data structure comprising an entry for tables accessed by the statement, each entry comprising a table identifier and an access mode identifier; code means for generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and code means for, before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is declared or until each entry in the table access data structure has been compared with the entries in the list of tables; and ii. when no conflict is declared, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
- 28. A computer-implemented method for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes, the method comprising the steps of:
a. generating for each statement, at the time of compilation, a table access data structure associated with the statement, the table access data structure comprising an entry corresponding to, and comprising the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement;. b. generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and c. before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is declared or until each entry in the table access data structure has been compared with the entries in the list of tables, the step of comparing a selected entry in the table access data structure and the entries in the list of tables comprising
a. looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of tables entry,
in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry, in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry, and in the case when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry and otherwise declaring there to be a conflict for the table access data structure entry; and ii. when no conflict is declared, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
- 29. A computer-implemented method for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes and each having an associated table access data structure, the table access data structure comprising an entry corresponding to, and comprising the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement, the method comprising the steps of:
a. generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and b. before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is determined or until each entry in the table access data structure has been compared with the entries in the list of tables, the step of comparing a selected entry in the table access data structure and the entries in the list of tables comprising
looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of table entry, in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry, in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry, and when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry and otherwise declaring there to be a conflict for the table access data structure entry; and ii. when no conflict is determined, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
- 30. A computer program product comprising a computer readable medium carrying program means for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes on a computer system, the computer program product comprising:
code means for generating for each statement, at the time of compilation, a table access data structure associated with the statement, the table access data structure comprising an entry corresponding to, and comprising the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement; code means for generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and code means for, before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is declared or until each entry in the table access data structure has been compared with the entries in the list of tables, the step of comparing a selected entry in the table access data structure and the entries in the list of tables comprising
looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of tables entry,
in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry, in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry, and in the case when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry and otherwise declaring there to be a conflict for the table access data structure entry; and ii. when no conflict is declared, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement.
- 31. A method for detecting writing conflicts in a database system for a database control statement, said database control statement comprising a parent statement and a nested statement, said method comprising the step of:
a. executing said nested statement when, prior to execution of said nested statement, table access information for said nested statement and cumulative table access information for said parent statement indicates that a writing conflict does not exist when, prior to execution of said nested statement, table access information for said nested statement and cumulative table access information for said parent statement indicates that a writing conflict does not exist.
- 32. The method of claim 28 further comprising the step of:
b. maintaining a set of statement table access information for said database control statement comprising cumulative table access information for said parent statement and table access information for said nested statement.
- 33. The method of claim 29 wherein said executing said nested statement step a. further comprises updating said cumulative table access information for said parent statement to include said table access information for said nested statement.
- 34. The method of claim 30 wherein said cumulative table access information for said parent statement comprises information specifying a table, a table access scope and an access mode.
- 35. The method of claim 31 wherein said table access scope comprises one or more database control statements.
- 36. The method of claim 31 further comprising the step of:
initializing said cumulative table access information so as to comprise table, table access scope and access mode information for said parent statement.
- 37. A computer program product comprising a computer readable medium carrying program means for detecting writing conflicts in a database system for a database control statement, said database control statement comprising a parent statement and a nested statement on a computer system, the computer program product comprising:
code means for executing said nested statement when, prior to execution of said nested statement, table access information for said nested statement and cumulative table access information for said parent statement indicates that a writing conflict does not exist.
- 38. The computer program product of claim 6 further comprising code means for deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
- 39. The method of claim 11 further comprising deleting the set of cumulative table access information for the parent statement on the completion of execution of the parent statement.
- 40. A computer program product comprising a computer readable medium carrying program means for carrying out writing conflict detection in a compiled SQL database system, for a parent SQL statement having a set of invoked nested SQL statements, the parent and nested SQL statements each being defined to be within one of a set of table access scopes and each having an associated table access data structure, the table access data structure comprising an entry corresponding to, and comprising the table identifier for, each permanent table and each declared global temporary table accessed by the statement, and the mode of access identifier for each entry reflecting the mode in which the table corresponding to the entry is accessed by the execution of the statement on a computer system, the computer program product comprising:
code means for generating, at execution time, a list of tables associated with the parent statement, each entry in the list of tables comprising a table identifier, a table access scope identifier and an access mode identifier, the list of tables being initialized with the information from the table access data structure entries of the parent statement; and code means for, before executing each statement in the set of nested statements,
i. comparing the tables and access modes identified by the entries in the table access data structure for the nested statement with the entries in the list of tables, until a conflict is determined or until each entry in the table access data structure has been compared with the entries in the list of tables, the step of comparing a selected entry in the table access data structure and the entries in the list of tables comprising
looking up the table access data structure entry table identifier in the table identifiers in the entries in the list of tables, and when there is a match with a located list of table entry,
in the case when the table access scope of the nested statement matches the table access scope identifier of the located list of tables entry declaring there to be no conflict for the table access data structure entry, in the case when the table access scope of the nested statement does not match the table access scope identifier of the located list of tables entry, and when table access scope entry access mode identifier and the located list of tables entry access mode identifier both correspond to the read value, declaring there to be no conflict for the table access data structure entry and otherwise declaring there to be a conflict for the table access data structure entry; and ii. when no conflict is determined, adding to the list of tables the information contained in each entry in the table access data structure for the nested statement and the table access scope defined to contain the nested statement
Priority Claims (1)
Number |
Date |
Country |
Kind |
2,382,712 |
Apr 2002 |
CA |
|