This application is related to patent application Ser. No. 11/336,140 entitled “QUERY EVALUATION USING ANCESTOR INFORMATION” and filed on Jan. 20, 2006 for Edison, et al.
1. Field of the Invention
This invention relates to XML pivot joins and more particularly relates to handling a LET binding used in a WHERE clause of an XQuery FLWOR expression during an XML pivot join procedure.
2. Description of the Related Art
XPath and XQuery are two common languages used to query an XML document. XPath is a path expression language for selecting data within XML documents. XQuery is a language for querying, transforming, and constructing XML data. An expression is a string of unicode characters which may be constructed from keywords, symbols, and operands. XPath allows expressions to be nested. XQuery uses XPath expression syntax to address specific parts of an XML document and is semantically similar to structured query language (SQL). The SQL-like XQuery syntax uses “For, Like, Where, Order by, and Return” clauses in a “FLWOR” expression.
XPath analyzes an XML document as an XML tree by representing each element of the XML document as a node in the XML tree. The XML tree may include parent-child nodes that directly correspond to the nested elements in the XML document. For more information regarding XPath and XQuery please visit their standards web pages which currently reside at http://www.w3.org/TR/xpath20/ and http://www.w3.org/TR/xquery/ respectively.
An XML pivot join procedure provides efficient filtering of XML documents that satisfy an XPath or XQuery expression. The XML pivot join procedure uses an XML index scan to filter an index for each leg in an expression. For example, given an XPath expression, “/a/b[(c=5) AND (d=6)],” and a collection of XML documents, an index will be filtered by performing an XML index scan on the index relating to “/a/b/c=5” (the first leg) as well as on the index relating to “/a/b/d=6” (the second leg). Each index will contain information from a qualifying XML document, which information includes the qualifying path, the XML document where the path is located, the node identification of the path, and the value received from the XML document. The XML pivot join procedure will “AND” the index scans thereby advancing the scan of one index based on the information of another.
Several structures are created during the XML pivot join procedure. From the query, a query tree is generated that describes the query in tree representation. Also, a paths table is created during the XML pivot join procedure to describe every unique path in the collection of XML documents. By nature, the paths table includes paths that are both relevant and non-relevant to the query. So, to summarize the relevant paths, a paths tree is created. Entries from the paths table are matched against the query tree and qualifying paths are combined to form the paths tree. A match graph is constructed by finding paths in the paths tree that match steps in the query tree. These structures are used at strategic points throughout the XML pivot join algorithm to identify qualifying documents.
XML pivot joining from an XPath expression produces expected results. However, XML pivot joining from an XQuery FLWOR expression may not produce expected results. That is, when pivot joining from an XQuery FLWOR expression, the information to be propagated may not compute properly. For example, given the XQuery FLWOR expression “FOR $a in doc( )//a LET $b in $a//b WHERE $b/c=5 and $b/d=6 RETURN $a,” the LET binding $b describes the sequence of one or more “b” nodes underneath “a” nodes of a document. So, the XQuery FLWOR expression searches for “c” nodes and “d” nodes under any of the “b” nodes that are under “a.” In other words, the “c=5” match and the “d=6” match does not necessarily need to be under the same “b” node.
Detrimentally, certain XML documents that, in theory, should satisfy the XQuery FLWOR expression do not. When the XML pivot join algorithm applies the “AND” operation on the indexes, evaluation of the subsequent leg of the expression relies on the information obtained from the evaluation of the prior leg. So, if the information obtained from evaluating the prior leg results in “Document 1” satisfying the “/a/b/c=5” path, then the subsequent expression would rely on that information to find the “/a/b/d=6” path by starting at the node location for the path “/a/b.” This necessitates having the “c=5” match and the “d=6” match under the same “b” node. But, when evaluating an XQuery FLWOR expression, the “c=5” match and the “d=6” match are not required to be located under the same “b” node. The “c=5” match and the “d=6” match can be under different parent nodes to qualify a document; however, current implementations of the XML pivot join procedure exclude the document.
Paths in the paths table matching the linear XPaths derived from the query tree comprise the paths tree. Thus, the paths tree summarizes all the unique paths in the collection of XML documents that are relevant to the XPath query. XML index entries are created for each linear XPath in the XPath query. Each index entry includes a path, which is the unique path that matched the linear XPath; a value, which is the value of the last document node in the path; a document identifier, which is the document identifier of the XML documents that contains the path; and a node identifier, which is the identifier of the node in the XML document that is in the path.
From this point on, the paths that match a linear XPath will be referenced using the last subscripted label. For example, to refer to the path z-e-x1-p1-v1-b1 above, the reference will be to the “b1” path. Likewise, for the path z-e-x1-q1-v2-b2, the reference will be to the “b2” path.
The first entry in the XML index in
Note that for the “b1” path, there are a number of XML index entries. The first “b1” entry points to document 1, nodeID 1.1.1.2.1.1.1. The second “b1” entry points to document 2 nodeID 1.1.1.1.1.1.1. This says that the indexes have found the “b1” path in both document 1 and document 2. From here on, instead of showing the XML index entries and their paths and locations, the subscripted paths along the xml document paths will be shown (see
In
In
A running example may be useful as it shows the XML pivot join procedure in detail. The following examples will show snapshots of the match graph and describe how the document locations are computed and how the index scans are advanced. The diagram of the xml documents in
In
In the match graph snapshot to the right, the location of “b1” has been truncated to the level of “v1.” It is apparent that this matched the nodeID computed from the truncation of the nodeID of “c1” to the level of “v1.” This match is depicted in location with an asterisk (*) at “v1.” This says that a “b1” path and a “c1” path are found to have the same “v1” ancestor at document 1, as can be seen in
Now that all the index cursors at the leaves of the Match Graph have been advanced once (without returning results), the cursors may again be advanced. The initial match graph (the match graph on the left) in
So, now “x1” has the asterisk (*). The location of “z” is computed from min(x1, x2) and the doc2 for “z” is received. A result for the XPath //x[.//v[b and c] and .//a] may be returned because a “b2” and a “c2” under the same “v1” has been found and the “v1” and “a2” have the same “x1” ancestor. So, the first match for the query //x[.//v[b and c] and .//a] is document 2.
Advancing the location of “z” to doc2+ to advance the index scans is required. This time a “b4” and a “c4” is found at document 5 with the same “v4,” and an “a3” at document 5 with the same “x2” as “b4.” So, document 5 can be returned as a match for the query //x[.//v[b and c] and .//a]. This example of the XML pivot join procedure was applied to an XPath query. The XML pivot join procedure produces expected results when applied to an XPath query. However, as noted above, desired results are not produced when the XML pivot join procedure handles a LET binding used in a WHERE clause of an XQuery FLWOR expression.
Using the collection of XML documents in
From the foregoing discussion, Applicants assert that a need exists for a method and apparatus that properly handles a LET binding used in a WHERE clause of an XQuery FLWOR expression during an XML pivot join procedure.
The present invention has been developed in response to the present state of the art, and in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available LET binding handling techniques. Accordingly, the present invention has been developed to provide an apparatus and method for handling a LET binding used in a WHERE clause of an XQuery FLWOR expression during an XML pivot join procedure.
The apparatus to handle a LET binding used in a WHERE clause of an XQuery FLWOR expression during an XML pivot join procedure is provided with a plurality of modules configured to functionally execute the necessary handling steps. These modules in the described embodiments include an identification module, a link module, a truncation module, and a return module.
The apparatus, in one embodiment, is configured to identify a series of XPath steps under a LET binding of an XQuery FLWOR expression. The LET binding includes a context step that establishes an origination point for the XPath step's traversals down an XML tree. The link module traverses up the XML tree from the terminal point of the XPath steps attempting to locate a first non-LET binding ancestor or Root Step that is common to all XPath steps under the LET binding of the WHERE clause of the XQuery FLWOR expression.
The truncation module truncates the location identifiers of each XPath step to the location identifier of the located first common non-LET binding ancestor or Root Step. The return module returns an XML document if the truncated location identifier matches at a first common FOR binding of the XQuery FLWOR expression. Similar to the LET binding, the FOR binding is an association of a variable to a value in an expression, but the variable is part of the FOR clause. If the truncated location identifier does not match at a first common FOR binding of the XQuery FLWOR expression, then the XML document is not returned.
A method of the present invention is also presented for handling a LET binding used in a WHERE clause of an XQuery FLWOR expression. The method in the disclosed embodiments substantially includes the steps necessary to carry out the functions presented above with respect to the operation of the described apparatus. In one embodiment, the method includes identifying a series of XPath steps, linking bindings under the LET binding to a first common non-LET binding ancestor, truncating a location identifier of each XPath step, and returning a qualifying XML document.
Identifying a series of XPath steps may include identifying the LET binding of the XQuery FLWOR expression and the steps associated with it. The LET binding may include a context step that indicates the originating location of the XPath steps. Linking bindings under the LET binding to a first common non-LET binding ancestor may include utilizing the match graph phase of the XML pivot join procedure. The XPath steps terminate at a terminal location in a paths tree, which is a structure generated during the XML pivot join procedure representing every unique path of a collection of XML documents. A query tree, which is a tree representation of the query, is another structure created during the XML pivot join procedure. Linking bindings may also include utilizing a match graph, which is also created during the XML pivot join procedure by combining matches in the paths tree and the query tree, and traversing from the terminations of the XPath steps back up to a first common non-LET binding ancestor.
Truncating the location identifier for each XPath step includes comparing the location identifier of the XPath step with the location identifier of the first common non-let binding ancestor. The location identifier for each XPath step is truncated to be identical to the location identifier of the first common non-LET binding ancestor. Returning the XML document includes ascertaining if the truncated location identifier of the XPath steps matches a first common FOR binding of the XQuery FLWOR expression. If the location identifiers match, then the XML document is returned; but if the location identifiers do not match, then the XML document is not returned.
Reference throughout this specification to features, advantages, or similar language does not imply that all of the features and advantages that may be realized with the present invention should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present invention. Thus, discussion of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment.
Furthermore, the described features, advantages, and characteristics of the invention may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the invention may be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the invention.
These features and advantages of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.
In order that the advantages of the invention will be readily understood, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments that are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments of the invention and are not therefore to be considered to be limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings, in which:
Many of the functional units described in this specification have been labeled as modules, in order to more particularly emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom VLSI circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
Modules may also be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data may be identified and illustrated herein within modules, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
Reference to a signal bearing medium may take any form capable of generating a signal, causing a signal to be generated, or causing execution of a program of machine-readable instructions on a digital processing apparatus. A signal bearing medium may be embodied by a transmission line, a compact disk, digital-video disk, a magnetic tape, a Bernoulli drive, a magnetic disk, a punch card, flash memory, integrated circuits, or other digital processing apparatus memory device.
Furthermore, the described features, structures, or characteristics of the invention may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided, such as examples of programming, software modules, user selections, network transactions, database queries, database structures, hardware modules, hardware circuits, hardware chips, etc., to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
The FLWOR expression module 101 may include modules corresponding to a FOR clause 102, a LET clause 104, a WHERE clause 106, an ORDER BY clause 108, and a RETURN clause 110. In one embodiment, the FLWOR expression module 101 provides clauses that support iteration and binding of variables to intermediate results. The FLWOR expression module 101 is often useful for computing joins between two or more documents and for restructuring data.
The FOR clause module 102 may bind one or more variables. In one embodiment, the purpose of a FOR clause in an XQuery FLWOR expression module 101 is to produce a tuple stream in which each tuple consists of one or more bound variables. The simplest example of a FOR clause may contain one variable and an associated expression. The value of an expression associated with a variable in a FOR clause is called the binding sequence for that variable. The FOR clause module 102 may iterate over the items in the binding sequence, binding the variable to each item in turn.
When multiple variables are present, each variable may have an associated expression whose value is the binding sequence for that variable; in this case, the FOR clause module iterates each variable over its binding sequence. The resulting tuple stream contains one tuple for each combination of values in the respective binding sequences.
Like the FOR clause module 102, the LET clause module 104 may bind one or more variables. One purpose of the LET clause is to produce a tuple stream in which each tuple consists of one or more bound variables. However, unlike the FOR clause module 102, the LET clause module 104 may bind each variable to the result of its associated expression, without iteration. In one embodiment, the variable bindings generated by the LET clause are added to the binding tuples generated by the FOR clause. If there are no FOR clauses, the LET clause may produce one tuple containing all the variable bindings. Although the FOR clause module 102 and the LET clause module 104 both bind variables, the manner in which variables are bound is different.
The WHERE clause module 106 may be optional. The WHERE clause may serve as a filter for the tuples of variable bindings generated by the FOR clause and the LET clause. In one embodiment, an expression in the WHERE clause is evaluated once for each of these tuples. If the effective boolean value of the expression in the WHERE clause is true, the tuple may be retained and its variable bindings may be used in an execution of the RETURN clause module 110. If the effective boolean value of the expression in the WHERE clause is false, the tuple may be discarded.
The RETURN clause of the XQuery FLWOR expression may be evaluated once for each tuple in the tuple stream, and the results of these evaluations may be concatenated to form the result of the XQuery FLWOR expression module 101. If the ORDER BY clause is not present, the order of the tuple stream may be determined by the FOR clause and the LET clause. If the ORDER BY clause is present, it may reorder the tuples in the tuple stream into a new, value-based order. In either case, the resulting order may determine the order in which the RETURN clause is evaluated; once for each tuple, using the variable bindings in the respective tuples.
For more information regarding the XQuery FLWOR expression and the FLWOR clauses, refer to the W3C publication, XQuery 1.0: An XML Query Language, currently located online at http://www.w3.org/TR/xquery/.
The pivot join module 120 may provide for efficient filtering of XML documents satisfying either an XPath query or XQuery expression. In one embodiment, the pivot join module 120 uses a query tree 122, a paths table 123, a paths tree 124, a match graph 126, and XML indexes 128 to filter XML documents. From an XQuery FLWOR expression, the pivot join module 120 generates a query tree 122.
The paths table 123 may be created to describe every unique path in the collection of XML documents. The paths table 123 may include paths that are both relevant and non-relevant to the query. In one embodiment, to summarize the relevant paths, a paths tree 124 is created. In order to sort the relevant paths from the non-relevant paths, both the query tree 122 and paths table 123 may be utilized to create the paths tree 124. Entries from the paths table 123 may be matched against the query tree 122 to identify qualifying paths which are combined to form the paths tree 124. A match graph 126 may be constructed by finding paths in the paths tree 124 that match steps in the query tree 122. These structures are used at strategic points throughout the pivot join module 120 to identify qualifying documents.
XML indexes may include entries which are derived from each linear XPath in the XPath query or XQuery expression. Each index entry includes a path, which is the unique path that matched the linear XPath; a value, which is the value of the last document node in the path; a document identifier, which is the document identifier of the XML documents that contains the path; and a node identifier, which is the identifier of the node in the XML document that is in the path. There may be one XML index for each linear XPath. As a result, each particular XML index will comprise entries satisfying the corresponding linear XPath. In one embodiment, the XML indexes are logically “AND”ed together to facilitate evaluation.
The identification module 140 may be configured to identify the LET binding of the LET clause 104. In one embodiment, the identification module 140 is configured to identify the XPath steps relating to the XQuery FLWOR expression. A step may be a part of a path expression that generates a sequence of items and then filters the sequence by zero or more predicates. A predicate may include an expression enclosed in square brackets. So, the XPath steps may be identified by examining the query or expression to locate components, which generate a sequence of items and then filter the sequence. For example, in the XQuery “for $a in doc( )/ //a LET $b in $a//b WHERE $b/c=5 and $b/d=6 RETURN $a;” the “$b/c=5” and “$b/d=6” components are both XPath steps.
The identification module 140 may also be configured to identify a context step of the XQuery expression. The context step is the step currently being processed. In one embodiment, the LET bindings are used as context steps in the WHERE clause. The match graph 126 may be represented by a tree structure. The XPath steps may lead down the tree structure of the match graph. The link module 150 may traverse back up through the tree structure by reversing the downward path.
In one embodiment, the link module 150 traverses upward until locating the first common non-LET binding ancestor of the context step. There is great significance in locating the first common non-LET binding ancestor. The XPath steps that traverse down the match graph 126 originate from at least one context step. The context step may be a LET binding. If traversing back up through the match graph only locates the context step or LET binding, the current problem of erroneously excluding a document would still occur.
For example, given the XQuery FLWOR expression “for $x in doc( ) //x LET $v in $x //v WHERE $v /b=‘b’ and $v /c=‘c’ and $x //a=‘a’ RETURN $x;” the result should return XML documents with “b” and “c” matches under a sequence of one or more “v” matches (provided all other components are satisfied). But, if the first common non-LET binding ancestor is not located, then the result would only return XML documents with “b” and “c” under one “v” match (provided all other components are satisfied). Given Document 3 in
In this instance, the first common non-LET binding ancestor is the FOR binding. In one embodiment, the truncation module 160 identifies a location identifier for the first common non-LET binding ancestor. The location identifier may be the node identification. The truncation module may truncate the location identifier for each XPath step to the location identifier of the first common non-LET binding ancestor. The truncation module may create a modified match graph as shown in
The return module 110 may compare either the location identifier of the first common non-LET binding ancestor or the truncated location identifier and a location identifier of a first common FOR binding of the XQuery FLWOR expression. If the location identifiers match, the return module may return the qualifying document. Document 3 of
The schematic flow chart diagrams that follow are generally set forth as logical flow chart diagrams. As such, the depicted order and labeled steps are indicative of one embodiment of the presented method. Other steps and methods may be conceived that are equivalent in function, logic, or effect to one or more steps, or portions thereof, of the illustrated method. Additionally, the format and symbols employed are provided to explain the logical steps of the method and are understood not to limit the scope of the method. Although various arrow types and line types may be employed in the flow chart diagrams, they are understood not to limit the scope of the corresponding method. Indeed, some arrows or other connectors may be used to indicate only the logical flow of the method. For instance, an arrow may indicate a waiting or monitoring period of unspecified duration between enumerated steps of the depicted method. Additionally, the order in which a particular method occurs may or may not strictly adhere to the order of the corresponding steps shown.
Identifying 210 XPath steps may include identifying the LET binding of the LET clause. In one embodiment, identifying 210 XPath steps includes identifying XPath steps relating to the XQuery FLWOR expression. Identifying 210 XPath steps may include identifying a context step of the XQuery expression.
Linking 220 one ore more bindings may include traversing up through the tree structure of the match graph to the first common non-LET binding ancestor. The first common non-LET binding ancestor is the first ancestor reached, while traversing up through the tree structure that is common to the XPath steps being linked but is not a LET binding. For example, the first non-LET binding ancestor may be a FOR binding.
Truncating 230 a location identifier may include identifying the location identifier of the first common non-LET binding ancestor. The location identifier may be a hierarchical node that is used to identify the location of the node in the tree structure of the match graph. In one embodiment, truncating 230 a location identifier includes truncating every XPath step to the location identifier of the first common non-LET binding ancestor.
Ascertaining 240 if the location identifier matches at a first common FOR binding, when traversing a tree structure from the bottom up, may include comparing the location of the first common non-LET binding ancestor to the location of one first common FOR binding. In one embodiment, ascertaining 240 if the location identifier matches at a first common FOR binding includes comparing the truncated location of the XPath steps to the location of one first common FOR binding ancestor. If the location identifiers match, then the method advances to returning 250 the qualifying XML document. If the location identifiers do not match, then the method does not return the XML document because it does not qualify.
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Number | Name | Date | Kind |
---|---|---|---|
7031956 | Lee et al. | Apr 2006 | B1 |
7162485 | Gottlob et al. | Jan 2007 | B2 |
7516121 | Liu et al. | Apr 2009 | B2 |
20040010752 | Chan et al. | Jan 2004 | A1 |
20050108209 | Beyer et al. | May 2005 | A1 |
20050289125 | Liu et al. | Dec 2005 | A1 |
20060235839 | Krishnaprasad et al. | Oct 2006 | A1 |
20070174242 | Josifovski et al. | Jul 2007 | A1 |
Number | Date | Country | |
---|---|---|---|
20080222187 A1 | Sep 2008 | US |