Patent Application
20060015482
The present invention generally relates to the field of organizing and inter-relating data files. More particularly, the present invention relates to a system and associated method for a dynamic folder hierarchy such that documents, items, or object groups stored without external organization provided by a static folder hierarchy can be viewed by the user in a dynamic folder hierarchy that adapts to modifications of the documents, items, or object groups without manual intervention.
As used herein, the term “folder” refers for example to a named collection of related items that can be retrieved, moved, and otherwise manipulated as one entity. “Foldering” or “linking” is a process where a content management system manages or controls the creation, retrieval, editing and distribution of content within an information processing system. Foldering or linking is the act of forming a “link” relationship between two Items. Generally, the content management system enables an end user to create a folder in the content management system and file it into a library by interacting with a suitable application.
Foldering is a generic concept of grouping documents or entities. A folder hierarchy can be used as a classification method to categorize documents, helping to narrow a search space for documents and providing a natural method of navigating documents. Examples of providing the folder hierarchy can be found in file systems such as, for example, the NTFS on Windows platforms, or in an email repository such as, for example, Lotus Notes®.
Conventional foldering mechanisms require a user to manually maintain the placement of documents in a folder within a folder hierarchy. When the content of a document is changed, users have to determine a location for the document within the folder hierarchy that matches the new content of the document. The possibility of misplacing documents in a folder hierarchy is relatively high. Once the document is misplaced, it can be difficult to locate.
Auto foldering systems address the issues of manual foldering. Conventional auto foldering systems automatically place the documents in folders using a predefined criterion based on the properties or content of the document. OLE_LINK2 Although this technology has proven to be useful, it would be desirable to present additional improvements.OLE_LINK2 Using an auto foldering system allows association of a document with many folders. If changes in the content of such a document occur frequently, the processing overhead involved in reevaluating the foldering criteria and placing the document in appropriate folders is high.
Conventional dynamic foldering systems address the issues of manual foldering while reducing processing overhead of auto foldering systems. Instead of requiring static placement of a document in one or more specific folders, a criterion (or criteria) is defined for each design-time folder to describe which documents are associated with the folder. When during run-time a corresponding dynamic folder is accessed via query or path navigation, a collection of documents is evaluated against the defined criteria. Those documents in the collection of documents that satisfy the criteria of the dynamic folder appear as members of the folder.
One conventional dynamic folder system provides a mechanism to populate “smart” folders with documents retrieved from a search executed upon a “folder open”command [reference is made to “Smart Folders in Greenpasture”, G5 Desktop Technical Note, http://www.greenpasture.com/teknotes/teknote_g5_desk top—03.pdf]. The smart folders contain pointers to documents returned from a saved search. To create a smart folder, a user first defines and saves a search. The user then creates a smart folder and associates the saved search with the smart folder. The system runs a search each time the user opens the smart folder and fills the folder with documents returned from the search. The result of the smart folder is the result of joining the nested queries of the nested folders [reference is made to http://www.greenpasture.com/demos.html]. One document can reside in any number of smart folders. The user may configure smart folders to search the entire library or base a search upon the position of the smart folder in the folder hierarchy. In the latter case, a smart folder returns only documents that are stored in folders at or below its own level in the hierarchy.
Another dynamic foldering system provides three ways of defining a folder using metadata: explicit folder creation, template-based folder creation, and rule-based folder creation [reference is made to J. Eder, et. al., “Self-maintained Folder Hierarchies as Document Repositories”. Int'l Conference on Digital Libraries: Research and Practice, Kyoto, Japan, November 2000]. In this dynamic foldering system, metadata is in the form of the attribute name-value pair. Examples of definition of explicit folder creation are:
Examples of definition of template-based folder creation are:
Examples of rule-based folder creation are:
This dynamic foldering system allows distinct values of an attribute to be the classification criteria for assigning a document to a folder as in template-based folder creation. Consequently, the folder hierarchy of this dynamic foldering system is driven by the content of the documents.
Yet another conventional dynamic foldering system utilizes a query language to retrieve some of the information from XML documents [reference is made to U.S. Pat. No. 5,418,946]. This conventional dynamic foldering system uses the retrieved information to automatically organize a hierarchy in which to organize the XML documents.
Although these conventional dynamic foldering technologies have proven to be useful, it would be desirable to present additional improvements. The conventional folder definitions mostly address only the domain of the flat data model. Many of the conventional dynamic foldering technologies assume the metadata appears in the form of a name—value attribute pair. Conventional dynamic foldering technologies do not provide a complete solution to cover the hierarchical data model, such as XML, where the criteria of a folder may depend on the context of the criteria of the ancestor folders. Further, the foldering criteria associated with a conventional dynamic folder are static, requiring determination when the folder is created. There is no mechanism in conventional foldering technologies to tailor the foldering criteria at the time a user accesses the dynamic folder. For example, users may want to define a criterion of the folder to be based on the current month.
What is therefore needed is a system, a service, a computer program product, and an associated method for creating dynamic folder hierarchies utilizing a context of a criteria of ancestor folders and dynamic foldering criteria. Further, a dynamic foldering technique is desired that allows a user to define foldering criteria at the time a user accesses a dynamic folder. The need for such a solution has heretofore remained unsatisfied.
The present invention satisfies this need, and presents a system, a service, a computer program product, and an associated method (collectively referred to herein as “the system”or “the present system”) for creating a dynamic folder hierarchy. The dynamic folder hierarchy is defined by a hierarchy of design-time folder groups. The design-time folder group is defined by a parameterized query/predicate on a document comprising structured or semi-structured data such as an XML document, an item, or an object graph.
The present system automatically manages the creations and deletions of the run-time dynamic folders. The present system further automatically manages selection of documents, items, or object graphs found in the run-time dynamic folders. An item refers to an object that has both metadata (can be of hierarchical structure such as XML) and one or more contents (structured, semi- or un-structured). An object graph refers to a graph structure of objects, where the objects can be XML documents, items, or other data. The existence of a folder within the present system depends on whether any documents in a collection of documents being organized by the present system meet the criteria for creation of that folder. If none of the documents in the collection of documents meet the criteria for a folder, the folder is not created.
The present system utilizes features of structured and semi-structured documents, items, or object graphs (collectively referenced as documents) to dynamically create the dynamic folders. The documents comprise a self-describing data format. The self-describing data format is analyzed by the present system to place the documents in a dynamic folder hierarchy. For example, an XML document comprises descriptive tags such as <author>. These descriptive tags are used by the present system to dynamically organize documents within a dynamic folder hierarchy. If designed to organized documents based on “author”, the present system utilizes the <author> tag to create dynamic folders based on names of authors and conceptually places the document in the appropriate dynamic folders.
The documents are not physically placed in a dynamic folder by the present system. Rather, the present system retrieves a set of documents matching a query; the present system follows a path to retrieve documents much as a user follows a path in opening folders in a conventional foldering system to view documents co-located based on some criteria. The criteria for creating a dynamic folder hierarchy are predetermined by the user. The user can modify these criteria without changing the location of any of the documents that the dynamic folder hierarchy is organizing. Based on the criteria for the dynamic folder hierarchy, the dynamic folder hierarchy changes the location of documents within the dynamic folder hierarchy after document update without requiring manual intervention by a user.
The present system comprises a query/predicate for a design-time folder group based on which dynamic folders are automatically managed, a variable binding mechanism, automatic identifications of dynamic folders containing a particular object, parallel navigation, and customized combination of foldering results. The query/predicate for a design-time folder group can be a parameterized query, making the query/predicate more dynamic and useful than conventional dynamic foldering techniques.
The present system uses variable binding to provide powerful query/predicate definitions on hierarchical data or graph-structured data. The variable binding mechanism for query/predicate definition is very useful for hierarchical data and graph-structured data.
Given a document, the present system automatically identifies which dynamic folders contain the document. The automatic identification of the dynamic folders that contain a particular document is very useful for analyzing the semantics of the object.
The present system comprises parallel navigation, allowing a user to navigate along additional paths in a hierarchy and combine the navigation results using set operations. The parallel navigation and the customized combination of the results provide a very powerful navigation mechanism.
The present system may be embodied in a utility program such as a dynamic folder hierarchy utility program. The present system provides means for the user to identify a collection of data as input data for which a dynamic folder hierarchy may be created by the present system. The present system also provides means for the user to specify a design-time folder group definition including a set of variable binding expressions from which the dynamic folder hierarchy is created. The present system further provides means by which a user may select a document to view or criteria by which a document is found. A user specifies the input data, the design-time folder group definitions including a set of variable binding expressions, and then invokes the dynamic folder hierarchy utility program to create the dynamic folder hierarchy. The user then invokes the dynamic folder hierarchy utility program to view a document or set of documents by specifying the desired dynamic folder(s).
The various features of the present invention and the manner of attaining them will be described in greater detail with reference to the following description, claims, and drawings, wherein reference numerals are reused, where appropriate, to indicate a correspondence between the referenced items, and wherein:
The following definitions and explanations provide background information pertaining to the technical field of the present invention, and are intended to facilitate the understanding of the present invention without limiting its scope:
Document: One definition of document is data stored in a structured or semi-structured format including items, objects, and object graphs. Another definition of document is a computer file that contains data that contains at least some data in structured or semi-structured format.
XML: extensible Markup Language. A standard, semi-structured language used for Web documents. During a document authoring stage, XML “tags” are embedded within the informational content of the document.
Internet: A collection of interconnected public and private computer networks that are linked together with routers by a set of standard protocols to form a global, distributed network.
Item: an object that has both metadata (can be of hierarchical structure such as XML) and one or more contents (structured, semi- or un-structured).
Object: a graph structure of objects, where the objects can be documents, items, or other data.
World Wide Web (WWW, also Web): An Internet client server hypertext distributed information retrieval system.
Users, such as remote Internet users, are represented by a variety of computers such as computers 20, 25, 30, and can access the host server 15 through a network 35. In one embodiment, system 10 creates dynamic folder hierarchies for documents, items, or object graphs stored on a data repository 40. Documents, items, or object graphs are collectively referenced herein as documents. In another embodiment, documents organized by system 10 in dynamic folder hierarchies are written in XML. Users access the documents through the dynamic folder hierarchy. In a further embodiment, users provide documents to system 10; system 10 then creates dynamic folder hierarchies for the user.
Computers 20, 25, 30 each comprise software that allows the user to interface securely with the host server 15. The host server 15 is connected to network 35 via a communications link 45 such as a telephone, cable, or satellite link. Computers 20, 25, 30, can be connected to network 35 via communications links 50, 55, 60, respectively. While system 10 is described in terms of network 35, computers 20, 25, 30 may also access system 10 locally rather than remotely. Computers 20, 25, 30 may access system 10 either manually, or automatically through the use of an application.
In the example of
The query/predicate processor 205 utilizes parameterized queries to define the design-time folder groups 340. For the design-time folder groups 340, exemplary parameterized queries are listed in Table 1. In one embodiment, the parameterized queries are queries which evaluate to atomic values. The number of dynamic folders in each of the design-time folder groups 340 is unknown when the design-time folder group hierarchy 300 is designed.
Table 1: Exemplary parameterized queries used by the query/predicate processor 205 to associate documents with the design-time folder groups 340.
Table 2 illustrates exemplary XML documents that can be organized by system 10 into the design-time folder groups 340 using the parameterized queries of Table 1. The XML documents of table 2 comprise nested tags. The entire XML content in the documents are used by the query/predicate processor 205 to determine which documents are conceptually placed in a dynamic subfolder. Each document may appear in more than one dynamic subfolder.
Given the documents of Table 2, the parameterized queries of Table 1, and the design-time folder group hierarchy 300 of
Within area 402, system 10 creates the dynamic folder “computer”404. System 10 creates a dynamic folder for each “area” represented by the collection of documents being organized. Additional “area” folders are created for each area represented. In the simple example illustrated by the documents of Table 2, only one “area” is represented, i.e., computer 404.
For each “area” such as computer 404, system 10 creates dynamic folders organization 406 and collaboration 408. Organization 406 corresponds to organization 315; collaboration 408 corresponds to collaboration 320. Within organization 406, system 10 creates a dynamic folder for each organization represented by the documents of Table 2: company 410 and non-company 412. System 10 organizes the organization types according to address by creating dynamic folders: address 414 for company 410 and address 416 for non-company 412.
Within address 414, system 10 creates a dynamic folder for each address found associated with a company in the collection of documents to which the design-time folder group hierarchy 300 is applied. In the exemplary list of documents in Table 2, two addresses are located for documents associated with company 410: Milpitas and San Jose. Within address 414, system 10 creates Milpitas 418 and San Jose 420. Milpitas 418 conceptually comprises document D2422. San Jose 420 conceptually comprises document D1424. One address is located for documents associated with non-company 412: San Jose. Within address 416, system 10 creates San Jose 426. San Jose 426 conceptually comprises document D3428.
System 10 does not move document D2422, document D1424, or document D3428 into a new location. Rather, system 10 defines a method by which an external organization through parameterized queries can find documents that meet criteria in a manner similar to locating documents organized within a folder hierarchy. As new distinct values are inserted and old distinct values are deleted, appropriate dynamic folders are conceptually created and deleted accordingly.
As represented by the documents of Table 2, all of the collaboration is by project. Consequently, system 10 creates subfolder project 430 of collaboration 408. Collaboration 408 corresponds to design-time folder group 320. Project 430 comprises personname 432. Based on the documents of Table 2, system 10 creates two subfolders for personname 432: Smith 434 and Jones 436. System 10 populates affiliation 438, with the affiliations associated with Smith 434: UCLA 440 and ABC 442. Document D4444 conceptually resides in UCLA 440. Document D5446 conceptually resides in ABC 442. The folder, affiliation 448, associated with Jones 436 comprises ABC 450. ABC 450 comprises the document D5446. Personname 432 corresponds to design-time folder group personnname 325. Affiliation 438 and affiliation 448 correspond to design-time folder group, affiliation 330.
System 10 determines one company name among the documents in Table 2 that may be organized under collaboration 408. System 10 then creates companyname 452 and folder XYZ1454. Folder XYZ1454 conceptually comprises document D4444 and document D5446. Companyname 452 corresponds to design-time folder group, companyname 335.
Within the structure of the dynamic folder hierarchy 400, the documents of Table 1 are conceptually inserted into one or more dynamic folders. For example, document D1424 is found in
/Area/Computer/Org/Company/Address/“San Jose” and its ancestor folders, because “//Area/@name” evaluates to “Computer”, “//Organization/@type” evaluates to “Company” and “//Address/@city” evaluates to “San Jose”. Similarly, document D2422 is found in /Area/Computer/Org/Company/Address/Milpitas. Document D3428 is found in /Area/Computer/Org/non-Company/Address/“San Jose”. Document D4444 is found in two dynamic folders:
Document D5446 is found in three dynamic folders:
To retrieve a set of documents in a dynamic folder, the query/predicate processor 205 executes a query on an associated collection of documents. The query intersects the predicate of the dynamic folder and the predicates of the ancestor dynamic folders of the dynamic folder. A query to retrieve the documents residing in San Jose 420 is formulated by the query/predicate processor 205 as:
A query to retrieve the documents residing in collaboration 408 is formulated as:
This query intersects two predicates. The query retrieves the documents in dynamic folder /Area/Computer/Collaboration/Project and its sub dynamic folders recursively, comprising:
The query/predicate processor 205 comprises an algorithm for retrieving documents within a dynamic folder, where:
An exemplary pseudocode of the query/predicate processor 205 is as follows:
In one embodiment, system 10 creates materialized query tables to pre-compute results for dynamic folders that are frequently accessed. Creating materialized query tables accelerates query execution by rewriting the query using the pre-computed result. In another embodiment, system 10 caches some of the results from an immediate folder during the navigation to use for further navigating the content of any descendent folders. In yet another embodiment, various indexes can be used or different query engines can be employed. In a further embodiment, system 10 incorporates constraints into the design-time folder group definitions:
The variable binding processor 210 utilizes a variable binding in the design-time folder group definitions in a hierarchy of design-time folder groups. Variable binding assigns a variable to a particular query. Variable binding provides a mechanism for relating values when defining a design-time folder group hierarchy. Relationships between values are reflected when folders are dynamically created by system 10.
Using variable binding, the design-time folder group definitions for personname 335 and affiliation 330 become:
The remaining design-time folder group definitions have the same definitions as previously described. Using variable binding, the semantics for /PersonName/Smith/Affiliation/UCLA, /PersonName/Smith/Affiliation/ABC and /PersonName/Jones/Affiliation/ABC in /Area/Computer/Collaboration/Project are different from the ones previously described. The dynamic folder /PersonName/Smith/Affiliation/UCLA classifies the projects Smith participated in while being affiliated with UCLA. The dynamic folder /PersonName/Smith/Affiliation/ABC classifies the projects Smith participated in while being affiliated with ABC.
The following document, D6, demonstrates the usefulness of variable binding:
System 10 uses variable binding to reflect a relationship between individuals and their affiliation. Document D6 represents two individuals with different affiliations participate in a project collaboration: Smith at UCLA and Jones at ABC. Without variable binding, document D6 appears in UCLA 440, ABC 442, ABC 450, and a UCLA folder under affiliation 448 because the terms UCLA, Smith, Jones, and ABC all appear in D6:
Through variable binding, the variable binding processor 210 recognizes the relationship between individual name and affiliation and places D6 only in UCLA 440 and ABC 450, as illustrated by D6456 in
A further example of a query using the variable binding processor 210 is: collection(“abc”)[(//Area/@name=“Computer”)
This query intersects four predicates, retrieving the documents in the following dynamic folder:
The variable binding processor 210 utilizes an enhanced retrieveQuery( ) method to manage variable binding. The retrieveDocument method is as previously described. The term “folderNode.getBinding( )”returns the binding statement and “null” in the absence of binding.
String retrieveQuery(in: folderNode; in: level, out: nesting) begin
External variable definitions in query languages allow values to be provided by the external environment. Consequently, the atomic-valued queries of the design-time folder group definitions can be parameterized queries. The values of the variables are added to the evaluation context before the derived query is evaluated and documents in the dynamic folders be retrieved. For example:
The algorithm to derive the query for retrieving the documents in a dynamic folder remains the same as previously described except that the variable definitions are added to the prolog of the query.
System 10 views the design-time folder hierarchy definition as a tree with the design-time folder group definitions as nodes. Given a design-time folder group node N, N.getName( ) returns the name of the folder group definition, and N.getQuery( ) returns the atomic-valued query of the folder group definition. The automatic identification processor 215 utilizes the following algorithm to determine dynamic folders given a design-time folder hierarchy definition and a document:
When “PreorderProcess” is executed with a given document, the root group definition of the hierarchy, an empty parent path, and an empty path list, the result path list returns the dynamic folders in which the given document can be found. As in the examples, the document can also be found in the ancestor dynamic folders of the dynamic folders listed. To avoid redundancy, the ancestor dynamic folders are not included in the list. System 10 examines a definition with respect to the algorithm. If a dynamic folder satisfies a certain definition, system 10 checks the children of the dynamic folder to see if the children satisfy the definition. If not, system 10 stops following that path because none of the descendants will satisfy the definition.
External variable definitions are bound before the execution of “PreorderProcess”. In conjunction with variable definitions and variable bindings, system 10 utilizes an additional parameter “var_pairs”. The parameter “var_pairs” is a list of name-value pairs for the variables. “PreorderProcess”passes the parameter “var_pairs”to its recursive calls and to “ExecuteQuery”. “ExecuteQuery”uses the parameter “var_pairs”to modify the query and appends the parameter “var_pairs”to the pair list if variable bindings are defined for the current node.
An example of the use of the parameter “var_pairs”is applied to affiliation 330. System 10 assumes var_paris={(v, “<Individual name=“Smith”affiliation=“ABC”/>”)}. Consequently, the query becomes:
In one embodiment, system 10 limits the query of each design-time folder group definition to return only one distinct atomic value. In this case, the hierarchy of the design-time folder groups is fixed; i.e., the hierarchy of the dynamic folders at run-time is the same as that in the definition time. This embodiment is useful for situations when users primarily desire a particular dimension for categorizing the documents. Examples of design-time folder group definitions in this embodiment are:
The parallel navigation processor 220 allows parallel navigation to documents along additional paths in a dynamic folder hierarchy. Using parallel navigation, a user can navigate along different paths in the dynamic folder hierarchy in different orders to view categorization of documents. The parallel navigation processor 220 in conjunction with the customizable combination processor 225 allows a user to define set operations on the results of additional paths. These set operations comprise a combination of intersections, unions, and differences.
With the dynamic folder hierarchy of
In the example, the user is interested in projects in which an individual named Smith and a company named XYZ1 participated. The user defines the overall result as the intersection of results from the paths to the individual named Smith and the company named XYZ1. When the user navigates to Affiliation 438 then ABC 442, the overall result is the intersection of documents in /Collaboration/Project/PersonName/Smith/Affiliation/ABC and XYZ1454.
In one embodiment, system 10 obtains the results of all the paths and then applies the defined set operations to combine the results into the overall result. The results of all the paths may be obtained from Automatic Summary Tables (ASTs). In another embodiment, system 10 examines the definitions of all the paths and combines and rewrites the query or queries. Consequently, system 10 avoids unnecessary computation and efficiently executes the query or queries.
The examples and the algorithms previously discussed have assumed one collection of documents associated with a dynamic folder hierarchy. In one embodiment, system 10 may provide a dynamic folder hierarchy for additional collections of documents. In this embodiment, system 10 generates additional dynamic folder hierarchies, each of which associates with a set of collections. Some overlap may occur between the dynamic folder hierarchies. In a further embodiment, system 10 allows the top level predicates of a dynamic folder hierarchy on document collections to determine which document collections are associated with each top level sub-tree. In this embodiment, a single dynamic folder hierarchy is sufficient.
In the examples presented, the data organized by system 10 into dynamic folder hierarchies are XML documents. The data can be easily generalized to items or object graphs because the variable binding and the variable definition mechanisms can be readily applied to such data.
At decision step 525, the user may choose to return to step 515 to create, update, or select documents. If at decision step 525 the user does not choose to create, update, or select documents, the user may choose to view additional documents at decision step 530. The user may view documents at step 520 without changing the design-time folder group definitions to accommodate the changed document set; system 10 automatically and dynamically modifies the folder hierarchy to reflect any changes in specific documents or the collection of documents for which system 10 is providing a dynamic folder hierarchy. If the user does not wish to view additional documents at decision step 530, the user may exit the dynamic folder hierarchy at step 535.
At decision step 620, the user chooses to select a document to view or select other viewing criteria. At step 625, system 10 translates the query representing the selection of document or viewing criteria of decision step 620. System 10 returns a result of the query to the user at step 630. Processing then returns to step 615 for additional action by the user. If the user does not select a document or viewing criteria at decision step 620, processing returns to step 615 for additional action by the user.
Steps 625 and 630 comprise a viewing stage of system 10. A user may find and view a document or set of documents inside a specified folder, find or view the folders in which a specified document is located, or perform parallel navigation. Parallel navigation allows the user to view more than one dynamic folders at a time and to combine viewing criteria or queries such as unions, intersections, etc.
It is to be understood that the specific embodiments of the invention that have been described are merely illustrative of certain applications of the principle of the present invention. Numerous modifications may be made to the system and method for creating dynamic folder hierarchies described herein without departing from the spirit and scope of the present invention. Moreover, while the present invention is described for illustration purpose only in relation to the WWW, it should be clear that the invention is applicable as well to, for example, data stored on an intranet, a local area network, locally, or any other location accessible by the present invention. Furthermore, while the present invention is described for illustration purpose only in relation to XML documents, it should be clear that the invention is applicable as well to, for example, any form of structured, semi-structured, or non-structured data.
