System, method, and computer program for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment

Abstract

The present invention extracts entity data from a plurality of related data objects from an external multi-tenant SaaS environment. The system extracts metadata related to an entity's data records and uses the metadata to identify a data schema associated with the entity's data. The system provides an interface for enabling a user to create an extraction tree that includes the data objects in the data schema from which data will be extracted. Enabling a user to create an extraction tree includes enabling a user to add a root node to the extraction tree, add any parent and child nodes of the root node in the data schema to a next level of the extraction tree, and add multiple additional levels of the extraction tree. The system creates an extraction plan based on the extraction tree and extracts data from the multi-tenant SaaS environment based on the extraction plan.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to a multi-tenant SaaS environment and, more specifically, to a system and method for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment.

2. Description of the Background Art

Companies need to be able to handle a multitude of complex, interrelated data. In one exemplary scenario, a customer service contact center that uses software, such as SALESFORCE, needs to manage customer cases. Every time a customer calls in, the system would create a ticket to track the issue and include information such as conversations, emails, chats, text, SMS, etc. Since the customer service contact center has so many customers, which leads to numerous customer calls and created tickets, the customer service contact center may soon face the dilemma of their SALESFORCE system slowing down or paying expensive storage fees. They may instead choose to archive the data (i.e., extract, but not delete the data) for easy accessibility while not storing it directly in the system. SALESFORCE is a huge database with multiple tables such that every table is linked to each other (e.g., case table, case comment table, email table, SMS table, etc.). Therefore, there is a need for a system and method that would enable a user to more easily select a plurality of interrelated tables and specify which data within the interrelated tables to extract.

SUMMARY OF THE DISCLOSURE

The present disclosure describes a system, method, and computer program for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment. The method is performed by a computer system that includes servers, storage systems, networks, operating systems, and databases.

The present invention provides a graphical user interface, and, in an alternate embodiment, an API, to create an extraction tree for extracting data objects stored in an external multi-tenant SaaS environment. The present invention also provides a novel data schema for organizing the data objects in the graphical user interface such that a user is able to traverse up and down the hierarchy of the data schema from any node (not just the root node) in adding descending nodes to the extraction tree. The present invention also enables the user to set extraction filter criteria for each data object added to the extraction tree. The benefit is that when the user sets extraction filter criteria for a data object, the child nodes of the data object are consistently filtered based on the extraction filter criteria, resulting in a targeted data extraction using the data schema. The present invention also provides a “quick start” algorithm that enables the user to select a plurality of data objects for the “quick start” algorithm to try to connect together and automatically create an extraction tree (rather than graphically adding a root node and graphically adding and connecting a plurality of parent and child nodes within the extraction tree).

In one embodiment, a method for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment comprises the following steps:

• • extracting metadata related to an entity's data records in the external multi-tenant SaaS environment;
  • using the metadata to identify a data schema associated with the entity's data in the multi-tenant SaaS environment;
  • providing an interface for enabling a user to create an extraction tree that includes the data objects in the data schema from which data will be extracted, wherein the extraction tree has a plurality of levels, wherein each level has at least one node corresponding to a data object in the data schema, wherein, in adding a child node to a parent node in the extraction tree, the user is able to select from both parent and child data objects of the parent node in the data schema, and wherein enabling a user to create an extraction tree comprises:
    • enabling a user to add a root node to the extraction tree;
    • enabling a user to add any parent and child nodes of the root node in the data schema to a next level of the extraction tree;
    • enabling a user to add multiple additional levels of the extraction tree, wherein at each new level the user is able to add both parent and child data objects in the data schema to nodes in the previous level, enabling a user to traverse up and down the hierarchy of the data schema in adding descending nodes to the extraction tree;
  • creating an extraction plan based on the extraction tree; and
  • extracting data from the multi-tenant SaaS environment based on the extraction plan.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart that illustrates a method, according to one embodiment, for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment.

FIG. 2 is a flowchart that illustrates a method, according to one embodiment, for enabling a user to create an extraction tree.

FIGS. 3A-3F are screenshots of an exemplary user interface, according to one embodiment, for enabling a user to create a graphical extraction tree.

FIG. 4 is a block diagram that illustrates an example system architecture according to one embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present disclosure describes a system, method, and computer program for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment. The method is performed by a computer system that includes servers, storage systems, networks, operating systems, and databases (“the system”).

Example implementations of the method are described in more detail with respect to FIGS. 1-4.

1. METHOD FOR EXTRACTING ENTITY DATA FROM A PLURALITY OF RELATED DATA OBJECTS FROM AN EXTERNAL MULTI-TENANT SAAS ENVIRONMENT

FIG. 1 illustrates a method for extracting entity data from a plurality of related data objects from an external multi-tenant SaaS environment. The system extracts metadata related to an entity's data records in an external multi-tenant SaaS environment (step 110). The system uses the metadata to identify a data schema associated with the entity's data in the multi-tenant SaaS environment (step 120). The system provides a user interface for enabling a user to create a graphical extraction tree that illustrates the data objects in the data schema from which the data will be extracted (step 130). The extraction tree has a plurality of levels. Each level has at least one node corresponding to a data object in the data schema. In adding a child node to a parent node in the graphical extraction tree, the user is able to select from both parent and child data objects of the parent node in the data schema. In certain embodiments, the system enables the user to set extraction filter criteria for each data object inserted into the extraction tree by the user. The system creates an extraction plan based on the graphical extraction tree (step 140). The system extracts data from the multi-tenant SaaS environment based on the extraction plan (step 150).

In certain embodiments, instead of the system providing a graphical user interface for enabling a user to create a graphical extraction tree, the system provides an API that enables the user to use a different user interface (e.g., created by a third-party) to interface with the system to create an extraction tree. Similar to the system-provided graphical user interface, the different user interface would enable the user to view the extraction tree and select nodes for the extraction tree.

In certain embodiments, the system also performs a “quick start” algorithm in which, in response to a user selecting a plurality of starting nodes to create the extraction tree, the system automatically adds any connecting nodes between the plurality of starting nodes in creating the extraction tree. In certain embodiments, the system also automatically adds one or more child nodes of each of the selected starting nodes in the data schema to a next level of the extraction tree.

In certain embodiments, the method further includes identifying chunks of data in a data object for purposes of data extraction, and, after extracting the data object by extracting the chunks of data, reconciling the chunks of data in the data object. For further details regarding such extraction techniques, please see U.S. patent application Ser. No. 17/496,543, entitled “System Method, and Computer Program for Extracting Large Customer Data Volumes at High Speed from an External Multi-tenant SaaS Environment,” filed on Oct. 7, 2021, which is incorporated by reference as if fully disclosed herein.

In certain embodiments, the system and method described herein are used for the purpose of archiving, sandboxing seeding, consumer rights, etc.

2. METHOD FOR ENABLING A USER TO CREATE AN EXTRACTION TREE

FIG. 2 illustrates a method for enabling a user to create an extraction tree. The system enables a user to add a root node to the extraction tree (step 210). The system enables a user to add any parent and child nodes of the root node in the data schema to a next level of the extraction tree (step 220). The system enables a user to add multiple additional levels of the extraction tree (step 230). At each new level, the user is able to add both parent and child data objects in the data schema to nodes in the previous level, which enables a user to traverse up and down the hierarchy of the data schema from any node (and not just the root node) in adding descending nodes to the extraction tree.

3. EXAMPLE SCREENSHOTS OF USER INTERFACE FOR ENABLING A USER TO CREATE A GRAPHICAL EXTRACTION TREE

FIGS. 3A-3F illustrate screenshots of an exemplary user interface for enabling a user to create a graphical extraction tree according to the present invention. A person skilled in the art would understand that the present invention may be embodied in other user interfaces having more or less functionality within the scope of the present invention. As such, FIGS. 3A-3F are intended to be illustrative and not limiting in any way.

As seen in FIG. 3A, a graphical user interface is provided for the “Financial Services Cloud” that includes a root node (e.g., “Account”) that was created by the user clicking the “Add root object” button, a plurality of child nodes (nodes with the arrow pointing downward), and a plurality of parent nodes (nodes with the arrow pointing upward). As previously discussed, the data schema for the graphical user interface is unique because instead of being a top down hierarchy, it enables a user to traverse up and down the hierarchy of the data schema from any given node in the graphical extraction tree.

As seen in FIG. 3B, when the user selects a node, in this case, the root node (i.e., “Account”), the system provides a window overlay that enables the user to add any parent or child nodes of the root node in the data schema to a next level of the extraction tree. While the window overlay as illustrated shows a plurality of available parent nodes, if the user scrolls down, the window overlay would also show a plurality of available child nodes. The user then has the option to select one or more of the parent and/or child nodes for adding to the root node. This process can be done with any node in the graphical extraction tree.

As seen in FIG. 3C, as the user is creating the graphical extraction tree, the system enables the user to set extraction filter criteria for each data object inserted into the graphical extraction tree by the user. In certain embodiments, the extraction filter criteria may include one or more of: limiting the rows in a data object from which data will be extracted, limiting the fields in the data object from which data will be extracted, and matching the fields/values in the data object. In certain embodiments, the extraction filter criteria include skipping specified rows or fields. In certain embodiments, when the user sets extraction filter criteria for a data object, the child nodes of the data object are consistently filtered based on the extraction filter criteria, resulting in a targeted data extraction using the data schema. For example, if the user selects only five specific accounts in the node “Accounts” for extraction, the child nodes would also reflect the data objects related to the five specific accounts.

As seen in FIGS. 3D-3F, instead of creating the graphical extraction tree by the user graphically adding a root node and graphically adding and connecting a plurality of parent and child nodes, a graphical extraction tree can also be created through a “quick start” algorithm. As seen in FIG. 3D, the user defines a new scope name and organization in step 1. In this case, the new scope name is “Extract Account” and the organization is “ACID analytics trial.”

As seen in FIG. 3E, the user is able to select a plurality of data objects for the “quick start” algorithm to try to connect together in step 2. In certain embodiments, the “quick start” algorithm has a maximum number of starting data objects (e.g., five data objects) that the user may select. In certain embodiments, the user can select to automatically add all cascade deletes from the selected data objects and/or to automatically add all first-level children from the selected data objects. The system then runs a scope validation algorithm in step 3 and builds the dataset in step 4.

As seen in FIG. 3F, the “quick start” algorithm has created a graphical extraction tree labeled “Extract Account” with the starting data objects selected by the user in step 2 (see FIG. 3E). The “quick start” algorithm automatically inserts any nodes that are in between the selected starting data objects in order to connect the selected starting data objects. In certain embodiments, the “quick start” algorithm also automatically adds one or more child nodes to each of the selected starting data objects (e.g., one level of child nodes) in order to provide more information regarding each of the selected starting data objects. The user can then adjust the graphical extraction tree by adding and/or deleting nodes, and/or the user can adjust the extraction filter criteria for each data object inserted into the graphical extraction tree by the user.

4. EXAMPLE SYSTEM ARCHITECTURE

FIG. 4 illustrates an example architecture for a system that performs the methods described herein. However, the methods described herein may be implemented in other systems and are not limited to the illustrated system. In order to obtain metadata and extract data records from a plurality of entities (e.g., Entity 1 to Entity n) in a multi-tenant SaaS environment 470 via the internet, one or more API interfaces 440 interfaces with the API interfaces 460 of the multi-tenant SaaS environment 470, an API optimizer 405 distributes API requests among a plurality of APIs and has a corresponding administrative user interface (UI) 412, a metadata extractor 410 extracts metadata, a data record extractor 415 extracts data records, and a database writer 425 writes to the database of the backup platform 435.

The backup platform 435 hosts a backup for each entity 430a, 430b, 430c. Each backup 430a, 430b, 430c includes the metadata and extracted data records that corresponds to the metadata and data records for each entity in the multi-tenant SaaS environment 450a, 450b, 450c. Both the multi-tenant SaaS environment 470 and the backup platform 435 do not provide a separate database for each entity. Hence, while the data records are illustrated separately using database symbols with respect to each entity in both the multi-tenant SaaS environment 470 and the backup platform 435, the database(s) is (are) often shared between entities on their respective servers. A customer can make API calls to the backup 430a, 430b, 430c via API interface 480.

5. GENERAL

The methods described with respect to FIGS. 1-4 are embodied in software and performed by a computer system (comprising one or more computing devices) executing the software. A person skilled in the art would understand that a computer system has one or more memory units, disks, or other physical, computer-readable storage media for storing software instructions, as well as one or more processors for executing the software instructions.

As will be understood by those familiar with the art, the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the above disclosure is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.

Claims

1. A method, performed by a computer system, for extracting entity data from a plurality of related data objects from an external multi-tenant software-as-a-service (SaaS) environment, the method comprising: extracting metadata related to an entity's data records in the external multi-tenant SaaS environment;using the metadata to identify a data schema associated with the entity's data in the multi-tenant SaaS environment, wherein the data schema forms a hierarchy of at least three levels of the entity's data in the multi-tenant SaaS environment;providing an interface for enabling a user to create an extraction tree;creating the extraction tree in the interface by a user viewing data objects in the data schema and selecting a plurality of data objects in the data schema as nodes in the extraction tree, wherein the extraction tree is stored in memory;building the extraction tree by the system automatically inserting any connecting data objects that are in between the selected plurality of data objects in the data schema as connecting nodes in the extraction tree;enabling a user to add any parent and child data objects in the data schema of the selected plurality of data objects and the any connecting data objects that were added as nodes and connecting nodes to the extraction tree to a next level of the extraction tree;enabling a user to add multiple additional levels to the extraction tree, wherein at each new level of the extraction tree the user is able to add both parent and child data objects in the data schema of data objects corresponding to nodes in a previous level of the extraction tree, enabling a user to traverse up and down the hierarchy of the data schema in adding child nodes to the extraction tree;creating an extraction plan based on the extraction tree; andextracting data from the multi-tenant SaaS environment based on the extraction plan.

2. The method of claim 1, wherein, as the user is creating the extraction tree, the system enables the user to set extraction filter criteria for each data object inserted into the extraction tree by the user.

3. The method of claim 2, wherein the extraction filter criteria comprises one or more of: limiting the rows in a data object from which data will be extracted, limiting the fields in the data object from which data will be extracted, and matching the fields and values in the data object.

4. The method of claim 2, wherein the extraction filter criteria comprises skipping specified rows or fields.

5. The method of claim 1, wherein the interface is a graphical user interface.

6. The method of claim 1, wherein the interface is an application programming interface (API).

7. A non-transitory computer-readable medium comprising a computer program, that, when executed by a computer system, enables the computer system to perform the following steps for extracting entity data from a plurality of related data objects from an external multi-tenant software-as-a-service (SaaS) environment, the steps comprising: extracting metadata related to an entity's data records in the external multi-tenant SaaS environment;using the metadata to identify a data schema associated with the entity's data in the multi-tenant SaaS environment, wherein the data schema forms a hierarchy of at least three levels of the entity's data in the multi-tenant SaaS environment;providing an interface for enabling a user to create an extraction tree;creating the extraction tree in the interface by a user viewing data objects in the data schema and selecting a plurality of data objects in the data schema as nodes in the extraction tree, wherein the extraction tree is stored in memory;building the extraction tree by the system automatically inserting any connecting data objects that are in between the selected plurality of data objects in the data schema as connecting nodes in the extraction tree;enabling a user to add any parent and child data objects in the data schema of the selected plurality of data objects and the any connecting data objects that were added as nodes and connecting nodes to the extraction tree to a next level of the extraction tree;enabling a user to add multiple additional levels to the extraction tree, wherein at each new level of the extraction tree the user is able to add both parent and child data objects in the data schema of data objects corresponding to nodes in a previous level of the extraction tree, enabling a user to traverse up and down the hierarchy of the data schema in adding child nodes to the extraction tree;creating an extraction plan based on the extraction tree; andextracting data from the multi-tenant SaaS environment based on the extraction plan.

8. The non-transitory computer-readable medium of claim 7, wherein, as the user is creating the extraction tree, the system enables the user to set extraction filter criteria for each data object inserted into the extraction tree by the user.

9. The non-transitory computer-readable medium of claim 8, wherein the extraction filter criteria comprises one or more of: limiting the rows in a data object from which data will be extracted, limiting the fields in the data object from which data will be extracted, and matching the fields and values in the data object.

10. The non-transitory computer-readable medium of claim 8, wherein the extraction filter criteria comprises skipping specified rows or fields.

11. The non-transitory computer-readable medium of claim 7, wherein the interface is a graphical user interface.

12. The non-transitory computer-readable medium of claim 7, wherein the interface is an application programming interface (API).

13. A computer system for extracting entity data from a plurality of related data objects from an external multi-tenant software-as-a-service (SaaS) environment, the system comprising: one or more processors;one or more memory units coupled to the one or more processors, wherein the one or more memory units store instructions that, when executed by the one or more processors, cause the system to perform the operations of: extracting metadata related to an entity's data records in the external multi-tenant SaaS environment;using the metadata to identify a data schema associated with the entity's data in the multi-tenant SaaS environment, wherein the data schema forms a hierarchy of at least three levels of the entity's data in the multi-tenant SaaS environment;providing an interface for enabling a user to create an extraction tree;creating the extraction tree in the interface by a user viewing data objects in the data schema and selecting a plurality of data objects in the data schema as nodes in the extraction tree, wherein the extraction tree is stored in memory;building the extraction tree by the system automatically inserting any connecting data objects that are in between the selected plurality of data objects in the data schema as connecting nodes in the extraction tree;enabling a user to add any parent and child data objects in the data schema of the selected plurality of data objects and the any connecting data objects that were added as nodes and connecting nodes to the extraction tree to a next level of the extraction tree;enabling a user to add multiple additional levels to the extraction tree, wherein at each new level of the extraction tree the user is able to add both parent and child data objects in the data schema of data objects corresponding to nodes in a previous level of the extraction tree, enabling a user to traverse up and down the hierarchy of the data schema in adding child nodes to the extraction tree;creating an extraction plan based on the extraction tree; andextracting data from the multi-tenant SaaS environment based on the extraction plan.

14. The computer system of claim 13, wherein, as the user is creating the extraction tree, the system enables the user to set extraction filter criteria for each data object inserted into the extraction tree by the user.

15. The computer system of claim 14, wherein the extraction filter criteria comprises one or more of: limiting the rows in a data object from which data will be extracted, limiting the fields in the data object from which data will be extracted, and matching the fields and values in the data object.

16. The computer system of claim 14, wherein the extraction filter criteria comprises skipping specified rows or fields.

17. The computer system of claim 13, wherein the interface is a graphical user interface.

18. The computer system of claim 13, wherein the interface is an application programming interface (API).