Method for analyzing time series activity streams and devices thereof

Information

  • Patent Grant
  • 9965527
  • Patent Number
    9,965,527
  • Date Filed
    Wednesday, April 20, 2016
    8 years ago
  • Date Issued
    Tuesday, May 8, 2018
    6 years ago
Abstract
A method, non-transitory computer readable medium, and data manager computing device comprises retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.
Description
FIELD

This technology generally relates to method for analyzing data and particularly relates to analyzing time series activity streams and devices thereof.


BACKGROUND

The connected world, also referred to as the internet of things, is growing quickly. Analysts have estimated that along with the continued growth of humans using the Internet, the number of connected devices and systems will rise from five billion to one trillion in the next ten years. However, the traditional ways to manage and communicate with these systems has not changed. In other words, all the information from these systems is not accessible or is not able to be correlated in a way that helps people or businesses do their jobs better and more efficiently, find information they are looking for in the proper context, or make this data consumable in a meaningful way.


There are a variety of specific solutions to handle the rising amount of data found in industry today. These solutions can be categorized into the following types of systems: Enterprise Resource Planning (ERP) systems; Portals and related technology systems; Traditional Business Intelligence systems; and Manufacturing Intelligence systems.


Enterprise Resource Planning systems are used by large and small companies to run their businesses. The typical minimal requirements for these systems are to provide financial and accounting services. However, these systems often have additional functionality for specific vertical industries, such as manufacturing, utilities, construction, and retail by way of example. These Enterprise Resource Planning systems are rigid, in both business process support and data models. They also are very expensive to implement and maintain. Further, these systems are usually implemented to enforce repeatable, standard business processes and it generally is not possible to use these systems for dynamic analysis of different types of data.


Traditional Business Intelligence systems usually rely on specific, detailed data models, such as data warehouses. While the data is typically current, for example about a day old, in these systems, the models are rigid and report writing may require Information Technology (IT) skills. While these systems have become much better at providing users with the ability to self-serve, the self service capability is restricted to the previously designed semantic search models. As a result, these Traditional Business Intelligence systems do not address current conditions, rapidly changing data, third party collaboration, or external data sources.


Manufacturing Intelligence systems (also referred to as Enterprise Manufacturing Intelligence or EMI) are typically concerned with real-time data collected from machines and devices. This time series data usually does not have any business context associated with it. The users of these Manufacturing Intelligence systems typically are plant operators and engineers. These systems do not handle other business related data, do not understand or correlate unstructured data, and are not easily readable.


Currently, most of the utilized solutions to pull all these separate systems with their different sources of data together so users can consume data from more than one of these solutions in a meaningful way, is to execute a complex, multi-year integration project that results in a data mart. Typically, this involves replicating large quantities of data from multiple systems into a rigid model, similar to a hub and spoke model. The hub is the data mart holding all the replicated data. As the systems changes at the end of the spokes, new time consuming integration and modeling is required. Unfortunately, this type of solution is expensive to maintain, the data model and semantics are not dynamic, and the ability to consume data is available only through pre-defined reports.


Other existing approaches to pull all these separate systems with their different sources of data together rely on relational data bases which are adept at answering known questions against known data structures (Known-Known) and can answer known questions against unknown data structures (Known-Unknown). Unfortunately, these existing approaches can not effectively answer unknown questions against known data structure (Unknown-Known), and unknown questions against unknown data structures (Unknown-Unknown).


As a result, currently users of existing technologies to identify and access data are concerned with the timeliness and relevance of acquired data. In particular, there is a concern about deficiencies with accurately identifying and accessing real-time data from devices and other storage systems. Additionally, these existing technologies have difficulties identifying and accessing different types of relevant data, such as business related data which can be stored in many varying formats and unstructured data. Further, these existing technologies typically require large quantities of data from multiple systems to first be entered into a rigid model and then this entered data can only be access in limited manners.


SUMMARY

A method for analyzing a time series activity stream including a data management computing apparatus for retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved by the data management computing apparatus. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data by the data management computing apparatus. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided by the data management computing apparatus.


A non-transitory computer readable medium having stored thereon instructions for analyzing a time series activity stream comprising machine executable code which when executed by at least one processor, causes the processor to perform steps including retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.


A data management computing apparatus comprising one or more processors, a memory coupled to the one or more processors which are configured to execute programmed instructions stored in the memory including retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.


This technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data. With this technology, a wide variety of different types of data, such as business related data, social media data and unstructured data, can be easily identified and accessed. Further, this technology does not require the data to be first loaded into a rigid model which can only be accessed in limited manners.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram of an environment with an exemplary data management computing apparatus for analyzing time series activity steam;



FIG. 2 is a flowchart of an exemplary method for obtaining and tagging time series data;



FIGS. 3A-3B are flowcharts of an exemplary method for analyzing time series activity steam;



FIG. 4 is an exemplary diagram of a method for obtaining and tagging heterogeneous data from multiple sources; and



FIG. 5 is an exemplary illustration of a method for servicing the request from a client computing device.





DETAILED DESCRIPTION

An exemplary environment 10 with a data management computing apparatus 14 that analyzes time series data is illustrated in FIG. 1. In this particular example, the environment 10 includes the data management computing device 14, plurality client computing devices 12, and a plurality of data servers 16, a social network database 17, monitored asset 32 and sensors 34 which are coupled together by the Local Area Network (LAN) 28 and Wide Area Network (WAN) 30, although the environment 10 can include other types and numbers of devices, components, elements and communication networks in other topologies and deployments. While not shown, the exemplary environment 10 may include additional components, such as routers, switches and other devices which are well known to those of ordinary skill in the art and thus will not be described here. This technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data.


Referring more specifically to FIG. 1, the data management computing apparatus 14 provides a number of functions analyzing time series data, although other numbers and types of systems can be used and other numbers and types of functions can be performed. The data management computing apparatus 14 includes at least one processor 18, memory 20, input and display devices 22, and interface device 24 which are coupled together by bus 26, although data management computing apparatus 14 may comprise other types and numbers of elements in other configurations.


Processor(s) 18 may execute one or more computer-executable instructions stored in the memory 20 for the methods illustrated and described with reference to the examples herein, although the processor(s) can execute other types and numbers of instructions and perform other types and numbers of operations. The processor(s) 18 may comprise one or more central processing units (“CPUs”) or general purpose processors with one or more processing cores, such as AMD® processor(s), although other types of processor(s) could be used (e.g., Intel®).


Memory 20 may comprise one or more tangible storage media, such as RAM, ROM, flash memory, CD-ROM, floppy disk, hard disk drive(s), solid state memory, DVD, or other memory storage types or devices, including combinations thereof, which are known to those of ordinary skill in the art. Memory 20 may store one or more non-transitory computer-readable instructions of this technology as illustrated and described with reference to the examples herein that may be executed by the one or more processor(s) 18. The flow chart shown in FIGS. 2 and 3A-3B is representative of example steps or actions of this technology that may be embodied or expressed as one or more non-transitory computer or machine readable instructions stored in memory 20 that may be executed by the processor(s) 18. Additionally, as illustrated in FIGS. 4-5, the memory 20 includes a graph database to which maintains the model relationship and indexes which support rapid retrieval of tag and nodal relationship data.


Input and display devices 22 enable a user, such as an administrator, to interact with the data management computing apparatus 14, such as to input and/or view data and/or to configure, program and/or operate it by way of example only. Input devices may include a touch screen, keyboard and/or a computer mouse and display devices may include a computer monitor, although other types and numbers of input devices and display devices could be used. Additionally, the input and display devices 22 can be used by the user, such as an administrator to develop applications using an application interface.


The interface device 24 in the data management computing apparatus 14 is used to operatively couple and communicate between the data management computing apparatus 14, the client computing devices 12, and the plurality of data servers 16 which are all coupled together by LAN 28 and WAN 30. By way of example only, the interface device 24 can use TCP/IP over Ethernet and industry-standard protocols, including NFS, CIFS, SOAP, XML, LDAP, and SNMP although other types and numbers of communication protocols can be used.


Each of the client computing devices 12 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. Each of the client computing devices 12 communicate with the data management computing apparatus 14 through LAN 28, although each of the client computing devices 12 can interact with the data management computing apparatus 14 in other manners.


Each of the plurality of data servers 16 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. Each of the plurality of data servers 16 enters, updates and/or store content, such as files and directories, although other numbers and types of functions can be implemented and other types and amounts of data could be entered, updated, or stored used. Each of the plurality of data servers 16 may include by way of example only, enterprise resource planning (ERP) systems, portals and related technologies, traditional business intelligence systems and manufacturing intelligence systems.


The social network database 17 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. The social network database 17 includes heterogeneous data entered by users from social network platforms, although the social network database 17 can include any additional information. By way of example only, the contents of the social network database 17 includes information from the users of Wikipedia, blogs which are entered and tagged by the users. As illustrated in FIG. 1, the data management computing apparatus 14 interacts with the social network database via LAN 28, although the data management computing apparatus 14 can interact with the social network database 17 via other network topologies.


The monitored asset 32 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. In this technology, the monitored asset 32 can be an electrical or mechanical devices, machines, or instruments. Additionally, the monitored asset 32 includes sensors 34 which assist with obtaining information from the monitored asset 32 or transmitting data out of the monitored asset 32. Although the sensors 34 has been illustrated in FIG. 1 to be coupled with the monitored asset, as it may be appreciated by a person having ordinary skill in the art, the sensors 34 can exist outside the monitored asset 34 and could be communicably coupled to the monitored asset 34. Further, the data management computing apparatus 14 interacts, obtains data or sends data to the monitored asset 32 or the sensors 34 via LAN 28, although the data management computing apparatus 14 can interact with the monitored asset 32 and the sensors 34 in other manners.


In this technology, sensor 34 is an electro-mechanical device which receives electrical data from the monitored asset 32 and converts the electrical signals to a format which can be read by an observer. By way of example only, sensor 34 can be a pressure sensor, thermal, heat, and/or temperature sensor, although other types and numbers of sensors and other monitors could be used. Accordingly, in this technology, sensors 34 are used by the data management computing apparatus 14 to obtain time series data from the monitored asset 32, although the data management computing apparatus 14 can use the sensors 34 for other additional functions.


Although an exemplary environment 10 with the plurality of client computing devices 12, the data management computing apparatus 14, the plurality of data servers 16, the social network database 17, the monitored asset 32 and sensors 34 are described and illustrated herein, other types and numbers of systems, devices in other topologies can be used. It is to be understood that the systems of the examples described herein are for exemplary purposes, as many variations of the specific hardware and software used to implement the examples are possible, as will be appreciated by those skilled in the relevant art(s).


In addition, two or more computing systems or devices can be substituted for any one of the systems or devices in any example. Accordingly, principles and advantages of distributed processing, such as redundancy and replication also can be implemented, as desired, to increase the robustness and performance of the devices and systems of the examples. The examples may also be implemented on computer system(s) that extend across any suitable network using any suitable interface mechanisms and traffic technologies, including by way of example only tele-traffic in any suitable form (e.g., voice and modem), wireless traffic media, wireless traffic networks, cellular traffic networks, 3G traffic networks, Public Switched Telephone Network (PSTNs), Packet Data Networks (PDNs), the Internet, intranets, and combinations thereof.


Furthermore, each of the systems of the examples may be conveniently implemented using one or more general purpose computer systems, microprocessors, digital signal processors, and micro-controllers, programmed according to the teachings of the examples, as described and illustrated herein, and as will be appreciated by those of ordinary skill in the art.


The examples may also be embodied as a non-transitory computer readable medium having instructions stored thereon for one or more aspects of the technology as described and illustrated by way of the examples herein, which when executed by a processor (or configurable hardware), cause the processor to carry out the steps necessary to implement the methods of the examples, as described and illustrated herein.


An exemplary method for analyzing time series data will now be described with reference to FIGS. 1, 2 and 3A-3B. Particularly with respect to FIGS. 1 and 2, in step 205, the data management computing apparatus 14 receiving the time series data of the monitored asset 32 from the sensors 34 in real time as illustrated in the first step of FIG. 4, although the data management computing apparatus 14 can obtain the time series from the plurality of data servers 16. By way of example only, the time series data can include real time data of monitored asset 32, such as continuous temperature readings or pressure readings, although the time series data can relate to other readings. However, in another example, the data management computing apparatus 14 may periodically obtain the time series data from sensors 34. Additionally, in yet another example, the data management computing apparatus 14 can obtain the time series data in response to a notification received from the sensors 34 when there is an event triggered in the monitored asset 32.


Next, in step 210, the data management computing apparatus 14 embeds tags to the obtained time series obtained in step 105, although the data management computing apparatus 14 can use other techniques to quickly and efficiently identify the time series data. In this example, the data management computing apparatus 14 automatically embeds tags to the time series data based on pre-defined rules. As it would be appreciated by a person having ordinary skill in the art, a tag is a non-hierarchical keyword or term or a metadata assigned to a piece of information. The tag helps describe an item and allows it to be found again by browsing or searching. Additionally, tags are can be customized depending on the system and can be of various types, such as a dynamic tag which can be created by the data management computing apparatus 14 based on the obtained time series data or fixed tags which are created by the data management computing apparatus 14 based on pre-defined vocabulary. By way of example only, the pre-defined rules can relate to embedding tag for a particular type of data, such as embedding “temperature values” as tags for all the time series data obtained from the sensors 34 relating to the temperature values of the monitored asset 32 and/or add the name of the particular component as the tag for all the data obtained from the sensors for particular component of the monitored asset 32, such as “therometer1”.


Optionally, the data management computing apparatus 14 can add metadata, such as the data source, the relationship of the source to the monitored asset 34 and additional context information to the obtained time series data.


In another example of the technology, the data management computing apparatus 14 can obtain the time series data from the sensors 34 and collectively create an activity stream. Additionally, the activity stream can be tagged using techniques illustrated in step 210 and store the activity stream within the memory 20.


In step 215, the data management computing apparatus 14 stores the tagged time series data in memory 20 as illustrated in FIG. 4, although the data management computing apparatus 14 can store the time series data at other memory locations. In this technology, the data management computing apparatus 14 stores the tagged time series data and in the memory 20 and the exact memory location of the tagged time series and the associated memory location is stored in the index table which is also present in the memory 20. By storing the tagged time series data and having an index table, the technology disclosed in this application provided benefits of rapid and accurate retrieval data.


Additionally, in this technology, the data management computing apparatus 14 stores the tagged time series in the memory 20 with time stamp. In this technology, time stamp relates to the information regarding the exact time and date the time series data was obtained in real-time from the sensors 34 and stored. By storing the heterogeneous data and the time series data with time stamp, the technology disclosed in this application provides benefits to further analyze the cause of an anomaly period accurately, although storing with the time stamp may provide other additional benefits.


In step 220, the process of obtaining and storing the time series data ends.


Next, in FIG. 3A, in step 305, the data management computing apparatus 14 receives a request to analyze time series data with a particular tag for a monitored asset 32 via an executing application in client computing device 12 as illustrated in FIG. 5, although the data management computing apparatus 14 may receive other types of requests from the client computing device 12.


In step 310, the data management computing apparatus 14 retrieves the stored time series data in step 115 of FIG. 2 associated with the received tag in response to the received request, although the data management computing apparatus 14 can obtain the stored time series data without using the received tag information. By way of example only, obtains the time series data stored in the step 215 from the memory 20 by referring to the index table and using the tag information present in the received request as illustrated in FIG. 5, although the data management computing apparatus 14 can directly obtain the heterogeneous contextual data from memory 20 without directly referring to the index table stored in memory 20 or without using the tag information received in the request for the time series data. By way of example only, the data management computing apparatus 14 uses the tag information received in the request for the time series data, matches the tag information with the listed tags in the index table and accordingly obtains the time series data from the memory location associated with the tag in the index table. As previously illustrated, the technology disclosed in this application provides advantages by to quickly and effectively obtain the requested data by referring to the index table. However, as illustrated earlier in another example, if the data management computing apparatus 14 obtains all the time series data present within the memory 20 when the data management computing apparatus 14 does not use the received tag to obtain the time series data stored in step 215.


In step 315, the data management computing apparatus 14 determines if there was an anomaly period within the time series data of the monitored asset. If the data management computing apparatus 14 determines there was no observed anomaly period within the time series data, then the No branch is taken to step 317 where the data management computing apparatus 14 provides the requesting client computing device 12 with the obtained time series data and the process flow ends. If the data management computing apparatus 14 determines there was an observed anomaly period within the time series data, then the Yes branch is taken to step 320.


In this example, the data management computing apparatus 14 determines when an anomaly period is observed within the time series data by comparing the time series data of the monitored asset 32 against threshold values for the monitored asset 22, although the data management computing apparatus 14 can determine when an anomaly period is observed in other manners well known to those of ordinary skill in the art, such as monitoring for readings in the time series data which are greater than a standard deviation by way of example.


In step 320, the data management computing apparatus 14 retrieves structured and/or unstructured heterogeneous data using the tag information received in step 305 from the multiple sources, such as plurality of data servers 16, social network database 17 or from sensors 34 as illustrated in FIG. 4 by way of example only, although the data management computing apparatus 14 can obtain structured or unstructured heterogeneous data from other sources. However, in another example, the data management computing apparatus 14 may obtain heterogeneous data associated with tags which are present in the anomaly period. In this technology, the data management computing apparatus 14 obtains the unstructured heterogeneous data relating to the received tag information by crawling to the plurality of data servers 16, although the data management computing apparatus 14 can obtain information relating to the tag information from other sources in other manners. In this technology, the structured or unstructured data relates to environmental data obtained from sensors 34 and business process information from one or more applications on one or more third party computing devices as illustrated in FIG. 4, although the contextual information can relate to other types and amounts of additional information obtained from other sources. For further illustrative purposes, the data management computing apparatus 14 obtains the user entered structured or unstructured data found in wikis, blogs or other social platforms from the social network database 17, although the data management computing apparatus 14 can obtain the user entered data from other sources.


In step 325, the data management computing apparatus 14 provides the obtained time series data and the heterogeneous time series data to the requesting client computing device 12. Additionally, in this technology, while providing the time series data and the heterogeneous data, the data management computing apparatus 14 converts the tagged time series data into a format convenient for viewing in the requesting client computing device 12. By way of example only, formats can be in a PDF, textual format, graphs, charts, tabular columns or an image format, although other formats can be used. Further, in this technology, the data management computing apparatus 14 provides the tagged time series data to the requesting client computing device 12 by embedding the converted time series data and the heterogeneous data within a work-flow of the executing application of the client computing device 12, although the data management computing apparatus 14 can provide the tagged time series data to the requesting client computing device 12 using other methods.


In step 330, the data management computing apparatus 14 receives a request from the client computing device 12 via the executing application for heterogeneous contextual data relating to the anomaly period, although the data management computing apparatus 14 may receive other types of request from the client computing device 12.


In step 335, the data management computing apparatus 14 retrieves the heterogeneous contextual data stored relating to the anomaly period from the plurality of data servers 16, social network database 17 or sensors 34 based on the model relationships in response to the received request, although the data management computing apparatus 14 can obtain the heterogeneous contextual data without a model relationship based on other parameters from other sources. In this technology, the model relationship defines the relationship, hierarchy, data or process flow, and/or interaction of the monitored asset 32 with other related assets. In this technology, the model relationship is present within the memory 20, although the model relationship can be stored at other locations. As it would appreciated by a person having ordinary skill in the art, heterogeneous contextual data in this technology relates to environmental data, such as temperature pressure, operator blog entries, customer order details, although heterogeneous contextual data can include other types and amounts of information.


In step 340, the data management computing apparatus 14 provides the obtained heterogeneous contextual data relating to the anomaly period to the requesting client computing device using techniques illustrated in step 325.


In step 345, the data management computing apparatus 14 receives a request for related heterogeneous asset data relating to the anomaly from the client computing device 12 via the executing application. Additionally, as illustrated in step 240, the data management computing apparatus 14 can receive keywords along with the request for the related heterogeneous asset data.


In step 350, the data management computing apparatus 14 retrieves the related heterogeneous asset data, such as upstream data and/or downstream data based on model relationships and also activities of the other machines associated during the anomaly period from the sensors 34, plurality of data servers 16 as illustrated in FIG. 4, although the data management computing apparatus 14 can obtain the related heterogeneous asset data from other sources in other manners. In this technology, upstream data includes data from related assets (not shown) upstream from the functionality performed by the monitored asset 32 and the downstream data includes data from related assets (not shown) downstream from the functionality performed by the monitored asset 32 during the anomaly period, although the obtained related heterogeneous asset data can also include the upstream and downstream data prior to the anomaly period. Additionally, in this technology, the data management computing apparatus 14 identifies the related assets which are upstream and downstream from the monitored asset based on the model relationship for the monitored asset 32 which explains the relationship hierarchy or flow between the monitored asset and related assets.


In step 355, the data management computing apparatus 14 provides the obtained related heterogeneous asset data to the requesting client computing device 12 using techniques illustrated in step 325.


Next, in step 360 the data management computing apparatus 14 identifies a cause of the anomaly period in the time series data from the monitored asset based on the time series data, the heterogeneous data, the heterogeneous contextual data, and the related heterogeneous asset data, although the data management computing apparatus 14 can determine the actual cause of anomaly using other techniques. In this technology, the time series, the heterogeneous data, the heterogeneous contextual data and the related heterogeneous asset data collectively provides an accurate cause of the anomaly period as one of the retrieved heterogeneous information independently may not provide the complete or accurate cause of the anomaly period.


Upon identifying the cause of anomaly, in step 365 the data management computing apparatus 14 identifies and provides corrective step(s) to the requesting client computing device 12 obtained by correlating the identified cause against a table of stored corrective step(s) to fix the cause of the anomaly period, although other manners identifying and providing corrective step(s) can be used. For example, the opinions from technical experts, suggestions from the manufacturer or comments present in blogs and other social media relating to the monitored asset mined from one or more of the plurality of data servers 16 and or the social network database 17 can be used. Additionally, the data management computing apparatus 14 may also direct the requesting client computing device 12 to a website or a technical expert who could further assist with preventing the anomaly period. In step 380, this exemplary method ends.


An example illustrating the methods for analyzing time series data is explained as follows. In this example, the data management computing apparatus 14 had captured the time series data of the electric car, such as car identification number, time started, time completed, level of charge to start, level of charge when completed from the sensors 34 when an electric car was being charged and stored the time series of the car using the date on which the car was charged and the name of the car within the memory 20.


The data management computing apparatus 14 computing apparatus 14 retrieves the stored time series data of the electric car using the tags of the date of charge and the name of the car.


Further, the data management computing apparatus 14 identifies anomaly in the obtained time series data, which in this case is the requirement for the car to be charged earlier than expected. For further illustrative purpose, the standard time for next battery recharge of the car was 48 hours, however, in this example the car is back for charging within 36 hours which means that the car has to be charged 12 hours earlier than the standard time. However, in this technology the data management computing apparatus 14 cannot accurately identify the cause for the electric car to be charged earlier than expected as the time series data obtained from the sensors 34 as the time series data of the car does not show any battery degradation.


Accordingly for further investigative purposes, the data management computing apparatus 14 obtains heterogeneous data from plurality of data servers 17 and the social network database 17, such as the driver internal blogs which indicate that the driver was behind on his delivery schedule for the day he charged the vehicle.


Next, the data management computing apparatus 14 retrieves the contextual data, such as the ambient temperature, from another heterogeneous data source based on the model relationship and determines the ambient temperature was above a stored threshold after the car was charged. The data management computing apparatus 14 retrieves other contextual data which indicates that ambient temperatures above that threshold lead to a shorter battery life.


Additionally, the data management computing apparatus 14 retrieves other heterogeneous business related blog data, such as information noted in a driver log data which indicated the driver was scheduled to visit an especially difficult customer and that the customer may lodge a complaint if the driver was late for delivery and this caused the driver to exceed speed recommendations, using more energy of the battery than normal.


Based on car battery information, the driver's internal blog, the ambient temperature and the driver log data, the data management computing apparatus 14 identifies the actual cause of the early recharge of the car to be negligence of the driver. Accordingly, the data management computing apparatus 14 provides improvement steps indicating that the driver may need to be reminded of proper hours and vehicle use and also indicates that the battery is in good condition and does not require any servicing.


Accordingly, as illustrated and described with the examples herein this technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data. With this technology, a wide variety of different types of data, such as business related data, social media data and unstructured data, can be easily identified and accessed. Further, this technology does not require the data to be first loaded into a rigid model which can only be accessed in limited manners.


Having thus described the basic concept of this technology, it will be rather apparent to those skilled in the art that the foregoing detailed disclosure is intended to be presented by way of example only, and is not limiting. Various alterations, improvements, and modifications will occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested hereby, and are within the spirit and scope of this technology. Additionally, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes to any order except as may be specified in the claims. Accordingly, this technology is limited only by the following claims and equivalents thereto.

Claims
  • 1. A method of operating a data management computing device for analyzing, time series data, the method comprising: providing access to a collection of time series data and a collection of heterogeneous data, both of which are accessible to the data management computing device and are associated with a plurality of monitored assets, wherein the collection of time series data comprises a plurality of sets of time series data, wherein each set of time series data comprises one or more obtained readings collected from one or more sensors of a given monitored asset of the plurality of monitored assets, wherein each set of time series data of the collection of time series data is associated with one or more tags, including a tag indicative of when the set of time series data of the collection was created by the one or more sensors, and wherein the collection of heterogeneous data is originated from a plurality of sources of different types;providing a model defining a hierarchical relationship among related monitored assets of the plurality of monitored assets;responsive to receipt of a single search request, the search request comprising a keyword: i) retrieving, by a processor of the data management computing device, from the collection of time series data, a first result based on one or more sets of time series data associated with a first monitored asset and associated with a tag matched to at least a portion of the keyword;ii) retrieving, by the processor of the data management computer device, from the collection of heterogeneous data, a second result based on a first set of heterogeneous data associated with the first monitored asset; andiii) retrieving, by the processor of the data management computing device, from the collection of heterogeneous data, a third result based on a second set of heterogeneous data associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets;aggregating, by the processor of the data management computing device, into a single result set, the first result based on the retrieved time series data, the second result based on the first set of heterogeneous data, and the third result based on the second set of heterogeneous data; andcausing, by the processor of the data management computing device, the result set to be displayed and/or stored in memory.
  • 2. The method of claim 1, wherein the first set of heterogeneous data is selected from the group consisting of: environmental data from one or more environmental sensors, business process information from one or more applications on one or more third party computing devices, and human entered data from one or more blogs or social media systems; andwherein the second set of heterogeneous data is selected from the group consisting of: upstream heterogeneous data from an upstream source within an industrial process, and downstream heterogeneous data from a downstream source within the industrial process.
  • 3. The method of claim 1, further comprising: receiving, by the data management computing device, time series data for the first monitored asset from one or more sensors associated therewith; andembedding, by the data management computing device, one or more contextual tags in the time series data for the first monitored asset based on one or more stored rules of the data management computing device.
  • 4. The method of claim 1, further comprising: automatically embedding tags to the time series data.
  • 5. The method of claim 1, wherein each of the collection of time series data and a collection of heterogeneous data are stored in one or more indexed tables.
  • 6. The method of claim 1, wherein the collection of heterogeneous data is selected from the group consisting of: one or more of unstructured data from one or more unstructured data sources, structured data from one or more structured data sources, and crawled data from one or more third party application and index data sources.
  • 7. The method of claim 1, wherein the collection of time series data and the collection of heterogeneous data are stored on one or more types of systems selected from the group consisting of: an enterprise resource planning (ERP) system, a business intelligence system, and a manufacturing intelligence system.
  • 8. A non-transitory computer readable medium having stored thereon instructions for analyzing time series data, the instructions comprising machine executable code, which when executed by one or more processors, cause the one or more processors to: access a collection of time series data and a collection of heterogeneous data, both of which are associated with a plurality of monitored assets, wherein the collection of time series data comprises a plurality of sets of time series data, wherein each set of time series data comprises one or more obtained readings collected from one or more sensors of a given monitored asset of the plurality of monitored assets, wherein each set of time series data of the collection of time series data is associated with one or more tags, including a tag indicative of when the set of time series data of the collection was created by the one or more sensors, and wherein the heterogeneous data is originated from a plurality of sources of different types;provide a model defining a hierarchical relationship among related monitored assets of the plurality of monitored assets;responsive to receipt of a single search request, the search request comprising a keyword: i) retrieve, from the collection of time series data, a first result based on sets of one or more time series data associated with the first monitored asset and associated with a tag matched to at least a portion of the keyword;ii) retrieve from the collection of heterogeneous data, a second result based on a first set of heterogeneous data associated with the first monitored asset; andiii) retrieve, from the collection of heterogeneous data, a third result based on a second set of heterogeneous data associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets; andaggregate into a single result set, the first result based on the retrieved time series data, the second result based on the first set of heterogeneous data, and third result based on the second set of heterogeneous data and cause the result set to be displayed and/or stored in the memory.
  • 9. The computer readable medium of claim 8, wherein the first set of heterogeneous data is selected from the group consisting of: environmental data from one or more environmental sensors, business process information from one or more applications on one or more third party computing devices, and human entered data from one or more blogs or social media systems; andwherein the second set of heterogeneous data is selected from the group consisting of: upstream heterogeneous data from an upstream source and downstream heterogeneous data from a downstream source of the industrial process.
  • 10. The computer readable medium of claim 8, wherein the instructions, when executed, further causes the processor to: receive the time series data from the first monitored asset; andembed the one or more tags into the time series data based on one or more rules stored in the memory.
  • 11. The computer readable medium of claim 8, wherein the time series data are automatically embedded with the one or more tags.
  • 12. The computer readable medium of claim 8, wherein each of the collection of time series data and a collection of heterogeneous data are stored in one or more indexed tables.
  • 13. The computer readable medium of claim 8, wherein the first set of heterogeneous data is selected from the group consisting of: unstructured data from one or more unstructured data sources, structured data from one or more structured data sources, and crawled data from one or more third party application and index data sources.
  • 14. A data management computing apparatus comprising: one or more processors;a memory coupled to the one or more processors, the memory having instructions stored thereon, the instructions when executed by the one or more processors, causing the one or more processors to:access a collection of time series data and a collection of heterogeneous data, both of which are associated with a plurality of monitored assets, wherein the collection of time series data comprises a plurality of sets of time series data, wherein each set of time series data comprises one or more obtained readings collected from one or more sensors of a given monitored asset of the plurality of monitored assets, wherein each set of time series data of the collection of time series data is associated with one or more tags, including a tag indicative of when the set of time series data of the collection was created by the one or more sensors, and wherein the collection of heterogeneous data is originated from a plurality of sources of different types;provide a model defining a hierarchical relationship among related monitored assets of the plurality of monitored assets;responsive to receipt of search request comprising a keyword: i) retrieve from the collection of time series data, a first result based on a set of time series data associated with a first monitored asset and associated with a tag matched to at least a portion of the keyword;ii) retrieve, from the collection of heterogeneous data, a second result based on a first set of heterogeneous data associated with the first monitored asset; andiii) retrieve, from the collection of heterogeneous data, a third result based on a second set of heterogeneous data associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets;aggregate into a single result set, the first result based on the retrieved time series data, the second result based on the first set of heterogeneous data, and the third result based on the second set of heterogeneous data; andcause the result set to be displayed and/or stored in the memory.
  • 15. The apparatus of claim 14, wherein the first set of heterogeneous data is selected from the group consisting of: environmental data from one or more environmental sensors, business process information from one or more applications on one or more third party computing devices, and human entered data from one or more blogs or social media systems; andwherein second set of heterogeneous data comprises at least one of upstream heterogeneous data from an upstream source within an industrial process or downstream heterogeneous data from a downstream source within the industrial process.
  • 16. The apparatus of claim 14, wherein the instructions when executed by the one or more processors, further cause the one or more processors to: receive the time series data from the first monitored asset; andembed one or more tags into the time series data based on one or more rules stored in the memory.
  • 17. The apparatus of claim 14, wherein the time series data are automatically embedded with the one or more tags.
  • 18. The apparatus of claim 14, wherein each of the collection of time series data and a collection of heterogeneous data are stored in one or more indexed tables.
  • 19. The apparatus of claim 14, wherein the first set of heterogeneous data comprises is selected from the group consisting of: unstructured data from one or more unstructured data sources, a structured data from one or more structured data sources, and crawled data from one or more third party application and index data sources.
  • 20. The apparatus of claim 14, wherein the collection of time series data and the collection of heterogeneous data are stored on one or more types of systems selected from the group consisting of: an enterprise resource planning (ERP) system, a business intelligence system, and a manufacturing intelligence system.
Parent Case Info

This application is a continuation of, and claims priority to and the benefit of, U.S. patent application Ser. No. 14/563,191, filed Dec. 8, 2014, now issued as U.S. Pat. No. 9,348,943, which is a continuation of U.S. patent application Ser. No. 13/678,809, filed Nov. 11, 2012 and issued as U.S. Pat. No. 8,909,641, which claims the benefit of U.S. Provisional Application No. 61/560,390, filed Nov. 16, 2011. The entire contents of each of these applications are incorporated by reference herein in its entirety.

US Referenced Citations (408)
Number Name Date Kind
3656112 Paull Apr 1972 A
3916412 Amoroso, Jr. Oct 1975 A
3983484 Hodama Sep 1976 A
4063173 Nelson et al. Dec 1977 A
4103250 Jackson Jul 1978 A
4134068 Richardson Jan 1979 A
4216546 Litt Aug 1980 A
4554668 Deman et al. Nov 1985 A
4601059 Gammenthaler Jul 1986 A
4680582 Mejia Jul 1987 A
4704585 Lind Nov 1987 A
4887204 Johnson et al. Dec 1989 A
4979170 Gilhousen et al. Dec 1990 A
5113416 Lindell May 1992 A
5134615 Freeburg et al. Jul 1992 A
5159704 Pirolli et al. Oct 1992 A
5276703 Budin et al. Jan 1994 A
5361401 Pirillo Nov 1994 A
5422889 Sevenhans et al. Jun 1995 A
5454010 Leveque Sep 1995 A
5479441 Tymes et al. Dec 1995 A
5493671 Pitt et al. Feb 1996 A
5515365 Sumner et al. May 1996 A
5734966 Farrer et al. Mar 1998 A
5737609 Reed et al. Apr 1998 A
5805442 Crater et al. Sep 1998 A
5892962 Cloutier Apr 1999 A
5909640 Farrer et al. Jun 1999 A
5925100 Drewry et al. Jul 1999 A
6169992 Beall et al. Jan 2001 B1
6182252 Wong et al. Jan 2001 B1
6198480 Cotugno et al. Mar 2001 B1
6377162 Delestienne et al. Apr 2002 B1
6430602 Kav et al. Aug 2002 B1
6473788 Kim et al. Oct 2002 B1
6510350 Steen et al. Jan 2003 B1
6553405 Desrochers Apr 2003 B1
6570867 Robinson et al. May 2003 B1
6618709 Sneerinqer Sep 2003 B1
6675193 Slavin et al. Jan 2004 B1
6757714 Hansen Jun 2004 B1
6766361 Veniaalla Jul 2004 B1
6797921 Niedereder et al. Sep 2004 B1
6810522 Cook et al. Oct 2004 B2
6813587 McIntvre et al. Nov 2004 B2
6850255 Muschetto Feb 2005 B2
6859757 Muehl et al. Feb 2005 B2
6915330 Hardy et al. Jul 2005 B2
6980558 Aramoto Dec 2005 B2
6993555 Kay et al. Jan 2006 B2
7031520 Tunney Apr 2006 B2
7046134 Hansen May 2006 B2
7047159 Muehl et al. May 2006 B2
7054922 Kinney et al. May 2006 B2
7082383 Baust et al. Jul 2006 B2
7082460 Hansen et al. Jul 2006 B2
7117239 Hansen Oct 2006 B1
7149792 Hansen et al. Dec 2006 B1
7178149 Hansen Feb 2007 B2
7185014 Hansen Feb 2007 B1
7250862 Bornhoevd et al. Jul 2007 B2
7254601 Baller et al. Aug 2007 B2
7269732 Kilian-Kehr Sep 2007 B2
7310590 Bansal Dec 2007 B1
7341197 Muehl et al. Mar 2008 B2
7380236 Hawley May 2008 B2
7496911 Rowley et al. Feb 2009 B2
7529570 Shirota May 2009 B2
7529750 Bair May 2009 B2
7536673 Brendle et al. May 2009 B2
7555355 Meyer Jun 2009 B2
7566005 Heusermann et al. Jul 2009 B2
7570755 Williams et al. Aug 2009 B2
7587251 Hopsecqer Sep 2009 B2
7591006 Werner Sep 2009 B2
7593917 Werner Sep 2009 B2
7613290 Williams et al. Nov 2009 B2
7616642 Anke et al. Nov 2009 B2
7617198 Durvasula Nov 2009 B2
7624092 Lieske et al. Nov 2009 B2
7624371 Kulkarni et al. Nov 2009 B2
7644120 Todorov et al. Jan 2010 B2
7644129 Videlov Jan 2010 B2
7647407 Omshehe et al. Jan 2010 B2
7650607 Resnick et al. Jan 2010 B2
7653902 Bozak et al. Jan 2010 B2
7673141 Kilian-Kehr et al. Mar 2010 B2
7684621 Tunney Mar 2010 B2
7703024 Kautzleben et al. Apr 2010 B2
7707550 Resnick et al. Apr 2010 B2
7725815 Peters May 2010 B2
7728838 Forney et al. Jun 2010 B2
7730498 Resnick et al. Jun 2010 B2
7743015 Schmitt Jun 2010 B2
7743155 Pisharody et al. Jun 2010 B2
7752335 Boxenhorn Jul 2010 B2
7757234 Krebs Jul 2010 B2
7761354 Kling et al. Jul 2010 B2
7774369 HerzoQ et al. Aug 2010 B2
7779089 Hessmer et al. Aug 2010 B2
7779383 Bornhoevd et al. Aug 2010 B2
7783984 Roediger et al. Aug 2010 B2
7802238 Clinton Sep 2010 B2
7814044 Schwerk Oct 2010 B2
7814208 Stephenson et al. Oct 2010 B2
7817039 Bornhoevd et al. Oct 2010 B2
7827169 Enenkiel Nov 2010 B2
7831600 Kilian Nov 2010 B2
7840701 Hsu et al. Nov 2010 B2
7852861 Wu et al. Dec 2010 B2
7853241 Harrison Dec 2010 B1
7853924 Curran Dec 2010 B2
7860968 Bornhoevd et al. Dec 2010 B2
7865442 Sowell Jan 2011 B1
7865731 Kilian-Kehr Jan 2011 B2
7865939 Schuster Jan 2011 B2
7873666 Sauermann Jan 2011 B2
7882148 Werner et al. Feb 2011 B2
7886278 Stulski Feb 2011 B2
7890388 Mariotti Feb 2011 B2
7890568 Belenki Feb 2011 B2
7895115 Bayyapu et al. Feb 2011 B2
7899777 Baier et al. Mar 2011 B2
7899803 Cotter et al. Mar 2011 B2
7908278 Akkiraiu et al. Mar 2011 B2
7917629 Werner Mar 2011 B2
7921137 Lieske et al. Apr 2011 B2
7921686 Baqepalli et al. Apr 2011 B2
7925979 Forney et al. Apr 2011 B2
7937370 Hansen May 2011 B2
7937408 Stuhec May 2011 B2
7945691 Dharamshi May 2011 B2
7953219 Freedman et al. May 2011 B2
7954107 Mao et al. May 2011 B2
7954115 Gisolfi May 2011 B2
7966418 Shedrinsky Jun 2011 B2
7975024 Nudler Jul 2011 B2
7987176 Latzina et al. Jul 2011 B2
7987193 Ganaoam et al. Jul 2011 B2
7992200 Kuehr-Mclaren et al. Aug 2011 B2
8000991 Montaqut Aug 2011 B2
8005879 Bornhoevd et al. Aug 2011 B2
8024218 Kumar et al. Sep 2011 B2
8024743 Werner Sep 2011 B2
8051045 Vogler Nov 2011 B2
8055758 Hansen Nov 2011 B2
8055787 Victor et al. Nov 2011 B2
8060886 Hansen Nov 2011 B2
8065397 Taylor et al. Nov 2011 B2
8069362 Gebhart et al. Nov 2011 B2
8073331 Mazed Dec 2011 B1
8074215 Cohen et al. Dec 2011 B2
8081584 Thibault et al. Dec 2011 B2
8082322 Pascarella et al. Dec 2011 B1
8090452 Johnson et al. Jan 2012 B2
8090552 Henry et al. Jan 2012 B2
8095632 Hessmer et al. Jan 2012 B2
8108543 Hansen Jan 2012 B2
8126903 Lehmann et al. Feb 2012 B2
8127237 Berinqer Feb 2012 B2
8131694 Bender et al. Mar 2012 B2
8131838 Bornhoevd et al. Mar 2012 B2
8136034 Stanton et al. Mar 2012 B2
8145468 Fritzsche et al. Mar 2012 B2
8145681 Macaleer et al. Mar 2012 B2
8151257 Zachmann Apr 2012 B2
8156117 Krvlov et al. Apr 2012 B2
8156208 Bornhoevd et al. Apr 2012 B2
8156473 Heidasch Apr 2012 B2
8183995 Wanq et al. May 2012 B2
8190708 Short et al. May 2012 B1
8229944 Latzina et al. Jul 2012 B2
8230333 Decherd et al. Jul 2012 B2
8249906 Ponce de Leon Aug 2012 B2
8250169 Berinqer et al. Aug 2012 B2
8254249 Wen et al. Aug 2012 B2
8261193 Alur et al. Sep 2012 B1
8271935 Lewis Sep 2012 B2
8280009 Stepanian Oct 2012 B2
8284033 Moran Oct 2012 B2
8285807 Slavin et al. Oct 2012 B2
8291039 Shedrinskv Oct 2012 B2
8291475 Jackson et al. Oct 2012 B2
8296198 Bhatt et al. Oct 2012 B2
8296266 Lehmann et al. Oct 2012 B2
8296413 Bornhoevd et al. Oct 2012 B2
8301770 van Coppenolle et al. Oct 2012 B2
8306635 Pryor Nov 2012 B2
8312383 Gilfix Nov 2012 B2
8321790 Sherrill et al. Nov 2012 B2
8321792 Alur et al. Nov 2012 B1
8331855 Williams et al. Dec 2012 B2
8346520 Lu et al. Jan 2013 B2
8359116 Manthey Jan 2013 B2
8364300 Pouyez et al. Jan 2013 B2
8370479 Hart et al. Feb 2013 B2
8370826 Johnson et al. Feb 2013 B2
8375292 Coffman et al. Feb 2013 B2
8375362 Brette et al. Feb 2013 B1
8392116 Lehmann et al. Mar 2013 B2
8392561 Dyer et al. Mar 2013 B1
8396929 Helfman et al. Mar 2013 B2
8397056 Malks et al. Mar 2013 B1
8406119 Taylor et al. Mar 2013 B2
8412579 Gonzalez Apr 2013 B2
8417764 Fletcher et al. Apr 2013 B2
8417854 Weng et al. Apr 2013 B2
8423418 Hald et al. Apr 2013 B2
8424058 Vinoqradov et al. Apr 2013 B2
8433664 Ziegler et al. Apr 2013 B2
8433815 van Coppenolle et al. Apr 2013 B2
8438132 Dziuk et al. May 2013 B1
8442933 Baier et al. May 2013 B2
8442999 Gorelik et al. May 2013 B2
8443069 Baqepalli et al. May 2013 B2
8443071 Lu et al. May 2013 B2
8457996 Winkler et al. Jun 2013 B2
8458189 Ludwig et al. Jun 2013 B1
8458315 Miehe et al. Jun 2013 B2
8458596 Malks et al. Jun 2013 B1
8458600 Dheap et al. Jun 2013 B2
8473317 Santoso et al. Jun 2013 B2
8478861 Taylor et al. Jul 2013 B2
8484156 Hancsarik et al. Jul 2013 B2
8489527 van Coppenolle et al. Jul 2013 B2
8490047 Petschnigg et al. Jul 2013 B2
8490876 Tan et al. Jul 2013 B2
8495072 Kapoor et al. Jul 2013 B1
8495511 Redpath Jul 2013 B2
8495683 van Coppenolle et al. Jul 2013 B2
8516296 Mendu Aug 2013 B2
8516383 Bryant et al. Aug 2013 B2
8521621 Hetzer et al. Aug 2013 B1
8522217 Dutta et al. Aug 2013 B2
8522341 Nochta et al. Aug 2013 B2
8532008 Das et al. Sep 2013 B2
8533660 Mehr et al. Sep 2013 B2
8538799 Haller et al. Sep 2013 B2
8543568 Wagenblatt Sep 2013 B2
8547838 Lee et al. Oct 2013 B2
8549157 Schnellbaecher Oct 2013 B2
8555248 Brunswig et al. Oct 2013 B2
8560636 Kieselbach Oct 2013 B2
8560713 Moreira Sa de Souza et al. Oct 2013 B2
8566193 Singh et al. Oct 2013 B2
8571908 Li et al. Oct 2013 B2
8572107 Fan et al. Oct 2013 B2
8577904 Marston Nov 2013 B2
8578059 Odayappan et al. Nov 2013 B2
8578328 Kamiyama et al. Nov 2013 B2
8578330 Dreilinq et al. Nov 2013 B2
8584082 Baird et al. Nov 2013 B2
8588765 Harrison Nov 2013 B1
8594023 He et al. Nov 2013 B2
8635254 Harvey et al. Jan 2014 B2
8689181 Biron, III Apr 2014 B2
8752074 Hansen Jun 2014 B2
8762497 Hansen Jun 2014 B2
8769095 Hart et al. Jul 2014 B2
8788632 Tavlor et al. Jul 2014 B2
8898294 Hansen Nov 2014 B2
9002980 Shedrinsky Apr 2015 B2
20020099454 Gerrity Jul 2002 A1
20020138596 Darwin et al. Sep 2002 A1
20030093710 Hashimoto et al. May 2003 A1
20030117280 Prehn Jun 2003 A1
20040027376 Calder et al. Feb 2004 A1
20040133635 Spriestersbach et al. Jul 2004 A1
20040158455 Spivack et al. Aug 2004 A1
20040158629 Herbeck et al. Aug 2004 A1
20040177124 Hansen Sep 2004 A1
20050015369 Styles et al. Jan 2005 A1
20050021506 Sauermann et al. Jan 2005 A1
20050027675 Schmitt et al. Feb 2005 A1
20050060186 Blowers et al. Mar 2005 A1
20050102362 Price et al. May 2005 A1
20050198137 Pavlik et al. Sep 2005 A1
20050213563 Shaffer et al. Sep 2005 A1
20050240427 Crichlow Oct 2005 A1
20050289154 Weiss et al. Dec 2005 A1
20060053123 Ide Mar 2006 A1
20060186986 Ma et al. Aug 2006 A1
20060208871 Hansen Sep 2006 A1
20070005736 Hansen et al. Jan 2007 A1
20070016557 Moore et al. Jan 2007 A1
20070027854 Rao et al. Feb 2007 A1
20070027914 Agiwal Feb 2007 A1
20070162486 Brueaaemann et al. Jul 2007 A1
20070174158 Bredehoeft et al. Jul 2007 A1
20070260593 Delvat Nov 2007 A1
20070266384 Labrou et al. Nov 2007 A1
20070300172 Runge et al. Dec 2007 A1
20080010330 Ide Jan 2008 A1
20080086451 Torres et al. Apr 2008 A1
20080098085 Krane et al. Apr 2008 A1
20080172632 Stambauah Jul 2008 A1
20080208890 Milam Aug 2008 A1
20080222599 Nathan et al. Sep 2008 A1
20080231414 Canosa Sep 2008 A1
20080244594 Chen et al. Oct 2008 A1
20080255782 Bilac et al. Oct 2008 A1
20080319947 Latzina et al. Dec 2008 A1
20090006391 Ram Jan 2009 A1
20090150431 Schmidt et al. Jun 2009 A1
20090193148 Jung et al. Jul 2009 A1
20090259442 Gandikota et al. Oct 2009 A1
20090265760 Zhu et al. Oct 2009 A1
20090299990 Setlur et al. Dec 2009 A1
20090300060 BerinQer et al. Dec 2009 A1
20090300417 Bonissone Dec 2009 A1
20090319518 Koudas et al. Dec 2009 A1
20090327337 Lee et al. Dec 2009 A1
20100017379 Naibo et al. Jan 2010 A1
20100017419 Francis Jan 2010 A1
20100064277 Baird et al. Mar 2010 A1
20100077001 VoQel et al. Mar 2010 A1
20100094843 Gras Apr 2010 A1
20100125584 Navas May 2010 A1
20100125826 Rice et al. May 2010 A1
20100250440 Wanq et al. Sep 2010 A1
20100257242 Morris Oct 2010 A1
20100286937 Hedley et al. Nov 2010 A1
20100287075 Herzoa et al. Nov 2010 A1
20100293360 Schoop et al. Nov 2010 A1
20100325132 Liu Dec 2010 A1
20110035188 Martinez-Heras et al. Feb 2011 A1
20110078599 Guertler et al. Mar 2011 A1
20110078600 Guertler et al. Mar 2011 A1
20110099190 Kreibe Apr 2011 A1
20110137883 Laqad et al. Jun 2011 A1
20110138354 Hertenstein et al. Jun 2011 A1
20110145712 Pontier et al. Jun 2011 A1
20110145933 Gambhir et al. Jun 2011 A1
20110153505 Brunswig et al. Jun 2011 A1
20110154226 Guertler et al. Jun 2011 A1
20110161409 Nair et al. Jun 2011 A1
20110173203 Jung et al. Jul 2011 A1
20110173220 Jung et al. Jul 2011 A1
20110173264 Kelly Jul 2011 A1
20110208788 Heller et al. Aug 2011 A1
20110209069 Mohler Aug 2011 A1
20110219327 Middleton, Jr. Sep 2011 A1
20110231592 Bleier et al. Sep 2011 A1
20110276360 Barth et al. Nov 2011 A1
20110307295 Steiert et al. Dec 2011 A1
20110307363 N et al. Dec 2011 A1
20110307405 Hammer et al. Dec 2011 A1
20110320525 Aqarwal et al. Dec 2011 A1
20120005577 Chakra et al. Jan 2012 A1
20120059856 Kreibe et al. Mar 2012 A1
20120072435 Han Mar 2012 A1
20120072885 Taragin et al. Mar 2012 A1
20120078959 Cho et al. Mar 2012 A1
20120096429 Desai et al. Apr 2012 A1
20120117051 Liu et al. May 2012 A1
20120131473 Biron, III May 2012 A1
20120136649 Freising et al. May 2012 A1
20120143970 Hansen Jun 2012 A1
20120144370 Kemmler et al. Jun 2012 A1
20120150859 Hu Jun 2012 A1
20120158914 Hansen Jun 2012 A1
20120166319 Deledda et al. Jun 2012 A1
20120167006 Tillert et al. Jun 2012 A1
20120173671 Callaghan et al. Jul 2012 A1
20120197488 Lee et al. Aug 2012 A1
20120197852 Dutta et al. Aug 2012 A1
20120197856 Banka et al. Aug 2012 A1
20120197898 Pandey et al. Aug 2012 A1
20120197911 Banka et al. Aug 2012 A1
20120239381 Heidasch Sep 2012 A1
20120239606 Heidasch Sep 2012 A1
20120254825 Sharma et al. Oct 2012 A1
20120259932 Kang et al. Oct 2012 A1
20120284259 Jehuda Nov 2012 A1
20120311501 Nonez et al. Dec 2012 A1
20120311526 DeAnna et al. Dec 2012 A1
20120311547 DeAnna et al. Dec 2012 A1
20120324066 Alam et al. Dec 2012 A1
20130006400 Caceres et al. Jan 2013 A1
20130036137 Ollis et al. Feb 2013 A1
20130054563 Heidasch Feb 2013 A1
20130060791 Szalwinski et al. Mar 2013 A1
20130067031 Shedrinsky Mar 2013 A1
20130067302 Chen et al. Mar 2013 A1
20130073969 Blank et al. Mar 2013 A1
20130080898 Lavian et al. Mar 2013 A1
20130110496 Heidasch May 2013 A1
20130110861 Rov et al. May 2013 A1
20130124505 Bullotta et al. May 2013 A1
20130124616 Bullotta et al. May 2013 A1
20130125053 Brunswig et al. May 2013 A1
20130132385 Bullotta et al. May 2013 A1
20130166563 Mueller et al. Jun 2013 A1
20130166569 Navas Jun 2013 A1
20130173062 Koenia-Richardson Jul 2013 A1
20130179565 Hart et al. Jul 2013 A1
20130185593 Taylor et al. Jul 2013 A1
20130185786 Dyer et al. Jul 2013 A1
20130191767 Peters et al. Jul 2013 A1
20130207980 Ankisettipalli et al. Aug 2013 A1
20130211555 Lawson et al. Aug 2013 A1
20130246897 O'Donnell Sep 2013 A1
20130262641 Zur et al. Oct 2013 A1
20130275344 Heidasch Oct 2013 A1
20130275550 Lee et al. Oct 2013 A1
20130304581 Soroca et al. Nov 2013 A1
20140019432 Lunenfeld Jan 2014 A1
20140282370 Schaefer et al. Sep 2014 A1
Foreign Referenced Citations (6)
Number Date Country
0497010 Aug 1992 EP
1187015 Mar 2002 EP
WO-9921152 Apr 1999 WO
WO-0077592 Dec 2000 WO
WO-2008115995 Sep 2008 WO
WO-2014145084 Sep 2014 WO
Non-Patent Literature Citations (3)
Entry
Shi, L. et al., Understanding Text Corpora with Multiple Facets, IEEE Symposium on Visual Analytics Science and Technoloav (VAST), 99-106 (2010).
Hart Server, retrieved from 2001 internet archive of hartcomm.org http://www.hartcomm.org/server2/index.html, 13 pages (2001).
Ray, Erik T., Learning XML, First Edition, 277 pages (2001).
Related Publications (1)
Number Date Country
20170017698 A1 Jan 2017 US
Provisional Applications (1)
Number Date Country
61560390 Nov 2011 US
Continuations (2)
Number Date Country
Parent 14563191 Dec 2014 US
Child 15133703 US
Parent 13678809 Nov 2012 US
Child 14563191 US