Patent Application
20240231909
Priority is claimed in the application data sheet to the following patents or patent applications, each of which is expressly incorporated herein by reference in its entirety:
The disclosure relates to the field of computer databases, and more particularly to the field of use of database registries containing provenance-related and ontologically-related metadata.
A major drawback of existing databases and registries is their inability to use database resources across domains, persistence paradigms, or outside of the use cases for which the resources were originally created. This prevents sharing of resources by other systems or users, or even identification of resources that might be useful because they were created for a different domain or use case. Another major drawback is the lack of provenance information for data in databases, which prevents the ability to validate or contextualize the data for suitability in a given situation. Further, existing databases and registries do not include data processing workflows and algorithms as part of their set of resources, thus failing to sufficiently universalize data and the computing resources and services that process those data.
What is needed is a system and method for unified contextualization of computing assets that allows for sharing of assets between systems and outside of the use case for which the resources were created.
Accordingly, the inventor has developed a system and method for unified contextualization of computing assets that utilize ontologically-related metadata to universalize computing assets combined with provenance-related metadata to contextualize the assets for suitability in a given situation. In a preferred embodiment, the system and method comprise an asset registry that contains provenance information and ontological information about available computing assets as well as metadata about the structure and organization of data, a provenance manager which tracks the provenance of each asset for data validation and contextual analysis purposes, an ontology manager that uses ontological relationships among assets to determine other domains in which an asset may be useful, and an interoperability manager which combines the provenance and ontology outputs to suggest computing assets that may be useful in a given context.
According to a preferred embodiment, a computing system for universal computer asset normalization and configuration management employing an asset registry platform, comprising: one or more hardware processors configured for: creating an asset registry, the asset registry comprising a list of computing assets with ontology metadata and provenance metadata for each computing asset, the provenance metadata for each computing asset comprising at least information about the origin, ownership, custody, validity, trustworthiness, and bias of each respective computing asset and its constituent components; loading a semantic ontology of computing assets represented by the ontology metadata, each computing asset comprising one or more data resources and one or more processing workflows that can be applied to the one or more data resources to perform data processing tasks producing a result; receiving a request from a user; wherein the request comprises any combination of: a computing use case selection; a request to share data, lists, or datasets, with other users; and a request to delegate ownership of data, lists, or datasets, to another user or users; creating a list of computing assets usable for the computing use case, the list comprising computing assets that are determined to be ontologically related to the computing use case based on the ontology; for each of the computing assets in the list, determining the semantic fit of the computing asset in the ontology to produce the result produced by that computing asset for the computing use case based on the provenance metadata; and displaying the list of computing assets usable for the computing use case with the calculated reliability of result for each computing asset in the list.
According to another preferred embodiment, a computer-implemented method executed on an asset registry platform for universal computer asset normalization and configuration management, the computer-implemented method comprising: creating an asset registry, the asset registry comprising a list of computing assets with ontology metadata and provenance metadata for each computing asset, the provenance metadata for each computing asset comprising at least information about the origin, ownership, custody, validity, trustworthiness, and bias of each respective computing asset and its constituent components; loading a semantic ontology of computing assets represented by the ontology metadata, each computing asset comprising one or more data resources and one or more processing workflows that can be applied to the one or more data resources to perform data processing tasks producing a result; receiving a request from a user; wherein the request comprises any combination of: a computing use case selection; a request to share data, lists, or datasets, with other users; and a request to delegate ownership of data, lists, or datasets, to another user or users; creating a list of computing assets usable for the computing use case, the list comprising computing assets that are determined to be ontologically related to the computing use case based on the ontology; for each of the computing assets in the list, determining the semantic fit of the computing asset in the ontology to produce the result produced by that computing asset for the computing use case based on the provenance metadata; displaying the list of computing assets usable for the computing use case; calculating a reliability of results for each of the computing assets in the list of computing assets useable for the computing use case using the provenance metadata; and displaying the list of computing assets usable for the computing use case with the calculated reliability of result for each computing asset in the list.
According to another preferred embodiment, a system for universal computer asset normalization and configuration management employing an asset registry platform, comprising one or more computers with executable instructions that, when executed, cause the system to: create an asset registry, the asset registry comprising a list of computing assets with ontology metadata and provenance metadata for each computing asset, the provenance metadata for each computing asset comprising at least information about the origin, ownership, custody, validity, trustworthiness, and bias of each respective computing asset and its constituent components; load a semantic ontology of computing assets represented by the ontology metadata, each computing asset comprising one or more data resources and one or more processing workflows that can be applied to the one or more data resources to perform data processing tasks producing a result; receive a request from a user; wherein the request comprises any combination of: a computing use case selection; a request to share data, lists, or datasets, with other users; and a request to delegate ownership of data, lists, or datasets, to another user or users; create a list of computing assets usable for the computing use case, the list comprising computing assets that are determined to be ontologically related to the computing use case based on the ontology; for each of the computing assets in the list, determine the semantic fit of the computing asset in the ontology to produce the result produced by that computing asset for the computing use case based on the provenance metadata; display the list of computing assets usable for the computing use case; calculate a reliability of results for each of the computing assets in the list of computing assets useable for the computing use case using the provenance metadata; and display the list of computing assets usable for the computing use case with the calculated reliability of result for each computing asset in the list.
According to another preferred embodiment, non-transitory, computer-readable storage media having computer-executable instructions embodied thereon that, when executed by one or more processors of a computing system employing an asset registry platform for universal computer asset normalization and configuration management, cause the computing system to: create an asset registry, the asset registry comprising a list of computing assets with ontology metadata and provenance metadata for each computing asset, the provenance metadata for each computing asset comprising at least information about the origin, ownership, custody, validity, trustworthiness, and bias of each respective computing asset and its constituent components; load a semantic ontology of computing assets represented by the ontology metadata, each computing asset comprising one or more data resources and one or more processing workflows that can be applied to the one or more data resources to perform data processing tasks producing a result; receive a request from a user; wherein the request comprises any combination of: a computing use case selection; a request to share data, lists, or datasets, with other users; and a request to delegate ownership of data, lists, or datasets, to another user or users; create a list of computing assets usable for the computing use case, the list comprising computing assets that are determined to be ontologically related to the computing use case based on the ontology; for each of the computing assets in the list, determine the semantic fit of the computing asset in the ontology to produce the result produced by that computing asset for the computing use case based on the provenance metadata; display the list of computing assets usable for the computing use case; calculate a reliability of results for each of the computing assets in the list of computing assets useable for the computing use case using the provenance metadata; and display the list of computing assets usable for the computing use case with the calculated reliability of result for each computing asset in the list.
According to an aspect of an embodiment, the asset registry subsystem further comprises provenance metadata for each asset, and a provenance manager is used to: track the provenance of each computing asset using the provenance metadata; for each computing asset on the list, calculate a reliability of results of the use of the computing asset for the computing use case based on the provenance metadata; and displaying the list of computing assets usable for the computing use case with the calculated reliability of results.
According to an aspect of an embodiment, the provenance metadata for each asset further comprises bias metadata, and the reliability of results includes an analysis of the bias metadata.
According to an aspect of an embodiment, an asset marketplace is used to allow the purchase, sale, or licensing of computing assets.
The accompanying drawings illustrate several aspects and, together with the description, serve to explain the principles of the invention according to the aspects. It will be appreciated by one skilled in the art that the particular arrangements illustrated in the drawings are merely exemplary, and are not to be considered as limiting of the scope of the invention or the claims herein in any way.
The inventor has conceived, and reduced to practice, a system and method for universal computer asset normalization and configuration management that utilizes structure, organization, and ontologically-related metadata to unify computing assets into a common data model combined with provenance-related metadata to contextualize the assets for suitability in a given situation. In a preferred embodiment, the system and method comprise an asset registry that contains provenance information and ontological information about available computing assets, a provenance manager which tracks the provenance of each asset for data validation and contextual analysis purposes, an ontology manager that uses ontological relationships among assets to determine other domains in which an asset may be useful, and an interoperability manager which combines the provenance and ontology outputs to suggest computing assets that may be useful in a given context.
The system is designed to unify computing assets under a common data model available on a computing platform, such that customers of the platform can access computing assets available on the platform to satisfy their data processing needs. The computing assets comprise data resources and processing workflows that can be combined together to solve computing needs such as data analysis and decision-making in a variety of domains. The computing assets are modular (i.e., are essentially data and processing building blocks) that can be arranged to perform data processing tasks required by the client. The computing assets can be combined serially to perform a sequence of step-by-step data processing, or in parallel to perform simultaneous data processing, or both, depending on the needs of the customer.
Further, the computing assets can be combined together to perform more complex computing assets. In some embodiments, computing assets will be classified by their complexity, in which computing assets may be assigned categories or levels. For example, a fundamental or level zero computing asset would be an asset which either cannot be broken down into smaller components or is impractical to break into smaller components, such as a database containing a parts list for a particular make, model, and year of a car, or a processing workflow that performs a Fourier transform of signal data. The next higher order of complexity (e.g., a level one computing asset) might be a database containing a parts list for a particular make and model of a car for all years, or a simple serial processing workflow that first performs a Fourier transform of a signal and then identifies the primary three frequencies that make up the signal. The next higher order of complexity (e.g., a level two computing asset) might be a database containing a parts list for a particular make of car and all models and years, or a serial processing workflow that first performs a Fourier transform of a signal, identifies the primary three frequencies that make up the signal, and then calculates a standard deviation of the amplitude of each signal from some expected signal distribution.
In order to universalize the computing assets, the system keeps an asset registry of all assets available on the platform. The asset registry keeps track of all metadata associated with each asset to categorize the asset and determine interoperability with other assets available on the platform and may further keep additional metadata separate from each asset. Categorization metadata may include such information as asset descriptions, whether the asset is a data resource or a processing workflow, the type or data or workflow, the level or complexity of the asset, the use case for which the data or workflow was developed, and other information useful for categorizing the assets.
The metadata tracked by the asset registry may include provenance information for each asset which may include such information as who created the asset, when the asset was created, asset source type information, where the asset is located or stored, ownership, licensing, pricing and royalty information, data validation, schema, compliance and auditing information, trustworthiness scores, re-use, expiration and staleness, and known or suspected biases associated with the asset. This provenance information can be used to determine a suitability, reliability, or trustworthiness of the asset or of outputs of workflows associated with an asset.
The metadata tracked by the asset registry may include ontology information for each asset which may include such information as a domain or use for which the asset was created, similar and related domains and uses to which the asset has been successfully applied, and other ontological relationship information such as categorization (as described above), key words, domain relationships, industry relationships and overlaps, business and customer relationships, data processing similarities, and data type similarities. This ontological information can be used to determine the suitability of use of an assert in a given domain which may be different from the domain for which the asset was created, and to determine interoperability of assets created by different entities, for different purposes, or in different contexts.
A combination of the above features allows for contextual universalization of computing assets across different aspects of a platform, such that customers using the platform can search for, select, and use computing assets appropriate to their computing needs. Some examples of computing assets that may be universalized in this manner include datasets, data feeds and streams, data stores or databases; stored queries schemas, indices, ontologies; connector workflows, data transformation workflows, and data processing workflows; data sources and sinks, data collectors and actuators; plugins for application programming interfaces (APIs) or cloud-based services or microservices; models, algorithms, and simulations; rules, scratchpads, reports, notes, and forms. At lower levels of complexity, such computing assets may be very simple, such as a real-time data stream from an air temperature sensor. At higher levels of complexity, simpler assets can be combined to obtain more complex information, such as combining the data stream from the air temperature sensor with a model of a greenhouse to predict internal temperatures within the greenhouse. Using ontologies, the same sensor and model may be used in a different domain to predict the internal temperature of a car, albeit with greater uncertainty which can be reflected into ontological relationships.
One or more different aspects may be described in the present application. Further, for one or more of the aspects described herein, numerous alternative arrangements may be described; it should be appreciated that these are presented for illustrative purposes only and are not limiting of the aspects contained herein or the claims presented herein in any way. One or more of the arrangements may be widely applicable to numerous aspects, as may be readily apparent from the disclosure. In general, arrangements are described in sufficient detail to enable those skilled in the art to practice one or more of the aspects, and it should be appreciated that other arrangements may be utilized and that structural, logical, software, electrical and other changes may be made without departing from the scope of the particular aspects. Particular features of one or more of the aspects described herein may be described with reference to one or more particular aspects or figures that form a part of the present disclosure, and in which are shown, by way of illustration, specific arrangements of one or more of the aspects. It should be appreciated, however, that such features are not limited to usage in the one or more particular aspects or figures with reference to which they are described. The present disclosure is neither a literal description of all arrangements of one or more of the aspects nor a listing of features of one or more of the aspects that must be present in all arrangements.
Headings of sections provided in this patent application and the title of this patent application are for convenience only, and are not to be taken as limiting the disclosure in any way.
Devices that are in communication with each other need not be in continuous communication with each other, unless expressly specified otherwise. In addition, devices that are in communication with each other may communicate directly or indirectly through one or more communication means or intermediaries, logical or physical.
A description of an aspect with several components in communication with each other does not imply that all such components are required. To the contrary, a variety of optional components may be described to illustrate a wide variety of possible aspects and in order to more fully illustrate one or more aspects. Similarly, although process steps, method steps, algorithms or the like may be described in a sequential order, such processes, methods and algorithms may generally be configured to work in alternate orders, unless specifically stated to the contrary. In other words, any sequence or order of steps that may be described in this patent application does not, in and of itself, indicate a requirement that the steps be performed in that order. The steps of described processes may be performed in any order practical. Further, some steps may be performed simultaneously despite being described or implied as occurring non-simultaneously (e.g., because one step is described after the other step). Moreover, the illustration of a process by its depiction in a drawing does not imply that the illustrated process is exclusive of other variations and modifications thereto, does not imply that the illustrated process or any of its steps are necessary to one or more of the aspects, and does not imply that the illustrated process is preferred. Also, steps are generally described once per aspect, but this does not mean they must occur once, or that they may only occur once each time a process, method, or algorithm is carried out or executed. Some steps may be omitted in some aspects or some occurrences, or some steps may be executed more than once in a given aspect or occurrence.
When a single device or article is described herein, it will be readily apparent that more than one device or article may be used in place of a single device or article. Similarly, where more than one device or article is described herein, it will be readily apparent that a single device or article may be used in place of the more than one device or article.
The functionality or the features of a device may be alternatively embodied by one or more other devices that are not explicitly described as having such functionality or features. Thus, other aspects need not include the device itself.
Techniques and mechanisms described or referenced herein will sometimes be described in singular form for clarity. However, it should be appreciated that particular aspects may include multiple iterations of a technique or multiple instantiations of a mechanism unless noted otherwise. Process descriptions or blocks in figures should be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process. Alternate implementations are included within the scope of various aspects in which, for example, functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those having ordinary skill in the art.
“Computing asset” or “asset” as used herein means a discretely-identifiable computing resource that may be used alone or in conjunction with our such resources to provide computing solutions. Assets may include, but are not limited to datasets, data feeds or streams, data stores or databases, stored queries, schemas, indices, ontologies, plugins, workflows, processes, algorithms, models, simulations, rules, notes, reports, forms, applications, programs, and data-processing services. Computer hardware is included in this definition where the hardware is configured to perform a discretely-identifiable data processing function.
“Graph” as used herein means a representation of information and relationships, where each primary unit of information makes up a “node” or “vertex” of the graph and the relationship between two nodes makes up an edge of the graph. Nodes can be further qualified by the connection of one or more descriptors or “properties” to that node. For example, given the node “James R,” name information for a person, qualifying properties might be “183 cm tall,” “DOB Aug. 13, 1965” and “speaks English”. Similar to the use of properties to further describe the information in a node, a relationship between two nodes that forms an edge can be qualified using a “label”. Thus, given a second node “Thomas G,” an edge between “James R” and “Thomas G” that indicates that the two people know each other might be labeled “knows.” When graph theory notation (Graph=(Vertices, Edges)) is applied this situation, the set of nodes are used as one parameter of the ordered pair, V and the set of 2 element edge endpoints are used as the second parameter of the ordered pair, E. When the order of the edge endpoints within the pairs of E is not significant, for example, the edge James R, Thomas G is equivalent to Thomas G, James R, the graph is designated as “undirected.” Under circumstances when a relationship flows from one node to another in one direction, for example James R is “taller” than Thomas G, the order of the endpoints is significant. Graphs with such edges are designated as “directed.” In the distributed computational graph system, transformations within transformation pipeline are represented as directed graph with each transformation comprising a node and the output messages between transformations comprising edges. Distributed computational graph stipulates the potential use of non-linear transformation pipelines which are programmatically linearized. Such linearization can result in exponential growth of resource consumption. The most sensible approach to overcome possibility is to introduce new transformation pipelines just as they are needed, creating only those that are ready to compute. Such method results in transformation graphs which are highly variable in size and node, edge composition as the system processes data streams. Those familiar with the art will realize that transformation graph may assume many shapes and sizes with a vast topography of edge relationships. The examples given were chosen for illustrative purposes only and represent a small number of the simplest of possibilities. These examples should not be taken to define the possible graphs expected as part of operation of the invention.
“Ontology” as used herein refers to a formal naming and definition of the types, properties, and interrelationships of the entities that exist in a particular domain of discourse. Ontologies are a method of classification of things and their relationships with other things. They are related to, but more flexible than, taxonomies, hierarchies, and class definitions. The term ontologies, as used herein, has the meaning associated with information and computer science, rather than the definition used in philosophy of classifying things as they exist in reality.
“Domain-specific ontology” as used herein refers to the meaning of a concept within a particular ontological domain (i.e., a set of reference ideas that establishes context). For example, the word “card” has many different meanings, depending on the ontological domain (context) in which it is used. In the domain of poker, the term “card” would refer to a “playing card” as used in playing the game of poker. In the domain of computer software, the term “card” may refer to the antiquated “punch card” form of information storage. In the domain of computer hardware, the term “card” could refer to a “video card”, an “SD card” (a type of memory storage device), or similar pieces of hardware.
“Provenance” or “data provenance” as used herein means the tracking of the history or status of a computing asset, and may include any information useful for describing the history or status including, but not limited to, information about the origin, ownership, custody, transfer, access, licensing, validity, trustworthiness, and bias associated with the data.
Results of the transformative analysis process may then be combined with further client directives, and additional business rules and practices relevant to the analysis and situational information external to the already available data in the automated planning service module 130 which also runs powerful information theory 130a based predictive statistics functions and machine learning algorithms to allow future trends and outcomes to be rapidly forecast based upon the current system derived results and choosing each a plurality of possible business decisions. The using all available data, the automated planning service module 130 may propose business decisions most likely to result is the most favorable business outcome with a usably high level of certainty. Closely related to the automated planning service module in the use of system derived results in conjunction with possible externally supplied additional information in the assistance of end user business decision making, the action outcome simulation module 125 with its discrete event simulator programming module 125a coupled with the end user facing observation and state estimation service 140 which is highly scriptable 140b as circumstances require and has a game engine 140a to more realistically stage possible outcomes of business decisions under consideration, allows business decision makers to investigate the probable outcomes of choosing one pending course of action over another based upon analysis of the current available data.
When performing external reconnaissance via a network 107, web crawler 115 may be used to perform a variety of port and service scanning operations on a plurality of hosts. This may be used to target individual network hosts (for example, to examine a specific server or client device) or to broadly scan any number of hosts (such as all hosts within a particular domain, or any number of hosts up to the complete IPv4 address space). Port scanning is primarily used for gathering information about hosts and services connected to a network, using probe messages sent to hosts that prompt a response from that host. Port scanning is generally centered around the transmission control protocol (TCP), and using the information provided in a prompted response a port scan can provide information about network and application layers on the targeted host.
Port scan results can yield information on open, closed, or undetermined ports on a target host. An open port indicated that an application or service is accepting connections on this port (such as ports used for receiving customer web traffic on a web server), and these ports generally disclose the greatest quantity of useful information about the host. A closed port indicates that no application or service is listening for connections on that port, and still provides information about the host such as revealing the operating system of the host, which may discovered by fingerprinting the TCP/IP stack in a response. Different operating systems exhibit identifiable behaviors when populating TCP fields, and collecting multiple responses and matching the fields against a database of known fingerprints makes it possible to determine the OS of the host even when no ports are open. An undetermined port is one that does not produce a requested response, generally because the port is being filtered by a firewall on the host or between the host and the network (for example, a corporate firewall behind which all internal servers operate).
Scanning may be defined by scope to limit the scan according to two dimensions, hosts and ports. A horizontal scan checks the same port on multiple hosts, often used by attackers to check for an open port on any available hosts to select a target for an attack that exploits a vulnerability using that port. This type of scan is also useful for security audits, to ensure that vulnerabilities are not exposed on any of the target hosts. A vertical scan defines multiple ports to examine on a single host, for example a “vanilla scan” which targets every port of a single host, or a “strobe scan” that targets a small subset of ports on the host. This type of scan is usually performed for vulnerability detection on single systems, and due to the single-host nature is impractical for large network scans. A block scan combines elements of both horizontal and vertical scanning, to scan multiple ports on multiple hosts. This type of scan is useful for a variety of service discovery and data collection tasks, as it allows a broad scan of many hosts (up to the entire Internet, using the complete IPv4 address space) for a number of desired ports in a single sweep.
Large port scans involve quantitative research, and as such may be treated as experimental scientific measurement and are subject to measurement and quality standards to ensure the usefulness of results. To avoid observational errors during measurement, results must be precise (describing a degree of relative proximity between individual measured values), accurate (describing relative proximity of measured values to a reference value), preserve any metadata that accompanies the measured data, avoid misinterpretation of data due to faulty measurement execution, and must be well-calibrated to efficiently expose and address issues of inaccuracy or misinterpretation. In addition to these basic requirements, large volumes of data may lead to unexpected behavior of analysis tools, and extracting a subset to perform initial analysis may help to provide an initial overview before working with the complete data set. Analysis should also be reproducible, as with all experimental science, and should incorporate publicly-available data to add value to the comprehensibility of the research as well as contributing to a “common framework” that may be used to confirm results.
When performing a port scan, web crawler 115 may employ a variety of software suitable for the task, such as Nmap, ZMap, or masscan. Nmap is suitable for large scans as well as scanning individual hosts, and excels in offering a variety of diverse scanning techniques. ZMap is a newer application and unlike Nmap (which is more general-purpose), ZMap is designed specifically with Internet-wide scans as the intent. As a result, ZMap is far less customizable and relies on horizontal port scans for functionality, achieving fast scan times using techniques of probe randomization (randomizing the order in which probes are sent to hosts, minimizing network saturation) and asynchronous design (utilizing stateless operation to send and receive packets in separate processing threads). Masscan uses the same asynchronous operation model of ZMap, as well as probe randomization. In masscan however, a certain degree of statistical randomness is sacrificed to improve computation time for large scans (such as when scanning the entire IPv4 address space), using the BlackRock algorithm. This is a modified implementation of symmetric encryption algorithm DES, with fewer rounds and modulo operations in place of binary ones to allow for arbitrary ranges and achieve faster computation time for large data sets.
Received scan responses may be collected and processed through a plurality of data pipelines 155a to analyze the collected information. MDTSDB 120 and graph stack 145 may be used to produce a hybrid graph/time-series database using the analyzed data, forming a graph of Internet-accessible organization resources and their evolving state information over time. Customer-specific profiling and scanning information may be linked to CPG graphs (as described below in detail, referring to
Other modules that make up the advanced cyber decision platform may also perform significant analytical transformations on trade related data. These may include the multidimensional time series data store 120 with its robust scripting features which may include a distributive friendly, fault-tolerant, real-time, continuous run prioritizing, programming platform such as, but not limited to Erlang/OTP 221 and a compatible but comprehensive and proven library of math functions of which the C++ math libraries are an example 222, data formalization and ability to capture time series data including irregularly transmitted, burst data; the GraphStack service 145 which transforms data into graphical representations for relational analysis and may use packages for graph format data storage such as Titan 245 or the like and a highly interface accessible programming interface an example of which may be Akka/Spray, although other, similar, combinations may equally serve the same purpose in this role 246 to facilitate optimal data handling; the directed computational graph module 155 and its distributed data pipeline 155a supplying related general transformer service module 160 and decomposable transformer module 150 which may efficiently carry out linear, branched, and recursive transformation pipelines during trading data analysis may be programmed with multiple trade related functions involved in predictive analytics of the received trade data. Both possibly during and following predictive analyses carried out by the system, results must be presented to clients 105 in formats best suited to convey the both important results for analysts to make highly informed decisions and, when needed, interim or final data in summary and potentially raw for direct human analysis. Simulations which may use data from a plurality of field spanning sources to predict future trade conditions these are accomplished within the action outcome simulation module 125. Data and simulation formatting may be completed or performed by the observation and state estimation service 140 using its ease of scripting and gaming engine to produce optimal presentation results.
In cases where there are both large amounts of data to be cleansed and formalized and then intricate transformations such as those that may be associated with deep machine learning, first disclosed in ¶067 of co-pending application Ser. No. 14/925,974, predictive analytics and predictive simulations, distribution of computer resources to a plurality of systems may be routinely required to accomplish these tasks due to the volume of data being handled and acted upon. The advanced cyber decision platform employs a distributed architecture that is highly extensible to meet these needs. A number of the tasks carried out by the system are extremely processor intensive and for these, the highly integrated process of hardware clustering of systems, possibly of a specific hardware architecture particularly suited to the calculations inherent in the task, is desirable, if not required for timely completion. The system includes a computational clustering module 280 to allow the configuration and management of such clusters during application of the advanced cyber decision platform. While the computational clustering module is drawn directly connected to specific co-modules of the advanced cyber decision platform these connections, while logical, are for ease of illustration and those skilled in the art will realize that the functions attributed to specific modules of an embodiment may require clustered computing under one use case and not under others. Similarly, the functions designated to a clustered configuration may be role, if not run, dictated. Further, not all use cases or data runs may use clustering.
For example, in an exemplary scoring system similar to a credit rating, information from initial Internet recon operations may be assigned a score up to 400 points, along with up to 200 additional points for web/application recon results, 100 points for patch frequency, and 50 points each for additional endpoints and open-source intel results. This yields a weighted score incorporating all available information from all scanned sources, allowing a meaningful and readily-appreciable representation of an organization's overall cybersecurity strength. Additionally, as scanning may be performed repeatedly and results collected into a time-series hybrid data structure, this cybersecurity rating may evolve over time to continuously reflect the current state of the organization, reflecting any recent changes, newly-discovered or announced vulnerabilities, software or hardware updates, newly-added or removed devices or services, and any other changes that may occur.
A customer portal 410 allows customers to access the various services available on the platform for the customer's computing needs, for example the data analytics engines 420 and decision platforms 440, as well as allowing the customer to buy, develop, and sell computing assets that it may require in the asset marketplace 430. The customer portal 410 includes tools for searching for available computing assets, retrieving the assets, and using the assets for the customer's computing needs, which may involve building of data processing workflows using multiple assets in series, in parallel, or a combination of both. The customer portal 4120 may also include a set of developer tools for creation of new assets either by uploading or creating new fundamental (level 0) assets or by building more complex higher-level computing assets by combining lower-level computing assets.
The asset marketplace 430 allows for exchange and sharing of assets. Assets available on the platform may be owned by different entities, for example the platform owner, by customers who develop the assets for their own uses, or by third parties who develop assets for the platform specifically to market them to others on the platform. The marketplace 430 provides purchase, sale, licensing, exchange, and sharing functionality for such purposes, and encourages the development of new assets by providing financial incentives to do so. The platform owner may receive or charge a fee for the sale, transfer, licensing, or use of the assets, including where the assets are owned by customers or third parties.
The use-case-specific platforms 440 are specific applications of the computing assets and data analytics engines 420 for specific purposes, for example customized sets of computing assets for analysis of insurance policies, premiums, and risks 441, cyber-security threats and mitigations 442, and financial and market predictions 443.
The provenance manager 502 assigns provenance metadata to each asset in the registry and tracks that information over time. The provenance manager 502 may further keep additional provenance metadata separate from each asset which provides additional provenance information (e.g., for groups of assets, etc.). The provenance metadata may include such information as who created the asset, when the asset was created, asset source type information, where the asset is located or stored, ownership, licensing, pricing and royalty information, data validation, compliance and auditing information, trustworthiness scores, re-use, expiration and staleness, and known or suspected biases associated with the asset. In many cases, the provenance metadata may be automatically obtained, for example where a customer creates or uses an asset, that information will be stored as provenance metadata. However, in some cases the provenance information may be entered manually, for example where data are obtained from a website with a known or discernable bias, a bias indicator may be entered for the data when it is entered as an asset in the system. This provenance information can be used to determine a suitability, reliability, or trustworthiness of the asset or of outputs of workflows associated with an asset. Detailed information about data provenance tracking is contained in U.S. patent application Ser. No. 15/931,534, which has been incorporated herein by reference.
The ontology manager 503 assigns ontology metadata to each asset in the registry and creates an ontology of assets. The ontology manager 503 is responsible for cataloging relationships between computing assets from metadata assigned to each asset, including the provenance metadata in appropriate circumstances. The ontology manager 503 is also responsible for version tracking and control of ontologies, which is key to avoiding conflicts in changes to the ontologies, particularly where changes are by two different entities (or automated systems) simultaneously. For example, if an asset is in use by two different customers at the same time, and a change is made by both users, a version conflict or data loss could occur. In such cases, the ontology manager ensures version continuity by using existing best practices for version control, which procedures may differ depending on whether the asset registry database is centralized or distributed. In some cases, ontological metadata may be automatically assigned, as would be the case, for example, where a child asset is created using some part of a parent asset, in which case the parent asset and child asset would have an ontological relationship by virtue of the fact that one asset was derived from the other. In some cases, ontological metadata may be manually assigned, as would be the case, for example, where the developer of an asset designates a use case or domain for which the asset was created. In some embodiments, machine learning algorithms may be used to construct the ontologies using patterns discovered by the machine learning algorithms within metadata assigned to the assets or from data within the assets themselves. Detailed information about the development and use of schemas and ontologies is contained in U.S. patent application Ser. No. 16/864,133 and U.S. patent application Ser. No. 15/847,443, both of which have been incorporated herein by reference. The interoperability manager 504 uses asset metadata and information from the provenance manager and ontology manager to determine whether an asset is suitable for use for a particular intended purpose. The provenance metadata can be used to determine a suitability, reliability, or trustworthiness of the asset or of outputs of workflows associated with an asset. The ontological metadata can be used to determine the suitability of use of an assert in a given domain which may be different from the domain for which the asset was created, and to determine interoperability of assets created by different entities, for different purposes, or in different contexts. A combination of provenance metadata with ontological metadata can thus indicate both whether a particular asset can be used for the purpose intended by a user (ontology) and the reliability of outputs from that asset (provenance). Using the classification metadata, the interoperability manager 504 groups computing assets into groups, categories, or domains which can be browsed by a customer. When the customer browses a group, category, or domain, the interoperability manager 504, using the ontology created by the ontology manager, suggests other groups, categories, domains, or even specific assets that may also be usable for similar purposes, and further indicates a likely reliability of results that may be obtained from using those other groups, categories, domains, or assets. The suggestions and recommendations of the interoperability manager 504 may be further improved by allowing the user to enter or select a computing need or an intended purpose, and using that information to refine the suggestions. To make its classifications, recommendations, and suggestions interoperability manager 504 may use simple comparison algorithms (e.g., key words comparisons), but more sophisticated graph traversal algorithms (e.g., shortest path algorithms, etc.), clustering algorithms (e.g., relative distance between vectors or between vertices of a graph), or machine learning algorithms (e.g., a graph convolutional network) may be used to analyze the ontology created by the ontology manager (which, as mentioned previously, may include the provenance metadata).
Weighting rules 640 are retrieved to determine how to weight the sources, types, and biases of the data to determine an adjusted premium based on the provenance labeled data 650. In this case, the facts that the business spent more on security, that the owner is potentially more “security conscious,” and that the owner is a business owner weigh in favor of lower premiums, while the fact that a vehicle has recently been stolen and that Business X is located in a high risk zip code weight in favor of higher premiums. The tracking of provenance metadata allows these weighted determinations to be applied.
Generally, the techniques disclosed herein may be implemented on hardware or a combination of software and hardware. For example, they may be implemented in an operating system kernel, in a separate user process, in a library package bound into network applications, on a specially constructed machine, on an application-specific integrated circuit (ASIC), or on a network interface card.
Software/hardware hybrid implementations of at least some of the aspects disclosed herein may be implemented on a programmable network-resident machine (which should be understood to include intermittently connected network-aware machines) selectively activated or reconfigured by a computer program stored in memory. Such network devices may have multiple network interfaces that may be configured or designed to utilize different types of network communication protocols. A general architecture for some of these machines may be described herein in order to illustrate one or more exemplary means by which a given unit of functionality may be implemented. According to specific aspects, at least some of the features or functionalities of the various aspects disclosed herein may be implemented on one or more general-purpose computers associated with one or more networks, such as for example an end-user computer system, a client computer, a network server or other server system, a mobile computing device (e.g., tablet computing device, mobile phone, smartphone, laptop, or other appropriate computing device), a consumer electronic device, a music player, or any other suitable electronic device, router, switch, or other suitable device, or any combination thereof. In at least some aspects, at least some of the features or functionalities of the various aspects disclosed herein may be implemented in one or more virtualized computing environments (e.g., network computing clouds, virtual machines hosted on one or more physical computing machines, or other appropriate virtual environments).
Referring now to
In one aspect, computing device 10 includes one or more central processing units (CPU) 12, one or more interfaces 15, and one or more busses 14 (such as a peripheral component interconnect (PCI) bus). When acting under the control of appropriate software or firmware, CPU 12 may be responsible for implementing specific functions associated with the functions of a specifically configured computing device or machine. For example, in at least one aspect, a computing device 10 may be configured or designed to function as a server system utilizing CPU 12, local memory 11 and/or remote memory 16, and interface(s) 15. In at least one aspect, CPU 12 May be caused to perform one or more of the different types of functions and/or operations under the control of software modules or components, which for example, may include an operating system and any appropriate applications software, drivers, and the like.
CPU 12 may include one or more processors 13 such as, for example, a processor from one of the Intel, ARM, Qualcomm, and AMD families of microprocessors. In some aspects, processors 13 may include specially designed hardware such as application-specific integrated circuits (ASICs), electrically erasable programmable read-only memories (EEPROMs), field-programmable gate arrays (FPGAs), and so forth, for controlling operations of computing device 10. In a particular aspect, a local memory 11 (such as non-volatile random access memory (RAM) and/or read-only memory (ROM), including for example one or more levels of cached memory) may also form part of CPU 12. However, there are many different ways in which memory may be coupled to system 10. Memory 11 may be used for a variety of purposes such as, for example, caching and/or storing data, programming instructions, and the like. It should be further appreciated that CPU 12 may be one of a variety of system-on-a-chip (SOC) type hardware that may include additional hardware such as memory or graphics processing chips, such as a QUALCOMM SNAPDRAGON™ or SAMSUNG EXYNOS™ CPU as are becoming increasingly common in the art, such as for use in mobile devices or integrated devices.
As used herein, the term “processor” is not limited merely to those integrated circuits referred to in the art as a processor, a mobile processor, or a microprocessor, but broadly refers to a microcontroller, a microcomputer, a programmable logic controller, an application-specific integrated circuit, and any other programmable circuit.
In one aspect, interfaces 15 are provided as network interface cards (NICs). Generally, NICs control the sending and receiving of data packets over a computer network; other types of interfaces 15 may for example support other peripherals used with computing device 10. Among the interfaces that may be provided are Ethernet interfaces, frame relay interfaces, cable interfaces, DSL interfaces, token ring interfaces, graphics interfaces, and the like. In addition, various types of interfaces may be provided such as, for example, universal serial bus (USB), Serial, Ethernet, FIREWIRE™, THUNDERBOLT™, PCI, parallel, radio frequency (RF), BLUETOOTH™, near-field communications (e.g., using near-field magnetics), 802.11 (Wi-Fi), frame relay, TCP/IP, ISDN, fast Ethernet interfaces, Gigabit Ethernet interfaces, Serial ATA (SATA) or external SATA (ESATA) interfaces, high-definition multimedia interface (HDMI), digital visual interface (DVI), analog or digital audio interfaces, asynchronous transfer mode (ATM) interfaces, high-speed serial interface (HSSI) interfaces, Point of Sale (POS) interfaces, fiber data distributed interfaces (FDDIs), and the like. Generally, such interfaces 15 May include physical ports appropriate for communication with appropriate media. In some cases, they may also include an independent processor (such as a dedicated audio or video processor, as is common in the art for high-fidelity A/V hardware interfaces) and, in some instances, volatile and/or non-volatile memory (e.g., RAM).
Although the system shown in
Regardless of network device configuration, the system of an aspect may employ one or more memories or memory modules (such as, for example, remote memory block 16 and local memory 11) configured to store data, program instructions for the general-purpose network operations, or other information relating to the functionality of the aspects described herein (or any combinations of the above). Program instructions may control execution of or comprise an operating system and/or one or more applications, for example. Memory 16 or memories 11, 16 may also be configured to store data structures, configuration data, encryption data, historical system operations information, or any other specific or generic non-program information described herein.
Because such information and program instructions may be employed to implement one or more systems or methods described herein, at least some network device aspects may include nontransitory machine-readable storage media, which, for example, may be configured or designed to store program instructions, state information, and the like for performing various operations described herein. Examples of such nontransitory machine-readable storage media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as optical disks, and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM), flash memory (as is common in mobile devices and integrated systems), solid state drives (SSD) and “hybrid SSD” storage drives that may combine physical components of solid state and hard disk drives in a single hardware device (as are becoming increasingly common in the art with regard to personal computers), memristor memory, random access memory (RAM), and the like. It should be appreciated that such storage means may be integral and non-removable (such as RAM hardware modules that may be soldered onto a motherboard or otherwise integrated into an electronic device), or they may be removable such as swappable flash memory modules (such as “thumb drives” or other removable media designed for rapidly exchanging physical storage devices), “hot-swappable” hard disk drives or solid state drives, removable optical storage discs, or other such removable media, and that such integral and removable storage media may be utilized interchangeably. Examples of program instructions include both object code, such as may be produced by a compiler, machine code, such as may be produced by an assembler or a linker, byte code, such as may be generated by for example a JAVA™ compiler and may be executed using a Java virtual machine or equivalent, or files containing higher level code that may be executed by the computer using an interpreter (for example, scripts written in Python, Perl, Ruby, Groovy, or any other scripting language).
In some aspects, systems may be implemented on a standalone computing system. Referring now to
In some aspects, systems may be implemented on a distributed computing network, such as one having any number of clients and/or servers. Referring now to
In addition, in some aspects, servers 32 may call external services 37 when needed to obtain additional information, or to refer to additional data concerning a particular call. Communications with external services 37 may take place, for example, via one or more networks 31. In various aspects, external services 37 may comprise web-enabled services or functionality related to or installed on the hardware device itself. For example, in one aspect where client applications 24 are implemented on a smartphone or other electronic device, client applications 24 may obtain information stored in a server system 32 in the cloud or on an external service 37 deployed on one or more of a particular enterprise's or user's premises. In addition to local storage on servers 32, remote storage 38 may be accessible through the network(s) 31.
In some aspects, clients 33 or servers 32 (or both) may make use of one or more specialized services or appliances that may be deployed locally or remotely across one or more networks 31. For example, one or more databases 34 in either local or remote storage 38 May be used or referred to by one or more aspects. It should be understood by one having ordinary skill in the art that databases in storage 34 may be arranged in a wide variety of architectures and using a wide variety of data access and manipulation means. For example, in various aspects one or more databases in storage 34 may comprise a relational database system using a structured query language (SQL), while others may comprise an alternative data storage technology such as those referred to in the art as “NoSQL” (for example, HADOOP CASSANDRA™, GOOGLE BIGTABLE™, and so forth). In some aspects, variant database architectures such as column-oriented databases, in-memory databases, clustered databases, distributed databases, or even flat file data repositories may be used according to the aspect. It will be appreciated by one having ordinary skill in the art that any combination of known or future database technologies may be used as appropriate, unless a specific database technology or a specific arrangement of components is specified for a particular aspect described herein. Moreover, it should be appreciated that the term “database” as used herein may refer to a physical database machine, a cluster of machines acting as a single database system, or a logical database within an overall database management system. Unless a specific meaning is specified for a given use of the term “database,” it should be construed to mean any of these senses of the word, all of which are understood as a plain meaning of the term “database” by those having ordinary skill in the art.
Similarly, some aspects may make use of one or more security systems 36 and configuration systems 35. Security and configuration management are common information technology (IT) and web functions, and some amount of each are generally associated with any IT or web systems. It should be understood by one having ordinary skill in the art that any configuration or security subsystems known in the art now or in the future may be used in conjunction with aspects without limitation, unless a specific security 36 or configuration system 35 or approach is specifically required by the description of any specific aspect.
In various aspects, functionality for implementing systems or methods of various aspects may be distributed among any number of client and/or server components. For example, various software modules may be implemented for performing various functions in connection with the system of any particular aspect, and such modules may be variously implemented to run on server and/or client components.
The skilled person will be aware of a range of possible modifications of the various aspects described above. Accordingly, the present invention is defined by the claims and their equivalents.
| Number | Date | Country | |
|---|---|---|---|
| 62568298 | Oct 2017 | US | |
| 62568291 | Oct 2017 | US | |
| 62568305 | Oct 2017 | US | |
| 62568312 | Oct 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17088387 | Nov 2020 | US |
| Child | 18602042 | US | |
| Parent | 15879182 | Jan 2018 | US |
| Child | 16718906 | US | |
| Parent | 15229476 | Aug 2016 | US |
| Child | 16660727 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16945698 | Jul 2020 | US |
| Child | 17088387 | US | |
| Parent | 16864133 | Apr 2020 | US |
| Child | 16945698 | US | |
| Parent | 15847443 | Dec 2017 | US |
| Child | 16864133 | US | |
| Parent | 15790457 | Oct 2017 | US |
| Child | 15847443 | US | |
| Parent | 15790327 | Oct 2017 | US |
| Child | 15790457 | US | |
| Parent | 15616427 | Jun 2017 | US |
| Child | 15790327 | US | |
| Parent | 15141752 | Apr 2016 | US |
| Child | 15616427 | US | |
| Parent | 15091563 | Apr 2016 | US |
| Child | 15141752 | US | |
| Parent | 14986536 | Dec 2015 | US |
| Child | 15091563 | US | |
| Parent | 14925974 | Oct 2015 | US |
| Child | 14986536 | US | |
| Parent | 15616427 | Jun 2017 | US |
| Child | 15847443 | US | |
| Parent | 14925974 | Oct 2015 | US |
| Child | 15616427 | US | |
| Parent | 15489716 | Apr 2017 | US |
| Child | 15847443 | US | |
| Parent | 15409510 | Jan 2017 | US |
| Child | 15489716 | US | |
| Parent | 15379899 | Dec 2016 | US |
| Child | 15409510 | US | |
| Parent | 15376657 | Dec 2016 | US |
| Child | 15379899 | US | |
| Parent | 15237625 | Aug 2016 | US |
| Child | 15376657 | US | |
| Parent | 15206195 | Jul 2016 | US |
| Child | 15237625 | US | |
| Parent | 15186453 | Jun 2016 | US |
| Child | 15206195 | US | |
| Parent | 15166158 | May 2016 | US |
| Child | 15186453 | US | |
| Parent | 15141752 | Apr 2016 | US |
| Child | 15166158 | US | |
| Parent | 16915176 | Jun 2020 | US |
| Child | 16945698 | US | |
| Parent | 15847443 | Dec 2017 | US |
| Child | 16915176 | US | |
| Parent | 15891329 | Feb 2018 | US |
| Child | 15847443 | US | |
| Parent | 15860980 | Jan 2018 | US |
| Child | 15891329 | US | |
| Parent | 15850037 | Dec 2017 | US |
| Child | 15860980 | US | |
| Parent | 15489716 | Apr 2017 | US |
| Child | 15850037 | US | |
| Parent | 15673368 | Aug 2017 | US |
| Child | 15489716 | US | |
| Parent | 15376657 | Dec 2016 | US |
| Child | 15673368 | US | |
| Parent | 15788002 | Oct 2017 | US |
| Child | 15860980 | US | |
| Parent | 15787601 | Oct 2017 | US |
| Child | 15788002 | US | |
| Parent | 15616427 | Jun 2017 | US |
| Child | 15787601 | US | |
| Parent | 15905041 | Feb 2018 | US |
| Child | 16915176 | US | |
| Parent | 15237625 | Aug 2016 | US |
| Child | 15905041 | US | |
| Parent | 15931534 | May 2020 | US |
| Child | 16945698 | US | |
| Parent | 16777270 | Jan 2020 | US |
| Child | 15931534 | US | |
| Parent | 16720383 | Dec 2019 | US |
| Child | 16777270 | US | |
| Parent | 15823363 | Nov 2017 | US |
| Child | 16720383 | US | |
| Parent | 15725274 | Oct 2017 | US |
| Child | 15823363 | US | |
| Parent | 15655113 | Jul 2017 | US |
| Child | 15725274 | US | |
| Parent | 15616427 | Jun 2017 | US |
| Child | 15655113 | US | |
| Parent | 15683765 | Aug 2017 | US |
| Child | 15931534 | US | |
| Parent | 15409510 | Jan 2017 | US |
| Child | 15683765 | US | |
| Parent | 16718906 | Dec 2019 | US |
| Child | 15931534 | US | |
| Parent | 15850037 | Dec 2017 | US |
| Child | 15879182 | US | |
| Parent | 15905041 | Feb 2018 | US |
| Child | 15931534 | US | |
| Parent | 16191054 | Nov 2018 | US |
| Child | 15905041 | US | |
| Parent | 15655113 | Jul 2017 | US |
| Child | 16191054 | US | |
| Parent | 15237625 | Aug 2016 | US |
| Child | 15655113 | US | |
| Parent | 16654309 | Oct 2019 | US |
| Child | 15931534 | US | |
| Parent | 15847443 | Dec 2017 | US |
| Child | 16654309 | US | |
| Parent | 16660727 | Oct 2019 | US |
| Child | 15931534 | US | |
| Parent | 15206195 | Jul 2016 | US |
| Child | 15229476 | US |
