Patent Grant
10862822
A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
The present disclosure relates, in general, to methods, systems, and apparatuses for implementing network services orchestration, and, in particular embodiments, to methods, systems, and computer software for implementing intent-based service configuration, service conformance, and service auditing.
In typical network resource allocation schemes, a customer might provide a request for network services from a set list of network services, which might include, among other things, information regarding one or more of specific hardware, specific hardware type, specific location, and/or specific network for providing network services, or the like. The customer might select the particular hardware, hardware type, location, and/or network based on stated or estimated performance metrics for these components or generic versions of these components, but might not convey the customer's specific desired performance parameters. The service provider then allocates network resources based on the selected one or more of specific hardware, specific hardware type, specific location, or specific network for providing network services, as indicated in the request.
Such specific requests, however, do not necessarily provide the service provider with the intent or expectations of the customer. Accordingly, the service provider will likely make network resource reallocation decisions based on what is best for the network from the perspective of the service provider, but not necessarily what is best for the customer. Importantly, these conventional systems do not utilize metadata in resource inventory databases for implementing intent-based service configuration, service conformance, and/or service auditing.
Hence, there is a need for more robust and scalable solutions for implementing network services orchestration, and, in particular embodiments, to methods, systems, and computer software for implementing intent-based service configuration, service conformance, and service auditing.
A further understanding of the nature and advantages of particular embodiments may be realized by reference to the remaining portions of the specification and the drawings, in which like reference numerals are used to refer to similar components. In some instances, a sub-label is associated with a reference numeral to denote one of multiple similar components. When reference is made to a reference numeral without specification to an existing sub-label, it is intended to refer to all such multiple similar components.
Various embodiments provide tools and techniques for implementing network services orchestration, and, in particular embodiments, to methods, systems, and computer software for implementing intent-based service configuration, service conformance, and service auditing.
In various embodiments, a computing system might receive a request for network services from a customer (e.g., from a user device associated with the customer, or the like). The request for network services might comprise desired characteristics and performance parameters for the requested network services, without information regarding any of specific hardware, specific hardware type, or specific network for providing the requested network services. The computing system might analyze first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database (e.g., a resource inventory database, or the like). Based on the analysis, the computing system might allocate at least one identified network resource among the identified one or more network resources for providing the requested network services.
The computing system might update a service database by adding or updating an entry in the service database (e.g., resource inventory database or an intent metadata database, or the like) with information indicating that the at least one identified network resource have been allocated for providing the requested network services, and might stripe the entry with second metadata (in some cases, in resource inventory database, intent metadata database, or an active inventory database, or the like) indicative of the desired characteristics and performance parameters as comprised in the request for network services.
According to some embodiments, the desired performance parameters might include, without limitation, at least one of a maximum latency, a maximum jitter, a maximum packet loss, or a maximum number of hops, and/or the like. In some embodiments, the desired characteristics might include, but are not limited to, at least one of requirement for network equipment to be geophysically proximate to the customer, requirement for network equipment to be located within a geophysical location, requirement to avoid routing network traffic through a geophysical location, requirement to route network traffic through a geophysical location, requirement to exclude a first type of network resources from fulfillment of the requested network services, requirement to include a second type of network resources for fulfillment of the requested network services, requirement to fulfill the requested network services based on a single goal indicated by the customer, or requirement to fulfill the requested network services based on multi-goals indicated by the customer, and/or the like.
Merely by way of example, in some cases, an audit engine might determine whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters via algorithm-based field extensions to its inventory and active inventory databases, or the like. The audit engine may perform pre-filtering resource selection functions and/or might check compliance of provisioned services. In some instances, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters on a periodic basis or in response to a request to perform an audit. Alternatively, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters, by: measuring one or more network performance metrics of each of the identified one or more network resources; comparing, with the audit engine, the measured one or more network performance metrics of each of the identified one or more network resources with the desired performance parameters; determining characteristics of each of the identified one or more network resources; and comparing, with the audit engine, the determined characteristics of each of the identified one or more network resources with the desired characteristics. Based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, the computing system might perform one of: reconfiguring the at least one identified network resource to provide the desired characteristics and performance parameters; or reallocating at least one other identified network resources among the identified one or more network resources for providing the requested network services.
In some aspects, each intent might be a goal for the service. These are not policy related. Intents might typically be performance related, or service component quantum oriented, which might mean delay, jitter, packet loss (performance), or service component (asset or path) types, geography, color, attribute, etc. might be considered. This means that the state engines in the service conformance (which might be on a control plane) must monitor and/or store those in local profiles for the bearer and/or service plane in order to make intent-based assignment decisions. These will require closed loop implementation, and the system might implement auditing to ensure that the state is tracked appropriately and that the network resources that are used for fulfilling requested network resources.
Importantly, the various systems utilize metadata in resource inventory databases (e.g., in resource inventory database, intent metadata database, or an active inventory database, or the like) for implementing intent-based service configuration, service conformance, and/or service auditing.
These and other functions of the system and method are described in greater detail above with respect to the figures.
The following detailed description illustrates a few exemplary embodiments in further detail to enable one of skill in the art to practice such embodiments. The described examples are provided for illustrative purposes and are not intended to limit the scope of the invention.
In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the described embodiments. It will be apparent to one skilled in the art, however, that other embodiments of the present invention may be practiced without some of these specific details. In other instances, certain structures and devices are shown in block diagram form. Several embodiments are described herein, and while various features are ascribed to different embodiments, it should be appreciated that the features described with respect to one embodiment may be incorporated with other embodiments as well. By the same token, however, no single feature or features of any described embodiment should be considered essential to every embodiment of the invention, as other embodiments of the invention may omit such features.
Unless otherwise indicated, all numbers used herein to express quantities, dimensions, and so forth used should be understood as being modified in all instances by the term “about.” In this application, the use of the singular includes the plural unless specifically stated otherwise, and use of the terms “and” and “or” means “and/or” unless otherwise indicated. Moreover, the use of the term “including,” as well as other forms, such as “includes” and “included,” should be considered non-exclusive. Also, terms such as “element” or “component” encompass both elements and components comprising one unit and elements and components that comprise more than one unit, unless specifically stated otherwise.
Various embodiments described herein, while embodying (in some cases) software products, computer-performed methods, and/or computer systems, represent tangible, concrete improvements to existing technological areas, including, without limitation, network configuration technology, network resource allocation technology, and/or the like. In other aspects, certain embodiments, can improve the functioning of a computer or network system itself (e.g., computing devices or systems that form parts of the network, computing devices or systems, network elements or the like for performing the functionalities described below, etc.), for example, by receiving, with a computing system over a network, a request for network services from a customer, the request for network services comprising desired characteristics and performance parameters for the requested network services, without information regarding any of specific hardware, specific hardware type, or specific network for providing the requested network services; analyzing, with the computing system, first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database; based on the analysis, allocating, with the computing system, at least one identified network resource among the identified one or more network resources for providing the requested network services; updating, with the computing system, a service database by adding or updating an entry in the service database with information indicating that the at least one identified network resource have been allocated for providing the requested network services; striping, with the computing system, the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services; determining, with an audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters; and based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, performing one of: reconfiguring, with the computing system, the at least one identified network resource to provide the desired characteristics and performance parameters; or reallocating, with the computing system, at least one other identified network resources among the identified one or more network resources for providing the requested network services; and/or the like.
In particular, to the extent any abstract concepts are present in the various embodiments, those concepts can be implemented as described herein by devices, software, systems, and methods that involve specific novel functionality (e.g., steps or operations), such as, utilizing metadata in resource inventory databases (e.g., in resource inventory database, intent metadata database, or an active inventory database, or the like) for implementing intent-based service configuration, service conformance, and/or service auditing, and/or the like, to name a few examples, that extend beyond mere conventional computer processing operations. These functionalities can produce tangible results outside of the implementing computer system, including, merely by way of example, ability to improve network functions, network resource allocation and utilization, and/or the like, in various embodiments based on the intent-driven requests that are tagged as metadata or the like in resource databases for network resources used to fulfill network service requests by customers, which may be observed or measured by customers and/or service providers.
In an aspect, a method might comprise receiving, with a computing system over a network, a request for network services from a customer, the request for network services comprising desired characteristics and performance parameters for the requested network services, without information regarding any of specific hardware, specific hardware type, or specific network for providing the requested network services; and analyzing, with the computing system, first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database. The method might further comprise, based on the analysis, allocating, with the computing system, at least one identified network resource among the identified one or more network resources for providing the requested network services; updating, with the computing system, a service database by adding or updating an entry in the service database with information indicating that the at least one identified network resource have been allocated for providing the requested network services; and striping, with the computing system, the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services.
In some embodiments, the computing system might comprise one of a server computer over a network, a cloud-based computing system over a network, or a distributed computing system, and/or the like. In some cases, the desired performance parameters might comprise at least one of a maximum latency, a maximum jitter, a maximum packet loss, or a maximum number of hops, and/or the like. In some instances, the desired characteristics might comprise at least one of requirement for network equipment to be geophysically proximate to the customer, requirement for network equipment to be located within a geophysical location, requirement to avoid routing network traffic through a geophysical location, requirement to route network traffic through a geophysical location, requirement to exclude a first type of network resources from fulfillment of the requested network services, requirement to include a second type of network resources for fulfillment of the requested network services, requirement to fulfill the requested network services based on a single goal indicated by the customer, or requirement to fulfill the requested network services based on multi-goals indicated by the customer, and/or the like.
According to some embodiments, the method might further comprise determining, with an audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters. In some cases, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters on a periodic basis or in response to a request to perform an audit. Alternatively, or additionally, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters, by: measuring one or more network performance metrics of each of the identified one or more network resources; comparing, with the audit engine, the measured one or more network performance metrics of each of the identified one or more network resources with the desired performance parameters; determining characteristics of each of the identified one or more network resources; and comparing, with the audit engine, the determined characteristics of each of the identified one or more network resources with the desired characteristics.
In some cases, the method might further comprise, based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, performing one of: reconfiguring, with the computing system, the at least one identified network resource to provide the desired characteristics and performance parameters; or reallocating, with the computing system, at least one other identified network resources among the identified one or more network resources for providing the requested network services.
According to some embodiments, each of the one or more network performance metrics might comprise at least one of quality of service (“QoS”) measurement data, platform resource data and metrics, service usage data, topology and reference data, historical network data, or network usage trend data, and/or the like. Alternatively, or additionally, each of the one or more network performance metrics might comprise one or more of information regarding at least one of latency, jitter, bandwidth, packet loss, nodal connectivity, compute resources, storage resources, memory capacity, routing, operations support systems (“OSS”), or business support systems (“BSS”) or information regarding at least one of fault, configuration, accounting, performance, or security (“FCAPS”), and/or the like. In some cases, the first metadata might be analyzed after being received by the computing system in response to one of a pull data distribution instruction, a push data distribution instruction, or a hybrid push-pull data distribution instruction.
In another aspect, an apparatus might comprise at least one process and a non-transitory computer readable medium communicatively coupled to the at least one processor. The non-transitory computer readable medium might have stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the apparatus to: receive, over a network, a request for network services from a customer, the request for network services comprising desired characteristics and performance parameters for the requested network services, without information regarding any of specific hardware, specific hardware type, or specific network for providing the requested network services; analyze first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database; based on the analysis, allocate at least one identified network resource among the identified one or more network resources for providing the requested network services; update a service database by adding or updating an entry in the service database with information indicating that the at least one identified network resource have been allocated for providing the requested network services; and stripe the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services.
According to some embodiments, the apparatus might comprise one of a server computer over a network, a cloud-based computing system over a network, or a distributed computing system, and/or the like. In some cases, the desired performance parameters comprise at least one of a maximum latency, a maximum jitter, a maximum packet loss, or a maximum number of hops, and/or the like. Alternatively, or additionally, the desired characteristics might comprise at least one of requirement for network equipment to be geophysically proximate to the customer, requirement for network equipment to be located within a geophysical location, requirement to avoid routing network traffic through a geophysical location, requirement to route network traffic through a geophysical location, requirement to exclude a first type of network resources from fulfillment of the requested network services, requirement to include a second type of network resources for fulfillment of the requested network services, requirement to fulfill the requested network services based on a single goal indicated by the customer, or requirement to fulfill the requested network services based on multi-goals indicated by the customer, and/or the like.
In some embodiments, the apparatus might further comprise an audit engine, which might comprise at least one second processor and a second non-transitory computer readable medium communicatively coupled to the at least one second processor. The second non-transitory computer readable medium might have stored thereon computer software comprising a second set of instructions that, when executed by the at least one second processor, causes the audit engine to: determine whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters.
In some cases, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters on a periodic basis or in response to a request to perform an audit. Alternatively, or additionally, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters, by: measuring one or more network performance metrics of each of the identified one or more network resources; comparing the measured one or more network performance metrics of each of the identified one or more network resources with the desired performance parameters; determining characteristics of each of the identified one or more network resources; and comparing the determined characteristics of each of the identified one or more network resources with the desired characteristics.
In yet another aspect, a system might comprise a computing system, which might comprise at least one first processor and a first non-transitory computer readable medium communicatively coupled to the at least one first processor. The first non-transitory computer readable medium might have stored thereon computer software comprising a first set of instructions that, when executed by the at least one first processor, causes the computing system to: receive, over a network, a request for network services from a customer, the request for network services comprising desired characteristics and performance parameters for the requested network services, without information regarding any of specific hardware, specific hardware type, or specific network for providing the requested network services; analyze first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database; based on the analysis, allocate at least one identified network resource among the identified one or more network resources for providing the requested network services; update a service database by adding or updating an entry in the service database with information indicating that the at least one identified network resource have been allocated for providing the requested network services; and stripe the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services.
In some embodiments, the computing system might comprise one of a server computer over a network, a cloud-based computing system over a network, or a distributed computing system, and/or the like.
Various modifications and additions can be made to the embodiments discussed without departing from the scope of the invention. For example, while the embodiments described above refer to particular features, the scope of this invention also includes embodiments having different combination of features and embodiments that do not include all of the above described features.
We now turn to the embodiments as illustrated by the drawings.
With reference to the figures,
In the non-limiting embodiment of
System 100 might further comprise network resources 130 that may be disposed, and/or communicatively coupled to, networks 135a-135n (collectively, “networks 135” or the like) and/or networks 140a-140n (collectively, “networks 140” or the like). The computing system 105 might analyze first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources 130 among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database, which might include, without limitation, resource inventory database 145, intent metadata database 150, data lake 170, and/or the like. Based on the analysis, the computing system 105 might allocate at least one identified network resource 130 among the identified one or more network resources 130 for providing the requested network services. The computing system 105 might stripe the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services. In some cases, striping the entry with the second metadata might comprise striping the entry in the resource inventory database 145. Alternatively, striping the entry with the second metadata might comprise striping or adding an entry in the intent metadata inventory 150, which might be part of resource inventory database 145 or might be physically separate (or logically partitioned) from the resource inventory database 145, or the like. In some cases, the first metadata might be analyzed after being received by the computing system in response to one of a pull data distribution instruction, a push data distribution instruction, or a hybrid push-pull data distribution instruction, and/or the like.
Once the at least one identified network resource 130 has been allocated or assigned, the computing system 105 might update an active inventory database 155 with such information—in some cases, by adding an entry in the active inventory database 155 with information indicating that the at least one identified network resource 130 has been allocated to provide particular requested network service(s) to customer 115. In some embodiments, the computing system 105 might stripe the added entry in the active inventory database 155 with a copy of the second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services. In some instances, the resource inventory database 145 might store an equipment record that lists every piece of inventory that is accessible by the computing system 105 (either already allocated for fulfillment of network services to existing customers or available for allocation for fulfillment of new network services to existing or new customers). The active inventory database 155 might store a circuit record listing the active inventory that are being used for fulfilling network services. The data lake 170 might store a customer record that lists the service record of customer, and/or the like.
According to some embodiments, system 100 might further comprise quality of service test and validate server or audit engine 160, which performs measurement and/or collection of network performance metrics for at least one of the one or more network resources 130 and/or the one or more networks 135 and/or 140, and/or which performs auditing to determine whether each of the identified one or more network resources 130 conforms with the desired characteristics and performance parameters. In some cases, network performance metrics might include, without limitation, at least one of quality of service (“QoS”) measurement data, platform resource data and metrics, service usage data, topology and reference data, historical network data, or network usage trend data, and/or the like. Alternatively, or additionally, network performance metrics might include, but are not limited to, one or more of information regarding at least one of latency, jitter, bandwidth, packet loss, nodal connectivity, compute resources, storage resources, memory capacity, routing, operations support systems (“OSS”), or business support systems (“BSS”) or information regarding at least one of fault, configuration, accounting, performance, or security (“FCAPS”), and/or the like, which are described in greater detail in the '244 and '884 applications, which have already been incorporated herein by reference in their entirety.
In some embodiments, computing system 105 might allocate one or more network resources 130 from one or more first networks 135a-135n of a first set of networks 135 and/or from one or more second networks 140a-140n of a second set of networks 140 for providing the requested network services, based at least in part on the desired performance parameters and/or based at least in part on a determination that the one or more first networks is capable of providing network resources each having the desired performance parameters. According to some embodiments, determination that the one or more first networks is capable of providing network resources each having the desired performance parameters is based on one or more network performance metrics of the one or more first networks at the time that the request for network services from a customer is received.
System 100 might further comprise one or more databases, including, but not limited to, a platform resource database 165a, a service usage database 165b, a topology and reference database 165c, a QoS measurement database 165d, and/or the like. The platform resource database 165a might collect and store data related or pertaining to platform resource data and metrics, or the like, while the service usage database 165b might collect and store data related or pertaining to service usage data or service profile data, and the topology and reference database 165c might collect and store data related or pertaining to topology and reference data. The QoS measurement database 165d might collect and store QoS data, network performance metrics, and/or results of the QoS test and validate process. Data stored in each of at least one of the platform resource database 165a, the service usage database 165b, the topology and reference database 165c, the QoS measurement database 165d, and/or the like, collected in data lake 170, and the collective data or selected data from the data lake 170 are used to perform optimization of network resource allocation (both physical and/or virtual) using the computing system 105 (and, in some cases, using an orchestration optimization engine (e.g., orchestration optimization engine 275 of FIG. 2 of the '244 and '884 applications), or the like).
In some embodiments, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine 160, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters on a periodic basis or in response to a request to perform an audit. Alternatively, or additionally, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters, by: measuring one or more network performance metrics of each of the identified one or more network resources; comparing, with the audit engine, the measured one or more network performance metrics of each of the identified one or more network resources with the desired performance parameters; determining characteristics of each of the identified one or more network resources; and comparing, with the audit engine, the determined characteristics of each of the identified one or more network resources with the desired characteristics.
Based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, the computing system 105 might perform one of: reconfiguring the at least one identified network resource to provide the desired characteristics and performance parameters; or reallocating at least one other identified network resources among the identified one or more network resources for providing the requested network services. In some cases, the computing system 105 might perform one of reconfiguring the at least one identified network resource or reallocating at least one other identified network resources, based on a determination that the measured one or more network performance metrics of each of the identified one or more network resources fails to match the desired performance parameters within third predetermined thresholds or based on a determination that the measured one or more network performance metrics of each of the identified one or more network resources fails to match the desired performance parameters within fourth predetermined thresholds.
In some aspects, intent might further include, without limitation, path intent, location intent, performance intent, and/or the like. Path intent, for example, might include a requirement that network traffic must be routed through a first particular geophysical location (e.g., a continent, a country, a region, a state, a province, a city, a town, a mountain range, etc.) and/or a requirement that network traffic must not be routed through a second particular geophysical location, or the like. In such cases, a service commission engine might either add (and/or mark as required) all paths through the first particular geophysical location and all network resources that indicate that they are located in the first particular geophysical location, or remove (and/or mark as excluded) all paths through the second particular geophysical location and all network resources that indicate that they are located in the second particular geophysical location. The service commission engine might use the required or non-excluded paths and network resources to identify which paths and network resources to allocate to fulfill requested network services. In some embodiments, the active inventory might be marked so that any fix or repair action is also restricted and that policy audits might be implemented to ensure no violations of path intent actually occur.
Location intent, for instance, might include a requirement that network resources that are used for fulfilling the requested network services are located in specific geographical locations (which are more specific compared to the general geophysical locations described above). In such cases, the inventory is required to include the metadata for the intent, then the service engine can perform the filtering and selection. Monitoring and/or restricting assets being reassigned may be performed using location intent policy markings (or metadata) on the service.
Performance intent, for example, might include a requirement that the requested services satisfy particular performance parameters or metrics—which might include, without limitation, maximum latency or delay, maximum jitter, maximum packet loss, maximum number of hops, minimum bandwidth, nodal connectivity, minimum amount of compute resources for each allocated network resource, minimum amount of storage resources for each allocated network resource, minimum memory capacity for each allocated network resource, fastest possible path, and/or the like. In such cases, service conformance engine might use the performance metrics (as measured by one or more nodes in the network, which in some cases might include the allocated network resource itself, or the like) between points (or network nodes) for filtering the compliant inventory options, and/or might propose higher levels of service to satisfy the customer and/or cost level alignment, or the like. Once the assignment portion of the engine has been performed, the active inventory might be marked with the appropriate performance intent policy.
In some embodiments, a SS7 advanced intelligence framework (which might have a local number portability dip to get instructions from an external advanced intelligence function) can be adapted with intent-based orchestration (as described herein) by putting a trigger (e.g., an external data dip, or the like) on the orchestrator between the requesting device or node (where the intent and intent criteria might be sent) and the source of the external function, which might scrape the inventory database to make its instructions and/or solution sets for the fulfillment engine and then stripe metadata, and/or returns that to the normal fulfillment engine.
These and other functions of the system 100 (and its components) are described in greater detail below with respect to
In the non-limiting embodiment 200 of
At block 225, the system might receive the system command (from block 205 and/or block 210) and, in response to receiving the system command, might create the new network service by standard methods of picking or selecting inventory resources to support the requested network service(s). In response, a service record (or metadata) 230 with the actively assigned resources might be sent to (and subsequently stored in) the active inventory database 235. In some embodiments, the added or striped entry in resource inventory database 215 and/or intent metadata database 220 might be sent as a service record (or metadata) 230 to the active inventory database 235. In some cases, the metadata that might be added or striped in the resource inventory database 215, the intent metadata database 220, and/or the active inventory database 235 might indicate reduced pool of resources or priority listing of resources for assignment.
In some embodiments, the system might audit the identified network resources assigned for fulfillment of the requested network service, based at least in part on the added or striped entry in the resource inventory database 215 and/or intent metadata database 220 or based at least in part on the service record 230 stored in active inventory database 235.
The non-limiting embodiment 200′ of
Given that intents are essentially automated commands, the fields or information that are passed or sent must be algorithmic-based (meaning that a compute system can use them in a command). The intent criteria (what those algorithm fields might be composed of) might become metadata for the inventory so that the intent may be executed. For example, data jurisdiction might require that the systems used must be located in Kansas (for instance). The resulting intent framework would be that the resource inventory database would be expanded for “state” and that entries for all resources in Kansas would be striped or populated with metadata indicating “Kansas.”
Another modification might be made to the service inventory or active inventory where the intent might be stored as part of the circuit record and might be used when performing audits to determine whether the service that is being provisioned on elements that meet its intent criteria.
In contrast to these systems, a conventional system—which might lack the sending of the intent and which might lack block 210 (or might have a blank or reserved block 210)—might have a standard process to create a new “service” that involves having a standard system resource definition, and a standard load balancing method of assigning resources to that service and creating a standard service record. These might utilize an inventory database, and might create service records that are stored in the active inventory as assigned services.
In the non-limiting example 300 of
As shown in
Process-wise, the “intent” translation engine might resolve a candidate list of viable resources and might remove non-compliant open inventory. A service engine might apply load balancing, prioritization, other standard service configuration and/or conformance routines, and/or the like. This may include, without limitation, pricing and/or informing a customer that his or her service level is not sufficiently high to receive that level of performance. In some cases, the selection might also be made on the customer profile, and existing service level agreements (“SLAs”) of the service, etc.
Once the service is assigned, the end-to-end performance metadata and/or the active inventory record might be marked with the corresponding or appropriate intent or policy marking or restriction, and performance monitoring might be used for automated repair actions. System stability inputs might be sent to the service conformance engine to perform audits, as described above with respect to
In the non-limiting example 400 of
Here, the intent framework might require a named goal that includes standardized criteria that may be a relationship between two items. For example, the named goal (or intent) might include, without limitation, lowest delay (where the criteria might be delay), least number of hops (where the criteria might be hops), proximity to me (in this case, the ME node 410; where the criteria might be geographical proximity, geophysical proximity, distance, etc.). In some embodiments, two or more goals (or intents) might be combined. In all cases, the criteria might be added or striped via metadata into the inventory database (e.g., databases 145, 150, 155, 170, 215, 220, and/or 235 of
In some cases, where goal-oriented intent is established, the inventory database might be augmented with tables that correlate with the “intent” criteria (such as shown in the delay table in
With reference to the non-limiting example 400′ of
Here, the exclusion and inclusion intents might modify the pool of resources that the fulfillment process might pick from by removing (i.e., excluding) or limiting (i.e., including) the resources that can be assigned to fulfill the service. Once this process is completed, then the normal fulfillment process continues on.
Referring to the non-limiting example 400″ of
In some cases, the set of resources 430′ (as shown in
While the techniques and procedures are depicted and/or described in a certain order for purposes of illustration, it should be appreciated that certain procedures may be reordered and/or omitted within the scope of various embodiments. Moreover, while the method 500 illustrated by
In the non-limiting embodiment of
At block 510, method 500 might comprise analyzing, with the computing system, first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database. In some cases, the first metadata might be analyzed after being received by the computing system in response to one of a pull data distribution instruction, a push data distribution instruction, or a hybrid push-pull data distribution instruction.
Method 500 might further comprise, based on the analysis, allocating, with the computing system, at least one identified network resource among the identified one or more network resources for providing the requested network services (block 515). Method 500 might further comprise, at block 520, updating, with the computing system, a service database by adding or updating an entry in the service database with information indicating that the at least one identified network resource have been allocated for providing the requested network services. At block 525, method 500 might comprise striping, with the computing system, the entry with second metadata indicative of the desired characteristics and performance parameters as comprised in the request for network services.
Method 500, at optional block 530, might comprise determining, with an audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters. Based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, method 500 might further comprise one of: reconfiguring, with the computing system, the at least one identified network resource to provide the desired characteristics and performance parameters (optional block 535); or reallocating, with the computing system, at least one other identified network resources among the identified one or more network resources for providing the requested network services (optional block 540).
With reference to
In some embodiments, each of the one or more network performance metrics might include, without limitation, at least one of quality of service (“QoS”) measurement data, platform resource data and metrics, service usage data, topology and reference data, historical network data, or network usage trend data, and/or the like. Alternatively, or additionally, each of the one or more network performance metrics might include, but are not limited to, one or more of information regarding at least one of latency, jitter, bandwidth, packet loss, nodal connectivity, compute resources, storage resources, memory capacity, routing, operations support systems (“OSS”), or business support systems (“BSS”) or information regarding at least one of fault, configuration, accounting, performance, or security (“FCAPS”), and/or the like.
The computer or hardware system 600—which might represent an embodiment of the computer or hardware system (i.e., computing system 105, user devices 120a-120n, network resources 130, QoS test and validate server 160, etc.), described above with respect to
The computer or hardware system 600 may further include (and/or be in communication with) one or more storage devices 625, which can comprise, without limitation, local and/or network accessible storage, and/or can include, without limitation, a disk drive, a drive array, an optical storage device, solid-state storage device such as a random access memory (“RAM”) and/or a read-only memory (“ROM”), which can be programmable, flash-updateable, and/or the like. Such storage devices may be configured to implement any appropriate data stores, including, without limitation, various file systems, database structures, and/or the like.
The computer or hardware system 600 might also include a communications subsystem 630, which can include, without limitation, a modem, a network card (wireless or wired), an infra-red communication device, a wireless communication device and/or chipset (such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMax device, a WWAN device, cellular communication facilities, etc.), and/or the like. The communications subsystem 630 may permit data to be exchanged with a network (such as the network described below, to name one example), with other computer or hardware systems, and/or with any other devices described herein. In many embodiments, the computer or hardware system 600 will further comprise a working memory 635, which can include a RAM or ROM device, as described above.
The computer or hardware system 600 also may comprise software elements, shown as being currently located within the working memory 635, including an operating system 640, device drivers, executable libraries, and/or other code, such as one or more application programs 645, which may comprise computer programs provided by various embodiments (including, without limitation, hypervisors, VMs, and the like), and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein. Merely by way of example, one or more procedures described with respect to the method(s) discussed above might be implemented as code and/or instructions executable by a computer (and/or a processor within a computer); in an aspect, then, such code and/or instructions can be used to configure and/or adapt a general purpose computer (or other device) to perform one or more operations in accordance with the described methods.
A set of these instructions and/or code might be encoded and/or stored on a non-transitory computer readable storage medium, such as the storage device(s) 625 described above. In some cases, the storage medium might be incorporated within a computer system, such as the system 600. In other embodiments, the storage medium might be separate from a computer system (i.e., a removable medium, such as a compact disc, etc.), and/or provided in an installation package, such that the storage medium can be used to program, configure, and/or adapt a general purpose computer with the instructions/code stored thereon. These instructions might take the form of executable code, which is executable by the computer or hardware system 600 and/or might take the form of source and/or installable code, which, upon compilation and/or installation on the computer or hardware system 600 (e.g., using any of a variety of generally available compilers, installation programs, compression/decompression utilities, etc.) then takes the form of executable code.
It will be apparent to those skilled in the art that substantial variations may be made in accordance with specific requirements. For example, customized hardware (such as programmable logic controllers, field-programmable gate arrays, application-specific integrated circuits, and/or the like) might also be used, and/or particular elements might be implemented in hardware, software (including portable software, such as applets, etc.), or both. Further, connection to other computing devices such as network input/output devices may be employed.
As mentioned above, in one aspect, some embodiments may employ a computer or hardware system (such as the computer or hardware system 600) to perform methods in accordance with various embodiments of the invention. According to a set of embodiments, some or all of the procedures of such methods are performed by the computer or hardware system 600 in response to processor 610 executing one or more sequences of one or more instructions (which might be incorporated into the operating system 640 and/or other code, such as an application program 645) contained in the working memory 635. Such instructions may be read into the working memory 635 from another computer readable medium, such as one or more of the storage device(s) 625. Merely by way of example, execution of the sequences of instructions contained in the working memory 635 might cause the processor(s) 610 to perform one or more procedures of the methods described herein.
The terms “machine readable medium” and “computer readable medium,” as used herein, refer to any medium that participates in providing data that causes a machine to operate in a specific fashion. In an embodiment implemented using the computer or hardware system 600, various computer readable media might be involved in providing instructions/code to processor(s) 610 for execution and/or might be used to store and/or carry such instructions/code (e.g., as signals). In many implementations, a computer readable medium is a non-transitory, physical, and/or tangible storage medium. In some embodiments, a computer readable medium may take many forms, including, but not limited to, non-volatile media, volatile media, or the like. Non-volatile media includes, for example, optical and/or magnetic disks, such as the storage device(s) 625. Volatile media includes, without limitation, dynamic memory, such as the working memory 635. In some alternative embodiments, a computer readable medium may take the form of transmission media, which includes, without limitation, coaxial cables, copper wire, and fiber optics, including the wires that comprise the bus 605, as well as the various components of the communication subsystem 630 (and/or the media by which the communications subsystem 630 provides communication with other devices). In an alternative set of embodiments, transmission media can also take the form of waves (including without limitation radio, acoustic, and/or light waves, such as those generated during radio-wave and infra-red data communications).
Common forms of physical and/or tangible computer readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read instructions and/or code.
Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to the processor(s) 610 for execution. Merely by way of example, the instructions may initially be carried on a magnetic disk and/or optical disc of a remote computer. A remote computer might load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and/or executed by the computer or hardware system 600. These signals, which might be in the form of electromagnetic signals, acoustic signals, optical signals, and/or the like, are all examples of carrier waves on which instructions can be encoded, in accordance with various embodiments of the invention.
The communications subsystem 630 (and/or components thereof) generally will receive the signals, and the bus 605 then might carry the signals (and/or the data, instructions, etc. carried by the signals) to the working memory 635, from which the processor(s) 605 retrieves and executes the instructions. The instructions received by the working memory 635 may optionally be stored on a storage device 625 either before or after execution by the processor(s) 610.
As noted above, a set of embodiments comprises methods and systems for implementing network services orchestration, and, in particular embodiments, to methods, systems, and computer software for implementing intent-based service configuration, service conformance, and service auditing.
Certain embodiments operate in a networked environment, which can include a network(s) 710. The network(s) 710 can be any type of network familiar to those skilled in the art that can support data communications using any of a variety of commercially-available (and/or free or proprietary) protocols, including, without limitation, TCP/IP, SNA™, IPX™, AppleTalk™, and the like. Merely by way of example, the network(s) 710 (similar to network(s) 110, 125, 135a-135n, and 140a-140n of
Embodiments can also include one or more server computers 715. Each of the server computers 715 may be configured with an operating system, including, without limitation, any of those discussed above, as well as any commercially (or freely) available server operating systems. Each of the servers 715 may also be running one or more applications, which can be configured to provide services to one or more clients 705 and/or other servers 715.
Merely by way of example, one of the servers 715 might be a data server, a web server, a cloud computing device(s), or the like, as described above. The data server might include (or be in communication with) a web server, which can be used, merely by way of example, to process requests for web pages or other electronic documents from user computers 705. The web server can also run a variety of server applications, including HTTP servers, FTP servers, CGI servers, database servers, Java servers, and the like. In some embodiments of the invention, the web server may be configured to serve web pages that can be operated within a web browser on one or more of the user computers 705 to perform methods of the invention.
The server computers 715, in some embodiments, might include one or more application servers, which can be configured with one or more applications accessible by a client running on one or more of the client computers 705 and/or other servers 715. Merely by way of example, the server(s) 715 can be one or more general purpose computers capable of executing programs or scripts in response to the user computers 705 and/or other servers 715, including, without limitation, web applications (which might, in some cases, be configured to perform methods provided by various embodiments). Merely by way of example, a web application can be implemented as one or more scripts or programs written in any suitable programming language, such as Java™, C, C#™ or C++, and/or any scripting language, such as Perl, Python, or TCL, as well as combinations of any programming and/or scripting languages. The application server(s) can also include database servers, including, without limitation, those commercially available from Oracle™, Microsoft™, Sybase™, IBM™, and the like, which can process requests from clients (including, depending on the configuration, dedicated database clients, API clients, web browsers, etc.) running on a user computer, user device, or customer device 705 and/or another server 715. In some embodiments, an application server can perform one or more of the processes for implementing network services orchestration, and, in particular embodiments, to methods, systems, and computer software for implementing intent-based service configuration, service conformance, and service auditing, as described in detail above. Data provided by an application server may be formatted as one or more web pages (comprising HTML, JavaScript, etc., for example) and/or may be forwarded to a user computer 705 via a web server (as described above, for example). Similarly, a web server might receive web page requests and/or input data from a user computer 705 and/or forward the web page requests and/or input data to an application server. In some cases, a web server may be integrated with an application server.
In accordance with further embodiments, one or more servers 715 can function as a file server and/or can include one or more of the files (e.g., application code, data files, etc.) necessary to implement various disclosed methods, incorporated by an application running on a user computer 705 and/or another server 715. Alternatively, as those skilled in the art will appreciate, a file server can include all necessary files, allowing such an application to be invoked remotely by a user computer, user device, or customer device 705 and/or server 715.
It should be noted that the functions described with respect to various servers herein (e.g., application server, database server, web server, file server, etc.) can be performed by a single server and/or a plurality of specialized servers, depending on implementation-specific needs and parameters.
In certain embodiments, the system can include one or more databases 720a-720n (collectively, “databases 720”). The location of each of the databases 720 is discretionary: merely by way of example, a database 720a might reside on a storage medium local to (and/or resident in) a server 715a (and/or a user computer, user device, or customer device 705). Alternatively, a database 720n can be remote from any or all of the computers 705, 715, so long as it can be in communication (e.g., via the network 710) with one or more of these. In a particular set of embodiments, a database 720 can reside in a storage-area network (“SAN”) familiar to those skilled in the art. (Likewise, any necessary files for performing the functions attributed to the computers 705, 715 can be stored locally on the respective computer and/or remotely, as appropriate.) In one set of embodiments, the database 720 can be a relational database, such as an Oracle database, that is adapted to store, update, and retrieve data in response to SQL-formatted commands. The database might be controlled and/or maintained by a database server, as described above, for example.
According to some embodiments, system 700 might further comprise computing system 725 (similar to computing systems 105 of
In operation, computing system 725 might receive a request for network services from a customer (e.g., from user device 705a or 705b (which might correspond to user devices 120a-120n of
The computing system 725 might analyze first metadata regarding resource attributes and characteristics of a plurality of unassigned network resources to identify one or more network resources among the plurality of unassigned network resources for providing the requested network services, the first metadata having been striped to entries of the plurality of unassigned network resources in a resource database (e.g., resource inventory database 740, or the like). Based on the analysis, the computing system 725 might allocate at least one identified network resource among the identified one or more network resources for providing the requested network services.
The computing system 725 might update a service database by adding or updating an entry in the service database (e.g., resource inventory database 740 or intent metadata database 745, or the like) with information indicating that the at least one identified network resource have been allocated for providing the requested network services, and might stripe the entry with second metadata (in some cases, in resource inventory database 740, intent metadata database 745, or active inventory database 750, or the like) indicative of the desired characteristics and performance parameters as comprised in the request for network services.
According to some embodiments, the desired performance parameters might include, without limitation, at least one of a maximum latency, a maximum jitter, a maximum packet loss, or a maximum number of hops, and/or the like. In some embodiments, the desired characteristics might include, but are not limited to, at least one of requirement for network equipment to be geophysically proximate to the customer, requirement for network equipment to be located within a geophysical location, requirement to avoid routing network traffic through a geophysical location, requirement to route network traffic through a geophysical location, requirement to exclude a first type of network resources from fulfillment of the requested network services, requirement to include a second type of network resources for fulfillment of the requested network services, requirement to fulfill the requested network services based on a single goal indicated by the customer, or requirement to fulfill the requested network services based on multi-goals indicated by the customer, and/or the like.
Merely by way of example, in some cases, the audit engine 730 might determine whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters. In some instances, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters on a periodic basis or in response to a request to perform an audit. Alternatively, determining whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters might comprise determining, with the audit engine, whether each of the identified one or more network resources conforms with the desired characteristics and performance parameters, by: measuring one or more network performance metrics of each of the identified one or more network resources; comparing, with the audit engine, the measured one or more network performance metrics of each of the identified one or more network resources with the desired performance parameters; determining characteristics of each of the identified one or more network resources; and comparing, with the audit engine, the determined characteristics of each of the identified one or more network resources with the desired characteristics. Based on a determination that at least one identified network resource among the identified one or more network resources fails to conform with the desired performance parameters within first predetermined thresholds or based on a determination that the determined characteristics of the at least one identified network resource fails to conform with the desired characteristics within second predetermined thresholds, the computing system 725 might perform one of: reconfiguring the at least one identified network resource to provide the desired characteristics and performance parameters; or reallocating at least one other identified network resources among the identified one or more network resources for providing the requested network services.
These and other functions of the system 700 (and its components) are described in greater detail above with respect to
While certain features and aspects have been described with respect to exemplary embodiments, one skilled in the art will recognize that numerous modifications are possible. For example, the methods and processes described herein may be implemented using hardware components, software components, and/or any combination thereof. Further, while various methods and processes described herein may be described with respect to particular structural and/or functional components for ease of description, methods provided by various embodiments are not limited to any particular structural and/or functional architecture but instead can be implemented on any suitable hardware, firmware and/or software configuration. Similarly, while certain functionality is ascribed to certain system components, unless the context dictates otherwise, this functionality can be distributed among various other system components in accordance with the several embodiments.
Moreover, while the procedures of the methods and processes described herein are described in a particular order for ease of description, unless the context dictates otherwise, various procedures may be reordered, added, and/or omitted in accordance with various embodiments. Moreover, the procedures described with respect to one method or process may be incorporated within other described methods or processes; likewise, system components described according to a particular structural architecture and/or with respect to one system may be organized in alternative structural architectures and/or incorporated within other described systems. Hence, while various embodiments are described with—or without—certain features for ease of description and to illustrate exemplary aspects of those embodiments, the various components and/or features described herein with respect to a particular embodiment can be substituted, added and/or subtracted from among other described embodiments, unless the context dictates otherwise. Consequently, although several exemplary embodiments are described above, it will be appreciated that the invention is intended to cover all modifications and equivalents within the scope of the following claims.
This application is a continuation application of U.S. patent application Ser. No. 16/277,498 (the “'498 Application”), filed Feb. 15, 2019 by Michael K. Bugenhagen et al., entitled, “Method and System for Implementing Intent-Based Service Configuration, Service Conformance, and Service Auditing,” which claims priority to U.S. Patent Application Ser. No. 62/774,776 (the “'776 Application”), filed Dec. 3, 2018 by Michael K. Bugenhagen et al., entitled, “Method and System for Implementing Intent-Based Service Configuration, Service Conformance, and Service Auditing,” and U.S. Patent Application Ser. No. 62/748,949 (the “'949 Application”), filed Oct. 22, 2018 by Michael K. Bugenhagen, entitled, “AI Self Adjusting Equality of Outcome ML Engine for Fairness Routines,” the disclosure of each of which is incorporated herein by reference in its entirety for all purposes. This application is a continuation-in-part application of U.S. patent application Ser. No. 15/857,244 (the “'244 Application”; now U.S. Pat. No. 10,250,525), filed Dec. 28, 2017 by Kevin McBride et al., entitled, “Intent-Based Services Orchestration,” which is a continuation of U.S. patent application Ser. No. 14/983,884 (the “'884 Application”; now U.S. Pat. No. 9,882,833) filed Dec. 30, 2015 by Kevin McBride et al., entitled, “Intent-Based Services Orchestration,” which claims priority to U.S. Patent Application Ser. No. 62/247,294 (the “'294 Application”) filed Oct. 28, 2015 by Kevin McBride et al., entitled, “Intent-Based Services Orchestration,” and U.S. Patent Application Ser. No. 62/233,911 (the “'911 Application”) filed Sep. 28, 2015 by Kevin McBride et al., entitled, “Intent-Based Services Orchestration,” the disclosure of which is incorporated herein by reference in its entirety for all purposes. The respective disclosures of these applications/patents (which this document refers to collectively as the “Related Applications”) are incorporated herein by reference in their entirety for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7254645 | Nishi | Aug 2007 | B2 |
| 7948909 | Bugenhagen | May 2011 | B2 |
| 9356883 | Borthakur | May 2016 | B1 |
| 20020059416 | Tuunanen | May 2002 | A1 |
| 20020152305 | Jackson | Oct 2002 | A1 |
| 20080002677 | Bugenhagen | Jan 2008 | A1 |
| 20080049639 | Wiley | Feb 2008 | A1 |
| 20080052387 | Heinz | Feb 2008 | A1 |
| 20150150020 | Duttagupta et al. | May 2015 | A1 |
| 20190182177 | Bugenhagen et al. | Jun 2019 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20200067848 A1 | Feb 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62774776 | Dec 2018 | US | |
| 62748949 | Oct 2018 | US | |
| 62247294 | Oct 2015 | US | |
| 62233911 | Sep 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16277498 | Feb 2019 | US |
| Child | 16670634 | US | |
| Parent | 14983884 | Dec 2015 | US |
| Child | 15857244 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15857244 | Dec 2017 | US |
| Child | 16277498 | US |
