Patent Application
20200005161
Predictive analytics can guide organizations in making informed decisions. According to predictive analytics, predictive models are “learned” based on large volumes of historical data and the models are then deployed in a production environment to predict future scenarios. The production environment may require the predictive model to be described in a particular format, such as Structured Query Language or the like.
It may be difficult to generate a learned predictive model in a format required by a production environment. Optimization of such a predictive model for the production environment presents further difficulties which may be best handled by developers of the production environment. Accordingly, what is needed is a system to efficiently describe predictive models in an agnostic and parseable manner.
Features and advantages of the example embodiments, and the manner in which the same are accomplished, will become more readily apparent with reference to the following detailed description taken in conjunction with the accompanying drawings.
Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals will be understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated or adjusted for clarity, illustration, and/or convenience.
In the following description, specific details are set forth in order to provide a thorough understanding of the various example embodiments. It should be appreciated that various modifications to the embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the disclosure. Moreover, in the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art should understand that embodiments may be practiced without the use of these specific details. In other instances, well-known structures and processes are not shown or described in order not to obscure the description with unnecessary detail. Thus, the present disclosure is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
The example embodiments are directed to a system and method for generating a specification which includes a description of a predictive formula (regression, classification, etc.) (i.e., a predictive model). The specification may be in JavaScript Object Notation (JSON) format and may include a definition of the predictive model along with transformations applied on raw data and influencers (variables of the model). The JSON format is not program code but is a description that can be parsed by a consumer system to extract the predictive formula therefrom and any other information needed, and integrated within applications written in multiple types of programming languages. By generating the specification, the example embodiments enable an application developer/consumer to integrate the predictive model in a manner that best suits the application.
The specification may be generated by a producing system in a test environment. In some embodiments, the specification may be exported to a consuming system in a production environment, which parses the specification to extract the predictive model and generates native code to implement the predictive model. The predictive model described by the specification may include equations (polynomials) having variables, data ranges, and the like. For example, the predictive model may include an encoding function to be applied on each variable of the model, and formulas to compute various predictive indicators based on the model.
A predictive model may be trained (e.g., through machine learning) using historical data as is known in the art and may be used to provide a prediction based on new/live data. Predictive models can be applied to various domains such as supply chain, weather, machine/equipment assets, maintenance, and the like. The predictive model may be trained based on patterns, trends, anomalies, and the like, identified within historical data. As a non-limiting example, a predictive model may include a sum of different variables with a coefficient. Examples of predictive model types include regression, classification, clustering, time-series, and the like.
The example embodiments include a specification that identifies transformations applied on variables, encoding information, and formulas. The specification may define all transformations steps applied on the variables until the value of the predictive indicator is reached.
Within the testing environment 110, users such as a data scientist may build (train) the predictive model 114 based on historical training data 112. The users may look for bugs, design defects, and the like, while evaluating a performance of the predictive model 114 through an iterative process. Meanwhile, the production environment 120 is where the model 114 may be deployed and put into operation for its intended use. For example, the predictive model 114 may be deployed from the testing environment 110 into the productive environment 120 and integrated with application 122.
In industrial use cases, the testing environment 110 where changes are originally made and the production environment 120 (what end users use) are separated through several stages in between. This structured release management process allows for phased deployment (rollout), testing, and rollback in case of problems. The phased deployment may include various stages which may include an initial hypothesis stage where a hypothesis is proposed, a load and transform data stage where data relevant to the hypothesis is collected and converted to fit a framework, a feature identification stage where data scientists can tailor a model before building it, a model building stage where one or more machine learning algorithms may be selected based on various factors (data, use case, available computational resources, etc.) and used to created predictive model 114, an evaluation stage where the predictive model 114 is evaluated with test data, and a deployment stage where the fully trained predictive model 114 is launched or otherwise deployed into the live production environment 120 where it can generate and output predictions based on live data 124.
According to various embodiments, when the predictive model 114 is deployed from the testing environment 110 into the production environment 120, one or more of the testing platform 101 and the host platform 102 may generate a specification describing the predictive model in a generic format. The specification can be parsed and integrated into the application 122 in order to deploy the predictive model 114.
In some embodiments, a user interface enables a user to select one or more predictive models which may be deployed and integrated with an application. For example, the user interface may display or otherwise output a list of predictive models available for integration within an application. In order to integrate a predictive model into the application, a process 200 shown in
Referring to
The format specification 230 describes the predictive model 210 in a format that can be parsed by a consuming system 240 to extract the model and freely integrate the model within an application 250. All subsequent processing applied on variables within the formulas can be defined and may include internal transformations applied on input variables to derive additional variables, encoding of the variables, computation of predicted values from the encoded variables, and the like.
Referring to
In the example of
The influencers of the equation object may contain a lists of variables taken into account in the equation. For example, the influencers can be encoded variables which are defined in the influencers property, predictive indicators defined in the equation property, or the like. The equation input variable may be the sum of all the variables.
Referring to
Referring to
Referring to
In 420, the method may include generating a specification for the predictive model, the specification comprising a description of a predictive formula of the predictive model in a format that is configured to be parsed and integrated into a predictive analytic. For example, the specification may be in a JSON format that is capable of being parsed and exported or otherwise integrated into a predictive analytic application regardless of a programming language used to develop the predictive analytic application. The formula may be a trained formula that performs a type of prediction such as a classification or a regression.
In some embodiments, the format specification may further include information describing internal transformations that are applied on input variables of the predictive formula to generate additional variables of the predictive formula. In some embodiments, the format specification may include a description of a plurality of predictive formulas corresponding to a plurality of steps of the predictive model. In some embodiments, the format specification may include encoding information of variables of the predictive formula. In some embodiments, the generating at 420 may include exporting the predictive formula from the predictive model to the format of the specification.
In 430, the method may include storing the generated specification in memory. The specification may be stored in association with the predictive model, or in place of the predictive model and may be exported into a live environment where it can be parsed and the predictive model can be integrated into a predictive analytics application. In some embodiments, the method may further include the parsing and the integrating of the specification.
The network interface 510 may transmit and receive data over a network such as the Internet, a private network, a public network, an enterprise network, and the like. The network interface 510 may be a wireless interface, a wired interface, or a combination thereof. The processor 520 may include one or more processing devices each including one or more processing cores. In some examples, the processor 520 is a multicore processor or a plurality of multicore processors. Also, the processor 520 may be fixed or it may be reconfigurable. The output 530 may output data to an embedded display of the computing system 500, an externally connected display, a display connected to the cloud, another device, and the like. For example, the output 530 may include a port, an interface, a cable, a wire, a board, and/or the like, with input/output capabilities. The network interface 510, the output 530, or a combination thereof, may interact with applications executing on other devices. The storage device 540 is not limited to a particular storage device and may include any known memory device such as RAM, NRAM, ROM, hard disk, and the like, and may or may not be included within the cloud environment. The storage 540 may store software modules or other instructions which can be executed by the processor 520 to perform the method 400 shown in
According to various embodiments, the processor 520 may receive a predictive model developed via a test environment, and generate a specification describing the predictive model. According to various embodiments, the specification may include a description of the predictive model in a generic format that is configured to be parsed and integrated into a predictive analytics application. Furthermore, the storage device 540 (e.g., memory, etc.) may store the generated specification. For example, the predictive model may include one of a regression formula and a classification formula which is described in a generic format within the specification. In some embodiments, the specification may conform to JSON format.
In some embodiments, the specification may further include information about internal transformations that are applied on variables of the predictive model. In some embodiments, the specification may include a plurality of formulas corresponding to the predictive model. In some embodiments, the specification may further include encoding information of variables of the predictive model. In some embodiments, the processor 520 may export the predictive model to the format of the specification. In some embodiments, the processor 520 may further parse the specification to integrate the predictive model within a predictive analytics application.
As will be appreciated based on the foregoing specification, the above-described examples of the disclosure may be implemented using computer programming or engineering techniques including computer software, firmware, hardware or any combination or subset thereof. Any such resulting program, having computer-readable code, may be embodied or provided within one or more non-transitory computer-readable media, thereby making a computer program product, i.e., an article of manufacture, according to the discussed examples of the disclosure. For example, the non-transitory computer-readable media may be, but is not limited to, a fixed drive, diskette, optical disk, magnetic tape, flash memory, external drive, semiconductor memory such as read-only memory (ROM), random-access memory (RAM), and/or any other non-transitory transmitting and/or receiving medium such as the Internet, cloud storage, the Internet of Things (IoT), or other communication network or link. The article of manufacture containing the computer code may be made and/or used by executing the code directly from one medium, by copying the code from one medium to another medium, or by transmitting the code over a network.
The computer programs (also referred to as programs, software, software applications, “apps”, or code) may include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms “machine-readable medium” and “computer-readable medium” refer to any computer program product, apparatus, cloud storage, internet of things, and/or device (e.g., magnetic discs, optical disks, memory, programmable logic devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The “machine-readable medium” and “computer-readable medium,” however, do not include transitory signals. The term “machine-readable signal” refers to any signal that may be used to provide machine instructions and/or any other kind of data to a programmable processor.
The above descriptions and illustrations of processes herein should not be considered to imply a fixed order for performing the process steps. Rather, the process steps may be performed in any order that is practicable, including simultaneous performance of at least some steps. Although the disclosure has been described in connection with specific examples, it should be understood that various changes, substitutions, and alterations apparent to those skilled in the art can be made to the disclosed embodiments without departing from the spirit and scope of the disclosure as set forth in the appended claims.
