Patent Application
20240135251
Embodiments described herein generally relate to artificial intelligence and in particular, but without limitation, to an artificial intelligence controller that selects an artificial intelligence algorithm for a software application component.
Many software applications rely on artificial intelligence (AI) to make decisions during normal operation. Games, in particular, use AI to determine state changes controlled by a computer, recommend state changes, and determine strategies. However, software applications are often limited to use of a prearranged AI algorithm for a given situation.
In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. Like numerals having different letter suffixes may represent different instances of similar components. Some embodiments are illustrated by way of example, and not limitation, in the figures of the accompanying drawings in which:
Presented herein are systems and methods for using an artificial intelligence (AI) controller to select an AI algorithm for use in a software application component. In the context of this disclosure, an AI controller is a simulated intelligence incorporating algorithms to satisfy conditions. AI in general in this disclosure may include aspects of machine learning, optimization using an objective function, incorporating feedback, or applying an algorithm to determine an output or set of outputs from an input or set of inputs. In this disclosure, an AI algorithm includes algorithms to solve particular technical problems based on state information and at least one end condition of a software application component. The AI algorithms may include, but are not limited to, a minmax algorithm, a Monte Carlo algorithm, a neural net algorithm, a decision tree algorithm, a Q-learning algorithm, or the like.
In an example, the AI controller 106 receives state information and an end condition and selects an AI algorithm from a plurality of AI algorithms (e.g. from the AI algorithm database 108) for the software application component 104. The state information may include a number of entities in the software application component, what potential state changes are available to each of those entities at a given time (e.g., for a game like chess, moving a piece on the board), or the like. An end condition may include a score for an entity, such as a relative score for a player against other players (e.g., who is winning) a ranking, an absolute score, or a strategic value of a potential state change.
In an example, the AI controller 106 may simulate AI algorithms from the plurality of AI algorithms applied to the software application component 104 or aspects of the software application component 104 to select an AI algorithm. For example an AI algorithm may include a minmax algorithm, which is computationally complex but guaranteed to give an optimal solution or a Monte Carlo algorithm, which is computationally cheap, but gives a potentially suboptimal solution. In an example, if the AI controller 106 determines from the state information that there are many potential state changes and a solution is needed quickly, the AI controller 106 may select the Monte Carlo algorithm. In another example, if the AI controller 106 determines from the state information that an optimal solution is desirable, the AI controller 106 may select the minmax algorithm. For example, an optimal solution would be desirable when possible (e.g., a short computational time to determine the optimal solution), or when accuracy is preferable over timeliness (e.g., when a user selects this preference or when the AI controller 106 determines the current state information implies at a particularly important decision).
In an example, the AI algorithm database 108 may be downloaded to the device 102 periodically. In another example, the software application component 104 may receive a third-party update, which may alter the AI controller 106 to change an AI algorithm, add an AI algorithm, or drop an AI algorithm to be used in the software application component 104. In an example, the state information may be identified by a third-party developer of the software application component. The state information may be filtered or normalized for use with the AI controller.
An AI algorithm may be used for various purposes in the software application component. In an example, the AI algorithm may be used to recommend one or more potential moves to a player-controlled side. In another example, the AI algorithm may be used to determine a next move for a computer-controlled side. Given a number of potential state changes (moves) for the top side, a particular AI algorithm may be more appropriate than others.
For example, in the first state 200A, exhaustively running an algorithm to find a solution to the board that guarantees a particular end condition, such as a minmax algorithm, may take too long to run on a device, may be difficult or impossible to implement, or may require more processing power than is available. Instead, given the potential state changes in the first state 200A, an AI controller may select an approximating AI algorithm, such as a Monte Carlo algorithm.
In other examples, the software application component may be another type of game or app, and may include other types of potential state changes or end conditions. In an example, a predetermined skill level for a side or a particular strategy may be used as state information to select an appropriate AI algorithm. For example, a strategy may include focusing on performance, high quality, trap avoidance, minimizing time, effectiveness of the AI (e.g., ruthlessness), such as high difficulty, medium, or low, balanced performance, or the like.
The chess example shown in
As the example game illustrated in
The AI algorithm determination component 308 may be used to interpret the state information and select an AI algorithm from a plurality of AI algorithms for use by the software application component based on the interpreted state information. The transmission reception component 310 may be used to transmit an AI algorithm communication indicating the selected AI algorithm (e.g., selected by the AI determination component 308) for use in the software application component on the device. The plurality of AI algorithms may be stored in the memory 306, or in an external database. The processor 304 may be used to implement the components 308 or 310 to perform operations. In an example, the AI controller 302 may be run as a network service, run on a local device, or run partially as a cloud service and partially on a local device.
For example, using a map app, an end condition may include finding an optimal route (e.g., quickest, least traffic, no highways, etc.) to a destination. The potential state changes include streets, turns, etc., To find the optimal route, the AI controller may provide each AI algorithm the possible routes, and select which AI algorithm should be used to predict the optimal route given the potential state changes, time limits, computational limits, etc. In another example, the method 400 may include determining an AI algorithm for use in routing airplanes, packages, or other shipments or traffic to find the optimal routes to get to different locations.
In an example, the at least one potential state change available to the software application component includes an active potential state change where a representative entity changes a position with respect to a game area (e.g., a game area on a display, a stored representation of a game area, a map, or the like) and an inactive potential state change where a representative entity remains still. For example, in a game, a potential state change may include a move or inaction by a piece. In an example, the metrics associated with the at least one end condition include at least one of a relative set of scores, an absolute set of scores, or a ranking of players. In an example, the software application component is a game and the state information for the software application component includes a win condition.
At operation 404, the method 400 includes interpreting the state information. In an example, interpreting the state information includes parsing the state information. At operation 406, the method 400 includes selecting an AI algorithm from a plurality of AI algorithms for use by the software application component based on the interpreted state information.
In an example, selecting the AI algorithm includes comparing the state information to conditions in a database. The conditions may include previously used AI algorithms for given state information, including relative success or satisfaction with the AI algorithms and the given state information. The conditions may include threshold potential state changes (e.g., when above a threshold, a first set of AI algorithms is included in the plurality of AI algorithms and when below the threshold, a second set of AI algorithms is included in the plurality of AI algorithms). The conditions may change depending on the software application component where the AI algorithm is to be applied (e.g., the plurality of AI algorithms may be predetermined for a specific software application component or for a type of software application component).
In another example, an AI controller may determine and associate a score for the plurality of AI algorithms and select an AI algorithm based on the score. In one example an AI algorithm with the highest (or lowest) score is selected. The determined score may be dependent on the potential state changes or the end condition, computational complexity, an anticipated or approximate time to an output, a skill level, or the like. In an example, selecting the AI algorithm includes evaluating a computational complexity of simulating the software application component using the state information for the plurality of AI algorithms. In an example, the AI algorithm is selected from a minmax algorithm, a Monte Carlo algorithm, a neural net algorithm, a decision tree algorithm, a Q-learning algorithm, or the like.
At operation 408, the method 400 includes transmitting an AI algorithm communication, the AI algorithm communication indicating the selected AI algorithm for use in the software application component on the device. In an example, the AI algorithm communication includes at least one AI algorithm. In another example, the AI algorithm communication includes an identity of at least one AI algorithm that is stored locally on the device.
At operation 508, the method 500 includes using the selected AI algorithm in the software application component. The selected AI algorithm may be a previously unused AI algorithm or may be an AI algorithm already previously used. To implement the selected AI algorithm in the software application component, the software application component may run scenarios or probabilities using the selected AI algorithm on current state information of the software application component. For example, the software application component may use the selected AI algorithm to determine and recommend a state change, to determine a computer-controlled state change, or determine and recommend a strategy (e.g., a plurality of state changes or a potential future state change).
Embodiments described herein may be implemented in one or a combination of hardware, firmware, and software. Embodiments may also be implemented as instructions stored on a machine-readable storage device, which may be read and executed by at least one processor to perform the operations described herein. A machine-readable storage device may include any non-transitory mechanism for storing information in a form readable by a machine (e.g., a computer). For example, a machine-readable storage device may include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, and other storage devices and media.
Examples, as described herein, may include, or may operate on, logic or a number of components, modules, or mechanisms. Modules may be hardware, software, or firmware communicatively coupled to one or more processors in order to carry out the operations described herein. Modules may hardware modules, and as such modules may be considered tangible entities capable of performing specified operations and may be configured or arranged in a certain manner. In an example, circuits may be arranged (e.g., internally or with respect to external entities such as other circuits) in a specified manner as a module. In an example, the whole or part of one or more computer systems (e.g., a standalone, client or server computer system) or one or more hardware processors may be configured by firmware or software (e.g., instructions, an application portion, or an application) as a module that operates to perform specified operations. In an example, the software may reside on a machine-readable medium. In an example, the software, when executed by the underlying hardware of the module, causes the hardware to perform the specified operations. Accordingly, the term hardware module is understood to encompass a tangible entity, be that an entity that is physically constructed, specifically configured (e.g., hardwired), or temporarily (e.g., transitorily) configured (e.g., programmed) to operate in a specified manner or to perform part or all of any operation described herein. Considering examples in which modules are temporarily configured, each of the modules need not be instantiated at any one moment in time. For example, where the modules comprise a general-purpose hardware processor configured using software; the general-purpose hardware processor may be configured as respective different modules at different times. Software may accordingly configure a hardware processor, for example, to constitute a particular module at one instance of time and to constitute a different module at a different instance of time. Modules may also be software or firmware modules, which operate to perform the methodologies described herein.
Example computer system 600 includes at least one processor 602 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both, processor cores, compute nodes, etc.), a main memory 604 and a static memory 606, which communicate with each other via a link 608 (e.g., bus). The computer system 600 may further include a video display unit 610, an alphanumeric input device 612 (e.g., a keyboard), and a user interface (UI) navigation device 614 (e.g., a mouse). In one embodiment, the video display unit 610, input device 612 and UI navigation device 614 are incorporated into a touch screen display. The computer system 600 may additionally include a storage device 616 (e.g., a drive unit), a signal generation device 618 (e.g., a speaker), a network interface device 620, and one or more sensors (not shown), such as a global positioning system (GPS) sensor, compass, accelerometer, or other sensor.
The storage device 616 includes a machine-readable medium 622 on which is stored one or more sets of data structures and instructions 624 (e.g., software) embodying or utilized by any one or more of the methodologies or functions described herein. The instructions 624 may also reside, completely or at least partially, within the main memory 604, static memory 606, and/or within the processor 602 during execution thereof by the computer system 600, with the main memory 604, static memory 606, and the processor 602 also constituting machine-readable media.
While the machine-readable medium 622 is illustrated in an example embodiment to be a single medium, the term “machine-readable medium” may include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more instructions 624. The term “machine-readable medium” shall also be taken to include any tangible medium that is capable of storing, encoding or carrying instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure or that is capable of storing, encoding or carrying data structures utilized by or associated with such instructions. The term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media. Specific examples of machine-readable media include non-volatile memory, including but not limited to, by way of example, semiconductor memory devices (e.g., electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.
The instructions 624 may further be transmitted or received over a communications network 626 using a transmission medium via the network interface device 620 utilizing any one of a number of well-known transfer protocols (e.g., HTTP). Examples of communication networks include a local area network (LAN), a wide area network (WAN), the Internet, mobile telephone networks, plain old telephone (POTS) networks, and wireless data networks (e.g., Wi-Fi, 3G, and 4G LTE/LTE-A or WiMAX networks). The term “transmission medium” shall be taken to include any intangible medium that is capable of storing, encoding, or carrying instructions for execution by the machine, and includes digital or analog communications signals or other intangible medium to facilitate communication of such software.
The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, by way of illustration, specific embodiments that may be practiced. These embodiments are also referred to herein as “examples.” Such examples may include elements in addition to those shown or described. However, also contemplated are examples that include the elements shown or described. Moreover, also contemplate are examples using any combination or permutation of those elements shown or described (or one or more aspects thereof), either with respect to a particular example (or one or more aspects thereof), or with respect to other examples (or one or more aspects thereof) shown or described herein.
Each of the following applications are hereby incorporated by reference: application Ser. No. 15/334,682 filed on Oct. 26, 2016; Application No. 62/348,461 filed on Jun. 10, 2016. The applicant hereby rescinds any disclaimer of claims scope in the parent application(s) or the prosecution history thereof and advises the USPTO that the claims in the application may be broader than any claim in the parent application(s).
| Number | Date | Country | |
|---|---|---|---|
| 62348461 | Jun 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15334682 | Oct 2016 | US |
| Child | 18390452 | US |
