The present invention is concerned with collective behavior of artificial entities in distributed computer systems, ergodic theory, dynamical systems, modal and temporal logics, evolutionary game theory, computer modeling, descriptive phenomenology, temporal geometries, strategic theory and the theory of action. In addition, the present invention deals with artificial intelligence techniques, including evolutionary computation, artificial neural networks and probabilistic simulations as well as with combinatorial optimization of hybrid mathematical and computational techniques. The present invention is applicable to computational, engineering, mechanical and aeronautical systems, including complex distributed systems.
Intelligent Mobile Software Agents (IMSAs) are complex autonomous computer software programs that operate in a multi-agent system (MAS). While there are various main models of software agents in multi-agent systems, the present system discloses novel approaches to the dynamic process of active IMSA self-organization to solve problems or achieve goals. When linked to particular functional applications, such as dynamic distributed databases, collective robotic systems, bioinformatics systems, enterprise resource management systems and dynamic commercial systems, the present system provides a powerful advance in the art.
There are several categories of art in which prior attempts have been made to develop multi-agent systems, including software agent systems, game theory, neurobiology, modal logic and ethology. The majority of this prior art lies in the domain of pure theoretical research. Consequently, the present invention generally seeks to apply these research concepts to specific computational and engineering systems for practical utility.
Although there is relatively nominal prior art on software agents, prior multi-agent systems include those described by Knapik and Johnson (1998), Ferber (1999) and Woolbridge (2002). These systems represent heuristic attempts to model cooperative agent behaviors by using applications of essential artificial intelligence techniques such as genetic algorithms; however, these multi-agent systems generally lack competitive game theoretic capabilities, complex computer simulation and decision capabilities and active self-organization capabilities which would render them applicable to sophisticated collective robotics systems, automated commercial systems or automated enterprise resource management systems.
Game theoretic modeling of agent behavior has been developed by Von Neumann and Morgenstern in their pioneering work on the theory of games and economic behavior. Schelling has also developed research on game theoretic behaviors of cooperative and competitive multi-agent interactions. More recent work, by Axelrod (1997) and Gintis (2000), involves evolutionary modeling of group behaviors. These prior game theoretic models and strategic theories have been useful in modeling economic and social behavior systems but have not involved significant systems of autonomous, or self-organizing, multi-agent collectives. Prior patents have been mainly restricted mainly to novel auction techniques that reflect a small part of the overall problem of developing a complex system for agency behaviors.
Recent work by IBM has explored the development of self-regulating networks for system repair by emulating autonomic biological systems such as the human immune system, but this research has not been more fully extended to the self-organization of multi-agent system behaviors for multiple applications such as collective robotics or automated commercial systems.
Biological researchers in such diverse fields as ethology (the theory of instinctive animal behavior) and neurobiology have sought to advance theories of system behavior involving adaptation to a changing environment, but none have advanced a novel computational system capable of self-organizational behaviors.
Researchers from the Santa Fe Institute (SFI) have also attempted to develop complex models of self-organizing behaviors by looking to economics (with the swarm computer model) and biological systems (namely, population dynamics and neuro-dynamics) but have not constructed an active system for self-organization. Like others, SFI researchers have noticed analogies from nature but have not built a dynamic system that emulates the complexity of natural systems.
The CHORO CHRONOS project, from a consortium of European nations seeking to develop temporal databases, is an attempt to develop a mechanism to organize the dynamics of complex systems, though it lacks the explication of functional dynamics required for a self-organizing system of collective agent behaviors.
In addition, the work of van Benthem in temporal logic demonstrates the theoretical use of modal logic to organize future possible pathways in game theoretic systems. However, this modal logic approach is not adaptive and interactive and does not account for the emergent behavior of decentralized collectives of agents in a self-organizing system.
Moreover, these systems are all typically static in nature. Once they are programmed, data is input and output within a preset organizational structure. These models cannot be applied to large or complex systems in order to solve dynamic problems in an active and uncertain changing environment.
Solomon has developed a complex spatio-temporal database management system (U.S. patent application Ser. No. 11/040945) for integration and operation of IMSAs in self-organizing networks and a mobile hybrid software router (U.S. patent application Ser. No. 11/227907) for use by IMSAs to combine novel computational and mathematical techniques, such as evolutionary computation, artificial neural networks and probabilistic techniques, to accomplish self-organizing functionalities. The distributed transformational spatio-temporal object relational (T-STOR) databases and the mobile hybrid software router provide key links that enable the truly autonomous functionality of self-organizing collectives of multi-agent systems.
What is needed is a complex dynamic MAS model that is adaptable, scalable and capable of evolution and reorganization. As computer systems become linked in the next generation, this model of distributed computer architecture will behave like an organic system in nature. Whereas there have been numerous advances on small parts of computer systems, there has been relatively little progress involving the management, control, automation and synthesis of complex aspects of very large-scale dynamic systems. The present system fills this important gap.
Embodiments of the present invention provide a system that automates the self-organization of collectives of computational entities. One variant of the invention provides a multi-agent system architecture with a plurality of interconnected system layers, including structural components, analytical functions, active functions and functional applications. Specifically, these system layers consist of a distributed computer and communications network of multi-functional IMSAs in a multi-agent system. In additional layers, IMSA analytical methods and group learning processes are organized. In further layers, active IMSA simulation modeling and group scenario generation and decision-making processes are organized. IMSA cooperation for aggregation and re-aggregation processes is organized on a further layer. IMSA inter-team rivalry and coalition formation and evolution are organized in an additional layer. The combination of these complex processes allows active network plasticity and automated programming functionality of later layers. Finally, functional applications are at the final layer.
Intelligent Mobile Software Agents
The main methods of inputting, ordering, searching, fetching and outputting data sets in a dynamic distributed computer system are utilized by intelligent mobile software agents (IMSAs). IMSAs are sophisticated software programs that can adapt, learn, generate or terminate code, move from machine to machine, and perform various functions. IMSAs include search agents, analytical agents for data mining and pattern recognition, negotiation agents, collaboration agents and decision-making agents. IMSAs may use game theoretic modeling, simulations and scenarios in order to perform a function or activate an application. The combination of multiple IMSAs in a dynamic distributed computer system constitutes a multi-agent system (MAS). Teams of agents have specialized (and multi-specialized) functions in the MAS of a dynamic distributed computer system. The present system is characterized by a range of main operations and processes of the dynamic distributed computer system MAS.
One main category of IMSA collective operation involves cooperation. In this model, IMSA collectives aggregate into common interest groups for specific missions. In some cases, the IMSAs may be specialized in functionality so that the combination of unique teams produces novel results.
Another main category of IMSA collective behavior involves competition. In this model, IMSA collectives negotiate by presenting arguments that are ranked and that change with changing circumstances.
A combination of cooperating and competing models occurs when teams of cooperating IMSAs compete with each other. In this sense, the competing teams emulate business operations in the economy.
IMSAs are capable of learning and prediction. IMSAs generate probabilistic scenarios by employing fuzzy logic and artificial intelligence techniques. IMSAs anticipate change in order to optimize system performance; thus potential future data sets are anticipated by analysis of past data sets. Many of these complex data processes are time sensitive. For instance, recent storage may be organized for easier early retrieval, while older data sets are reordered with less priority. Analysis of environmental changes in recent data sets generates model scenarios that involve anticipatory processes based on learning from and projecting trends.
Prediction, Problem-Solving and Scenarios
One of the main challenges in developing automated dynamic self-organizing systems is the need to design adaptive and effective processes that anticipate behaviors. The ability to anticipate behaviors or patterns in a system depends upon the development of predictive capabilities. Although predictions have constraints, the artificial computer systems field can overcome these constraints by borrowing from the field of econometrics and adopting designs based on Bayesian reasoning and other methods to predict and anticipate various scenarios within temporal limits. The present system contains methods for dealing with the most recent data flows and data analysis to inform scenario generation and selection, based on the use of predictions and expectations derived from the analysis of trends.
In some ways, the challenge for a complex dynamic system is one of discerning how to solve problems. For every set of problems, a set of solutions is proposed and tested in real time. Prior patterns of problem solving are presented in order to assess the optimal solution to a new set of facts. Solution option scenarios are anticipated by past problem-solving sequences. Anomalies are detected as limits in past solutions, multivariate analyses are performed on the problem, and a new set of solution options is generated and evaluated by combining possible solutions. Problem solving is performed on the fly in real time with limited information. After a pattern of problems is recognized and solution options are offered, the system will anticipate changes in the environment and generate simulated scenarios for optimal solutions to future problems. The analysis of trends and the generation and evaluation of scenarios suggest that the system is capable of learning and adapting to the uncertainty of ever changing environments. These sorts of models have been applied to securities markets but have application to a much broader range of categories.
The application of prediction analysis and scenario generation and selection processes relies on principles of induction and learning. Consequently, the present system incorporates these processes. Artificial intelligence methods and techniques, including evolutionary computation and artificial neural networking, are possible because generations of programs have been trained to learn. Inductive inference represents a way to learn from instances in the past, while deductive inference stems from an axiomatic set of rules (and meta-rules) within a finite systemic range of actions. For the most part, inductive inference is the dominant learning model in complex adaptive dynamic self-organizing systems.
The ability of an adaptive system to learn depends on a number of factors, including the environmental inputs, the analysis of patterns and trends, the development of experimental protocols, the assessment and matching of potential solutions to real problems, the continual readjustment process through periods of turbulence, the anticipation of problems and anomalies, and the generation, evaluation and selection of simulated scenarios and solutions.
Modal Logic, Temporal Logic and Temporal Geometry
Modal logic and temporal logic deal with “possible worlds” and counterfactuals. They ask the question “What if” something happens differently. Historical events are contingent on specific prior events occurring, so modal logic asks, “what is the realm of these possibilities?” An example of the use of modal logic may be observed in economic history in which specific variables can be changed to supply a different outcome.
The use of modal, or temporal, logic is essential to understanding the implications of alternative scenarios in possible actions in which specific behaviors interact with an uncertain and active environment. The use of temporal logic is both dynamic, that is, interactive and adaptive, and collective in the sense that it must deal with a realm of possible choices and optimal solutions in the organization of a set of scenarios. Integral temporal logic analyzes the history of events to trace the variables to a source period; use of this analytical tool is important in projection of key possible scenarios for collective action and environmental interaction. Temporal logic provides a conceptual mechanism for sorting combinations of possible courses of actions in large collectives of IMSAs.
When the system is applied to extensible objects in space, such as a collective robotic system, the present invention uses temporal geometries and temporal topologies to plot and select possible scenarios that are chosen as an optimum solution to a problem without necessarily converging upon space occupied by another entity.
One of the key features of the present system's application of temporal logic to a group of IMSAs is the pruning and narrowing of possibilities for future actions using probabilistic assessments, predictions and anticipations based on past experiences. Multi-manifold possible worlds are limited in order to achieve the most effectual solution among options. In another sense, the system analyzes variable time granularities in order to optimize the generation and selection of potential scenarios for future action. This procedure is essential to organizing the compatibility of groups of IMSAs with dynamic distributed computer networks for the processing of automated real-time environmental interaction.
System Architectural Self-Organization and Automatic Programming: Implementing AI
Because these systems are complex and dynamic, there is no equilibrium within them. Rather than simply passively analyzing and assessing data sets, the present system is active. It initiates actions and changes the structure of the system itself in order to accommodate these changes. In this sense, the present system is characterized by plasticity within a dynamic architecture in much the same way that the human brain constantly rewires itself based on various threshold inputs and activities. While the system constantly adapts itself to its changing environment and rewires itself, it is also a distributed network. Accordingly, data streams flow between all active nodes in the system. Activity hubs emerge and decline. These data flows inform, and are consequently rerouted by, the restructuration of the system.
In such a system, the network's computers themselves behave like switches in a giant distributed system. The benefit of this system's dynamic reconfigurable unified artificial adaptive network is that as demand rapidly changes, virtual intelligent hubs are created, as needed. In this sense, the system self-organizes and suggests a sort of unified field theory of dynamic distributed computation systems.
This system relies on a new generation of automatic programming. The distributed computer network contains software agents that control and organize the broader network, with IMSAs that are capable of identifying and assessing problems and generating, evaluating and selecting solutions, all by generating program code autonomously.
The present system is designed to be an artificial distributed, adaptive, self-organizing, auto-programming computer system that, like genetic material, performs various complex functions. In fact, it is a system within a system because it employs a MAS within the distributed computer network. Such a system is not only multi-tasking, but adaptive as well, because inputs are evaluated and solutions generated to solve problems constantly presented by a demanding and changing environment. Finally, the system continually reconfigures its architecture in order to optimize its solutions. The system uses AI techniques and methods, including evolutionary computation, artificial neural networks, Bayesian reasoning, probabilistic simulations and fuzzy logic, in order to meet various challenges, from analysis of problems to the generation and selection of simulated scenario options.
Combination of IMSAs with Hybrid Software Router
IMSAs use complex program code in their operation. In order to employ the most useful AI techniques to solve complex problems on the fly at key times, IMSAs use a hybrid software router. The hybrid software router identifies and combines the appropriate artificial intelligence (including evolutionary computation, genetic algorithms, artificial neural networks, fuzzy logic or probabilistic simulations) techniques and routes the proper hybrid techniques to the best use in real time. The hybrid software router is integrated into the program code of the IMSA for optimum performance.
Combination of IMSAs with Dynamic Adaptive Spatio-Temporal Databases
Though IMSAs are useful in numerous applications, they operate within complex distributed computer systems. IMSAs operate in a MAS that is integrated into a network of computer hardware and software. The hardware may be microprocessors, application specific integrated circuits (ASICs) or continuously programmable field programmable gate arrays (CP-FPGAs) that behave as evolvable hardware with characteristics of microprocessors and ASICS. The software may be comprised of, and executed in, various computer languages. One key software component is the database structure which is seen as a major resource that integrates with a MAS. Since the overall system within which the IMSAs operate is structured as a computer network, the databases are distributed and decentralized.
When combined with distributed transformational spatio-temporal object relational (T-STOR) databases, IMSAs are provided with an important symbiotic relationship of functionality, with the IMSAs operating as the mobile software code and the databases operating as the active storage facilities for data objects. The T-STOR databases continually transform in order to maximize efficiencies while processing large amounts of data inputs and outputs so as to adapt complex functions in real time. The IMSAs perform complex functions by using cooperating and competing MAS processes to collect, evaluate and analyze data, make decisions about specific actions and perform specific functions in an evolving environment by continuously interacting with and integrating into T-STOR databases. Distributed T-STOR databases allow for adaptive and dynamic behaviors and are an important mechanism for integration with a self-organizing MAS.
The present invention evolved out of research in complex self-organizing systems and work in T-STOR databases.
Linkages
One of the key aspects of the system is that it links subsystems. In this sense, the system is a “metasystem” that controls various networks. The scope of this metasystem is broad. It is able to link computer networks from the following categories: commerce (commercial hubs, demand-based negotiation and transactions and supply chain management), financial networks, traffic routing, information organization management, demand-based learning, data mining and analysis, (mobile) sensor networks, simulation modeling, collective robotics, wireless mobile communications, automated decision making and adaptive computer systems.
These complex systems share two main attributes. First, they are all adaptive dynamic systems that use self-organization of data inputs that respond to changing and unpredictable environments. Second, these networks can be linked into a single, unified organic metasystem.
The limits of static computer networks make it necessary to posit a more realistic system that emulates the dynamism and unpredictability of complex systems. These advanced systems require novel learning mechanisms that adapt and optimize their evolutionary development paths. The present system model satisfies the requirements of an evolutionary dynamic self-organizing and adaptive network.
The present system describes connections between software and hardware on the one hand, and middleware and its specific applications on the other.
Problems that the System Solves
The system provides solutions to a number of problematical questions. These questions are classed into general problems and optimization problems. The general problems include:
How can a single IMSA find and solve problems?
What analytical techniques are used by IMSAs to solve problems?
How can a single IMSA apply Bayesian theory for learning?
How can a MAS structure collective analysis?
How can a MAS organize social learning for Just-in-Time behaviors?
How can IMSAs be organized to cooperate on a specific mission?
How can IMSAs be organized for initial aggregation?
How can IMSAs be organized for reaggregation processes?
How can competitions be organized between teams of IMSAs?
How can teams of IMSAs organize their best strategies?
How can IMSAs negotiate with each other?
How can IMSA team strategies co-evolve?
How can IMSAs use simulations?
How can IMSA simulations be tested?
How can IMSAs generate varied scenarios?
How do IMSAs anticipate dynamic action in an environment?
How are databases used in dynamic interaction within IMSAs?
How are IMSA scenarios ranked?
How are IMSA scenario solution options generated?
How are IMSA functions organized?
How are IMSA communications organized?
How do IMSAs switch roles?
How are IMSAs trained?
How do IMSAs accumulate functions?
How do IMSAs organize functional combinations?
How do IMSAs select scenarios for decisions and actions?
How do IMSA collectives organize problem-solution auto-programming for network optimization?
How do IMSAs organize semi-automated programming?
How do IMSAs rewire the network for plasticity?
How is modal logic used by IMSA collectives?
How is temporal geometry used by IMSA collectives in extensible systems?
How are networks of IMSAs self-regulating for autonomic computing?
How can a dynamic MAS be applied to e-commerce for supply chain management?
How can a dynamic MAS be applied to collective robotics, primarily for factory production, traffic coordination, surveillance, automated weaponry and hazard management systems?
How can a dynamic MAS be used in a distributed T-STOR dbms?
How can a dynamic MAS be applied to a bioinformatics modeling system?
How can a dynamic MAS be applied to a global enterprise resource management system?
The optimization problems include:
How do IMSAs automatically generate optimizing algorithms?
How do IMSAs continue to optimize multi-phasal processes?
How do IMSAs constantly learn?
How do IMSAs solve combinatorial optimization problems?
How do IMSAs efficiently reroute data flows in dynamic networks?
How do IMSAs provide a solution to problems of winner-determination?
How do IMSAs maximize efficiency?
How do IMSAs optimize multi-tasking functions?
How do IMSA groups solve problems in a coordinated team?
How do IMSAs in a group align strategies to solve problems or achieve goals?
Analogies with Biological and Other Systems
The present invention is designed as a novel self-organizing system that adapts to environmental interactions in real time. By using anticipatory behaviors, learning, and automated programming features, the interaction processes are maximized for mission critical applications.
Analogies to this complex metasystem may be found in both economic and biological behaviors. In economics, the structure of markets constantly evolves, driven by the behavior of self-interested agents. Inter-agent rivalry forces new market configurations. These intra-system processes reshape the architecture of the markets themselves, a transformation that in turn affects the competitive organization and so on.
In the context of biological systems, several analogies are pertinent to the present system. First, evolutionary behavior resembles the competitive configuration of economic behavior. Groups of individuals compete for limited resources as whole species rise and fall according to environmental circumstances. These complex processes have led to such diverse phenomena as collective behavior in groups of animals (herding, schooling, flocking and swarming) and the organization of antibodies in the bloodstream to fight off viruses.
The second analogy between biology and complex self-organizing systems involves genetics. Refined over millions of years, genetic material is known to be an amazingly complex self-organizing system. Specific genes are activated at specific times to perform functions, for instance, to generate a protein that in turn will activate other genes to perform another function within a limited time. This complex dance of genetic material, and its mutations over time, allows living entities to survive in and adapt to hostile, uncertain and changing environments.
In addition, the present active dynamic multi-agent system emulates other aspects of specific biological systems including development of complex functional proteomic interactions and neurological interactive processes and the evolution of the human immune system.
A particularly cogent illustration of a complex self-organizing system is the human immune system. Our immune systems, when healthy, use proteins and antibodies which identify, mark, attack (in waves) and remove pathogens. In effect, these synchronized processes utilize specialized agents for self-regulating autonomic behaviors. In general, the human immune system functions in equilibrium with its environment, but the immune system can be suppressed or the environment can present increased numbers of pathogens to overwhelm the immune system. Pathogenic disease is a key cause of death, so effective operation of the immune system is crucial to survival. The immune system embodies a complex system comprised of numerous agents (proteins and antibodies) that has evolved in a constant war with its environment in order to survive.
One way to emulate the functional dynamics of biological (or economic) systems is to use computer simulations or cellular automata (CA) simulations. CA makes use of nearest-neighbor contacts to communicate change in the overall system, much like micro-economic behaviors create macro-economic effects. However, the present system seeks to go beyond these simulations by introducing feedback and active adaptation to decentralized functional dynamics of specific applications.
The challenge of organizing a system to transcend the limits of cellular automata systems (which typically have closest-neighbor communications applicable to swarming or flocking natural behaviors) involves developing methods of coordinating multiple agents with ubiquitous network communications. Multi-agent systems which use algorithms that organize simulation scenarios, learning and decision-making processes that go beyond spatially or temporally local algorithms may dramatically increase the functionality of self-organizing dynamic systems. These CA-transcendent models of complex behavior restructure the dynamics of groups in decentralized self-organizing matrices. Since many other MAS models omit methods of such collective dynamics, the present invention is an advance.
Innovations of the Invention
The innovations of the present invention number in the dozens. Regarding IMSAs as entities themselves, these innovations include the ability of IMSAs to switch roles between main functions, accumulate functionality for specific missions in IMSA collectives, and enable distinctive functional IMSA combinations. Regarding analytical learning processes, the present invention represents innovations in problem finding approaches for IMSA analytical methods, sharing of information and collective analysis between IMSAs, the Just-in-Time learning capacity of IMSAs, social aspects of Bayesian theory applied to IMSA collectives and the hybrid social learning capabilities of IMSAs. Regarding the aggregation of IMSA collectives, the present invention reveals novel approaches to schedule formation and synchronization, particularly in dynamic time-table modeling, for IMSA collectives, as well as novel reaggregation approaches of IMSA collectives in varied discrete mission functions. Coalitions of IMSA collectives constantly reorganize contingent on the functional and problem-solving capabilities.
Regarding game theoretic simulations, the present invention advances the art substantially by teaching multilateral and multivariate negotiation processes within IMSA collectives; additionally, the invention illuminates argumentation and objection procedures in negotiation and decision-making processes of IMSA collectives, the adaptation and co-evolutionary strategies of game theoretic modeling for and by IMSA collectives, organization of the experimentation process by IMSA collectives and the assessment of environmental feedback and adaptation of IMSA collectives using simulations. The present system also reveals innovations in: organizing mechanisms for the prediction of external actions by IMSA collectives using scenario analysis; establishing procedures for anticipating dynamic environmental action using IMSA collectives employing techniques for scenario analysis, scenario solution option generation and scenario-ranking processes; and evolving criteria for scenario selection and the selection of a best available strategy using simulations and scenario-analysis processes by majorities of IMSA collectives.
The present invention uses counterfactual analysis derived from temporal logic research in collective scenario analysis. This research combines elements from philosophy, mathematics, logic and economics research to apply to dynamic computational and engineering systems. The temporal aspects in the present system that are integrated into dynamic distributed database management systems and that functionally allow collective behavior are novel as well.
The present invention illustrates innovations in advanced computation by developing problem-based automated computing for network optimization using IMSA collectives, plasticity processes using automated network rewiring techniques and self-regulating networks using IMSA collective behaviors.
Overall, the application of the present invention to numerous complex system categories is novel and useful. These applications include automated commercial systems for supply chain management optimization, collective robotics systems (for dozens of specific applications), genetics and proteomics modeling systems, global enterprise resource management systems, communications network optimization, distributed computer and distributed database management systems, dynamic mobile computer or communications network systems and interactive personalized education systems.
Advantages of the System
The present invention has numerous advantages over earlier models. The system optimizes the adaptive self-organizing operations of dynamic networks. Though it is not meant to be a complete list, the present system is applicable to a broad range of applications, from mobile computing network optimization to collective robotics and from dynamic commercial systems to remote sensing networks.
The present invention allows dramatic increases in productivity in network optimization. The present system goes beyond prior systems by providing combinations of techniques and processes to accomplish automated computational problem solving. While other MASes are static and pre-programmed, the present system is designed for adaptation, co-evolution, collective learning and problem solving in changing environments. Because of the invention's applications to various complex functional systems, the present system is modular.
References to the remaining portions of the specification, including the drawings and claims, will explicate other features and advantages of the present invention. Further features and advantages of the present invention, as well as the structure and operation of various embodiments of the invention, are described in detail below with respect to accompanying drawings.
System Components
IMSAs are categorized into specific types according to specialized and multi-functional attributes. IMSAs utilize analytical methods, both individually and collectively. Similarly, IMSAs use learning methods, both individually and collectively.
One of the main functional capabilities of the present system is its performance of aggregation and re-aggregation processes using cooperative computational methods. In addition, the system uses game theoretical modeling of competitive IMSA collectives to perform functions. IMSAs also use simulation modeling. Scenarios are generated by IMSAs via modeling techniques, and collective decision-making processes organize to select a best scenario.
One outgrowth of combining these complex and novel processes is the organization of automatic programming of computational systems using IMSA collectives. The auto-programming features of the present invention allow IMSA collectives to rewire networks in real time to adapt to changing environments, thus engendering network plasticity capabilities.
The following detailed description of the drawings is divided into several parts that explain: (1) the system structure, which consists of (a) the apparatus of a distributed computer and communications network, (b) IMSAs in a multi-agent system, (c) specialized and multi-functional IMSAs, and individual IMSA analytical methods, (2) the group analytical functions, which consist of (a) IMSA collective learning processes, (b) IMSA collective simulation-modeling processes, (c) IMSA group scenario generation processes and (d) IMSA group decision-making processes, (3) the active functions, which consist of (a) cooperative IMSA aggregation and re-aggregation processes, (b) IMSA team competition and coalition formation, (c) active network plasticity and (d) auto-programming in a multi-agent system with IMSA collectives and; (4) functional applications, including (a) automated commerce, (b) collective robotics, (c) enterprise resource management, (d) bioinformatics and (e) communications network systems.
General Architecture and Dynamics
The first four levels pertain to the system structure. The first level involves a computer and communications network, with hardware consisting of microprocessors, application specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs). These computer hardware components are linked in a communications network that may be a local area network, a wide area network or other types of complex node-to-node network. Each of these hardware components contains databases to store and access data.
In the second level, intelligent mobile software agents (IMSAs) operate in a multi-agent system (MAS). IMSAs are complex software entities comprised of auto-generating program code components that learn, adapt and solve problems in a changing and uncertain environment.
In the third level, IMSAs have multiple functionality. IMSAs combine specialty functions within a single entity in order to more efficiently meet goals or solve problems.
In the fourth level, individual IMSA analytical methods are organized to recognize data patterns and to collect and analyze data sets.
The second main system category represents group analytical functions of the fifth through eighth levels.
IMSA group learning processes are organized in the fifth level.
The sixth level organizes collective IMSAs' active simulation-modeling processes, while the seventh level organizes the IMSA group scenario-generation process and the eighth level organizes the IMSA group decision-making process.
Levels nine through eleven provide the third main functional category of active system functions.
Level nine shows the cooperative IMSA aggregation and reaggregation processes.
On level ten, IMSA team competition occurs as does coalition formation and reformation that arises from inter-team rivalry.
Active network plasticity occurs in level eleven and automated programming is organized in level twelve.
The final tier reveals the functional applications of the system applicable to, among other systems, automated commerce, collective robotics, enterprise resource management, molecular simulation modeling, optimal network management, mobile network management, advanced ubiquitous computing, personalized education, and interoperation of these various systems.
Database types range from relational databases to object databases and from object-relational databases to temporal databases. Though the present system will operate with any of a range of databases, the preferred embodiment will use a distributed transformational spatio-temporal object-relational (T-STOR) database management system. The T-STOR database system is active, adaptive and optimized for the complex functions of IMSA collectives. In essence, the T-STOR dbms is organized for dynamic behaviors which anticipate and actively re-order the structure of the database to optimize real-time functions that require environmental interaction by constantly recategorizing and reprioritizing data sets. These dynamic functions allow these advanced databases to provide real time responsiveness and adaptability to environmental interaction processes.
When structured in a network of distributed T-STOR databases, the present invention optimizes the plasticity of the network by enabling it to dynamically adapt to a specific environment.
The mobile hybrid software routers are used by IMSAs for elasticity of functionality in order to provide code-on-demand. The routers combine specific computational and logical techniques in order to solve problems in real time. Because the routers are mobile, software program code efficiently “travels” with them (and the IMSAs) from location to location. As more code is needed for a specific task, programs are requested from external sources or internally generated, whereas if less code is needed, program code is discontinued as the router (or IMSA) moves between locations. Thus, inessential programs are subtracted in time-sensitive or mobile situations so as to maximize the efficiency of performing a task. See also the discussion at
In this figure, the arrows show a particular set of relationships. Specifically, IMSA 1 and IMSA 3 have a “dialogue” and negotiation at database 2. IMSA 2 moves to database 4, and IMSA 4 moves to database 3.
Some IMSAs return to the test bed to continue to train, while others move on to obtain proficiency at a level of specialization (640). Some of these specialized IMSAs return to obtain more experience, while other specialized IMSAs move on to obtain a higher level of proficiency in multiple specializations (650). The most mature IMSAs (660), the evident “thought” leaders because of their higher-echelon specialization and experience, in turn train untrained IMSAs. At each stage in the process, qualifying thresholds are met. A matrix of experience level, (accumulation of) specialization and evolutionary computation training can be constructed to show the combinations of IMSA training features. The amalgamation of unique IMSA features in specific collectives allows the IMSAs to solve a range of specific functional problems.
In
Traditionally, computation processes use hash tables to organize scheduling. However, complex distributed tasks require continuous recalibration of time tables, which emphasize the temporal aspects of the system. As data flows require the reprioritization of tasks and goals among IMSAs, there is a constant updating of schedules, which necessitates evolving time tables. The data flow dynamics of the self-organizing system involve the need for dynamic and evolving time tables that reclassify and rearrange schedules in order to optimize the problem-solving processes of groups of IMSAs.
The use of evolving time tables to continuously restructure schedules to accommodate distributed dynamic activities is further optimized with the use of temporal databases. As data streams from the external environment are input into the distributed temporal databases, they are continuously rerouted to optimize data flows. Temporal databases provide the adaptive and flexible functions of reprioritizing data flows so as to maximize their utility. As temporal dynamics change the priority of the data objects, the temporal databases rearrange the data classification structure. In addition, temporal databases allow the anticipation, and the delimitation, of possible future behaviors based on analyses of past trajectories. Thanks to the use of temporal databases, evolving time tables and their data object synchronizations and scheduling are optimized.
Simulations are computational modeling processes that can be characterized somewhere between deductive methodology and inductive methodology. With computer simulations, researchers can actively organize and reorganize possible multivariate scenarios in order to identify and select an optimal pathway for action. In the context of IMSA collectives, simulations are also useful for actively organizing possible scenarios in order to identify an optimal pathway for action. For groups of IMSAs, simulation processes work in a manner similar to experimentation, wherein various possible scenarios are identified and tested and the best path selected for the optimum outcome. IMSAs constantly generate simulations in order to provide the range of possibilities for planning courses of action.
Possible scenarios are developed by specific IMSAs given the limited information that is available to each IMSA. These scenarios include counterfactual situations that modify variables of inputs in order to yield alternative possible outcomes. In some cases, alternative assumptions are considered in order to generate an appropriate range of counterfactuals. Each scenario is tested for probable strategic outcome, and the various IMSAs analyze, evaluate and select the best available scenario for the IMSA group from among the multiple IMSA possible scenarios that are generated to carry out a strategy for completing a goal or solving a problem. See also the discussion below involving modal logic and temporal logic in the analysis and selection of possible behaviors.
Counterfactuals present alternative assumptions about possible trajectories of actions for non-deterministic processes. As a practical matter, the set of possibilities that counterfactuals provide are limited to the most probable set of variables that will produce the most probable effects; rather than speaking of “possible worlds,” we are speaking of the most “probable worlds.” This analysis therefore restricts the simulation range to the most probable sets of scenarios. For example, an analysis of history generally yields few genuine surprises but rather a number of threshold conditions of actions that yield contingent sequences; with more information provided at each stage, it is possible to continuously update the optimum scenario and thereby improve predictability.
FIGS. 21 to 25 discuss scenario planning by IMSA groups, while FIGS. 26 to 29 discuss the scenario selection process by groups of IMSAs.
In
In
The initial grouping of an IMSA collective into behavior patterns of aggregation positions is triggered by the program parameters of various IMSAs to solve a problem or to achieve a goal.
Groups of IMSAs participate in mission-specific projects in which particular IMSAs are added or subtracted from the emergent collective at key times in the aggregation process. After the initial aggregation process, the interaction of the IMSA collective with the external environment allows a change in the IMSA group configuration. This re-aggregation process can consist of requests that IMSAs with complementary specialties be added to the collective or that IMSAs not properly functional to meet the demands of the present goals be removed. The trigger that alters the configuration of the IMSA collective may be either internal or external. If it is internal, group decisions (based on program parameters) may demand the change; if external, environmental changes may require a modification. The constantly changing composition of the IMSA collective over time illustrates the re-aggregation process of continuously adjusting the parameters of optimum performance.
In
The emergence of coalitions is an important part of IMSA re-aggregation processes. As bargaining between IMSAs in collectives occurs, the configuration of the groupings shifts in order to maximize their effectiveness at completing a goal or solving a problem. In general, the constantly shifting character of coalitions represents the IMSA collective's attempt to modulate the skills and tools necessary to accomplish a goal in a non-equilibrium environment. In effect, IMSA collectives constantly align contest-winning strategies that continually optimize the problem-solving goals in a perpetually shifting external environment. Such coalitions may be cooperative, competitive, or both.
IMSA groups may aggregate using cooperative or competitive operational models. Coalitions within an IMSA team will work together to organize a team strategy. In some cases, IMSAs in groups may alternate between cooperative and competitive stances, similar to the way individuals within bureaucratic organizations are cooperative or competitive with each other. Because IMSA groups are generally competitive with other IMSA groups, inter-team rivalries emerge.
Competition between groups may be multilateral, rather than merely bilateral, because there are multiple groups with which IMSA teams may compete, each match-up requiring a distinctive strategy. Game theoretic modeling is used by IMSAs to model the dynamics of the strategic interactions in complex multi-agent and multi-team environments. In order to develop mechanisms for competition between IMSA teams, negotiation and argumentation tactics are adopted to resolve disputes and to select common scenarios and strategies of action.
Using complex game theoretic modeling, IMSAs study the behavior of other IMSAs to discern their behaviors. However, for maximal negotiation potential in hostile environments, the signaling process of IMSA communications and actions must be disguised. As an example, in order to disguise its team strategy, an IMSA may employ a less than optimally efficient strategy to deceive the opposing team and achieve its objectives. In effect, IMSA team strategies simulate poker strategies. IMSA team strategies may oscillate between cooperative and competitive modes so as to seek competitive advantages over other teams and thereby achieve objectives. Over time, oligopolies of IMSA teams adapt their strategies in order to co-evolve with other IMSA teams. These processes are described in FIGS. 35 to 40.
If the IMSA does not signal its strategy to other IMSAs, it disguises its strategy by interacting primarily with competitive IMSAs (3810). If it disguises its strategy, it either hides its actions until the last moment (3825) or intentionally misleads competitive IMSAs with evasive strategy (3830). If it hides its actions until the last moment, it either misdirects actions intentionally (3845) or unintentionally misdirects actions (3850). If it intentionally misleads competitive IMSAs with an evasive strategy, it either disguises its moves (3855) or intentionally produces lags in its timing of moves in order to disguise the transparency of its moves (3860).
In
Plasticity is the process of reconfiguring a network. In general, “regular” patterns of pathways are reinforced, while patterns of less-used pathways disappear over time. These behaviors are common to insect and animal communities as well as communications and economic networks. One paradigm of plasticity behaviors is the human brain, which learns patterns and may continually re-learn new behaviors as needed for adaptation even as it drops patterns, for example, of unused language skills. In effect, the human brain “re-wires” itself in order to adapt to complex new environments.
One of the notable variables in the plasticity phenomenon is its critical temporality. After a period of relative normalcy, a key external event may create the need for an intense burst of activity or a correspondingly large drop-off in activity. Temporal logic is an excellent tool to use in mapping these complex network transformations. The elasticity of supply and demand activity in commercial hubs, for instance, can be tracked using temporal logic which traces the specific geodesic connections between each part of the network at specific phases of time.
FIGS. 42 to 45 lay out the phenomena of automated computer programming. The present system allows computers in networks to perform specific auto-programming functions. In particular, routine tasks use auto-programming techniques to self-organize and execute strategies and to align with and adapt to a changing external environment. The use of IMSA collectives, combined with the distributed T-STOR database management system (see below at
Adaptation to change requires of complex computation systems the ability to autonomously evolve their program parameters. For this to be possible, the rule-parameters and meta-rules need to evolve. The present system provides techniques, methods and apparatus for these complex processes to occur. Sets of these techniques are provided within the functionality of collectives of IMSAs, allowing them to self-organize through the use of anticipation, strategic formation, scenario development and selection, coalition formation and group analysis, learning and decision-making processes. Automated programming processes involving IMSA collectives are discussed in FIGS. 42 to 45.
In order for the automated programming of IMSA collectives to be effective in computation and engineering systems, they must have external applications. The numerous complex system applications with which the present system may combine include economic networks, collective robotics, communications networks, bioinformatics systems and enterprise resource management systems. These are generally described in FIGS. 47 to 51.
One key aspect of the present system involves the temporal dynamics of processes. In order to describe these temporal dynamics, it is necessary to develop and apply specific logical and mathematical fields. Modal logic, which involves developing possible eventualities from specific assumptions and counterfactuals, is an example of a useful logic for describing temporal events. Temporal logic, which maps the temporal components of possible and probable event streams, is also useful in describing temporal events in ergodic systems. Temporal logic is typically organized to apply to specific event streams and is well suited for processing in computational environments. However, the application of temporal logic to collectives is especially important because different pathways and vectors may be mapped, contingent on the outcomes of other IMSAs moves. This novel collective temporal logic is useful in the modeling of game theoretic simulations and scenarios contained in the prevent system.
Just as temporal and modal logics are useful for describing computation possibilities, temporal geometries and topologies are useful for describing the extensible and manifold spatio-temporal aspects of specific applications to which the present invention refers, including collective robotics systems. Temporal algebraic geometries, temporal differential geometries, temporal combinatorial topologies and temporal combinatorial geometries are valuable tools to help describe dynamic engineering systems. A novel field of temporal integral geometry involves working backward from a spatio-temporal result to understand the multivariate sources that probabilistically make possible specific outcomes. Multi-agent systems use this new field of mathematics to analyze possible scenarios and thereby evaluate and select the best available scenario for action at each phase. Temporal integral geometry is a tool that combines with Bayesian learning and Monte Carlo probabilities simulation and provides critical evidence of prior experiences with which the optimum performance of evolving systems may be calculated.
Multiple categories of mathematics and logic are involved in the description of complex dynamic systems. From the viewpoint of an IMSA collective, the main phases are the deterministic phase, the feedback stage, the non-equilibrium phase, the system adaptation phase and the scenario development phase. Different math and logic categories are involved in describing each of these phases. Any particular logic or math category will cease to be optimum in describing a specific phase in the dynamic system process as another math or logic category becomes more suited to such description.
In addition, specific combinations of math or logic fields may best describe a specific phase of the process. Overall, then, it is possible to construct a multi-category system of combinatorial active modeling which optimally organizes each particular math or logic category, and its combinations, to solve specific problems in the complex dynamic system. A general phenomenology of active events produced by groups of independent agents, which the present system embodies, requires a combinatorial multi-category math and logic system of active modeling.
Social history may also be described with a modal logic representation of possible pathways and vectors of ideological and institutional change, as exemplified in
It is understood that the examples and embodiments described herein are for illustrative purposes only and that various modifications or changes in light thereof will be suggested to persons skilled in the art and are to be included within the spirit and purview of this application and scope of the appended claims. All publications, patents, and patent applications cited herein are hereby incorporated by reference for all purposes in their entirety.
The present application claims the benefit of priority under 35 U.S.C. §119 from U.S. Provisional Patent Application Ser. No. 60/646,052, filed on Jan. 21, 2005, the disclosures of which are hereby incorporated by reference in their entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
60646052 | Jan 2005 | US |