Artificial intelligence platform

Abstract

The present invention provides a new and unique platform for authoring and deploying interactive characters which are powered by artificial intelligence. The platform permits the creation of a virtual world populated by multiple characters and objects, interacting with one another so as to create a life-like virtual world and interacting with a user so as to provide a more interesting and powerful experience for the user. This system can be used for entertainment purposes, for commercial purposes, for educational purposes, etc.

Description

FIELD OF THE INVENTION

[0002] This invention relates to artificial intelligence in general, and more particularly to a novel software platform for authoring and deployment of interactive characters powered by artificial intelligence.

BACKGROUND OF THE INVENTION

[0003] Artificial intelligence is the field of computer science concerned with creating a computer or other machine which can perform activities that are normally thought to require intelligence.

[0004] One subfield in this area relates to creating a computer which can mimic human behavior, i.e., so that the computer, or a character displayed by the computer, appears to display human traits.

[0005] A substantial amount of effort has been made in this latter area, i.e., to provide a computer character which appears to display human traits. Unfortunately, however, the efforts to date have generally proven unsatisfactory for a number of reasons. Among these are: (1) the artificial intelligence program must be generally custom made for each character, which is a costly and time-consuming process; (2) the artificial intelligence program must generally be custom tailored for a specific application program (e.g., for a specific game, for a specific educational program, for a specific search engine, etc.); (3) the characters tend to be standalone, and not part of a larger “virtual world” of interactive characters, etc.

SUMMARY OF THE INVENTION

[0006] The present invention provides a new and unique platform for authoring and deploying interactive characters which are powered by artificial intelligence. The platform permits the creation of a virtual world populated by multiple characters and objects, interacting with one another so as to create a life-like virtual world and interacting with a user so as to provide a more interesting and powerful experience for the user. This system can be used for entertainment purposes, for educational purposes, for commercial purposes, etc.

[0007] In one form of the invention, there is provided a virtual world comprising:

[0008] a virtual environment;

[0009] a plurality of virtual elements within the virtual environment, each of the virtual elements being capable of interacting with other of the virtual elements within the virtual environment; and

[0010] user controls for enabling a user to interact with at least one of the virtual elements within the virtual environment;

[0011] wherein at least one of the virtual elements comprises a virtual character comprising a behavior state, an emotion state and a learning state, and wherein the behavior state, the emotion state and the learning state are capable of changing in response to (i) interaction with other virtual elements within the virtual environment, and/or (ii) commands from the user input controls; and

[0012] wherein the virtual environment is configured so that additional virtual elements can be introduced into the virtual environment.

[0013] In another form of the invention, there is provided a virtual character for disposition within a virtual environment, the virtual character comprising a behavior state, an emotion state and a learning state, and wherein the behavior state, the emotion state and the learning state are capable of changing in response to (i) interaction with other virtual elements within the virtual environment, and/or (ii) commands from outside the virtual environment.

[0014] And in one preferred embodiment, the virtual character further comprises a sensory capability for sensing other virtual elements within the virtual environment.

[0015] And in one preferred embodiment, the sensory capability is configured to sense the presence of other virtual elements within the virtual environment.

[0016] And in one preferred embodiment, the sensory capability is configured to sense the motion of other virtual elements within the virtual environment.

[0017] And in one preferred embodiment, the sensory capability is configured to sense a characteristic of other virtual elements within the virtual environment.

[0018] And in another form of the invention, there is provided a method for doing business comprising:

[0019] providing an individual with a virtual environment and at least one virtual element within the virtual environment, wherein the virtual environment is configured so that additional virtual elements can be introduced into the virtual environment, and wherein at least one of the virtual elements comprises a virtual character comprising a behavior state, an emotion state and a learning state, and wherein the behavior state, the emotion state and the learning state are capable of changing in response to stimuli received from within the virtual environment and/or from outside of the virtual environment; and

[0020] enabling a customer to add an additional virtual element to the virtual environment in response to the purchase of a product.

[0021] And in one preferred embodiment, the additional virtual element is different than the product being purchased.

[0022] And in one preferred embodiment, the product comprises a good.

[0023] And in one preferred embodiment, the product comprises a service.

[0024] And in one preferred embodiment, the product is purchased by the customer on-line.

[0025] And in one preferred embodiment, the product is purchased by the customer at a physical location.

[0026] And in one preferred embodiment, the additional virtual element is delivered to the customer on-line.

[0027] And in one preferred embodiment, the additional virtual element is delivered to the customer on electronic storage media.

[0028] And in one preferred embodiment, the additional virtual element is configured to change state in response to stimuli received from within the virtual environment and/or from outside the virtual environment.

[0029] And in one preferred embodiment, the additional virtual element comprises a virtual character.

[0030] And in one preferred embodiment, the method comprises the additional step of enabling a customer to add an additional virtual element to the virtual environment without the purchase of a product.

[0031] And in one preferred embodiment, the method comprises the additional step of tracking the results of customer interaction through metrics specific to a measure of Brand Involvement.

[0032] And in another form of the invention, there is provided a method for teaching a skill to an individual comprising:

[0033] providing a virtual world comprising:

[0034] a virtual environment;

[0035] a plurality of virtual elements within the virtual environment, each of the virtual elements being capable of interacting with other of the virtual elements within the virtual environment; and

[0036] user controls for enabling an individual to interact with at least one of the virtual elements within the virtual environment;

[0037] wherein at least one of the virtual elements comprises a virtual character comprising a behavior state, an emotion state and a learning state, and wherein the behavior state, the emotion state and the learning state are capable of changing in response to (i) interaction with other virtual elements within the virtual environment, and/or (ii) commands from the user controls;

[0038] presenting a learning circumstance to the individual through the use of the virtual elements within the virtual environment;

[0039] prompting the individual to provide instructions to at least one of the virtual elements within the virtual environment, wherein the instructions being provided by the individual incorporate the skill to be taught to the individual, such that the individual learns the skill by providing instructions to the at least one virtual element; and

[0040] providing positive reinforcement to the individual when the instructions provided by the individual are correct.

[0041] And in one preferred embodiment, the instructions are provided to a virtual character.

[0042] And in one preferred embodiment, the individual learns the skill by teaching that same skill to a virtual character.

[0043] And in one preferred embodiment, the instructions comprise direct instructions.

[0044] And in one preferred embodiment, the instructions comprise indirect instructions.

[0045] And in one preferred embodiment, the indirect instructions comprise providing an example.

[0046] And in one preferred embodiment, the indirect instructions comprise creating an inference.

[0047] And in one preferred embodiment, the virtual environment is configured so that additional virtual elements can be introduced into the virtual environment.

BRIEF DESCRIPTION OF THE DRAWINGS

[0048] These and other objects and features of the present invention will be more fully disclosed or rendered obvious by the following detailed description of the preferred embodiments of the invention, which is to be considered together with the accompanying drawings wherein like numbers refer to like parts and further wherein:

[0049] FIG. 1 is a schematic view providing a high level description of the novel artificial intelligence platform of the present invention;

[0050] FIG. 2 is a schematic view providing a high level description of the platform's Studio Tool;

[0051] FIG. 3 is a schematic view providing a high level description of the platform's AI Engine;

[0052] FIG. 4 is a schematic view providing a high level description of the functionality of the Music Engine;

[0053] FIG. 5 is a schematic view providing a high level description of the platform's behavior engine;

[0054] FIG. 6 is a schematic view providing a high level description of the behavior hierarchy of a character;

[0055] FIG. 7 is a schematic view showing how a three dimentional space can be partitioned into distinct regions that correspond to the individual emotions of a character;

[0056] FIG. 8 is a table which shows the trigger condition, resulting behavior and the behavioral function for six of the ten cardinal emotions;

[0057] FIG. 9 is a schematic diagram illustrating one form of layered animation model within the Animation Engine;

[0058] FIG. 10 is a schematic diagram illustrating some similarities between the layered animation model of the present invention and the Adobe Photoshop model;

[0059] FIG. 11 is a further schematic diagram illustrating layering within the layered animation model;

[0060] FIG. 12 is a schematic diagram illustrating blending within the layered animation model;

[0061] FIG. 13 is a schematic diagram illustrating interaction between the Animation Engine and the Behavior Engine;

[0062] FIG. 14 is a schematic view providing a high level description of the platform's AI Player;

[0063] FIG. 15 is a schematic view providing a more detailed view of the AI Player;

[0064] FIG. 16 is a schematic view providing a high level description of the platform's Persister;

[0065] FIG. 17 is a schematic view providing a high level description of the interaction between the platform's Authorizer and Code Enter components;

[0066] FIG. 18 is a schematic view providing a high level description of user input to the AI Player;

[0067] FIG. 19 is a schematic view providing a high level description of the code layers of the AI Player;

[0068] FIG. 20 is a schematic diagram showing a parallel between (i) the architecture of the WildTangent™ plugin, and (ii) the architecture of the AI Player together with WildTangent™ graphics;

[0069] FIG. 21 is a table showing how the platform is adapted to run on various operating systems and browers;

[0070] FIG. 22 is a schematic view providing a high level description of the Studio Tool;

[0071] FIG. 23 is a table showing how the list of importers can expand;

[0072] FIG. 24 is a schematic view providing a high level description of the platform's sensor system;

[0073] FIG. 25 is a schematic view providing a high level description of the platform's behavior system;

[0074] FIG. 26 is a schematic view providing a high level description of the platform's emotion system;

[0075] FIG. 27 is a schematic view showing the platform's AVS emotional cube;

[0076] FIG. 28 is a schematic view providing a high level description of the platform's learning system;

[0077] FIG. 29 is a schematic view providing a high level description of the platform's motor system;

[0078] FIG. 30 shows the sequence of updates used to propagate a user change in a character's behavior network all the way through to affect the character's behavior;

[0079] FIG. 31 is a schematic diagram providing a high level description of the system's AI architecture;

[0080] FIG. 32 is a schematic diagram providing a high level description of the system's three-tiered data architecture;

[0081] FIG. 33 is a schematic diagram illustrating how the system becomes more engaging for the user as more elements are introduced into the virtual world;

[0082] FIG. 34 is a schematic diagram illustrating possible positive and negative interactions as a measure of Brand Involvement;

[0083] FIG. 35 is a table showing various code modules/libraries and their functionality in one preferred implementation of the invention;

[0084] FIG. 36 is a schematic diagram showing one way in which the novel platform may be used;

[0085] FIG. 37 is a schematic diagram showing another way in which the novel platform may be used;

[0086] FIG. 38 is a schematic diagram showing still another way in which the novel platform may be used; and

[0087] FIG. 39 is a schematic diagram showing the general operation of the novel platform of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

1. Overall System

[0088] The present invention comprises a novel software platform for authoring and deployment of interactive characters powered by Artificial Intelligence (AI). The characters must convey a strong illusion of life. The AI that brings the characters to life is based on a unique mix of Behavior, Emotion and Learning.

[0089] The core AI functionality is the heart of a complex software system that is necessary to make the AI applicable in the real world. The full system consists of:

[0090] (i) the AI Engine, the “heart” of the system;

[0091] (ii) the AI Player, a software system that wraps the AI Engine for deployment;,

[0092] (iii) the Studio Tool, a standalone application that wraps the AI Engine for authoring;, and

[0093] (iv) the .ing File Format, a proprietary data and file format for AI specification. Together, these systems constitute the Artificial Intelligence Platform.

[0094] The AI-powered animated characters are deployable over the Web. It is also possible to deploy them on a CD-ROM.

[0095] The system is focused on AI and is not yet another graphics solution. However, the system benefits from existing “graphics-over-the-Web” solutions.

[0096] 1.1 Runtime—The AI Engine

[0097] The AI Engine is the heart of the system. It is a software system that determines what a given character does at any given moment (behavior), how it “feels” (emotion) and how its past experience affects its future actions (learning).

[0098] The AI Engine relies on other systems to become useful as a release-ready application, whether as a plugin to a Web browser or as a standalone software tool. The AI Engine also relies on a proprietary data structure, the “AI Graph”, that resides in memory, and a proprietary file format, the .ing file format, that stores the AI Graph data structure.

[0099] 1.2 Data—The .ing File Format

[0100] The .ing file format is a proprietary data file format that specifies the AI behavioral characteristics of a set of characters inside a virtual world. The .ing file format does not contain any information about graphics or sound; it is a purely behavioral description. The .ing file format is registered within an operating system (e.g., Windows) to be read by the AI Player. The Studio Tool reads and writes the ing file format.

[0101] 1.3 Deployment—The AI Player

[0102] Looking first at FIG. 1, the AI Player is a plug-in to a Web browser. The AI Player contains the core AI Engine and plays out the character's behaviors as specified in the .ing file. The AI Player self-installs into the browser the first time the Web browser encounters an .ing file.

[0103] The AI Player is not a graphics solution. It runs on top of a 3rd party graphics plugin such as Flash™, WildTangent™, Pulse3d™, etc. As a result, the final interactive requires the .ing file together with one or more graphics, animation and music data files required by the chosen graphics plugin.

[0104] 1.4 Authoring—The Studio Tool

[0105] Looking next at FIG. 2, the Studio Tool is a standalone application. The Studio Tool consists of a graphical editing environment that reads in data, allows the user to modify that data, and writes the modified data out again. The Studio Tool reads in the .ing file together with industry-standard file formats for specifying 3D models, animations, textures, sounds, etc. (e.g., file formats such as .obj, .mb, .jpg, .wav, etc.). The Studio Tool allows the user to compose the characters and to author their behavioral specifications through a set of Graphical User Interface (GUI) Editors. A real-time preview is provided in a window that displays a 3D world in which the characters “run around”, behaving as specified. Changing any parameter of a character's behavior has an immediate effect on the character's actions as performed in the preview window. Finally, the Studio Tool allows the user to export all information inherent in the character's AI, scene functionality, camera dynamics, etc., as one or more .ing files. All graphical representations of the character are exported in the form of existing 3rd party graphics formats (e.g., WildTangent™, Flash™, etc.). The user then simply posts all files on his or her Website and a brand-new intelligent animated character is born.

2. The AI Engine

[0106] FIG. 3 is a schematic diagram providing a high level description of the functionality of the AI Engine.

[0107] 2.1 Basic Functionality

[0108] The AI Engine is a software system that determines what a given creature does at any given moment (behavior), how it “feels” (emotion) and how its past experience affects its future actions (learning). The AI Engine is the heart of the system, giving the technology its unique functionality. The AI Engine traverses an AI Graph, a data structure that resides in memory and represents the behavioral specification for all creatures, the world and the camera. Each traversal determines the next action taken in the world based on the user's input. The AI Engine also modifies the AI Graph, for example, as a result of the learning that the creatures perform.

[0109] 2.2 Story Engine

[0110] The story engine imposes a high-level story on the open-ended interactions. Instead of developing a complex story engine initially, the system can provide this functionality through the use of the Java API.

[0111] 2.3 Music Engine

[0112] The AI Engine has a music engine together with a suitable file format for music data (e.g., MIDI is one preferred implementation). The Music Engine matches and plays the correct sound effects and background music based on the behavior of the characters and the overall mood of the story provided by the story engine.

[0113] FIG. 4 is a schematic diagram providing a high level description of the functionality of the Music Engine.

[0114] In most other interactive systems, the music engine comes last, i.e., it is only added after all game, behavior, and animation updates are computed. The present invention pushes the music engine higher up the hierarchy—the music controls the animation, triggers the sunset, or motivates a character's actions or emotions. In this way, a vast amount of authoring tools and expertise (music production) can be used to dramatically produce compelling emotional interactions with the audience.

[0115] The music engine may be, without limitation, both a controlling force and a responsive force. The following points detail how data to and from the music engine can control various parts of the character system, or even the entire system.

[0116] Definition of terms:

[0117] Music Engine—the program functionality that interprets incoming data, possibly from a musical or audio source, and somehow affects or alters the system.

[0118] Animation Clip—an authored piece of artwork, 3D or 2D, that may change over time.

[0119] Model—2D art or 3D model that has been authored in advance, possibly matched to and affected by an animation clip.

[0120] Data Source—any source of data, possibly musical, such as (but not limited to) a CD or DVD, a stream off the Web, continuous data from a user control, data from a music sequencer or other piece of software, or data from a piece of hardware such as a music keyboard or mixing board.

[0121] Data Stream—The data that is being produced by a data source.

[0122] Skill—A piece of functionality associated with the character system.

[0123] Based on an incoming data stream, the music engine may take an animation clip and alter it in some way, i.e., without limitation, it may speed it up, slow it down, exaggerate certain aspects of the motion, or otherwise change the fundamental characteristics of that animation clip. By way of example but not limitation, if the stream source is a long, drawn-out stretching sound effect, the music engine may stretch the animation length out to match the length of the sound effect.

[0124] Based on an incoming data stream, the music engine may take a model and alter it in some way, e.g., it may stretch it, color it, warp it somehow, or otherwise change the fundamental characteristics of that model. By way of example but not limitation, if the incoming data stream is a stream of music and the music genre changes from Rock and Roll to Blues, the music engine may change the color of the model to blue.

[0125] Based on an incoming data stream, the music engine may start and stop individual (possibly modified) animations or sequences of animations. By way of example but not limitation, assume there is a model of a little boy and an animation of that model tip-toeing across a floor. The data stream is being created by a music sequencing program and the user of that program is writing “tiptoe” music, that is, short unevenly spaced notes. The music engine interprets the incoming stream of note data and plays out one cycle of the tiptoe animation for every note, thereby creating the effect of synchronized scoring. By way of further example, if the stream switched to a “CRASH!” sound effect, the music engine would trigger and play the trip-and-fall animation clip, followed by the get-up-off-the floor animation clip, followed, possibly, depending on the data stream, by more tiptoeing.

[0126] Based on an incoming data stream, the music engine may alter system parameters or system state such as (but not limited to) system variables, blackboard and field values, or any other piece of system-accessible data. By way of example but not limitation, a music data stream may contain within it a piece of data such that, when the musical score becomes huge and romantic and sappy, that control data, interpreted by the music engine, alters the state of a character's emotional and behavior system such that the creature falls in love at exactly the musically correct time.

[0127] Based on an incoming data stream, the music engine may start and stop skills. By way of example but not limitation, when the incoming data stream contains the humorous “buh dum bump!” snare hit following a comedy routine, the music engine might trigger the crowd-laugh skill.

[0128] Based on an incoming data stream, the music engine may “stitch together”, in sequence or in parallel, animations, skills, sequences of animations and/or skills, or any other pieces of functionality. This “stitching together” may be done by pre-processing the data stream or by examining it as it arrives from the data source and creating the sequences on-the-fly, in real time. By way of example but not limitation, if the tiptoeing model (detailed as an example above) were to run into a toy on the ground, the music engine could play out a stubbed-toe animation, trigger a skill that animates the toy to skitter across the floor, and change the system state such that the parent characters wake up and come downstairs to investigate.

[0129] The data stream may be bi-directional—that is, the music engine may send data “upstream” to the source of the data stream. By way of example but not limitation, if the author of a game is debugging the system and wants to view a particular scenario over again, the music engine may note that the system is “rewinding” and send appropriate timing information back to the data source (which may or may not ignore the timing information) such that the data source can stay synchronized with the character system. By way of additional example but not limitation, in the above example wherein the tiptoeing model trips on a toy and the music engine triggers a series of events, the music engine may send some data upstream to the data source requesting various sound effects such as a trip sound effect, a toy-skittering-on-the-ground sound effect, and a light-click-on-and-parents-coming-downstairs sound effects.

[0130] While, in the above examples, the data stream is of a musical nature, the music engine may respond to an arbitrary data stream. By way of example but not limitation, a user may be creating a data stream by moving a slider in an arbitrary application or tool (mixing board). The music engine might use this data stream to change the color of the sunset or to increase the odds of a particular team winning the baseball game. In either case, the music engine does not require the data stream to be of a musical nature.

[0131] 2.4 Cinema Engine

[0132] The AI Engine uses a custom system for camera behaviors. Each camera is a behavior character that has the ability to compose shots as a part of its “skills”.

[0133] 2.5 Behavior Engine

[0134] FIG. 5 is a schematic diagram providing a high level description of the functionality of the behavior engine. The arrows represent flow of communication. Each active boundary between the components is defined as a software interface.

[0135] The runtime structure of the AI Engine can be represented as a continuous flow of information. First, a character's sensory system gathers sensory stimuli by sampling the state of the virtual world around the character and any input from the human user, and cues from the story engine. After filtering and processing this data, it is passed on to the character's emotional model and behavior selection system. Influenced by sensory and emotional inputs, the behavior system determines the most appropriate behavior at that particular moment, and passes this information along to both the learning subsystem and the animation engine. The learning subsystem uses the past history and current state of the creature to draw inferences about appropriate future actions. The animation engine is in charge of interpreting, blending, and transitioning between motions, and ensures that the character performs its actions in a way that reflects the current state of the world and the character's emotions. Finally, the output of the animation engine is sent to a graphics subsystem which renders the character on the user's screen.

[0136] 2.5.1 Sensory System

[0137] Even though it would be possible to give each creature complete information about the world it lives in, it is highly undesirable to do so. Creatures must maintain “sensory honesty” in order for their behavior to be believable. Just as real creatures cannot collect perfect information about the environment around them, virtual creatures should face the same difficulty. A large amount of “natural” behavior stems from the division between the world and the creature's representation of it. The purpose of the sensing system is to populate this gap.

[0138] 2.5.2 Behavior System

[0139] The behavior system is the component that controls both the actions that a character takes and the manner in which they are performed. The actions undertaken by a character are known as behaviors. When several different behaviors can achieve the same goal in different ways, they are organized into behavior groups and compete with each other for the opportunity to become active. Behaviors compete on the basis of the excitation energy they receive from their sensory and motivational inputs.

[0140] FIG. 6 is a schematic diagram providing a high level description of the behavior hierarchy of a character. Boxes with rounded corners represent drives (top of the image). Circles represent sensory releasers. Gray boxes are behavior groups while white boxes are behaviors. Bold boxes correspond to consummatory behaviors within the group. Simple arrows represent the flow of activation energy. Large gray arrows represent commands sent to the animation engine.

[0141] 2.5.3 Emotional Model

[0142] Each creature displays ten cardinal emotions: joy, interest, calmness, boredom, sorrow, anger, distress, disgust, fear and surprise. The present invention defines a three-dimensional space that can be partitioned into distinct regions that correspond to the individual emotions. It is organized around the axes of Arousal (the level of energy, ranging from Low to High), Valence (the measure of “goodness”, ranging from Good to Bad), and Stance (the level of being approachable, ranging from Open, receptive, to Closed, defensive). By a way of example but not limitation, high energy and good valence corresponds to Joy, low energy and bad valence corresponds to Sorrow, and high energy and bad valence corresponds to Anger. FIG. 7 illustrates this approach.

[0143] All emotions arise in a particular context, and cause the creature to respond in a particular manner. FIG. 8 lists the trigger condition, the resulting behavior, and the behavioral function for six of the ten cardinal emotions.

[0144] 2.5.4 Learning

[0145] In order to be compelling over extended periods of time, it is important that a character learn from the past and apply this knowledge to its future interactions. The goal of the learning system is to enable characters to learn things that are immediately understandable, important, and ultimately meaningful to the people interacting with them.

[0146] 2.6 Animation Engine

[0147] The animation engine is responsible for executing the chosen behavior through the most expressive motion possible. It offers several levels of functionality:

[0148] (i) Playback—the ability to play out hand-crafted animations, such as “walk”;

[0149] (ii) Layering—the ability to layer animations on topof one another, such “wave hand” on top of “walk” to generate a walking character waving its hand;

[0150] (iii) Blending—it must support motion blending animations, such that blending “turn right” and “walk” will make the character turn right while making a step forward; and

[0151] (iv) Procedural motion—the animation engine must be able to generate procedural motion, such as flocking of a number of separate characters.

[0152] The behavior system sends requests for motor commands on every update. The animation engine interprets them, consults with the physics and calculates the updated numerical values for each moving part of the character.

[0153] The authoring of complex animation and blending sequences is possible because of a layered animation model within the Animation Engine. See FIG. 9. This model is inspired by the Adobe Photoshop model of compositing images from layers, with the following differences:

[0154] (i) animation data is used instead of pixels; and

[0155] (ii) the resulting composite is a complex motion in time instead of an image.

[0156] In order to clarify the functionality of the system, it is useful to extend this metaphor further. See FIG. 10.

[0157] 1. Layers (see FIG. 11)

[0158] a. Layers are ordered. Each Layer adds its influence into the composite of the Layers below.

[0159] b. Each Layer contains Skills (animations).

[0160] c. Each Skill belongs to one Layer only.

[0161] d. A Layer has only one active Skill at a time, except in case of transitions when two Skills are being cross-faded.

[0162] e. If a Skill starts other Skills (GroupSkill, SequenceSkill), it can only do so for Skills in Layers below its own. A Skill can never start a Skill “above” itself.

[0163] f. Neighboring Layers have a Blend Mode between them.

[0164] 2. Blend Mode (See FIG. 12)

[0165] a. Describes how the current layer adds its influence on the composite of all the layers below it.

[0166] b. Consists of Type and Amount (Percentage)

[0167] c. Some Preferred Types:

[0168] i. Subsume (if at 100%, such active skill subsumes all skills in layers below its own); and

[0169] ii. Multiply (multiplies its own influence onto the layers below).

[0170] 3. Group Skills

[0171] a. GroupSkills are groups of skills.

[0172] b. Some preferred GroupSkills:

[0173] i. EmotionGroupSkill

[0174] 1. Holds onto other Skills that each have an emotional coloring. Emotion and child skill can be mapped.

[0175] ii. ParallelGroupSkill

[0176] 1. Holds onto a bag of skills and executes them upon starting.

[0177] 2. Remembers whom it started and cleans up upon getting interrupted (upon stop ( ) being called).

[0178] iii. SerialGroupSkill

[0179] 1. Holds onto a bag of skills and executes them one after another (in sequence) remembers.

[0180] 2. Remembers whom it started and cleans up upon getting interrupted (upon stop ( ) being called).

[0181] iv. AmbuLocoGroupSkill

[0182] 1. Contains an AmbulateSkill (computing the motion of the root node).

[0183] 2. Contains a LocomoteSkill (animation, e.g., the walk cycle).

[0184] 3. Is responsible for communicating the parameters of the Locomote to the Ambulate mechanism (like forward speed inherent in the animation cycle).

[0185] 4. Locomote Skill is any skill, e.g., an EmotionGroupSkill, which means that changes of emotion happen “under the hood”; also, the AmbuLocoGroup needs to communicate the parameters based on which subskill of the locomote group skill is running (in other words, it has to poll locomote often).

[0186] 4. Relation to the Behavior Engine.

[0187] The Animation Engine invariably arrives at information that is necessary for the Behavior Engine, for example, if a Skill WalkTo(Tree) times out because the character has reached the Tree object, the Behavior Engine must be notified. This flow of information “upwards” is implemented using an Event Queue. See FIG. 13.

[0188] a. Behavior System actuates a skill, e.g., Walk-To(Tree).

[0189] b. The Behavior will be waiting on a termination event, e.g., “SUCCESS”.

[0190] c. The relevant AmbulateSkill will compute success, e.g., has the creature reached the object Tree?

[0191] d. If so, the MotorSystem will post an event “SUCCESS: Has reached object: Tree” to the Behavior Engine (through an Event Queue).

[0192] e. The Behavior will either:

[0193] i. Hear “SUCCESS”, stop waiting and adjust the Emotional state, e.g., be Happy;

[0194] ii. Or, not hear it in time, timeout, and post failure (unhappy or frustrated).

[0195] It also stops the ambulate skill, so that the creature does not stay stuck looking for Tree forever.

[0196] 2.7 AI Graph Data Structure

[0197] The AI Engine relies on a complex internal data structure, the so-called “AI Graph”. The AI Graph contains all behavior trees, motion transition graphs, learning networks, etc. for each of the characters as well as functional specifications for the world and the cameras. The AI Engine traverses the AI Graph to determine the update to the graphical character world. The AI Engine also modifies the AI Graph to accommodate for permanent changes (e.g., learning) in the characters or the world. For more information, refer to Section 7.0 Three-Tiered Data Architecture.

3. .ing File Format

[0198] 3.1 Basic Functionality

[0199] The .ing file format is essentially the AI Graph written out to a file. It contains all character, world and camera behavior specification. The .ing file format is a flexible, extensible file format with strong support for versioning. The .ing file format is a binary file format (non-human readable).

[0200] 3.2 File Content

[0201] The .ing file contains all of the information inherent in the AI Graph.

4. The AI Player

[0202] FIG. 14 is a schematic diagram providing a high level description of the functionality of the AI Player.

[0203] 4.1 Basic Functionality

[0204] The AI Player is a shell around the AI Engine that turns it into a plugin to a Web browser. The AI Player is a sophisticated piece of software that performs several tasks:

[0205] (i) it reads the .ing file;

[0206] (ii) it uses the AI Engine to compute the character's behavior based on user interaction; and

[0207] (iii) it connects to a graphics adapter and directs the rendering of the final animation that is visible to the end user.

[0208] The AI Player also includes basic maintenance components, such as the mechanism for the AI Player's version updates and the ability to prompt for, and verify, PowerCodes (see below) entered by the user to unlock components of the interaction (e.g., toy ball, book, etc.).

[0209] 4.2 Overall Design

[0210] The overall AI Player design is shown in FIG. 15.

[0211] The AI Engine forms the heart of the AI Player. The AI Engine's animation module connects directly to a Graphics Adapter which, in turn, asks the appropriate Graphics Engine (e.g., Wild Tangen™, Flash™, etc.) to render the requested animation.

[0212] The Graphics Adapter is a thin interface that wraps around a given graphics engine, such as WildTangent™ or Flash™. The advantage of using such an interface is that the AI Player can be selective about the way the same character renders on different machines, depending on the processing power of a particular machine. For low-end machines, the Flash™ graphics engine may provide a smoother pseudo-3D experience. High-end machines, on the other hand, will still be able to benefit from a fully interactive 3D environment provided by a graphics engine such as WildTangent™.

[0213] Furthermore, the different graphics engines (Flash™, WildTangent™, etc.) have different data file requirements. Flash™, for example, requires a number of independent flash movie snippets, whereas the WildTangent™ engine requires 3D model files. The corresponding graphics adapters know the file structure needs for their graphics engines and they are able to request the correct graphics data files to be played out.

[0214] Finally, having different graphics engines wrapped in the same graphics adapter interface allows for easy expansion of the number of supported graphical engines in the future. If the need arises to create a hybrid graphics engine later on, this can be done and it can be integrated seamlessly with the AI Player.

[0215] The AI Engine relies on two other pieces of code within the AI Player itself—the Persistent State Manager and the Persister. The Persistent State Manager tracks and records changes that happen within the original scene during user interaction. The Persistent State Manager monitors the learning behavior of the character as well as the position and state of all objects in the scene. How the manager stores this information depends entirely on the Persister. The Persister is an interchangeable module whose only job is to store persistent information. For some applications, the Persister will store the data locally, on the user's hard drive. For other applications, the Persister will contact an external server and store the information there. By having the Persister as an external module to the AI Player, its functionality can be modified without modifying the AI Player, as shown in FIG. 16.

[0216] The Code Enter and Authorizer components are two other key components of the AI Player. Any character or object in the scene has the ability to be locked and unavailable to the user until the user enters a secret code through the AI Player. Hence, characters and scene objects can be collected simply by collecting secret codes. In order to achieve this functionality, the AI Player contains a piece of logic called Code Enter that allows the AI Player to collect a secret code from the user and then connect to an external Authorizer module in order to verify the authenticity of that secret code. Authorizer, on the other hand, can be as simple as a small piece of logic that authorizes any secret code that conforms to a predefined pattern or as complex as a separate module that connects over the Internet to an external server to authorize the given code and expire it at the same time, so it may be used only once. The exact approach to dealing with secret codes may be devised on an application-by-application basis, which is possible because of the Authorizer modularity. The interaction between the Authorizer and Code Enter is depicted in FIG. 17.

[0217] 4.2.1 User Input

[0218] Since each graphics engine is the rendering end point of the character animation, it is also the starting point of user interaction. It is up to the graphics engine to track mouse movements and keyboard strokes, and this information must be fed back into the AI logic component. To solve this problem, an event queue is used into which the graphics adapter queues all input information, such as key strokes and mouse movements. The main player application has a list of registered event clients, or a list of the different player modules, all of which are interested in one type of an event or another. It is the main player application's responsibility to notify all the event clients of all the events they are interested in knowing about, as shown in FIG. 18.

[0219] 4.2.2 Code Structure and Organization

[0220] For ease of development as well as ease of future modifications, it is desirable the structure of the code be rigid and well defined. Careful layering of the code provides this. The AI Player code is organized into layers, or groups of source code files with similar functionality and use, such that any given layer of code will only be able to use the code layers below it and are unaware of the code layers above it. By utilizing a strong code structure such as this, it is possible to isolate core functionality into independent units, modularize the application, and allow for new entry points into the application so as to expand its functionality and applicability in the future.

[0221] 4.2.3 Code Layers

[0222] The layers for the AI Player are shown in FIG. 19.

[0223] The Core Layer forms the base of all the layers and it is required by all of the layers above it. It administers the core functionality and data set definitions of the AI Player. It includes the Graph Library containing classes and methods to construct scene graphs, behavioral graphs, and other similar structures needed to represent the character and scene information for the rest of the application. Similarly, it contains the Core Library which is essentially a collection of basic utility tools used by the AI Player, such as event handling procedures and string and IO functionality.

[0224] The File Layer sits directly on top of the Core Layer and contains all file handling logic required by the application. It utilizes the graph representation structures as well as other utilities from the Core Layer, and it itself acts as a utility to all the layers above it to convert data from files into internal data structures. It contains functions that know how to read, write, and interpret the .ing file format.

[0225] The Adapter Layer defines both the adapter interface as well any of its implementations. For example, it contains code that wraps the adapter interface around a WildTangent™ graphics engine and that allows it to receive user input from the WildTangent™ engine and feed it into the application event queue as discussed above.

[0226] The Logic Layer contains the AI logic required by the AI Player to create interactive character behaviors. The AI Logic Module is one of the main components of the Logic Layer. It is able to take in scene and behavior graphs as well as external event queues as input and compute the next state of the world as its output.

[0227] The Application Layer is the top-most of the layers and contains the code that “drives” the application. It consists of modules that contain the main update loop, code responsible for player versioning, as well as code to verify and authorize character unlocking.

[0228] 4.2.4 Application Programming Interface (API)

[0229] The system of code layering opens the possibility of another expansion in the AI Player's functionality and use. It allows the AI Player's API to be easily exposed to other applications and have them drive the behavior of the player. It will permit Java, Visual Basic or C++ APIs to be created to allow developers to use the AI Player's functionality from their own code. In this way, complex functionality is introduced “on top of” the AI Player. Custom game logic, plot sequences, cut scenes, etc. can be developed without any need to modify the core functionality of the AI Player.

[0230] FIG. 20 shows a parallel between (i) the architecture of the WildTangent™ plugin, and (ii) the architecture of the AI Player together with WildTangent™ graphics. WildTangent™ currently allows Java application programming through its Java API. The AI Player becomes another layer in this architecture, allowing the developer to access the AI functionality through a similar Java API.

[0231] 4.3 Platforms/Compatibility The AI Player will run on the Windows and OSX operating systems, as well as across different browsers running on each operating system. By way of example, but not limitation, the AI Player will run on the following platforms: Windows/Internet Explorer, Windows/Netscape, OSX/Internet Explorer, OSX/Netscape, OSX/Safari, etc. See FIG. 21.

5. Studio Tool

[0232] FIG. 22 is a schematic diagram providing a high level description of the functionality of the platform's Studio Tool.

[0233] 5.1 Basic Functionality

[0234] The Studio Tool is a standalone application, a graphical editing environment that reads in data, allows the user to modify it, and writes it out again. The Studio Tool reads in the .ing file together with 3D models, animations, textures, sounds, etc. and allows the user to author the characters' AI through a set of Editors. A real-time preview is provided to debug the behaviors. Finally, the Studio Tool allows the user to export the characters' AI as an .ing file, together with all necessary graphics and sound in separate files.

[0235] 5.2 ..ing Read/Write

[0236] The Studio Tool needs to read and write the ing file format. Together with the .ing specification, there is a Parser for .ing files. The Parser reads in an .ing file and builds the AI Graph internal data structure in memory. Conversely, the Parser traverses an AI Graph and generates the .ing file. The Parser is also responsible for the Load/Save and Export functionality of the Studio Tool.

[0237] 5.3 Importers

[0238] In addition to reading the .ing file, the Studio Tool imports 3rd party data files that describe 3D models for the characters, objects and environments, animation files, sound and music files, 2D texture maps (images), etc. These file formats are industry standard. Some of the file format choices are listed in FIG. 23.

[0239] The list of importers is intended to grow over time. This is made possible by a using a flexible code architecture that allows for easy additions of new importers.

[0240] 5.4 GUI Editors

[0241] In essence, the behavior of any character is defined by graphs—networks of nodes and connections, representing states and transitions between states respectively. The authoring process thus involves creating and editing such graphs. There are different types of graphs that represent behavior trees, sensory networks, learning equations, and motor transition graphs. Each graph type has a Graphical User Interface (GUI) Editor associated with it. Each Editor supports “drag and drop” for nodes and connections, typing in values through text boxes, etc. All changes made to the AI graphs are immediately visible in the behavior of the character as shown in the Real-Time Preview window.

[0242] 5.4.1 Sensors

[0243] Sensors are nodes that take in an object in the 3D scene and output a numerical value. For example, a proximity Sensor constantly computes the distance between the character and an object it is responsible for sensing. The developer must set up a network of such connections through the Sensor Editor. See FIG. 24.

[0244] 5.4.2 Behaviors

[0245] Behavior trees are complex structures that connect the output values from Sensors, Drives and Emotions to inputs for Behaviors and Behavior Groups. Behaviors then drive the Motor System. A behavior tree is traversed on every update of the system and allows the system to determine what the most relevant action is at any given moment. The developer needs to set up the behavior trees for all autonomous characters in the 3D world through the Behavior Editor.

[0246] Behavior trees can often be cleanly subdivided into subtrees with well defined functionality. For example, a character oscillating between looking for food when it is hungry and going to sleep when it is well fed can de defined by a behavior tree with fairly simple topology. Once a subtree that implements this functionality is defined and debugged, it can be grouped into a new node that will appear as a part of a larger, more complicated behavior tree. The Behavior Editor provides such encapsulation functionality. See FIG. 25.

[0247] 5.4.3 Emotions

[0248] FIG. 26 is a schematic diagram providing a high level description of the functionality of the emotion system.

[0249] The Emotion Editor must provide for a number of different functionalities:

[0250] (i) Designing how the outcome of different behaviors affects the emotional state of the character;

[0251] (ii) Designing how the emotional state affects the character's future choice of behavior; and

[0252] (iii) Adjusting the parameters of the given emotional model (e.g., the AVS Emotional Cube, where “AVS” stands for Arousal, Valence, and Stance).

[0253] It is important to design and control the complex interplay between the Behavior and Emotion systems. Different Behavior outcomes must affect emotion (e.g., the character just ate lunch and therefore became happy) and, conversely, emotion must affect the choice of behavior (e.g., since the character is happy, it will take a nap). The Emotion Editor allows for the authoring of such dependencies.

[0254] The character will typically follow a fixed emotional model (for example, the AVS emotional cube, see FIG. 27). However, it is important to be able to adjust the parameters of such emotional model (e.g., the character is happy most of the time) as this functionality allows for the creation of personalities.

[0255] 5.4.4 Learning

[0256] FIG. 28 is a schematic diagram providing a high level description of the learning system.

[0257] The Learning Editor must allow the developer to insert a specific learning mechanism into the Behavior graph. A number of learning mechanisms can be designed and the functionality can grow with subsequent releases of the Studio Tool. In the simplest form, however, it must be possible to introduce simple reinforcement learning through the Learning Editor.

[0258] 5.4.5 Motor System

[0259] The developer needs to set up a motor transition graph, i.e., a network of nodes that will tell the Motor System how to use the set of animations available to the character. For example, if the character has the “Sit”, “Stand Up” and “Walk” animations available, the Motor System must understand that a sitting character cannot snap into a walk unless it stands up first. See FIG. 29. It is up to the user to define such dependencies using the Motor Editor.

[0260] 5.5 Real-Time Preview

[0261] The Studio Tool allows for an immediate real-time preview of all changes to the character's behavior. This happens in a window with real-time 3D graphics in which the characters roam around. The immediacy of the changes in the characters' behavior is crucial to successful authoring and debugging.

[0262] FIG. 30 shows the sequence of updates used to propagate a user change in a character's behavior network all the way through to affect the character's behavior. User input (e.g., click, mouse movement, etc.) is collected in the Graph Editor window and used to interpret the change and to repaint the graph. The change is propagated to the internal data structure that resides in memory and reflects the current state of the system. A behavior update loop traverses this data structure to determine the next relevant behavior. The behavior modifies the 3D scene graph data structure and the 3D render loop paints the scene in the Real-Time Preview window.

[0263] The Studio Tool thus needs to include a full real-time 3D rendering system. This may be provided as custom code written on top of OpenGL or as a set of licensed 3rd party graphics libraries (e.g., WildTangent™). The code to synchronize the updates of the internal memory data structure representing the “mind” of the characters with all rendering passes must be custom written.

[0264] 5.6 Exporters

[0265] Once the user designs the behavior specifications for the virtual world and all the characters in it, it is necessary to export the work. The “write” functionality of the .ing parser is used to generate the final .ing file. Separate exporters are used to generate the graphics and sound data files necessary for each of the graphics delivery solutions supported (e.g., WildTangent™, Flashy, etc.). This is done using the file format specifications provided by the parties owning those file formats.

[0266] 5.7 Platforms/Compatibility

[0267] The Studio Tool is designed to run on all operating systems of interest, including both Windows and OSX.

6. Layered AI Architecture

[0268] FIG. 31 is a schematic diagram providing a high level description of the system's AI architecture.

[0269] The AI Platform is designed to be modular and media independent. The same AI Engine can run on top of different media display devices, such as but not limited to:

[0270] 3D Graphics Systems (WildTangent, Pulse3D, Adobe Atmosphere, etc.);

[0271] 2D Graphics Systems (Flash, Director, etc.);

[0272] Audio Systems (DirectAudio, etc.);

[0273] Robots (Kismet, Leonardo, Space Shuttle, Mars Rover, etc.); and

[0274] Animatronic Figures (“Pirates of the Caribbean” theme ride, Terminator, etc.).

[0275] This is accomplished by introducing a general MediaAdapter API and a suite of media-specific MediaAdapters that implement it. There is one MediaAdapter for each desired media device. Swapping in different MediaAdapters is extremely easy, a single line change in a page of html code suffices. This introduces high flexibility and reusability of the system.

[0276] In case of on-screen animated characters, a typical implementation of the system consists of a GraphicsAdapter and an AudioAdapter. If convenient, these may point to the same 3rd party media display device.

[0277] The character media files (3D models, animations, morph targets, texture maps, audio tracks, etc.) are authored in an industry-standard tool (e.g., Maya, 3Dstudio MAX, etc.) and then exported to display-specific file formats (WildTangent .wt files, Macromedia Flash .swf files, etc.). One collection of Master Media Files is used.

[0278] The AI Platform descriptor files are exported with each of the display-specific file formats. For example, a .wting file is generated in addition to all .wt files for an export to WildTangent Web Driver™ Equivalently, .FLing files describe Flash media, etc. At runtime, a Media Adapter and a 3rd party Media Renderer are instantiated. The media and media descriptor files are read in.

[0279] The AI Engine sits above the Media Adapter API and sends down commands. The Media Renderer generates asynchronous, user-specific events (mouse clicks, key strokes, audio input, voice recognition, etc.) and communicates them back up the chain to all interested modules. This communication is done through an Event Queue and, more generally, the Event Bus.

[0280] The Event Bus is a series of cascading Event Queues that are accessible by modules higher in the chain. The Event Queue 1 collects all events arriving from below the Media Adapter API and makes them available to all modules above (e.g., Animation Engine, Behavior Engine, Game Code, etc.). Similarly, The Event Queue 2 collects all events arriving from below the Motor Adapter API and makes them available to all modules above (e.g., Behavior Engine, Game Code, etc.). In this way, the flow of information is unidirectional: each module “knows” about the modules below it but not about anything above it.

[0281] The Motor Adapter API exposes the necessary general functionality of the Animation Engine. Because of this architecture, any Animation Engine that implements the Motor Adapter API can be used. Multiple engines can be swapped in and out much like the different media systems. A motor.ing descriptor file contains the run-time data for the Animation Engine.

[0282] The Behavior Adapter API exposes the behavioral functionality necessary for the Game Code to drive characters. Again, any behavior engine implementing the Behavior Adapter API can be swapped in. A behavior.ing descriptor file contains the run-time data for the Behavior Engine.

[0283] As a result, the API of each module can be exposed as a separate software library. Such libraries can be incorporated into 3rd party code bases.

[0284] Each character contains a Blackboard, a flat data structure that allows others to access elements of its internal state. A blackboard.ing descriptor file contains the run-time data for a character's blackboard.

[0285] A Game System is a module written in a programming language of choice (e.g., C++, Java, C#) that implements the game logic (game of football, baseball, space invaders, tic-tac-toe, chess, etc.). It communicates with the AI system through the exposed APIs: Game API, Motor Adapter API, and Media Adapter API. It is able to read from the Event Bus and access character blackboards. The files containing game code are those of the programming language used.

[0286] If desired, all sub-system .ing data files (e.g., motor, behavior, etc.) for can be collected into a single .ing file. As a result, a full interactive experience preferably as four main types of files:

[0287] 3rd party media files (e.g., .wt files for WildTangent media);

[0288] Media descriptor files (e.g., .WTing descriptor for the WildTangent Graphics Adapter);

[0289] AI files (e.g., .ing master file containing all information for behavior, motor, blackboard, etc.); and

[0290] Game code files (e.g., Java implementation of the game of tic-tac-toe).

7. Three-Tiered Data Architecture

[0291] 1. Three-Tiered Data Architecture (3TDA) (see FIG. 32).

[0292] a. The 3TDA is a general concept which clearly delineates the ideas of:

[0293] i. Descriptive Data (a file, network transmission, or other non-volatile piece of descriptive data): Tier I;

[0294] ii. Run-Time Data Structure that represents the Descriptive Data: Tier II; and

[0295] iii. Functional operations that are applied to or make use of the Run-time Data Structure: Tier III.

[0296] b. These three ideas permit a software architecture to be developed:

[0297] i. that is file-format independent;

[0298] ii. whose data structures are not only completely extensible but also completely independent of the run time functionality; and

[0299] iii. whose run time functionality is completely extensible because the run time data structure is simply a structured information container and does not make any assumptions about or enforce any usage methods by the run time functionality.

[0300] 2. Generic Graph, Behavior Graph, Blackboard, and Neural Nets as example (but not limiting) instances of 3TDA.

[0301] a. Generic Graph

[0302] i. A generic directed graph can be constructed using the above concepts. Imagine a file format (Tier I) that describes a Node. A node is a collection of Fields, each field being an arbitrary piece of data—a string, a boolean, a pointer to a data structure, a URL, anything. Such a file format could be written as such:

(1) (Node
    (Field String “Hello”)
    (Field Integer 3)
    (Field Float 3.14159)
    )

[0303] ii. A node could also have fields grouped into inputs and outputs—outputs could be the fields that belong to that node, and inputs could be references to fields belonging to other nodes. Example:

(1)
(Node
(Name Node1)
(Outputs
(MyField String “Hello World”)
)
)
(Node
(Name Node2)
(Outputs
(AField String “Hello”)
(AnotherField Integer 3)
(YetAnotherField Float 3.14159)
)
(Inputs
(Node1.MyField)
)
)

[0304] iii. By using the above description, a two-node graph is constructed. Just as easily, a 100-node graph could be constructed. Yet nowhere is there any indication of the potential functionality of this graph—it is simply a data structure of arbitrary topological complexity with an arbitrary richness and sophistication of data content (II).

[0305] iv. To each node in this graph, one or more Updaters can be attached, stand-alone pieces of functionality (Tier III) that are associated with that node. An updater's job is to take note of a node's fields and anything else that is of importance, and perhaps update the node's fields. For instance, if a node has two numeric inputs and one numeric output, an AdditionUpdater could be built that would take the two inputs, sum them, and set the output to that value. Note that more than one updater can be associated with a single node and more than one node with a single updater. Also, note that 1) the updater has no notion or relationship to the original data format that described the creation of the node, 2) each updater may or may not know or care about any other updaters, and 3) each updater may or may not care about the overall topology of the graph. The updaters' functionality can be as local or as broad in scope as is desired without impacting the fundamental extensibility and flexibility of the system. Which updaters are attached to which nodes can be described in the graph file or can be cleanly removed to another file. Either way, the file/data/functionality divisions are enforced.

[0306] v. With such a general graph system, where the data is cleanly delineated from the functional aspects of the graph, some useful examples can be derived.

[0307] b. Artificial Neural Network

[0308] i. Using a graph as described above, an Artificial Neural Network could be implemented. By describing the data fields in each node as being numeric weights and attaching Updaters such as AdditionUpdater, XORUpdater, AndUpdater, and OrUpdater, a fully functional artificial neural network may be created whose data and functionality are completely separate. That network topology may then be used in a completely different manner, as a shader network, for example, simply by changing the updaters. Note also that the network structure that has been created by the updaters can be saved out to a general file description again (Tier I).

[0309] c. Behavior Graph

[0310] i. The general graph structure can be used to implement a behavior graph. Each node can be defined to contain data fields related to emotion, frustration, desires, etc. Updaters can then be built that modify those fields based on certain rules—if a desire is not being achieved quickly enough, increase the frustration level. If the input to a desire node is the output of a frustration node, an updater may change the output of the desire node as the frustration increases, further changing the downstream graph behavior.

[0311] d. Blackboard

[0312] i. A graph may be defined in which none of the nodes are connected—they simply exist independently of one another. In this case, the nodes can be used as a sort of Blackboard where each node is a repository for specific pieces of data (fields) and any piece of functionality that is interested can either query or set the value of a specific field of a specific node. In this manner a node can share data among many interested parties. Updaters are not required in this use Nodes, which shows again that the removal of the updater system (Tier III) in no manner impacts the usefulness of extensibility of the data structure (Tier II) and affiliated file format that describes it (Tier I). Note below where updaters will be used with the blackboard to communicate with the event system.

[0313] e. Infinite Detail

[0314] i. Because of the data separation, an updater may only be told about some particular fields of a node. Note that, because of this, and because of the fact that a node may have more than one updater, a node may be supported by a potentially arbitrary amount of data. Imagine a creature's behavior graph that contains a node. That node has two inputs relating to vision and sound (eyes and ears) and a single output detailing whether the creature should proceed forward or run away. It is possible to create a separate graph being used as an artificial neural network, and to hide that graph completely inside an updater that is attached to the node. When the updater looks at the node, it takes the value of the two input fields, gives them to it's arbitrarily large neural network that the node, the behavior graph, and the other updaters know nothing about, takes the output value of it's neural network, and sets the walk forward/run away field of the original node to that value. Despite the fact that the original node in the behavior graph only has three fields, it is supported by a completely new and independent graph. And note that the neural net graph could, in turn, be supported by other independent graphs, and so on. This is possible because the data and the functional systems cleanly delineated and are not making assumptions about each other.

[0315] 3. Event System

[0316] a. When something of interest happens in a game or interactive or any other piece of functionality (mouse click, user interaction, system failure, etc), there may be other pieces of functionality that want to know about it. A system can be built that sends events to interested parties whenever something of interest (an event trigger) has happened. A generic event system can be built based on three basic pieces:

[0317] i. An event object—an object that contains some data relevant to the interesting thing that just happened.

[0318] ii. An event listener—someone who is interested in the event.

[0319] iii. An event pool—a clearinghouse for events. Event listeners register themselves with an event pool, telling the event pool which events they are interested in. When a specific event is sent, the event pool retrieves the list of parties interested in that specific event, and tells them about it, passing along the relevant data contained in the event object.

[0320] b. A general event system can be built by not defining in advance exactly what events are or what data is relevant to them. Instead, it is possible to define how systems interact with the event system—how they send events and how they listen for them. As a result, event objects can be described at a later time, confident that while existing systems may not understand or even know about the new event descriptions, they will nonetheless be able to handle their ignorance in a graceful manner, allowing new pieces of functionality to take advantage of newly defined events.

[0321] i. As an example, imagine two different event types—system events and blackboard events. System events consist of computer system-related event triggers—mouse clicks, keyboard presses, etc. Blackboard events consist of blackboard-related event triggers—the value of a field of a node being changed, for instance. Because the basic manner in which systems interact can be defined with event systems—registering as a listener, sending events to the pool, etc, to create a new event type, only the set of data relevant to the new event has to be defined. Data for mouse events may include the location of the mouse cursor when the mouse button was clicked, data for the blackboard event may included the name of the field that was changed.

[0322] ii. Using the blackboard, and even the generic graph detailed above as an example, a graph event could be defined that is triggered when something interesting happens to a graph node. An updater could be used that watches a node and its fields. When a field goes to 0 or is set equal to some value or when a node is created or destroyed, an event can be fired through the newly-defined graph event pool. Systems that are interested in the graph (or the blackboard) can simply register to be told about specific types of events. When such an event is triggered, the systems will be told about it and passed the relevant information.

8. Business Methodology and Brand Involvement Metrics

[0323] 8.1 Business Methodology

[0324] “One important relationship for many brands is a friendship link characterized by trust, dependability, understanding, and caring. A friend is there for you, treats you with respect, is comfortable, is someone you like, and is an enjoyable person with whom to spend time.” David Aaker, “Building Strong Brands”.

[0325] The marketing landscape is changing, bringing to the forefront a need for strengthening the Brand. The present invention provides a means to create a compelling, long-time, one-on-one Brand interaction—between the Brand and the Brand's consumer.

[0326] “We cannot sell more packages unless we have entertainment,” Consumer Packaged Goods (CPG) companies are increasingly realizing this dynamic. Children are used to bite-size, videogame-like fast entertainment, and used to food that provides such entertainment with on-package puzzles or in-box toys. Adults are used to food with colorful packaging and co-branding of entertainment properties.

[0327] There are two distinct pulls within marketing—Promotions and Branding. There is a tension between the two pulls. On the one hand, companies are feeling pressure to increase promotions spending for fast volume lifts. On the other hand, marketers spend large resources on Branding and Communications.

[0328] 8.1.1 Promotions Marketing

[0329] Several changes in the business landscape have made promotions increasingly strategic.

[0330] Marketing impact has shifted from TV to retail outlets. People decide on purchases at the shelf rather than in advance.

[0331] Wall Street's influence has risen sharply, which often leads to emphasis of short-term sales over long-term branding. Short-term sales increase with promotions, especially premium incentives sold along with the packaged product. The market for premium incentives (such as toys or DVDs included along with the product) was $26 billion in 2001, a quarter of total promotions spending.

[0332] Including premiums along with the product has become increasingly simple with new forms of technology (creating plastic toy and digital entertainment).

[0333] Companies have responded to these business pressures over the past decade: promotions spending has reached $99 billion in 2001, up from $56 billion in 1991.

[0334] 8 .1.2 Brand Marketing

[0335] To increase the frequency and length of customer interactions with their products, marketers are turning to Branding for several reasons.

[0336] After studying 100 of the world's most valuable brands, the well-known source of brand valuations Interbrand has concluded that a brand typically accounts for an average of 37% of market capitalization. For example, Interbrand's 2001 Survey names Coca-Cola as having the largest brand value. Coke's brand value was estimated to contribute up to 61% of its $113 billion market capitalization, for a total of $69 billion in brand value. This is used by many in marketing to demonstrate the significance of engaging in brand marketing.

[0337] According to McKinsey and Company, “Sustainable, profitable brand growth has become the key objective for most marketing executives.”

[0338] Brand marketing becomes more important as an increased variety of channels vie for the viewer's attention, from TV to the Internet to print. While the viewer is bombarded with advertisements, it has been shown that the viewer tends to ignore and bypass such attempts at advertising. For example, 88% of television commercials are skipped by viewers with TiVo boxes. As TiVo and other time-shifting devices proliferate, a dramatically large portion of all advertising dollars goes wasted.

[0339] At the same time that people bypass general advertising, a study by Research.net for Forbes.com shows that people, especially high-level executives, seek out branded content. In particular, high-level executives spend on average 16 hours per week on the Internet, compared to 8.6 hours on TV, 5.7 hours on radio, and 6.6 hours on print. “Business leaders, the survey found, respond positively to online advertising, which ranked highest over all other media measured (TV, radio, newspapers, magazines) when they want information on new products and services.”

[0340] Both Promotions and Branding are growing in size and influence within an organization as marketers walk the fine line between immediate consumer gratification accomplished through Promotions, and long-term mind-share with the consumer built up through Branding.

[0341] 8.2 The Artificial Intelligence Solution

[0342] The AI Platform answers the needs of both the Promotions and the Branding marketers within each organization. The AI Platform creates long-term interactive characters based on the Brand's own character property. Furthermore, these characters are collectible as part of a long brand-enhancing promotion.

[0343] With the present invention, virtual, three-dimensional, intelligent interactive characters may be created. CPG companies with brand mascots, Service companies with brand character champions, and Popular Entertainment Properties that want to bring their character assets to life. For these companies, Interactive Brand Champions (IBCs) (or, equivalently, Interactive Brand Icons (IBIs)) may be created that appear intelligent as they interact with the user and each other. The characters encourage collecting—the more characters are collected, the more interesting the virtual world they create. The characters are delivered to the user's personal computer over the web through a code or a CD-ROM or other medium found on the inside of consumer goods packaging.

[0344] The AI Solution based on branded intelligent interactive characters enables an organization to:

[0345] 1. Develop and strengthen brand identity.

[0346] 2. Create one-on-one brand value communication channel.

[0347] 3. Generate continuous, long-term interaction with the brand.

[0348] 4. Collect precise user statistics.

[0349] 8.3 Business Applications

[0350] In various forms of the invention, there are systems for integrating the novel interactive environment with a commercial transaction system. Applications for the technology and invention can be found, without limitation, in the following:

[0351] 8.3.1 Embedded Entertainment

[0352] The present invention describes a technology system that delivers entertainment through virtual elements within a virtual environment that arrive at the viewers' homes through physical products. Every can of food, bottle of milk, or jar of jam may contain virtual elements. In addition, but without limitation, codes can be accessible from a combination of physical products, such as through a code printed on a grocery store receipt or on a package of food. It is entertainment embedded in the physical product or group of products; it is a marriage of bits (content) and atoms (physical products).

[0353] There are different ways in which this can be accomplished, by way of example but not limitation:

[0354] a. Alphanumeric code

[0355] b. Sensing mechanism

[0356] c. Barcode

[0357] More particularly, in this form of the invention, a customer might buy a product from a vendor and, as a premium for the purchase, receive a special access code. The customer then goes to a web site and enters the access code, whereupon the customer will receive a new virtual element (or feature for an existing virtual element) for insertion into the virtual environment, thus making the virtual environment more robust, and hence more interesting, to the customer. As a result, the customer is more motivated to purchase that vendor's product.

[0358] By way of example but not limitation, the XYZ beverage company might set up a promotional venture in which the novel interactive environment is used to create an XYZ virtual world. When customer John Smith purchases a bottle of XYZ beverage, John Smith receives, as a premium, an access code (e.g., on the underside of the bottle cap). John Smith goes home, enters the access code into his computer and receives a new object (e.g., an animated character) for insertion into the XYZ virtual world. As the XYZ world is populated with more and more objects (e.g., characters, houses, cars, roads, etc.), or features for objects (e.g., a skill for an existing character), the XYZ virtual world becomes progressively more robust, and hence progressively interesting, for John Smith. The characters encourage collecting—the more characters are collected, the more interesting the virtual world they create. John Smith is therefore motivated to purchase XYZ beverages as opposed to another vendor's beverages. See FIG. 33.

[0359] 8.3.2 Interactive Brand Champions

[0360] The present invention provides a method of strengthening brand identity using interactive animated virtual characters, called Interactive Brand Champions. The virtual characters are typically (but not limited to) representations of mascots, character champions, or brand logos that represent the brand.

[0361] By way of example but not limitation, the XYZ food company or the ABC service company might have a character that represents that brand. The brand character might display some traditionally ABC-company or XYZ-company brand values, such as (but not limited to) trust, reliability, fun, excitement. In this case, a brand champion is created, an animated virtual element that also possesses those same brand values. In particular, but without limitation, the brand characters may belong to CPG companies with brand mascots, Service companies with brand character champions, and Popular Entertainment Properties that want to bring their character assets to life.

[0362] The concept of branded intelligent interactive characters enables an organization to:

[0363] 1. Develop and strengthen brand identity. Through an animated character brand champion, the customer's brand benefits from increased visibility, high technological edge, and increased mind share with the customer.

[0364] 2. Create one-on-one brand value communication channel. Because the characters exhibit autonomous behavior, emotion and learning, they interact with each user in a way that is unique and personalized. As a result, the organization gains a unique, one-on-one channel of communication between its brand and its target audience.

[0365] 3. Generate continuous, long-term interaction with the brand. Because the characters learn and adapt to changing conditions and interaction patterns, the user experience remains fresh and appealing for a significantly longer time than previously possible.

[0366] 4. Collect precise user statistics and determine Brand Involvement. The extent of the promotion can be monitored precisely through statistical analysis of the traffic over applicable databases. This information is compiled and offered to the organization as a part of the service license. In this way, the client can directly measure intangible benefits such as feedback and word of mouth and metrics of Brand Involvement, variables previously impossible to measure.

[0367] 8.4 Brand Involvement

[0368] In order to evaluate each application of the AI Platform, here are several new metrics to measure the success of each particular instantiation of the system. These metrics are called metrics of Brand Involvement as they measure the amount of interaction by the user with the brand character.

[0369] Brand Involvement Metrics include, without limitation, the following metrics:

[0370] (i) Measure of Ownership. How customized a character does the user create? By a way of example but not limitation, this metric is defined as the dot product of the personality vector of the user's character after a time of interaction and the personality vector of the original character. This metric thus represents the “distance” that the user covered in owning the character.

[0371] (ii) Measures of Caregiver Interaction. How emotionally involved is the user with the character? There are two metrics of caregiver interaction: sad-to-happy and time-to-response. By a way of example but not limitation, the sad-to-happy metric is a percentage of the times that a character was sad (or in another negative emotional state) and the user proactively interacted with the character to change the character's state to happy (or to another positive state). The time-to-response metric is the length of time on average before the user responds to the character's needs.

[0372] (iii) Measures of Teacher Interaction. How much did the character learn and how much did the user teach? The two metrics observed are number of behaviors modified or changed as a result of interaction and number of times user attempted to correct the character's behavior.

[0373] (iv) Measure of Positive-Neutral-Negative Relationship. How much did the user not interact at all (neutral)? A neutral interaction is less preferable in terms of creating a relationship with the brand to that with a positive or negative interaction. Even a negative interaction can reveal interesting elements of the user's desired relationship and boundaries of interacting with the brand. As another measure, how long did the user interact in a positive and in a negative way? These metrics may be measured in a number of ways, including without limitation as percentage of all possible interactions or as degrees of intensity of interaction. FIG. 34 refers to possible positive and negative interactions, as a measure of Brand Involvement.

[0374] Thus Brand Involvement can be measured, without limitation, by metrics of 1) ownership, 2) caregiver interaction, 3) teacher interaction, and 4) positive-neutral-negative brand relationship.

9. Modules

[0375] FIG. 35 shows a list of modules utilized in one preferred form of the present invention.

[0376] At a minimum, the AI Player provides at least the following functionality:

[0377] (i) Installs and runs in a Web browser;

[0378] (ii) Reads in an .ing file;

[0379] (iii) Builds the AI Graph data structure in memory;

[0380] (iv) Executes behaviors as specified in the AI Graph;

[0381] (v) Renders finished characters using a graphics engine;

[0382] (vi) Reads in graphic engine graphics files, as necessary;

[0383] (vii) Drives a graphics engine;

[0384] (viii) Takes in a PowerCode, if necessary;

[0385] (ix) Verifies a PowerCode, as necessary; and

[0386] (x) Keeps track of world state between sessions (combined with user/login databases) as necessary.

10. System Applications

[0387] Based on the requirements of the user, it is believed that there are at least three major scenarios in which the novel software platform will be used: CD-ROM release, Web release, and independent authoring and use.

[0388] 10.1 CD-ROM Release

[0389] FIG. 36 is a schematic diagram providing a high level description of a CD-ROM release.

[0390] In the case of shipping characters on a CD-ROM, the AI Player and all data files must be contained on the CD-ROM and install on the user's computer through a standard install procedure. If the CD-ROM is shipped as a part of a consumer product (e.g., inside a box of cereal), a paper strip with a printed unique alphanumeric code (i.e., the PowerCode) is also included. While the CD-ROM is identical on all boxes of cereal, each box has a unique PowerCode printed on the paper strip inside.

[0391] Once the end-user launches the AI Player, he or she can type in the PowerCode to retrieve the first interactive character. The PowerCode may be verified, as necessary, through a PowerCode database that will be hosted remotely. In this case, the user's computer (the “client”) must be connected to the Internet for PowerCode verification. After successful verification, the character is “unlocked” and the user may play with it.

[0392] 10.2 Web Release

[0393] FIG. 37 is a schematic diagram providing a high level description of a Web release.

[0394] If the characters are delivered over the Web, the user will need to register and login using a password. Once the browser encounters an .ing file upon login, it downloads and installs the AI Player if not already present. When the user types in a PowerCode, it will be verified in a remote database. After a successful verification, the user can play with a freshly unlocked character.

[0395] The characters, collected together with any changes to their state, must be saved as a part of the account information for each user. The information in the user database grows with any PowerCode typed in.

[0396] 10.3 Authoring and Release

[0397] FIG. 38 is a schematic diagram providing a high level description of the authoring and release application scenario.

[0398] The Studio Tool makes it possible for any developer to generate custom intelligent characters. The .ing files produced may be posted on the Web together with the corresponding graphics and sound data. Any user who directs their browser to these files will be able to install the AI Player, download the data files and play out the interaction.

[0399] 10.4 General Model

[0400] Given the three major scenarios above, it is possible to define a general model describing the system. See FIG. 39. First, upon encountering an .ing file, the AI Player is downloaded and installed in the user's browser. Second, the character .ing file is downloaded. Third, the PowerCode is typed in and authorized. This last step is optional, as many applications may not require it. Finally, the user can play with an intelligent interactive character.

[0401] 10.5. Commercial Applications

[0402] The AI Platform is able to provide a game environment for children of different ages. The game entails a virtual reality world containing specific characters, events and rules of interaction between them. It is not a static world; the child builds the virtual world by introducing chosen elements into the virtual world. These elements include, but are not limited to, “live” characters, parts of the scenery, objects, animals and events. By way of example but not limitation, a child can introduce his or her favorite character, and lead it through a series of events. Since the characters in the AI Platform world are capable of learning, the underlying basic rules defining how the characters behave can change, causing the game to be less predictable and therefore more fascinating to a child. By introducing more and more characters to his or her virtual world and subjecting them to various events, a child can create a fascinating world where characters “live their own lives”.

[0403] The game provides the opportunity for the constant addition of new characters, elements or events by the child. Because this causes the game to be more robust, children will tend to have the desire to add new elements to the AI world.

[0404] A child might start interacting with an initially very simple environment of the AI world, i.e., an environment containing only one character and one environment element. Such a basic version of the AI world, in form of a plug-in to a Web browser (AI Player) may be obtained as a separate software package (with instructions of use) on a CD-ROM or downloaded over the Internet from the Ingeeni Studios, Inc. Website.

[0405] When a child becomes familiar with the initially simple rules of such a “bare” version, he or she will typically desire to change the character's behavior by inserting another character or event. Such insertion of a character or event, if repeated multiple times, will lead to building a more robust world, and will continuously drive the child to a desire to acquire more elements.

[0406] Such new desirable element can be obtained in different ways. In one preferred form of the invention, the key to obtaining a new character or element is the PowerCode, which needs to be typed in the computer by the child in order to activate the desirable element, so that the new element can be inserted into the AI world environment.

[0407] PowerCode is a unique piece of information that can be easily included with a number of products in the form of a printed coupon, thus enabling easy and widespread distribution. For example, a PowerCode can be supplied on a coupon inserted inside the packaging of food products, toy products or educational products. This helps promotion of both the AI Platform software and the particular products containing the PowerCode.

[0408] This way of distributing PowerCodes gives rise to a powerful business model. The desire for populating their virtual world causes children to explore ways in which they can obtain the PowerCode for the new elements or new characters.

[0409] Combining the distribution of PowerCode with distributing other goods, completely unrelated to the AI Platform, is a powerful marketing strategy. When presented with a choice between buying a product with or without PowerCode, the child's choice may be influenced by a desire to obtain another PowerCode and the child may choose the product which contains the PowerCode inside its packaging. In this way, marketers can help boost their sales by distributing a PowerCodes with their products. This way of distribution is particularly desirable with certain class of food products which target children, like breakfast cereals, chocolates, candies or other snacks, although it can also be implemented in the distribution of any product, i.e., children's movies, comic books, CDs, etc. Since PowerCode is easily stored on a number of media, e.g., paper media, electronic media, and/or Internet download, its distribution may also promote products distributed though less traditional channels, like Internet shopping, Web TV shopping, etc. It should also be appreciated that even though it may be more desirable to distribute PowerCodes with products whose target customers are children, it is also possible to distribute PowerCode with products designed for adults.

[0410] By way of example but not limitation, a PowerCode can be printed on a coupon placed inside a box of cereal. After the purchase of the cereal, the new desirable character or element can be downloaded from the Ingeeni Studios, Inc. Website, and activated with the PowerCode printed on a coupon.

[0411] The PowerCode obtained through buying a product will determine the particular environmental element or character delivered to the child. This element or character may be random. For example, a cereal box may contain a “surprise” PowerCode, where the element or character will only be revealed to the child after typing the PowerCode in the AI Platform application. Alternatively, a child might be offered a choice of some elements or characters. For example, a cereal box may contain a picture or name of the character or element, so that a child can deliberately choose an element that is desirable in the AI environment.

[0412] The child's AI Platform environment will grow with every PowerCode typed in; there is no limit as to how “rich” an environment can be created by a child using the characters and elements created and provided by Ingeeni Studios, Inc. or independent developers. Children will aspire to create more and more complex worlds, and they might compete with each other in creating those worlds so that the desire to obtain more and more characters will perpetuate.

[0413] Although the AI Platform is a game environment which may be designed primarily for entertainment purposes, in the process of playing the game, the children can also learn, i.e., as the child interacts with the AI world, he or she will learn to recognize correlations between the events and environmental elements of the AI world and the emotions and behavior of its characters. By changing the character's environment in a controlled and deliberate way, children will learn to influence the character's emotions and actions, thereby testing their acquired knowledge about the typical human emotions and behavior.

[0414] 10.6 Learning System—User Interactions

[0415] The AI Platform can generate, without limitation, the following novel and beneficial interactions:

[0416] Method of Teaching—User as Teacher

[0417] The user can train an interactive animated character while learning him or herself. Creating a virtual character that fulfils the role of the student places the human user in the position of a teacher. The best way one learns any material is if one has to teach it. Thus, this technology platform gives rise to a powerful novel method of teaching through a teacher-student role reversal.

[0418] User as Coach

[0419] The user can train an interactive animated character while learning him or herself within a sports setting. The user trains the virtual athletes to increase characteristics such as their strength, balance, agility. The more athletes and sports accessories are collected, the more the user plays and trains the team. Additionally, once a whole team is collected (although the interaction can, without limitation, be created for a single-user sport, such as snowboarding or mountain biking a particular course), with an entire team, the user can play against a virtual team or against another user's team. In this way users can meet online, as in a chat room, and can compete, without limitation, their separately trained teams.

[0420] User as Caretaker (Pet Owner, Mom/Dad)

[0421] The User can have the interaction of a caretaker such as (but not limited to) a pet owner or a Mom or Dad. The User can take care of the animated interactive character, including (but not limited to), making certain that the character rests, eats, plays as necessary for proper growth.

[0422] In another aspect of the present invention, the platform's life-like animated characters can be harnessed for educational purposes.

[0423] More particularly, it has been recognized that one of the best ways to learn a skill is to teach that skill to someone else. This concept may be powerfully exploited in the context of the novel artificial intelligence platform, which provides life-like animated characters which can engage the user in a more interesting and powerful interactive experience. By providing the proper storyline and animated characters to a user, the user can be called upon to teach a skill to the animated characters and, in the process, learn that skill themselves. In essence, the process consists of (i) providing an interesting and interactive virtual world to the user; (ii) presenting a learning circumstance to the user through the use of this virtual world; (iii) prompting the user to provide instructions to the animated characters, wherein the instructions incorporate the skill to be taught to the user, such that the individual learns the skill by providing instructions to the animated characters; and (iv) providing a positive result to the user when the instructions provided by the individual are correct. For example, suppose a parent wishes to help teach a young child about personal grooming habits such as washing their hands, brushing their teeth, combing their hair, etc. Here, the young child might be presented with a virtual world in which an animated character, preferably in the form of a young child, is shown in its home. The child would be called upon to instruct the animated character on the grooming habits to be learned (e.g., brushing their teeth) and, upon providing the desired instructions, would receive some positive result (e.g., positive feedback, a reward, etc.).

Claims

1. A virtual world comprising: a virtual environment; a plurality of virtual elements within said virtual environment, each of said virtual elements being capable of interacting with other of said virtual elements within the virtual environment; and user controls for enabling a user to interact with at least one of said virtual elements within said virtual environment; wherein at least one of said virtual elements comprises a virtual character comprising a behavior state, an emotion state and a learning state, and wherein said behavior state, said emotion state and said learning state are capable of changing in response to (i) interaction with other virtual elements within the virtual environment, and/or (ii) commands from said user input controls; and wherein said virtual environment is configured so that additional virtual elements can be introduced into said virtual environment.

2. A virtual character for disposition within a virtual environment, said virtual character comprising a behavior state, an emotion state and a learning state, and wherein said behavior state, said emotion state and said learning state are capable of changing in response to (i) interaction with other virtual elements within the virtual environment, and/or (ii) commands from outside said virtual environment.

3. A virtual character according to claim 2 wherein said virtual character further comprises a sensory capability for sensing other virtual elements within said virtual environment.

4. A virtual character according to claim 3 wherein said sensory capability is configured to sense the presence of other virtual elements within said virtual environment.

5. A virtual character according to claim 3 wherein said sensory capability is configured to sense the motion of other virtual elements within said virtual environment.

6. A virtual character according to claim 4 wherein said sensory capability is configured to sense a characteristic of other virtual elements within said virtual environment.