Patent Application
20110161060
The disclosed embodiments of the invention relate generally to computer-generated imagery, and relate more particularly to crowd simulation tasks in computer-generated imagery.
Virtual World applications (e.g., Second Life) are becoming an important component of the Connected Visual Computing (CVC) paradigm. One of the important tasks to be executed is the A.I. (artificial intelligence), wherein the characters in the virtual world perform specific assigned tasks and navigate through the world. The character navigation, also referred to as Crowd Simulation, is a computationally intensive task, and existing algorithms can only simulate a few thousands of agents in real-time. This is an order of magnitude from supporting the tens to hundreds of thousands of agents that would be required to generate a realistic virtual world scenario.
The disclosed embodiments will be better understood from a reading of the following detailed description, taken in conjunction with the accompanying figures in the drawings in which:
For simplicity and clarity of illustration, the drawing figures illustrate the general manner of construction, and descriptions and details of well-known features and techniques may be omitted to avoid unnecessarily obscuring the discussion of the described embodiments of the invention. Additionally, elements in the drawing figures are not necessarily drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve understanding of embodiments of the present invention. The same reference numerals in different figures denote the same elements, while similar reference numerals may, but do not necessarily, denote similar elements.
The terms “first,” “second,” “third,” “fourth,” and the like in the description and in the claims, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Similarly, if a method is described herein as comprising a series of steps, the order of such steps as presented herein is not necessarily the only order in which such steps may be performed, and certain of the stated steps may possibly be omitted and/or certain other steps not described herein may possibly be added to the method. Furthermore, the terms “comprise,” “include,” “have,” and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The terms “left,” “right,” “front,” “back,” “top,” “bottom,” “over,” “under,” and the like in the description and in the claims, if any, are used for descriptive purposes and not necessarily for describing permanent relative positions. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in other orientations than those illustrated or otherwise described herein. The term “coupled,” as used herein, is defined as directly or indirectly connected in an electrical or non-electrical manner. Objects described herein as being “adjacent to” each other may be in physical contact with each other, in close proximity to each other, or in the same general region or area as each other, as appropriate for the context in which the phrase is used. Occurrences of the phrase “in one embodiment” herein do not necessarily all refer to the same embodiment.
In one embodiment of the invention, a method of computing a collision-free velocity for an agent in a crowd simulation environment comprises identifying a quadratic optimization problem that corresponds to, the collision-free velocity, and finding an exact solution for the quadratic optimization problem by using a geometric approach.
Crowd Simulation in Virtual Worlds is of growing importance given the advent of 3D social networking sites. Likewise, Crowd Simulation is a growing component of the A.I. portion of the visual simulation loop. Computing collision-free velocities of the agents is the most time consuming part of the Crowd Simulation algorithm. The method most commonly used today is called RVO (Reciprocal Velocity Obstacle), wherein obstacle cones are formed for an agent in the velocity space, and a velocity that maximizes the time to collision with these cones is computed. The algorithm uses a sampling based method, where a set of 200-300 samples is chosen from a uniform distribution of points, and the sample that maximizes the time to collision is chosen as the velocity for the next time step of the agent. This method is not even guaranteed to find a collision-free velocity, and in fact often leads to collisions among agents.
In contrast, embodiments of the invention formulate the collision-free velocity problem as a quadratic optimization problem and solve it exactly using a geometric approach, as will be further described below. (A quadratic optimization problem seeks an optimal value where the optimization function is quadratic and the constraint functions are linear.) Embodiments of the invention enable local collision-avoidance velocities of the agents to be computed significantly faster than currently-used methods and enable the generation of realistic 3D crowd simulations, new use-case scenarios, and richer user experience. The disclosed methods are applicable to modern 3D games as well, since these are a specific instance of Virtual Worlds.
Referring now to the drawings,
As shown, the velocity arrow 115 for agent 110 intersects obstacle cone 125, meaning a collision with agent 120 is imminent. A new velocity for agent 110 must therefore be computed in order to avoid the collision; this new velocity should lie outside of both obstacle cones. Referring still to
As mentioned, embodiments of the invention compute the new (collision-free) velocity (which, it should be recalled, is a point in 2D velocity space) that lies outside all of the obstacle cones and deviates the least from the original velocity point. This may be done by minimizing the Euclidian distance of the new velocity from the original velocity to obtain the following quadratic optimization problem (in which (x0, y0) represents the original velocity and (x, y) represents the new velocity of the agent in question):
Minimize (x−x0)2+(y−y0)2, such that Aix+Biy<Ci for all cone segments. (1)
For N cones, there will be 2N such (linear) constraints.
Instead of using methods like interior point, active set, or conjugate gradient, embodiments of the invention exploit the geometric nature of the crowd simulation problem in order to compute the resultant velocity (x, y) geometrically. As an example, the appropriate resultant velocity can be visualized by manipulating obstacle cones in velocity space, as illustrated in
In some scenarios it may not be possible to find a solution. In these cases, the least significant constraint is removed (e.g., the agent that is least important for the agent in question is ignored), and the optimization problem is resolved according to the steps outlined above. As an example, the least important agent may be taken as the agent that is farthest away from the agent in question, or the agent that is moving in a direction directly opposite the motion of the agent in question, or that otherwise may be least likely to affect the agent in question.
Embodiments of the invention enable crowd simulation execution times (for numbers of agents varying from 100 to 250,000 and beyond) that are an order of magnitude faster than the best execution times reported in the literature. In addition, embodiments of the invention scale nearly linearly with large number of cores (32 and beyond), and also can exploit data-level parallelism to achieve even faster speedups. On an 8-core Intel Penryn system, for example, a 7× parallel scaling overall has been observed. When simulated with a many-core simulator, a 29× scaling on 32 cores was achieved. All together, on an 8-core, 3.2 GHz Penryn system, embodiments of the invention are able to simulate 15,000 agents at 58 FPS (frames per second) and 5,000 agents in a complex environment at 121 FPS.
The foregoing results were obtained, and embodiments of the invention were tested and compared to existing methods, using input data such as will now be described.
Circle-100: 100 agents start arranged uniformly around a circle and try to move directly through the circle to their antipodal position on the other side. The scenario becomes very crowded when all the agents meet in the middle, leading to swirling behavior.
Four-Streams: 2,000 agents are organized as four streams that walk along the diagonals of a square. Smooth motion, lane formation, and some swirls are observed.
Back & Forth: Between 10 and 100 agents move back and forth along a line. This test was run side-by-side with OpenSteer (a C++ library to help construct steering behaviors for autonomous characters in games and animation) to compare the number of collisions of unmodified OpenSteer versus collisions of OpenSteer combined with embodiments of the invention.
Building Evacuation: Agents are set up in initial positions in different rooms of an office building. The scene has 218 obstacles and the roadmap consists of 429 nodes and 7200 edges. The agents move towards the goal positions corresponding to the exit signs. Three versions of this scenario were used, with 500, 1000, and 5000 agents, respectively.
Stadium Scene: This simulates the motion of 25,000 agents as they exit from their seats out of a stadium. The scene has around 1400 obstacles and the roadmap consists of almost 2000 nodes and 3200 edges. The agents move towards the corridors, leading to congestion and highly-packed scenarios.
City Simulation: A city model with buildings and streets and 1500 obstacles was used. The roadmap has 480 nodes and 916 edges. The motion of different agents as they walk around the city and at intersections is simulated. The agents move at different speeds and overtake each other and avoid collisions with oncoming agents. Three versions of this scenario were used, with 10,000, 100,000 and 250,000 agents, respectively.
A step 310 of method 300 is to identify a quadratic optimization problem that corresponds to the collision-free velocity. As an example, the quadratic optimization problem can be similar to expression (1) that appears above. As another example, the computing device can be a client computer, the second computing device can be a server, and the communications network can be the Internet.
A step 320 of method 300 is to find an exact solution at the computing device for the quadratic optimization problem by using a geometric approach. In certain embodiments, the geometric approach involves identifying obstacle cones for the agent in a velocity space and finding a point that lies outside of the obstacle cones (where the point represents the collision-free velocity).
In some embodiments, finding the (collision-free velocity) point comprises identifying a plurality of obstacle cone boundary segments, identifying a subset of the obstacle cone boundary segments that lie outside of all of the obstacle cones, computing (for each obstacle cone boundary segment in the subset) a minimum distance from an initial point in the velocity space that corresponds to an initial velocity of the agent, and selecting a smallest one of the computed minimum distances. This smallest one of the minimum distances will be the point in question, i.e., the collision-free velocity.
A step 410 of method 400 is to identify as an outside boundary segment all boundary segments of the obstacle cones that lie outside of all other obstacle cones. As an example, the obstacle cones can be similar to obstacle cones 125, 135, 225, and 235 that are shown in
A step 420 of method 400 is to compute, for each outside boundary segment, a minimum distance of the outside boundary segment from the initial velocity. This computation may be accomplished simply by measuring the Euclidian distance (using standard techniques) between points in a velocity space.
A step 430 of method 400 is to select as the collision-free velocity a velocity corresponding to the smallest computed minimum distance.
A step 510 of method 500 is to obtain an initial velocity for the agent. It should be understood that this does not require (though it does permit) an actual calculation to be done; it simply requires that the initial velocity be known prior to completing the subsequent steps. Thus, the initial velocity may be calculated, received from the Virtual World server, or obtained in some other way.
A step 520 of method 500 is to construct an obstacle cone in a velocity space for each foreign agent in the Virtual World application located within a particular distance of the agent. As first described above, each such obstacle cone represents a set of all velocities that will result in a collision between the agent and a particular foreign agent assuming no change in velocity for the particular foreign agent.
A step 530 of method 500 is to identify a plurality of possible new velocities for the agent, each of which lie outside all of the obstacle cones. In one embodiment, step 530 comprises identifying a plurality of obstacle cone boundary segments, identifying a subset of the obstacle cone boundary segments that lie outside of all of the obstacle cones, and for each obstacle cone boundary segment in the subset, computing a minimum distance from an initial point in the velocity space that corresponds to an initial velocity of the agent.
A step 540 of method 500 is to determine a distance from the initial velocity to each one of the possible new velocities in order to find a particular one of the possible new velocities that is closest to the initial velocity. hi one embodiment, finding the particular one of the possible new velocities comprises minimizing (x−x0)2+(y−y0)2 such that Aix+Biy<Ci for each one of the obstacle cones, where (x0, y0) is the initial velocity, (x, y) is the collision-free velocity of the agent, and Aix+Biy<Ci is a linear constraint check.
A step 550 of method 500 is to select the closest one of the plurality of new velocities as the collision-free velocity for the image update frame.
Although the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes may be made without departing from the spirit or scope of the invention. Accordingly, the disclosure of embodiments of the invention is intended to be illustrative of the scope of the invention and is not intended to be limiting. It is intended that the scope of the invention shall be limited only to the extent required by the appended claims. For example, to one of ordinary skill in the art, it will be readily apparent that the crowd simulation calculation methods and related methods discussed herein may be implemented in a variety of embodiments, and that the foregoing discussion of certain of these embodiments does not necessarily represent a complete description of all possible embodiments.
Additionally, benefits, other advantages, and solutions to problems have been described with regard to specific embodiments. The benefits, advantages, solutions to problems, and any element or elements that may cause any benefit, advantage, or solution to occur or become more pronounced, however, are not to be construed as critical, required, or essential features or elements of any or all of the claims.
Moreover, embodiments and limitations disclosed herein are not dedicated to the public under the doctrine of dedication if the embodiments and/or limitations: (1) are not expressly claimed in the claims; and (2) are or are potentially equivalents of express elements and/or limitations in the claims under the doctrine of equivalents.
