1. Field of the Invention
The present invention relates to motion picture, and more specifically, to rendering a 3-D scene geometry to a 2-D image representation for a motion picture.
2. Background
Scenegraphs are structured hierarchies of data that contain all information necessary to render a 3-D scene. For example, a common method of using scenegraphs includes representing coordinate transformations at intermediate locations in a tree, with a renderable geometry at leaf locations of the tree. Computer graphics packages typically use some versions of a scenegraph representation. For example, a computer graphics package may include a static scenegraph representation that an artist directly edits to build up the desired result. A more procedural approach to scenegraph construction can be found in other computer graphics packages where blocks of data (such as point lists) can be manipulated by nodes.
Traditional 3-D software packages require a complete scenegraph description to be loaded into memory to be manipulated or processed. Modifications to the scenegraph are either performed directly on the loaded geometry or on additional copies of the geometry in memory. However, when working with scenes of increasing complexity (e.g. New York City), it may not be practical to load the entire scene into memory given the limitations of the memory. Thus, a common method for reducing the memory usage in an interactive session is to segment the scene into workable pieces, load and manipulate only selected pieces at a time, and cache the modified results to files on a disk. These individual geometry caches are then loaded as needed when rendering the 3-D scene geometry to a 2-D image representation. Further, it is common to employ “instancing” (i.e., sharing the underlying data representation amongst multiple identical objects in a scene) to reduce the time spent by an artist to create geometry descriptions and to reduce the memory needed to render the geometry. This technique is primarily used for objects such as trees, grass, or buildings which can be represented as repeated geometry without appearing unduly repetitive. For example, if a building in a city has hundreds of identical windows, an individual window might be created and set up once, and then “instanced” at every window location on the building, which itself might be instanced multiple times in the city. This single window description is cached on a disk and referenced in higher-level scene descriptions of the building and city. The tradeoff with these methods is that it becomes increasingly difficult to manage these individual scene building blocks. For example, to implement an artistic decision to modify a single window using the traditional methods described above, it is necessary to first create a duplicate geometry cache for the modified window and to then update any references to the window in multiple hierarchical layers of the scene description. It is also potentially wasteful to duplicate the full description of an object when only a single property needs to change, such as its color.
Embodiments of the present invention are used to process a scenegraph describing a 3-D scene for a client.
In one implementation, a method of processing a scenegraph for a client is disclosed. The method including: creating a stack of filters, wherein each filter of the stack of filters is configured to edit or create a property on an object within the scenegraph; presenting a query by the client to the stack of filters for a first property on a first object within the scenegraph to determine whether a filter of the stack of filters edits or creates the first property on the first object; and returning a value for the first property if the filter of the stack of filters edits or creates the first property.
In another implementation, a deferred scenegraph processing system for processing a scenegraph describing a 3-D scene for a client is disclosed. The system including: a scene load filter configured to load a property on an object when the client requests to load the property; a stack of object filters, wherein each object filter of the stack of object filters is configured to edit or create a property on an object within the scenegraph; and a processor configured to receive a query from the client for a first property on a first object within the scenegraph, wherein the query is configured to determine whether a filter of the stack of filters edits or creates the first property on the first object, and wherein a value is returned for the first property if the filter of the stack of filters edits or creates the first property.
In yet another implementation, a computer-readable storage medium storing a computer program for processing a scenegraph for a client is disclosed. The computer program including executable instructions that cause a computer to: create a stack of filters, wherein each filter of the stack of filters is configured to edit or create a property on an object within the scenegraph; present a query by the client to the stack of filters for a first property on a first object within the scenegraph to determine whether a filter of the stack of filters edits or creates the first property on the first object; and return a value for the first property if the filter of the stack of filters edits or creates the first property.
Other features and advantages of the present invention will become more readily apparent to those of ordinary skill in the art after reviewing the following detailed description and accompanying drawings.
As discussed above, traditional 3-D software packages require a complete scenegraph description to be loaded into memory to be manipulated or processed. Modifications to the scenegraph are either performed directly on the loaded geometry or on additional copies of the geometry in memory. However, it may not be practical to load the entire scene into memory. Thus, a common method for reducing the memory usage in an interactive session is to segment the scene into workable pieces, load and manipulate only selected pieces at a time, and cache the modified results to files on a disk. These individual geometry caches are then loaded as needed when rendering the 3-D scene geometry to a 2-D image representation. Further, it is common to employ “instancing” to reduce the time spent by an artist to create geometry descriptions and to reduce the memory needed to render the geometry. For example, if a building in a city has hundreds of identical windows, an individual window might be created and set up once, and then “instanced” at every window location on the building, which itself might be instanced multiple times in the city. This single window description is cached on a disk and referenced in higher-level scene descriptions of the building and city.
A description of a scenegraph using instanced geometry for the changes to this city is shown in
Although the example shown in
To overcome some of the problems described above, certain implementations as disclosed herein provide for methods and systems to implement a particular technique for a computer system to process data for rendering a 3-D scene. One implementation uses a deferred 3-D scenegraph processing model, where results are not computed until the client (e.g., the user/artist or renderer) requests them.
After reading this description it will become apparent how to implement the invention in various alternative implementations and alternative applications. However, although various implementations of the present invention will be described herein, it is understood that these implementations are presented by way of example only, and not limitation. As such, this detailed description of various alternative implementations should not be construed to limit the scope or breadth of the present invention.
In one implementation, a deferred scenegraph processing system is configured to facilitate interactive changes to large 3-D scenes. In this system, basic geometric shape descriptions remain as cached files on disks. However, the user does not directly modify these files. Instead, the user creates a series (or a stack) of filters (referred to as object filters) that modify the results to scene queries, without modifying the original scene. A simple example is an object filter that changes the shape of a single window which can be specified either by name or by using a more powerful pattern matching language. When the scene is queried for shape, the object filter returns the modified shape for only the modified window and passes through the original shape for all other unmodified windows.
In the illustrated implementation of
The above-described implementation based on these filtering principles is made possible by relying on a deferred scenegraph processing model, in which scenegraph objects are only loaded on demand. In an interactive processing session, the artist creates, loads, and modifies only the object filters, not the scenegraph itself. During the process of creating and modifying object filters, it may be necessary for the artist to view the properties of specific scenegraph objects. To do this, the artist simply directs the deferred scenegraph processing system to progressively load and cache in memory the filtered results of the objects of interest. Once the artist is done with specific objects, it is just as simple to instruct the system to unload those objects, releasing the memory used by them. Any object filters created or modified by the artist during this interactive process are stored in memory (and eventually to a disk) as a “lightweight” description of the instructions necessary to build the scenegraph.
As this “lightweight” description of the object filters is all that is necessary to interact with the scene in an interactive processing session, this same filter description is all that is needed to render the 3-D scene to a 2-D image. That is, rather than caching the full scene details to the disk before rendering, this series of object filters runs as a plug-in within a renderer. As it is possible in the interactive processing session to load only the scene geometry needed for the given operation, the renderer requests details of the scene objects based on their spatial bounds, loading only that which is necessary to complete the render. Thus, the scene geometry is kept in the memory only as long as needed.
The processor 820 creates a “light-weight” representation filter stack 830, and performs scenegraph queries which are routed through the filters 830. If a scene property is not changed or created by a downstream filter in the stack 830, the client 840, through the processor 820, queries the next upstream filter until the client query is percolated back to the locked disk representation in the files 860. However, if a filter does need to apply a client edit or creation to a scene property, the filter directly returns the new property to the client 840. The processor 820 can store the created stack of object filters in storage 850.
Memory 1520 stores data temporarily for use by the other components of the computer system 1500. In one implementation, memory 1520 is implemented as RAM. In one implementation, memory 1520 also includes long-term or permanent memory, such as flash memory and/or ROM.
Storage 1530 stores data temporarily or long term for use by other components of the computer system 1500, such as for storing data used by the deferred scenegraph processing system 1590. In one implementation, storage 1530 is a hard disk drive.
The media device 1540 receives removable media and reads and/or writes data to the inserted media. In one implementation, for example, the media device 1540 is an optical disc drive.
The user interface 1550 includes components for accepting user input from the user of the computer system 1500 and presenting information to the user. In one implementation, the user interface 1550 includes a keyboard, a mouse, audio speakers, and a display. The controller 1510 uses input from the user to adjust the operation of the computer system 1500.
The I/O interface 1560 includes one or more I/O ports to connect to corresponding I/O devices, such as external storage or supplemental devices (e.g., a printer or a PDA). In one implementation, the ports of the I/O interface 1560 include ports such as: USB ports, PCMCIA ports, serial ports, and/or parallel ports. In another implementation, the I/O interface 1560 includes a wireless interface for communication with external devices wirelessly.
The network interface 1570 includes a wired and/or wireless network connection, such as an RJ-45 or “Wi-Fi” interface (including, but not limited to 802.11) supporting an Ethernet connection.
The computer system 1500 includes additional hardware and software typical of computer systems (e.g., power, cooling, operating system), though these components are not specifically shown in
Various implementations are or can be implemented primarily in hardware using, for example, components such as application specific integrated circuits (“ASICs”), or field programmable gate arrays (“FPGAs”). Implementations of a hardware state machine capable of performing the functions described herein will also be apparent to those skilled in the relevant art. Various implementations may also be implemented using a combination of both hardware and software.
Furthermore, those of skill in the art will appreciate that the various illustrative logical blocks, modules, connectors, data paths, circuits, and method steps described in connection with the above described figures and the implementations disclosed herein can often be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled persons can implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the invention. In addition, the grouping of functions within a module, block, circuit or step is for ease of description. Specific functions or steps can be moved from one module, block or circuit to another without departing from the invention.
Moreover, the various illustrative logical blocks, modules, connectors, data paths, circuits, and method steps described in connection with the implementations disclosed herein can be implemented or performed with a general purpose processor, a digital signal processor (“DSP”), an ASIC, FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor can be a microprocessor, but in the alternative, the processor can be any processor, controller, microcontroller, or state machine. A processor can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
Additionally, the steps of a method or algorithm described in connection with the implementations disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of computer-readable storage medium including a network storage medium. A storage medium can be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium can be integral to the processor. The processor and the storage medium can also reside in an ASIC.
The above description of the disclosed implementations is provided to enable any person skilled in the art to make or use the invention. Various modifications to these implementations will be readily apparent to those skilled in the art, and the generic principles described herein can be applied to other implementations without departing from the spirit or scope of the invention. Thus, it is to be understood that the description and drawings presented herein represent a presently preferred implementation of the invention and are therefore representative of the subject matter which is broadly contemplated by the present invention. It is further understood that the scope of the present invention fully encompasses other implementations that may become obvious to those skilled in the art and that the scope of the present invention is accordingly limited by nothing other than the appended claims.
This application claims the benefit of priority under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 61/087,939, filed Aug. 11, 2008, entitled “Deferred 3-D Scenegraph Processing Model.” The disclosure of the above-referenced application is incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5430870 | Stanton et al. | Jul 1995 | A |
| 5873081 | Harel | Feb 1999 | A |
| 5896139 | Strauss | Apr 1999 | A |
| 6215495 | Grantham et al. | Apr 2001 | B1 |
| 6243856 | Meyer et al. | Jun 2001 | B1 |
| 6262734 | Ishikawa | Jul 2001 | B1 |
| 6263339 | Hirsch | Jul 2001 | B1 |
| 6263496 | Meyer et al. | Jul 2001 | B1 |
| 6301579 | Becker | Oct 2001 | B1 |
| 6326964 | Snyder et al. | Dec 2001 | B1 |
| 6483508 | Ishikawa | Nov 2002 | B1 |
| 6552721 | Ishikawa | Apr 2003 | B1 |
| 6570564 | Sowizral et al. | May 2003 | B1 |
| 6626954 | Kamachi et al. | Sep 2003 | B1 |
| 6631403 | Deutsch et al. | Oct 2003 | B1 |
| 6751655 | Deutsch et al. | Jun 2004 | B1 |
| 6765571 | Sowizral et al. | Jul 2004 | B2 |
| 6915301 | Hirsch | Jul 2005 | B2 |
| 6919891 | Schneider et al. | Jul 2005 | B2 |
| 6980935 | Lu et al. | Dec 2005 | B2 |
| 7290216 | Kawahara et al. | Oct 2007 | B1 |
| 7432925 | D'Amora | Oct 2008 | B2 |
| 7444595 | Fournie | Oct 2008 | B2 |
| 20020059293 | Hirsch | May 2002 | A1 |
| 20030025692 | Lu et al. | Feb 2003 | A1 |
| 20030025693 | Haley | Feb 2003 | A1 |
| 20030065668 | Sowizral et al. | Apr 2003 | A1 |
| 20030132937 | Schneider et al. | Jul 2003 | A1 |
| 20030172366 | Rhee et al. | Sep 2003 | A1 |
| 20040125114 | Schmidt et al. | Jul 2004 | A1 |
| 20040128070 | Schmidt et al. | Jul 2004 | A1 |
| 20040139080 | Schmidt et al. | Jul 2004 | A1 |
| 20040189667 | Beda et al. | Sep 2004 | A1 |
| 20040189669 | David et al. | Sep 2004 | A1 |
| 20050062678 | Mark et al. | Mar 2005 | A1 |
| 20050179703 | Johnson | Aug 2005 | A1 |
| 20050182844 | Johnson et al. | Aug 2005 | A1 |
| 20050234946 | Woo et al. | Oct 2005 | A1 |
| 20070035543 | David et al. | Feb 2007 | A1 |
| 20070211065 | Feth et al. | Sep 2007 | A1 |
| 20080129819 | Mark et al. | Jun 2008 | A1 |
| 20080136817 | Dederichs et al. | Jun 2008 | A1 |
| 20080278482 | Farmanbar et al. | Nov 2008 | A1 |
| Entry |
|---|
| The render Graph: A data structure to aid in the interactive display of scene graph data, Hofman et al, Jan. 31, 2003. |
| Extending the scene graph with a dataflow visualization system, Kalkusch et al, VRST, Nov. 1-3, 2006. |
| A rendering architecture, Rick LaMont, 2005. |
| Flexible parametrization of scene graphs, Reitmayr et al., Proceeding of the IEEE Virtual Reality 2005 (VR'05). |
| Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays, Ahlberg et al, Human Factors in Computing Systems, 1994. |
| A Generalized Scene Graph, Jürgen Döllner and Klaus Hinrichs, Institut für Informatik, Universität Münster. |
| Number | Date | Country | |
|---|---|---|---|
| 20100042614 A1 | Feb 2010 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61087939 | Aug 2008 | US |