SYSTEMS AND METHODS FOR ELLIPTICAL FILTERING

Abstract

An improved attribute determination process allows the sharpness of a surface attribute function to be adjusted on a per-object, per-surface, per-texture, per-function, or other appropriate basis. A computer-based animator then can selectively adjust the sharpness or other attribute(s) of portions of a to-be-rendered image without significantly increasing the rendering time. For a selected texture, corresponding sampling regions will be shifted about the respective surface points projected in texture space. A multi-dimensional set of sub-regions can be generated for the shifted sampling region. Bounding boxes can be determined for each sub-region, the boxes occupying less area, such as in texture space, than a single bounding box for the original sampling region. The bounding boxes can be used for local attribute determinations (such as texture lookups) for each sub-region, with the local attributes being processed to determine an attribute for the respective surface point.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments in accordance with the present invention will be described with reference to the drawings, in which:

FIG. 1( a) illustrates an example image plane;

FIG. 1( b) illustrates a side view of an image plane and a circular filter kernel;

FIG. 1( c) illustrates an overhead view of a surface;

FIG. 2 illustrates steps of a process that can be used in accordance with one embodiment of the present invention;

FIG. 3 illustrates a shifted micropolygon sampling region for a surface point in accordance with one embodiment of the present invention;

FIG. 4 illustrates sub-regions based on sub-division of the vectors in accordance with one embodiment of the present invention;

FIG. 5 illustrates a bounding box for one of sub-regions in accordance with one embodiment of the present invention;

FIG. 6 illustrates a plurality of bounding boxes for sub-regions of an original micropolygon sampling region in accordance with one embodiment of the present invention; and

FIG. 7 illustrates a processing system that can be used with various embodiments of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Systems and methods in accordance with various embodiments of the present invention can overcome the aforementioned and other deficiencies in existing animation and rendering systems by changing the way in which attributes are determined for surface points, objects, and various other elements. In one embodiment, the way in which the color or other visual attribute of a surface point or micropolygon is determined is improved by allowing an animator to increase the number of samples of the surface attribute functions that are evaluated (e.g., texture lookups) without affecting the number of samples for other objects, surfaces, or textures in that frame. Such an approach can be independently applied to any texture, surface, object, or other basis, and can provide a much faster approach than the brute force approach of oversampling the entire shader or even an entire scene.

As discussed above, a surface to be rendered in one embodiment can be broken down into micropolygons. For each micropolygon, a surface attribute function can be evaluated to determine the appropriate color to assign to that micropolygon, typically assigned as a surface point corresponding to a vertex for the micropolygon. Oftentimes, this evaluation will include at least one texture map. The use of texture maps, or “texture mapping,” is a common technique used for simulating detail on the surface of an object model by mapping images or “textures” onto the various micropolygons of that object. An object or surface can have multiple overlapping textures mapped thereon, with each micropolygon having associated therewith at least one texture. A texture map can be thought of as an image that resides in its own texture coordinate space, typically designated as (u, v) space as known in the art.

FIGS. 1( a)-(c) illustrate the sampling of a surface and its surface attribute function by a renderer. FIG. 1(a) illustrates an example image plane 100. Image plane 100 includes a set of pixels such as pixels 102A, 102B, and 102C. Each pixel represents the value of a sample of a three dimensional scene. The value of a pixel can be determined by projecting one or more samples of the scene, such as micropolygons from one or more surfaces, on to the image plane 100 and then combining the values of the projected samples for each corresponding pixel. Each pixel can include a filter kernel, such as filter kernel 104, that specifies the weights used to combine samples as a function of distance from the center of the pixel.

As discussed above, the filter kernel of a pixel can be projected back on to a surface in the scene to determine the ideal sample region. FIG. 1(b) illustrates a side view of the image plane 100 and circular filter kernel 104. In FIG. 1(b), the filter kernel 104 has been projected back on to the surface 106. In this example, surface 106 is at an angle to the image plane 100. Sample region 108 is defined by the projection of filter kernel 104.

In this example, sample region 108 is in the shape of an ellipse, even though the filter kernel 104 is circular. This is illustrated more clearly in FIG. 1(c). In FIG. 1(c) shows an overhead view of the surface 106. As can be seen in this view, the sample region 108 is an ellipse.

A surface attribute function 100, such as a texture map, provides surface attribute values for surface 106. To determine the value of the pixel associated with the filter kernel 104, the surface attribute function 110 should be sampled only within the sample region 108. However, due the difficulties with elliptical filtering, some renderers approximate sample region 108 with an isotropic sample region 112. Isotropic sample region 112 includes additional portions 114A and 114B of the surface attribute function 110, which are outside of the ellipse of sample region 108 but inside the circle of isotropic sample region 112. Because these additional portions 114A and 114B are not within the sample region 108, their contribution to the value of a pixel causes blurring artifacts.

A system in accordance one embodiment provides a better approximation of anisotropic sample regions, such as ellipses, by increasing the number of samples and decreasing the size of sample regions for the objects, surfaces, textures, and/or any other portion of the scene that requires an increase in sharpness or visual accuracy.

FIG. 2 illustrates steps of an exemplary process 200 that can be used in accordance with one embodiment of the present invention. In step 202 a selection is received from a user specifying an object, surface, texture, or other surface attribute function where improved sharpness or attribute accuracy is desired. In an embodiment, an animator or renderer sets a sharpness attribute of the object, surface, texture, or other surface attribute function with a shading or rendering tool to indicate that the process 200 is to be applied to this entity.

For each surface point corresponding to that object, surface, or texture, a sampling region is determined. This sampling region typically is defined in texture space, although other sampling approaches can be used as known to one of ordinary skill in the art. Since derivative vectors dP/du and dP/dv are known for each point P(u,v) in texture space, the sampling region can correspond to a micropolygon defined by those vectors, wherein the surface point corresponds to a vertex of the sampling region.

Since only one surface point is being sampled per lookup, the sampling region is shifted in step 204 so that the surface point P is in the center of a new sampling region, such as a new micropolygon having new (shifted) derivative vectors. As shown in FIG. 3, the projection of the original micropolygon 302 has the surface point 304 at the vertex of the derivatives defining that micropolygon. By “shifting” the position of the micropolygon sampling region used for the lookup (such as by moving back one half the sum of the two vectors), a new lookup micropolygon sampling region 306 can be generated that has the surface point 304 at its center. Shifting the sampling region to be centered about the surface point can improve the accuracy of the sampling for that surface point, as the sampling will be more representative of the surroundings of the surface point.

A multi-dimensional (e.g., two-dimensional or three-dimensional) set of sub-sampling regions, or “sub-regions,” then can be formed in the original (or shifted) sampling region in step 206. In an example using “shifted” derivative vectors associated with the new sampling region, the new sampling region is segmented into a multi-dimensional set of sub-regions, such as by segmenting the shifted vectors then using the segments to form smaller sub-regions only for the sampling region of interest. The plot 400 of FIG. 4 shows the shifted sampling region 306 centered about the surface point 304, with reference numbers carried over for simplicity of understanding only. The shifted vectors 402, 404 can be segmented, then used to form smaller sub-regions only for the sampling region 306 of interest. For example, the shifted vectors 402, 404 in FIG. 4 are segmented into thirds, forming a 3×3 array of sub-regions inside the micropolygon sampling region 306 and centered around the surface point 304. This is similar to dropping the shading rate, but only for the texture of interest. It also should be noted that micropolygons typically are only approximated in texture space using the pair of vectors, so that each sub-region may only be approximated based on the segmented vectors. Further, other shapes, sizes, and sets of sub-regions can be used as would be apparent to one of ordinary skill in the art in light of the description and suggestions contained herein. In some embodiments, different sub-regions can have different shapes and/or different sizes, such as to better approximate the desired sampling region.

A lookup box, or bounding box, can be determined for each sub-region in step 208, such as by generating a lookup box for a texture lookup corresponding to a vertex point of each respective sub-region. In other embodiments, other approximations or regions can be used for a texture lookup or other type of evaluation of a surface attribute function as would be understood to one of ordinary skill in the art. As illustrated in the plot 500 of FIG. 5, this can involve using a new, smaller bounding box 502 for each sub-region 504 examined. The size of this bounding box 504 can be defined by the MIP level (or can correspond directly to the size of the sub-region), but a different MIP level can be used than for an original bounding box that would have been used for the initial micropolygon.

A local attribute then is determined for each sub-region, such as may be based on a texture lookup for that sub-region, in step 210. The determination can be based on a pre-computed array of values for that sub-region as discussed above. The look-ups can correspond to vertices of the sub-regions, where appropriate, or can correspond to any other appropriate point or points of the sub-regions. The plot 600 of FIG. 6 shows an area covered by bounding boxes for each sub-region, which ultimately can be combined to determine the attribute(s) of the surface point. As can be seen in this example, the area in texture space used to define the surface point more closely matches the shape of the micropolygon projection, being somewhat elliptical in shape. Further, imposing a bounding box 600 the size of the original bounding box on the plot (for explanation) purposes shows the drastic reduction in data outside the micropolygon sampling region that is averaged, blurred, or otherwise processed to determine, for example, the appropriate color to assign to the surface point. Further still, the area to be processed is approximately centered about the surface point and analyzed at a higher data level, thereby providing a much more accurate value that is likely to significantly improve the clarify and sharpness of the texture after rendering. The small number of additional lookups for the selected texture(s) in many cases will be almost negligible.

The local attributes for each sub-region then are analyzed in step 212 to determine an attribute for the surface point corresponding to the original micropolygon sampling region. As discussed above, this can include averaging, weighted averaging, or any other appropriate approach for combining or otherwise processing the attributes. In one approach, these values are weighted based on a position in the overall micropolygon sampling region or an amount of area inside the sampling region. For example, a sub-region at the center of the sampling region might be weighted more in the average than a sub-region along the outside. Further, if the look-ups still occur for vertices on the edges of the sub-regions, a vertex that is on the edge of the sampling region might be weighted less than a vertex in the interior of the sampling region, even though both sub-regions might be on the edge of the sampling region.

The additional lookups can happen inside a surface shader at the shader level. In some shaders there is an oversampling control that can be used for all texture calls, where if the sampling control is set to 1 the shader goes through all the texture calls once. If the control is set to 2, the shader goes through in a 2×2 fashion. The additional lookups could be set up in a similar fashion.

Such an approach also is not limited to a texture subsystem, but can be done for any procedural texturer, shader, or other similar device. At any point in the process where there are approximations for blurriness, or where image accuracy can be improved, such an approach can be used.

FIG. 7 illustrates an example computer system 700 suitable for implementing an embodiment of the invention. Computer system 700 typically includes a monitor 702, computer 704, a keyboard 706, a user input device 708, and a network interface 710. User input device 708 includes a computer mouse, a trackball, a track pad, graphics tablet, touch screen, and/or other wired or wireless input devices that allow a user to create or select graphics, objects, icons, and/or text appearing on the monitor 702. Embodiments of network interface 710 typically provides wired or wireless communication with an electronic communications network, such as a local area network, a wide area network, for example the Internet, and/or virtual networks, for example a virtual private network (VPN).

Computer 704 typically includes components such as one or more processors 712, and memory storage devices, such as a random access memory (RAM) 714, disk drives 716, and system bus 718 interconnecting the above components. Processors 712 can include one or more general purpose processors and optional special purpose processors for processing video data, audio data, or other types of data. RAM 714 and disk drive 716 are examples of tangible computer-readable media for storage of data, audio/video files, computer programs, applet interpreters or compilers, virtual machines, and embodiments of the herein described invention. Other types of tangible computer-readable media include floppy disks; removable hard disks; optical storage media such as DVD-ROM, CD-ROM, MINIDISC, optical discs, and bar codes; non-volatile memory devices such as flash memories; read-only-memories (ROMS); battery-backed volatile memories; networked storage devices. Computer-readable media also can include a data signal embodied in a carrier wave.

Further embodiments can be envisioned to one of ordinary skill in the art in light of the teachings an suggestions contained herein. Other embodiments, including combinations or sub-combinations of the above disclosed embodiments can be advantageously made as would be understood to one of ordinary skill in the art. The block diagrams of the architecture and flow charts are examples used for ease of understanding. However it should be understood that combinations, additions, re-arrangement, and the like are contemplated in alternative embodiments.

The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. It will, however, be evident that various modifications and changes may be made thereunto without departing from the broader spirit and scope of the invention as set forth in the claims.

Claims

1. A method of performing an attribute determination for a surface point, comprising: receiving a surface point having an attribute to be determined, the surface point having a location and a sampling region associated therewith;determining a multi-dimensional set of sub-regions in the sampling region, the sizes of the sub-regions being determined by at least one of a size and a shape of the sampling region;determining a local attribute for each sub-region based on a pre-computed array of values for that sub-region; andprocessing the local attributes for each sub-region to determine an attribute for the surface point.

2. A method according to claim 1, wherein: the sampling region is a micropolygon sampling region approximating a micropolygon associated with the surface point.

3. A method according to claim 1, wherein: the surface point further has a set of derivative vectors, whereby the location and the derivative vectors define the sample region.

4. A method according to claim 3, wherein: the step of determining a multi-dimensional set of sub-regions includes subdividing the derivative vectors and determining the sub-regions based on the subdivided derivative vectors.

5. A method according to claim 3, wherein: the location and derivative vectors are defined in texture space.

6. A method according to claim 1, wherein: all of the sub-regions for the surface point are symmetric.

7. A method according to claim 1, wherein: all of the sub-regions for the surface point are substantially the same size.

8. A method according to claim 1, further comprising: creating a set of bounding boxes corresponding to the multi-dimensional set of sub-regions, the set of bounding boxes occupying less area than a single bounding box corresponding to the sampling region.

9. A method according to claim 8, wherein: the step of determining a local attribute for each sub-region is based on a respective bounding box from the set of bounding boxes.

10. A method according to claim 1, further comprising: shifting the sampling region about the surface point before determining the local attribute for each sub-region.

11. A method according to claim 1, further comprising: shifting the sampling region about the surface point before creating the multi-dimensional set of sub-regions.

12. A method according to claim 1, wherein: the sampling region and the multi-dimensional set of sub-regions correspond to different MIP levels.

13. A method according to claim 1, wherein: processing the local attributes includes averaging the values of each local attribute.

14. A method according to claim 1, wherein: processing the local attributes includes doing a weighted average of the values of each local attribute.

15. A method according to claim 1, further comprising: receiving a sharpness value for the surface point, the sharpness value determining the number of sub-regions in the multi-dimensional set of sub-regions.

16. A method of performing an attribute determination for a surface point, comprising: receiving a surface point having an attribute to be determined, the surface point having a location in texture space and a sampling region associated therewith;determining a multi-dimensional set of sub-regions in the sampling region;performing a texture lookup for each sub-region; andprocessing the texture lookups to determine an attribute for the surface point.

17. A method according to claim 16, further comprising: creating a set of bounding boxes corresponding to the multi-dimensional set of sub-regions, the set of bounding boxes occupying less area than a single bounding box corresponding to the sampling region in texture space.

18. A method according to claim 17, wherein: performing a texture lookup for each sub-region includes using a respective bounding box from the set of bounding boxes.

19. A method according to claim 16, further comprising: shifting the sampling region about the surface point before determining a multi-dimensional set of sub-regions in the sampling region.

20. A method according to claim 16, wherein: the sampling region and sub-regions are micropolygons.

21. A method according to claim 16, wherein: the sampling region and the sub-regions correspond to different MIP levels.

22. A method according to claim 16, further comprising: receiving a sharpness value for the surface point, the sharpness value determining the number of sub-regions in the multi-dimensional set of sub-regions.

23. A computer program product embedded in a computer readable medium, comprising: computer program code for receiving a surface point having an attribute to be determined, the surface point having a location and a sampling region associated therewith;computer program code for determining a multi-dimensional set of sub-regions in the sampling region, the sizes of the sub-regions being determined by at least one of a size and a shape of the sampling region;computer program code for determining a local attribute for each sub-region based on a pre-computed array of values for that sub-region; andcomputer program code for processing the local attributes for each sub-region to determine an attribute for the surface point.

24. A computer program product according to claim 23, further comprising: computer program code for creating a set of bounding boxes corresponding to the multi-dimensional set of sub-regions, the set of bounding boxes occupying less area than a single bounding box corresponding to the sampling region.

25. A computer program product according to claim 24, further comprising: computer program code for determining a local attribute for each sub-region using a respective bounding box from the set of bounding boxes.

26. A computer program product according to claim 23, further comprising: computer program code for shifting the sampling region about the surface point before determining the multi-dimensional set of sub-regions in the sampling region.

27. A computer program product embedded in a computer readable medium, comprising: computer program code for receiving a surface point having an attribute to be determined, the surface point having a location in texture space and a sampling region associated therewith;determining a multi-dimensional set of sub-regions in the sampling region;performing a texture lookup for each sub-region; andprocessing the texture lookups to determine an attribute for the surface point.