Frame buffer addressing scheme

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] This invention relates generally to the field of computer graphics and, more particularly, to generating frame buffer addresses.

[0003] 2. Description of the Related Art

[0004] A computer system typically relies upon its graphics system for producing visual output on the computer screen or display device. Early graphics systems were only responsible for taking what the processor produced as output and displaying it on the screen. In essence, they acted as simple translators or interfaces. Modem graphics systems, however, incorporate graphics processors with a great deal of processing power. They now act more like coprocessors rather than simple translators. This change is due to the recent increase in both the complexity and amount of data being sent to the display device. For example, modem computer displays have many more pixels, greater color depth, and are able to display more complex images with higher refresh rates than earlier models. Similarly, the images displayed are now more complex and may involve advanced techniques such as anti-aliasing and texture mapping.

[0005] As a result, without considerable processing power in the graphics system, the CPU would spend a great deal of time performing graphics calculations. This could rob the computer system of the processing power needed for performing other tasks associated with program execution and thereby dramatically reduce overall system performance. With a powerful graphics system, however, when the CPU is instructed to draw a box on the screen, the CPU is freed from having to compute the position and color of each pixel. Instead, the CPU may send a request to the video card stating “draw a box at these coordinates.” The graphics system then draws the box, freeing the processor to perform other tasks.

[0006] Generally, a graphics system in a computer (also referred to as a graphics system) is a type of video adapter that contains its own processor to boost performance levels. These processors are specialized for computing graphical transformations, so they tend to achieve better results than the general-purpose CPU used by the computer system. In addition, they free up the computer's CPU to execute other commands while the graphics system is handling graphics computations. The popularity of graphical applications, and especially multimedia applications, has made high performance graphics systems a common feature of computer systems. Most computer manufacturers now bundle a high performance graphics system with their systems.

[0007] Since graphics systems typically perform only a limited set of functions, they may be customized and therefore far more efficient at graphics operations than the computer's general-purpose central processor. While early graphics systems were limited to performing two-dimensional (2D) graphics, their functionality has increased to support three-dimensional (3D) wire-frame graphics, 3D solids, and now includes support for three-dimensional (3D) graphics with textures and special effects such as advanced shading, fogging, alpha-blending, and specular highlighting.

[0008] A modern graphics system may generally operate as follows. First, graphics data is initially read from a computer system's main memory into the graphics system. The graphics data may include geometric primitives such as polygons (e.g., triangles), NURBS (Non-Uniform Rational B-Splines), sub-division surfaces, voxels (volume elements) and other types of data. The various types of data are typically converted into triangles (e.g., three vertices having at least position and color information). Then, transform and lighting calculation units receive and process the triangles. Transform calculations typically include changing a triangle's coordinate axis, while lighting calculations typically determine what effect, if any, lighting has on the color of triangle's vertices. The transformed and lit triangles may then be conveyed to a clip test/back face culling unit that determines which triangles are outside the current parameters for visibility (e.g., triangles that are off screen). These triangles are typically discarded to prevent additional system resources from being spent on non-visible triangles.

[0009] Next, the triangles that pass the clip test and back-face culling may be translated into screen space. The screen space triangles may then be forwarded to the set-up and draw processor for rasterization. Rasterization typically refers to the process of generating actual pixels (or samples) by interpolation from the vertices. The rendering process may include interpolating slopes of edges of the polygon or triangle, and then calculating pixels or samples on these edges based on these interpolated slopes. Pixels or samples may also be calculated in the interior of the polygon or triangle.

[0010] As noted above, in some cases samples are generated by the rasterization process instead of pixels. A pixel typically has a one-to-one correlation with the hardware pixels present in a display device, while samples are typically more numerous than the hardware pixel elements and need not have any direct correlation to the display device. Where pixels are generated, the pixels may be stored into a frame buffer, or possibly provided directly to refresh the display. Where samples are generated, the samples may be stored into a sample buffer or frame buffer. The samples may later be accessed and filtered to generate pixels, which may then be stored into a frame buffer, or the samples may possibly filtered to form pixels that are provided directly to refresh the display without any intervening frame buffer storage of the pixels.

[0011] The pixels are converted into an analog video signal by digital-to-analog converters. If samples are used, the samples may be read out of sample buffer or frame buffer and filtered to generate pixels, which may be stored and later conveyed to digital to analog converters. The video signal from converters is conveyed to a display device such as a computer monitor, LCD display, or projector.

[0012] In many graphics systems, it is desirable to improve the efficiency of accesses to the frame buffer so that rendering accesses and/or display device accesses may be performed more quickly.

SUMMARY OF THE INVENTION

[0013] Various embodiments of systems and methods of generating frame buffer addresses are disclosed. In one embodiment, a graphics system includes a frame buffer that includes one or more memory devices and a frame buffer interface coupled to the frame buffer. Each memory device in the frame buffer includes N banks. Each of the N banks includes multiple pages, and each page is configured to store data corresponding to a portion of a screen region. The frame buffer interface is configured to generate address used to store data corresponding to a frame of data (e.g., the data that specifies a screen to be displayed on a display device) in the frame buffer. The frame includes multiple screen regions. The frame buffer interface is configured to generate addresses corresponding to the data and to provide the addresses to the frame buffer. The addresses are generated such that each of the N banks stores data corresponding to a portion of one out of every N screen regions within a horizontal group of screen regions. Furthermore, the address are generated such that portions of horizontally neighboring screen regions are stored in different banks. For example, if a first screen region and a second screen region are horizontally neighboring screen regions, the addresses may be generated such that data corresponding to a portion of the first screen region is stored in a first one of the N banks and data corresponding to a portion of the second screen region is stored in a second one of the N banks.

[0014] In some embodiments, each screen region included in the frame may include more pixels in a horizontal direction than in a vertical direction. Each screen region included in the frame may be stored in a frame buffer page that is interleaved within the frame buffer. For example, each frame buffer page may include a page from each memory device in the frame buffer.

BRIEF DESCRIPTION OF THE DRAWINGS

[0015] A better understanding of the present invention can be obtained when the following detailed description is considered in conjunction with the following drawings, in which:

[0016]
FIG. 1 is a perspective view of one embodiment of a computer system.

[0017]
FIG. 2 is a simplified block diagram of one embodiment of a computer system.

[0018]
FIG. 3 is a functional block diagram of one embodiment of a graphics system.

[0019]
FIG. 4 is a functional block diagram of one embodiment of the media processor of FIG. 3.

[0020]
FIG. 5 is a functional block diagram of one embodiment of the hardware accelerator of FIG. 3.

[0021]
FIG. 6 is a functional block diagram of one embodiment of the video output processor of FIG. 3.

[0022]
FIG. 7 shows how samples may be organized into bins in one embodiment.

[0023]
FIG. 8 shows a block diagram of a memory device that may be included in one embodiment of a frame buffer.

[0024]
FIG. 9 shows one embodiment of a frame buffer interface that may handle requests to access data in a frame buffer.

[0025]
FIG. 10 is a block diagram of an L2 cache fill request queue that may be included in one embodiment of a frame buffer interface.

[0026] FIGS. 11A-11D illustrate embodiments of frame buffer addressing schemes that may be used to generate addresses to access data in a frame buffer.

[0027]
FIG. 12 shows one embodiment of a method of using a frame buffer addressing scheme to access data in a frame buffer.

[0028] While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present invention as defined by the appended claims. Note, the headings are for organizational purposes only and are not meant to be used to limit or interpret the description or claims. Furthermore, note that the word “may” is used throughout this application in a permissive sense (i.e., having the potential to, being able to), not a mandatory sense (i.e., must).” The term “include”, and derivations thereof, mean “including, but not limited to”. The term “connected” means “directly or indirectly connected”, and the term “coupled” means “directly or indirectly connected”.

DETAILED DESCRIPTION OF EMBODIMENTS

[0029] Computer System—FIG. 1

[0030]
FIG. 1 illustrates one embodiment of a computer system 80 that includes a graphics system. The graphics system may be included in any of various systems such as computer systems, network PCs, Internet appliances, televisions (e.g. HDTV systems and interactive television systems), personal digital assistants (PDAs), virtual reality systems, and other devices that display 2D and/or 3D graphics, among others.

[0031] As shown, the computer system 80 includes a system unit 82 and a video monitor or display device 84 coupled to the system unit 82. The display device 84 may be any of various types of display monitors or devices (e.g., a CRT, LCD, or gas-plasma display). Various input devices may be connected to the computer system, including a keyboard 86 and/or a mouse 88, or other input device (e.g., a trackball, digitizer, tablet, six-degree of freedom input device, head tracker, eye tracker, data glove, or body sensors). Application software may be executed by the computer system 80 to display graphical objects on display device 84.

[0032] Computer System Block Diagram—FIG. 2

[0033]
FIG. 2 is a simplified block diagram illustrating the computer system of FIG. 1. As shown, the computer system 80 includes a central processing unit (CPU) 102 coupled to a high-speed memory bus or system bus 104 also referred to as the host bus 104. A system memory 106 (also referred to herein as main memory) may also be coupled to high-speed bus 104.

[0034] Host processor 102 may include one or more processors of varying types, e.g., microprocessors, multi-processors and CPUs. The system memory 106 may include any combination of different types of memory subsystems such as random access memories (e.g., static random access memories or “SRAMs,” synchronous dynamic random access memories or “SDRAMs,” and Rambus dynamic random access memories or “RDRAMs,” among others), read-only memories, and mass storage devices. The system bus or host bus 104 may include one or more communication or host computer buses (for communication between host processors, CPUs, and memory subsystems) as well as specialized subsystem buses.

[0035] In FIG. 2, a graphics system 112 is coupled to the high-speed memory bus 104. The graphics system 112 may be coupled to the bus 104 by, for example, a crossbar switch or other bus connectivity logic. It is assumed that various other peripheral devices, or other buses, may be connected to the high-speed memory bus 104. It is noted that the graphics system 112 may be coupled to one or more of the buses in computer system 80 and/or may be coupled to various types of buses. In addition, the graphics system 112 may be coupled to a communication port and thereby directly receive graphics data from an external source, e.g., the Internet or a network. As shown in the figure, one or more display devices 84 may be connected to the graphics system 112.

[0036] Host CPU 102 may transfer information to and from the graphics system 112 according to a programmed input/output (I/O) protocol over host bus 104. Alternately, graphics system 112 may access system memory 106 according to a direct memory access (DMA) protocol or through intelligent bus mastering.

[0037] A graphics application program conforming to an application programming interface (API) such as OpenGL® or Java 3D™ may execute on host CPU 102 and generate commands and graphics data that define geometric primitives such as polygons for output on display device 84. Host processor 102 may transfer the graphics data to system memory 106. Thereafter, the host processor 102 may operate to transfer the graphics data to the graphics system 112 over the host bus 104. In another embodiment, the graphics system 112 may read in geometry data arrays over the host bus 104 using DMA access cycles. In yet another embodiment, the graphics system 112 may be coupled to the system memory 106 through a direct port, such as the Advanced Graphics Port (AGP) promulgated by Intel Corporation.

[0038] The graphics system may receive graphics data from any of various sources, including host CPU 102 and/or system memory 106, other memory, or from an external source such as a network (e.g., the Internet), or from a broadcast medium, e.g., television, or from other sources.

[0039] Note while graphics system 112 is depicted as part of computer system 80, graphics system 112 may also be configured as a stand-alone device (e.g., with its own built-in display). Graphics system 112 may also be configured as a single chip device or as part of a system-on-a-chip or a multi-chip module. Additionally, in some embodiments, certain of the processing operations performed by elements of the illustrated graphics system 112 may be implemented in software.

[0040] Graphics System—FIG. 3

[0041]
FIG. 3 is a functional block diagram illustrating one embodiment of graphics system 112. Note that many other embodiments of graphics system 112 are possible and contemplated. Graphics system 112 may include one or more media processors 14, one or more hardware accelerators 18, one or more texture buffers 20, one or more frame buffers 22, and one or more video output processors 24. Graphics system 112 may also include one or more output devices such as digital-to-analog converters (DACs) 26, video encoders 28, flat-panel-display drivers (not shown), and/or video projectors (not shown). Media processor 14 and/or hardware accelerator 18 may include any suitable type of high performance processor (e.g., specialized graphics processors or calculation units, multimedia processors, DSPs, or general purpose processors).

[0042] In some embodiments, one or more of these components may be removed. For example, the texture buffer may not be included in an embodiment that does not provide texture mapping. In other embodiments, all or part of the functionality incorporated in either or both of the media processor or the hardware accelerator may be implemented in software.

[0043] In one set of embodiments, media processor 14 is one integrated circuit and hardware accelerator is another integrated circuit. In other embodiments, media processor 14 and hardware accelerator 18 may be incorporated within the same integrated circuit. In some embodiments, portions of media processor 14 and/or hardware accelerator 18 may be included in separate integrated circuits.

[0044] As shown, graphics system 112 may include an interface to a host bus such as host bus 104 in FIG. 2 to enable graphics system 112 to communicate with a host system such as computer system 80. More particularly, host bus 104 may allow a host processor to send commands to the graphics system 112. In one embodiment, host bus 104 may be a bi-directional bus.

[0045] Media Processor—FIG. 4

[0046]
FIG. 4 shows one embodiment of media processor 14. As shown, media processor 14 may operate as the interface between graphics system 112 and computer system 80 by controlling the transfer of data between computer system 80 and graphics system 112. In some embodiments, media processor 14 may also be configured to perform transformations, lighting, and/or other general-purpose processing operations on graphics data.

[0047] Transformation refers to the spatial manipulation of objects (or portions of objects) and includes translation, scaling (e.g., stretching or shrinking), rotation, reflection, or combinations thereof. More generally, transformation may include linear mappings (e.g., matrix multiplications), nonlinear mappings, and combinations thereof.

[0048] Lighting refers to calculating the illumination of the objects within the displayed image to determine what color values and/or brightness values each individual object will have. Depending upon the shading algorithm being used (e.g., constant, Gourand, or Phong), lighting may be evaluated at a number of different spatial locations.

[0049] As illustrated, media processor 14 may be configured to receive graphics data via host interface 11. A graphics queue 148 may be included in media processor 14 to buffer a stream of data received via the accelerated port of host interface 11. The received graphics data may include one or more graphics primitives. As used herein, the term graphics primitive may include polygons, parametric surfaces, splines, NURBS (non-uniform rational B-splines), sub-divisions surfaces, fractals, volume primitives, voxels (i.e., three-dimensional pixels), and particle systems. In one embodiment, media processor 14 may also include a geometry data preprocessor 150 and one or more microprocessor units (MPUs) 152. MPUs 152 may be configured to perform vertex transformation, lighting calculations and other programmable functions, and to send the results to hardware accelerator 18. MPUs 152 may also have read/write access to texels (i.e., the smallest addressable unit of a texture map) and pixels in the hardware accelerator 18. Geometry data preprocessor 150 may be configured to decompress geometry, to convert and format vertex data, to dispatch vertices and instructions to the MPUs 152, and to send vertex and attribute tags or register data to hardware accelerator 18.

[0050] As shown, media processor 14 may have other possible interfaces, including an interface to one or more memories. For example, as shown, media processor 14 may include direct Rambus interface 156 to a direct Rambus DRAM (DRDRAM) 16. A memory such as DRDRAM 16 may be used for program and/or data storage for MPUs 152. DRDRAM 16 may also be used to store display lists and/or vertex texture maps.

[0051] Media processor 14 may also include interfaces to other functional components of graphics system 112. For example, media processor 14 may have an interface to another specialized processor such as hardware accelerator 18. In the illustrated embodiment, controller 160 includes an accelerated port path that allows media processor 14 to control hardware accelerator 18. Media processor 14 may also include a direct interface such as bus interface unit (BIU) 154. Bus interface unit 154 provides a path to memory 16 and a path to hardware accelerator 18 and video output processor 24 via controller 160.

[0052] Hardware Accelerator—FIG. 5

[0053] One or more hardware accelerators 18 may be configured to receive graphics instructions and data from media processor 14 and to perform a number of functions on the received data according to the received instructions. For example, hardware accelerator 18 may be configured to perform rasterization, 2D and/or 3D texturing, pixel transfers, imaging, fragment processing, clipping, depth cueing, transparency processing, set-up, and/or screen space rendering of various graphics primitives occurring within the graphics data.

[0054] Clipping refers to the elimination of graphics primitives or portions of graphics primitives that lie outside of a 3D view volume in world space. The 3D view volume may represent that portion of world space that is visible to a virtual observer (or virtual camera) situated in world space. For example, the view volume may be a solid truncated pyramid generated by a 2D view window, a viewpoint located in world space, a front clipping plane and a back clipping plane. The viewpoint may represent the world space location of the virtual observer. In most cases, primitives or portions of primitives that lie outside the 3D view volume are not currently visible and may be eliminated from further processing. Primitives or portions of primitives that lie inside the 3D view volume are candidates for projection onto the 2D view window.

[0055] Set-up refers to mapping primitives to a three-dimensional viewport. This involves translating and transforming the objects from their original “world-coordinate” system to the established viewport's coordinates. This creates the correct perspective for three-dimensional objects displayed on the screen.

[0056] Screen-space rendering refers to the calculations performed to generate the data used to form each pixel that will be displayed. For example, hardware accelerator 18 may calculate “samples.” Samples are points that have color information but no real area. Samples allow hardware accelerator 18 to “super-sample,” or calculate more than one sample per pixel. Super-sampling may result in a higher quality image.

[0057] Hardware accelerator 18 may also include several interfaces. For example, in the illustrated embodiment, hardware accelerator 18 has four interfaces. Hardware accelerator 18 has an interface 161 (referred to as the “North Interface”) to communicate with media processor 14. Hardware accelerator 18 may receive commands and/or data from media processor 14 through interface 161. Additionally, hardware accelerator 18 may include an interface 176 to bus 32. Bus 32 may connect hardware accelerator 18 to boot PROM 30 and/or video output processor 24. Boot PROM 30 may be configured to store system initialization data and/or control code for frame buffer 22. Hardware accelerator 18 may also include an interface to a texture buffer 20. For example, hardware accelerator 18 may interface to texture buffer 20 using an eight-way interleaved texel bus that allows hardware accelerator 18 to read from and write to texture buffer 20. Hardware accelerator 18 may also interface to a frame buffer 22. For example, hardware accelerator 18 may be configured to read from and/or write to frame buffer 22 using a four-way interleaved pixel bus.

[0058] The vertex processor 162 may be configured to use the vertex tags received from the media processor 14 to perform ordered assembly of the vertex data from the MPUs 152. Vertices may be saved in and/or retrieved from a mesh buffer 164.

[0059] The render pipeline 166 may be configured to rasterize 2D window system primitives and 3D primitives into fragments. A fragment may contain one or more samples. Each sample may contain a vector of color data and perhaps other data such as alpha and control tags. 2D primitives include objects such as dots, fonts, Bresenham lines and 2D polygons. 3D primitives include objects such as smooth and large dots, smooth and wide DDA (Digital Differential Analyzer) lines and 3D polygons (e.g. 3D triangles).

[0060] For example, the render pipeline 166 may be configured to receive vertices defining a triangle, to identify fragments that intersect the triangle.

[0061] The render pipeline 166 may be configured to handle full-screen size primitives, to calculate plane and edge slopes, and to interpolate data (such as color) down to tile resolution (or fragment resolution) using interpolants or components such as:

[0062] r, g, b (i.e., red, green, and blue vertex color);

[0063] r2, g2, b2 (i.e., red, green, and blue specular color from lit textures);

[0064] alpha (i.e., transparency);

[0065] z (i.e., depth); and

[0066] s, t, r, and w (i.e., texture components).

[0067] In embodiments using supersampling, the sample generator 174 may be configured to generate samples from the fragments output by the render pipeline 166 and to determine which samples are inside the rasterization edge. Sample positions may be defined by user-loadable tables to enable stochastic sample-positioning patterns.

[0068] Hardware accelerator 18 may be configured to write textured fragments from 3D primitives to frame buffer 22. The render pipeline 166 may send pixel tiles defining r, s, t and w to the texture address unit 168. The texture address unit 168 may use the r, s, t and w texture coordinates to compute texel addresses (e.g. addresses for a set of neighboring texels) and to determine interpolation coefficients for the texture filter 170. The texel addresses are used to access texture data (i.e. texels) from texture buffer 20. The texture buffer 20 may be interleaved to obtain as many neighboring texels as possible in each clock. The texture filter 170 may perform bilinear, trilinear or quadlinear interpolation. The texture environment 180 may apply texels to samples produced by the sample generator 174. The texture environment 180 may also be used to perform geometric transformations on images (e.g., bilinear scale, rotate, flip) as well as to perform other image filtering operations on texture buffer image data (e.g., bicubic scale and convolutions).

[0069] In the illustrated embodiment, the pixel transfer MUX 178 controls the input to the pixel transfer unit 182. The pixel transfer unit 182 may selectively unpack pixel data received via north interface 161, select channels from either the frame buffer 22 or the texture buffer 20, or select data received from the texture filter 170 or sample filter 172.

[0070] The pixel transfer unit 182 may be used to perform scale, bias, and/or color matrix operations, color lookup operations, histogram operations, accumulation operations, normalization operations, and/or min/max functions. Depending on the source of (and operations performed on) the processed data, the pixel transfer unit 182 may output the processed data to the texture buffer 20 (via the texture buffer MUX 186), the frame buffer 22 (via the texture environment unit 180 and the fragment processor 184), or to the host (via north interface 161). For example, in one embodiment, when the pixel transfer unit 182 receives pixel data from the host via the pixel transfer MUX 178, the pixel transfer unit 182 may be used to perform a scale and bias or color matrix operation, followed by a color lookup or histogram operation, followed by a min/max function. The pixel transfer unit 182 may also scale and bias and/or lookup texels. The pixel transfer unit 182 may then output data to either the texture buffer 20 or the frame buffer 22.

[0071] Fragment processor 184 may be used to perform standard fragment processing operations such as the OpenGL® fragment processing operations. For example, the fragment processor 184 may be configured to perform the following operations: fog, area pattern, scissor, alpha/color test, ownership test (WID), stencil test, depth test, alpha blends or logic ops (ROP), plane masking, buffer selection, pick hit/occlusion detection, and/or auxiliary clipping in order to accelerate overlapping windows.

[0072] Texture Buffer 20

[0073] In one embodiment, texture buffer 20 may include several SDRAMs. Texture buffer 20 may be configured to store texture maps, image processing buffers, and accumulation buffers for hardware accelerator 18. Texture buffer 20 may have many different capacities (e.g., depending on the type of SDRAM included in texture buffer 20). In some embodiments, each pair of SDRAMs may be independently row and column addressable.

[0074] Frame Buffer 22

[0075] Graphics system 112 may also include a frame buffer 22. In one embodiment, frame buffer 22 may include multiple memory devices such as 3D-RAM memory devices manufactured by Mitsubishi Electric Corporation. Frame buffer 22 may be configured as a display pixel buffer, an offscreen pixel buffer, and/or a super-sample buffer. Furthermore, in one embodiment, certain portions of frame buffer 22 may be used as a display pixel buffer, while other portions may be used as an offscreen pixel buffer and sample buffer.

[0076] Video Output Processor—FIG. 6

[0077] A video output processor 24 may also be included within graphics system 112. Video output processor 24 may buffer and process pixels output from frame buffer 22. For example, video output processor 24 may be configured to read bursts of pixels from frame buffer 22. Video output processor 24 may also be configured to perform double buffer selection (dbsel) if the frame buffer 22 is double-buffered, overlay transparency (using transparency/overlay unit 190), plane group extraction, gamma correction, psuedocolor or color lookup or bypass, and/or cursor generation. For example, in the illustrated embodiment, the output processor 24 includes WID (Window ID) lookup tables (WLUTs) 192 and gamma and color map lookup tables (GLUTs, CLUTs) 194. In one embodiment, frame buffer 22 may include multiple 3DRAM64s 201 that include the transparency overlay 190 and all or some of the WLUTs 192. Video output processor 24 may also be configured to support two video output streams to two displays using the two independent video raster timing generators 196. For example, one raster (e.g., 196A) may drive a 1280×1024 CRT while the other (e.g., 196B) may drive a NTSC or PAL device with encoded television video.

[0078] DAC 26 may operate as the final output stage of graphics system 112. The DAC 26 translates the digital pixel data received from GLUT/CLUTs/Cursor unit 194 into analog video signals that are then sent to a display device. In one embodiment, DAC 26 may be bypassed or omitted completely in order to output digital pixel data in lieu of analog video signals. This may be useful when a display device is based on a digital technology (e.g., an LCD-type display or a digital micro-mirror display).

[0079] DAC 26 may be a red-green-blue digital-to-analog converter configured to provide an analog video output to a display device such as a cathode ray tube (CRT) monitor. In one embodiment, DAC 26 may be configured to provide a high resolution RGB analog video output at dot rates of 240 MHz. Similarly, encoder 28 may be configured to supply an encoded video signal to a display. For example, encoder 28 may provide encoded NTSC or PAL video to an S-Video or composite video television monitor or recording device.

[0080] In other embodiments, the video output processor 24 may output pixel data to other combinations of displays. For example, by outputting pixel data to two DACs 26 (instead of one DAC 26 and one encoder 28), video output processor 24 may drive two CRTs. Alternately, by using two encoders 28, video output processor 24 may supply appropriate video input to two television monitors. Generally, many different combinations of display devices may be supported by supplying the proper output device and/or converter for that display device.

[0081] Sample-to-Pixel Processing Flow—FIG. 7

[0082] In one set of embodiments, hardware accelerator 18 may receive geometric parameters defining primitives such as triangles from media processor 14, and render the primitives in terms of samples. The samples may be stored in a sample storage area (also referred to as the sample buffer) of frame buffer 22. The samples are then read from the sample storage area of frame buffer 22 and filtered by sample filter 22 to generate pixels. The pixels are stored in a pixel storage area of frame buffer 22. The pixel storage area may be double-buffered. Video output processor 24 reads the pixels from the pixel storage area of frame buffer 22 and generates a video stream from the pixels. The video stream may be provided to one or more display devices (e.g., monitors, projectors, head-mounted displays, and so forth) through DAC 26 and/or video encoder 28.

[0083] The samples are computed at positions in a two-dimensional sample space (also referred to as rendering space). The sample space may be partitioned into an array of bins (also referred to herein as fragments). The storage of samples in the sample storage area of frame buffer 22 may be organized according to bins (e.g., bin 300) as illustrated in FIG. 7. Each bin may contain one or more samples. The number of samples per bin may be a programmable parameter.

[0084] Prefetching Frame Buffer Data

[0085]
FIG. 8 shows an exemplary 3D-RAM device 912 that may be used in one embodiment of a frame buffer 22. 3D-RAM 912 includes four independent banks of DRAM 914A-914D (collectively referred to as DRAM 914). 3D-RAM 912 includes two access ports 952 and 954. The first port 952 is used to output display data from the two SAMs (Serial Access Memories) 916A and 916B (collectively, SAMs 916) to the output controller 24, which outputs display data to a display device. The other port 954 is accessed by the hardware accelerator 18 to read and write pixels and/or samples. Pixels and samples may be read from the DRAM banks 914 into the internal buffer 930 (e.g., an SRAM buffer) via bus 950. In order to provide data from one of the DRAM banks 914A onto bus 950, the data being accessed (e.g., a page of data) may be loaded into a sense amplifier 960A (sense amplifiers 960A, 960B, 960C, or 960D are collectively sense amplifiers 960) coupled to the DRAM bank 914A. Each of the DRAM banks 914 may be configured so that they are independently accessible. Each sense amplifier 960 may be loaded independently of each other sense amplifier.

[0086] The internal ALU (arithmetic logic unit) 924 may modify data stored in the buffer 930. While data is being modified, additional data may be written to the buffer 930. Since the 3D-RAM allows data to be modified as it is being read from the buffer (i.e., without having to output the data off-chip), operations such as Z-buffer and pixel blend operations may be more efficiently performed. For example, instead of such operations being performed as “read-modify-writes,” these operations may be more efficiently performed as “mostly writes.”

[0087] When providing bursts of display information to the output controller 24, the odd banks of DRAM output display information to a first SAM buffer 916A and the even banks output display information to a second SAM buffer 916B. Each buffer 916 may be loaded with display information in a single operation. Because of this configuration, display information may be read from the first SAM 916A while display information is being written to the second SAM 916B and vice versa. Multiplexer 928 may select the output from either SAM 916A or SAM 916B. The even (SAM II 916B) and odd (SAM I 916A) SAMs correspond to the even and odd DRAM banks 914.

[0088] In one embodiment, a frame buffer 22 may be implemented using one or more 3D-RAM devices 912. Each 3D-RAM device 912 may be managed by treating the buffer 930 and the sense amplifiers 960 as different levels of frame buffer cache. The sense amplifiers 960 may be managed as an L2 cache. For example, a data request may be defined as hitting in the L2 cache if the requested data is already available at the output of a sense amplifier 960. Similarly, the pixel buffer 930 may be managed as an L1 cache. In one embodiment, the L2 cache may store one or more pages of data (e.g., each sense amplifier 960 may amplify a page of data at a time) and the L1 cache may store one or more blocks of data (e.g., loaded into pixel buffer 930 from one or more sense amplifiers 960 via bus 950). In other embodiments, a frame buffer 22 may include other types of memory devices that are similarly managed as having multiple levels of cache.

[0089] Requests for data in the frame buffer 22 (e.g., from a hardware accelerator 18) may hit or miss in the L1 or L2 cache. If a data request misses in the L1 cache, it may be beneficial to prefetch the requested data into the L1 cache. Similarly, if an access misses in the L2 cache, the requested data may be prefetched into the L2 cache. If an L2 cache miss occurs, the requested data may be prefetched into the L2 cache (and/or subsequently prefetched into the L1 cache). Note that other embodiments may implement multiple levels of cache in a different manner.

[0090]
FIG. 9 shows one embodiment of a frame buffer interface 200. In this embodiment, the frame buffer 22 is implemented with two levels of cache (e.g., an L1 cache that includes one or more blocks of SRAM and an L2 cache that includes one or more sense amplifiers). Note that in some embodiments, multiple memory chips may be included in the frame buffer. The frame buffer interface 200 receives requests for data in the frame buffer (e.g., from an output controller 24 and a hardware accelerator 18), processes the received requests, and provides the requests to the frame buffer.

[0091] The frame buffer interface 200 may include a video address generator 202 that receives requests for display data asserted by an output controller 24 and translates those requests into indications of where the requested data is located in the frame buffer 22. The video address generator 202 may provide translated requests to a video request processor 206 that may in turn provide those requests to a memory request processor 216. The video request processor 206 may determine when display requests should be processed and provide timing indications to the memory request processor 216.

[0092] The frame buffer interface 200 may also include a request preprocessor 208 that may process requests for image data asserted by the hardware accelerator 18. The hardware accelerator's requests may be received by the request preprocessor via the frame buffer address translation unit 204. For a particular pixel or block request, the request preprocessor 208 may detect whether there is a cache hit or miss according to the current status of the L1 cache and L2 cache. If there is a cache miss, the request preprocessor 208 may generate appropriate L2 and/or L1 replacement requests requesting that the data be loaded into the L2 and/or L1 cache. Note that in some embodiments, if a request hits in the L1 cache, an L2 cache fill request may not be generated even if the request misses in the L2 cache. Various replacement algorithms (e.g., LRU (Least Recently Used) replacement, FIFO (First In, First Out) replacement, and random replacement) may be used to select data for replacement within the cache. Cache hit/miss and replacement information may be stored in an L1 tags buffer 282 and an L2 tags buffer 280. Note that in some embodiments, data for display requests may also be prefetched into an L1 and/or L2 cache.

[0093] In order to begin prefetching data, the address (e.g., the page or block) of the requested data may be loaded into an L1 and/or an L2 queue of pending cache fill requests. An additional queue 214 may also store pending requests (including those that are being prefetched). Cache fill requests asserted by the request preprocessor may be sent to the L2 queue 210, the L1 queue 212, and the pixel queue 214. Note that if multiple memory chips are included in frame buffer 22, there may be an independent L1 queue 212, L2 queue 210, and pixel queue 214 for each memory chip. The request preprocessor may also update the L1 Tags buffer 282 and the L2 Tags buffer 280 in response to data being loaded into the L1 and L2 queues in some embodiments.

[0094] The L1 tag buffer 282 may store tags for data stored in the L1 cache. In one embodiment, the L1 tag buffer may store several tag entries that each correspond to a block of data in the L1 cache. Each entry may provide the request preprocessor 208 with information about a block in the L1 cache. The tags in the L1 tag buffer 282 may reflect the current state of each L1 cache block, as well as the pending L1 requests still in the L1 Queue. For example, if a pending request will change the state of the L1 cache, the tags may indicate the state after the pending request has completed. The information in an entry may include the address of the block (e.g., bank, page, column), attributes of the block (state, buffer select (if the frame buffer is double buffered), type of block (e.g., read-modify-write, read-clear-write, color block)), and/or status info (e.g., replacement information and/or a validity bit).

[0095] The L2 tag buffer 280 may store several tags that each provide the request preprocessor 208 information about the data stored in the L2 cache. In one embodiment, each tag may provide information about the data available at the output of a sense amplifier unit. The L2 tags may reflect the current state of data in the L2 cache, as well as information indicating its state after the pending L2 requests still in the L2 queue are satisfied. For example, if a pending request will bring a requested page into the L2 cache, the L2 tags may indicate that the requested page is present in the cache. Similarly, if a pending request will overwrite the requested page, which is currently in the L2 cache (e.g., because that page is the least recently used page and an LRU replacement scheme is being used), the L2 tags may indicate that the requested page misses in the L2 cache (e.g., by indicating that the requested page is invalid). The information stored in each tag may include address information (e.g., page) and/or status information (e.g., a validity indication).

[0096] The L2 queue 210 stores outstanding L2 cache fill requests. In some embodiments, the L2 queue 210 may store requests for each memory bank in a frame buffer memory chip. In one embodiment, there may be one queue entry for each frame buffer memory bank (note that other embodiments may include multiple entries for each frame buffer memory bank). The memory request processor 216 may select requests from the L2 queue 210. The L2 queue 210 may be configured to select the queue entries in any order in one embodiment, with priority given to older requests (e.g., requests that were asserted before other requests in the L2 queue 210). For example, if a first bank is busy (e.g., outputting data to a SAM 916 in response to a display request or outputting data to a sense amplifier 960 in response to another rendering access) by a display and a pending L2 request to that bank is the oldest request, the memory request processor 216 may be configured to select a request targeting another, non-busy memory bank that is accessible independently of the busy memory bank. If two requests target non-busy memory banks, the memory request processor 216 may select the oldest of the two requests. In some embodiments, by implementing the L2 queue in a way that allows non-FIFO (i.e., unordered) selection from the L2 queue 210, prefetching performance may be improved since an inability to process the oldest request at a particular time may not stall other pending L2 requests. Similar request queues may be implemented for additional levels of cache (e.g., an L3 cache) in some embodiments.

[0097] L1 queue 212 is a queue for storing pending L1 cache fill requests. In one embodiment, the L1 queue 212 may be implemented as a FIFO queue that stores one pending request for each L1 cache block. Note that other embodiments may store multiple pending requests for each L1 cache block (or for other granularities of data in the L1 cache, depending on the organization of data in the L1 cache).

[0098] In some embodiments, a frame buffer interface 200 may include a pixel queue 214 that stores pending pixel requests being provided to the frame buffer 22. In one embodiment, the pixel queue 214 may be subdivided into a pixel address queue that stores address and control information for associated pixel requests and a pixel data queue that stores data for associated pixel requests. In many embodiments, the prefetching system used to load data into the L1 and L2 queues may increase the likelihood that data requested by the requests in the pixel queue 214 has been prefetched into the L1 cache by the time each pixel request reaches the front of the queue 214.

[0099] The memory request processor 216 may issue DRAM operations to the frame buffer. The memory request processor 216 may process pending requests from the L1 queue 210, the L2 queue 212, and a video request queue (not shown) that stores requests for display data. The memory request processor may select among the various queues according to a certain priority (e.g., selecting L1 requests before L2 requests, selecting rendering requests (L1 and L2 requests) before video requests unless doing so would starve the display device, etc.). The memory request processor 216 may also handle block cleanser requests and memory refresh requests. It uses information from the Bottom L1 Tags and Bottom L2 Tags.

[0100] In some embodiments where the frame buffer 22 is implemented with an internal ALU 924, a frame buffer interface 200 may include a pixel request processor 218 that issues ALU operations to the frame buffer 22 (e.g., in embodiments where the frame buffer is implemented using 3D-RAM memory devices). The pixel request processor 218 may process pending requests (e.g., in a FIFO manner) from the pixel queue 214. When a read pixel/register request is issued, the corresponding control data (e.g., opcode, interleave enable, and/or tag data) may be sent to the frame buffer 22. The pixel processor may keep track of when valid data will be returned from the frame buffer 22 and notify recipient devices (e.g., a buffer that temporarily stores returned data and/or a device that requested the returned data) accordingly.

[0101]
FIG. 10 shows one embodiment of a L2 queue 210. In this embodiment, the L2 queue 210 includes four buffers 260A, 260B, 260C, and 260D (collectively, buffers 260) that each store requests targeting a specific independently-accessible bank in a frame buffer memory device (e.g., buffer 260A stores requests targeting bank 1, buffer 260B stores requests targeting bank 2, and so on). Note that other embodiments may have different numbers of buffers. In alternative embodiments, each buffer 260 may correspond to a group of several memory banks, where memory banks within each group are not independently accessible but memory banks in different groups are independently accessible. In some embodiments, each buffer 260 may be implemented as a FIFO queue. In one embodiment, each buffer 260 may be implemented as a single-entry buffer configured to store a single pending request.

[0102] The oldest request in each buffer 260 may be output to the memory request processor 216. The memory request processor 216 may include a selection unit 262 configured to select the oldest L2 cache fill request from one of the buffers 260. However, if the oldest L2 cache fill request targets a bank that is currently busy (e.g., because it is being accessed as part of a prior access request), as indicated by the bank status signals 264, the selection unit 262 may be configured to select the next-oldest request that targets a different bank that is currently non-busy. The selection unit 262 may select the oldest request to a non-busy bank, if any, and output that request to the frame buffer 22. When the selection unit 262 outputs a request to the frame buffer 22, the entry corresponding to that request may be deallocated from the L2 queue 210, freeing room for a new request from request preprocessor 208.

[0103] Frame Buffer Addressing

[0104]
FIGS. 11A and 11D show various embodiments of frame buffer address schemes that may be used to access (e.g., read or write) data in a frame buffer. As shown in FIGS. 11A and 11D, the data corresponding to a 1280 pixel×1024 pixel frame may be subdivided into frame buffer pages in one embodiment. Note that other sizes and types of frames may be similarly subdivided into frame buffer pages in other embodiments. The data stored in a frame buffer page is referred to herein as a screen region. FIG. 11B shows how each frame buffer page may be 80 pixels wide and 16 pixels high. In many embodiments, each frame buffer page may be interleaved across several memory devices. For example, if a frame buffer includes eight memory chips, each frame buffer page may include a page from each memory chip, as shown in FIG. 11C (and thus each page within a memory chip may store a portion of a screen region in interleaved embodiments). Within each memory chip, pages may be 20 pixels wide and 8 pixels high in one embodiment. A frame buffer interface (e.g., video address generator 202 and/or frame buffer address translation unit 204) may translate requests for data (e.g., pixels or samples) into addresses within the frame buffer 22 using an embodiment of an addressing scheme like those shown in FIGS. 11A and 11D.

[0105] In graphics systems, data tends to be accessed in a somewhat predictable order depending on the type of access (e.g., read access initiated to output data to a display device or read/write accesses that occur as data is being rendered or drawn into the frame buffer). For example, rendering accesses (e.g., performed by a process rendering a triangle or other shape) tend to access neighboring pixels or samples. For example, a rendering process may move diagonally across screen regions if the shape being rendered crosses several screen regions. Generally, during rendering accesses, neighboring pixels or samples tend to be accessed in succession. Display accesses tend to access data in scanline order, so if a first pixel in a scanline is output to a display device, it is likely that other pixels in that scanline will also be output to the display device.

[0106] Page switching often has a negative impact on performance. The worst performance may occur when switching between pages in the same bank. Accordingly, addresses for neighboring screen regions may be calculated so that the neighboring screen regions are not stored in the same bank. An addressing scheme like the ones shown in FIG. 11A and FIG. 11D may be used to determine how addresses should be generated.

[0107] In the embodiments of FIGS. 11A and 11D, the frame buffer includes multiple memory devices (e.g., 3D-RAM memory devices). In these exemplary embodiments, each memory device includes four memory banks A-D (e.g., banks 914A-914D in FIG. 8) that are each configured to store at least 256 pages (pages 0-255). Note that other embodiments may be configured differently.

[0108] In one embodiment, each frame buffer page may be interleaved to include a page of data from the same bank in each memory device. For example, frame buffer page A0 may include page 0 from bank A of each memory device. In alternative embodiments, a frame buffer page may include data from one bank (e.g., bank A) of some memory devices and another bank (e.g., bank C) of the other memory devices. In such embodiments, a bank in one group of memory devices may be linked to a bank in another group of memory devices. For example, bank A in memory devices 0-3 may be linked to bank C in memory devices 4-7 so that if a frame buffer page includes a page from bank A in each memory device 0-3, that frame buffer page will also include a page from bank C in memory devices 4-7. Interleaving frame buffer pages may improve access performance by allowing neighboring pixels to be read out in parallel. Note that not all embodiments may include interleaved frame buffer pages.

[0109]
FIG. 11A shows one embodiment of an addressing scheme used to access data stored in a frame buffer. In the embodiment of FIG. 11A, neighboring screen regions are stored in different banks within each memory device. In each horizontal group of screen regions (e.g., the group containing pages A0-D3), one out of every four screen regions is stored in the same bank. In embodiments with N banks in each memory device, one out of every N screen regions may be stored in the same bank. Successive horizontal groups of screen regions (e.g., horizontal groups that vertically neighbor each other) alternate between being stored in banks A and C and banks B and D. This may improve vertical accesses. For example, if a vertical rendering process accesses the screen regions stored in page 9 of bank A after accessing the screen region stored in page 5 in bank B, the page switching may be less than if the same addressing scheme was used for each horizontal group of screen regions.

[0110] Looking at frame buffer page B29, the arrows show how many frame buffer pages may be crossed before accessing another page in bank B. For vertical accesses, there is one intervening screen region (e.g., the screen region stored in frame buffer page A25) between screen regions stored in the same memory bank (e.g., frame buffer pages B21 and B29). Thus, two frame buffer pages may be crossed vertically before accessing a frame buffer page stored in the same bank. For horizontal accesses, four frame buffer pages may be crossed before accessing another frame buffer page stored in the same bank. Diagonally (e.g., moving at a 45 degree angle across the frame), four frame buffer pages may be crossed before accessing another frame buffer page stored in the same bank.

[0111]
FIG. 11D shows another embodiment of an addressing scheme used to access data in a frame buffer. This embodiment is similar to the one shown in FIG. 11A. However, the addresses scheme used to generate addresses for the screen regions in vertically neighboring horizontal regions alternates every four horizontal regions (as opposed to every two horizontal regions as shown in FIG. 11A). In this embodiment, four frame buffer pages may be crossed before accessing screen regions stored in the same bank. However, accesses in one of the diagonal directions (for frame buffer page D29, accesses moving toward the lower left-hand corner of the frame) may have reduced performance because of successive accesses to the same bank (e.g., D29 and D32 are both stored in the same bank).

[0112] As noted above, a frame buffer may include multiple memory devices (e.g., 3D-RAMs) that include SAMs to output display data to a display device. Since several banks may be configured to output data to the same SAM, performance for display accesses may be improved if successive horizontal screen regions access banks that output data to different SAMs. For example, if banks A and B output data to a first SAM and banks C and D output data to a second SAM, better performance may arise when sequential requests for display data alternate between the two SAMs so that one SAM can be refilled with data while the other is outputting data. Thus, it may be desirable to have sequential display accesses to banks that output data to different SAMs in order to avoid sequentially accessing banks that output data to the same SAM. Thus, in this embodiment, successive screen regions are stored in banks that output data to different SAMs. As a result, data (e.g., from page 0 of bank C) may be loaded into one SAM while data is read out (e.g., from page 0 of bank A) of the other SAM. When the first SAM finishes outputting data, it may be reloaded (e.g., with data from page 0 of bank B) while the other SAM outputs its data.

[0113] The impact of page switching may also be reduced by switching pages while reading from other banks that already have their pages ready. As described above, a frame buffer page may be prefetched (e.g., into an L2 cache implemented in one or more sense amplifiers as described above) from a bank that is not currently being accessed while data is read from or written into a page stored in another bank. If the frame buffer includes several levels of cache (e.g., sense amplifiers implemented as L2 cache and an SRAM device implemented as an L1 cache), there may be several levels of prefetching. However, even if a frame buffer page is not prefetched, the page switch penalty may be reduced by having successive accesses to pages stored in different banks (as opposed to pages stored in the same bank).

[0114] In embodiments that include one or more levels of cache within the frame buffer, it may be desirable to decrease block switching by storing groups of neighboring pixels or samples in the same block within a page. For example, blocks may be loaded into an L1 cache (e.g., buffer 913 in FIG. 8) from an L2 cache that stores pages of data (e.g., sense amplifiers 960 in FIG. 8). If a block in the L1 cache stores neighboring pixels or samples, it may be less likely that pixels or samples in another block will be accessed. Accordingly, it may be less likely that another block will need to be fetched into the L1 cache.

[0115] In the embodiments shown above, frame buffer pages (and pages in each memory device) are organized so that they include more pixels in a horizontal direction than in a vertical direction (i.e., pages are wider than they are tall). This may improve performance when display data is output (e.g., if display data is output in scanlines). Other embodiments may organize pages in other manners (e.g., with square pages or pages that are taller than they are wide).

[0116] In some embodiments, a frame buffer addressing scheme may be used to generate addresses for rendering accesses dependent on what mode of sampling or super-sampling is being used. As described above, some graphics systems store multiple samples per pixel. For example, in a non-sampling mode, or in a mode where there is one sample per pixel, blocks within an individual memory device may each hold 4×4 pixels (four pixels wide and four pixels deep). If there are eight memory devices and blocks are arranged in a 2×4 arrangement (two blocks wide and four blocks deep), frame buffer block size may be 8×16 pixels. If each frame buffer page holds five blocks (e.g., in a 5×2 arrangement), each frame buffer page may store 40×32 pixels.

[0117] As the number of samples per pixel increase, the amount of storage space taken up by each pixel may correspondingly increase. Thus, as the number of samples per pixel increases, the effective size of each block (in terms of the number of pixels stored within) may decrease. Consequentially, the effective size of each frame buffer block and frame buffer page may decrease. From the perspective of a rendering device (e.g., hardware accelerator 18), the number of frame buffer pages used to describe a given frame may correspondingly increase as the effective sizes decrease.

[0118]
FIG. 13 shows the effective frame buffer block size that may be used for different sampling modes. In order to simplify address generation, the frame buffer block size for each mode may be selected to fit within a certain “footprint.” For example, in FIG. 13, frame buffer block sizes are selected to fit within an 8×16 footprint. No frame buffer block sizes occur in any sampling mode that do not fit within this footprint. Thus, there are no frame buffer block sizes of, for example, 16×8. Additionally, the frame buffer block size in each mode may be selected to have the same orientation A×B, where A<B (or where AB). The address generation scheme may generate addresses dependent on the current sampling mode and the effective block size that occurs in each mode. In each mode, the footprint of each frame buffer block may be the same size as or smaller than the maximum footprint (e.g., 8×16 in the above example).

[0119]
FIG. 12 shows one embodiment of a method of generating addresses for data stored in a frame buffer. Each memory device included in the frame buffer has N banks in each memory device (e.g., there may be four banks in each 3D-RAM device). In this embodiment, a request (e.g., a read and/or write) for data stored in the frame buffer is received at 901. At 903, an address is generated for the requested data (e.g., by an address translator or a video address generator). The address is generated so that neighboring screen regions (e.g., the portion of a frame stored in a frame buffer page) in the same horizontal region of the frame are stored in different banks within the frame buffer. Each bank stores one out of every N screen regions. The address generated at 903 is then provided to the frame buffer so that the requested data access can be performed, as indicated at 905.

[0120] Although the embodiments above have been described in considerable detail, other versions are possible. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications. Note the section headings used herein are for organizational purposes only and are not meant to limit the description provided herein or the claims attached hereto.

Frame buffer addressing scheme

Information

Publication Number

Date Filed

Date Published

Inventors

CPC

US Classifications

International Classifications

Abstract

Description

Claims