1. Field of the Invention
The present invention relates in general to microprocessor systems and, more particularly, to a system, method, and mechanism providing cache coherency in microprocessor systems with cache support.
2. Relevant Background
Microprocessors manipulate data according to instructions specified by a computer program. The instructions and data in a conventional system are stored in main memory which is coupled to the processor by a memory bus. The ability of processors to execute instructions has typically outpaced the ability of memory subsystems to supply instructions and data to the processors. As used herein the terms “microprocessor” and “processor” include complete instruction set computers (CISC), reduced instruction set computers (RISC) and hybrids.
Most processors use a cache memory system to speed memory access. Cache memory comprises one or more levels of dedicated high-speed memory holding recently accessed data and instructions, designed to speed up subsequent access to the same data and instructions. Cache technology is based on a premise that programs frequently re-execute the same instructions and data. Also, instructions and data exhibit a trait called “spatial locality” which means that instructions and data to be used in the future tend to be located in the same general region of memory as recently used instructions and data. When data is read from main system memory, a copy is also saved in the cache memory, along with an index to the associated location in main memory. Often the cache entry includes not only the data specifically requested, but data surrounding the specifically requested data.
The cache then monitors subsequent requests for data to see if the information needed has already been stored in the cache. If the data had indeed been stored in the cache, the data is delivered immediately to the processor while the attempt to fetch the information from main memory is aborted (or not started). If, on the other hand, the data had not been previously stored in cache then it is fetched directly from main memory and also saved in cache for future access.
Microprocessor performance is greatly enhanced by the use of cache memory. Cache memory comprises memory devices that have lower latency than the main memory. In particular, one or more levels of on-chip cache memory provide particularly low-latency storage. On-chip cache memory can be implemented in memory structures and devices having latency of only one or two clock cycles. Cache memory, particularly on-chip cache memory, is particularly suited to being accessed by the microprocessor at high speed.
A task for the cache subsystem is to maintain cache coherency. Cache coherency refers to the task of ensuring that the contents of cache memory are consistent with the corresponding locations in main memory. When only the microprocessor can access main memory cache coherency is a relatively simple task. However, this restriction forces all accesses to main memory to be routed through the microprocessor. Many devices such as graphics modules, mulitimedia modules and network interface modules, for example, can make use of system memory for efficient operation. However, if these modules must tie up the processor in order to use system memory, overall performance is lowered.
To make more efficient use of the processor, many systems allow modules and peripherals other than the microprocessor to access main memory directly. The system bus in a typical computer system architecture couples to the microprocessor and to a direct memory access (DMA) controller. Other modules and peripherals coupled to the bus can access main memory without tying up the microprocessor using the DMA controller. This may also be referred to as a shared memory system as all or part of the main memory is shared amongst the variety of devices, including the microprocessor, that can access the memory.
Shared memory systems complicate the cache coherency task significantly. DMA devices access main memory directly, but usually do not access the cache memory directly. To ensure that the DMA device obtains correct data steps must be taken to verify that the contents of the shared memory location being accessed by a DMA device have not been changed in the cached copy of that location being used by the microprocessor. Moreover, the latency imposed by this coherency check cannot be such as to outweigh the benefits of either caching or direct memory access.
One solution is to partition the main memory into cacheable and uncacheable portions. DMA devices are restricted to using only uncacheable portions of memory. In this manner, the DMA device can be unconcerned with the cache contents. However, for the data stored in the uncacheable portions all of the benefits of cache technology are lost.
Another solution is to enable the DMA controller or other hardware coupled to the system bus to “snoop” the cache before the access to shared memory is allowed. An example of this is in the peripheral component interconnect (PCI) bus that enables the PCI bridge device to snoop the CPU cache automatically as a part of any DMA device transaction. This allows shared memory to be cached, however, also adds latency to every DMA transaction. Systems having a single system bus on which all DMA transactions are performed can implement snooping protocols efficiently. This is because a single bus system enables any device to broadcast a signal to all other devices quickly and efficiently to indicate that a shared memory access is occurring.
There is an increasing demand for systems with robust, complex, multi-path communications subsystems for interconnecting system components. Complex communications networks enable greater expansion potential and customization. Moreover, such systems enable existing, proven subsystem and module designs (often referred to as intellectual property or “IP”) to be reused. In systems with more complex bus networks that enable multiple independent paths a network broadcast can be slow making conventional snoop protocols impractical.
Another solution used for more complex networks uses a centralized or distributed directory structure to hold cache status information. These may be seen, for example, in multiprocessor architectures. Any device accessing shared memory first accesses the directory to determine whether the target memory address is currently cached. When the address is not cached, a direct access to the shared memory location is made. When the address is cached, the cached data is written back to main memory before the direct access is completed. Directory-based solutions are faster than snoop operations, but also add latency to each DMA access as well as hardware overhead to support the directory structure.
Existing solutions often rely on interrupt signals generated by the device and interrupt handler routines to implement cache operations such as a snoop. Interrupt mechanisms interrupt instruction flow and delay processing. Interrupt handlers involve multiple instructions and require state of the currently executing thread to be stored while the interrupt handler executes and restored after the interrupt handler executes. Hence, interrupt mechanisms for executing cache operations are an inefficient means to execute what may amount to a single cache instruction.
A need exists for a mechanism, method and system that enables efficient shared memory access in a cached memory system. A need specifically exists for a mechanism to perform cache coherency in a system have a complex, multipath system bus.
The present invention involves a data processing system having shared memory accessible through a transaction-based bus mechanism. A plurality of system components, including a central processor, are coupled to the bus mechanism. The bus mechanism includes a cache coherency transaction within its transaction set. The cache coherency transaction comprises a request issued by one of the system components that is recognized by the central processor as an explicit command to perform a cache coherency operation. The transaction further comprises a response issued by the central processor indicating status of the cache coherency operation.
The present invention involves a method for managing cache coherency in a shared memory system having a plurality of modules including a processing unit coupled to a system bus. One of the processing modules initiates a cache coherency transaction on the system bus. In response to the cache coherency transaction, the processing unit executes a cache coherency operation and responds to the processing module that initiated the transaction with an acknowledge message indicating the cache state.
The foregoing and other features, utilities and advantages of the invention will be apparent from the following more particular description of a preferred embodiment of the invention as illustrated in the accompanying drawings.
The preferred implementation of the present invention comprises a system that may be implemented as a single integrated circuit system-on-a-chip solution or as multiple integrated circuits with varying levels of integration. In either case, sub-components of the system are interconnected by a bus network that may comprise one or more types of bus technologies. The bus network implements a transaction set comprising a plurality of defined transactions that can be communicated over the bus network. Each transaction comprises a request/response pair or a set of request/response pairs.
In the particular implementation, the transaction set includes cache transaction primitives. One of the system components coupled to the bus network is a central processing unit (CPU). Among other features, the CPU includes a cache management or memory management unit that allows the CPU to cache instructions and data from main memory. Modules, devices and sub-components coupled to the bus network use the cache transactions to cause the CPU to perform cache management activities on their behalf. In this manner, when a module desires to access main memory directly, cache coherency can be ensured by issuing a cache transaction prior to the direct memory access. In the preferred implementation, these cache transactions are interpreted by the CPU as explicit commands.
Any system is usefully described as a collection of processes or modules communicating via data objects or messages as shown in
The present invention is illustrated in terms of a media system 100 shown in
Video controller 105 receives digital data from system bus 102 and generates video signals to display information on an external video monitor, television set, and the like. The generated video signals may be analog or digital. Optionally, video controller may receive analog and/or digital video signals from external devices as well. Audio controller 107 operates in a manner akin to video controller 105, but differs in that it controls audio information rather than video. Network I/O controller 109 may be a conventional network card, ISDN connection, modem, and the like for communicating digital information. Mass storage device 111 coupled to high speed bus 102 may comprise magnetic disks, tape drives, CDROM, DVD, banks of random access memory, and the like. A wide variety of random access and read only memory technologies are available and are equivalent for purposes of the present invention. Mass storage 111 may include computer programs and data stored therein.
In a particular example, high speed bus 102 is implemented as a peripheral component interconnect (PCI) industry standard bus. An advantage of using an industry standard bus is that a wide variety of expansion units such as controller's 105, 107, 109 and 111 are readily available. PCI bus 102 supports direct memory access components using a snooping protocol.
Peripherals 113 include a variety of general purpose I/O devices that may require lower bandwidth communication than provided by high speed bus 102. Typical I/O devices include read only memory (ROM) devices such as game program cartridges, serial input devices such as a mouse or joystick, keyboards, and the like. Processor 101 includes corresponding serial port(s), parallel port(s), printer ports, and external timer ports to communicate with peripherals 113. Additionally, ports may be included to support communication with on-board ROM, such as a BIOS ROM, integrated with processor 101.
External memory 103 is typically required to provide working storage for processor 101 and may be implemented using dynamic or static RAM, ROM, synchronous DRAM, or any of a wide variety of equivalent devices capable of storing digital data in a manner accessible to processor 101.
Processor 101 is illustrated in greater detail in the functional diagram of
CPU core 201 communicates with other components shown in
External memory interface 203 provides an interface between the system bus 202 and the external main memory subsystem 103 (shown in
The organization of interconnects in the system illustrated in
It should be noted that in the system of the present invention, the PCI bridge 207 is not coupled directly to CPU 201 and so cannot support snooping in the conventional manner specified by the PCI standards. Instead, system bus 202 provides a protocol in accordance with the present invention that maps cache commands from, for example, PCI bridge 207 onto a cache transaction within the transaction set of bus 202. CPU 201 responds to the cache transaction by implementing the expected cache command.
Packet router 305 uses the destination bits to perform routing. Packet router 305 inspects the destination bits of a received packet, determines the appropriate port to which the packet is to be routed, and routes the packet to the specified module. Packet router 305 may be implemented as a bus, crossbar, packet routing network, or equivalent packet transport mechanism to meet the needs of a particular application.
A packet comprises a plurality of fields indicating information such as the type of transaction, target address of the transaction, and/or data needed or produced by the transaction. An exemplary packet 601 suitable for cache transactions in accordance with the present invention is shown in
Additional fields may be included such as a source identity field and a transaction identity field shown in
Each packet is associated with a source module and a destination module. The source sends a packet 301 or 303 over a port into a packet-router 305 within bus 202. Packet-router 305 arranges for the packet to be routed to a p-port connected to the destination. The destination then receives this packet over that p-port from the packet-router. It is possible for the source and destination to be the same module. It is also possible for a packet to be decomposed into multiple “cells” where each cell of the packet has the same source and destination module and same packet type. The multiple cells are combined into a packet at the destination.
A “transaction” 300, suggested by the dashed line box in
In the preferred implementation there is a 1:1 correspondence between request and response packets. The transaction protocol in the preferred implementation is “split phase” because the request packet 301 and response packet 303 are asynchronous with respect to each other. Requests can be pipelined in that a requesting module 307 can generate multiple request packets 301 before any response packets 303 are received so as to overlap latencies associated with transactions.
Responding 309 modules process requests in the order received, and do not generate a response packet 303 until the requested action is committed. In this manner, apart from internal latency inside the destination module, the access is completed as viewed by all modules coupled to bus 202 when a request packet 301 is received. Any subsequently received requests to that target module will act after that access. This guarantees that time-ordering of access at a destination can be imposed by waiting for the corresponding response.
One of the packet types of particular importance to the present invention is a cache coherency packet type associated with a cache coherency transaction. Cache coherency transactions include a “flush” and a “purge” transaction. These are provided primarily to support the integration of DMA type modules such as PCI bridge 207 shown in
The flush transaction has a single operand which is the physical address which is to be flushed from the cache. When a flush transaction is received from bus 202 by the cache/MMU within CPU 201 it causes the cache/MMU to lookup the address in the cache. If the lookup yields a miss or a hit to a cache line that is unmodified with regard to main memory, the cache/MMU issues a response to the flush request immediately following the lookup. If the lookup yields a hit to a cache line that is modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. Following the writeback the cache/MMU issues a response to the flush request. The response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered.
The purge transaction has a single operand which is the physical address which is to be purged from the cache. When a purge transaction is received from bus 202 by the cache/MMU within CPU 201 it causes the cache/MMU to lookup the address in the cache. If the lookup yields a miss the cache/MMU issues a response to the purge request immediately following the lookup. If the lookup yields a hit to the cache line modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. If the lookup yields a hit the cache line is invalidated whether or not the line is modified with respect to main memory. Following the invalidation the cache/MMU issues a response to the purge request. The response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered and that the specified memory location is no longer valid in the cache.
The use of flush and purge by a module provides a level of cache coherency. These operations guarantee that a read operation by a module to an address in a shared memory system will receive the value last written to that address. The time of access is given as the time at which the flush is received by the cache controller. The module read operation is guaranteed to get a data value coherent with the value of the system memory no earlier than the time of access. In the case of a write operation by a module to an address in shared memory, the purge operation guarantees that the written data is readable by all memory users after the time of access. The time of access is given as the time at which the write operation is performed to system memory following the purge of the data cache(s).
In a typical operation, a component coupled to PCI bus 205 wishes to access a shared memory location, it asserts the memory request using PCI standard DMA signaling protocol to PCI bridge 207. Because CPU 201 is not coupled to the PCI bus 205 directly, this signaling protocol is not recognized by CPU 201. Although the operation in accordance with the present invention is described with particular reference to PCI module 207, it should be understood that any module coupled to bus 202 that desires to use shared memory can implement the steps outlined below.
When PCI module 207 wishes to complete the coherent request to shared memory, module 207 performs the steps shown generally in
For a read operation from shared memory, a load request is then made in step 405 in a packet addressed to the memory interface unit 203. In the case of a write operation, a store request packet is addressed to memory interface unit 203 in step 407. In step 409 external memory interface unit generates a response packet indicating completion of the coherent access.
In this manner the present invention provides cache control instructions that are integrated into the basic transaction set of bus 202. This feature enables any module coupled to bus 202 to implement cache control and ensure coherent use of shared memory resources in a system where multiple memory users can concurrently read information while only one memory user has exclusive write control. Corresponding logic in the cache/MMU of CPU 201 responds to the cache control transactions to perform the cache control operation on behalf of the requesting module. The logic in the cache/MMU has an ability to recognize and process cache control transactions directly without the assistance of instructions executed on a CPU and without using any type of interrupt mechanism.
In the preferred implementation, the cache/MMU in CPU 201 implements a valid bit and a dirty bit for each cache line and the cache/MMU is able to perform a lookup on a physical address specified by request packet from a module that uses shared memory.
The coherency logic within the requesting module (e.g., PCI bridge 207) preferably can specify one or more caching windows and allow remote specification of the caching policy for a particular region in cache to increase coherency performance. The actual encoding and range sizes as well as the number of discrete ranges that are enabled are a matter of design choice selected to meet the needs of a particular application. In this manner, a cache partition can be implemented by storing an address and the size of the partition within the PCI module 207. The cache coherency policy for that partition can be controlled by setting a mode value within the PCI module 207. This feature of the present invention enables the remote specification of the caching policy in a manner that does not require any manipulation of control registers within CPU 201. Whether or not a flush or purge command is issued is determined by the PCI module 207 and the cache/MMU within CPU 201 merely responds to execute and acknowledge issued cache control commands.
To implement the above feature, PCI module 207 will precede step 401 in
While the invention has been particularly shown and described with reference to a preferred embodiment thereof, it will be understood by those skilled in the art that various other changes in the form and details may be made without departing from the spirit and scope of the invention. The various embodiments have been described using hardware examples, but the present invention can be readily implemented in software. For example, it is contemplated that a programmable logic device, hardware emulator, software simulator, or the like of sufficient complexity could implement the present invention as a computer program product including a computer usable medium having computer readable code embodied therein to perform precise architectural update in an emulated or simulated out-of-order machine. Accordingly, these and other variations are equivalent to the specific implementations and embodiments described herein.
The present application is a continuation of and claims priority to U.S. patent application Ser. No. 09/410,928, filed Oct. 1, 1999, entitled “System and Method for Maintaining Cache Coherency in a Shared Memory System”, the disclosure of which is herein specifically incorporated by this reference.
Number | Date | Country | |
---|---|---|---|
Parent | 09410928 | Oct 1999 | US |
Child | 11313261 | Dec 2005 | US |