Patent Application
20050149686
Not Applicable.
Not Applicable.
Not Applicable.
The invention disclosed broadly relates to the field of computer memory management. More particularly, the present invention relates to a method and apparatus for defragmenting a memory without stopping the running of an ongoing application.
With regard to computers, garbage collection refers to a process of identifying unused areas of main memory storage. In object-oriented computing languages, the computer executing the program allocates memory for each of the objects. A Java Virtual Machine (JVM) using the object oriented programming language Java allocates memory for the instantiation of the objects from a free memory area called a heap. Memory is allocated to, and freed from, the heap in blocks of one of a number of predetermined sizes. Eventually, when the objects are no longer being referenced by the program, the memory allocated for the created objects is reclaimed through a process called garbage collection. The garbage collection process clears the objects from memory such that the once allocated memory is again available for use. More particularly, a garbage collection process involves automatically determining which blocks of memory can be freed, marking unused blocks as no longer needed by an application, collecting all of the unused blocks of memory at periodic intervals, returning the unused blocks to the heap, and marking the blocks as free for use. Such a garbage collection process is often referred to as a mark-and-sweep since unused portions of memory are marked as garbage during a mark phase and then removed from allocated memory in a sweep phase. Although the process of garbage collection frees memory it may be problematic in applications where its unpredictable consumption of processor time affects the running of the application. In addition, the constant allocating and freeing of blocks of memory tends to fragment the memory over time.
The exact garbage collection strategy used by an object oriented program will often vary depending on the type of system in which the program is executing. For example, in some JVM implementations, the garbage collector is a built-in component. In other applications, different garbage collectors may be plugged in for different circumstances. Many different algorithms have been employed in these different garbage collector implementations. For example, server applications in a multi-user multiprocessor environment tend to have a memory-use profile that differs from a desktop computer environment. Furthermore, embedded-Java devices such as cell phones and handheld devices have different memory-use profiles. A single garbage collector is typically designed to implement one particular strategy and cannot be modified “on-the-fly” to change its strategy. Therefore, a customized garbage collector must typically be built into each programming instance depending upon the computer platform and operating environment in which the program is executing. On any given day, a particular set of garbage collection characteristics or garbage collection algorithm metrics will be better for one device but not for another device. For example, a device with a small amount of memory may require a very aggressive garbage collection routine whereas as a large server with lots of memory may permit a more relaxed approach. In each case, a different type of garbage collection algorithm is needed in order to adapt the performance of the garbage collector to the performance characteristics of the hardware platform. Therefore, what is needed is a garbage collection process that can be easily be tuned for a variety of particular applications.
There are several common techniques for garbage collection. One technique is referred to as “copying” and relates to logically dividing the memory in half and using only one half of the memory at a time. During garbage collection, the collection routine copies all live objects to the other half of the memory. Following the copying of all the live objects, the memory manager adds the entire first half of memory to the free list. Consequently, the previously used memory which contained both the live objects and the garbage objects becomes free memory. In other words, the garbage filled memory has been reclaimed for later use. Another garbage collection technique is the mark-and-sweep method. The mark-and-sweep technique marks all live objects of memory. Each memory object usable by a program application is marked as used by the garbage collector. The garbage collector then sweeps the entire heap to reclaim all unmarked objects of memory by adding the unmarked objects to the free list. When the sweep phase is complete, all garbage objects are now on the free list and available to be reallocated to a computer program.
In some instances, the mark-and-sweep technique might be preferred over the copying technique because it is faster than copying, since the copying of objects and updating the references takes more time than adding a garbage block to a free list. Moreover, the mark-and-sweep technique is often more space efficient since it uses the whole memory, as opposed to only half, as used in the copying technique. However, in other situations, the copying technique may be preferred due to the lack of fragmentation and in instances having a relatively small number of live memory blocks.
Unfortunately, the mark-and-sweep technique has disadvantages. One such disadvantage is that the sweep function of the mark-and-sweep technique examines every single memory block. This is time consuming if the number of live objects is low relative to the number of objects allocated. In particular, some applications such as anti-lock brake management system are real time applications in that they require that a primary application never stop running. In such an application, it is important that the amount of processor time and memory devoted to garbage collection not interrupt the running of the application or mutator. In addition, it is important that the memory not be fragmented to the point that a certain level of memory is not available for the primary application. Unfortunately, prior art garbage collection routines cannot guarantee a given level of performance. Therefore, what is needed is a real time garbage collection algorithm with guaranteed performance that allows for managed defragmentation of the memory.
An application of the present invention is directed toward a method of defragmenting a memory heap arranged into a series of pages further divided into blocks of one of a number of different block size classes. In accordance with the method, objects are marked in the memory that were not used during a previous cycle as dead objects. Objects that were used during the previous cycle are marked as live objects. Pages of memory containing the dead objects are defragmented such that there is at most one page having both used and dead objects by moving live objects from pages having a least number of live objects to pages having a greatest number of live objects. The defragmenting is performed for objects in each of the different size classes of blocks progressing from a largest block size to a smallest block size. The sizes of the classes of block sizes are selected such that adjacent classes ci and c(i-1) satisfy the formula ci=c(i-1)(1+ρ) where ρ is a desired bound ratio for the internal defragmentation. The pages are sorted to form a list of the pages such that a first page in the list has a lowest number of dead objects and a last page in the list has a highest number of dead objects. The used objects are then moved from the last page in the list to the first page in the list and the pages are progressed through as the pages are respectively filled and evacuated until all of the used objects have been moved. The objects are moved to blocks of memory that are of a smallest size class that will contain the object being moved. A read barrier with a forwarding pointer is used to assist in moving the objects. The defragmentation process is preferably performed as part of a garbage collection process and is only performed when a number of empty pages of memory drops below a threshold level.
Yet another application of the present invention is directed toward a method of defragmenting a memory divided into a series of pages without affecting a running application. The pages of memory are divided into a series of blocks of different size classes. The size of the block size classes is selected to limit an amount of internal fragmentation. In accordance with the method, the memory is arranged into a number of pages. A number of dead objects on each of the pages of the memory is determined. The pages are then sorted by the number of dead objects on each of the pages to create a list of pages proceeding from a page having a lowest number of dead objects and to a page having a highest number of dead objects. A read barrier is used to move used objects saved in the memory from the page having the highest number of dead objects to the page having the lowest number of dead objects. An allocation pointer is set to the page having the lowest number of dead objects and an evacuation pointer is set to the page having the highest number of dead objects. The allocation pointer is then progressed to a subsequent page when all blocks of memory on a previous page have been allocated and the evacuation pointer is progressed to a subsequent page when all of the live objects have been evacuated from a previous page. The allocation pointer and the evacuation pointer are progressed until the pointers point to the same page. When the defragmentation is performed as part of a garbage collection process, the pointers in the read barrier are preferably altered to reflect new locations of the objects during a mark phase of a mark and sweep garbage collection process. A frequency at which garbage collection is scheduled is also preferably selected to limit a processor's utilization or a required memory size.
Yet another application of the present invention is directed toward a software program for managing a memory heap for a processor running a time sensitive application. The software program includes a garbage collection routine. The garbage collection routine includes a defragmentation routine wherein used objects are moved from pages of memory containing a lowest amount of used objects to pages of memory containing a highest amount of used objects. The software sorts the pages of memory based on a number of dead objects on the pages. The garbage collection routine and the application are interleaved on a time-based or work-based schedule. The software divides the pages of memory into blocks of different size classes. Objects of larger block size classes are moved before blocks of the lower block size classes. A read barrier having a to-space invariant is included. A forwarding pointer is located in a header of each object. Optimizing software optimizes the read barrier to reduce its software overhead.
A collector constructed in accordance with a preferred embodiment of the present will provide guaranteed performance provided the application is correctly characterized by the user. In particular, the user must be able to specify the maximum amount of simultaneous live data, m, as well as the peak allocation rate over the time interval of a garbage collection a*(ΔGC). The collector is parameterized by its tracing rate R. Given these characteristics of the mutator and the collector, the user then has the ability to tune the performance of the system using three interrelated parameters: total memory consumption, minimum guaranteed CPU utilization and the resolution at which the utilization is calculated.
The relationship between these parameters is shown graphically in
Referring now to
The total fragmentation of a system such as that shown in
Secondly, there is unused space at the end of a page which is referred to as page-internal fragmentation. The ratio of the page size to the largest block class size primarily determines the amount of page-internal fragmentation. More particularly, the amount of internal fragmentation is generally bound by the largest block size divided by the page size. Thus, the selection of the page size and the largest block size class may be used to bound the page-internal fragmentation for time or memory sensitive applications.
Finally, there are unused blocks that could satisfy a request for a different size object. This type of fragmentation is referred to as external fragmentation. External fragmentation only occurs on pages that have both live and dead objects. External fragmentation is often determined by the size of the objects being allocated by the application. Applications typically exhibit locality in that the number of objects of a particular size class that were allocated during a previous cycle is often a good predictor of the number of objects in the size class that will be allocated during the next cycle. External fragmentation is practically eliminated in accordance with an embodiment of the present invention by using arraylets or blocks whereby large arrays are broken into fixed-sized pieces. An arraylet is a block of maximum class size. This bounds the potential external fragmentation caused by large objects. In addition, explicit defragmentation may be performed on pages containing dead objects as discussed in more detail herein.
A read barrier is preferably used to address the pages and blocks of the memory. A most preferred embodiment of the present invention uses a Brooks-style read barrier wherein each object contains a forwarding pointer that normally points to itself. However, when the object has been moved, the pointer points to the moved object. Because the preferred embodiment uses a forwarding pointer, the collector maintains a to-space invariant. Thus, the mutator or application always sees the new version of an object. However, the sets comprising the from-space and to-space have a large intersection, rather than being completely disjoint as in a pure copying collector. While the preferred embodiment uses a read barrier and a to-space invariant, the collector does not suffer from variations in mutator utilization because all of the work of finding and moving objects is performed by the collector during the collection phase.
A preferred method 300 of moving of an object using a read barrier with a forwarding pointer in accordance with an embodiment of the present invention is described with respect to
The preferred embodiment overcomes the high software costs typically associated with read barriers by using an optimizing compiler wherein the compiler is able to optimize the barriers. A number of optimizations can be used to reduce the costs of the read barriers. Common sub-expression elimination, as well as other special purpose optimizations like barrier-sinking in which the barrier is sunk down to its point of use to thereby allow the null-check required by the Java object dereference to be folded into the null-check required by the barrier, can be used. Since the pointer can be null, the barrier cannot perform forwarding unconditionally. Optimization works with whatever null-checking approach is used by the run time system whether it is accomplished via explicit comparisons or implicit traps on null dereferences. The point is to usually avoid introducing explicit checks for null and the preferred embodiment guarantees that any exception due to a null pointer occurs at the same place as it would have in the original program.
Referring now to
Defragmentation occurs during the garbage collection phase as set forth in step 404. First, it is determined whether or not the number of empty pages of memory has fallen below a threshold number of empty pages of memory as shown in step 406. If the threshold has not been breached, the proceeds to step 408 wherein no defragmentation occurs during the present garbage collection phase. The threshold number of pages is selected such that there is always enough memory to run the primary real time application. If the threshold has been breached, the method proceeds to step 410 wherein all objects that have not be used since the last collection cycle are marked as dead objects. During the mark phase of the garbage collection process, the memory blocks for all of the objects that have been previously relocated during a previous collection process as described with respect to
Once the objects have been marked as used or unused, the pages of memory are sorted according to the number of dead objects per page as shown in step 414. In one embodiment, the first entry in the list contains the page with the least number of dead or dead objects and the last entry contains the page with the greatest. number of dead objects. In step 416, starting with the largest block size, live objects are moved from the pages having the most dead objects to pages having the least dead objects. After the largest block class sized objects have been moved, the process is repeated for each lower block size. The later smaller classes of blocks are used to fill in the holes left by the allocation of the larger earlier blocks. Thus, proceeding in this manner reduces the internal fragmentation of the heap. The objects are preferably moved by setting an evacuation pointer to the emptiest page and an allocation pointer to the fullest page in step 418. The process continues in step 420 until the evacuation pointer and the allocation pointer point to the same page or, alternatively, until the threshold number of pages have been emptied. The process then waits until the threshold is again violated at which time the garbage collection cycle begins again.
Referring to
What has been shown and discussed is a highly-simplified depiction of a programmable computer apparatus. Those skilled in the art will appreciate that other low-level components and connections are required in any practical application of a computer apparatus. Therefore, while there has been described what is presently considered to be the preferred embodiment, it will be understood by those skilled in the art that other modifications can be made within the spirit of the invention.
