1. Technical Field
The present invention relates to data processing systems and, in particular, to remote method invocation in a Java environment. Still more particularly, the present invention provides a method, apparatus, and program for reusing remote method invocation connections.
2. Description of Related Art
Java is a programming language designed to generate applications that can run on all hardware platforms without modification. Java was modeled after C++, and Java programs can be called from within hypertext markup language (HTML) documents or launched stand alone. The source code of a Java program is compiled into an intermediate language called “bytecode,” which cannot run by itself. The bytecode must be converted (interpreted) into machine code at runtime. When running a Java application, a Java interpreter (Java Virtual Machine) is invoked. The Java Virtual Machine (JVM) translates the bytecode into machine code and runs it. As a result, Java programs are not dependent on any specific hardware and will run in any computer with the Java Virtual Machine software.
Remote Method Invocation (RMI) is a remote procedure call (RPC), which allows Java objects (software components) stored in a network to be run remotely. In the Java distributed object model, a remote object is one whose methods can be invoked from another JVM, on the same host or potentially on a different host.
Creating an RMI connection between two JVMs can be an expensive process both in terms of time and resources. Thus, it would be advantageous to reuse an established connection when possible. An RMI connection between two JVMs is encapsulated within a Java remote object. A connection can be reused by maintaining a normal reference to the connection object on the RMI client. In order to properly manage these connection objects, the RMI remote object class may implement the Unreferenced interface to allow the object to be notified when it is no longer referenced by a client JVM. When the object is notified via the Unreferenced interface, the object becomes unusable and can be destroyed in response to garbage collection by the server JVM. Garbage collection is a routine that searches memory for program segments or data that are no longer active in order to reclaim that space.
To prevent a remote object from becoming unreferenced and invoking the notification mechanism, a client JVM may hold a normal reference to the connection object. However, holding a normal reference to a connection object prevents the resources that it is using in the server JVM from being reclaimed until the client JVM releases the reference to the object. A problem may occur when the server JVM is instructed to shutdown. If a client JVM still holds a normal reference to a connection object connecting the client JVM to the server JVM, it can prevent or greatly delay the shutdown process of the server JVM. A problem may also occur if the server JVM is running low on memory resources. If the client JVM still holds a normal reference to a connection, the server JVM cannot reclaim the memory used for that object even though the connection may not be needed.
Thus, it would be advantageous to provide an improved mechanism for reusing established RMI connections.
The present invention implements an efficient caching mechanism for Java RMI remote objects that implement the Unreferenced interface. In order to efficiently manage a cache for these connection objects, the client JVM may hold a normal reference to the object while the connection is in use and for a period of time thereafter. A thread, referred to as a connection expiration thread, is used as a timer for each connection with a normal reference. After that period of time expires, only a weak reference is held by the client JVM and the connection may be garbage collected. The period of time may be adjusted to suit the needs of the server JVM. A shorter time may be used to ensure responsiveness of the server JVM to memory demand and shutdown requests, while a longer time may be used to enhance the effectiveness of the caching mechanism by forcing connections to stay open longer after they are no longer being used and before they are automatically destroyed due to garbage collection by the server JVM.
The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
With reference now to the figures,
In the depicted example, a server 104 is connected to network 102 along with storage unit 106. In addition, clients 108, 110, and 112 also are connected to network 102. These clients 108, 110, and 112 may be, for example, personal computers or network computers. In the depicted example, server 104 provides data, such as boot files, operating system images, and applications to clients 108–112. Clients 108, 110, and 112 are clients to server 104. Network data processing system 100 may include additional servers, clients, and other devices not shown. In the depicted example, network data processing system 100 is the Internet with network 102 representing a worldwide collection of networks and gateways that use the TCP/IP suite of protocols to communicate with one another. At the heart of the Internet is a backbone of high-speed data communication lines between major nodes or host computers, consisting of thousands of commercial, government, educational and other computer systems that route data and messages. Of course, network data processing system 100 also may be implemented as a number of different types of networks, such as for example, an intranet, a local area network (LAN), or a wide area network (WAN).
Referring to
Peripheral component interconnect (PCI) bus bridge 214 connected to I/O bus 212 provides an interface to PCI local bus 216. A number of modems may be connected to PCI bus 216. Typical PCI bus implementations will support four PCI expansion slots or add-in connectors. Communications links to network computers 108–112 in
Additional PCI bus bridges 222 and 224 provide interfaces for additional PCI buses 226 and 228, from which additional modems or network adapters may be supported. In this manner, data processing system 200 allows connections to multiple network computers. A memory-mapped graphics adapter 230 and hard disk 232 may also be connected to I/O bus 212 as depicted, either directly or indirectly.
Those of ordinary skill in the art will appreciate that the hardware depicted in
The data processing system depicted in
With reference now to
An operating system runs on processor 302 and is used to coordinate and provide control of various components within data processing system 300 in
Those of ordinary skill in the art will appreciate that the hardware in
As another example, data processing system 300 may be a stand-alone system configured to be bootable without relying on some type of network communication interface, whether or not data processing system 300 comprises some type of network communication interface. As a further example, data processing system 300 may be a Personal Digital Assistant (PDA) device, which is configured with ROM and/or flash ROM in order to provide non-volatile memory for storing operating system files and/or user-generated data.
The depicted example in
With reference to
The RMI client sends a request for an RMI connection to the RMI server (step 401) and the RMI server returns an RMI connection object (step 402). The RMI connection is then used to send and receive data (step 403). When the RMI client is done with the connection, the RMI server destroys the connection object by distributed garbage collection (step 404).
When a new connection is required, the above steps are repeated. Using this mechanism may be expensive from a time standpoint, because it requires a new connection to be established every time data is exchanged.
With reference now to
The RMI client sends a request for an RMI connection to the RMI server (step 501) and the RMI server returns an RMI connection object (step 502). The RMI connection is then used to send and receive data (step 503). After the RMI client is done with the connection, the connection is stored as a normal reference in cache 512. Since the connection object is cached, the RMI connection may be reused to exchange data (step 504).
Maintaining a normal reference to connection objects may be expensive from a memory usage standpoint, because it never allows unused connections to be destroyed through the RMI server garbage collection mechanism. Therefore, in accordance with a preferred embodiment of the present invention, the RMI client sets an expiration timer. When the cache timer expires, the RMI client maintains a weak reference to the connection object (step 505). If a connection to RMI server 520 is needed while the connection object is weakly referenced, the RMI server may reestablish a normal reference to the connection object and the connection may be reused (step 506). However, while the connection object is weakly referenced, the connection object may also be destroyed through the RMI server garbage collection mechanism (step 507).
Using this caching technique, the connection is cached by the RMI client for a specified period of time. If a connection to the RMI server is needed within that time period, the connection is reused. Once the time period expires, the connection may be garbage collected and destroyed by the RMI server. After garbage collection, a new connection must be established to the RMI server.
In accordance with a preferred embodiment of the present invention, an efficient caching mechanism for Java RMI remote objects implements the Unreferenced interface. The Unreferenced interface allows the object to be notified when it is no longer referenced by a client JVM. If a client JVM holds only a weak reference to a connection object, the server JVM may treat the connection object as if there is no client JVM referencing the object. As known in the art, a weak reference is a means to hold a Java object which allows it to be used but also allows it to be available for garbage collection. Invoking the unreferenced interface is the process that happens when the RMI server detects that no client JVMs hold a normal reference to the object. A weakly referenced object is an object that does not prevent its referent from being available for garbage collection. Garbage collection refers to the process of making the object finalizable, invoking the finalize method of the object, and then reclaiming its storage space.
In order to efficiently implement a cache for these connection objects, the client JVM may hold a normal (non-weak) reference to the connection object while the connection is in use and for a period of time thereafter. After that period of time expires, the object may only be held with a weak reference by the client JVM. This allows the connection object to be reused at any time until the server JVM realizes that the connection object is no longer held with a normal reference by the client JVM and invokes the unreferenced mechanism.
A The cache is implemented by both a HashMap and a WeakHashMap. The concepts of weak references, WeakHashMaps, and HashMaps are well known features of Java. When a connection is created, a reference to the connection object is added to both hash maps. When a connection is needed, the WeakHashMap is searched. The HashMap need not be searched, since the WeakHashMap contains a superset of the objects in the HashMap. The HashMap is the cache that contains the normal references to the connection objects.
Each connection object is also modified to contain a test method. The test method is used to test the object and ensure that still responds properly to remote interaction. If the test method throws a RemoteException, the connection object is no longer usable and must be recreated. If a matching connection object is found in the WeakHashMap, the test method is invoked to ensure that the object is still usable.
When a connection is no longer being used, a call is made to the connection expiration thread for this connection object. The connection expiration thread adds the connection object back to the HashMap, if necessary, and waits for a specified amount of time. When the time has elapsed, it then deletes the reference to the connection object from the HashMap. When this happens, the only remaining reference to the connection object is in the WeakHashMap, which is a weak reference. This allows connection objects to be efficiently cached as they are always held as weak references and only held as normal references when they are in use and for a short period of time thereafter.
A normal reference to the connection object is held for a period of time after the connection is no longer in use to ensure that the connection object is available for reuse for at least that period of time. The period of time may be adjusted based upon the implementation. For example, in an implementation which is not likely to reuse connections often, the period of time may be shortened. However, in an implementation in which connections are reused frequently, the period of time may be lengthened to increase the likelihood that the connection object will be held in cache.
The wait time of the connection expiration thread may be adjusted to suit the needs of the server JVM. A shorter time may be used to ensure responsiveness of the server JVM to memory demand and shutdown requests, while a longer time may be used to enhance the effectiveness of the caching mechanism by forcing connections to stay open longer after they are no longer being used and before they are automatically available for garbage collection.
With reference to
Particularly, with respect to
Turning to
With reference now to
Finally, turning to
With reference to
If the connection is good, the process notifies the connection expiration thread for this connection and the connection is reused (step 710). Thereafter, the process adds the connection object to the HashMap (step 720), uses the connection (step 722), notifies the expiration thread and sets the connection expiration thread timer to a desired value (step 724), and ends.
If the connection is not good in step 708, the process notifies the expiration thread that the connection has been closed (step 712), establishes a new connection to the server (step 714), creates a connection expiration thread for the new connection (step 716), and adds the connection object to the WeakHashMap (step 718). Then, the process adds the connection object to the HashMap (step 720), uses the connection (722), notifies the expiration thread and sets the timer to a desired value (step 724), and ends.
Returning to step 704, if the connection does not exist, the process establishes a new connection to the server (step 714), creates a connection expiration thread for the new connection (step 716), and adds the connection object to the WeakHashMap (step 718). Then, the process adds the connection object to the HashMap (step 720), uses the connection (722), notifies the expiration thread and sets the timer to a desired value (step 724), and ends.
With reference now to
Once the process has been notified, a determination is made as to why it was notified (step 804). If it was notified because the connection was closed, the process ends. If it was notified to set the expiration timer value and start the timer, it enters an efficient wait state and waits until the timer expires or it is notified that the connection is going to be reused (step 806).
The process then makes a determination as to why the wait in step 806 ended (step 808). If the wait ended because the process was notified that the connection object is being reused, the process returns to step 802 to wait to be notified to set the expiration timer again when the connection is done being used. If the wait ended because the timer expired, the process removes the connection from the HashMap (step 810), and returns to step 802 to wait to be notified either to set the expiration timer again if the connection has been reused after it was removed from the HashMap or to end the process because the connection has been closed.
With reference to
Turning now to
If a reference exists, the process returns to step 1002 to wait again. If a reference does not exist in step 1006, the process invokes the unreferenced interface for the connection (step 1008) and ends.
Thus, the present invention solves the disadvantages of the prior art by implementing an efficient caching mechanism for Java RMI remote objects that implement the Unreferenced interface. In order to efficiently implement a cache for these connection objects, the client JVM may hold a normal reference to the object while the connection is in use and for a period of time thereafter. After that period of time expires, only a weak reference is held by the client JVM and the connection may be garbage collected. The period of time may be adjusted to suit the needs of the server JVM. A shorter time may be used to ensure responsiveness of the server JVM to memory demand and shutdown requests, while a longer time may be used to enhance the effectiveness of the caching mechanism by forcing connections to stay open longer after they are no longer being used and before they are automatically garbage collected.
It is important to note that while the present invention has been described in the context of a fully functioning data processing system, those of ordinary skill in the art will appreciate that the processes of the present invention are capable of being distributed in the form of a computer readable medium of instructions and a variety of forms and that the present invention applies equally regardless of the particular type of signal bearing media actually used to carry out the distribution. Examples of computer readable media include recordable-type media, such as a floppy disk, a hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and transmission-type media, such as digital and analog communications links, wired or wireless communications links using transmission forms, such as, for example, radio frequency and light wave transmissions. The computer readable media may take the form of coded formats that are decoded for actual use in a particular data processing system.
The description of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiment was chosen and described in order to best explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
Number | Name | Date | Kind |
---|---|---|---|
5247520 | Geise et al. | Sep 1993 | A |
5274804 | Jackson et al. | Dec 1993 | A |
5371499 | Graybill et al. | Dec 1994 | A |
5398334 | Topka et al. | Mar 1995 | A |
5560003 | Nilsen et al. | Sep 1996 | A |
5692185 | Nilsen et al. | Nov 1997 | A |
5699361 | Ding et al. | Dec 1997 | A |
5761511 | Gibbons et al. | Jun 1998 | A |
5768510 | Gish | Jun 1998 | A |
5796393 | MacNaughton et al. | Aug 1998 | A |
5832529 | Wollrath et al. | Nov 1998 | A |
5878420 | de la Salle | Mar 1999 | A |
5900001 | Wolczko et al. | May 1999 | A |
5903900 | Knippel et al. | May 1999 | A |
5911144 | Schwartz et al. | Jun 1999 | A |
5915255 | Schwartz et al. | Jun 1999 | A |
5920876 | Ungar et al. | Jul 1999 | A |
6006268 | Coile et al. | Dec 1999 | A |
6035324 | Chang et al. | Mar 2000 | A |
6038572 | Schwartz et al. | Mar 2000 | A |
6047295 | Endicott et al. | Apr 2000 | A |
6070184 | Blount et al. | May 2000 | A |
6073175 | Tavs et al. | Jun 2000 | A |
6098080 | Endicott et al. | Aug 2000 | A |
6108687 | Craig | Aug 2000 | A |
6115782 | Wolczko et al. | Sep 2000 | A |
6134603 | Jones et al. | Oct 2000 | A |
6167535 | Foote et al. | Dec 2000 | A |
6237060 | Shilts et al. | May 2001 | B1 |
6247060 | Boucher et al. | Jun 2001 | B1 |
6317775 | Coile et al. | Nov 2001 | B1 |
6338089 | Quinlan | Jan 2002 | B1 |
6366558 | Howes et al. | Apr 2002 | B1 |
6414610 | Smith | Jul 2002 | B1 |
6421690 | Kirk, III | Jul 2002 | B1 |
6429860 | Hughes | Aug 2002 | B1 |
6434543 | Goldberg et al. | Aug 2002 | B1 |
6438560 | Loen | Aug 2002 | B1 |
6487581 | Spence et al. | Nov 2002 | B1 |
6598094 | Wollrath et al. | Jul 2003 | B1 |
6671707 | Hudson et al. | Dec 2003 | B1 |
6701520 | Santosuosso et al. | Mar 2004 | B1 |
6820261 | Bloch | Nov 2004 | B1 |
6874074 | Burton et al. | Mar 2005 | B1 |
20050278726 | Cano et al. | Dec 2005 | A1 |
20060031282 | Tuttle | Feb 2006 | A1 |
Number | Date | Country | |
---|---|---|---|
20020161894 A1 | Oct 2002 | US |