Patent Application
20140108532
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
The current application hereby incorporates by reference the material in the following patent applications:
U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR PROVIDING PARTITION PERSISTENT STATE CONSISTENCY IN A DISTRIBUTED DATA GRID,” by inventors Robert H. Lee and Gene Gleyzer, filed ______ (Attorney Docket No.: ORACL-05359US0).
U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR PROVIDING TRANSIENT PARTITION CONSISTENCY IN A DISTRIBUTED DATA GRID,” by inventors Robert H. Lee and Gene Gleyzer, filed ______(Attorney Docket No.: ORACL-05359US1).
U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR SUPPORTING ASYNCHRONOUS MESSAGE PROCESSING IN A DISTRIBUTED DATA GRID,” by inventor Gene Gleyzer, filed ______ (Attorney Docket No.: ORACL-05360US0).
U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR SUPPORTING OUT-OF-ORDER MESSAGE PROCESSING IN A DISTRIBUTED DATA GRID,” by inventors Mark Falco and Gene Gleyzer, filed ______ (Attorney Docket No.: ORACL-05364US0).
1. Field of Invention
The present invention is generally related to computer systems, and is particularly related to a distributed data grid.
2. Background
Modern computing systems, particularly those employed by larger organizations and enterprises, continue to increase in size and complexity. Particularly, in areas such as Internet applications, there is an expectation that millions of users should be able to simultaneously access that application, which effectively leads to an exponential increase in the amount of content generated and consumed by users, and transactions involving that content. Such activity also results in a corresponding increase in the number of transaction calls to databases and metadata stores, which have a limited capacity to accommodate that demand.
This is the general area that embodiments of the invention are intended to address.
Described herein are systems and methods that can support guaranteed multi-point message delivery in a distributed data grid. A messaging facility in the distributed data grid can receive an incoming message that is adaptive to be delivered to a plurality of nodes in the distributed data grid. The messaging facility can deliver the incoming message to the plurality of nodes according to an order in a list. Furthermore, a node in the plurality of nodes operates to skip a next node in the list to deliver the incoming message, when the next node is dead or unavailable.
Described herein are systems and methods that can support guaranteed multi-point message delivery in a distributed data grid.
In accordance with an embodiment, as referred to herein a “distributed data grid”, “data grid cluster”, or “data grid”, is a system comprising a plurality of computer servers which work together to manage information and related operations, such as computations, within a distributed or clustered environment. The data grid cluster can be used to manage application objects and data that are shared across the servers. Preferably, a data grid cluster should have low response time, high throughput, predictable scalability, continuous availability and information reliability. As a result of these capabilities, data grid clusters are well suited for use in computational intensive, stateful middle-tier applications. Some examples of data grid clusters, e.g., the Oracle Coherence data grid cluster, can store the information in-memory to achieve higher performance, and can employ redundancy in keeping copies of that information synchronized across multiple servers, thus ensuring resiliency of the system and the availability of the data in the event of server failure. For example, Coherence provides replicated and distributed (partitioned) data management and caching services on top of a reliable, highly scalable peer-to-peer clustering protocol.
An in-memory data grid can provide the data storage and management capabilities by distributing data over a number of servers working together. The data grid can be middleware that runs in the same tier as an application server or within an application server. It can provide management and processing of data and can also push the processing to where the data is located in the grid. In addition, the in-memory data grid can eliminate single points of failure by automatically and transparently failing over and redistributing its clustered data management services when a server becomes inoperative or is disconnected from the network. When a new server is added, or when a failed server is restarted, it can automatically join the cluster and services can be failed back over to it, transparently redistributing the cluster load. The data grid can also include network-level fault tolerance features and transparent soft re-start capability.
In accordance with an embodiment, the functionality of a data grid cluster is based on using different cluster services. The cluster services can include root cluster services, partitioned cache services, and proxy services. Within the data grid cluster, each cluster node can participate in a number of cluster services, both in terms of providing and consuming the cluster services. Each cluster service has a service name that uniquely identifies the service within the data grid cluster, and a service type, which defines what the cluster service can do. Other than the root cluster service running on each cluster node in the data grid cluster, there may be multiple named instances of each service type. The services can be either configured by the user, or provided by the data grid cluster as a default set of services.
In accordance with various embodiments of the invention, a distributed data grid can support guaranteed multi-point message delivery, which can provide consistency in delivering messages among different cluster nodes in the distributed data grid.
A cluster node, e.g. node A 201, can be either the originator of an internal message, or a recipient of an internal message. Additionally, the cluster node A 201 can also be a recipient of an incoming message from a client 210. The cluster node A 201 can use a message facility 211 to configure and deliver a message to different cluster nodes in the distributed data grid 200, such as nodes B-D 202-204.
The cluster node A 201 can deliver the message to the recipient nodes B-D 202-204 in a particular order, e.g. based on a list from node B 202 to node C 203 then to node D 204. Here, the message facility 211 on the cluster node A 201 can be used to assign the order to the recipient nodes B-D 202-204 in the distributed data grid 200.
Furthermore, each recipient node B-D 202-204 in the list can keep track of how the message is to be delivered down the list. For example, a recipient node, e.g. node B 202, can detect that node C 203, which is the next node in the list, is dead or temporarily unavailable. Then, the node B 202 can skip the node C 203, and deliver the message directly to node D 204, which is the node next to the node C 203 on the list.
As shown in
In accordance with various embodiments of the invention, the guaranteed multi-point message delivery feature can be used for managing partition backups. For example, a cluster node, e.g. the node A 201, can be the owner of a partition, while nodes B-D are backup nodes for the node A 201. Here, the partition can define that the value of a property x is equal to 1 (“x=1”), which can be maintained on both the primary owner node A 201 and each backup node B-D 202-204.
Then, the node A 201 can receive a message from the client 210, which changes the value of the property x to 2 (“x=2”). Thus, the cluster node A 201 may propagate the message, “x=2”, to each backup node B-D 202-204.
As shown in
On the other hand, an alternative approach is that the cluster node A 201 can deliver the message to each recipient node B-D 202-204 separately, or in parallel (as shown in dotted line in
Unlike the guaranteed multi-point message delivery feature as described in the above, this alternative approach can be problematic in the scenario when a cluster node, e.g. node C 203 is dead or become unavailable. Since the delivery of the message, “x=2”, to the cluster node C 203 may not go through, the value of x on node C may remain to be 1 without notice.
Thus, using the alternative approach, the distributed data grid 200 may not be able to maintain a consistent view that the value of x equals to 2. This alternative approach can cause inconsistency, in terms of determining the value of x at a later time point, among the different cluster nodes A-D 201-204 in the distributed data grid 200.
Furthermore, such inconsistency may not be resolved until a full synchronization is performed in the distributed data grid 200. The full synchronization in the distributed data grid 200 can be costly, since it may require the distributed data grid 200 to stop providing services.
Additionally, the guaranteed multi-point message delivery feature can be used complimentarily with a partition versioning feature supported in the distributed data grid 200. For example, when a new node E 205 is added into the distributed data grid 200, the distributed data grid 200 can bring the state of the newly added node E 205 current, based on the partition versioning feature, so that the node E 205 can start receive new messages based on the guaranteed multi-point message delivery feature, as described above.
Additional descriptions of various embodiments of using partition versioning feature in a distributed data grid 200 are provided in U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR PROVIDING PARTITION PERSISTENT STATE CONSISTENCY IN A DISTRIBUTED DATA GRID”, filed ______, which application is herein incorporated by reference.
Furthermore, the guaranteed multi-point message delivery feature can be used complimentarily with a poll model that is supported in the distributed data grid 200 for processing incoming messages asynchronizingly.
Additional descriptions of various embodiments of supporting asynchronized message processing in a distributed data grid 200 are provided in U.S. patent application Ser. No. ______, entitled “SYSTEM AND METHOD FOR SUPPORTING ASYNCHRONIZED MESSAGE PROCESSING IN A DISTRIBUTED DATA GRID”, filed ______, which application is herein incorporated by reference.
The chain request message 320 can be either initiated by the cluster node A 301, or be created based on an incoming message 310 received by the cluster node A 301. The chain request message 320 can include an internal data structure 321 that stores the information about a list of recipient nodes that the chain request message 320 will be delivered to.
As shown in
A messaging facility 412 in the cluster node B 402 can track the delivery of the chain request message 420 to the rest of the recipient nodes in the list 421. For example, when the cluster node B 402 detects that node C 403 is dead or is unavailable, the cluster node B 402 can access the internal data structure 421 for the list of recipient nodes and find out that node D 204 is the next node following node C 203. Therefore, the cluster node B 402 can deliver the chain request message 420 to node D 404 accordingly.
Initially, a partition can define that the value of a property x is equal to 1 (“x=1”). The partition can be maintained on the primary owner node A 501 and each backup node B-D 502-504. Then, the node A 501 can receive a message from the client 510, which changes the value of the property x to 2 (“x=2”). Thus, the messaging facility 511 in the cluster node A 501 can propagate the message, “x=2”, to each backup node B-D 202-204.
As shown in
When the message, “x=2”, has already been delivered to the cluster node B 502, the distributed data grid 500 can guarantee that the message is delivered to the rest of nodes C-D 503-504, and can ensure a consistent view that the value of x is equal to 2. On the other hand when the message, “x=2”, is undelivered before the primary owner node A 501 becomes unavailable, the distributed data grid 500 maintains the consistent view that the value of x is equal to 1. Thus, the distributed data grid 500 can ensure a consistent view of the value of x client 510 in either case.
Then, the distributed data grid 500 can provide a new primary owner node, e.g. cluster node E 505, which can continue maintaining the partition and handle subsequent incoming messages from the client 510.
Alternatively, the cluster node A 501 can deliver the message, “x=2”, to each recipient node B-D 502-504 separately, or in parallel (as shown in dotted line in
The present invention may be conveniently implemented using one or more conventional general purpose or specialized digital computer, computing device, machine, or microprocessor, including one or more processors, memory and/or computer readable storage media programmed according to the teachings of the present disclosure. Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art.
In some embodiments, the present invention includes a computer program product which is a storage medium or computer readable medium (media) having instructions stored thereon/in which can be used to program a computer to perform any of the processes of the present invention. The storage medium can include, but is not limited to, any type of disk including floppy disks, optical discs, DVD, CD-ROMs, microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.
The foregoing description of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations will be apparent to the practitioner skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention for various embodiments and with various modifications that are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalence.
This application claims priority on U.S. Provisional Patent Application No. 61/714,100, entitled “SYSTEM AND METHOD FOR SUPPORTING A DISTRIBUTED DATA GRID IN A MIDDLEWARE ENVIRONMENT,” by inventors Robert H. Lee, Gene Gleyzer, Charlie Helin, Mark Falco, Ballav Bihani and Jason Howes, filed Oct. 15, 2012, which application is herein incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| 61714100 | Oct 2012 | US |
