This invention generally relates to optimizing distribution of resources and more particularly, to a method and systems for optimizing the resource allocation through bookmark based allocation from parent to child nodes.
Allocation of resources in a hierarchical system may be accomplished through the use of parent nodes, each of which is coupled to a plurality of child nodes. An example of a hierarchical system is a network that distributes bandwidth resources according to the needs of child nodes through a parent node. With the widespread use of network based applications and the advent of the need to transmit larger amounts of data in different formats such as HTTP for web data and VOIP for audio data, concerns have been raised with unbalanced allocation of resources by parent nodes to child nodes in network allocation of bandwidth resources. Such unbalanced allocations occur when the greater need for certain child nodes results in the denial of resources to other child nodes by the parent node.
In a system such as a network LAN, an appliance that receives traffic from a WAN such as the Internet may be required to distribute limited resources to a variety of different application protocols. The total available resources may be viewed as a parent node. Each of the different application protocols, in the role of child nodes, are coupled to the parent node. Requests received from the child nodes are allocated resources as resources are available to both the children individually, and to the parent node as a system. In a typical system, children do not negotiate with other children to maintain fairness between different applications. The crowding out of resources decreases the service provided by the child nodes that have lower frequencies of resource requests.
One example of a network based appliance that allocates resources is an Internet traffic management device. The Internet traffic management device may be viewed a parent node and may be structured so that child nodes use Internet traffic resources for HTTP services, VOIP services, and CMB/CFIS services. In such a system, the traffic management device has a limited number of tokens representing bandwidth that is allocated to each of the child nodes according to requests during a resource allocation phase. The more resource intensive child nodes such as a VOIP server often crowd out the other child nodes resulting in poor or no service for the other child nodes.
According to one example, a method is disclosed for a method for allocation of resources between child nodes from a parent node having a limited number of resources available in a resource allocation phrase. The parent node has a limited number of resources available in a resource allocation phrase. The limited number of resources are allocated according to requests from the child nodes in the resource allocation phase. It is determined whether at least one of the child nodes has a request not met by the allocated resources. A bookmark associated with the child node is set for the additional required resources. Additional resources are allocated to the child node according to the bookmark in a subsequent resource allocation phase.
Another example is a machine readable medium having stored thereon instructions for resource allocation in a system having a parent node and a parent node. The stored instructions include machine executable code, which when executed by at least one machine processor, causes the machine to allocate the limited number of resources according to requests from the child nodes in the resource allocation phase. The stored instructions cause the machine to determine whether at least one of the child nodes has a request not met by the allocated resources. The stored instructions cause the machine to set a bookmark associated with the child node for the additional required resources and allocate additional resources to the child node according to the bookmark in a subsequent resource allocation phase.
Another example is a system for efficient allocation of network resources. The system includes a parent node having a limited number of allocated resources. A plurality of child nodes each have a settable bookmark. A source provides resources to the parent node in a resource allocation phase. A network traffic allocation module is interposed between the source and the parent node. The network traffic allocation module allocates the limited number of resources according to requests from the child nodes in the resource allocation phase. The network traffic allocation module determines whether at least one of the child nodes has a request not met by the allocated resources. The bookmark associated with the child node for the additional required resources is set. Additional resources are allocated to the child node according to the bookmark in a subsequent resource allocation phase.
Another example is a traffic management device parent node for interposition between a network and a plurality of child node servers each in communication with the traffic management device parent node for network resources. The traffic management device parent node includes a network interface that receives bandwidth resources from the network and a child interface coupled to the child nodes. A resource allocation module distributes network resources to the plurality of child nodes during allocation phases. The resource allocation module allocates the bandwidth resources according to requests from the child node servers in a resource allocation phase. The module determines whether at least one of the child nodes has a request not met by the allocated resources, reads a bookmark set by the child node for the additional required resources, and allocates additional resources to the child node according to the bookmark in a subsequent resource allocation phase.
Additional aspects will be apparent to those of ordinary skill in the art in view of the detailed description of various embodiments, which is made with reference to the drawings, a brief description of which is provided below.
While these examples are susceptible of embodiment in many different forms, there is shown in the drawings and will herein be described in detail preferred examples with the understanding that the present disclosure is to be considered as an exemplification and is not intended to limit the broad aspect to the embodiments illustrated.
Currently, the ability to guarantee minimal levels of service among resource competitive child nodes from limited resources provided from a parent node is impeded by the crowding out of lower resource child nodes by resource intensive child nodes. The result is that the lower resource child nodes are denied resources from the parent node resulting in a decline in service.
In the next resource allocation phase, as shown in
As shown above, by using the bookmark scheme in
The allocation of resources according to the bookmarks may be made according to a scheme such as by equal distribution between the child nodes. Alternatively, the allocation may be made according to the importance of the child nodes. As shown in the above example, the child node 106 was prioritized in importance and therefore received proportionally more resources from the parent node 102 during the resource allocation phase. Another scheme may include weighting according to the relative proportion of needed resources for each child node. Intelligent prioritization may therefore be made via the allocation scheme dictating resource allocation by the parent node to the child nodes.
One example of resources may be the allocation of tokens representing network traffic resources on a reliable delivery communication standard such as a Transmission Control Protocol/Internet Protocol (TCP/IP) based network. The allocation of tokens for necessary bandwidth to perform operations may be requested by each child node to the parent node. In this example, the parent node may be a network traffic device that has a limited number of tokens representing bandwidth of a WAN during each predetermined time period. Another example may be for a network based on an unreliable delivery communication standard such as User Datagram Protocol/Internet Protocol (UDP/IP).
In such an example, each child node may request bandwidth for a different IP-based protocol application such as SMTP for e-mail, HTTP/SSL for Internet applications, SOAP for Internet applications, and VOIP for voice. The methods described herein provide optimal bandwidth utilization in conjunction with other traffic management functions.
In this example, the traffic management device 210 may be the WANJET® traffic management appliance available from F5 Networks, Inc. of Seattle, Wash., although other traffic management devices could be used. Alternatively, the resource allocation methods and systems described herein may be used in other devices with network traffic management functionality such as the BIG-IP® products available from F5 Networks, Inc. of Seattle, Wash. As will be explained below, the resource allocation methods and systems described herein may also be used entirely internally or partly internally on a device such as a server or a client computer. The methods and system below may also be used with traffic management devices on other types of networks. Additionally, any other system or device which is required to distribute resources in a hierarchical manner may use this algorithm. Examples of such systems may include, but are not limited to, memory allocation systems, storage allocation systems, processor based resource allocation systems such as single or multi-core systems.
The traffic management device 210 may provide a connection to a wide area network (WAN) 220 and manages traffic to and from the wide area network 220. The wide area network 220 may include any publicly accessible network environment, such as the Internet, which includes network components, such as public servers that are not directly managed or under direct control by the traffic management device 210, yet whose operation may still be influenced in unique, novel and unexpected ways in response to TCP/IP protocol directives strategically purposefully determined and sent from the traffic management device 210 to make the private network 208, and perhaps the wide area network 220, operate more efficiently, as will be described in greater detail herein. It should be noted, however, that the ensuing descriptions of the various functionalities relating to the private servers 202, 204 and 206 are generally applicable to the network devices coupled to the wide area network 220, and thus the remaining description will simply refer to either one as servers 202, 204 and 206 unless noted otherwise.
In this example, the private network 208 may be a local area network (LAN) environment employing any suitable interface mechanisms and communications technologies including, for example telecommunications in any suitable form (e.g., voice, modem, and the like), Public Switched Telephone Network (PSTNs), Ethernet based Packet Data Networks (PDNs), combinations thereof, and the like. Moreover, private network 208 may be made up of one or more interconnected LANs located in substantially the same geographic location or geographically separated, although the network 208 may include other types of networks arranged in other configurations. Moreover, the private network 208 may include one or more additional intermediary and/or network infrastructure devices in communication with each other via one or more wired and/or wireless network links, such as switches, routers, modems, or gateways (not shown), and the like, as well as other types of network devices including network storage devices.
The traffic management device 210 may be interposed between the servers 202, 204 and 206 and the wide area network 220 as shown in
From the perspective of the clients of the wide area network 220, they have directly established a connection in the usual way to the appropriate servers 202, 204 and 206 and respective server applications. The existence of a proxy connection may be entirely transparent to a requesting client computer. The implementation of such a proxy may be performed with known address spoofing techniques to assure transparency, although other methods could be used. The traffic management device 210 may provide high availability of IP applications/services running across multiple servers such as the servers 202, 204 and 206. The traffic management device 210 may act as a parent node to distribute requests from the client computers coupled to the wide area network 220 according to business policies, data center conditions and network conditions to ensure availability of the applications running on the servers 202, 204 and 206 in accordance with the resource allocation scheme described above in
For example, the traffic management device 210 acting as a parent node may allocate network bandwidth resources to the servers 202, 204 and 206 according to requests from the servers 202, 204 and 206. In this example, the server 206 may make a request for bandwidth resources for a VOIP application. If the server 202 also makes a request for bandwidth resources for an e-mail application, the respective servers 202 and 206 may set bookmarks indicating the need for resources. The traffic management device 210 may allocate the network bandwidth resources according to a predetermined allocation scheme. In this example, the administrator of the system 200 may give priority to the e-mail traffic and therefore the traffic management device 210 may allocate necessary bandwidth resources to the server 202. In this example, the request for bandwidth resources for the VOIP application by the server 206 may not be sufficient. The server 206 would thus set a bookmark and the traffic management device 210 acting as a parent node would allocate additional bandwidth resources in a future resource allocation phase. This may insure that bandwidth resources are equitably allocated among requesting child nodes such as the servers 202, 204 and 206 and in this example insure a certain level of application service.
A traffic management OS 310 may be stored on the memory 302 and may be run by the controller 300. The traffic management OS 310 may have a modular structure with different modules 312 to perform various network traffic management functions. In this example, the modules 312 of the traffic management OS 310 may include a resource allocation module 314 embodying the principles discussed with reference to
The traffic management OS 310 features architectural elements of a proxy approach, high-speed performance, modular functionality. The traffic management OS 310 in this example may be customized to the needs of a particular network. An example of the traffic management OS 310 may be the TMOS® platform available from F5 Networks, Inc. of Seattle, Wash., although other traffic management applications could be used. The traffic management OS 310 may provide functions such as performance, security, availability and management. The traffic management OS 310 may provide shared application services such as iRules, rate shaping, resource cloaking, transaction assurance, universal persistence, caching, compression, encryption, authentication, application health monitors and application switching that are run by the application modules 312. The traffic management OS 310 may also provide shared network services including TCP express, protocol sanitization, high performance SSL, DoS and DDos protection, VLAN segmentation, line rate switching, IP packet filtering, dynamic routing, secure network address translation, port mapping and common management framework.
Each of the client computers, servers, and the traffic management device 210 described above may include a central processing unit (CPU), controller or processor, a memory, and an interface system which are coupled together by a bus or other link, although other numbers and types of each of the components and other configurations and locations for the components can be used. The processor in the traffic management device 210 may execute a program of stored instructions for one or more aspects of the methods and systems as described herein, including for increasing data transmission efficiency, although the processor could execute other types of programmed instructions. The memory may store these programmed instructions for one or more aspects of the methods and systems as described herein, including the method for increasing the transmission efficiency, although some or all of the programmed instructions could be stored and/or executed elsewhere. A variety of different types of memory storage devices, such as a random access memory (RAM) or a read only memory (ROM) in the system or a floppy disk, hard disk, CD ROM, DVD ROM, or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor, may be used for the memory. The user input device may comprise a computer keyboard and a computer mouse, although other types and numbers of user input devices may be used. The display may comprise a computer display screen, such as a CRT or LCD screen by way of example only, although other types and numbers of displays could be used.
Although an example of the traffic management device 210 are described and illustrated herein in connection with
Furthermore, each of the systems of the system 200 may be conveniently implemented using one or more general purpose computer systems, microprocessors, digital signal processors, micro-controllers, application specific integrated circuits (ASIC), programmable logic devices (PLD), field programmable logic devices (FPLD), field programmable gate arrays (FPGA) and the like, programmed according to the teachings as described and illustrated herein, as will be appreciated by those skilled in the computer, software and networking arts.
In addition, two or more computing systems or devices may be substituted for any one of the systems in the system 200. Accordingly, principles and advantages of distributed processing, such as redundancy, replication, and the like, also can be implemented, as desired, to increase the robustness and performance of the devices and systems of the system 200. The system 200 may also be implemented on a computer system or systems that extend across any network environment using any suitable interface mechanisms and communications technologies including, for example telecommunications in any suitable form (e.g., voice, modem, and the like), Public Switched Telephone Network (PSTNs), Packet Data Networks (PDNs), the Internet, intranets, a combination thereof, and the like.
The operation of the example resource allocation module 314, shown in
After resources from the resource allocation phase are allocated to the child node 104, the child node 104 may decrement the counter 124 by the resources that were allocated. The child node 104 then determines whether sufficient resources were allocated by determining whether the counter is at zero indicating that insufficient resources were allocated (408). If there were sufficient resources indicating the child node 104 could complete the task, the child node 104 may clear the bookmark 114 (410). If there are insufficient resources (408), the child node 104 may calculate the shortage in resources (412). The required resources determined by this calculation may be used to set the bookmark 114 for the next resource allocation phase (414). The algorithm then cycles back to determine the need for resources in the next resource allocation phase (400).
Having thus described the basic concepts, it will be rather apparent to those skilled in the art that the foregoing detailed disclosure is intended to be presented by way of example only, and is not limiting. Various alterations, improvements, and modifications will occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested hereby, and are within the spirit and scope of the examples. Additionally, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes to any order except as may be specified in the claims. Accordingly, the invention is limited only by the following claims and equivalents thereto.
This is a continuation application from U.S. Ser. No. 12/143,411 filed Jun. 20, 2008 to the same inventor. That application is hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5761534 | Lundberg et al. | Jun 1998 | A |
5828835 | Isfeld et al. | Oct 1998 | A |
5941988 | Bhagwat et al. | Aug 1999 | A |
6026443 | Oskouy et al. | Feb 2000 | A |
6115802 | Tock et al. | Sep 2000 | A |
6529508 | Li et al. | Mar 2003 | B1 |
6700871 | Harper et al. | Mar 2004 | B1 |
6748457 | Fallon et al. | Jun 2004 | B2 |
6781990 | Puri et al. | Aug 2004 | B1 |
6820133 | Grove et al. | Nov 2004 | B1 |
7065630 | Ledebohm et al. | Jun 2006 | B1 |
7107348 | Shimada et al. | Sep 2006 | B2 |
7142540 | Hendel et al. | Nov 2006 | B2 |
7236491 | Tsao et al. | Jun 2007 | B2 |
7281030 | Davis | Oct 2007 | B1 |
7324525 | Fuhs et al. | Jan 2008 | B2 |
7355977 | Li | Apr 2008 | B1 |
7376772 | Fallon | May 2008 | B2 |
7403542 | Thompson | Jul 2008 | B1 |
7420931 | Nanda et al. | Sep 2008 | B2 |
7478186 | Onufryk et al. | Jan 2009 | B1 |
7496695 | Go et al. | Feb 2009 | B2 |
7500028 | Yamagishi | Mar 2009 | B2 |
7512721 | Olson | Mar 2009 | B1 |
7533197 | Leonard et al. | May 2009 | B2 |
7558910 | Alverson et al. | Jul 2009 | B2 |
7571299 | Loeb | Aug 2009 | B2 |
7647416 | Chiang et al. | Jan 2010 | B2 |
7657659 | Lambeth et al. | Feb 2010 | B1 |
7668727 | Mitchell et al. | Feb 2010 | B2 |
7668851 | Triplett | Feb 2010 | B2 |
7729239 | Aronov et al. | Jun 2010 | B1 |
7735099 | Micalizzi, Jr. | Jun 2010 | B1 |
7742412 | Medina | Jun 2010 | B1 |
7784093 | Deng et al. | Aug 2010 | B2 |
7826487 | Mukerji et al. | Nov 2010 | B1 |
7877524 | Annem et al. | Jan 2011 | B1 |
7916728 | Mimms | Mar 2011 | B1 |
8006016 | Muller et al. | Aug 2011 | B2 |
8103809 | Michels et al. | Jan 2012 | B1 |
8112491 | Michels et al. | Feb 2012 | B1 |
20030067930 | Salapura et al. | Apr 2003 | A1 |
20030204636 | Greenblat et al. | Oct 2003 | A1 |
20040202161 | Stachura et al. | Oct 2004 | A1 |
20040249948 | Sethi et al. | Dec 2004 | A1 |
20040267897 | Hill et al. | Dec 2004 | A1 |
20050007991 | Ton et al. | Jan 2005 | A1 |
20050083952 | Swain | Apr 2005 | A1 |
20050114559 | Miller | May 2005 | A1 |
20050175014 | Patrick | Aug 2005 | A1 |
20060007928 | Sangillo | Jan 2006 | A1 |
20060104303 | Makineni et al. | May 2006 | A1 |
20060221832 | Muller et al. | Oct 2006 | A1 |
20060221835 | Sweeney | Oct 2006 | A1 |
20060235996 | Wolde et al. | Oct 2006 | A1 |
20060288128 | Moskalev et al. | Dec 2006 | A1 |
20080126509 | Subramanian et al. | May 2008 | A1 |
20080184248 | Barua et al. | Jul 2008 | A1 |
20090003204 | Okholm et al. | Jan 2009 | A1 |
20090016217 | Kashyap | Jan 2009 | A1 |
20090222598 | Hayden | Sep 2009 | A1 |
20090248911 | Conroy et al. | Oct 2009 | A1 |
20100082849 | Millet et al. | Apr 2010 | A1 |
20100094945 | Chan et al. | Apr 2010 | A1 |
Number | Date | Country |
---|---|---|
1813084 | Aug 2007 | EP |
WO 2006055494 | May 2006 | WO |
Number | Date | Country | |
---|---|---|---|
Parent | 12143411 | Jun 2008 | US |
Child | 12174262 | US |