Patent Grant
7619761
Nowadays, the Internet is widely used to transfer applications to users through browsers. The Internet also is used for e-commerce in which individual customers and businesses use the Web to purchase various goods and services. In fact, some companies offer goods and services solely on the Web while others use the Web to extend their reach.
With respect to these commercial activities and others, businesses and content providers employ servers to process requests from different users. Various architectures are employed in handling these requests. Often, distributed architectures in which a set of servers in a cluster (“server farm”) are used to handle requests. In such a server farm architecture, the set of servers appears to a user as a single server. A load-balancing mechanism may be used to determine which server within the server farm will be used to handle various requests directed to the server farm.
Configuring and maintaining the various servers within a server farm has historically been a challenge. This challenge is exacerbated as the number of servers employed in a given server farm increases in number and as more features, implemented for the applications running on the server farm, are added to the server farm as customized operations (“jobs”). For example, administrators of a server farm often want to run timed jobs on servers in the server farm. Such a job may be a one-time job that only runs once by any of the servers in the server farm. Such a job can also be a recurring job that executed at a definable interval, during a certain time period in the hour, day, week, month, or year. Usually, such jobs may be defined by developers enhancing applications running on the server farm, and submitted to the server farm by authorized personnel (“administrator”) of the server farm. Therefore, it is desirable to provide a system and method that can easily integrate jobs submitted by administrators into the server farm. It is also desirable that the jobs can be automatically deployed to proper servers in the server farm and executed in a consistent manner.
The invention addresses the above-identified needs by providing a system and a method for centrally storing in a server farm job definitions submitted by administrators of the server farm, automatically distributing the job definitions to servers in the server farm, and consistently executing jobs defined by the job definitions on suitable servers in the server farm.
One aspect of the invention provides a configuration database that stores all job definitions submitted to the server farm by administrators of the server farm. The submitted job definitions may extend a configuration object model that enables the job definitions to be integrated into the configuration database without the administrators understanding or modifying the underlying schema of the configuration database. Preferably, an interface such as a command-line interface or a graphic user interface can be used to view and/or modify any job definition existing in the configuration database. The interface may exist on a system outside the server farm.
According to another aspect of the invention, each job definition also extends a job definition object model. The job definition object model includes multiple properties used to define a job. Such properties may be used to identify, for example, the job, handler to the assembly file containing implementation code for the job, handler to the class that defines the job. Such properties may also be used to identify a server on which the job runs, the service that the job is associated with, and whether the job can be re-executed if the execution of the job fails for various reasons. Such properties may be used to identify whether the job runs on exactly one of the servers or runs on all servers. Such properties may also be used to determine whether no locking is needed, job level locking is needed, or database level locking is needed. Such properties may be used to identify running schedule for the job, when the job is lastly run, whether the job is exclusive, or next job in line if the job is in a job sequence. The job definition object model may also include multiple functions such as a function to update the status of the job, to delete the job definition, or to start executing the job.
In addition, the configuration database may also include multiple running job objects for jobs that are currently running on servers in the server farm. Each running timer object may extend a running job object model. The running job object model may include multiple properties such as properties for identifying when a running job starts executing, the job definition that the running job is associated with, the current status of the running job, the percentage of work the running job has completed. The properties may also be used to identify the server(s) that the job is currently running on, the service that the running job is associated with, etc. The running job object model may also include multiple functions such as a function to stop execution of the job and a function to update status or progress of the job.
The configuration database may further include multiple service objects. Each service object includes a property identifying a collection of job definitions that are available on the server in which a service exists. A service object may also include a property indicating a collection of running job objects for jobs that are currently running on the server in which a service exists.
In accordance with yet another aspect of the invention, each server in the server farm operates a timer service. The timer service queries the configuration database periodically to retrieve any change in the configuration database, including any new or modified job definitions. The timer service downloads such change to the server. The timer service then identifies any job definitions that are suitable to be executed on the server. Preferably, the timer service may first query and search for new or modified job definitions that are suitable to be run on the server and then downloading them to the server. For each of such job definitions, the timer service executes the job defined by the job definition at the time specified by the job definition. A job may run only once or with recurrence.
In accordance with a further aspect of the invention, if a job contains functions that modify the local server system, the timer service transfers the execution of the job to an admin service that has local admin privilege. The admin service only executes the functions in the job that require the local admin privilege.
Another aspect of the invention uses a lock to distribute execution of a job among different servers in the server farm. For example, a first timer service executing a job first locks the corresponding job definition in the configuration database. A second timer service running on another server can execute the job only if the lock has been released by the first timer service or the first timer service's holding of the lock seems to be unreasonably long. For jobs that require database locking, multiple such jobs share a database lock, and a server that has a database lock will execute all such jobs to run against that database. The locking scheme also supports failover, such that each server refreshing its locks at a predetermined interval, and when a server goes down, once its lock expires, another server will acquire that lock and execute all jobs that utilize that lock. In accordance with yet another aspect of the invention, multiple jobs can be arranged into a job sequence. Only after a job in the job sequence has been completed, will the next job in the job sequence start to execute.
In summary, the invention provides a system and method that allows administrators to submit job definitions for a server farm to a configuration database in the server farm. The invention also enables jobs defined by the job definitions to be automatically distributed and executed among different servers in the server farm according to the job definitions. As a result, services provided by a server farm can be expanded by job definitions containing jobs that the server farm is capable of automatically distributing and executing.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as the preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
As shown in
In the depicted example, the network 100 of data processing systems is the Internet, where the network 102 represents a worldwide collection of networks and gateways that use a TCP/IP suite of protocols to communicate with one another. At the heart of the Internet is a backbone of high-speed data communication lines between major nodes or host computers. These nodes or host computers include thousands of commercial, government, educational, and other computer systems that route data and messages. The network 100 of data processing systems may also be implemented as a number of different types of networks, such as, for example, an intranet, a local area net (LAN), or a wide area network (WAN).
The server farm 104 may include a load manager 214 that is connected to the communication system 212 and that serves to receive requests directed to the server farm 104 from the network 102. The requests may include requests received from clients 108-112 (
In embodiments of the invention, the server farm 104 includes a configuration database 218 that stores all the configuration data for the server farm 104. In embodiments of the invention, the configuration database 218 is the master copy of all configuration data in the server farm 104, thus enables the same information to be available across a set of servers in the server farm 104. The configuration database 218 is operatively connected to the communication system 212 to allow configuration data to be sent to each of the servers 202a-202c in the server farm 104. The configuration database 218 may be used to manage configuration settings of each of the servers 202a-202c. The configuration database 218, therefore, acts as a central repository for any configuration settings that must be changed and/or added to the various servers 202a-202c of the server farm 104. Providing the configuration database 218 eliminates the necessity of having to manually update and/or add configuration settings of the servers 202a-202c. Besides storing information about a server topology, the configuration database 218 may also store application-specific settings such as security policies, antivirus definitions, language settings, etc.
In embodiments of the invention, the configuration database also stores one or more job definitions submitted by administrators of the server farm 104; each job definition contains a job that is to be run on one or more servers in the server farm 104. A job includes code that can instruct a server to provide specific content or services. In embodiments of the invention, a job definition is a logical object that includes multiple properties defining a job and multiple functions operating the job.
The server farm 104 may also include at least one content database 220. Similar to the other operational elements of the server farm 104, the content database 220 is operationally connected to the communication system 212 in order to allow information stored within the content database 220 to be distributed to the various components of the server farm 104. In exemplary embodiments of the invention, the content database 220 contains data for the servers in the server farm 104. Such data include documents, data items, discussions, tasks, etc. The content database 220 operates in conjunction with the configuration database 218 to provide content specifically related to a given configuration change of one or more of the servers 202a-202c. In exemplary embodiments of the invention, the content database 220 does not interface with the configuration database 218. The configuration database 218 contains a map of which content database stores data for a server. As a result, it is not necessary to query each content database 220 in the server farm 104 to see if the content database contains the content for a particular server in the server farm 104. The cluster of servers mapped to a content database is called a virtual server for the content database.
In exemplary embodiments of the invention, the server farm 104 is arbitrarily extensible. This includes that the server farm 104 can be arbitrarily extended with multiple servers other than the servers 202a-202c. In addition, the server farm 104 may include multiple content databases 220 to store data for the multiple servers in the server farm 104.
In particular, exemplary embodiments of the invention allow a developer to extend services provided by the server farm 104 by defining jobs accordingly to the developer's preferences and adding the resultant job definitions such as new job definitions 301 to the configuration database 218. Preferably, as shown in
Embodiments of the invention also provide an interface such as the central admin UI 304 that allows an administrator of the server farm 104 to view and/or modify any existing job definitions stored in the configuration database 218. The central admin UI 304 can be a command-line interface or a graphic user interface. The central admin UI 304 can be run from any server in the server farm 104. The central admin UI 304 can also run on a system outside the server farm 104 and communicate with the server farm 104 through the network 102.
Embodiments of the invention enable automatic distribution and execution of a job defined by a given job definition on one or more proper servers in the server farm 104. Embodiments of the invention provide a pull-based mechanism for querying and retrieving job definitions from the configuration database 218 to a server in the server farm 104. Using such a pull-based mechanism avoids the need to open an additional TCP/IP port on a server such as the server 202a in order to communicate with the configuration database 218. By not requiring an additional open port, less risk is resulted on the server by not exposing a potential entryway for hackers, viruses, or other forms of attack.
In exemplary embodiments of the invention, such a pull-based mechanism is realized by a timer service running on each server in the server farm 104. Preferably, the server may not contain a database. In embodiments of the invention, the timer service queries the configuration database 218 to identify new job definitions that are submitted to the configuration database 218 since the last query.
In exemplary embodiments of the invention, the timer service 402 has rights to modify the content database 220 and the configuration database 218, but does not have permissions on the server 202a to do operations such as modifying files. For high privileged operations like resetting a password for an application on the server 202a, the job containing such operations needs to have high privileges such as a local admin privilege on the server 202a. To allow such operations to be executed, in an exemplary embodiment of the invention, the timer service 402 use a remote procedure call to roll the execution of the job over to a separate service on the server 202a, the admin service 404. The admin service 404 runs with high privileges such as a local admin privilege. In exemplary embodiments of the invention, the admin service 404 is only engaged to execute functions in a job that modify entities or services on the server 202a. The segmentation between the timer service 402 and the admin service 404 ensures that the timer service 402 does not receive more security privileges than necessary.
In embodiments of the invention, job definitions in the configuration database 218 also extend a job definition object model. The configuration database 218 also includes running job objects for jobs that are currently running on the servers of the server farm 104; each running job object extends a running job object model. The configuration database 218 further includes a service object for each service in the server farm 104, including the timer service such as the timer service 402.
In embodiments of the invention, the job definition object model 502 includes properties that define a job, which can be a recurring job, a scheduled one-time job, or an immediate job. If a one-time job has been instanced, a corresponding running job object exists in the configuration database 218.
The job definition object model 502 may also include a TargetType property 512 for identifying target of the job. In embodiments of the invention, the TargetType property 512 of a job may have an enumeration value of NULL, which indicates that the job should not be targeted at anything in particular. If the TargetType property 512 has an enumeration value of “single,” it indicates that the job should be run on exactly one of the servers in the server farm 104. If the TargetType property 512 has an enumeration value of “ContentDatabase,” it indicates that the job should be run on a specific server that is mapped to a specific content database in the server farm 104. As noted above, when describing the content database 220, one server in the server farm 104 may be associated, i.e., targeted at one or more content databases in the server farm 104.
The job definition object model 502 also includes an IsDisabled property 514 such that if the property is set, the job will not be executed but will remain in the configuration database. The Service property 516 may be used to identify service type for the job. If the value of the Service property 516 is the timer service itself, the job will run on all servers in the server farm 104. If the value is set to a particular service, the job will run only on servers that have this service. Similarly, the Server property 518 identifies a specific server. If the value of the Server property 518 is NULL, the job will run on all servers in the server farm 104. Otherwise, the job will only run on the server that has the value specified by the Server property 518.
The job definition object model 502 includes a Schedule property 520, whose value identifies the running schedule of the job. The LastRuntime property 522 specifies the last time that the job was run. If the job has never been run before, the value of the LastRuntime property 522 is set to be an arbitrary unrealistic value, such as a date in the past. The IsExclusive property 524 indicates whether the job should run by itself on a given server in the server farm 104. The Retry property 526 is used to indicate whether the job can be re-executed if an execution of the job fails for various reasons.
Some embodiments of the invention enable an administrator to schedule multiple jobs into a job sequence. The job sequence contains a plurality of jobs that need to be executed in sequence. A job in the job sequence needs to complete on all the targets it is scheduled to run, before the next job in the job sequence can run. In a job sequence, the first job determines when the job sequence will start. After the first job completes, each job in the sequence is queued up as soon as the previous job completes, until the final job is serviced. Consequently, the job definition object model 502 may include a NextJob property 527, whose value returns the job definition of the next job in the job sequence that the job is in. This property is set to be NULL if the job is not in a job sequence.
The job definition object model 502 may also include exemplary functions such as an Update( ) function 528 that updates the state of a job definition. The job definition object model 502 may further include an Execute( ) function 529. This function contains the specific operations offered by the job. The job definition object model 502 may also include a Delete( ) function 530 that removes the job definition from a list of available job definitions. The job definition object model 502 may further include a Start( ) function 531 that creates a new job instance using a job definition. This function may be used by an administrator of the server farm 104 to start a job immediately. The job definition object model 502 may also include an UpdateProgress( ) function 546 that updates the progress of an instance of the job. A running job object represents a running instance of a job and has read-only properties. The running job object model 504 contains exemplary properties and functions that are used to get information about a job that is in execution. For example, the running job object model 504 includes a StartTime property 532 for identifying the time at which the running job is started. The Status property 534 is used to indicate the current status of a running job. In an exemplary embodiment of the invention, the value of the Status property 534 may indicate that the running job has been initialized, that the running job has completed successfully, that the running job has failed because of an internal error, that the running job has stopped while the timer service is attempting to re-execute the job, or that the running job has been aborted upon receiving a request from an administrator, or that it is being re-executed. The PercentageDone property 536 may be used for indicating what percentage of the running job has been completed. The ServerName property 538 may be used to identify the server that the job is running on. The ServiceId property 540 is used to identify the service object that the job is contained within. The JobDefinition property 544 is used to identify the job definition that defines the running job.
The job definition object model 504 may contain one or more functions, such as a StopExecution( ) function 548 that stops the running of the job.
As shown in
As noted above,
As shown in
Meanwhile, the timer service checks to determine if it is time to run a job that is already stored on the server. See decision block 708. In embodiments of the invention, the timer service creates an individual thread for running each job. If the answer to decision block 708 is YES, the routine 606 executes a routine 710 where the timer service and/or an admin service such as the admin service 404 (
As noted above,
After acquiring the lock on the job, or if the job being executed does not need a lock, the timer service executes the job. See block 806. As noted above, in embodiments of the invention, the timer service may modify any of the content databases or the configuration database in the server farm, but sometimes not the server on which the timer service runs. Therefore, if the job being executed has operations that modify the server on which the timer service runs, the timer service may transfer executions of such operations to an admin service on the server that has local admin privilege. Therefore, as shown in
While the exemplary embodiments of the present invention have been illustrated and described, it will be appreciated that various changes can be made therein without departing from the spirit and scope of the present invention.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5325527 | Cwikowski et al. | Jun 1994 | A |
| 20080034369 | Polizzi et al. | Feb 2008 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20070005732 A1 | Jan 2007 | US |
