The term upgrading a software application generally refers to the process of replacing an existing version of the software application with a newer version or adding a new version of the software application where none previously existed. A software upgrade may be performed for various reasons such as to add one or more features, remove one or more features, modify one or more features from an existing version of the software, remove bugs or errors, improve the software efficiency, and other reasons. An upgrade is generally performed to enhance the performance of the software application.
Many modern computing environments typically include a framework of multiple software applications, which may be developed by different third-party entities. Each software application may include zero or more plugins. The plugins may include software components that add a new utility/feature or enhance the utilities/features of a software application. The applications may run on or be hosted by multiple host machines (“hosts”) in a distributed environment, with each host potentially hosting multiple applications. Performing an upgrade operation in such a distributed environment comprises multiple upgrade processes executed by multiple hosts such that one or more upgrade processes may be executed to upgrade each application. Many of the upgrade processes may be executed in parallel. Possible dependencies among the upgrade processes further complicate the overall upgrade.
Some conventional upgrade mechanisms include a framework for generating timing reports but the information shown by these reports is very limited. For example, while conventional reports may show the start and end time of an overall upgrade operation that comprises multiple upgrade processes running on multiple host machines and total time of the overall upgrade executing on the multiple host machines, they fail to show useful information such as timing information for each host machine among the multiple host machines. The existing timing report tools are not able to distinguish between the execution time of upgrade processes on a given host, the operational idle time (i.e., idle time) of the host (e.g., when no upgrade processes execute on the host) and the time the host spent on coordinating with peer hosts. In addition, existing timing report tools are not able to report how many times the upgrade processes are re-run.
In some implementations, a reporting tool may use log files generated on the one or more hosts involved in the upgrade operations to generate a timing report. In such an implementation, each host involved in the upgrade operation is forced to store log files storing some timing information associated with that host. Further, all the log file generated by the multiple hosts have to follow the same logging format (e.g., use the same nomenclature to mark the milestones of the upgrade processes running on each host) so that the reporting tool can parse the logs appropriately in order to generate the timing report. A log-based timing report system also is not extensible, for example when a new host is added to the overall upgrade operation. In addition, log files occupy a lot of memory resources and, as a result, some implementations may not archive the log files, or may purge the archived log files due to disk space limitations. In such implementations, the log-based timing report solutions do not work properly. Moreover, when multiple upgrade processes are executed concurrently, a user will have to manually review the log files to find overlapping execution times among hosts. The task becomes even more difficult when the log files do not distinguish between the times when upgrade processes execute on the host and no upgrade processes execute on the host. Additionally, the log files may be stored at multiple locations on multiple hosts and some may not be accessible due to a variety of reasons, such as, security concerns. This prevents a reporting tool from generating a comprehensive image of all the upgrade processes running on multiple hosts as part of the overall upgrade operation.
According to an embodiment of the present invention, an improved upgrade infrastructure is provided for performing software upgrades in such a distributed heterogeneous environment in an automated and efficient manner. The upgrade infrastructure is configured to initiate and manage an overall upgrade operation that is responsible for performing software upgrades across the multiple hosts. In certain embodiments, as part of the overall upgrade operation, multiple upgrade processes are started and executed on the multiple hosts, where an upgrade process executed on a host is configured to upgrade one or more software applications hosted by that host. In certain embodiments, the upgrade infrastructure provides a shared storage area that can be accessed by the various hosts involved in the upgrade process. While performing an upgrade, an upgrade process may, from time to time, write checkpoint data to the shared storage. The checkpoint data is a snapshot of a particular upgrade process at a given time that comprises information indicative of the upgrade status of that particular upgrade process.
In one embodiment, a timing reporting tool may be provided that can communicate with the shared storage and retrieve timing information stored by the upgrade processes. The timing information for an upgrade process may include, among others, execution timing of an upgrade process, status of the upgrade process, number of times the upgrade process was attempted, coordination time with other upgrade processes hosted by peer hosts, etc. The timing information is obtained through the checkpoints generated while the upgrade processes execute on the hosts. Since the checkpoint data is centrally located on the shared storage, the timing reporting tool may access the checkpoint data of all the upgrade processes hosted by multiple hosts.
The timing reporting tool may then generate one or more timing reports based upon the information read from the shared storage locations. The timing reports may be generated by the timing reporting tool at different granularity levels. For example, one report may be generated at the upgrade-process level, another report may be generated at host-level or multiple hosts-level. In certain embodiments, the information may also be consolidated in a single report for the overall upgrade operation that includes upgrade-process level timing information, milestone-level timing information, host-level timing information and/or multiple hosts-level timing information.
In certain embodiments, techniques (including methods, systems, code or software instructions executed by one or more processors) are provided for executing a first upgrade process on a first host machine for upgrading a first software application on the first host machine. A second upgrade process is executed on a second host machine for upgrading a second software application on the second host machine. A shared storage is provided. In certain embodiments, the shared storage may be provided on the first host machine or the second host machine. The first upgrade process stores first data in the shared storage. The first data may be indicative of a status of the first upgrade process. The second upgrade process stores second data in the shared storage. The second data may be indicative of a status of the second upgrade process. A data processing system may read the first data and the second data from the shared storage. The data processing system may generate a report based upon the first data and the second data read from the shared storage. The report may include timing information associated with the execution of the first upgrade process on the first host machine and the execution of the second upgrade process on the second host machine. In some embodiments, the report may be generated during execution of at least the first upgrade process or the second upgrade process. The report may include a number of times the first upgrade process or the second upgrade process re-started executing. The report may be communicated to a user.
The timing report may provide information associated with at least one of the first host machine and the second host machine. The information associated with the first host machine may include one or more of a total execution time of the first host machine, a total idle time of the first host machine and a time that the first host machine spent coordinating with another host machine. Similarly, the information associated with the second host machine may include may include one or more of a total execution time of the first host machine, a total idle time of the first host machine and a time that the first host machine spent coordinating with another host machine.
According to some embodiments, the report may be displayed on a display device while the first upgrade process or the second upgrade process is executing. In such embodiments, the report may be dynamically updated based on additional data generated during execution of the first upgrade process or the second upgrade process. Dynamically updating the report based on additional data further may include the data processing system reading third data written to the shared storage by the first host machine after the report has been generated based upon the first data and the second data, and updating the report communicated to the user based upon the third data. The report may also be modified to incorporate information associated with additional host machine(s), such as a third host machine.
In certain embodiments, techniques (including methods, systems, code or software instructions executed by one or more processors) are provided for receiving, by a timing reporting tool, a request to generate a report for an upgrade operation. The upgrade processes may generate data, such as checkpoint data, at various time points during their execution. The data for each upgrade process may include information indicative of a status of that upgrade process when the data is generated. The upgrade processes may store the generated data in a shared storage. The upgrade operation may include multiple upgrade processes running on multiple host machines. The timing reporting tool may access a shared storage to read data from the shared storage. The timing reporting tool may read the data stored by the multiple upgrade processes from the shared storage. Using the retrieved data, the timing reporting tool may determine information about upgrade processes that have completed execution, upgrade processes that are currently executing, and upgrade processes to be executed. The timing reporting tool may generate the report based upon the data read from the shared storage, the report comprising timing information associated with the execution of the plurality of upgrade processes running on the plurality of host machines. The report may be communicated to one or more users.
These and other embodiments are described in further detail below.
Illustrative embodiments of the present invention are described in detail below with reference to the following drawing figures:
In the following description, for the purposes of explanation, specific details are set forth in order to provide a thorough understanding of embodiments of the invention. However, it will be apparent that some embodiments may be practiced without these specific details. The figures and description are not intended to be restrictive.
Systems depicted in some of the figures may be provided in various configurations. In some embodiments, the systems may be configured as a distributed system where one or more components of the system are distributed across one or more networks.
An improved upgrade infrastructure is provided for performing software upgrades in a distributed heterogeneous computing environment comprising multiple hosts hosting multiple software applications. A host, as used herein, refers to any computing device comprising one or more processors. A host may be configured to host one or more software applications. The configuration (e.g., processing capabilities, memory resource capabilities, networking resource capabilities, operating systems (e.g., Windows, iOS, UNIX, LINUX, etc.) on the hosts, etc.) of a host in the computing environment may be the same as or different from another host in the computing environment. Accordingly, the computing environment in which the software upgrade is to be performed may comprise heterogeneous hosts of different configurations and capabilities.
Various different types of software applications may be hosted by a host or by multiple hosts, such as, without limitation, enterprise applications, resource planning applications, business applications, productivity applications, and the like. The applications hosted by one host may be same as or different from the applications hosted by another host in the computing environment. For example, two hosts may host the same customer relationship management (CRM) application. As another example, a first host may host one or more customer relationship management (CRM) applications while a second host may host one or more supply chain management applications. Further, even for a given software application, different hosts may host different versions of the same application. The software applications hosted by the hosts may be developed by same or different third-party entities.
Due to the heterogeneity of the computing environment, the task of performing software upgrades in such an environment is very complicated. The complexity of performing such a distributed upgrade is impacted and complicated by several factors such as the number of applications that need to be upgraded, the different types of applications, the distributed nature of the applications, potential dependencies between the applications, the number of hosts involved in the upgrade, differences in configurations and/or capabilities of the hosts, potential upgrade dependencies between the upgrade processes that are responsible for upgrading the applications hosted by the same or different hosts, customized upgrade requirements for different applications, and other factors.
According to an embodiment of the present invention, an improved upgrade infrastructure is provided for performing software upgrades in such a distributed heterogeneous environment in an automated and efficient manner. The upgrade infrastructure is configured to initiate and manage an overall upgrade operation that is responsible for performing software upgrades across the multiple hosts. The upgrade infrastructure is configured to initiate and manage an upgrade operation that is responsible for performing software upgrades across the multiple hosts. In certain embodiments, as part of the overall upgrade operation, multiple upgrade processes are started and executed on the multiple hosts, where an upgrade process executed on a host is configured to upgrade one or more software applications hosted by that host. For example, as part of the upgrade, an upgrade process may be configured to replace an existing version of the software application with a newer version or add a new version of the software application where none previously existed. A software upgrade may result in one or more features being added to a software application, one or more features being removed from the software application, one or more features from an existing version of the application being modified, removal of bugs or errors from an application, improvements in the software application performance (e.g., increase in efficiency), and the like.
An upgrade infrastructure, as described herein, enables software upgrades to be performed in a heterogeneous and distributed computing environment in an automated and efficient manner. The upgrade infrastructure enables two or more upgrade processes hosted by the same host or hosted by multiple different hosts to synchronize and coordinate their upgrade activities in an automated manner. In certain embodiments, the upgrade infrastructure provides a shared storage area that can be accessed by the various hosts involved in the upgrade process. While performing an upgrade, an upgrade process may, from time to time, write checkpoint data to the shared storage. The checkpoint data is a snapshot of a particular upgrade process at a given time that comprises information indicative of the upgrade status of that particular upgrade process.
The shared storage discussed above (and below) may be provided in various different ways. In one embodiment, the shared storage may be provided on a central host that is accessible by all upgrade processes executing on all the hosts participating in the overall upgrade. In some embodiments, the shared storage can also be provided on one of the multiple hosts participating in the overall upgrade provided that the shared storage is accessible by all upgrade processes executing on all the hosts.
In one embodiment, a timing reporting tool may be provided that can communicate with the shared storage and retrieve timing information stored by the upgrade processes. The timing information for an upgrade process may include, among others, execution timing of an upgrade process, status of the upgrade process, number of times the upgrade process was attempted, coordination time with other upgrade processes hosted by peer hosts, etc. The timing information is obtained through the checkpoints generated while the upgrade processes execute on the hosts. Since the checkpoint data is centrally located on the shared storage, the timing reporting tool may access the checkpoint data of all the upgrade processes hosted by multiple hosts.
The timing reporting tool may then generate one or more timing reports based upon the information read from the shared storage locations. The timing reports may be generated by the timing reporting tool at different granularity levels. For example, one report may be generated at the upgrade-process level, another report may be generated at host-level or multiple hosts-level. In certain embodiments, the information may also be consolidated in a single report for the overall upgrade operation that includes upgrade-process level timing information, milestone-level timing information, host-level timing information and/or multiple hosts-level timing information.
The timing reporting tool discussed herein may be invoked anytime by, for example, a user. For example, before one or more upgrade processes start execution, while one or more upgrade processes are executing, or after one or more upgrade processes completed execution.
The timing reporting tool may generate reports in various formats, including but not limited to, Extensible Markup Language (XML) reports and HyperText Markup Language (HTML) reports. The generated timing reports may be integrated with any external system via XML streams.
In certain embodiments, one or more hosts may be grouped into a pod. A pod, as used herein, defines a modular set of resources including, for example, a specific set of infrastructure, middleware, and/or application resources.
In the embodiment depicted in
In certain embodiments, the overall upgrade operation may be performed in phases. During each phase, multiple upgrade processes (i.e., tasks) may run on one or more of the hosts 110, 120, 130. The upgrade orchestrator 106 may ensure that a current set of upgrade processes run to successful completion before initiating and proceeding with the next set of upgrade processes. One of ordinary skill in the art will appreciate that the upgrade infrastructure 100 may include any number of components, hosts and upgrade processes. Thus, the upgrade infrastructure 100 is not limited to the components, hosts and upgrade processes illustrated in
As illustrated in
In certain embodiments, each host is configured to execute a upgrade orchestrator module that communicates with upgrade orchestrator 106 and facilitates the upgrade activities performed on that host. For example, as depicted in
The upgrade infrastructure 100 also includes a shared storage 150 accessible by the upgrade processes 112, 114, 122, 124, 132, 134. For example, the shared storage 150 may be provided on a central host that is accessible by the upgrade processes 112, 114, 122, 124, 132, 134. In certain embodiments, the central host may be one of the hosts 110, 120, 130 and accessible by the upgrade processes 112, 114, 122, 124, 132, 134. The upgrade processes 112, 114, 122, 124, 132, 134 be hosted by the hosts 110, 120, 130 may write their checkpoint data to the shared storage 150.
The upgrade infrastructure 100 may also include a timing report generator 170 in communication with the shared storage 150. The timing report generator 170 may use the checkpoint data stored in the shared storage 150 to generate one or more timing reports. The timing report(s) may include timing information such as execution timing of an upgrade process, status of the upgrade process, number of times the upgrade process was attempted, coordination time with other upgrade processes hosted by peer hosts, etc. The timing report generator 170 may communicate the timing reports to the user 102 through the communication network 108. In certain embodiments, the timing report(s) may be displayed on the upgrade console 104. The user 102 may get a complete picture of the overall upgrade operation using the timing reports. The timing reporting tool may be executed by a data processing system. In some embodiments, one of the host machines involved in the overall upgrade operation may be configured to execute the timing reporting tool.
The timing report generator 170 may be invoked before the execution of the upgrade processes 112, 114, 122, 124, 132, 134, during the execution of the upgrade processes 112, 114, 122, 124, 132, 134 (i.e., in real-time) or after the execution of the upgrade processes 112, 114, 122, 124, 132, 134 has completed. In certain embodiments, timing reports generated by timing report tool 170 may be communicated to upgrade console 104 and displayed on the upgrade console 104. The reports may be displayed while the upgrade processes 112, 114, 122, 124, 132, 134 are still executing. The timing report generator 170 may dynamically update a timing report displayed on the upgrade console 104 such that new execution data generated during the execution of the upgrade processes 112, 114, 122, 124, 132, 134 is dynamically incorporated into and displayed with the timing report. In this manner, a timing report is dynamic and may be automatically updated as new timing information relevant to that report is available.
The timing report generator 170 may be a dynamic tool such that when a new host is incorporated into the upgrade infrastructure 100, the timing report generator 170 may modify the timing reports to include timing information for the new host. Similarly, when one or more of the hosts 110, 120, 130 are no longer a part of the upgrade infrastructure 100, the timing report generator 170 may modify the timing reports to remove timing information generated by or associated with the removed host(s).
The timing report generator 170 may generate the timing reports in an efficient manner, without requiring extra time to search for and/or parse the log files. All timing data is stored with associated checkpoints while the upgrade executed. Accordingly, there is no extra time needed to parse thousands of log files spanning multiple hosts to locate and extract the timing data. The timing report can be generated for all hosts in the upgrade infrastructure 100 in 1 second. In certain embodiments, the timing report generator 170 is capable of generating a timing report for all hosts (e.g., a thousand hosts) in the upgrade infrastructure 100 in about a few seconds.
The timing report generator 170 may use various techniques to determine timing data such as start time of an upgrade process, start time of a current execution attempt for the upgrade process, end time of the upgrade process, execution time of the current execution attempt for the upgrade process, wait time for the current execution attempt for the upgrade process, total execution time of the upgrade process, idle time of the upgrade process and number of total attempts of the upgrade process. The timing data may have slightly different definitions at various granularity levels. For example, the start time may have different meanings at upgrade process level, at upgrade phase level and at a host level. Table 1 provides a list of exemplary techniques that may be used in calculating the timing data at various granularity levels.
In certain embodiments, the timing report may be used for performance analysis and performance enhancement. Specifically, the timing report providing information for multiple hosts at any given time, may also be used for the performance diagnostic and tuning of the upgrade infrastructure 100. Problems with a given host performance may be identified by comparing and/or analyzing the timing data for that host. The identified problem may be addressed to enhance the performance of that host, and hence, of the upgrade infrastructure. For example, if a timing report indicates that the same upgrade process to be executed on multiple hosts is executed on different hosts at significantly different execution times, then this may indicate some performance issues for hosts on which the process is executed late. As another example, if a timing report indicates that an upgrade process that is run on multiple host machines, takes significantly longer time to complete on a first host 110, compared to other hosts 120, 130 of the same kind, this may be interpreted to indicate a performance issue with host 110, such as hard disk read/write issues, network connection problems, etc. In this manner, the timing report may be used to identify performance problems with hosts involved in the overall upgrade operation. This performance data may then be used to fine tune the upgrade infrastructure 110.
In some embodiments, the timing report may be used by the upgrade console 104 to identify a performance problem or issue, and automatically take corrective action to enhance the performance of the upgrade infrastructure 100. For example, if a timing report indicates that there issues associated with a given host, the upgrade console may take corrective action such as assigning the execution of the upgrade processes to another host and reporting the host to the system administrator for further review. Certain embodiments may use machine learning to determine patterns for corrective action(s) associated with identified problems. This may streamline the automatic correction process.
In certain embodiments, the upgrade console 104 and/or the upgrade orchestrator 106 may restart the execution of the upgrade process(es) on the given host. Alternatively, dependent on the identified problem, the upgrade console 104 and/or the upgrade orchestrator 106 may restart the overall upgrade operation on all hosts. The timing reporting tool 170 may regenerate a timing report. If the new (e.g. updated) timing report identifies the same or similar problems after the restart, a corrective action may be automatically applied. If the new (e.g. updated) timing report does not identify the same or similar problems after the restart, the overall upgrade operation may proceed without taking corrective action. If the new (e.g. updated) timing report identifies new problems, both the previously identified problems and the newly identified problems may be provided (e.g. reported) to the upgrade console 104.
The automatic corrective action may be implemented based on the nature of the identified problems (e.g., errors). For example, the timing report may identify automatically correctable errors such as timeout to obtain certain resources (e.g., timeout to obtain the lock to the file system), or timeout to access to certain network services or databases. For such errors, the overall upgrade operation or the upgrade operations hosted by a given host may be rerun. On the other hand, some types of errors may require a user 102 to review the timing report and may not be suitable for automatic correction. For example, if a required correction for an identified problem is known to be a lengthy and/or risky process, the correction may not be implemented automatically and may be referred to the user 102 for further review.
In certain embodiments, the timing reports generated by timing report generator 170 may communicated to a user 102 through communication network 108. In some embodiments, the reports may be communicated to upgrade console 104 and output (e.g., displayed) to the user using an output device (e.g., a screen, display). In some other embodiments, the timing reports may be communicated to one or more client computing devices used by the user, such as a mobile phone, a laptop, etc. and output via these devices.
Section 204 of report 200 comprises timing information at a second level of granularity that is more detailed than information at the first level of granularity displayed in section 202. In section 204, timing information is displayed at a host-level. Within section 204, a separate section of information is shown for each host identified in section 202. For example, as shown in
The timing information provided in section 204 for a particular host may include various pieces of information specific to that host machine. For example, in the embodiment depicted in
According to some embodiments, multiple upgrade processes (or tasks) may be running on a given host. Timing report 200 may also show, for each host machine, information at the upgrade process or task-level. For example, in section 204, the sections for the host machines each comprise a “Task Execution Details” option or link 210, which when selected by a user shows upgrade process-level information for that host machine. In one embodiment, when “Task Execution Details” is selected, a new timing report 220 illustrated in
Timing report 200 is generated by the timing tool based upon information read by the timing reporting tool from shared storage. As described above, the upgrade processes involved in the overall upgrade operation are configured to write status information, including timing information, the shared storage location. This information is then read by the timing reporting tool and used to generate the timing report, such as report 200. In certain embodiments, some or all the timing information may be calculated or otherwise generated by the timing reporting tool using the checkpoint data stored in the shared storage.
A timing report such as report 200 depicted in
The information in a timing report can be updated dynamically as more information becomes available. Accordingly, a timing report, may show information related to upgrade processes that are waiting to be started, upgrade processes that are currently being executed, and/or for upgrade processes that have finished execution. In this manner, the timing report may show updated information, in real time, for an upgrade process as the upgrade process transitions through various stages of its life cycle. As the information displayed in a timing report is updated in real time, the user may use this information to identify any errors while the upgrade operation is in progress and attempt to fix the errors. In some embodiments, the user may include a software tool that may analyze the timing report to identify the errors associated with the upgrade processes or the hosts and automatically implement corrective action.
The timing reports, such as the exemplary timing report 200 illustrated in
The timing report depicted in
An overall upgrade operation may comprise multiple upgrade processes executing on multiple host machines. For purposes of simplicity,
At 302, a first upgrade process is executed on a first host machine for upgrading a first software application on the first host machine. At 304, a second upgrade process is executed on a second host machine for upgrading a second software application on the second host machine. The first and the second upgrade processes may generate data, such as checkpoint data, at various time points during their execution. The data for each upgrade process may include information indicative of a status of that upgrade process when the data is generated.
At 306, the first upgrade process stores first data generated by the first upgrade process in a shared storage. The first data may include information indicative of a status of the first upgrade process. At 308, the second upgrade process stores the second data generated by the second upgrade process in the shared storage. The second data may include information indicative of a status of the second upgrade process. An upgrade process may write data one or more times to the shared storage during its lifetime.
The shared storage is selected such that it accessible to the various upgrade processes involved in the overall upgrade operation, including being accessible to the first upgrade process and the second upgrade process. The shared storage may be pre-configured prior to initiation of the overall upgrade operation. For example, the shared storage may be provided on a central host machine that is accessible by both the first upgrade process and the second upgrade process. The shared storage may also be provided on one of the first host machine or the second host machine.
At 309, a timing reporting tool is configured to access the shared storage and read upgrades-related data written to the shared storage by the upgrade processes. For example, in 309, the timing reporting tool is configured to read the first data and the second data written to the shared storage by the first upgrade process and the second upgrade process respectively.
At 310, the timing reporting tool is configured to generate a timing report based upon the information read in 309. The timing report may comprise information related to the various upgrade processes. For example, in 310, a timing report may be generated comprising information for the first upgrade process and the second upgrade process, the report generated based upon first data and second data read from the shared storage in 309. The report may be generated during the execution of the first upgrade process and/or the second upgrade process.
As previously indicated, the generated report may comprise information at various levels of granularity, e.g., at the overall upgrade operation level, at a host level, at a upgrade process level, and the like. For example, the report generated in 310 may comprise information associated with at least one of the first host machine and the second host machine. The information associated with the first host machine may include various time-related information associated with the execution of the first upgrade process on the first host machine. Similarly, the information for the second host machine may include various time-related information associated with the execution of the second upgrade process on the second host machine. The report may also comprise information at a host-level, e.g., for the first host machine and for the second host machine, such as one or more of a total execution time of that host machine, a total idle time of that host machine and a time that the host machine spent coordinating with other host machine(s).
A timing report may comprise various types of timing information. Some of this timing information may be stored by the upgrade processes to the shared storage and read by the timing reporting tool from the shared tool. The timing reporting tool may also be configured to derive or calculate additional information based upon the information read from the shared storage. Various different techniques may be used by the timing reporting tool for computing this information based upon the information read from the shared storage. [Tie this to the table previously shown in the spec.]
At 312, the report may be sent and output to a user. For example, the report may be communicated to an upgrade console and output via an output device (e.g., a screen or display) of the upgrade console. As another example, the report may be communicated to a client computing device used by a user and output (e.g., displayed) to the user via the client computing device.
As previously described, the contents of a timing report may be dynamically updated as more information is available to the timing tool with passage of time. The timing reporting tool is configured to continuously or periodically monitor the shared storage for updated information written to the shared storage by the upgrade processes, and as such information becomes available, is configured to update any existing timing report with the updated information. The report may be displayed and updated while the first upgrade process and/or the second upgrade process are executing. The report may be dynamically updated based on additional data generated during execution of the first upgrade process and/or the second upgrade process. The report may also be updated to incorporate execution timing information associated with additional host machines, such as a third host machine.
At 402, the timing reporting tool receives a request to generate a report for an upgrade operation. The timing reporting tool may be executed by a data processing system and the data processing system may receive the request in 402. In some embodiments, one of the host machines involved in the overall upgrade operation may be configured to execute the timing reporting tool and receive the request in 402.
The request in 402 may be initiated from one or more sources. In certain embodiments, a user may initiate the request using an upgrade console or a user client computing device. In some embodiments, the request may also be generated in response to some event occurring, such as, when a certain time period has passed after initiation of the overall upgrade operation or upon the start of execution of an upgrade process.
The upgrade operation may include multiple upgrade processes hosted by multiple host machines. Each upgrade process may execute on a given host machine for upgrading a software application on that host machine. The upgrade processes may generate data, such as checkpoint data, at various time points during their execution. The data for each upgrade process may include information indicative of a status of that upgrade process at the moment the data is generated. The upgrade processes may store the generated data in a shared storage. The shared storage may be provided on a central host machine that is accessible by all upgrade processes.
At 404, the timing reporting tool may access the shared storage to retrieve data stored by the multiple upgrade processes. At 406, the timing reporting tool may retrieve the data stored by the multiple upgrade processes from the shared storage.
At 408, using the retrieved data, the timing reporting tool may determine information about upgrade processes that have completed, upgrade processes that are currently executing, and upgrade processes still to be executed. According to certain embodiments, the timing reporting tool may determine information about the multiple hosts using the retrieved data. For example, the timing reporting tool may determine a total execution time of each one of the multiple host machines, a total idle time of the host machines and a time that a given host machine spent coordinating with another host machine.
At 410, the timing reporting tool may generate the report providing information indicative of time associated with execution of the multiple upgrade processes based on the determined information. The timing reporting tool may organize the generated report based on a pre-determined criteria. For example, the timing reporting tool may organize the report by upgrade processes, by hosts or, if the hosts are grouped into one or more pods, by pods.
At 412, the timing reporting tool may deliver the report to one or more users. For example, the report may be displayed on a display screen. In certain embodiments, the report may be displayed while the upgrade processes are executing. In such embodiments, the timing report may be dynamically updated based on additional data generated during execution of the upgrade processes. The timing report may also be updated to incorporate execution timing information associated with additional host machines that may be added to the environment where the upgrade operation is performed.
The timing reporting tool discussed herein creates a timing report using checkpoint data generated by the upgrade processes running on one or multiple hosts. The timing report may include data for all hosts and may be presented to a user after the upgrade or during the upgrade. When the report is provided during the upgrade, the report may be dynamically updated to incorporate new timing data generated by the upgrade processes as they execute. Accordingly, the timing report may include historical data, as well as real-time data.
In some embodiments, server 512 may be adapted to run one or more services or software applications provided by one or more of the components of the system. In some embodiments, these services may be offered as web-based or cloud services or under a Software as a Service (SaaS) model to the users of client computing devices 502, 504, 506, and/or 508. Users operating client computing devices 502, 504, 506, and/or 508 may in turn utilize one or more client applications to interact with server 512 to utilize the services provided by these components.
In the configuration depicted in the figure, the software components 518, 520 and 522 of system 500 are shown as being implemented on server 512. In other embodiments, one or more of the components of system 500 and/or the services provided by these components may also be implemented by one or more of the client computing devices 502, 504, 506, and/or 508. Users operating the client computing devices may then utilize one or more client applications to use the services provided by these components. These components may be implemented in hardware, firmware, software, or combinations thereof. It should be appreciated that various different system configurations are possible, which may be different from distributed system 500. The embodiment shown in the figure is thus one example of a distributed system for implementing an embodiment system and is not intended to be limiting.
Client computing devices 502, 504, 506, and/or 508 may be portable handheld devices (e.g., an iPhone®, cellular telephone, an iPad®, computing tablet, a personal digital assistant (PDA)) or wearable devices (e.g., a Google Glass® head mounted display), running software such as Microsoft Windows Mobile®, and/or a variety of mobile operating systems such as iOS, Windows Phone, Android, BlackBerry 10, Palm OS, and the like, and being Internet, e-mail, short message service (SMS), Blackberry®, or other communication protocol enabled. The client computing devices can be general purpose personal computers including, by way of example, personal computers and/or laptop computers running various versions of Microsoft Windows®, Apple Macintosh®, and/or Linux operating systems. The client computing devices can be workstation computers running any of a variety of commercially-available UNIX® or UNIX-like operating systems, including without limitation the variety of GNU/Linux operating systems, such as for example, Google Chrome OS. Alternatively, or in addition, client computing devices 502, 504, 506, and 508 may be any other electronic device, such as a thin-client computer, an Internet-enabled gaming system (e.g., a Microsoft Xbox gaming console with or without a Kinect® gesture input device), and/or a personal messaging device, capable of communicating over network(s) 510.
Although exemplary distributed system 500 is shown with four client computing devices, any number of client computing devices may be supported. Other devices, such as devices with sensors, etc., may interact with server 512.
Network(s) 510 in distributed system 500 may be any type of network familiar to those skilled in the art that can support data communications using any of a variety of commercially-available protocols, including without limitation TCP/IP (transmission control protocol/Internet protocol), SNA (systems network architecture), IPX (Internet packet exchange), AppleTalk, and the like. Merely by way of example, network(s) 510 can be a local area network (LAN), such as one based on Ethernet, Token-Ring and/or the like. Network(s) 510 can be a wide-area network and the Internet. It can include a virtual network, including without limitation a virtual private network (VPN), an intranet, an extranet, a public switched telephone network (PSTN), an infra-red network, a wireless network (e.g., a network operating under any of the Institute of Electrical and Electronics (IEEE) 802.11 suite of protocols, Bluetooth®, and/or any other wireless protocol); and/or any combination of these and/or other networks.
Server 512 may be composed of one or more general purpose computers, specialized server computers (including, by way of example, PC (personal computer) servers, UNIX® servers, mid-range servers, mainframe computers, rack-mounted servers, etc.), server farms, server clusters, or any other appropriate arrangement and/or combination. In some embodiments, server 512 may be adapted to run one or more services or software applications described in the foregoing disclosure. For example, server 512 may correspond to a server for performing processing described above according to an embodiment of the present disclosure.
Server 512 may run an operating system including any of those discussed above, as well as any commercially available server operating system. Server 512 may also run any of a variety of additional server applications and/or mid-tier applications, including HTTP (hypertext transport protocol) servers, FTP (file transfer protocol) servers, CGI (common gateway interface) servers, JAVA® servers, database servers, and the like. Exemplary database servers include without limitation those commercially available from Oracle, Microsoft, Sybase, IBM (International Business Machines), and the like.
In some implementations, server 512 may include one or more applications to analyze and consolidate data feeds and/or event updates received from users of client computing devices 502, 504, 506, and 508. As an example, data feeds and/or event updates may include, but are not limited to, Twitter® feeds, Facebook® updates or real-time updates received from one or more third party information sources and continuous data streams, which may include real-time events related to sensor data applications, financial tickers, network performance measuring tools (e.g., network monitoring and traffic management applications), clickstream analysis tools, automobile traffic monitoring, and the like. Server 512 may also include one or more applications to display the data feeds and/or real-time events via one or more display devices of client computing devices 502, 504, 506, and 508.
Distributed system 500 may also include one or more databases 514 and 516. Databases 514 and 516 may reside in a variety of locations. By way of example, one or more of databases 514 and 516 may reside on a non-transitory storage medium local to (and/or resident in) server 512. Alternatively, databases 514 and 516 may be remote from server 512 and in communication with server 512 via a network-based or dedicated connection. In one set of embodiments, databases 514 and 516 may reside in a storage-area network (SAN). Similarly, any necessary files for performing the functions attributed to server 512 may be stored locally on server 512 and/or remotely, as appropriate. In one set of embodiments, databases 514 and 516 may include relational databases, such as databases provided by Oracle, that are adapted to store, update, and retrieve data in response to SQL-formatted commands.
Bus subsystem 602 provides a mechanism for letting the various components and subsystems of computer system 600 communicate with each other as intended. Although bus subsystem 602 is shown schematically as a single bus, alternative embodiments of the bus subsystem may utilize multiple buses. Bus subsystem 602 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. For example, such architectures may include an Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, which can be implemented as a Mezzanine bus manufactured to the IEEE P1386.1 standard.
Processing unit 604, which can be implemented as one or more integrated circuits (e.g., a conventional microprocessor or microcontroller), controls the operation of computer system 600. One or more processors may be included in processing unit 604. These processors may include single core or multicore processors. In certain embodiments, processing unit 604 may be implemented as one or more independent processing units 632 and/or 634 with single or multicore processors included in each processing unit. In other embodiments, processing unit 604 may also be implemented as a quad-core processing unit formed by integrating two dual-core processors into a single chip.
In some embodiments, processing unit 604 can execute a variety of programs in response to program code and can maintain multiple concurrently executing programs or processes. At any given time, some or all of the program code to be executed can be resident in processor(s) 604 and/or in storage subsystem 618. Through suitable programming, processor(s) 604 can provide various functionalities described above. Computer system 600 may additionally include a processing acceleration unit 606, which can include a digital signal processor (DSP), a special-purpose processor, and/or the like.
I/O subsystem 608 may include user interface input devices and user interface output devices. User interface input devices may include a keyboard, pointing devices such as a mouse or trackball, a touchpad or touch screen incorporated into a display, a scroll wheel, a click wheel, a dial, a button, a switch, a keypad, audio input devices with voice command recognition systems, microphones, and other types of input devices. User interface input devices may include, for example, motion sensing and/or gesture recognition devices such as the Microsoft Kinect® motion sensor that enables users to control and interact with an input device, such as the Microsoft Xbox® 360 game controller, through a natural user interface using gestures and spoken commands. User interface input devices may also include eye gesture recognition devices such as the Google Glass® blink detector that detects eye activity (e.g., ‘blinking’ while taking pictures and/or making a menu selection) from users and transforms the eye gestures as input into an input device (e.g., Google Glass®). Additionally, user interface input devices may include voice recognition sensing devices that enable users to interact with voice recognition systems (e.g., Siri® navigator), through voice commands.
User interface input devices may also include, without limitation, three dimensional (3D) mice, joysticks or pointing sticks, gamepads and graphic tablets, and audio/visual devices such as speakers, digital cameras, digital camcorders, portable media players, webcams, image scanners, fingerprint scanners, barcode reader 3D scanners, 3D printers, laser rangefinders, and eye gaze tracking devices. Additionally, user interface input devices may include, for example, medical imaging input devices such as computed tomography, magnetic resonance imaging, position emission tomography, medical ultrasonography devices. User interface input devices may also include, for example, audio input devices such as MIDI keyboards, digital musical instruments and the like.
User interface output devices may include a display subsystem, indicator lights, or non-visual displays such as audio output devices, etc. The display subsystem may be a cathode ray tube (CRT), a flat-panel device, such as that using a liquid crystal display (LCD) or plasma display, a projection device, a touch screen, and the like. In general, use of the term “output device” is intended to include all possible types of devices and mechanisms for outputting information from computer system 600 to a user or other computer. For example, user interface output devices may include, without limitation, a variety of display devices that visually convey text, graphics and audio/video information such as monitors, printers, speakers, headphones, automotive navigation systems, plotters, voice output devices, and modems.
Computer system 600 may comprise a storage subsystem 618 that comprises software elements, shown as being currently located within a system memory 610. System memory 610 may store program instructions that are loadable and executable on processing unit 604, as well as data generated during the execution of these programs.
Depending on the configuration and type of computer system 600, system memory 610 may be volatile (such as random access memory (RAM)) and/or non-volatile (such as read-only memory (ROM), flash memory, etc.) The RAM typically contains data and/or program modules that are immediately accessible to and/or presently being operated and executed by processing unit 604. In some implementations, system memory 610 may include multiple different types of memory, such as static random access memory (SRAM) or dynamic random access memory (DRAM). In some implementations, a basic input/output system (BIOS), containing the basic routines that help to transfer information between elements within computer system 600, such as during start-up, may typically be stored in the ROM. By way of example, and not limitation, system memory 610 also illustrates application programs 612, which may include client applications, Web browsers, mid-tier applications, relational database management systems (RDBMS), etc., program data 614, and an operating system 616. By way of example, operating system 616 may include various versions of Microsoft Windows®, Apple Macintosh®, and/or Linux operating systems, a variety of commercially-available UNIX® or UNIX-like operating systems (including without limitation the variety of GNU/Linux operating systems, the Google Chrome® OS, and the like) and/or mobile operating systems such as iOS, Windows® Phone, Android® OS, BlackBerry® 10 OS, and Palm® OS operating systems.
Storage subsystem 618 may also provide a tangible computer-readable storage medium for storing the basic programming and data constructs that provide the functionality of some embodiments. Software (programs, code modules, instructions) that when executed by a processor provide the functionality described above may be stored in storage subsystem 618. These software modules or instructions may be executed by processing unit 604. Storage subsystem 618 may also provide a repository for storing data used in accordance with the present invention.
Storage subsystem 600 may also include a computer-readable storage media reader 620 that can further be connected to computer-readable storage media 622. Together and, optionally, in combination with system memory 610, computer-readable storage media 622 may comprehensively represent remote, local, fixed, and/or removable storage devices plus storage media for temporarily and/or more permanently containing, storing, transmitting, and retrieving computer-readable information.
Computer-readable storage media 622 containing code, or portions of code, can also include any appropriate media known or used in the art, including storage media and communication media, such as but not limited to, volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage and/or transmission of information. This can include tangible computer-readable storage media such as RAM, ROM, electronically erasable programmable ROM (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disk (DVD), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other tangible computer readable media. This can also include nontangible computer-readable media, such as data signals, data transmissions, or any other medium which can be used to transmit the desired information and which can be accessed by computing system 600.
By way of example, computer-readable storage media 622 may include a hard disk drive that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive that reads from or writes to a removable, nonvolatile magnetic disk, and an optical disk drive that reads from or writes to a removable, nonvolatile optical disk such as a CD ROM, DVD, and Blu-Ray® disk, or other optical media. Computer-readable storage media 622 may include, but is not limited to, Zip® drives, flash memory cards, universal serial bus (USB) flash drives, secure digital (SD) cards, DVD disks, digital video tape, and the like. Computer-readable storage media 622 may also include, solid-state drives (SSD) based on non-volatile memory such as flash-memory based SSDs, enterprise flash drives, solid state ROM, and the like, SSDs based on volatile memory such as solid state RAM, dynamic RAM, static RAM, DRAM-based SSDs, magnetoresistive RAM (MRAM) SSDs, and hybrid SSDs that use a combination of DRAM and flash memory based SSDs. The disk drives and their associated computer-readable media may provide non-volatile storage of computer-readable instructions, data structures, program modules, and other data for computer system 600.
Communications subsystem 624 provides an interface to other computer systems and networks. Communications subsystem 624 serves as an interface for receiving data from and transmitting data to other systems from computer system 600. For example, communications subsystem 624 may enable computer system 600 to connect to one or more devices via the Internet. In some embodiments communications subsystem 624 can include radio frequency (RF) transceiver components for accessing wireless voice and/or data networks (e.g., using cellular telephone technology, advanced data network technology, such as 3G, 4G or EDGE (enhanced data rates for global evolution), WiFi (IEEE 602.11 family standards, or other mobile communication technologies, or any combination thereof), global positioning system (GPS) receiver components, and/or other components. In some embodiments communications subsystem 624 can provide wired network connectivity (e.g., Ethernet) in addition to or instead of a wireless interface.
In some embodiments, communications subsystem 624 may also receive input communication in the form of structured and/or unstructured data feeds 626, event streams 628, event updates 630, and the like on behalf of one or more users who may use computer system 600.
By way of example, communications subsystem 624 may be configured to receive data feeds 626 in real-time from users of social networks and/or other communication services such as Twitter® feeds, Facebook® updates, web feeds such as Rich Site Summary (RSS) feeds, and/or real-time updates from one or more third party information sources.
Additionally, communications subsystem 624 may also be configured to receive data in the form of continuous data streams, which may include event streams 628 of real-time events and/or event updates 630, that may be continuous or unbounded in nature with no explicit end. Examples of applications that generate continuous data may include, for example, sensor data applications, financial tickers, network performance measuring tools (e.g., network monitoring and traffic management applications), clickstream analysis tools, automobile traffic monitoring, and the like.
Communications subsystem 624 may also be configured to output the structured and/or unstructured data feeds 626, event streams 628, event updates 630, and the like to one or more databases that may be in communication with one or more streaming data source computers coupled to computer system 600.
Computer system 600 can be one of various types, including a handheld portable device (e.g., an iPhone® cellular phone, an iPad® computing tablet, a PDA), a wearable device (e.g., a Google Glass® head mounted display), a PC, a workstation, a mainframe, a kiosk, a server rack, or any other data processing system.
Due to the ever-changing nature of computers and networks, the description of computer system 600 depicted in the figure is intended only as a specific example. Many other configurations having more or fewer components than the system depicted in the figure are possible. For example, customized hardware might also be used and/or particular elements might be implemented in hardware, firmware, software (including applets), or a combination. Further, connection to other computing devices, such as network input/output devices, may be employed. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will appreciate other ways and/or methods to implement the some embodiments.
In the foregoing specification, aspects of the invention are described with reference to specific embodiments thereof, but those skilled in the art will recognize that the invention is not limited thereto. Various features and aspects of the above-described invention may be used individually or jointly. Further, embodiments can be utilized in any number of environments and applications beyond those described herein without departing from the broader spirit and scope of the specification. The specification and drawings are, accordingly, to be regarded as illustrative rather than restrictive.
This application is a non-provisional of and claims the benefit of and priority to U.S. Provisional Application No. 62/076,448, filed Nov. 6, 2014 and entitled “TIMING REPORT FRAMEWORK FOR DISTRIBUTED SOFTWARE UPGRADES,” the entire disclosure of which is incorporated herein by reference for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
5862325 | Reed et al. | Jan 1999 | A |
6088717 | Reed | Jul 2000 | A |
6314567 | Oberhauser et al. | Nov 2001 | B1 |
6360366 | Heath | Mar 2002 | B1 |
6633899 | Coward | Oct 2003 | B1 |
6775830 | Matsunami et al. | Aug 2004 | B1 |
6779028 | Nakamura | Aug 2004 | B1 |
7191187 | Takeshita et al. | Mar 2007 | B2 |
7457880 | Kim | Nov 2008 | B1 |
7584467 | Wickham et al. | Sep 2009 | B2 |
7739677 | Kekre et al. | Jun 2010 | B1 |
8346913 | Gao et al. | Jan 2013 | B2 |
8589535 | Calder et al. | Nov 2013 | B2 |
8752040 | Halliday | Jun 2014 | B2 |
9032053 | Kosuru et al. | May 2015 | B2 |
9185514 | Reeves et al. | Nov 2015 | B1 |
20030005351 | Lim | Jan 2003 | A1 |
20040003352 | Bargeron et al. | Jan 2004 | A1 |
20040010808 | deCarmo | Jan 2004 | A1 |
20040012613 | Rast | Jan 2004 | A1 |
20040030567 | Takeshita et al. | Feb 2004 | A1 |
20040044736 | Austin-Lane et al. | Mar 2004 | A1 |
20040103411 | Thayer | May 2004 | A1 |
20060010233 | Fellenstein et al. | Jan 2006 | A1 |
20060015861 | Takata | Jan 2006 | A1 |
20060218545 | Taguchi | Sep 2006 | A1 |
20060240803 | Valeriano et al. | Oct 2006 | A1 |
20080133741 | Kubota | Jun 2008 | A1 |
20080168434 | Gee et al. | Jul 2008 | A1 |
20080244555 | Welvaert et al. | Oct 2008 | A1 |
20080250405 | Farhangi et al. | Oct 2008 | A1 |
20090248801 | Then et al. | Oct 2009 | A1 |
20100125849 | Oswald | May 2010 | A1 |
20100235823 | Garbers et al. | Sep 2010 | A1 |
20110289498 | Xie et al. | Nov 2011 | A1 |
20120005316 | Perry | Jan 2012 | A1 |
20120066380 | Gao et al. | Mar 2012 | A1 |
20120204171 | Reisman | Aug 2012 | A1 |
20130174178 | Chakraborty | Jul 2013 | A1 |
20130263104 | Baset et al. | Oct 2013 | A1 |
20130291099 | Donfried et al. | Oct 2013 | A1 |
20130346922 | Shiplacoff et al. | Dec 2013 | A1 |
20140096076 | Ashbrook et al. | Apr 2014 | A1 |
20140189030 | Benchenaa et al. | Jul 2014 | A1 |
20140298196 | Aoyama et al. | Oct 2014 | A1 |
20140304714 | Shapiro | Oct 2014 | A1 |
20140317522 | Lucero et al. | Oct 2014 | A1 |
20150067819 | Shribman | Mar 2015 | A1 |
20150178066 | Horn et al. | Jun 2015 | A1 |
20150193222 | Pirzadeh | Jul 2015 | A1 |
20160028667 | Faaborg et al. | Jan 2016 | A1 |
20160066145 | Pietraniec et al. | Mar 2016 | A1 |
20160070558 | Hu et al. | Mar 2016 | A1 |
20160092310 | Peacock et al. | Mar 2016 | A1 |
20160124741 | Hu et al. | May 2016 | A1 |
20160132318 | Hu et al. | May 2016 | A1 |
Entry |
---|
U.S. Appl. No. 14/838,184, Non-Final Office Action mailed on Aug. 11, 2016, 15 pages. |
What is Prevayler?, Prevayler, Version 2.6, http://prevayler.org/, Jan. 15, 2013, 1 page. |
U.S. Appl. No. 14/925,354, Non-Final Office Action mailed on Oct. 20, 2016, 12 pages. |
Dumitras et al., Why Do Upgrades Fail and What Can We Do about It? Toward Dependable, Online Upgrades in Enterprise System, IFIP International Federation for Information Processing, 2009, pp. 349-372. |
Greene, SCOM 2012—Configuring Application Performance Monitoring (APM) Part 3, IT Blog, http:/lkevingreeneitblog.blogspot.com/2012/03/scom-2012-configuring-application—49.html, Mar. 2012, 9 pages. |
Microsoft, Orchestration Suspended Instances Availability Monitor Monitor, http://mpwiki.viacode.com/default.aspx?g=posts&t=164367, Oct. 2013, 2 pages. |
Vancauwenberghe, Monitoring suspended orchestrations using System Center Operations Manager, Codit Blog., Feb. 14, 2014, 8 pages. |
U.S. Appl. No. 14/935,254, Non-Final Office Action mailed on Dec. 14, 2016, 16 pages. |
U.S. Appl. No. 14/838,184, Final Office Action mailed on Feb. 14, 2017, 17 pages. |
U.S. Appl. No. 14/925,354, Notice of Allowance dated Apr. 12, 2017, 8 pages. |
U.S. Appl. No. 14/838,184, “Notice of Allowance”, dated Jun. 8, 2017, 10 pages. |
U.S. Appl. No. 14/935,254, Final Office Action dated May 23, 2017, 19 pages. |
Number | Date | Country | |
---|---|---|---|
20160132316 A1 | May 2016 | US |
Number | Date | Country | |
---|---|---|---|
62076448 | Nov 2014 | US |