Patent Application
20150363250
The present invention relates to a system analysis device and a system analysis method.
One example of an operation management system that models a system using time series information of system performance and determines a cause of a failure, an abnormality, or the like of the system using the generated model is described in PTL 1.
The operation management system described in PTL 1 determines a correlation function that indicates a correlation of each pair among a plurality of metrics on the basis of measurement values of the plurality of metrics of the system to generate a correlation model of the system. Then, the operation management system detects destruction of the correlation (correlation destruction) using the generated correlation model, and determines a failure cause of the system on the basis of the correlation destruction. A technique for analyzing a state of the system on the basis of the correlation destruction in this manner is called an invariant relation analysis.
In the invariant relation analysis, one example of a technique for determining a failure cause on the basis of a similarity of states of correlation destruction between at the time of a failure in the past and at the present time is disclosed in PTL 2. An operation management device described in PTL 2 classifies metrics into several groups, and compares distributions of the number of metrics in which correlation destruction occurs in the respective groups between at the time of a failure in the past and at the present time. However, in the operation management device of PTL 2, even if metrics in which correlation destruction occurs are different in the groups, when the distributions of the number of metrics in which correlation destruction occurs in the respective groups are similar, it may be determined to be the same failure.
One example of a technique for solving the problem is disclosed in PTL 3. An operation management device described in PTL 3 compares patterns of correlations in which correlation destruction occurs (correlation destruction patterns) between at the time of a failure in the past and at the present time. By comparing corresponding ratios of the presence or absence of the occurrence of the correlation destruction in the respective correlations in a correlation model, the operation management device determines a cause of the failure.
[PTL 1] Japanese Patent Publication No. 4872944
[PTL 2] WO 2010/032701
[PTL 3] WO 2011/155621
In the above-described technique of PTL 3, since the correlation destruction patterns are compared, a system at the time of a failure in the past and a system at the present time are required to be the same system having the same correlation model. In addition, unless failure locations at the time of a failure in the past and failure locations at the present time are the same, it is not determined to be the same failure.
For example, when there is a change in the correlation model of the system between at the time of a failure in the past and at the present time, by adding a device of the same type performing distributed processing, a failure cause cannot be determined using the correlation destruction pattern at the time of a failure in the past. In addition, when a device in which a failure occurred in the past and a device in which a failure has occurred at present are devices of the same type performing distributed processing, but different devices, a failure cause cannot be determined using the correlation destruction pattern at the time of a failure in the past.
An object of the present invention is to solve the above-described problem, and to provide a system analysis device and a system analysis method that can improve the versatility of a correlation destruction pattern, in state detection of a system using the correlation destruction pattern.
A system analysis device according to an exemplary aspect of the invention includes: a correlation destruction pattern storage means for storing a plurality of correlation destruction patterns each of which is a set of correlations in which correlation destruction has been detected among correlations of pairs of metrics in a system; an aggregated destruction pattern generation means for generating an aggregated destruction pattern which is obtained by aggregating correlation destruction patterns of the same type among the plurality of correlation destruction patterns; and a similarity calculation means for calculating and outputting a similarity between the aggregated destruction pattern and a newly-detected correlation destruction pattern.
A system analysis method according to an exemplary aspect of the invention includes: storing a plurality of correlation destruction patterns each of which is a set of correlations in which correlation destruction has been detected among correlations of pairs of metrics in a system; generating an aggregated destruction pattern which is obtained by aggregating correlation destruction patterns of the same type among the plurality of correlation destruction patterns; and calculating and outputting a similarity between the aggregated destruction pattern and a newly-detected correlation destruction pattern.
A computer readable storage medium according to an exemplary aspect of the invention records thereon a program, causing a computer to perform a method including: storing a plurality of correlation destruction patterns each of which is a set of correlations in which correlation destruction has been detected among correlations of pairs of metrics in a system; generating an aggregated destruction pattern which is obtained by aggregating correlation destruction patterns of the same type among the plurality of correlation destruction patterns; and calculating and outputting a similarity between the aggregated destruction pattern and a newly-detected correlation destruction pattern.
The advantageous effect of the present invention is to be able to improve the versatility of a correlation destruction pattern, in state detection of a system using the correlation destruction pattern.
An exemplary embodiment of the present invention will be described.
Firstly, a configuration of the exemplary embodiment of the present invention will be described.
Referring to
It is to be noted that, in the following description, a code in quotation marks indicates an identifier. For example, a device group “WEB” indicates a device group having an identifier WEB, and a Web server “WEB 1” indicates a Web server having an identifier WEB 1.
The monitored device 200 measures actual measurement data (measurement values) of performance values of a plurality of items of the monitored device 200 at regular intervals, and transmits the actual measurement data to the system analysis device 100. As the items of the performance values, for example, utilization or usage of a computer resource or a network resource, such as CPU (Central Processing Unit) utilization, memory utilization, disk access frequency, and an input/output packet count, are used.
Here, a combination of the monitored device 200 and the item of the performance value is defined as a metric (performance index), and a combination of values of a plurality of metrics measured at the same time is defined as performance information. The metric is represented by a numerical value of an integer number or a decimal number. The metric corresponds to an “element” for which a correlation model is generated in PTL 1.
Hereinafter, an identifier of the metric is indicated by a combination of the device identifier and the item of the performance value. For example, a metric “WEB 1. CPU” indicates CPU utilization of the Web server “WEB 1”. In addition, a metric “NW 1. IN” indicates an input packet count of the network device “NW 1”.
The system analysis device 100 generates a correlation model 122 of the monitored system on the basis of performance information collected from the monitored devices 200, and analyzes a state of the monitored system using the generated correlation model 122.
The system analysis device 100 includes a performance information collection unit 101, a correlation model generation unit 102, a correlation destruction detection unit 103, an aggregated destruction pattern generation unit 104, a similarity calculation unit 105, and a dialogue unit 106. The system analysis device 100 further includes a performance information storage unit 111, a correlation model storage unit 112, a correlation destruction pattern storage unit 113, and an aggregated destruction pattern storage unit 114.
The performance information collection unit 101 collects the performance information from the monitored devices 200.
The performance information storage unit 111 stores time series variation of the performance information collected by the performance information collection unit 101, as performance series information 121.
The correlation model generation unit 102 generates the correlation model 122 of the monitored system on the basis of the performance series information 121.
Here, the correlation model 122 includes a correlation function (or conversion function) that indicates a correlation of each pair of metrics among a plurality of metrics. The correlation function is a function that uses time series data at and before time t of one metric (input metric) of a pair of metrics and time series data before time t of the other metric (output metric) to estimate a value of the output metric at time t. The correlation model generation unit 102 determines a coefficient of the correlation function for each pair of metrics on the basis of the performance information in a predetermined modeling period. The coefficient of the correlation function is determined by system identification processing for time series of the measurement values of the metrics, as is the case with an operation management device of PTL 1. The correlation model generation unit 102 may calculate weight on the basis of a conversion error of the correlation function for each pair of metrics, and use a set of the correlation functions (effective correlation functions) whose weight is equal to or greater than a predetermined value, as the correlation model 122, as is the case with the operation management device of PTL 1.
Hereinafter, each correlation in the correlation model 122 is indicated by a pair of an identifier of the input metric and an identifier of the output metric. For example, a correlation “NW 1. IN-WEB 1. CPU” indicates a correlation in which the metric “NW 1. IN” is input and the metric “WEB 1. CPU” is output.
The correlation model storage unit 112 stores the correlation model 122 generated by the correlation model generation unit 102.
The correlation destruction detection unit 103 detects correlation destruction of the correlation included in the correlation model 122, with respect to newly-inputted performance information, as is the case with the operation management device of PTL 1.
Here, the correlation destruction detection unit 103 inputs the measurement values of the metrics into the correlation function to obtain a predicted value of the output metric, with respect to each pair of metrics, as is the case with PTL 1. Then, when a difference (conversion error due to correlation function) between the obtained predicted value of the output metric and the measurement value of the output metric is equal to or greater than a predetermined value, the correlation destruction detection unit 103 detects correlation destruction of the correlation of the pair.
In addition, the correlation destruction detection unit 103 generates correlation destruction patterns 123 each of which is a set of correlations in which correlation destruction has been detected.
The correlation destruction pattern 123 includes a set of correlations in which correlation destruction has been detected. In addition, the correlation destruction pattern 123 may further include a failure name or an abnormality name that identifies a failure or an abnormality that has occurred when the correlation destruction has been detected. In this case, the failure name or the abnormality name is set by an administrator or the like, with respect to the set of correlations in which correlation destruction has been detected when the failure or the abnormality has occurred, for example.
The correlation destruction pattern storage unit 113 stores the correlation destruction patterns 123 generated by the correlation destruction detection unit 103.
The aggregated destruction pattern generation unit 104 extracts correlation destruction patterns 123 of the same type, from the correlation destruction patterns 123 stored in the correlation destruction pattern storage unit 113, and generates an aggregated destruction pattern 124 which is obtained by aggregating the correlation destruction patterns 123 of the same type.
The aggregated destruction pattern storage unit 114 stores the aggregated destruction pattern 124 generated by the aggregated destruction pattern generation unit 104.
The similarity calculation unit 105 calculates a similarity between a newly-detected correlation destruction pattern 123 and the aggregated destruction pattern 124.
The dialogue unit 106 provides the calculation result of the similarity by the similarity calculation unit 105 for the administrator or the like.
The system analysis device 100 may be a computer that includes a CPU and a storage medium storing a program and operates by control based on the program. In addition, the performance information storage unit 111, the correlation model storage unit 112, the correlation destruction pattern storage unit 113, and the aggregated destruction pattern storage unit 114 may be separate storage mediums or may be configured by one storage medium.
Next, an operation of the system analysis device 100 in the exemplary embodiment of the present invention will be described.
Here, it is assumed that the correlation model 122 illustrated in
Firstly, aggregated destruction pattern generation processing in the exemplary embodiment of the present invention will be described.
The aggregated destruction pattern generation unit 104 extracts correlation destruction patterns 123 of the same type, from the correlation destruction patterns 123 stored in the correlation destruction pattern storage unit 113 (Step S101).
Here, the aggregated destruction pattern generation unit 104 determines that, between correlation destruction patterns 123, correlations having the same pairs of metric types and a difference of correlation coefficients within a predetermined range are correlations of the same type. Here, having the same pairs of metric types means that, between the correlations, the input metric types and the output metric types are the same, respectively. Then, the aggregated destruction pattern generation unit 104 extracts correlation destruction patterns 123 including, for example, a predetermined number or more, or a predetermined ratio or more of the correlations of the same type, as the correlation destruction patterns 123 of the same type.
The metric type is determined such that metrics that behave in the same way on the monitored system are metrics of the same type. For example, metrics having the same items of the performance values in the different monitored devices 200 that provide the same service (belong to the same device group) are metrics of the same type.
The metric type is determined on the basis of the device group and the item of the performance value included in the identifier of the metric, for example. In addition, when the identifier of the metric includes the metric type, the metric type may be obtained from the identifier of the metric. In addition, when information in which the identifier of the metric and the metric type are associated is stored in a storage unit that is not illustrated in the drawings, the metric type may be determined on the basis of the information.
Hereinafter, the metric type is indicated by a combination of the device group to which the monitored device 200 belongs and the item of the performance value. For example, a metric type “WEB. CPU” indicates a metric according to the CPU utilization of the monitored device 200 that belongs to the device group “WEB”. In addition, a metric type “NW. IN” indicates a metric according to the input packet count of the monitored device 200 that belongs to the device group “NW”. In addition, the pair of metric types is indicated by a combination of the input metric type and the output metric type. For example, a pair of metric types “NW. IN-WEB. CPU” indicates that the input metric type is “NW. IN” and the output metric type is “WEB. CPU”.
For example, in
Similarly, it is assumed that a difference between correlation coefficients of a correlation function fw1, a1 of a correlation “NW 1. IN-AP 1. CPU” and a correlation function fw2, a2 of a correlation “NW 2. IN-AP 2. CPU” whose pairs of metric types are “NW. IN-AP. CPU” is within a predetermined range. In this case, the aggregated destruction pattern generation unit 104 determines that these correlations are also the same type. Furthermore, it is assumed that a difference between correlation coefficients of a correlation function fw1, a1 of a correlation “WEB 1. CPU-AP 1. CPU” and a correlation function fw3, a2 of a correlation “WEB 3. CPU-AP 2. CPU” whose pairs of metric types are “WEB. CPU-AP. CPU” is within a predetermined range. In this case, the aggregated destruction pattern generation unit 104 determines that these correlations are also the same type.
On the other hand, it is assumed that a difference between correlation coefficients of a correlation function fa1, d1 of a correlation “AP 1. CPU-DB 1. CPU” and a correlation function fa2, d2 of a correlation “AP 2. CPU-DB 2. CPU” whose pairs of metric types are “AP. CPU-DB. CPU” exceeds a predetermined range. In this case, the aggregated destruction pattern generation unit 104 determines that these correlations are not the same type.
Then, for example, it is assumed that, when the ratio of the correlations of the same type is equal to or greater than 60%, it is determined that the correlation destruction patterns 123 are the same type. In this case, the aggregated destruction pattern generation unit 104 extracts the correlation destruction pattern 123a and the correlation destruction pattern 123b, as the correlation destruction patterns 123 of the same type.
It is to be noted that the aggregated destruction pattern generation unit 104 may determine that correlations having the same pairs of metric types are correlations of the same type, without using the correlation coefficients.
Next, the aggregated destruction pattern generation unit 104 generates aggregated destruction pattern 124 on the basis of the correlation destruction patterns 123 of the same type (Step S102).
Here, the aggregated destruction pattern 124 includes a set of aggregated correlations in which the correlations of the same type are aggregated. The pairs of metric types according to the correlations of the same type are used for the aggregated correlations.
Hereinafter, each aggregated correlation is indicated by a pair of the input metric type and the output metric type. For example, an aggregated correlation “NW. IN-WEB. CPU” indicates an aggregated correlation in which the input metric type is “NW. IN” and the output metric type is “WEB. CPU”.
For example, in
In addition, the aggregated destruction pattern generation unit 104 may set a failure name or an abnormality name that is common to the failure name or the abnormality name of the correlation destruction patterns 123 of the same type, in the aggregated destruction pattern 124. In this case, the common failure name or abnormality name may be set by the administrator or the like, with respect to the correlation destruction patterns 123 of the same type, for example.
For example, in
Next, abnormality level calculation processing in the exemplary embodiment of the present invention will be described.
The correlation destruction detection unit 103 detects correlation destruction of the correlation included in the correlation model 122 using performance information newly-collected by the performance information collection unit 101, and generates a new correlation destruction pattern 123 (Step S201).
For example, the correlation destruction detection unit 103 detects correlation destruction of
Next, the similarity calculation unit 105 calculates the similarity between the aggregated destruction pattern 124 and the new correlation destruction pattern 123 (Step S202).
Here, when aggregated correlations included in the aggregated destruction pattern 124 and correlations included in the new correlation destruction pattern 123 have the same pairs of metric types, the similarity calculation unit 105 determines that the aggregated correlations and the correlations are the same type. Here, having the same pairs of metric types means that, between the aggregated correlation and the correlation, the input metric types and the output metric types are the same, respectively. Then, for example, the similarity calculation unit 105 calculates the number or the ratio of the aggregated correlations among the aggregated correlations included in the aggregated destruction pattern 124, which are the same type as the correlations included in the new correlation destruction pattern 123, as the similarity.
For example, in
Then, the similarity calculation unit 105 calculates 67% that is the ratio of the aggregated correlations of the same type, as the similarity.
Next, the similarity calculation unit 105 outputs the calculation result of the similarity to the administrator or the like, through the dialogue unit 106 (Step S203). Here, the similarity calculation unit 105 may output the similarity together with the failure name or the abnormality name included in the aggregated destruction pattern 124. In addition, the similarity calculation unit 105 may output a list of the similarities with respect to a respective plurality of the aggregated destruction patterns 124 in order of the similarities.
In the example of
The administrator or the like refers to the display screen 300, and can determine that a failure or an abnormality having a large similarity may occur in a monitored system.
For example, the administrator or the like can determine that a failure of the WEB server (“WEB 2”) having a large similarity may occur on the basis of the display screen 300 of
Accordingly, the operation of the exemplary embodiment of the present invention is completed.
It is to be noted that, in the exemplary embodiment of the present invention, the aggregated destruction pattern generation unit 104 extracts the correlations in which the input metric types and the output metric types are the same, respectively, as the correlations of the same type. However, the aggregated destruction pattern generation unit 104 may extract the correlations in which the input metric type and the output metric type of one side are the same as the output metric type and the input metric type of the other side, respectively, as the correlations of the same type. Similarly, the similarity calculation unit 105 determines that the aggregated correlation and the correlation, in which the input metric types and the output metric types are the same, respectively, are the same type. However, the similarity calculation unit 105 may determine that the aggregated correlation and the correlation, in which the input metric type and the output metric type of one side are the same as the output metric type and the input metric type of the other side, respectively, are the same type.
Next, a characteristic configuration of the exemplary embodiment of the present invention will be described.
Referring to
The correlation destruction pattern storage unit 113 stores a plurality of correlation destruction patterns 123 each of which is a set of correlations in which correlation destruction has been detected among correlations of pairs of metrics in a system. The aggregated destruction pattern generation unit 104 generates an aggregated destruction pattern 124 which is obtained by aggregating correlation destruction patterns 123 of the same type among the plurality of correlation destruction patterns 123. The similarity calculation unit 105 calculates and outputs a similarity between the aggregated destruction pattern 124 and a newly-detected correlation destruction pattern 123.
According to the exemplary embodiment of the present invention, in state detection of a system using a correlation destruction pattern, the versatility of the correlation destruction pattern can be improved. The reason is as follows. The aggregated destruction pattern generation unit 104 generates the aggregated destruction pattern 124 which is obtained by aggregating the correlation destruction patterns 123 of the same type among the plurality of correlation destruction patterns 123. Then, the similarity calculation unit 105 calculates the similarity between the aggregated destruction pattern 124 and the newly-detected correlation destruction pattern 123.
Accordingly, even if there is a change in a correlation model, for example, a device of the same type performing distributed processing is added, by using the aggregated destruction pattern 124 generated on the basis of the correlation destruction pattern 123 at the time of a failure or abnormality in the past, a cause of the failure or the abnormality can be determined. In addition, even if a device in which a failure or abnormality occurred in the past and a device in which a failure or abnormality has occurred at present are devices of the same type performing distributed processing, but different devices, a cause of the failure or the abnormality can be determined using the aggregated destruction pattern 124.
While the invention has been particularly shown and described with reference to exemplary embodiments thereof, the invention is not limited to these embodiments. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the claims.
For example, in the above-described exemplary embodiment, the monitored system is an IT system including a server device, a network device, and the like as the monitored devices 200. However, the monitored system may be another system as long as a correlation model of the monitored system is generated and an abnormality cause can be determined on the basis of correlation destruction. For example, the monitored system may be a plant system such as factory equipment or a power plant, a structure such as a bridge or a tunnel, or transportation equipment such as a vehicle or an aircraft. In this case, the system analysis device 100 generates the correlation model 122 using various sensor values such as a temperature, a vibration, a position, a current, a voltage, a speed, and an angle, as metrics. Then, the system analysis device 100 generates the aggregated destruction pattern 124 and calculates the similarity using sensors that are the same type and behave in the same way (arranged at the same position, for example) as metrics of the same type.
This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-028746, filed on Feb. 18, 2013, the disclosure of which is incorporated herein in its entirety by reference.
The present invention can be applied to a system analysis such as an IT system, a plant system, a physical system, or a social system, which determines a cause of an abnormality or a failure on the basis of correlation destruction detected on a correlation model.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-028746 | Feb 2013 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2014/000613 | 2/5/2014 | WO | 00 |
