Patent Application
20150089481
This application claims priority to India Patent Application No. 4294/CHE/2013, filed Sep. 23, 2013, the disclosure of which is hereby incorporated by reference in its entirety.
The present invention relates generally to bug prediction techniques in a software application. More specifically, the present invention relates to a method and system for quantifying a bug detection efficiency of a bug prediction technique applied on the software application.
A current practice of software maintenance includes taking corrective actions, after bugs are reported by end users in software, post deployment of the software. Such practice, results in degradation of software quality, usability and overall response time for support activities. Thus a better approach lies in preventing bugs prior to the deployment of the software. Such an approach may be referred to as preventive maintenance. Preventive maintenance is a means by which one may anticipate and correct the bugs in the software, before the end users detect the bugs post deployment of the software.
A typical bug prediction technique (BPT) may implement approaches such as heuristic, machine learning, and regression analysis on various software artifacts in order to predict and identify potential bugs in the software. Certain bug prediction frameworks, may analyze a source code and a bug history data of the software. However none of the existing BPT, evaluate the efficiency or quality of the BPT, in unraveling the potential bugs in the software. Thus, there exists a challenge in quantifying a preventability of the BPT, in terms of a capability of the BPT in identifying bugs.
Hence an alternative system and method is required for quantifying the BPT applied on the software. A software quality measure known as a bug preventability measure for quantifying the quality and efficiency of the BPT has been proposed. The alternate system and method must compute the preventability measure of the BPT applied on the software. Thus a system and method for quantifying the bug preventability measure of the bug prediction technique is proposed.
The present invention provides a method and system for quantifying a bug preventability measure of a bug prediction technique. In accordance with a disclosed embodiment, the method may include applying a weighted recursive function, on an actual bug count of each version of an application, for computing a golden bug count of the each version. Further, the method shall include deriving a set of source code parameters of the application and applying a linear regression model, on the set of source code parameters of the each version of the application in order to calculate a predicted bug count for the each version. A weighted aggregated deviation between the predicted bug count and the golden bug count of the each version, and a weighted quadratic aggregation of a maximum of the predicted bug count and the golden bug count of the each version may be computed. A bug deviation ratio, which shall be indicative of the bug preventability measure, can be defined as a ratio of the weighted aggregated deviation and the weighted quadratic aggregation.
In an additional embodiment, a system for quantifying a bug preventability measure of a bug prediction technique has been proposed. The system comprises a projection module, configured to compute a golden bug count of each version of an application by applying a weighted recursive function on an actual bug count of the each version. The system further includes a prediction module, configured to compute a predicted bug count of the each version of the application from a set of source code parameters, and a computing module, configured to compute a weighted aggregated deviation between the predicted bug count and the golden bug count of the each version, and a weighted quadratic aggregation of a maximum of the predicted bug count and the golden bug count of the each version. Finally the system shall include a measuring module configured to compute the bug preventability measure as a unitary deviation of a ratio of the weighted aggregated deviation and the weighted quadratic aggregation.
These and other features, aspects, and advantages of the present invention will be better understood with reference to the following description and claims.
While systems and methods are described herein by way of example and embodiments, those skilled in the art recognize that systems and methods for electronic financial transfers are not limited to the embodiments or drawings described. It should be understood that the drawings and description are not intended to be limiting to the particular form disclosed. Rather, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the appended claims. Any headings used herein are for organizational purposes only and are not meant to limit the scope of the description or the claims. As used herein, the word “may” is used in a permissive sense (i.e., meaning having the potential to) rather than the mandatory sense (i.e., meaning must). Similarly, the words “include”, “including”, and “includes” mean including, but not limited to.
Disclosed embodiments provide computer-implemented methods, systems, and computer-program products for quantifying a bug detection efficiency in terms of a bug preventability measure of a bug prediction technique. More specifically the methods and systems disclosed shall parse a source code of a software application and analyze a bug history data of the software application for quantifying and calculating the bug preventability measure.
At step 206, a source code of a latest version of the application can be parsed for obtaining a set of source code parameters. For instance the set of source code parameters may include an afferent coupling (CA), an efferent coupling (CE), an abstractness (A), an instability (I), a distance (D), and a Cycles (V) of the software application. At step 208, the set of source code parameters are derived by processing the step 206. The set of source code parameters can depend on a type of a bug prediction technique used and the type of the software application. For example, a number of interfaces, a number of complex icons, a set of parameters passed, and a depth of a function call tree are important prediction parameters for a graphic user interface (GUI) software application and for a functional program. On the other hand, the afferent coupling, the efferent coupling, the abstractness and a dependency cycle, are important source code parameters for object oriented programs. The type of a bug prediction technique may determine a set of prediction parameters that may be used for bug prediction. Thus, a seed of a bug prediction technique is the set of prediction parameters and the type of the bug prediction technique, used in the bug prediction technique for predicting a final bug count. An instance of a bug prediction technique can be a linear regression model on the set of prediction parameters. However, it is often found that a set of prediction parameters considered by the bug prediction technique may not be sufficient and properly used under the linear regression model for accumulation and prediction of the bugs. The set of prediction parameters selected maybe correct however, due to unavailability of sufficient versions, the linear regression model may not fit well enough for accumulation of the set of prediction parameters across versions. In order to assess an efficiency of the bug prediction technique, at step 210, the linear regression model shall be applied on the set of source code parameters of the each version of the software application for calculating a predicted bug count of the each version. Firstly, based on the actual bug count, a set of linear regression equations shall be solved to find a set of regression co-efficients for the each versions of the software application. A weighted aggregation on the set of source code parameters, a set of regression co-efficient and a set of regression factors shall be applied across all versions for calculation of the predicted bug count. A regression co-efficient varies with the number of versions available and a regression factor varies with the type of the bug prediction technique. An instance of tool that shall provide the set of regression co-efficients and the set of regression factors as a single multiplicative factor associated with the set of source code parameters can be Weka.
At step 212, a weighted aggregated deviation between the predicted bug count and the golden bug count of the each version, and a weighted quadratic aggregation of a maximum of the predicted bug count and the golden bug count of the each version can be calculated. The weighted aggregated deviation, Eβk for a kth version of the software application can be expressed as:
Where
ni+1 refers to the predicted bug count of the i+1th version of the application;
βk refers to the actual bug count of the kth version of the application;
ci refers to a validity bit of the ith version of the application, where ci=1 when the ith version is validated and ci=0 if the ith version is not validated;
εi,i+1: refers to the golden bug count of the ith version of the application
Eβk : refers to the weighted aggregated deviation of the kth version of the application.
Similarly, weighted quadratic aggregation viz. mβk can be expressed as;
Further, at step 214, a bug deviation ratio, shall be computed as a ratio of the weighted aggregated deviation and the weighted quadratic aggregation. The bug deviation ratio may be expressed as:
The bug deviation ratio shall indicate a fraction of the potential bugs deviated in terms of the predicted bug count while applying the bug prediction technique. The bug deviation ratio shall indicate a weakness index of the bug prediction technique. If the bug deviation ratio is less, it shall imply that the bug prediction technique is good in predicting the bugs as there shall be lesser deviations of predicted bug count from the golden bug count viz. an actual projected bug count. Therefore, to represent the efficiency or preventability measure or performance index of the bug prediction technique, the bug deviation ratio could be subtracted from 1 to yield the preventability measure. The preventability measure can be equated as: qm=1−Δr. The bug preventability measure can be an indicator of the bug detection efficiency of the bug prediction technique.
Hence, an event where the bug deviation ratio is less than the preventability measure will be higher. The preventability measure shall lie in a range of [0,1]. A high value of the preventability measure indicates a better efficiency of the bug prediction technique in terms of bug prediction.
One or more of the above-described techniques can be implemented in or involve one or more computer systems.
With reference to
A computing environment may have additional features. For example, the computing environment 400 includes storage 440, one or more input devices 440, one or more output devices 460, and one or more communication connections 470. An interconnection mechanism (not shown) such as a bus, controller, or network interconnects the components of the computing environment 400. Typically, operating system software (not shown) provides an operating environment for other software executing in the computing environment 400, and coordinates activities of the components of the computing environment 400.
The storage 440 may be removable or non-removable, and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other medium which can be used to store information and which can be accessed within the computing environment 400. In some embodiments, the storage 440 stores instructions for the software 480.
The input device(s) 450 may be a touch input device such as a keyboard, mouse, pen, trackball, touch screen, or game controller, a voice input device, a scanning device, a digital camera, or another device that provides input to the computing environment 400. The output device(s) 460 may be a display, printer, speaker, or another device that provides output from the computing environment 400.
The communication connection(s) 470 enable communication over a communication medium to another computing entity. The communication medium conveys information such as computer-executable instructions, audio or video information, or other data in a modulated data signal. A modulated data signal is a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired or wireless techniques implemented with an electrical, optical, RF, infrared, acoustic, or other carrier.
Implementations can be described in the general context of computer-readable media. Computer-readable media are any available media that can be accessed within a computing environment. By way of example, and not limitation, within the computing environment 400, computer-readable media include memory 420, storage 440, communication media, and combinations of any of the above.
Having described and illustrated the principles of our invention with reference to described embodiments, it will be recognized that the described embodiments can be modified in arrangement and detail without departing from such principles. It should be understood that the programs, processes, or methods described herein are not related or limited to any particular type of computing environment, unless indicated otherwise. Various types of general purpose or specialized computing environments may be used with or perform operations in accordance with the teachings described herein. Elements of the described embodiments shown in software may be implemented in hardware and vice versa.
As will be appreciated by those ordinary skilled in the art, the foregoing example, demonstrations, and method steps may be implemented by suitable code on a processor base system, such as general purpose or special purpose computer. It should also be noted that different implementations of the present technique may perform some or all the steps described herein in different orders or substantially concurrently, that is, in parallel. Furthermore, the functions may be implemented in a variety of programming languages. Such code, as will be appreciated by those of ordinary skilled in the art, may be stored or adapted for storage in one or more tangible machine readable media, such as on memory chips, local or remote hard disks, optical disks or other media, which may be accessed by a processor based system to execute the stored code. Note that the tangible media may comprise paper or another suitable medium upon which the instructions are printed. For instance, the instructions may be electronically captured via optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
The following description is presented to enable a person of ordinary skill in the art to make and use the invention and is provided in the context of the requirement for a obtaining a patent. The present description is the best presently-contemplated method for carrying out the present invention. Various modifications to the preferred embodiment will be readily apparent to those skilled in the art and the generic principles of the present invention may be applied to other embodiments, and some features of the present invention may be used without the corresponding use of other features. Accordingly, the present invention is not intended to be limited to the embodiment shown but is to be accorded the widest scope consistent with the principles and features described herein.
While the foregoing has described certain embodiments and the best mode of practicing the invention, it is understood that various implementations, modifications and examples of the subject matter disclosed herein may be made. It is intended by the following claims to cover the various implementations, modifications, and variations that may fall within the scope of the subject matter described.
| Number | Date | Country | Kind |
|---|---|---|---|
| 4294/CHE/2013 | Sep 2013 | IN | national |
