The present disclosure relates to testing computer software applications in general, and more particularly to detecting error states when interacting with web applications.
So-called “web” applications typically include interrelated Hypertext Markup Language (HTML)-encoded web pages that are hosted by a computer server for access by one or more client computers via a computer network, such as the Internet. When testing web applications, dynamic analysis, or “black-box,” tools typically employ “crawling” techniques to navigate to the various web pages of a web application in order to expose its various interfaces for testing. Such techniques typically require a degree of interaction with the web pages as well. For example, to test a banking application properly, a dynamic analysis tool would typically have to log in with valid credentials and provide input to one or more transaction screens for each of the banking operations.
The effectiveness of such dynamic analysis tools depends on their ability to uncover an application's interfaces, which in turn depends on their ability to navigate from one web page to another. Thus, for example, if a dynamic analysis tool navigates to a web page and encounters an error state, and the error state prevents the dynamic analysis tool from navigating to another web page and uncovering and testing its interfaces, this may result in a partial analysis, giving the tester the false impression that the application is safer and/or better than it really is. This is particularly problematic if the dynamic analysis tool is unable to determine that such an error state has been encountered.
In one embodiment of the invention, a method is provided for detecting error states when interacting with web applications. The method includes accessing a first web page of a web application, determining that the first web page includes an input validation operation, configuring an input to cause the input validation operation to effect an error state, providing the input to the first web page, thereby effecting the error state, identifying a feature that is absent from the first web page before the input is provided to the first web page and present in the first web page after the input is provided to the first web page, and detecting that a second web page of the web application is in an error state if the feature is present in the second web page.
In other embodiments of the present invention, systems and computer program products are provided.
Embodiments of the present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the appended drawings in which:
The embodiments of the present invention will now be described, although the description is intended to be illustrative of the invention as a whole, and is not to be construed as limiting the invention to the embodiments shown. It is appreciated that various modifications may occur to those skilled in the art that, while not specifically shown herein, are nevertheless within the true spirit and scope of the invention.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical data storage device, a magnetic data storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java™, Smalltalk™, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects of the present invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Reference is now made to
For any web page 102 that includes an input validation operation: a web application tester 106 is configured to configure an input to cause the input validation operation to effect an error state, and provide the input to the web page 102, thereby effecting the error state; and an error state detector 108 is configured to identify any feature that is absent from the web page before the input is provided to the web page, and present in the web page after the input is provided to the web page.
In an embodiment, web application analyzer 100, web application tester 106, and error state detector 108 process multiple web pages 102 of web application 104 in the manner described above, where error state detector 108 is configured to determine which of the aforementioned features are common to a predefined number or percentage of the web pages 102.
Error state detector 108 is configured to use such identified features to detect that any given web page 102 of web application 104 is in an error state if the features are present in the given web page 102.
Once error state detector 108 detects that a given web page 102 of web application 104 is in an error state, web application tester 106 may be configured to provide one or more different, and randomly configured, inputs to the given web page 102 until the features are absent from the given web page, thus bypassing the error state. Additionally or alternatively, web application analyzer 100 is configured to analyze the input validation operation of any given web page 102, such as by statically analyzing software instructions associated with the input validation operation, to identify one or more characteristics of the input validation operation, where web application tester 106 is configured to configure any of the different inputs based on the identified characteristics in order to bypass the error state.
In an alternative embodiment, a crawler 110 is configured to access and navigate between web pages 102 using conventional crawling techniques, where crawler 110 provides web application analyzer 100, web application tester 106, and error state detector 108 with access to the crawled web pages 102. Any of web application analyzer 100, web application tester 106, and error state detector 108 is optionally embodied in crawler 110.
Any of the elements shown in
Reference is now made to
The system of
Referring now to
As shown, the techniques for controlling access to at least one resource may be implemented in accordance with a processor 510, a memory 512, I/O devices 514, and a network interface 516, coupled via a computer bus 518 or alternate connection arrangement.
It is to be appreciated that the term “processor” as used herein is intended to include any processing device, such as, for example, one that includes a CPU (central processing unit) and/or other processing circuitry. It is also to be understood that the term “processor” may refer to more than one processing device and that various elements associated with a processing device may be shared by other processing devices.
The term “memory” as used herein is intended to include memory associated with a processor or CPU, such as, for example, RAM, ROM, a fixed memory device (e.g., hard drive), a removable memory device (e.g., diskette), flash memory, etc. Such memory may be considered a computer readable storage medium.
In addition, the phrase “input/output devices” or “I/O devices” as used herein is intended to include, for example, one or more input devices (e.g., keyboard, mouse, scanner, etc.) for entering data to the processing unit, and/or one or more output devices (e.g., speaker, display, printer, etc.) for presenting results associated with the processing unit.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will be appreciated that any of the elements described hereinabove may be implemented as a computer program product embodied in a computer-readable medium, such as in the form of computer program instructions stored on magnetic or optical storage media or embedded within computer hardware, and may be executed by or otherwise accessible to a computer.
While the methods and apparatus herein may or may not have been described with reference to specific computer hardware or software, it is appreciated that the methods and apparatus described herein may be readily implemented in computer hardware or software using conventional techniques.
While the invention has been described with reference to one or more specific embodiments, the description is intended to be illustrative of the invention as a whole and is not to be construed as limiting the invention to the embodiments shown. It is appreciated that various modifications may occur to those skilled in the art that, while not specifically shown herein, are nevertheless within the true spirit and scope of the invention.
This application is a continuation of the legally related U.S. application Ser. No. 15/061,146 filed Mar. 4, 2016 which is a continuation of legally related U.S. application Ser. No. 14/040,906 filed Sep. 30, 2013, which has now issued as U.S. Pat. No. 9,323,649B2, issued on Apr. 26, 2016; both of which are fully incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
8839201 | Schissel et al. | Sep 2014 | B2 |
20050086643 | Shane | Apr 2005 | A1 |
20070074188 | Huang | Mar 2007 | A1 |
20080109680 | Kodaka | May 2008 | A1 |
20130159975 | Hu | Jun 2013 | A1 |
20150095721 | Beskrovny | Apr 2015 | A1 |
Number | Date | Country | |
---|---|---|---|
20160350210 A1 | Dec 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15061146 | Mar 2016 | US |
Child | 15245417 | US | |
Parent | 14040906 | Sep 2013 | US |
Child | 15061146 | US |