Patent Application
20080070222
The demonstration of the knowledge of certain facts in a test does not equate with the ability of the test taker to apply that knowledge in a meaning way. In order to more appropriately adjudge learning and understanding, it has been suggested that performance-based testing be employed. One type of performance-based testing is interactive computer simulation, wherein test items simulate the behavior of a particular software product and ask the user to perform a specified function correctly within that simulation.
A problem associated with interactive computer simulation is that it may be desirable that the test taker demonstrate efficiency with respect to a number of software products not designed to run on the same operating system. Testing of skill in using each of these products in the past might require the employment of a number of different computers. Recently, however, emulation strategies have been developed in the computing environment which allows one of more disparate family software programs to be run on a common piece of hardware.
Such emulation strategies allow for a single piece of hardware, such as a server, to be segregated so as to permit the running of software applications on the common hardware although such applications are normally only executable using a different operating system.
In embodiments of the present invention, emulation strategies are employed to permit individual test takers to be challenged with a number of different software applications irrespectively of the operating system for which they were configured. Such system, for example, would allow a test taker to be tested on his or her skills with Macintosh drawing programs as well as Microsoft Word. However, it is recognized herein that segregation of a server into a number of stand alone virtual servers in itself does not overcome the problem faced by administrators of performance-based tests in having to constantly update and reformat testing to assure that subsequent test takers do not learn from previous test takers.
To overcome such problem, in one embodiment there is provided a number of virtual hard drive images, each of which is directed to a different scenario executable by an application hosted by the virtual server. Such virtual hard drive images can be used by the virtual server image to recreate different application environments, and to proffer different test takers different data within the same application. By changing out the different virtual hard drive image the virtual server image can be reused and re-purposed dramatically reducing the cost to develop performance-based assessment scenarios.
For example, a test taker seeking to show his or her abilities with respect to Visio, or another proprietary drawing program, may be asked to prepare certain charts or drawings. If the test taker is seeking employment in the marketing department of an electrical engineering company, the virtual hard drive image associated with the program may be selected from one or more virtual hard drive images that propose a scenario that requires the test taker to demonstrate proficiency in importing drawings or preparing flow charts. If the test taker is seeking employment as an electrical engineer, the virtual hard drive image for testing purposes may be selected from one or more virtual hard drive images proposing a scenario that requires the test taker to prepare a electric circuit diagram. In each case, the test taker is tested with respect to the test taker's abilities with the drawing program, but each is faced with real-life scenarios that are important to their anticipated tasks at the company.
In one embodiment, the particular virtual hard drive image selected for testing purposes of the application may be in whole or in part selected at random. For example, one test taker electrical engineer may be faced with the task of computer drafting one type of electrical circuit, while another may be faced with the task of computer drafting another type of electrical circuit. The initial selection of virtual hard drive images may be selected in a directed fashion (e.g., an electrical circuit diagram scenario); however, the final selection of which virtual hard drive image is presented to any particular test taker used may be at random. Randomization is useful in preventing one test taker from affecting the response of another test taker, at the time of the test, or at a later date.
The scenario presented to a test taker may be in the form of a series of commands or requests for the test taker to perform. For example, the test taker may be requested to use a software program to determine the stresses and strains on a particular engineered structure, to resolve an IT problem indicated by the scenario to have occurred, or to summarize data necessary to resolve a scenario.
In one embodiment there is provided a software program which automatically grades a test taker's responses to a given PBT. Such program is configured to compare responses (keystrokes, etc,) against a library of responses, each of which has been given a pre-determined point grade value. Such library of responses may be compiled from prior responses or may be actively compiled as a test taker takes the PBT (with appropriate “grading” added thereafter). If a response of a test taker is not found in the library, manual grading may be required.
Now turning to
System server 105 comprises a virtualization software layer 40 which permits creation and execution of different virtual servers (10 to 10′) on the server. System server 105 runs on its own host operating system 45, which may be distinct from the virtual server environments. System server 105 comprises both software and hardware (50) components, and typically is run in a network environment (55) allowing for access by multiple workstations simultaneously.
Each virtual server (10 to 10′) is operatively configured to allow for section of among a plurality of application images (85/90 to 100) and a plurality of virtual hard drive images (60, 65, 70, 75 to 80) to permit a user (5, 5′, 5″, 5′″, and 5″″) to allow for different scenarios with respect to any application program for various test takers based upon the selection of the virtual server (10 to 10′), application image (85/90 to 100) and virtual hard drive image (60, 65, 70, 75 to 80) selected. Virtual hard drive image (60, 65, 70, 75 to 80) may be selected randomly, in whole or in part, to provide for differing scenarios being tendered to test takers on a random basis. By randomly changing the scenario with which a test taker may be confronted, the test taker is not allowed to cheat or rotely learn to pass the test.
While the invention has been described with respect to the foregoing, those skilled in the art will readily appreciate that various changes and/or modifications can be made to the invention without departing from the spirit or scope of the invention as defined by the appended claims.
