Patent Application
20070111182
The invention generally relates to a method and system of distributing answers and, more particularly, to a method and system for distributing test answers in a randomized, weighted or other predetermined order for a standardized test or questionnaire, as one example.
Standardized tests are widely viewed as an objective measure of student achievement and have thus gained widespread acceptance throughout academia. These standardized tests include, for example, norm-referenced tests, criterion-referenced tests, mental ability tests, special placement tests, and aptitude tests, among others. Specific types of standardized tests include, to name a few, LSAT, SAT and MCATS, etc., in addition to a host of tests associated with the “No Child Left Behind” program mandated by the U.S. federal government.
These and other standardized tests typically include a number of questions prepared by a teaching professional or a group of educators. In preparing these tests, for each question, there are a number of answers, usually lettered “A” through “E”. In the current manner of preparing these multiple choice tests, though, the letter (or number) of the correct answer is selected by the person creating the test. However, this can lead to a conscious bias to one particular letter or number.
To aid the student in taking, passing and excelling in these standardized tests, an entire industry has evolved. This industry has developed many effective skills and strategies for approaching standardized testing, important to the student in gaining an advantage when taking such standardized test. Basically, these testing strategies attempt to eliminate giving up points needlessly due to undisciplined testing behavior, irrational responses to test items, or some combination of other counter productive habits. According to test preparation professionals, these strategies serve to equalize the opportunity for all students as well as improve the validity of test results.
These testing strategies and skills may include, amongst others, to follow directions closely, practice using test item formats, review practice items and answers, review questions very carefully noting certain keywords, and practice using answer sheets, all in order to familiarize the student with the particular test. These strategies and skills have been shown to improve testing confidence and hence increase testing scores by making the student more comfortable with the testing situation and format, as well as the opportunity to practice their test-taking skills to refine their abilities.
Further strategies include teaching the student to realize that standardized tests are constructed in such a manner that:
As to the latter strategy, for example, it is well-known that one strategy is to direct the student to always select one letter (or number) for questions they do not know and need to guess. This latter strategy is based on the bias of the test preparer, as discussed above.
Additionally, although it sounds like an urban legend, there is some legitimacy to the strategy that one letter answer, e.g., “C”, is usually used in a test more so than other letters. In such instances, a student which would otherwise not be able to make a passing grade may obtain a passing grade by at least obtaining a correct answer for some portion of the questions by choosing, e.g., “C”. People have even been known to pass tests without trying by simply selecting the same answer for every question, e.g., selecting the same letter answer.
In an aspect of the invention, a system and method comprises tagging correct answers to each of a plurality of questions in order to associate the each of the correct answers to a respective one of the plurality of questions. The system and method further comprises providing an objective criteria for distributing the correct answers for each of the plurality of questions amongst the plurality of questions and distributing the correct answers with relation to one another and the plurality of questions using the objective criteria.
In another aspect of the invention, a system and method comprises associating correct answers and a plurality of incorrect answers to each question of a plurality of questions, and associating a letter or number with each of the correct answers based on a distribution across a total sum of the plurality of questions. The distribution may be based on at least a random distribution, a weighted distribution, a predefined pattern or an equal distribution.
In another aspect of the invention, a computer program product comprising a computer usable medium having readable program code embodied in the medium is provided. The computer program product includes at least one component to:
distribute the correct answers with relation to one another and the plurality of questions using the objective criteria.
The invention is directed to a method and system for ensuring that each letter or number associated with a correct answer of a test or questionnaire will have a certain distribution across a total sum of the questions. This distribution may be, for example, a random distribution, a weighted distribution for each section, subsection or the like, as well as an equal distribution, to name a few. For example, by implementing the invention, each letter or number would be used for an equal number of times or have a weighted distribution, depending on the particular criteria set forth by the test author. Accordingly, the implementation of the invention makes it more difficult for a person taking the test to significantly increase his/her grade simply by selecting one answer for every question.
Furthermore, the invention can take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.
A data processing system suitable for storing and/or executing program code will include at least one processor coupled directly or indirectly to memory elements through a system bus. The memory elements can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code must be retrieved from bulk storage during execution.
Input/output or I/O devices (including but not limited to keyboards, displays, pointing devices, etc.) can be coupled to the system either directly or through intervening I/O controllers. Network adapters may also be coupled to the system to enable the data processing system to become coupled to other data processing systems or remote printers or storage devices through intervening private or public networks. Modems, cable modem and Ethernet cards are just a few of the currently available types of network adapters.
Being more specific and referring to
Still referring to
In the environment thus described, the author can begin authoring a test (or questionnaire) by preparing questions and accompanying answers. This can be accomplished, in one illustrative example, by entering such data into the client workstation 110 and tagging the correct answer to each question (which can be provided by the user or automatically by the system). This will associate the correct answer with the appropriate question. The data can then be transmitted to a server 120 via the network 115 for storage, and more specifically to populate a database or remain in a flat file. Alternatively, the data may remain resident on the client workstation 110 to populate the database or remain in a flat file. Once the data is entered, it may be accessed via the Internet and more particularly the World Wide Web, the client workstation 110, be printed or the like.
In one illustrative example, the author may select any of the following options for the distribution of the correct answers when preparing the test, all of which may be implemented on either hardware or on a computer program product. These options include:
The computer 130 can be programmed to scan the answer sheet and to determine the response to each question and thereafter determine the overall score for the test. In embodiments, it is contemplated that the computer 130 can be programmed with a particular key code, e.g., “ABC”, such that a user can select the key code for a particular test at which time the computer 130 would correlate that code with the test prior to the scoring thereof.
Continuing with the flow of
In the alternative embodiment, the author (or system) can opt to have the distribution spread calculated across sub-sections, at step 215. For example, if the test comprises an English section and mathematics section, the author might have a different number of answers calculated for each section. This would allow test sections that have a different number of answers to not have an adverse effect on the average number of answers.
By way of illustration and expanding upon the English and mathematics example, the English section could have an average of three answers, one correct and two incorrect answers; whereas, the mathematics section could have an average of five answers. Therefore, on a one hundred question test, 50% English and 50% mathematics, the English distribution would be 16.5% of each answer, A-C, while the mathematics section would have a distribution of 10% of each answer, A-E.
In a further embodiment, referring to
In this and other embodiments disclosed herein, the author can also opt to assign a code or key to each test or set of tests, in order to more easily associate the generated test with the appropriate answer key, at step 315. This latter step allows a grader to more easily grade the test, and may also allow a grader to make any correlations between different variations of the test, e.g., conduct statistical analysis between different test patterns. The test and any chosen options may also be saved at step 320, for later access and/or use.
Once the test is generated, it is contemplated that the system of the invention can maintain a database or flat file of created tests and associated options chosen by the author. A subsequent user of the system can request a list of the tests stored in the database (or flat file) such that the system responds by presenting a list of the tests. The tests can then be accessed on the World Wide Web or an individual workstation or printed for use.
The answer sheet as shown in
In another embodiment, the invention provides a business method that performs the process steps of the invention on a subscription, advertising, and/or fee basis. That is, a service provider, such as a Solution Integrator, could offer to system and method of distributing answers. In this case, the service provider can create, maintain, support, etc., a computer infrastructure that performs the process steps of the invention for one or more customers. In return, the service provider can receive payment from the customer(s) under a subscription and/or fee agreement and/or the service provider can receive payment from the sale of advertising content to one or more third parties.
While the invention has been described in terms of embodiments, those skilled in the art will recognize that the invention can be practiced with modifications and in the spirit and scope of the appended claims.
