The present invention relates generally to the field of testing and measuring cognitive mathematical ability. The present invention is a method and system for numerically measuring mathematical fitness through the measurement of a performance metric, a persistence metric, and a creativity metric based on a user solving an open-ended mathematical problem.
For most of the history of mathematics, the primary focus was on computation. Successful citizenry required mastery of a set of basic computation skills. Even in jobs that required higher mathematics, such as algebra, the focus was on computation. Learning mathematics consisted largely of practice to mastery of a set of standard procedures for carrying out numeral or symbolic calculations. Testing and credentialing of mathematical mastery asked candidates to solve, under controlled conditions, a number of problems using those standard procedures. But with today's ubiquitous availability of cheap, powerful computational devices, the need for mathematical skills has changed. In the 21st Century, the crucial ability is to make effective use of that computational resource. The key ability has transitioned from mastery of procedures to creative problem solving—frequently referred to as mathematical thinking. Testing and credentialing has to focus on that newly important ability. The present invention is a novel method for measuring mathematical fitness, which is the capacity to engage in productive mathematical thinking.
Currently, automated testing methods only check answers to problems, not how the problems were solved. Moreover, in order to implement at scale, the problems used are overwhelmingly presented in a multiple-choice format. Selecting one from a small number of presented possible answers as a solution to a problem is not the same as solving the problem when the problem is presented with no indication of what the solution may be. These factors mean those problems are not truly open-ended and do not assess the thinking that led to the solution. Therefore, new metrics and new testing methods are required. Since the essence of 21st Century mathematical thinking is the ability to solve a novel problem that does not easily fit a standard template, the key capacity to be measured is mathematical fitness.
The present invention measures mathematical fitness by means of three factors: performance (embodying completion, correctness and efficiency), persistence, and creativity.
The best, scalable, current assessment methods attempt to measure all three aspects of mathematical problem solving but the use of multiple-choice questions is a significant limitation and the notion of “creativity” they measure is simplistic. The current methods are used because, given currently available assessment technology, they are the only ones that can be implemented at scale. The present invention provides a method to measure all three factors at scale through the application of novel assessment technology.
All illustrations of the drawings are for the purpose of describing selected versions of the present invention and are not intended to limit the scope of the present invention.
The present invention relates to the field of cognitive testing. More specifically, the present invention is a method and system for numerically measuring mathematical fitness in order to quantify the creative solving ability of an individual. This is achieved through the use of an extended test interaction where the individual is asked to solve a series of open-ended problems or puzzles through a computing device. Two important aspects about this assessment is that there are no multiple-choice questions and that the individual must carry out all key steps of the problem, or puzzle, with the computing device. This allows the present invention to monitor and track every step that the individual goes through in order to solve the problem or puzzle; repeating the procedure for a variety of problems and a number of individuals to yield raw descriptive information. The raw descriptive information is used to measure a performance score, a persistence score, and a creativity score for each individual; which are then used to calculate an overall mathematical intelligence score for each individual. It is important to implement the present invention on a large group of people. A significant sample size ensures that significant, reliable, and more fine-grained data is obtained that not only reflects the cognitive ability of each individual but also can be used to make inferences and predictions about a corresponding population.
The present invention includes a method and a system in order to test and assess the mathematical cognitive ability of a plurality of user accounts. The plurality of user accounts represent a group of individuals; preferably a group of individuals with equal or similar educational levels such that an equal comparison can be made between them. The present invention is described in relation to an arbitrary account, wherein the arbitrary account represents any one of the user accounts. The method is executed by the system in the form of a software application. In particular, referring to
A variety of mathematical problems may be used for the present invention in order to suit the education level of the plurality of user accounts. In alternative embodiments of the present invention, the mathematical problem is replaced by a puzzle that may or may not represent a mathematical problem. The ideal problem is an open-ended problem that can be solved a multitude of ways with each way being associated with a correct answer. Furthermore, the ideal problem also requires the individual to interact with the PC device in a step-by-step fashion such that each step may be monitored and recorded.
In general, prior to implementation, the present invention must first be provided with a plurality of mathematical problems, wherein each of the mathematical problems is associated with a plurality of solutions and a plurality of known solving procedures (Step B). A solution is a number, symbol, word, or phrase that is the answer to the associated mathematical problem. A known solving procedure is the entire sequence of steps that need to be taken to reach the solution for the associated mathematical problem. The present invention is further provided with usage frequency data for the plurality of known solving procedure (Step C). The usage frequency data depicts the number of times each of the plurality of known solving procedures is used. During the execution of the present invention, the usage frequency data is continuously updated based on the user solving procedures of each of the user accounts. In alternative embodiments, the usage frequency data is obtained from external testing or other external origins. The plurality of known solving procedures and the usage frequency data are stored on the external server.
Referring to
Continuing the overall process, the external server continuously monitors step D and step E in order to measure the performance score and the persistence score for the arbitrary account as well as record a user solving procedure for the arbitrary account (Step G). The performance score reflects the degree to which the mathematical problem is solved, a variety of factors may be used to determine this metric. Since performance score is, by and large, what current assessment methods primarily measure, there are many procedures and algorithms that can be used as a basis for the computation of the performance score. The persistence score is a measure of the degree to which the arbitrary account will continue to work on the mathematical problem, trying different approaches, until one of the solutions is reached or else adequate progress is made. Next, the external server measures the creativity score for the arbitrary account by comparing the user solving procedure of the arbitrary account to the usage frequency data (Step H). The creativity score measures the degree to which the answering data of the arbitrary account shows novelty, described in further detail below. Finally, through the PC device, the present invention enables the arbitrary account to view a performance portfolio (Step I) in order to provide performance feedback to the arbitrary account. The performance portfolio includes the performance score, the persistence score, and the creativity score for the arbitrary account in regards to the mathematical problem.
The performance score quantifies the degree of correctness of the arbitrary account for the mathematical problem. Referring to
Referring to
Referring to
The persistence score quantifies the effort and time that the arbitrary account puts into solving or attempting to solve the mathematical problem. This metric is possible to measure because the present invention is centered around open-ended problems that require several steps/stages to obtain the solution. In one embodiment of the present invention, in order to measure the persistence score, the arbitrary account is provided with a notification after Step F which indicates if he or she has identified one of the solutions. The notification allows the present invention to quantify the number attempts that the arbitrary account takes before either giving up or solving the mathematical problem.
More specifically, referring to
Referring to
The creativity score reflects the degree of novelty shown by the arbitrary account while solving the mathematical problem. The creativity score depends on which of the plurality of known solving procedures is used to solve the mathematical problem. In order to measure the creativity score, the present invention is provided with the usage frequency data for the plurality of known solving procedures. This includes data on how often each of the plurality of known solving procedures is used to solve the mathematical problem. A variety of means may be used to obtain the usage frequency data. Referring to
In one embodiment of the present invention, a low frequency solving procedure is assigned a higher rank as this indicates thinking outside the norm. Complimentary, a high frequency solving procedure is assigned a lower rank. Equipped with this information, the creativity score of the arbitrary account is proportionately adjusted according to the frequency rank of the user solving procedure. A more novel solving procedure, a low frequency solving procedure, yields in a higher creativity score; a more common solving procedure, a high frequency solving procedure, yields in a lower creativity score.
In an alternative embodiment, the administrative entity assigns a weight to each of the known solving procedures, defining which solving procedure requires a more creative mindset. The weight of the known solving procedure is then used to determine the creativity score of each of the plurality of user accounts.
Referring to
Referring to
The external server then compares the performance portfolio of the arbitrary account against the performance portfolio of each of the user accounts in order to calculate a relative ranking value for the arbitrary account. In particular, the present invention calculates the relative ranking value of the arbitrary account in relation to any individual constituents, or any combination of the constituents, of the performance portfolio. The relative ranking value is then added to the performance portfolio of the arbitrary account and may be displayed through a variety of means including, but not limited to, graphs, charts, simple numbers, percentages, or other traditional means. It is preferred that the arbitrary account is provided with all the information within the performance portfolio, starting with a broad overview of his or her performance to the individual score for each of the mathematical problems; this allows for the arbitrary account to see what type of mathematical problems he or she needs to work on.
In alternative embodiments, the method of the present invention may be applied to alternative fields of study such as biology, physics, engineering, and other similar fields.
Although the invention has been explained in relation to its preferred embodiment, it is to be understood that many other possible modifications and variations can be made without departing from the spirit and scope of the invention as hereinafter claimed.
The current application claims a priority to the U.S. Provisional Patent application Ser. No. 62/116,707 filed on Feb. 16, 2015.
Number | Date | Country | |
---|---|---|---|
62116707 | Feb 2015 | US |