The present invention relates to a system and method for collecting data regarding on-line learning assessments and analysing same. The system and method is particularly useful for maintaining a record of an individual's progress regarding their learning journey and may also be useful when seeking to identify learning disabilities that are typically difficult to identify and assess in situations that require consistent and regular monitoring of an individual's progress over an extended period of time, for example, over a number of years.
Traditional methods of monitoring a student's academic progress in a particular field of study involve requiring the student to undertake one or more assessments with a view to understanding the student's knowledge based solely on the student's responses to a particular assessment in isolation of other factors, including their performance in other areas of study and in different educational institutions.
Due to the isolated nature of traditional forms of assessment, an assessor is only able to gain a limited insight into a student's academic progress in a particular field of study. Moreover, when a student underperforms in an assessment, the assessor often concludes, incorrectly, that the student has failed to apply themselves. In other words, this factor is considered the sole basis for their underperformance in an assessment, and fails to give consideration to other possible reasons for the student's poor, or suboptimal, performance (e.g. one or more underlying learning disorders).
Furthermore, as more learning activities and assessments are moving from a classroom environment toward an online environment, teachers do not have the benefit of face-to-face interaction with their students and thereby often miss subtle queues and indicators regarding learning difficulties/disorders or particular problems with specific types of subject matter that may impede or retard a student's academic progress.
Existing systems and methods of learning and assessment, particularly when conducted in an online environment, do not facilitate assessors identifying one or more indicators of underperformance including disabilities or learning disorders of students. In particular, existing systems and methods of assessing a student's academic progress do not take into account, or are unable to take into account, a student's individual learning difficulties, learning styles or any learning disabilities the student may have (e.g. dyslexia, disgraphia, dyscalcula, auditory processing disorders, language processing disorders, nonverbal learning disabilities and/or visual perceptual/visual motor deficit).
Accordingly, there exists a need for a system and method that addresses the abovementioned problems associated with existing learning and assessment systems and methods, or at least provides an alternative to same. More particularly, there exists a need for a system and method that enables the automated collection and analysis of data to assist the identification of academic underperformance including disabilities and learning disorders in students in a consistent and objective manner, and thereby assist rectification such that students realise their full academic potential.
The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement or any suggestion, that the prior art forms part of the common general knowledge.
In one aspect, the present invention provides a computer-implemented system for facilitating the collection and analysis of academic assessment data, the system including one or more processors in operable communication with one or more devices, each device operable by a student and configured to connect with a data communications network such that any information requested of, received by, or relating to the student, is retrieved from, and/or stored in, a data repository connected to the data communications network, the one or more processors operable to request information from the student in accordance with an assessment, receive data entered by the student using their device in response to the request for information, the data entered by the student including any one or more of, a selected option from a number of options presented to the student, a hand-written text or numeric answer, a text or numeric answer entered using a keyboard, and a voice capture, receive additional data from one or more assessors associated with the student as the student progresses through their educational journey from the commencement of primary school through to their final year of high school, receive current and/or historical information relating to educational instructions attended by the student, retrieve data stored in the data repository associated with the student, perform an analysis upon the received data from the student, the retrieved data associated with the student, the additional data received from the one or more assessors, and the current and/or historical information relating to educational institutions attended by the student, to determine the education proficiency of the student according to the assessment and further identifying the presence of one or more indicators regarding one or more learning disorders associated with the student, wherein the analysis is performed by a voice recognition algorithm for assessment of word and sound pronunciation of voice recorded data, and any one or more of a reading analysis algorithm for assessment of a reading proficiency, a spelling analysis algorithm for assessment of spelling proficiency, or a mathematical analysis algorithm for assessment of mathematical proficiency, wherein each of the algorithms operate according to a benchmark associated with a particular question or activity, and generate a report regarding the determined educational proficiency and/or presence of the one or more identified indicators for subsequent storage and/or transmission, and further automatically adjust any future assessments to suit the determined educational proficiency and/or the one or more identified indicators regarding one or more learning disorders associated with the student.
Embodiments of the present invention may find particular application with respect to on-line learning arrangements wherein students receive and complete educational assessments using a computing device (e.g. computer tablet) that collects data for each student with the data subsequently analysed using a reading, spelling and/or mathematical analysis algorithm to determine the educational proficiency of the student and the identification of any possible learning difficulties or disabilities.
In a particular embodiment, the system is used by students from a very young age (e.g., kindergarten) through to their final year of high school and whilst collecting data for each student as they progress through their educational journey, any data and/or analysis is collected and stored in the data repository for sharing with future teachers. It will be appreciated that the sharing of such data may be particularly useful if a student transfers from one school to another or transitions from primary school to high school or high school to tertiary education.
In an embodiment, the analysis may include the implementation of one or more algorithms operable to determine the presence of one or more indicators regarding one or more learning difficulties or disorders associated with the student.
In an embodiment, the one or more indicators may relate to one or more learning difficulties or disorders with respect to reading, spelling and mathematics.
In an embodiment, the data collected by the system may include recorded voice data, and the analysis includes voice recognition algorithms such that word and sound pronunciation may be assessed.
In an embodiment, the data stored in the data repository may be made available for review by the student and/or assessors.
In an embodiment, the system may perform analysis to determine the presence of indicators regarding learning difficulties or disorders including, but not limited to, dyslexia, disgraphia, dyscalcula, auditory processing disorders, language processing disorders, nonverbal learning disabilities and visual perceptual/visual motor deficit.
In an embodiment, the data repository stores further information regarding the expected education proficiency for individual students of different ages and the one or more processors apply the educational proficiency expected for individual students and compare same with an actual education proficiency of each student determined from the assessments.
In an embodiment, the one or more processors are further operable to adjust assessments to suit the educational proficiency of individual students according to individual requirements, disabilities or learning disorders of the students as identified by the system.
In an embodiment, the one or more processors are operable to provide the assessors and/or parents/guardians with one or more notifications identifying notable events with respect to the assessment of a student.
In an embodiment, the one or more processors are operable to conduct various trend analyses with respect to student assessment in order to determine individual student progress and identify trends that will likely result in difficulty for a student to achieve an expected educational proficiency in the future. In this regard, it is often the case that whilst assessors are able to identify significant events that indicate a potential learning disorder, often learning disabilities/disorders in an individual are not accompanied by any significant signs or queues, and are therefore missed. This is particularly the case if the progress of a student's educational proficiency is not followed/monitored over a sufficient period of time in an objective and consistent manner.
In this regard, it will be appreciated that a number of factors may affect an assessor's ability to detect one or more indicators of a disability or learning disorder of a student. Such factors include, but are not limited to, the assessor's level of training, skill and expertise, or an assessor's ability to perceive an indicator of a disability or learning disorder. Accordingly, depending on the assessor, different (and sometimes incorrect) conclusions may be formed regarding a student's academic proficiency and thereby suboptimal remedies and courses of action may be suggested in an attempt to facilitate a student's academic progress.
The system and method of the present invention thereby seeks to provide a consistent and objective method of assessing a student's educational/academic proficiency. In particular, the system and method of the present invention may be used to assess a student's educational proficiency/academic performance over sufficient periods of time to identify queues and/or signs (indicators of any difficulties, disabilities or learning disorders associated with the student) that may otherwise be imperceptible to an assessor when teaching/assessing a student in an online environment and, in particular, when teaching/assessing the student in the absence of any knowledge regarding the student's prior academic history and performance. It will be appreciated that the ability of the present system and method to identify trends in a student's progress that may otherwise be imperceptible to an assessor relying upon their subjective skills of identifying indicators of disabilities and learning disorders, advantageously allows for early intervention and better prospects for successful learning outcomes and student academic progress.
In one particular embodiment, the analysis performed to determine the educational proficiency of the student takes into account indigenous ways of learning such that learning difficulties may be detected where the cause of difficulty relates to a difference between the students preferred learning style as compared with style of the subject matter delivery. Of course, this embodiment may be particularly useful for indigenous students and improving indigenous literacy and numeracy statistics.
It will be appreciated that in various embodiments, the system is operable to enable students and/or assessors to access the system from anywhere, and at any time, such that learning and student assessment is not restricted to any geographical location or time zone.
In another aspect, the present invention provides a computer-implemented method for facilitating the collection and analysis of academic assessment data, the method including requesting, by one or more processors associated with a computer-implemented system, information from a student in accordance with an assessment, receiving, by the one or more processors, data entered by the student in response to the request for information using a device operable to connect with a data communications network and storing the data in a data repository connected to the data communications network, the data entered by the student including any one or more of, a selected option from a number of options presented to the student, a hand-written text or numeric answer, a text or numeric answer entered using a keyboard, and a voice capture, receive additional data from one or more assessors associated with the student as the student progresses through their educational journey from the commencement of primary school through to their final year of high school, receive current and/or historical information relating to educational instructions attended by the student, retrieving, by the one or more processors, the data associated with the student stored in the data repository, performing, by the one or more processors, an analysis upon the data associated with the student, the additional data received from the one or more assessors, and the current and/or historical information relating to educational institutions attended by the student, to determine the educational proficiency of the student according to the assessment and further identifying the presence of one or more indicators regarding one or more learning disorders associated with the student, wherein the analysis is performed by a voice recognition algorithm for assessment of word and sound pronunciation of voice recorded data, and any one or more of a reading analysis algorithm for assessment of a reading proficiency, a spelling analysis algorithm for assessment of spelling proficiency, or a mathematical analysis algorithm for assessment of mathematical proficiency, wherein each of the algorithms operate according to a benchmark associated with a particular question or activity, and generating, by the one or more processors, a report regarding the determined educational proficiency and/or presence of the one or more identified indicators for subsequent storage and/or transmission, and further automatically adjust any future assessments to suit the determined educational proficiency and/or the one or more identified indicators regarding one or more learning disorders associated with the student.
In a further aspect, the present invention provides a computer-readable medium that when executed on a computer, causes one or more processors of the computer to perform the steps of request information from a student in accordance with an assessment, receive data entered by the student in response to the request for information using a device operable to connect with a data communications network and storing the data in a data repository connected to the data communications network, the data entered by the student including any one or more of, a selected option from a number of options presented to the student, a hand-written text or numeric answer, a text or numeric answer entered using a keyboard, and a voice capture, receive additional data from one or more assessors associated with the student as the student progresses through their educational journey from the commencement of primary school through to their final year of high school, receive current and/or historical information relating to educational instructions attended by the student, retrieve the data associated with the student stored in the data repository, perform an analysis upon the data associated with the student, the additional data received from the one or more assessors, and the current and/or historical information relating to educational institutions attended by the student, to determine the educational proficiency of the student according to the assessment and further identify the presence of one or more indicators regarding one or more learning disorders associated with the student, wherein the analysis is performed by a voice recognition algorithm for assessment of word and sound pronunciation of voice recorded data, and any one or more of a reading analysis algorithm for assessment of a reading proficiency, a spelling analysis algorithm for assessment of spelling proficiency, or a mathematical analysis algorithm for assessment of mathematical proficiency, wherein each of the algorithms operate according to a benchmark associated with a particular question or activity, and generate a report regarding the determined educational proficiency and/or presence of the one or more identified indicators for subsequent storage and/or transmission, and further automatically adjust any future assessments to suit the determined educational proficiency and/or the one or more identified indicators regarding one or more learning disorders associated with the student.
Embodiments of the invention will now be described in further detail with reference to the accompanying Figures in which:
For simplicity and illustrative purposes, the present disclosure is described by referring to embodiment(s) thereof. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the disclosure. It will be readily apparent, however, that the current disclosure may be practiced without limitation to the specific details. In other instances, some methods and structures have not been described in detail to avoid obscuring disclosure.
According to an embodiment, the present invention relates to a system and method for facilitating the correction and analysis of academic assessment data as depicted in
The central server (20) maintains one or more processors and/or databases for performing functions, including requesting information from a student (30) in accordance with an assessment (310), and receiving data (312/314/316) input by the student (30) in response to the request for information. The student (30) uses their data communication device (50) to input the data, which is operable to connect with the server (20) via a data communications network, the server (20) operable to store the data in a data repository (160). The server (20) may then retrieve the data associated with the student (30) and perform an analysis (e.g. using artificial intelligence analysis engine (170)) upon the data associated with the student (30) to determine the educational proficiency of the student (30) according to the assessment. The server (20) may further determine the presence of one or more indicators regarding one or more learning disorders associated with the student (30).
The person skilled in the relevant field of technology will appreciate that the platform provides a solution that provides teachers/administrators (60), and others who have an interest in the education of students (30) (e.g. parents and/or caregivers), with the ability to regularly assess the learning of the students (30). Through the use of the artificial intelligence engine (170), the users (60) may identify students who are progressing well through a syllabus, for example, as compared with those who are struggling with the content (taking into account additional factors including learning disorders associated with the student (30), etc). In this way, the application (70) may be utilized to identify learning difficulties in the student (30) so that early intervention and assistance can be provided to prevent students (30) falling behind.
The server component (20) is additionally detailed in
As an alternative, or in addition to, steps described herein as performed by the server (20) the steps described may be performed by one or more processors associated with the user devices (50) (i.e. in a distributed architecture). Different arrangements are possible in this regard, but according to a particular implementation of the present invention, the server (20) is programmed to provide all of the functions described herein where they cannot be provided locally on the user devices (50).
Segment 300 of
As mentioned above,
It is to be understood that the server (20) may utilize data stored in any one or more of the above-described databases and repositories, or any external data source, regarding the expected educational proficiency for individual students of different ages. This data may be utilized to establish an expected proficiency (i.e. threshold or benchmark) against which to compare an actual education proficiency of each student determined from the assessments. The server (20) may be further operable to adjust assessments automatically in order to suit the educational proficiency of individual students according to individual requirements, disabilities or learning disorders of the students as identified by the system.
The application (70) may also enable, for example via interface (250) shown in
As described above, the user student account register (100) may capture information sufficient to enable each student to be correctly identified. Alternatively, a student's account may be set up by the educational institution responsible for the student for and on behalf of the student (30).
Once the application (40) has been accessed by student (30), the student (30) may be presented with an interface (280) that allows the student (30) to create and maintain a student profile that will subsequently enable students (30) (as well as teachers/administrators (60)) to view information about the student (30), and further allow students (30) to manage their student profile. The profile may contain basic information about the student including name, age, location, school, etc. and over time, the student's profile may include additional information such as a history of past schools/institutions, assessment and educational achievements. The student profile may also include information relating to any learning difficulties or disorders associated with the student (30), as determined by the system. Such difficulties or disorders may include, but are not limited to, dyslexia, dysgraphia, dyscalculia, auditory process disorders, language processing disorders, non verbal learning difficulties and visual perceptional, visual motor deficits.
The type of answer captured will depend upon the particular device capabilities, and the assessment question/activity. For example, answers may be input by way of selecting an option that is presented on the interface (310), writing text or numeric answers, hand-writing or voice capture. For example,
Accordingly, it will be appreciated that depending upon the classroom arrangements, students may either be notified by the application (40) or requested by their teacher (60) to take an assessment that the teacher (60) has scheduled on the application. The student (30) may locate the assessment from a listing of assessments to be completed, for example, and the application (40) may then assess the student (30) through a range of online questions and/or activities. The application (40) will capture the student's answers/response to questions and activities, and the type of answers/response captured will depend upon the device capabilities, as described above.
The analysis of a student's answers/response to questions and/or activities may be carried out by the artificial intelligence analysis engine (170), which may implement one or more algorithms that in addition to assessing an education proficiency of the student (30) is also operable to determine the presence of one or more indicators regarding learning difficulties and/or disorders associated with the student (30). For example, the one or more indicators may relate to learning difficulties and/or disorders with respect to reading, spelling or mathematics. In the case where the data received from the student (30) is in the form of a voice recording, the analysis may involve the implementation of voice recognition algorithms such that word and sound pronunciation may be assessed. Additional algorithms may be implemented so that an appropriate analysis of the student's answers/response may be undertaken, including for example, a reading, spelling or mathematical analysis algorithm to determine the educational proficiency of the student (30).
The algorithms may operate on the basis of benchmarks or thresholds, that is, whereby particular answers or responses from each student (30) are compared against the particular benchmark or threshold associated with a particular question or activity. Where the student's answers/response satisfies the benchmark or threshold, a particular educational proficiency level (as well as a particular learning difficulty and/or disability) may be determined and the particular student may be categorized accordingly. For example, based on the analysis results, it may be determined that student (30A) has an acceptable educational proficiency with no learning difficulties or disabilities, whilst student (30B) is found not to satisfy the particular benchmark or threshold associated with a particular question or activity and is therefore determined as having an educational proficiency that requires additional monitoring or assistance. It may further be further determined that student (30C) has a particular learning difficulty and/or disability based on the analysis of the answers/response provided by student (30C) during a single assessment, or based upon the answers/response provided over multiple assessments.
It will be appreciated that by collecting data regarding online learning assessments and analyzing same in this manner, a record of a student's progress along their learning journey may be recorded, providing a useful repository of data for identifying learning disabilities that are otherwise difficult to identify and assess in situations that require consistent and regular monitoring of a student's progress over an extended period of time, e.g. over a number of years. The sharing of such data may be particularly useful if a student transfers from one school or institution to another or transitions from primary school to high school to tertiary school.
The teacher (60) may select a particular student from the listing in order to be provided with additional information relating to the student's answers and results. In this regard, interface (330) is an example interface provided to teacher's (60) to enable teachers (60) to view a detailed report on the selected students progress based upon assessments (130) and the artificial intelligence analysis (170). The report may also show assessment results (160), as well as trends and any identified learning difficulties (190). As required, such reports may be printed and shared with parents and students to indicate progress and determine when interventions may be required.
Both software applications (40/70) may generate alerts and/or notifications to the teachers (60) as well as to the students (30). For example, the notifications may identify notable events with respect to the assessment of a student (30), such as a higher than average result with respect to a particular test or assessment, or on the other hand a lower than average result.
An additional benefit of storing the various inputs by students (30) in response to questions and activities, and the results of analysis conducted by the artificial intelligence engine (170) and any additional processing techniques performed by server (20) with respect to the assessment of students and their learning difficulties and/or disorders, is that the server (20) may subsequently be used to conduct various additional analyses based on historical data, such as trend analyses and the like. A trend analysis with respect to student assessment may be used to determine individual student progress and identify trends that will result in difficulty for a student to achieve an expected educational proficiency in the future. This allows teachers/administrators as well as parents and/or guardians to identify potential learning disabilities/disorders without the need for significant events to be identified, since through the use of the application (70) a student's educational proficiency may be followed/monitored over a sufficient period of time in an objective and consistent manner. Therefore, indicators of any disabilities and/or learning disorders associated with students (30) that may otherwise be imperceptible to an assessor, may now become more apparent through the identification of trends in the students progress. This may enable early intervention and increased prospects for better learning outcomes and student academic progress.
As used herein, the term “server”, “system”, “computer”, “computing system” or the like may include any processor-based or microprocessor-based system including systems using microcontrollers, reduced instruction set computers (RISC), application specific integrated circuits (ASICs), logic circuits, and any other circuit or processor including hardware, software, or a combination thereof capable of executing the functions described herein. Such are exemplary only, and are thus not intended to limit in any way the definition and/or meaning of such terms.
The one or more processors as described herein are configured to execute a set of instructions that are stored in one or more data storage units or elements (such as one or more memories), in order to process data. For example, the one or more processors may include or be coupled to one or more memories. The data storage units may also store data or other information as desired or needed. The data storage units may be in the form of an information source or a physical memory element within a processing machine.
The set of instructions may include various commands that instruct the one or more processors to perform specific operations such as the methods and processes of the various embodiments of the subject matter described herein. The set of instructions may be in the form of a software program. The software may be in various forms such as system software or application software. Further, the software may be in the form of a collection of separate programs, a program subset within a larger program or a portion of a program. The software may also include modular programming in the form of object-oriented programming. The processing of input data by the processing machine may be in response to user commands, or in response to results of previous processing, or in response to a request made by another processing machine.
The diagrams of embodiments herein illustrate one or more control or processing units. It is to be understood that the processing or control units may represent circuits, circuitry, or portions thereof that may be implemented as hardware with associated instructions (e.g., software stored on a tangible and non-transitory computer readable storage medium, such as a computer hard drive, ROM, RAM, or the like) that perform the operations described herein. The hardware may include state machine circuitry hardwired to perform the functions described herein. Optionally, the hardware may include electronic circuits that include and/or are connected to one or more logic-based devices, such as microprocessors, processors, controllers, or the like.
Optionally, the one or more processors may represent processing circuitry such as one or more of a field programmable gate array (FPGA), application specific integrated circuit (ASIC), microprocessor(s), and/or the like. The circuits in various embodiments may be configured to execute one or more algorithms to perform functions described herein. The one or more algorithms may include aspects of embodiments disclosed herein, whether or not expressly identified in the figures or a described method.
It will be appreciated by persons skilled in the relevant field of technology that numerous variations and/or modifications may be made to the invention as detailed in the embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all aspects as illustrative and not restrictive.
Throughout this specification and claims which follow, unless the context requires otherwise, the word “comprise”, and variations such as “comprises” and “comprising”, will be understood to imply the inclusion of a stated feature or step, or group of features or steps, but not the exclusion of any other feature or step or group of features or steps.
Number | Date | Country | Kind |
---|---|---|---|
2021904079 | Dec 2021 | AU | national |
This application is a national stage entry of International Application No. PCT/AU2022/051462 filed on Dec. 7, 2022, which claims the benefit of priority to Australian Application No. 2021904079, filed Dec. 15, 2021, the entire disclosures of which are hereby incorporated herein by reference.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/AU2022/051462 | 12/7/2022 | WO |