Patent Application
20080280269
1. Field of the Invention
The present invention is generally related to a computer-aided language tutor. More particularly, the present invention is related to a homework assignment and assessment system for spoken language education and testing.
2. Description
When learning to speak a second language or a native language, students need lots of oral practice. Traditional classroom learning does not allow each student the opportunity to have many chances to speak orally in class, especially when the student to teacher ratio is large (that is, one teacher teaching many students). To provide students with enough oral practice, teachers often require the students to read their lessons as homework. Unfortunately, traditional methods cannot check whether the students have carefully read their homework assignments. Traditional methods of oral language testing require each student to use a tape recorder to record the student's pronunciation and then have a team of judges to provide feedback on the performance of each student. Not only is this method time consuming, but it is also subjective.
Thus, what is needed is a computer-aided assignment and assessment system and method for enabling a teacher to assign oral practice assignments to each student. What is also needed is a computer-aided assignment and assessment system and method for objectively assessing the quality of the student's pronunciation and intonation of the spoken language. What is further needed is a computer-aided assignment and assessment system that monitors each student's progress to enable the teacher to provide constructive feedback to each student.
The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments of the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the pertinent art(s) to make and use the invention. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawing in which an element first appears is indicated by the leftmost digit(s) in the corresponding reference number.
While the present invention is described herein with reference to illustrative embodiments for particular applications, it should be understood that the invention is not limited thereto. Those skilled in the relevant art(s) with access to the teachings provided herein will recognize additional modifications, applications, and embodiments within the scope thereof and additional fields in which embodiments of the present invention would be of significant utility.
Reference in the specification to “one embodiment”, “an embodiment” or “another embodiment” of the present invention means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrase “in one embodiment” or “in an embodiment” appearing in various places throughout the specification are not necessarily all referring to the same embodiment.
Embodiments of the present invention are directed to an assignment and assessment language learning system and method for teaching students a language. With the use of text-speech mapping, speech analysis, pattern recognition, and data mining technologies, embodiments of the present invention facilitate the oral teaching, learning, and testing of a language to students in an efficient and flexible manner. The system enables a teacher to assign oral language assignments to students in language education. Upon completion of an oral language assignment by the student, the system provides the student and teacher with an objective and accurate evaluation on the quality of the student's pronunciation and intonation of the oral language assignment. The system also enables the teacher to closely monitor each student's progress and to select homework assignments geared toward correcting student weaknesses.
Although embodiments of the present invention are described with Chinese as the native language and English as the second language, the invention is not limited to teaching a second language. One skilled in the relevant art(s) would know that the invention is applicable to native language training as well.
A student may communicate with VLT online client 104 via a student computing device (not shown), such as a personal computer (PC), a lap top computer, a notebook computer, a workstation, a server, a mainframe, a hand-held computer, a palm top computer, a personal digital assistant (PDA), a telephony device, etc. Signals sent from VLT online client 104 to the student via the computing device include Assignment, Feedback, Grading, and Benchmark A/V signals. Signals sent to VLT online client 104 from the student include oral recitations of the Benchmark A/V signals, shown in
Virtual language tutor online server 112 comprises a virtual language tutor content management module 112a, a homework management module 112b, and a virtual language tutor learner information management module 112c. VLT content management module 112a comprises content modules that may be used for assignments, or to prepare assignments. Content for an assignment may be obtained from a plurality of sources, such as, for example, lectures, speeches, audio tapes, excerpts from audio books, etc. The content may be imported into content management module 112a with the aid of an administrator of system 100. Homework Management Module 112b allows the teacher to assign homework assignments to one or more students, one or more classes, etc. The homework assignments are selected by the teacher from content management module 112a. VLT Learner Information Management Module 112c comprises learning histories for all students that have previously used system 100. When a homework assignment has been completed by a student, the status of the homework assignment as well as the feedback and grading that results from the analysis of the homework by VLT online client 104 are uploaded to VLT online server 112 and immediately becomes part of the student's learning history in VLT Learner Information Management Module 112c. The status of the homework assignment including the feedback and grading of the homework assignment are now accessible to the teacher. Learning histories may be provided to the individual student or to the teacher. Unless special permissions are provided, a student may only access his/her own learning history.
A student may communicate with VLT online server 112 via client web browser 106 using the computing device as well. In fact, in one embodiment, client web browser 106 may reside on the student computing device. In this instance, the student may select a language course offered by VLT online server, receive learning histories or records from previous assignments performed by the student and receive feedback from the teacher for one or more previous completed assignments.
A teacher may communicate with VLT online server 112 via server web browser 114 using a teacher computing device (not shown), such as a personal computer (PC), a lap top computer, a notebook computer, a workstation, a server, a mainframe, a hand-held computer, a palm top computer, a personal digital assistant (PDA), a telephony device, etc. In fact, in one embodiment, server web browser 114 may reside on the teacher computing device. Signals provided to the teacher from VLT online server 112 (via server web browser 114) include student completion status and analysis reports. Signals sent from the teacher (via the teacher computing device) to VLT online server 112 include homework design, assignment, and feedback. Student completion status, analysis reports, homework design, assignment, and feedback signals will be discussed in further detail below.
VLT online client 104 comprises client software that enables a student to obtain oral practice assignments assigned by the teacher, perform the oral practice assignments, and receive performance results or feedback and grading based on their performance of the oral practice assignments.
In block 204, a student may log on to VLT online client 104 using a computing device, such as a personal computer (PC), a workstation, a server, a mainframe, a hand-held computer, a palm top computer, a personal digital assistant (PDA), a telephony device, a network appliance, a convergence device, etc. Login procedures consisting of the student providing a user identification (ID) and a password are well known in the relevant art(s). Once the student has logged onto VLT online client 104, the process proceeds to decision block 206.
In decision block 206, it is determined whether a homework assignment is available for the student. If a homework assignment is not available for the student, then either the student has completed all of their current homework assignments or the teacher has not assigned any new homework assignments. In this case, the process proceeds to decision block 208.
In decision block 208, it is determined whether other oral practice materials are available for training the student that the student may use as a practice module. If other oral practice materials are available for training the student, the process proceeds to block 210.
In block 210, the student may select an oral practice module from the other oral practice materials and perform the module. Upon completion of the practice module, the results of the practice module are uploaded to VLT online server 112 (block 212). The process then proceeds to decision block 214 to query the student as to whether the student desires to continue practicing. If the student desires to continue practicing, the process proceeds back to decision block 208 to determine whether another practice module is available.
In decision block 208, if it is determined that there are no practice modules available, the process proceeds to block 216, where the process ends.
Returning to decision block 214, if it is determined that the student does not wish to continue practicing, then the process proceeds to block 216, where the process ends.
Returning to decision block 206, if it is determined that a homework assignment is available for the student, the process proceeds to block 218. In block 218, the student may perform the homework assignment on VLT online client 104. Upon completion of the homework assignment, the results of the homework assignment, including status completion results, feedback and grading (that is, analysis results), are uploaded to VLT online server 112 (block 220). The process then proceeds back to decision block 206 to determine whether another homework assignment is available.
An exemplary homework assignment 300 is shown in
To perform an oral homework assignment, the student must first listen to the audio portion of the benchmark voice pronunciation and intonation of a sentence by playing the benchmark A/V (block 404). VLT online client 104 plays one sentence of the benchmark A/V at a time when the student presses a play button. The student also has an option of repeating a sentence or moving to the next sentence by pressing a forward or reverse button, respectively. After listening to a sentence, the student may respond in block 406 by pressing a record button and orally repeating the sentence back to VLT online client 104. VLT online client 104 will record the student's pronunciation of the sentence, separate the student's recorded sentence, word by word, and phoneme by phoneme (block 408), and analyze the student's pronunciation and intonation of each word/phoneme by comparing it with the pronunciation and intonation of the benchmark voice (block 410). This is accomplished using forced alignment, speech analysis, and pattern recognition techniques. Speech analysis and pattern recognition techniques are well known in the relevant art(s). Forced alignment is a technique used to match the student's recorded speech with a transcription of the benchmark voice. A method for automatic text-speech mapping is described in a co-pending patent application entitled “Automatic Text-Speech Mapping” to Minerva Yeung et al., filed concurrently with the present application. After comparing the student's response with the benchmark voice, VLT online client 104 will provide feedback and grading to the student (block 412). The feedback and grading provide the student with detailed information regarding pronunciation and intonation, which aids the student in knowing which word or phoneme needs improvement.
Area 602 lists a category 602a, a course or assignment 602b, information regarding a sentence 602c in course 602b, and a transcript of the current sentence 602d. Course 602b may be selected by the student using course button 612. Category 602a lists the category of the selected course or assignment 602b. In this instance, course 602b is “State of Union” and category 602a is “Famous Speech.”
Area 604 provides the benchmark A/V. As previously indicated, in an embodiment, a student may opt to only have the audio portion of the benchmark A/V played. Area 604 also acts a recorder to record the sentence recited by the student. Button 604a is a fast forward button. Button 604a allows the student to fast forward the play of the benchmark A/V. Button 604b is a record button that allows the student to record his/her recited sentence. Button 604c is a playback button that enables the student to play back their own sentence. Button 604d is a play button for playing the benchmark A/V.
Area 606 shows a caricature of a teacher 606a. Also shown in area 606 are forward and reverse buttons 606b and 606c. Forward and reverse buttons 606b and 606c allow a student to advance to the next sentence of the assignment or to go back to the previous sentence, respectively.
Area 608 provides a score box comprising an overall score 608a, a pronunciation score 608b, an intonation score 608c, and feedback 608d. Feedback 608d includes advice on what a student may do to improve their pronunciation and intonation scores.
A student may also interact with VLT online server 112 via client web browser 106.
In block 704, a student may log on to VLT online server 112 using their computing device and client web browser 106. As previously indicated, login procedures consisting of the student providing a user identification (ID) and a password are well known in the relevant art(s). Once the student has logged onto VLT online server 112, the student may choose to select one or more of the following in block 706: check homework status (block 708), query their learning records (block 716), get an assessment of their progress from the teacher for a particular assignment (block 720), or exit (block 724).
If the student desires to check their homework status (block 708), the process will proceed to decision block 710. In decision block 710, it is determined whether the student has any outstanding homework assignments. If it is determined that the student does not have any outstanding homework assignments, then the student is informed that all homework assignments have been completed in block 712, and the process proceeds back to block 706.
Returning to decision block 710, if it is determined that the student has one or more outstanding homework assignments to complete, then the process proceeds to block 714. In block 714, the student is informed that they need to log onto VLT online client to complete one or more homework assignments. The process then proceeds back to block 706.
Returning to block 706, if the student decides to query their learning records (block 716), the process proceeds to block 718. In block 718, the student is presented with their learning records. As previously indicated, the learning records include the results of every sentence from every homework assignment and practice module completed by the student. The process then proceeds back to block 706.
Returning to block 706, if the student decides to receive feedback from the teacher (block 720), the process proceeds to block 722. In block 722, the student may obtain teacher feedback from any of the student's previous homework assignments. The process then proceeds back to block 706.
Returning to block 706, if the student decides to exit VLT online server 112 (block 724), the process proceeds to block 726, where the process ends.
As previously indicated, teacher communications with VLT online server 112 include selection of a homework design for a class or individual student, preparation of an assignment for a class, preparing personalized feedback for an individual student as well as the class, receiving completion status for a class, and receiving analysis reports for a class as well as an individual student.
In block 804, a teacher may login to a teacher page on VLT online server 112. Login procedures consisting of the teacher providing a user identification (ID) and a password are well known in the relevant art(s). Once the teacher has logged onto VLT online server 112, the teacher page will appear.
In block 806, the teacher may select a homework design from VLT Content Management Module 112a. After the teacher has selected the homework design, the process proceeds to block 808.
In block 808, the teacher may prepare the assignment. Preparing the assignment includes providing the course or task (which is the homework design that was previously selected), the list of students in the class, the due date, the number of times the student is required to repeat the course, the minimum score required, and any comments from the teacher. As previously indicated, an exemplary homework assignment is shown in
In block 810, the homework assignment is downloaded to each student in the class so that when the student logs on to VLT online client 104 or VLT online server 112 through web browser 106, the student can access the homework assignment.
In block 904, a teacher may login to a teacher page on VLT online server 112. Login procedures consisting of the teacher providing a user identification (ID) and a password are well known in the relevant art(s). Once the teacher has logged onto VLT online server 112, the teacher page will appear.
In block 906, the teacher may select a class in which the teacher would like to receive homework results. In block 908, the teacher may select a homework name for the homework assignment of interest to the teacher. The teacher may then request a completion status report in block 910 to see the completion status of the class. An exemplary completion status report 1000 is shown in
Returning to
Returning to
In block 920, the teacher, upon completing the evaluation, may input the personalized evaluation. In block 922, the evaluation may be downloaded to enable a student to retrieve the personalized evaluation from the teacher. The process then proceeds back to block 914 to select the next student. When all students have been evaluated by the teacher, the process ends.
Although embodiments of the present invention have been described as a client/server based assignment and assessment language learning system and method for teaching students a language, one skilled in the relevant art(s) would know that other environments are also possible. For example, the system may comprise a VLT online module that is coupled to a hard disk drive and/or a removable storage drive, such as a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. Removable storage drives read from and/or write to removable storage units, such as a floppy disk, magnetic tape, optical disk, etc., in a well-known manner. In this embodiment, both the student and teacher may interact with the VLT online module. In one such embodiment, assignments may be in the form of a CD-ROM (Compact Disc Read Only Memory), floppy disk, magnetic tape, optical disk, etc. Student histories may be stored on the hard disk drive, which may be accessible to both the student and the teacher.
Embodiments of the present invention may be implemented using hardware, software, or a combination thereof and may be implemented in one or more computer systems or other processing systems. In fact, in one embodiment, the invention is directed toward one or more computer systems capable of carrying out the functionality described here. An example implementation of a computer system 1200 is shown in
Computer system 1200 includes one or more processors, such as processor 1203. Processor 1203 is connected to a communication bus 1202. Computer system 1200 also includes a main memory 1205, preferably random access memory (RAM) or a derivative thereof (such as SRAM, DRAM, etc.), and may also include a secondary memory 1210. Secondary memory 1210 may include, for example, a hard disk drive 1212 and/or a removable storage drive 1214, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. Removable storage drive 1214 reads from and/or writes to a removable storage unit 1218 in a well-known manner. Removable storage unit 1218 represents a floppy disk, magnetic tape, optical disk, etc., which is read by and written to by removable storage drive 1214. As will be appreciated, removable storage unit 1218 includes a computer usable storage medium having stored therein computer software and/or data.
In alternative embodiments, secondary memory 1210 may include other similar means for allowing computer programs or other instructions to be loaded into computer system 1200. Such means may include, for example, a removable storage unit 1222 and an interface 1220. Examples of such may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM (erasable programmable read-only memory), PROM (programmable read-only memory), or flash memory) and associated socket, and other removable storage units 1222 and interfaces 1220 which allow software and data to be transferred from removable storage unit 1222 to computer system 1200.
Computer system 1200 may also include a communications interface 1224. Communications interface 1224 allows software and data to be transferred between computer system 1200 and external devices. Examples of communications interface 1224 may include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA (personal computer memory card international association) slot and card, a wireless LAN (local area network) interface, etc. Software and data transferred via communications interface 1224 are in the form of signals 1228 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 1224. These signals 1228 are provided to communications interface 1224 via a communications path (i.e., channel) 1226. Channel 1226 carries signals 1228 and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, a wireless link, and other communications channels.
In this document, the term “computer program product” refers to removable storage units 1218, 1222, and signals 1228. These computer program products are means for providing software to computer system 1200. Embodiments of the invention are directed to such computer program products.
Computer programs (also called computer control logic) are stored in main memory 1205, and/or secondary memory 1210 and/or in computer program products. Computer programs may also be received via communications interface 1224. Such computer programs, when executed, enable computer system 1200 to perform the features of the present invention as discussed herein. In particular, the computer programs, when executed, enable processor 1203 to perform the features of embodiments of the present invention. Accordingly, such computer programs represent controllers of computer system 1200.
In an embodiment where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system 1200 using removable storage drive 1214, hard drive 1212 or communications interface 1224. The control logic (software), when executed by processor 1203, causes processor 1203 to perform the functions of the invention as described herein.
In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of hardware state machine(s) so as to perform the functions described herein will be apparent to persons skilled in the relevant art(s). In yet another embodiment, the invention is implemented using a combination of both hardware and software.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined in accordance with the following claims and their equivalents.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/CN05/00746 | 5/27/2005 | WO | 00 | 4/28/2006 |
