Patent Grant
8251704
Video games show potential as an effective tool for learning a range of subjects. However, learning-oriented games to date have been designed as separated experiences, and cannot measure, store, or retrieve learning data about game players across game titles. For example, skills acquired by the user in one game are not available for reading or modification by other games. This problem is compounded when games are from different publishers, for example, due to the different formats for data that each publisher employs. As a result, the player must start anew acquiring skills, and spend needless time playing levels of the game that are not adjusted to the user's skills.
While some video games enable a user to select a general level of difficulty prior to starting a game, this has the drawback of potentially incorrect self assessment, and also does not account for skill-by-skill differences in the ability of players. Further, games in which a user selects a level of difficulty are not provided with mechanisms by which the game can update or modify the user's level of difficulty, for example, if the user selected too low a difficulty level, or if the user improves his skill through practice in the game. Thus, the user may grow tired of a game that is too easy, or quit a game that is too hard. Finally, there is no way to compare user learning in games from one game to the next, because a difficulty level in one game may not be comparable to a difficulty level in another game. For this reason, the user experience with learning software applications has been isolated, fragmented and non-cumulative.
A computerized learning method is provided. The method may include receiving a write request from a first learning application program to write a learning level for a skill in a user profile. The user profile is configured to store data indicative of a plurality of skills and a learning level for each skill. The skills and learning levels are defined according to a profile schema. The method may further include writing the learning level and other learning data for the skill in the user profile. The method may also include receiving a read request from a second learning application program to read the learning level and other learning data for the skill in the user profile. The method may finally include retrieving the learning level and other learning data from the user profile, and sending the learning information to the second learning application program.
This Summary is provided to introduce a selection of concepts in a simplified form that is further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
I. Overview
As used herein “program” refers to software or firmware components that may be executed by, or utilized by one or more computing devices of the computerized learning system 100, and is meant to encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc. It will be appreciated that the learning service program 106 may include a local component and an online component. The local component may be a local learning service program 112 executed on the user client device 102, and the online component may be an online learning service program 114 executed on an online server system 116. The local component may function as a subset of the online component functionality in the event that connectivity is not available. Alternatively, the local component may be a “thin client” (e.g. a Web browser) to which application software and services are communicated via the Internet. Whether the learning application programs are displayed on the user client device via a thin client which is served remotely, or reside as standalone applications, they are described herein to be executed on the client device.
The profile 110 may be stored in the user client device 102, in a peripheral device 130 associated with the user client device 102 as illustrated at 110A, or on a data store 118 associated with the online server system 116, as illustrated at 110B. The user client device 102 and the online server system 116 are configured to communicate via a computer network 120, which may include a wide area network (WAN) 122. The learning application programs 104 of the user client device 102 may be configured to communicate over WAN 122 with the online learning service program 114 via the application programming interface 108 and local learning service 112. In other embodiments, for example, the computer network 120 may be a wireless telephone network configured to communicate with computer-enabled wireless telephones or other mobile computing devices.
The user client device 102 may be a personal computer, computer-enabled wireless telephone, portable data assistant (PDA), or other computing device on which a computer operating system is configured to interact with learning application programs 104. The user client device 102 may include various components not shown in
As noted above, peripheral device 130 equipped with a non-volatile storage 132A, 132B for storing a copy of the profile 110 may also be provided. The peripheral device 130 may be, for example, a memory-equipped stylus, mouse, portable USB flash drive, etc., and may be configured to connect directly, or via a wired or wireless connection to the user client device 102.
The computerized learning system 100 further includes a plurality of other client devices connected to the computer network 120, such as local peer client devices 134, remote peer client devices 136, a parent client device 138, and an administrator client device 140. It will be appreciated that as used herein the term “administrator” is used broadly to refer to a person with authority to administer educational services to a population of students, and encompasses teachers and managers alike, as explained in detail below. Thus, separate user interfaces may be provided for teacher administrators and managing administrators to access the learning system via the administrator client device 140. Like the user client device 102, each of these other client devices 134-140 is configured to run one or more of the learning application programs 104 and the local learning service program 112. As these devices 134-140 are configured similarly to device 102, they will not be described in detail. It will be appreciated that the computer network 120 may further include a local area network (LAN) 142, and local peer client devices 134 are configured to communicate with the user client device 102 via LAN 142. LAN 142 may be a wireless or wired network.
Remote peer client devices 136 typically connect to WAN 122 of the computer network 120. It will be appreciated that the primary difference between local peer client devices and remote peer client devices is their respective point of contact with the computer network 120, and a single computing device, such as a portable laptop computer or web-enabled mobile telephone, may transition between network access points and alternately assume the role of locally and remotely connected peer device. Similarly, it will be appreciated that parent client device 138 and administrator client device 140 are configured to connect to WAN 122, but may alternatively connect to LAN 142. It will also be appreciated that the distinction between parent, administrator (e.g., teacher or management), user and peer client devices also depends on which of a plurality of users is using the client device to access the learning service program 106, and users may use different client devices to access the learning service than the ones which hold the learning application programs. For example, a child user can play a learning application program on a first computing device, and a parent can access the online learning service to review statistics on the child's play via a second computing device that does not hold a learning application program. With reference to
Continuing with reference to
As mentioned above, the computerized learning system 100 may include the data store 118 configured to communicate with the online server system 116. The data store 118 may be configured to store data used by the online server system 116, including profiles 110, as discussed above and illustrated at 110B, recommendations 168 generated by the recommendation engine, statistics 170 generated by the statistics engine, application-specific game schemas 172, and scaffolding schemas 174. The function of these data types is also described in detail below.
The assessment engine of the learning service program 106 may administer an assessment test to a user. In one embodiment, an intra-game assessment is made by learning application program 104. Alternatively, a request is sent to the assessment engine of learning service program 106 to administer an assessment test to the user. The assessment test is designed to verify learning levels determined in the intra-game assessment.
For example, when a user is determined to advance a learning level, the content of the learning application program may be made more difficult and relevant to the aspiring level. Thus, one purpose of the assessment test is to verify that a proposed adjustment of content in the learning application program based on advancement of a learning level is appropriate. By doing this, the learning service program 106 may verify that the intra-game assessment of the user's learning level is substantially equivalent to the assessment engine's evaluation of the user's learning level before the assessed learning level may be updated to the profile 110 of the user. Another related purpose of the assessment test is to verify that the learning application program is presenting content to users that is standardized or consistent in its difficulty. If one learning application program continually recommends users for learning level advancement who in turn fail assessment tests, the learning service operator may inform the learning application program vendor that the content of the learning application program needs to be made more difficult in order to adhere to accepted standards. These accepted standards could be defined by the learning service operator, for example.
In this way, the assessment test may facilitate standardization of criterion for receiving trophies that are awarded across a plurality of learning application programs. In addition, the assessment engine may be used to verify that adjustment of support in the learning application program by scaffolding engine 210 may be appropriately correlated to skills gained by the user.
It may be further desired to receive parental authorization for the user to undertake the assessment test prior to administering the assessment test. In particular, the assessment test may be administered via the online learning service program 114 such that a parent of the user may authorize administration of a assessment test from a remote client device before the user may take the test. Accordingly, an API call may request retrieval of data for generating an assessment test following parent authorization of the assessment test. For example, an assessment test may be generated based on trophy data stored in the profile 110 of the user such that the assessment test may effectively test skills intended to be acquired by the user for the trophy specified. In addition, a notification message may be sent to an authorized parent of the user following the award of a trophy to the user. For example, a parent of the user may receive a notification message in a parent view of data associated with the profile 110, as described in further detail below.
Reporting engine 160A, 160B may arrange data stored in the profile 110 of the user in a plurality of preselected report templates for the user. In particular, profile learning data may be arranged in a view corresponding to the user accessing the information, such as a student user, a parent of the user, an administrative user, etc. As such, reporting engine 160A, 160B may arrange data retrieved from the profile 110 of the user by an API call into viewable reports that may vary depending on the requesting client.
Referring now to
The learning application programs 104 further may include a game engine 208 including a copy of application-specific game schema 172. The application-specific game schema 172, may, for example, take the form of a game configuration file written in an extensible mark up language, as described in detail below. The game engine functions to generate the game play displayed on GUI 200 of the learning application program. For example, the game engine 208 may control the audio and visual output of the learning application program 104.
The content and presentation of the support 212 may be determined and controlled by a support system 214 in the learning application program, with input from a scaffolding engine 210. The scaffolding engine is configured to store a copy of scaffolding schema 174, which provides a standardized framework for customizing support to a user's assessed scaffolding level, as described in detail below.
The application programming interface 108 shown in
A driver 216 or other suitable device interface is provided to facilitate communications between the user client device 102 and peripheral device 130, and a network interface 218 is provided to facilitate communications between the user client device 102 and the online server system 116 or other computing devices connected to the computer network 120.
Furthermore, sign-in interface 300 may include an add new user selector 308. The add new user selector 308 may be selected by a first-time user that is signing into the learning service program 106 for the first time. Upon selecting selector 308, the first-time user may be prompted to create a profile 110. In one particular example, the creation process of the profile 110 may include creating a user ID, selecting an identification picture or avatar, selecting a color scheme of the profile 110, selecting a primary language (and a secondary language where applicable), and selecting a number of other possible personalizing/distinguishing attributes for the profile. Once the profile 110 is created, the profile 110 may be added to a list of selectable client IDs on the sign-in interface, and stored as described above on the user client device 102, peripheral 130, or the data store 118 associated with the online server system 116.
In some embodiments, the sign-in interface 300 may include a guest selector 310 which a user may select to interact with a particular learning application program. By signing in to the learning service as a guest, a user may bypass the creation process of the profile 110 and may be provided with a guest ID. A guest may interact with various learning application programs, but typically no user performance data may be saved and no learning level may be tracked once the guest stops interacting with the learning application program. Further, a guest may have limited (or no) ability to interact with other users online.
In some embodiments, the sign-in interface 300 may be displayed responsive to execution of the learning application program. Alternatively, the sign-in interface 300 may be displayed as an element of a dashboard interface that may be selectively displayed by the learning service program 106.
In some cases, the sign-in interface may be selectively displayed during interaction with the learning application program so that different users may sign in or sign out of the learning service.
The user interface 400 also may include a friends status list 406. In one example, friends status list 406 may show the friends (or other online associates) associated with the particular user. In a more particular example, friends status list 406 may show which friends of the user are currently logged into the learning service (locally or online). In some embodiments, friend status list 406 may include a details selector that is configured to display a friends graphic user interface that presents detailed information about friends of the user.
User interface 400 may include a trophies pane 408 configured to display trophies that represent achievements the user has made in each of the plurality of learning application programs. In a more particular example, each of the displayed trophies may include a trophy graphic 409 and a description of the accomplished task associated with the trophy. In some embodiments, the trophies pane 408 may include a details selector that is configured to display a trophy graphic user interface that present detailed information about trophies earned by the user.
User interface 400 may include a learning level progress pane 410. In one example, learning level progress pane 410 may display a learning level for one or more selected skills of the user. In the depicted embodiment, a graphical and textual representation of the user's learning level for a plurality of skills, English and Math, are included. In some embodiments, learning level progress pane 410 may present learning level information of the user compared to other users. For example, a statistical comparison of the user to a group of users, or a head to head comparison of the user to one or more other users may be displayed.
User interface 400 may include an available games list 412 configured to display titles of appropriate learning application programs, which are depicted as The Golden Dragon, Word Drop, Navigator, and Story Creator in
II. Profile
The interaction of the various components of the computerized learning system 100 with profile 110, as well as the organization of profile 110, is discussed in detail hereinafter. As discussed above, the application programming interface 108 is configured to receive user performance data 206 from a plurality of learning application programs 104 executed on a user client device 102 and store the user performance data in profile 110 of the user in non-volatile storage 132A, 132B accessible from the user client device 102. As shown in
The application programming interface 108 further may be configured to send the assessed user learning level for the skill to a requesting learning application program. In turn, the requesting learning application program may be configured to adjust content based on the assessed user learning level. One manner in which the content may be adjusted, is by adjusting the difficulty of the challenge presented. In addition, the level of support 212 offered by the support system 214 may be adjusted, based on the user learning level, as discussed below.
As shown in
Referring next to
As shown above, profile meta data 502 may include elements such as an learning client system version element, a profile ID, a password, a parent ID, a synch date stamp, a network ID, a synch PC ID, a screen name, a primary language ID, a secondary language ID, a color, a picture, an application array, an achievement array, and an earned achievement content element. The learning client system version element may include a unique ID of the system detected during the most recent access of profile 110. This ensures that the client application is kept up to date relative to the server software. The profile ID may include a unique ID associated with the user of profile 110. The profile ID may be used to identify the user as online or offline. The password associated with profile 110 of the user may be an encrypted password received as user input during the inaugural use of profile 110.
The parent ID may be a unique ID associated with an approved parent of the user. An approved parent may be another user associated with the user, such as a parent, teacher administrator, or managing administrator, authorized to modify control elements of the profile 110. Further, an approved parent of the user may be authorized to modify a plurality of profiles. For example, a teacher may be authorized to modify profiles associated with students in a classroom of the teacher. The sync date stamp may be an element of profile meta data identifying the most recent communication sync between profile 110 on user client device 102, for example, and online learning service program 114. In addition, the sync date stamp may be associated with a network ID and/or user client device ID associated with the sync date stamp.
It will be appreciated that profile 110 may be associated with a particular client device. Further, profile 110 may be limited to syncing with a single user client device. For example, a user of profile 110 attempting to sync to a plurality of personal computers may be prompted to select association with one of the personal computers.
Profile meta data 502 may include a screen name. The primary and secondary language ID and/or the locale ID may associate profile 110 with a language and/or various other relevant data pertaining to the locale of the user based on user input. The locale ID typically refers to a geographic region in which the user resides. Profile 110 may be associated with a background color and a picture, such as a jpeg, enabling the user to customize aspects of the graphical user interface. The application array may include game IDs uploaded from game meta data, a number of times played, and a date associated with the last time the game was played. Further, the trophy array may include trophy IDs associated with the game IDs as the user completes the trophy. Each trophy ID may be associated with a title, and description.
Settings 504 associated with profile 110 may include elements such as a pen/mouse speed, an inversion element, a sync to PC element, and a sync to network element, although various other elements may be added. The pen/mouse speed element may include slow, medium, and fast settings. The inversion element may facilitate configuring learning application programs including a control system GUI, such as an airplane simulation GUI, to operate in an inverted mode, such that, for example, an airplane can be controlled to go up by pushing forward rather than backward on a joystick. The sync to PC and sync to network elements may facilitate one of a manual or automatic syncing option, based on a parameter such as a user preference, learning application specification, etc.
Controls and restrictions 506 associated with profile 110 may include elements such as a community ID sharing element, a community content sharing element, a wireless ID sharing element, and a wireless content sharing element. The community ID sharing element may be configured to allow other users to access a view of a shared portion of profile 110 of the user. In some embodiments, the community ID sharing element may be selected by an authorized parent of the user and/or an authorized administrator for a group of users. For example, the community ID sharing element may be set to restricting views of profile 110 of the user from other users. In addition, the sharing element may be set to restricting views of profile 110 from all users, unless otherwise authorized. In another example, access to views of profile 110 may be restricted to authorized friends of the user. In yet another example, other users in a restricted network may be authorized to access views of profile 110. The community content sharing element may be configured to allow users identified in the community ID sharing element to view particular elements in profile 110.
Community member information 508 associated with profile 110 may include elements such as a friends array, a group array, and a group members array. The friends array element may identify profiles associated with one or more friends of the user that may view profile 110 of the user. As such, profile IDs listed in the friends array element may be allowed to access views of profile 110 if the user enables such access via access controls in the graphical user interface. The listing of the community members also facilitates easy lookup and communication with them directly from the user profile. The group array element may identify groups to which the user belongs. In one example, an authorized parent and a user may be members of a group, and access may be restricted to network IDs corresponding to home and school networks of the parent and user. Learning service 106 may be provided with an API configured to manage users and groups, and present user interfaces by which the users and groups may interact.
As shown in Table 1 and illustrated in
Each learning level element may include game play records for learning application programs 104 updated to profile 110. In one example, each learning level element may include a record for application-specific learning data for up to five recently used learning application programs. Further, each record associated with the learning application programs may include a level ID associated with the learning level element, a game ID uploaded to profile 110 from game meta data of application-specific game schema 172, for example, and a date associated with the most recent use of the learning application program of the record. Some learning level elements, such as reading, speaking, writing, spelling, and listening, may be grouped under a common language ID so that the skills can be tracked separately under each language.
Profile game data stored in game data 514 may include elements such as a games-saved element for continuing saved games and a game settings element for storing settings related to learning application programs used. Further, student storage 516 may include elements such as a story element, an art element, and a picture element or other personalization for storing media associated with learning application programs 104.
At 1404, the method may include adjusting the content of the requesting learning application program, based on profile 110 of the user. The difficulty of the challenge or the type and degree of support offered may be adjusted, for example. At 1406, the method may include storing the assessed user learning level in profile 110 of the user. Profile 110 of the user may be organized according to a profile schema, and may be configured to store learning level data for each of a plurality of skills.
For example, the plurality of skills may include one or more language acquisition skills, and one of the language acquisition skills may include vocabulary mastery. In such a case, profile 110 of the user may be configured to store vocabulary words that have been demonstrated as known to the user. For each vocabulary word, a plurality of skills may apply. For example, different language acquisition skills may be defined to include reading, speaking, writing, spelling, and listening to each vocabulary word. In addition, other skills beyond language acquisition skills may be defined. For example, the plurality of skills may include a visual skill such as pattern recognition, an aural skill such as phoneme recognition, a mathematical skill, such as adding, subtracting, multiplying, or dividing, number sense, or virtually any other suitable learning skill.
It will be appreciated that profile 110 of the user may be configured to store one or more of profile meta data, user setting data, access control data, community member data, game data, and user storage data, described above. Further, as discussed above, profile 110 of the user may be stored at a location accessible by a local learning service on a user client device, such as at the data store 118 accessible to online learning service program 114. As described above a local copy of profile 110 of the user may be stored on a user client device or a peripheral thereof, and a remote copy of profile 110 of the user may be stored at an online learning service. The method may further include syncing the local copy and the remote copy of profile 110 of the user according to predetermined sync rules.
At 1408, the method includes sending the user learning level to a requesting learning application program. At 1410, the method may include displaying a view of profile 110 on a graphical user interface, such as user interface 400 described above. At 1412, the method may include displaying a statistical comparison of profile 110 of the user with profiles of other users on a graphical user interface, such as in parent and teacher administrator graphical user interfaces 1100, 1200 described below. For example, the statistical comparison may comparison include a comparison of a user or group of users with other users or groups of users who have played the same learning application programs, or who have played learning application programs that affect learning of similar types of skills.
III. Schematization and Instrumentation
As discussed above, the computerized learning system 100 may utilize schematization and instrumentation of learning application programs. Schematization refers to the process of defining a format for data that is exchanged between software components of the computerized learning system 100, such as among the learning service program, the application programming interface 108 and learning application program. Instrumentation refers to the process of providing a software component the ability to collect, store and retrieve schematized data, such as through an application programming interface 108.
The interaction of various components of computerized learning system 100 to achieve instrumentation and schematization will now be described. As discussed above, the computerized learning system 100 may include a plurality of learning profiles stored in non-volatile storage 132A, 132B, each profile being associated with a user. Further, each profile may include learning data organized according to a profile schema, where the learning data includes one or more skills. Further still, an assessed user learning level for each skill may be selected from among a plurality of possible learning levels. The computerized learning system 100 may further include learning service program 106 configured to receive requests from a plurality of learning application programs. As one example, the requests may be used to read and write learning data relating to the learning levels for each skill to and from each of the user profiles. The requests may be sent from the learning application program 104, via application programming interface 108, to be received by the learning service program 106. The computerized learning system 100 may include an arbitration engine 158A and 158B configured to determine if each of the read and write requests is authorized. This engine may compare the results submitted by a plurality of users who have played a multi-player learning application together. This comparison can be used to determine if any of the results submitted through the application programming interface have been tampered with. The local arbitration engine 158B may determine if read and write requests for the local copy of a profile are allowed, while arbitration engine 158A may determine if read and write requests for an online copy of the profile stored in data store 118 are allowed. Alternatively, all arbitration may be performed by an online arbitration engine and the local arbitration engine may be omitted.
Another element in the schematization of the data exchanged in computerized learning system 100, is application-specific game schema 172, which is used to organize data related to a specific learning application program. Application-game specific game schema 172 may organize information related to a specific learning application program into game meta data, which identifies characteristics about the learning application program, game learning data, which identifies various skills that the user is recommended to possess for the application or may acquire through playing the game, and game trophy data, which defines milestone accomplishments for which trophies are awarded in the learning application program.
Game meta data may be organized into elements such as a game ID, a game title, a minimum and/or maximum number of players for the game, and online play capabilities of the application. Game learning data may be organized into elements such as application-specific target skills and skill levels where the target skill element may be assigned a skill ID. As such, applications may be targeted to users exhibiting a range of skill levels in one or more skills associated with a learning application program. Game trophy data may organized into elements such as an achievement ID, an achievement name, an achievement description, capability to display an achievement (achievements that may be displayed may be assigned a description such that the user may learn how the achievement may be earned), a point value for each achievement, and an image for each achievement. One example embodiment of an application-specific game schema is shown in Table 3 below.
Returning to
It will be appreciated that the skills 512 may include virtually any skill suitable to schematization, including general mastery of vocabulary words, and the learning service program may be configured to receive requests to read a set of vocabulary words for a user, and write newly mastered vocabulary words to the user profile, in response to requests from learning application programs. In the depicted embodiment, the profile is configured to store a learning level for each of reading 518, speaking 520, writing 522, spelling 524 and listening 526, for each of a plurality of words in a target language. This enables, for example, the content of a challenge or support presented to a user to be modified based not only on a user's general mastery of a vocabulary word, but on the user's relative learning levels for different skills associated with that vocabulary word. It will also be appreciated that mathematical skills, such as adding 528, subtracting 530, multiplying 532, and dividing 534, may also be included within skills 512.
At 1608, the method may include presenting a support selector to the user via the user interface to aid the user in responding to the challenge, wherein the user performance data includes support history data indicating use of the support selector by the user. Examples of support selectors are illustrated in
At 1610, the method 1600 may further include presenting support to the user, either in response to a user request for support (pull support) or upon reaching a predetermine support threshold (push support), as described below. The presentation of support to the user may be recorded as user performance data, may form the part of the basis for the determination of learning level for a skill. For example, users who request help often may be deemed not to be prepared to advance a learning level, while users who seldom are presented with help may be candidates for advancement.
At 1612, the method 1600 may further include receiving a response to the challenge via the user interface of the learning application, the user performance data being based on the response to the challenge. For example, the method at 1612A may include measuring a response time of the user response to the challenge, the user performance data further including the response time. At 1612B, the method may include counting a number of inaccurate responses received from the user in response to the challenge, the user performance data including the number of inaccurate responses. At 1612C, the method may include determining a degree of accuracy of the response, and the response data may include the degree of accuracy of the response.
According to one example, the method may include receiving a spoken response from the user via a microphone and determining a degree of accuracy of the spoken response. Thus, the response data may include the degree of accuracy of the spoken response, and the skill may be spoken language ability in a target language. The method may further include determining via a game-based learning assessment module (not shown) that the stored learning level for the skill should be updated to an updated learning level, based at least in part on the degree of accuracy of the spoken response.
According to another example, the method may include receiving a written response from the user via the user interface and determining a degree of accuracy of the written response. Thus, it will be appreciated that the response data may include the degree of accuracy of the written response, and the skill may be written language ability in a target language. Further, the method may include determining via a game-based learning assessment module that the stored learning level for the skill should be updated to an updated learning level and may be based at least in part on the degree of accuracy of the written response.
At 1614, the method may include determining that a learning level for a skill of a user profile should be updated to an updated learning level, based on user performance data from the learning application program and predetermined learning assessment rules. It will be appreciated that this determination may be based on a plurality of user responses to challenges. Thus, as indicated by a dashed line between steps 1612 and 1606, the method may iteratively present a plurality of challenges to the user prior to making the determination at 1614. For example, the user may be presented with a challenge set containing a predetermined number of challenges which are successively presented to the user, and the determination at 1614 may be based on the plurality of responses received for the challenge set.
At 1616, the method may include sending a write request to learning service program 106, to modify the learning level for the skill in the user profile to an updated learning level.
IV. Scaffolding
The interaction of various components of computerized learning system 100 to achieve a scaffolding support system is described in detail below. As described above with reference to
The scaffolding level for the skill may be stored in a user profile, for example, in non-volatile memory accessible to the learning application program via application programming interface 108. The support system 214 may be configured with a pull support option in which the support system 214 presents support in response a user request for support via a support selector on the user interface. The support system 214 may be configured with a push support option in which the support system 214 presents support in response to a measured response parameter. Push and pull support are illustrated in greater detail in
Referring now to
Furthermore, the support system 214 may be configured to tailor the amount of push and pull support offered to a user based on the user's scaffolding level for a skill, with the most push and pull support being offered at the high scaffolding level, some push support and full pull support being offered at the medium scaffolding level, no push support and some pull support offered at the low scaffolding level, and no push or pull support being offered when scaffolding is turned off. Thus, it will be appreciated that not only the challenge itself may be tailored to the user's learning level, but also the support for the challenge may be scaled to the user's scaffolding level for a particular skill.
The measured response parameter on which the support system 214 delivers push support may be selected from a group consisting of response time, number of incorrect responses (response attempts), accuracy level of response, and score. A predetermined threshold for each type of measured response parameter may be set, beyond which push support is presented to the user. As one example, the skill may include listening and the support 212 may include audio. As another example, the skill may include reading and the support may include text. In yet another example, push support may be presented to a user with a lowest score among a group of users, or to a user whose score is below a predetermined threshold. Further, the support 212 may be provided in a native language of the user in one of spoken or written form. The support 212 may also be provided in a target language of study in one of spoken or written form. Further, the support system 214 may be configured to assign a cost to the use of support, the cost being used by the support system 214 in evaluating whether to decrease the scaffolding level of the user. The cost of support in the target language may be lower than the cost of support in the native language, for example. The support system 214 may be configured to display the support 212 in variety of output formats, such as text, audio, animation, video, haptic pressure, etc., which output may be attributable to a non-player character in the learning application program. Further, the support system 214 may be configured to display the support 212 as one or more user response options in one or more input format, such as text input through a keyboard, audio input through a microphone, handwriting or input through a stylus, mouse clicks, gestures captured by a camera, etc.
The learning application program may be configured to perform an intra-game assessment and determine that the user has attained a user scaffolding level. The intra-game assessment may be based on the use of support by the user in responding to one or more challenges. Typically, the intra-game assessment is based on a cumulative pattern of use of support by the user as compared to the use of support by other users. The learning application program may be further configured to sending a write request to update the profile of the user upon assessing that a user has attained a new scaffolding level. The learning application program may assess that a user has attained a new scaffolding level when the pattern of use of support for the user corresponds to that of other users at the new scaffolding level. By continuously performing intra-game assessments, the user's scaffolding level may be adjusted in order to stretch the user's learning ability. In this way, support offered to the user is decreased and the rate of learning may be increased.
Furthermore, the learning application program may be configured to assign a zone of proximal development as indicated at 538 to the user, based on the users assessed learning level and scaffolding level for a skill. The zone of proximal development as indicated at 538 may be used to measure the approximate range of a user's current learning ability, and may be used to adjust the content of the support or challenge presented by the learning application program, with the goal of presenting content and support that is at the top of, but still within, the user's ability to comprehend and learn. For example, language application program 104 may be configured to determine whether a unit of game content such as challenge or support content is within the zone of proximal development, and if it is not, then to refrain from presenting the content to the user. In another example, the learning application program may be configured to determine that a unit of content such as challenge or support content is above the user's current assessed and recorded learning level but within the user's zone of proximal development, and may determine to present the content to the user in such a case, to encourage growth of the user's learning level and test if the user is approaching a new scaffolding level or learning level.
Further, the zone of proximal development may be considered when adjusting a scaffolding level or a learning level of the user. For example, if the zone of proximal development indicates that a user's learning ability extends into a new scaffolding level or learning level, at least one of the learning application program and the learning service program may initiate formal assessment, review of scaffolding usage data, and arbitration to request a change at least one of the scaffolding level and the learning level. Further, if the review of scaffolding usage data indicates that a user's scaffolding level or learning level is above a threshold level the user's level may be updated and the zone of proximal development may be adjusted accordingly.
In some embodiments, the support system 214 may be configured to display a user-accessible dictionary including each of a plurality of words presented in the challenge. The dictionary is typically a service-level application, and is a component of learning service program 106. As one example, the dictionary may include information selected from a group consisting of a definition of the word in the target language and the native language of the user, a media that illustrates the word, a sample sentence using the word in context, an audio file of the word being spoken, and a pronunciation detector configured to receive and evaluate a user pronunciation of the word.
According to another embodiment, the support system 214 of the learning application program may be configured to present, via a user interface of the learning application program, a selected one of a plurality of levels of support. The selected level of support may be chosen based on a scaffolding level of the user. The scaffolding level of the user may be read from a user profile stored in memory and updatable upon determining that user performance in a learning application program meets or exceeds a predetermined threshold for scaffolding level advancement.
Game interface 700 may include challenge module 704 that may present a challenge to the user. Challenge module 704 may include a challenge display pane 706 for displaying the challenge in written form in at least one of the user's native language (e.g. Chinese) and the target language of study (e.g. English). In some cases, when a challenge is presented by a non-playable character, a portrait 707 of the character may be included adjacent challenge display pane 706 so that the user may identify who is providing the challenge.
As described above, the learning application program may include a support system 214 that can provide support to the user to respond to the challenge based on the user's scaffolding level. The support system 214 may be configured with a pull support option in which the support system 214 presents support in response to a user request for support, and a push support option in which the support system 214 presents support in response to a measured response parameter.
Furthermore, both push and pull support may be selectively available based on a user's scaffolding level. In at least one embodiment, the scaffolding levels may be selected from a group consisting of none, low, medium, and high. Accordingly, the support system 214 may be configured to enable both the push support option and the pull support option upon detecting that a user scaffolding level for a skill is high; disable some push support options and enable all pull support options upon detecting that a user scaffolding level for a skill is medium; disable all push support options and enable some pull support options upon detecting that a user scaffolding level for a skill is low; and disable both the pull support option and the pull support option upon detecting that a user scaffolding level for a skill is none.
In some embodiments, the learning application program may be configured to display various types of visual or audio support based on the user's scaffolding level. For example, a user with a high scaffolding level in Basic English may receive both written and spoken support, whereas a user with a low scaffolding level may receive only spoken support. In the illustrated embodiment, the user has a high scaffolding level so both visual and audio support may be provided.
Continuing with
Game interface 700 may further include response module 716 configured to enable the user to respond to the challenge. Response module 716 may include a written response pane configured to display a user's written response and may also include spoken response selector 720. Response selector 720 may be selected to activate an audio recording device to capture a user's spoken response. In some examples, depending on the particular challenge, a user's response may be only written or only spoken. In such cases, the learning application program may adjust the appearance of the response module to only present the associated response mechanism (i.e. written response pane or spoken response selector).
The support system 214 may be configured to display support as user response options in text or audio. Accordingly, the response module may include response support selectors 721 configured to provide pull support to the user, similar to the support selectors of the challenge module. In particular, the response support selectors 721 may provide target language written support, target language spoken support, native language written support, and native language spoken support. In some examples, a challenge may include multiple responses that may be presented in the response module, for example, responding “yes” or “no”. In such cases, the response module may include support selectors that correspond to each of the respective responses, similar to challenge selectors, described above. For this reason, the response support selectors will not be described in detail.
In some embodiments, the support system 214 may be configured to assign a cost to the use of support. The cost may be used by the support system 214 in evaluating whether to decrease (or increase) the scaffolding level of the user. The cost may be based on, for example, response time, number of response attempts, requests for support, etc. Thus, cost meter 722 may display the current number of support requests that a user may have remaining in order to demonstrate mastery of the challenge and to indicate to the user the norms for support requests at his/her level of scaffolding. In addition, cost meter 722 may change its appearance each time the user requests support so that the user may have an indication of the number of support requests remaining. For example, the cost meter may change color or eliminate a bar of the meter each time a request for support is made. In addition to a visual cost meter, it will be appreciated that the cost of support may be implemented in another suitable manner, for example, by a score handicap according to which a user is awarded fewer points for completion of a challenge using support.
In some embodiments, the cost of support may be different based on the type of support. For example, the cost of support presented in the native language may be higher than the cost of support in the target language. Further, in some embodiments, the cost of support may be eliminated or reduce based on a user's scaffolding level. For example, a user with a high scaffolding level (a user who needs more help) may not have a cost for support.
In some examples, the support system 214 may be configured to display a user-accessible dictionary 724. For each of a plurality of words presented to the user in a challenge, the dictionary may include information selected from a group consisting of a definition of the word in the target language and the native language of the user; a media that illustrates the word; a sample sentence using the word in context; an audio file of the word being spoken; and a pronunciation detector. The pronunciation detector may be configured to receive and evaluate a user pronunciation of the word. In some embodiments, the dictionary may be selectively available based on at least one of scaffolding level and learning level.
In this example push support is supplied as target language written support displayed in the response module, however, push support may include other written or spoken support. Further, in some cases, push support may be presented by non-player characters to aid the user in responding to the challenge.
The following table illustrates one specific set of scaffolding rules that may be used to deliver push and pull support based on user scaffolding levels in the user interface of
It will be appreciated that the above scaffolding rules merely examples, and are designed to be applied in learning application programs that teach language acquisition. Scaffolding that is applied in learning application programs that relate to other subjects, such as mathematics, may take a different appearance. For example, instead of support in a native and target language, all help may be in the native language. Further, pull or push help for a math problem may display building blocks of knowledge that can be used by the user to solve the math problem, or may begin solving an equation step by step, etc.
V. Evaluation and Recommendation
Referring now to
Beginning at 1802, a profile characteristic of the user may be received as an input at the learning application program. As one example, referring also to
As indicated at 1806, the method may further include receiving performance data for the user from at least one of a plurality of learning application programs, at the learning service program. As one example, where the user interacts with or uses a particular learning application program, performance data associated with the interaction may be received by the learning service program. In some embodiments, the performance data may be received by one or both of local learning service program 112 and online learning service program 114. The performance data may be used by the assessment engine 150A, 150B to determine a particular learning level for the user, which may be stored in the user's profile. Note that the user's profile may reside locally at client device 102, at a peripheral device as illustrated at 110A, or remotely at 110B at the data store 118. The performance data may also be used by the assessment engine 150A, 150B to update other learning data of the user, in addition to or alternatively from the learning level of the user. For example, in some embodiments, the assessment engine may update a scaffolding level or other learning data stored in the user profile.
As indicated at 1808, the method may further include updating a learning level and/or other learning data of the user based on the performance data from at least one of the plurality of learning applications. As performance data is received by the learning service in response to user interaction with a learning application program, assessment engine 150A, 150B is configured to determine a learning level for the user based on the performance data generated from the interaction. The learning level of the user for a particular skill may then be used to update the learning level of the skill at the user's profile. In some embodiments, a change in the learning level for the user may be measured between the previous learning level that was stored in the user profile and the updated learning level. For example, a learning level of the user for each skill identified by the learning service program may remain the same, increase, or decrease with respect to the previous learning level stored at the profile. As discussed above, the assessment engine can reside at either or both of the local and online service programs.
At 1810, a recommendation may be determined for the user by a recommendation engine 152A, 152B, which may include one or more of the operations described with reference to 1812-1822. The recommendation may be based on the updated learning level or other learning data of the user. In some embodiments, the determination of the recommendation also may be based on comparisons to patterns of advancement shown by aggregated performance data from other users using the plurality of learning application programs, the other users sharing one or more matching profile attributes with the user. As described herein, a recommendation may indicate one or more learning application programs, websites, printed or electronic publications such as books, or other content stored at or referenced by the learning service, about which the learning service has knowledge or meta-data. In some embodiments, the recommendation may further indicate a particular portion or challenge of the learning application that may be accessed by the user to improve a particular skill. As discussed above, the recommendation engine can reside at either or both of the local and online service programs. However, while depicted in both locations in the Figures, in some embodiments it will be appreciated that the recommendation does not reside locally, but only on the online server system 116.
At 1812, the method may include identifying a group of users based on at least one matching profile characteristic with the user. For example, the identified group of users may have at least one matching profile characteristic with the user, where one or more of the matching profile characteristics may be received as input from the user. Alternatively, the matching profile characteristic may be inferred from user activity by the learning service program. As one example, the group of users may be selected based on native language and target language of study. However, it should be appreciated that other matching profile characteristics may be considered. Profile characteristics being matched further may include similarities in learning trend data or other data captured in the learning service but not explicit in the users' profiles. The identification of one or more groups of users is described in greater detail with reference to
As indicated at 1814, the method may further include updating a learning level for the group of users from a previous learning level at an online learning service. For example, as each user of the group of users interacts with or uses a learning application program, the learning level of each of the users may be updated in a respective user profile as described above with reference to 1808.
As indicated at 1816, the method may further include measuring a change in the learning level for the group of users between the previous learning level and the updated learning level attributable to at least a selected one of the plurality of learning application programs. The change in the learning level of each user of the group of users may be used to identify which learning applications are effective at increasing the learning level of the user.
At 1818, a recommendation may be determined for the user based on at least one of the updated learning levels of the user and the measured change in the learning level for the group of users. For example, the method may include determining a recommendation for the user based on the updated learning level of the user. Additionally, the determination of the recommendation may be further based on the measured change in the learning level for the group of users. For example, the recommendation may be determined by the recommendation engine so that it indicates learning application programs that have caused the greatest increase in the learning level of the group of users for a particular skill.
Note that a recommendation may indicate any suitable number of learning application programs or particular challenges associated with a learning application program. As one example, the recommendation may indicate at least one of a plurality of learning application programs. In some embodiments, the recommendation may further indicate a particular challenge of a learning application program. As yet another example, the recommendation may indicate at least two of the plurality of learning application programs. Furthermore, in some embodiments, the recommendation does not include a learning application program that was previously used by the user. In this way, the user may be recommended learning applications, books, websites, etc., that have not been previously used or purchased by the user, thereby reducing redundancy in the recommendation and increasing the relevancy of the recommendation.
As indicated at 1820, a weighting factor may be determined based on a comparison of the profile characteristics of the user and the group of users. As is described in greater detail with reference to
As indicated at 1822, the method may include assigning a recommendation value to each learning application program of the recommendation. The recommendation values may be used for displaying the recommendation on a graphical user interface. As one example, the relative position on the graphical user interface of each of the learning application programs indicated by the recommendation may be based on the assigned recommendation value of each learning application program. For example, a recommendation value may be assigned to each learning application program of the recommendation based on the measured change in the learning level of the group of users and the weighting factor for the group of users determined at 1820. Note that in some examples, a weighting factor may not be used by the recommendation engine when determining a recommendation for the user. For example, the user may be assigned to a user group without necessarily requiring that a weighting factor be determined.
As one non-limiting example, the learning application programs indicated by the recommendation may be arranged in a particular order when displayed on the graphical user interface. This order may be based on the recommendation value of each of the learning application programs. For example, the learning application program that is attributable to the greatest increase in the learning level of the group of users may be assigned the highest recommendation value of the plurality of learning applications such that it may be placed at the first position or top of the order. Conversely, a learning application that did not increase the learning level of the group of users may be assigned a lower recommendation value, thereby causing the learning application to be displayed closer to the bottom of the list or at a different page. In this way, it may be more likely that user or the user's parent, teacher, or other administrator will select the most effective learning application program.
At 1824, the recommendation for the user may be stored. As one example, the recommendation may be stored at the learning service, either locally at the local learning service or remotely at the online learning service. As another example, the recommendation may be stored at a profile of the user, such as at the local profile located at the client, at a profile located at a peripheral device, or remotely at the online learning service. In this way, the recommendation may be determined in advance to a user's recommendation request, thereby reducing the amount of time for providing the recommendation to the user.
At 1826, a request for the recommendation for the user may be received. For example, the user may request the recommendation at the learning service program. Alternatively, a parent, teacher administrator, or other administrator of the user may request the recommendation at the same or at a different client device via a respective parent, teacher administrator, or other administrator graphical user interface.
As indicated at 1828, the method may include displaying the recommendation on a graphical user interface of the learning service program. Where the recommendation is stored prior to the request, the recommendation may be retrieved by the learning service. Alternatively, the recommendation may be determined upon a request for the recommendation. Where the recommendation indicates multiple learning application programs, the method may include displaying each learning application program of the recommendation on the graphical user interface. In some embodiments, the relative position of each of the learning application programs on the graphical user interface may be based on the assigned recommendation value of each learning application program that is indicated by the recommendation.
As indicated by 1902 of the graphical user interface, User 1 is logged in or signed in to the learning application program marketplace such that recommendation 1900 for User 1 is displayed. Alternatively, a parent, teacher administrator, or other administrator may sign into the learning application program marketplace, which may likewise be indicated at 1902. Further, 1904 indicates that the recommendation currently displayed by the graphical user interface is for User 1.
In this particular example, the recommendation displayed by the graphical user interface indicates learning application programs 1-N via indicia 1932-1940. However, it should be appreciated that any suitable number of learning application programs or particular challenges thereof may be indicated by the recommendation, as indicated by the variable N in the fourth learning application program shown. Furthermore, it should be appreciated that a recommendation may indicate learning application programs that span two or more pages displayed by the graphical user interface or that occupy a scrollable window. Thus,
A first learning application program of the recommendation for User 1 is indicated at 1906. The first learning application program may be indicated by a title 1908, indicated, for example, as “Learning Application Program Gamma”. A customer rating 1910 of the learning application program may be represented graphically, for example, by a number of stars. It should be appreciated that other suitable approaches may be used for displaying a user rating for the learning application program. A set of skills utilized by the learning application program may be indicated at 1910. These skills may be used by the recommendation engine for recommending learning application program to the user based on the user's learning level for the particular skills associated with each of the learning application programs. For example, the set of skills associated with learning application program Gamma includes skills such as English reading, speaking, and listening. Further, the set of skills may include a skill range indicated by
A purchasing interface 1918 may be displayed by the graphical user interface to enable the user or administrator of the user to select and purchase the learning application program. For example, a selectable icon 1920 titled “Buy Now” may be displayed. Further, a, learning application program Gamma may require 25 points of a currency to complete the purchase. One or more seals 1921 may be provided adjacent each learning application program recommendation, indicating that the learning application program has earned a seal of approval and is thus recommended by a third party certification service, such as a testing service, a government agency, a school, etc.
A second learning application program of the recommendation for User 1 is indicated at 1924. The second learning application program may be indicated by a title that is different from the first learning application program indicated as learning application program Alpha. The second learning application program may be displayed in a manner that is similar to the first learning application program. For example, learning application program Alpha may also include a customer rating, a skill set including a skill level and list of skills, a description, and an associated image. Furthermore, a purchasing interface for learning application program Alpha may also be displayed. Note that, in some embodiments, a common purchasing interface may be to facilitate the purchase of two or more learning application programs.
A third learning application program “Beta” of the recommendation for User 1 is indicated at 1926. The third learning application may be indicated using similar indicia as the first and second learning application programs. An Nth learning application program “Sigma” of the recommendation for User 1 is indicated at 1928. The Nth learning application program may represent any suitable number of learning application programs that may be indicated by the recommendation for User 1.
In some embodiments, only a portion of the recommendation may be displayed by the graphical user interface at a particular instance. Thus, a selectable icon 1930 may be provided to enable the user or an administrator for the user to view more learning application programs that may be indicated by the recommendation in addition to those currently displayed.
As described with reference to method 1800, learning application programs may be displayed in an order that corresponds to their respective recommendation value. For example, referring again to
Furthermore, a learning application program that has already been purchased by the user or has already been used by the user may not be presented for the user with the recommendation or may be excluded from the recommendation. For example, a learning application program may have a higher recommendation value than Gamma, but it may nonetheless be removed from the recommendation by the recommendation engine. In this way, redundancies in the recommendation may be reduced and relevancy of the recommendation may be increased.
As described with reference to 1812 of method 1800, a group of users may be identified when determining a recommendation for a particular user based on at least one matching profile characteristic. Referring now to
Population 2002 also includes the users associated with groups 2004, 2006, 2008, and 2008. Group 2004, which includes a subset of users from population 2002, may be defined as the users of population 2002 that share a first number of matching profile characteristics. As one specific example, the users of group 2004 may share a profile characteristic that includes native language. For example, the users of group 2004 may have a native language of Chinese. Hence, the users of group 2004 may be more closely related to each other based on their profile characteristics than the remainder of population 2002 that is excluded from group 2004.
Group 2006, which includes a subset of users from group 2004, may be defined as the users of population 2002 that share a second number of matching profile characteristics. In this particular example, the second number of matching profile characteristics is greater than the first number of matching profile characteristics associated with group 2004. In other words, the users of group 2006 may be more closely related to each other based on their matching profile characteristics than the users of group 2004 that are excluded from group 2006. For example, where the users of group 2004 share a profile characteristic that includes native language, the users of group 2006 may share profile characteristics that include both native language and grade of the user. Hence, the number of users of group 2006 may be less than the number of users of group 2004 as group 2006 includes a more specific subset of users.
Similarly, group 2008, which also includes a subset of users from group 2004, may be defined as the users of population 2002 that share a third number of matching profile characteristics. In this particular example, the third number of matching profile characteristics associated with group 2008 is also greater than the first number of matching profile characteristics associated with group 2004. Hence, the number of users of group 2006 may be less than the number of users of group 2004.
Note that the second number of matching profile characteristics defining group 2006 can be the same or different from the third number of matching profile characteristics defining group 2008. Furthermore, the type of profile characteristic that is shared among users may also differ. Groups 2006 and 2008 may be defined by different matching profile characteristics while sharing the same number of matching profile characteristics. As one example, the users of groups 2006 and 2008 may share profile characteristics that include native language. As a more specific example, group 2006 can include a native language of Chinese and a user age of 10 years, and group 2008 can include a native language of Chinese and a target language of study of English. It should be appreciated that any number and type of matching profile characteristics may be used to define a group of users of the user population. For example, similar learning levels for specified skills may also be used as a matching profile characteristic. A summary of example profile characteristics is described herein with reference to Table 1.
Continuing with
In this way, one or more groups of users may be defined within a population of users based on any suitable number or type of matching profile characteristics. Further, as illustrated by
As described with reference to 1820 of method 1800, a weighting factor may be determined in at least some examples based on a comparison of the profile characteristics of the user and the profile characteristics of a group of users. Referring now to
The weighting factor may then be used by the recommendation engine to influence the recommendation. For example, the influence of a particular group on the recommendation may increase with increasing weighting factor. As one non-limiting example, the relevance of the measured change in the learning level of the group of users may be adjusted by the weighting factor. In this way, users that are more closely matched to the user for whom the recommendation is determined may influence the recommendation more than users that are less closely matched to the user.
Note that while
VI. Matching
Referring again briefly to
The learning service program may be configured to send the match result to the requesting learning application program. The learning system may further include application programming interface 108 configured to transmit communications between the learning service program and the requesting learning application program.
Computerized learning system 100 may further include online learning service program 114 executed on the online server system 116 configured to communicate over the computer network 120 with the local learning service program executed on user client device 102. The matching engine 154A, 154B may be a component of the online service learning service program, and may be configured to send the match result to the requesting learning application program via the local learning service program.
Computerized learning system 100 may further include assessment engine 150A, 150B associated with the learning service program configured to determine an assessed learning level for each of the plurality of users based on the performance data. It should be appreciated that the assessed learning level may be determined on a per skill basis for each of the plurality of users. The matching engine 154A, 154B may be configured to match the plurality of users based on the assessed learning level for each of the plurality of users. It will be appreciated that other learning data for each of the plurality of users may also form the basis for the matching.
The matching engine 154A, 154B may be configured to determine one or more skills utilized by the requesting learning application program by referencing application-specific game schema 172 in a game configuration file. As one example, the game configuration file may be stored in non-volatile storage 132A, 132B accessible to the matching engine 154A, 154B. The matching engine 154A, 154B may be configured to match users based on learning levels for the skills determined to be utilized by the learning application program.
Computerized learning system 100 for matching users may include a matching engine configured to receive a matchmaking request from a requesting learning application program via application programming interface 108. The request may be used to perform matching of a plurality of users for multi-user interaction via a learning application program. The matching engine 154A, 154B may be further configured to process the request by determining a plurality of available users who are available for game play, reading performance data in a learner profile for each of the available users, comparing the performance data according to a matching mode to thereby produce a match result including one or more matched groups of users, and sending the match result to the requesting learning application program.
The learning service program may include local learning service program 112 executed on a user device. The learning service program may further include online learning service program 114 having an associated matching engine. The learning service program may receive requests from users to engage in a multi-user online interaction via a learning application program, where the matching may be performed in response to the request. At 2208, the method includes receiving a request to perform matching of the plurality of users for multi-user interaction from a requesting learning application program. It will be appreciated that the request to perform matching may be received from a requesting learning application program, and the request may include data indicating the game type of the requesting learning application program.
As shown at 2210, the method may include determining one or more skills utilized by the requesting learning application program by referencing an application-specific game schema 172 in a game configuration file stored at a location accessible to the learning service program. At 2212, the method may further include, at the learning service program, selecting a matching mode for matching the plurality of users, based on the received game type of the requesting learning application program. For example, the matching mode may be selected from a group including a mentor matching mode, a team matching mode, and a parity matching mode. Thus, in some examples, a plurality of matching modes may be provided.
At 2214, the method may include matching the plurality of users based on one or more parameters. As indicated at 2216, the method may include matching the plurality of users based on the performance data for each user received from the plurality of learning application programs, to thereby produce a match result including one or more matched groups of users. As indicated at 2218, the method may further include matching the plurality of users based on a matched user profile characteristic of each of the plurality of users. The matched user profile characteristic may be selected from the group consisting of first (or native) language, target language, country, grade level, learning level for a skill, age, gender, interests, other profile data stored for each user, or other user data that may be relevant to targeted learning skill or game genre.
At 2220, the method may include matching the plurality of users based on the assessed learning level for each of the plurality of users. At 2222, the matching may be based on learning levels for the skills determined to be utilized by the learning application program. At 2224, the method may further include matching among a plurality of users who are logged into the online service program and who have access to the learning application assets needed to play the learning application program, or are otherwise registered to be online and available to play. In some embodiments, the matchmaking engine is configured to send a message asking users who are detected to be online but not logged into the online learning service whether they would like to join a group of users who are commencing interactive play. The matching of the plurality of users may be based on one or more parameters described with reference to 2216-2224.
Referring to
As indicated at 2230, the matching mode may be a parity matching mode, according to which the learning service program may be configured to match users of substantially equal learning levels for head-to-head or cooperative game play. In some embodiments, the learning service program may be configured to match users of substantially similar learning levels or may be configured to create the closest match of the users that may be practical from the population of users.
As indicated at 2232, the matching mode may be a team matching mode, according to which the learning service program may be configured to match users into two or more teams of users with substantially equal aggregate team learning levels. In some embodiments, the learning service program may be configured to match users into two or more teams with substantially similar learning levels or may be configured to create the most equal match of the teams that may be practical from the population of users. Note that the aggregate team learning level can include a total learning level of the team members, an average learning level of the team members, or a median learning level of the team members, among other suitable aggregation approaches. In this way, the users may be matched based on a selected matching mode.
At 2234 the method may further include recommending a handicap level to achieve substantial equality in learning levels among matched users. As one example, where the parity matching mode is selected, users having different learning levels may be provided with a handicap to reduce the difference between the learning levels. It should be appreciated that the handicap may be applied to each of the matching modes where there is an undesired difference in learning levels.
The method may further include, at 2236, sending the match result to the requesting learning application program, and at 2238, displaying the match result on a graphical user interface of the requesting learning application program. As one example, the match result may be displayed on sign-in interface 300 of a particular learning application program via user client device 102. Once the match result is displayed, the computerized learning system 100 is configured to enable the users to engage in multi-user interaction according to the match result.
VII. Trophies
The interaction of the various components of computerized learning system 100 with trophy engine 156A, 156B are discussed in detail hereinafter. Referring to
Learning service program 106 may be configured to store data relating to a trophy in profile 110 of the user. For example, data relating to a trophy may be stored in the achievement array element of profile 110. It may be appreciated that profile 110 of the user may be stored in non-volatile storage 132A, 132B on one or both of a local user client device and an online learning service.
As discussed above, computerized learning system 100 may further include application programming interface 108 configured to receive the user performance data 206 from each of the plurality of learning application programs, and store the user performance data 206 in profile 110 for retrieval by the learning service program, application programming interface 108 being further configured to read and write data relating to the trophy in the user profile.
Learning service program 106 further may be configured to display a graphical user interface including an icon representing the trophy. According to another embodiment, the system may include learning service program 106 configured to display a graphical user interface, the graphical user interface being configured to display trophies awarded to a user by the learning service program for achieving assessed user learning levels meeting or exceeding a predetermined learning level threshold based on user performance in a plurality of learning application programs 104.
Referring to
In the depicted embodiment, the trophy information of friends Mei-Mei and Da-rin is displayed in the semi-private friends pane 1002 of trophy graphical user interface 1000. The semi-private friends pane 1002 may include information associated with trophy points, trophies won, trophy progress, and dates corresponding to trophies for each friend. Additionally, the trophy can record learning assessment data, including detailed information regarding the skill levels achieved prior to awarding the trophy, with pointers to a data record of the assessment. The trophy graphical user interface 1000 may include a selector 1008 for receiving a user selection to cause the trophy to be hidden from friends in the semi-private view. In the depicted embodiment the selector hides all trophies from the view of friends; however it will be appreciated that the hide selector may be provided for each trophy individually. Further, learning service program 106 may be configured to send a notification message to a parent of the user regarding the award of the trophy. This enables parents to keep up to date on a student's learning progress. A similar message may be sent to an administrator such as a teacher. For example, the system may be configured to send a teacher trophy information for each student in a class.
As shown in
At 2308, the method may further include awarding a trophy to the user upon determining that the assessed user learning characteristic meets or exceeds a predetermined threshold. As discussed above, this may include determining that a user learning level meets or exceeds a predetermined user learning level threshold. At 2310, the method may further include storing the trophy in a user profile accessible to the learning service program. At 2312, the method may further include displaying the trophy on a graphical user interface of the learning service program. Alternatively, the trophy may be displayed on the user interface of a learning application program.
At 2314, the method may include sending a notification message from the online learning service to the parent of the user regarding the award of the trophy.
As discussed above, it should be appreciated that trophies may also be awarded for user learning characteristics that represent achievements within a learning application program that are not directly related to attainment of a learning level. For example, a learning application program developer may specify that a user is to be awarded a trophy after playing the learning application a predetermined number of times, or for perfect attendance at online events. In this case, instead of steps 2304-2308 above, the method may include determining that the user has achieved a predetermined trophy criterion, which may be set by the game developer, and then awarding the trophy to the user upon making such determination.
VIII. Parent Interface
The interaction of the various components of computerized learning system 100 with parent graphical user interface 1100 is discussed in detail hereinafter. Referring to
As described above, learning service program 106 may include assessment engine 150A, 150B configured to determine an assessed user learning level based on the user performance data, and store the learning level being in profile 110 of the user. The assessed user learning level may be stored in profile 110 according to a profile schema. Learning service program 106 may further include a statistics engine 164A, 164B configured to aggregate learning data stored in profile 110 of the user with data stored in profiles of other users to thereby produce a statistical comparison. Learning data may be uploaded from profile 110 of the user. Learning data of other users, as defined by various elements such as the friends array, the group array, and the group members array according to the profile schema, may be uploaded from profiles of other aggregated users. Learning service program 106 may include recommendation engine 152A, 152B configured to determine a recommendation for continued action for the user based on data stored in the learner profile.
Referring next to
The parent graphical user interface 100 may include various panels configured to present information to a parent. In some embodiments, the information presented to the parent may include information produced by the various engines of learning service program 106 shown and described in reference to
Information from each of these engines may be shown on parent graphical user interface 1100. For example, the parent graphical user interface 1100 may be configured to display an assessed user learning level determined by assessment engine 150. In the depicted embodiment, the assessed learning level is displayed in progress panel 1102 as a plurality of learning levels for a skill arranged over time. Likewise, statistical comparisons of a user to other users generated by statistics engine 164B may be displayed in a statistical comparison panel 1104. Further, a recommendation generated by recommendation engine 152A, 152B may be displayed in a student recommendations panel 1106. As specific examples of recommendations, one or more recommended learning application programs for the user may be listed in the recommendations panel 1106.
Continuing with
The parent graphical user interface 1100 may further include a friends status panel 1110 showing which of the user's friends are currently online, and also a service-level vocabulary status panel 1112 showing progress made acquiring vocabulary in one or more learning application programs. The parent graphical user interface 1100 may be further configured to display a control panel 1114 on the parent graphical user interface, control panel 1114 being configured to receive parent selected control parameters governing a parent regulated activity of the user on the computerized learning system 100. Examples of activities that may be regulated include, but are not limited to, approved games, approved friends, and/or approved time for playing games.
At 2408, the method may further include authorizing access to the parent graphical user interface for an authenticated parent of the user. For example, a parent ID stored in meta data of profile 110 may be associated with an encrypted password of an authenticated parent of the user.
The method may further include, at 2410, displaying learning data from engines of learning service program 106. For example, the method may include, at 2412, reading an assessed user learning level for a skill from profile 110 of the user and displaying the assessed user learning level in the parent view of profile 110 of the user on parent graphical user interface 1100. Additionally, the method may include, at 2414, displaying a statistical comparison of learning data stored in profile 110 of the user with data stored in profiles of other users, on parent graphical user interface 1100. The method may further include, at 2416, displaying a recommendation for the user on parent graphical user interface 1100, the recommendation being selected based on data stored in profile 110 of the user. The method may also include, at 2418, displaying a summary of user activity in the plurality of learning activity programs, on parent graphical user interface 1100, displaying, at 2420, information regarding online friends of a user on parent graphical user interface 1100, and/or displaying, at 2422, information regarding new skills acquired by the user on parent graphical user interface 1100. The information displayed by the method described may be embodied in panels of parent graphical user interface 1100, as described above.
The method may further include, at 2424, displaying a control on the parent graphical user interface, the control being configured to receive parent selected control parameters governing a parent regulated activity of the user on the computerized learning system 100. One or more parent regulated activities may be selected by an authenticated parent of the user in the controls of profile 110 according to profile schema, as described above. The parent regulated activities may be selected in control panel 1114 on parent graphical user interface 1100. Examples of parent regulated activities include, but are not limited to, whether a user is allowed to associate with selected other users via a friends interface, whether a game or other application is an allowed application, whether a selection within a game or application is an allowed selection, and whether a user has permission to use a game or application for a specified duration, at a specified time, identity of the learning application program, or whether “an exchange” of activities may be arranged, e.g. an equal amount of time spent in learning activities can be exchanged for watching videos or other entertainment.
IX. Admin Interface
The interaction of the various components of computerized learning system 100 with an administrator graphical user interface discussed in detail hereinafter. Two exemplary administrator graphical user interfaces are illustrated in
As discussed above, learning service program 106 may be configured to receive learning data for a plurality of users from a plurality of learning application programs 104. Computerized learning system 100 may further include reporting engine 160A, 160B responsive to administrator selected parameters so as to retrieve and process the learning data to produce reports configured to be displayed on teacher and managing administrator graphical user interfaces 1200, 1300. It may be understood that reporting engine 160A, 160B may be configured to receive and process administrative data for use in creation of the reports. Teacher and managing administrator graphical user interfaces 1200, 1300 may include a selector 1202, 1302 configured to receive the administrator selected parameters, and the administrator selected parameters are adapted to form the basis for the display of a learning data report.
As discussed above, learning service program 106 may include an assessment engine 150A, 150B configured to determine an assessed user learning level based on the learning data, wherein the assessed user learning level is displayed on teacher and managing administrator graphical user interfaces 1200, 1300. Learning service program 106 may further include statistics engine 164A, 164B configured to aggregate the learning data for the plurality of users. Teacher and managing administrator graphical user interfaces 1200, 1300 may display a statistical comparison of the learning data. Learning service program 106 may include recommendation engine 152A, 152B configured to determine a recommendation for continued action for the user based on data stored in the learner profile. Teacher and managing administrator graphical user interfaces 1200, 1300 may further display a recommendation for one or more of the plurality of users, the recommendation being selected based on the learning data. Learning service program 106 may include matching engine 154A, 154B configured to match two or more of the plurality of users based on the learning data received at learning service program 106 for said two or more users.
In one embodiment, teacher administrator selected parameters may be adapted such that learning data displayed in a learning data report, such as report 1204, on teacher administrator graphical user interface 1200 may include learning level data. For example, learning data parameters 1206 may be selected in report selector 1202 such that the learning data report at 1204 may display learning level data. In another embodiment, learning data displayed on teacher administrator graphical user interface 1200 may include learning data associated with a predefined group of users through time. For example, learning data parameters 1206 may be selected in report selector 1202 to include a group of one or more users. The predefined group of users may include at least one of a classroom, a school, a school district, a state, and a country, for example. Student selector 1212, subject selector 1214, and report template selector 1216 are provided to select individual students, subjects, and report templates for the learning data report. Further, it will be appreciated that in the depicted embodiment, data in these selectors 1212-1216 is populated by demographic selector 1218. Demographic selector 1218 includes pull down menus by which a user may select a class, year, semester, and month from which data is to be drawn from for including in selectors 1212-1214, which in turn may be used by the user to further filter the data for inclusion in report 1204. Some or all of this demographic data may be gathered from school records via proprietary computerized database systems, if not available from computerized learning system 100. Further, it will be appreciated that in some embodiments learning data gathered from computerized learning system 100 may be combined with learning data from other sources, such as standardized test scores, demographic data, etc., to produce report 1204.
As described above, teacher administrator graphical user interface 1200 may display a statistical comparison of the learning data. For example, a statistical comparison 1208 in the form of a graph or table may be included in report 1204. Teacher administrator graphical user interface 1200 may further display a recommendation for one or more of the plurality of users, the recommendation being selected based on the learning data. For example, recommendation pane 1210 may include an assessment of the learning level of one or more students or the group, for a skill, and a list of one or more recommendations.
The following is a list of example reports that may be produced via the teacher administrator user interface.
Various administrative data may be selected via report selector 1302. Report selector 1302 typically includes a demographics selector 1304 configured to receive user selection of geographic region such as state, class, and school district, and block/neighborhood within a school district from which administrative data will be drawn to produce administrative report 1310. Report selector 1302 may further include an administrative data selectors such as computerized learning system data selector 1306 and external data selector 1308 configured to enable the user to select with particularity which data gathered from external sources to include in administrative report 1310. The computerized learning system data selector 1306 typically is configured to enable the user to select data gathered from computerized learning system 100, while external data selector 1308 is typically configured to enable the user to select data gathered from third party and proprietary sources, such national exam statistics or a school district's own records.
In one embodiment, the external data may include financial data such as salary data, management expense data, and promotion data that the administrator may wish to compare and correlate. This data may be drawn from third party or proprietary services that reside outside of the learning service, and may be combined with learning service data through the use of web services. The external data may also include administrative data such as testing data administered and scored in a standard manner. For example, testing data may include one or more of state or national exam scores, TOEFL scores, and/or Flesch-Kincaid or other proficiency data. In yet another embodiment, the external data may also include organizational data gathered from services outside of the learning service but combined for reporting purposes with learning service data. For example, the organizational data may include one or more of enrollment data, disability data, gender distribution data, and teacher absentee data. Various other exemplary data types are illustrated in
Further, it will be appreciated that managing administrator graphical user interface is typically configured to offer the administrator access via link 1314 to the teacher administrator graphical user interface with managing administrator level permissions, thereby enabling the generation of all of the reports listed above on a individual or classroom basis, plus the following reports for larger aggregate groups of students.
The administrator user interface 1300 may also be configured to display a marketplace pane 1312 in which, for example, books and software of interest to managing administrators may be displayed. In the depicted embodiment, a top sellers list is illustrated. Within the marketplace pane 1312, a link may be provided by which the administrator can access further information or make a purchase.
At 2506, the method may further comprise displaying a selector on administrator graphical user interface 1300, the selector being configured to receive administrator selected learning data parameters governing learning data displayed on administrator graphical user interface 1300, and, at 2508, arranging learning data into a report displayed on administrator graphical user interface 1300 based on the selected learning data parameters. It will be appreciated that the learning data may be for aggregate student populations, and may be combined with data not gathered via computerized learning system 100, to produce the types of reports described above.
At 2510, the method may further comprise displaying a statistical comparison of the learning data, on the administrator graphical user interface. At 2512, the method may further comprise displaying a recommendation for one or more of the plurality of users, the recommendation being selected based on the learning data. At 2514, the method may further comprise authorizing access to the administrator graphical user interface for an authenticated administrator. It should be appreciated that the steps illustrated in
It should be understood that the embodiments herein are illustrative and not restrictive, since the scope of the invention is defined by the appended claims rather than by the description preceding them, and all changes that fall within metes and bounds of the claims, or equivalence of such metes and bounds thereof are therefore intended to be embraced by the claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4336020 | Zacharin | Jun 1982 | A |
| 4798543 | Spiece | Jan 1989 | A |
| 4967077 | Watson | Oct 1990 | A |
| 5035625 | Munson et al. | Jul 1991 | A |
| 5437555 | Ziv-El | Aug 1995 | A |
| 5439232 | Pollock | Aug 1995 | A |
| 5456607 | Antoniak | Oct 1995 | A |
| 5607356 | Schwartz | Mar 1997 | A |
| 5782692 | Stelovsky | Jul 1998 | A |
| 5806056 | Hekmatpour | Sep 1998 | A |
| 5813913 | Berner et al. | Sep 1998 | A |
| 5879165 | Brunkow et al. | Mar 1999 | A |
| 6076021 | Houriet, Jr. et al. | Jun 2000 | A |
| 610639 | Begis | Aug 2000 | A |
| 6099320 | Papadopoulos | Aug 2000 | A |
| 6146148 | Stuppy | Nov 2000 | A |
| 6149441 | Pellegrino et al. | Nov 2000 | A |
| 6164975 | Weingarden et al. | Dec 2000 | A |
| 6186794 | Brown et al. | Feb 2001 | B1 |
| 6227863 | Spector | May 2001 | B1 |
| 6270351 | Roper | Aug 2001 | B1 |
| 6287123 | O'Brien | Sep 2001 | B1 |
| 6301462 | Freeman et al. | Oct 2001 | B1 |
| 6302698 | Ziv-El | Oct 2001 | B1 |
| 6322366 | Bergan et al. | Nov 2001 | B1 |
| 6336813 | Siefert | Jan 2002 | B1 |
| 6347333 | Eisendrath et al. | Feb 2002 | B2 |
| 6352479 | Sparks, II | Mar 2002 | B1 |
| 6377781 | Mishkin | Apr 2002 | B1 |
| 6405162 | Segond et al. | Jun 2002 | B1 |
| 6419496 | Vaughan, Jr. | Jul 2002 | B1 |
| 6487583 | Harvey et al. | Nov 2002 | B1 |
| 6507726 | Atkinson et al. | Jan 2003 | B1 |
| 6546230 | Allison | Apr 2003 | B1 |
| 6551107 | Buckley et al. | Apr 2003 | B1 |
| 6554618 | Lockwood | Apr 2003 | B1 |
| 6634949 | Briggs et al. | Oct 2003 | B1 |
| 664876 | Nicastro | Nov 2003 | A1 |
| 6641481 | Mai et al. | Nov 2003 | B1 |
| 6688888 | Ho et al. | Feb 2004 | B1 |
| 6699043 | Ho et al. | Mar 2004 | B2 |
| 6699125 | Kirmse et al. | Mar 2004 | B2 |
| 6704541 | Ciarallo et al. | Mar 2004 | B1 |
| 6790045 | Drimmer | Sep 2004 | B1 |
| 6808393 | Mascarenhas | Oct 2004 | B2 |
| 6813474 | Robinson et al. | Nov 2004 | B2 |
| 6817947 | Tanskanen | Nov 2004 | B2 |
| 6825601 | Yamauchi et al. | Nov 2004 | B2 |
| 6884175 | Toriyama et al. | Apr 2005 | B2 |
| 6921268 | Bruno et al. | Jul 2005 | B2 |
| 6944596 | Gray et al. | Sep 2005 | B1 |
| 6944624 | Orton et al. | Sep 2005 | B2 |
| 6979267 | Leen et al. | Dec 2005 | B2 |
| 6987945 | Corn et al. | Jan 2006 | B2 |
| 6996366 | L'Allier et al. | Feb 2006 | B2 |
| 7025675 | Fogel et al. | Apr 2006 | B2 |
| 7029394 | Leen et al. | Apr 2006 | B2 |
| 7050753 | Knutson | May 2006 | B2 |
| 7054831 | Koenig | May 2006 | B2 |
| 7080030 | Eglen et al. | Jul 2006 | B2 |
| 7192352 | Walker et al. | Mar 2007 | B2 |
| 7545784 | Mgrdechian et al. | Jun 2009 | B2 |
| 7895625 | Bryan et al. | Feb 2011 | B1 |
| 20010017632 | Goren-Bar | Aug 2001 | A1 |
| 20010031456 | Cynaumon et al. | Oct 2001 | A1 |
| 20010049084 | Mitry | Dec 2001 | A1 |
| 20020045154 | Wood et al. | Apr 2002 | A1 |
| 20020046202 | Honda | Apr 2002 | A1 |
| 20020081561 | Skeans et al. | Jun 2002 | A1 |
| 20020086267 | Birkhoelzer et al. | Jul 2002 | A1 |
| 20020101036 | Kutzik | Aug 2002 | A1 |
| 20020138456 | Levy et al. | Sep 2002 | A1 |
| 20020142815 | Candelore | Oct 2002 | A1 |
| 20020187463 | Aspe et al. | Dec 2002 | A1 |
| 20020188583 | Rukavina et al. | Dec 2002 | A1 |
| 20020193162 | Walker et al. | Dec 2002 | A1 |
| 20030009742 | Bass et al. | Jan 2003 | A1 |
| 20030017442 | Tudor et al. | Jan 2003 | A1 |
| 20030027121 | Grudnitski et al. | Feb 2003 | A1 |
| 20030059761 | Patterson | Mar 2003 | A1 |
| 20030134261 | Jennen et al. | Jul 2003 | A1 |
| 20030148253 | Sacco et al. | Aug 2003 | A1 |
| 20030152902 | Altenhofen et al. | Aug 2003 | A1 |
| 20030152903 | Theilmann | Aug 2003 | A1 |
| 20030203346 | Wen et al. | Oct 2003 | A1 |
| 20030207237 | Glezerman | Nov 2003 | A1 |
| 20030207242 | Balasubramanian | Nov 2003 | A1 |
| 20040009457 | Weiner et al. | Jan 2004 | A1 |
| 20040009462 | McElwrath | Jan 2004 | A1 |
| 20040018479 | Pritchard et al. | Jan 2004 | A1 |
| 20040073787 | Ban et al. | Apr 2004 | A1 |
| 20040110119 | Riconda et al. | Jun 2004 | A1 |
| 20040114032 | Kakii et al. | Jun 2004 | A1 |
| 20040127289 | Davis et al. | Jul 2004 | A1 |
| 20040128319 | Davis et al. | Jul 2004 | A1 |
| 20040180317 | Bodner et al. | Sep 2004 | A1 |
| 20040193776 | Iida et al. | Sep 2004 | A1 |
| 20040209231 | Merritt | Oct 2004 | A1 |
| 20040219502 | Bechard et al. | Nov 2004 | A1 |
| 20040219504 | Hattie | Nov 2004 | A1 |
| 20040241625 | Raya et al. | Dec 2004 | A1 |
| 20050026131 | Elzinga et al. | Feb 2005 | A1 |
| 20050048458 | Collins et al. | Mar 2005 | A1 |
| 20050089829 | Wasowicz | Apr 2005 | A1 |
| 20050113164 | Buecheler et al. | May 2005 | A1 |
| 20050137006 | Rothschild et al. | Jun 2005 | A1 |
| 20050175970 | Dunlap et al. | Aug 2005 | A1 |
| 20050186550 | Gillani | Aug 2005 | A1 |
| 20050191605 | Nguyen et al. | Sep 2005 | A1 |
| 20050192097 | Farnham et al. | Sep 2005 | A1 |
| 20050221261 | Wen et al. | Oct 2005 | A1 |
| 20050221268 | Chaar et al. | Oct 2005 | A1 |
| 20050227215 | Bruno et al. | Oct 2005 | A1 |
| 20050227216 | Gupta | Oct 2005 | A1 |
| 20050227792 | McCreary et al. | Oct 2005 | A1 |
| 20050233288 | McGrath | Oct 2005 | A1 |
| 20050266906 | Stevens | Dec 2005 | A1 |
| 20050278041 | Bortnik et al. | Dec 2005 | A1 |
| 20060046239 | Allen et al. | Mar 2006 | A1 |
| 20060078863 | Coleman et al. | Apr 2006 | A1 |
| 20060078868 | Douglas et al. | Apr 2006 | A1 |
| 20060082060 | Soto | Apr 2006 | A1 |
| 20060105313 | Mansfield et al. | May 2006 | A1 |
| 20060121991 | Bortnik et al. | Jun 2006 | A1 |
| 20060121992 | Bortnik et al. | Jun 2006 | A1 |
| 20060122716 | Bortnik et al. | Jun 2006 | A1 |
| 20060127871 | Grayson | Jun 2006 | A1 |
| 20060135264 | Shaw et al. | Jun 2006 | A1 |
| 20060154227 | Rossi et al. | Jul 2006 | A1 |
| 20060166174 | Rowe et al. | Jul 2006 | A1 |
| 20060170945 | Bill | Aug 2006 | A1 |
| 20060204947 | Berger et al. | Sep 2006 | A1 |
| 20060223041 | Beck et al. | Oct 2006 | A1 |
| 20060240395 | Faist et al. | Oct 2006 | A1 |
| 20060247055 | O'Kelley, II et al. | Nov 2006 | A1 |
| 20060258416 | Crawford | Nov 2006 | A1 |
| 20060286538 | Scalone et al. | Dec 2006 | A1 |
| 20060287106 | Jensen | Dec 2006 | A1 |
| 20070009875 | Berman | Jan 2007 | A1 |
| 20070021168 | Chamizer et al. | Jan 2007 | A1 |
| 20070136603 | Kuecuekyan | Jun 2007 | A1 |
| 20070143130 | Hearn | Jun 2007 | A1 |
| 20070143175 | Tien et al. | Jun 2007 | A1 |
| 20070218434 | Habichler et al. | Sep 2007 | A1 |
| 20070218447 | Chavan | Sep 2007 | A1 |
| 20070248938 | Ronald | Oct 2007 | A1 |
| 20070273101 | Berke et al. | Nov 2007 | A1 |
| 20070277104 | Hennum et al. | Nov 2007 | A1 |
| 20070281285 | Jayaweera | Dec 2007 | A1 |
| 20080108035 | Warda | May 2008 | A1 |
| 20080109453 | Bauer | May 2008 | A1 |
| 20080153596 | Nguyen | Jun 2008 | A1 |
| 20080268414 | Fung | Oct 2008 | A1 |
| 20090054127 | Sweary et al. | Feb 2009 | A1 |
| Number | Date | Country |
|---|---|---|
| 1326189 | Jul 2003 | EP |
| 2004233734 | Aug 2004 | JP |
| 20010000648 | Jan 2001 | KR |
| 20010044827 | Jun 2001 | KR |
| 20010075837 | Aug 2001 | KR |
| 20020003721 | Jan 2002 | KR |
| 20020086422 | Nov 2002 | KR |
| 2005113093 | Dec 2005 | WO |
| 2006073377 | Jul 2006 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20080254429 A1 | Oct 2008 | US |
