Structural elements for a collaborative e-learning system

Abstract

A learning system, method, and data structure provides collaborative activities between learners. The system includes an interface to receive a learning strategy selected by a learner. A content management system stores one or more structural elements associated with a course. A learning management system determines the learning content and the one or more structural elements to present to the learner based on the selected learning strategy.

Description

TECHNICAL FIELD

The following description relates generally to e-learning and in particular to collaborative e-learning.

BACKGROUND

Systems and applications for delivering computer-based training (CBT) have existed for many years. However, CBT systems historically have not gained wide acceptance. A problem hindering the reception of CBTs as a means of training workers and learners is the inflexibility of courses and training material to adapt to the need of individual learners.

Some CBTs were based on hypermedia systems that statically linked content. User guidance was given by annotating the hyperlinks with descriptive information. The trainee could proceed through learning material by traversing the links embedded in the material. The structure associated with the material was very rigid, and the material could not be easily written, edited, or reused to create additional or new learning material.

Newer methods for intelligent tutoring and CBT systems are based on special domain models that must be defined prior to creation of the course or content. Once a course is created, the course material may not be easily adapted or changed for specific training needs of different learners. As a result, the course often fails to meet the needs of the trainee and/or trainer.

In addition, CBT systems do not provide for collaborative learning that is typically associated with classes taught in a classroom. Practically all CBT courses are constructed according to the paradigm of individual learning that at best is enhanced by an environment that enables users to communicate with each other. For example, a typical web-based course may include an elaborate hyper media structure. The structure is embedded into an environment that provides general tools for communication (e.g., chat rooms or video conferencing). However, content and collaboration are not integrated.

Therefore, for the above and other reasons, new methods and technologies are needed to supplement traditional computer based training and instruction.

SUMMARY

In one general aspect, a learning system includes an interface to receive a learning strategy selected by a learner. A content management system stores one or more structural elements associated with a course, where at least one of the structural elements is configured to allow a learner to engage in a collaboration activity. A learning management system determines the structural elements to present to the learner based on the selected learning strategy.

In one implementation, the at least one structural element may be a knowledge item. The at least one structural element may be configured to provide a collaboration tool. The collaboration tool may be configured to allow two or more learners to participate in the collaboration activity. The structural elements may be configured so as to not enforce a sequence that a learner uses to traverse the course.

Additionally, one or more competencies may be associated with the at least one structural element. The learning system may use the competencies to determine how to present structural elements to the learner. A collaboration property may be associated with the at least one structural element. The collaboration property may indicate a learner's interaction with the at least one structural element. The collaboration property may be used by the learning system to determine how to present structural elements to the learner.

In another general aspect, a method may be used to divide content associated with an e-learning course into two or more structural elements that may be interpreted by a browser, wherein at least one of the structural elements is configured to allow a learner to engage in a collaboration activity. The method may include aggregating the structural elements into two or more levels, where a higher level may refer to any instance of a lower level, and assembling the structural elements into a course.

In one implementation, the method may include providing the at least one structural element to a learner and receiving a selection from the learner to participate in the collaboration activity. The collaboration activity may be configured to facilitate collaboration between two or more learners. The at least one structural element may be a knowledge item. The structural elements may be configured so as to not enforce a sequence of structural elements that a learner uses to traverse the course. The method may include associating metadata with the structural elements.

In another implementation, the method includes associating a competency with the at least one structural element, and determining how to present course material to the learner based on the competency. The method may include associating a collaboration property with the at least one structural element. The method also may include storing the collaboration property to indicate a learner's interaction with the at least one structural element. The method also may include determining how to present structural elements to the learner based on the collaboration property.

In yet another general aspect, a memory for storing course data for access by an application program being executed by a content player includes a course data structure stored in the memory. The course data structure includes information used by the application to present an e-learning course. The course data structure includes a plurality of structural elements aggregated into two or more levels, where a higher level may refer to any instance of a lower level, and at least one of the structural elements is configured to allow a learner to engage in a collaboration activity. The course data structure further includes metadata to describe the structural elements, and a plurality of relations to indicate dependencies between the structural elements.

In one implementation, the collaboration activity may be configured to facilitate collaboration between two or more learners. Additionally, the at least one structural element may be a knowledge item. The structural elements may be configured so as to not enforce a sequence of the structural elements that a learner uses to traverse the course.

In another implementation, a competency may be associated with the at least one structural element. A collaboration property may be associated with the at least one structural element. The collaboration property may be configured to indicate an aspect of a learner's interaction with the at least one element, and/or the collaboration property may be configured to allow a learning system to determine how to present the structural elements to the learner.

In yet another general aspect, an author station includes an author input device to input commands. An author tool receives input commands and assembles structural elements in response to the commands of the author tool, and includes an interface to present the structural elements, to select the structural elements, and to create at least one structural element that is configured to allow a learner to engage in collaboration activity.

In one implementation, the at least one structural element may include a knowledge item. The structural elements may be configured so as to not enforce a sequence of the structural elements that a learner uses to traverse the course. The author tool may be configured to create metadata that is associated with the structural elements. The author tool may be configured to associate a competency with the at least one structural element. The competency may be configured to be used to determine how to present structural elements to the learner.

In another implementation, the author tool may be configured to associate a collaboration property with the at least one structural element. The collaboration property may be configured to be used to determine how to present structural elements to the learner.

Other features and advantages will be apparent from the description, the drawings, and the claims.

DESCRIPTION OF DRAWINGS

FIG. 1 is an exemplary course content aggregation model.

FIG. 2 is an example of an ontology of knowledge types for e-learning.

FIG. 3 is an example of a course graph for e-learning.

FIG. 4 is an example of a sub-course graph for e-learning.

FIG. 5 is an example of a learning unit graph for e-learning.

FIGS. 6 and 7 are block diagrams of exemplary e-learning systems.

FIG. 8 is an example of a collaboration user interface for use with the systems of FIGS. 6 and 7.

Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

E-Learning Content Structure

According to the implementations described below, an e-learning system and methodology structures content associated with a course or training so that the content is reusable and flexible. For example, the content structure allows the creator of a course to reuse existing content to create new or additional courses. In addition, the content structure provides flexible content delivery that may be adapted to the needs of different learners. In particular, course content may be dynamically assembled into a temporary course as explained in detail below. In addition, collaborative activities may be integrated in the course to enhance a learner's experience.

A course may be created from a number of learning objects associated with content that forms the course material. Each learning object may include information/data associated with the course and/or links to the data. The learning objects also may have associated metadata that may be used to describe attributes, characteristics, and/or qualities of the learning objects, in addition to relations to other learning objects. The learning objects may be organized and/or assembled to create a course (which may be presented to a learner).

In one implementation, the e-learning objects may be implemented using one or more structural elements. Content associated with the course may be amassed using the structural elements arranged at different aggregation levels. Each higher level structural element may refer to any instances of all structural elements of a lower level. At its lowest level, a structural element refers to content and may not be further divided. According to one implementation shown in FIG. 1, course material 100 may be divided into four structural elements: a course 110, a sub-course 120, a learning unit 130, and a knowledge item 140.

Starting from the lowest level, knowledge items 140 are the basis for the other structural elements and are the building blocks of the course content structure. Each knowledge item 140 may include content that illustrates, explains, practices, or tests an aspect of a thematic area or topic. In addition, knowledge items may be used to implement collaboration activities. Knowledge items 140 typically are small in size (e.g., of limited duration).

A number of attributes may be used to describe a knowledge item 140, such as, for example, a name, a type of media, access rights, device capabilities, and a type of knowledge. The name may be used by a learning system to identify and locate the content associated with a knowledge item 140. The type of media describes the form of the content that is associated with the knowledge item 140. For example, media types include a presentation type, a communication type, and an interactive type. A presentation media type may include a text, a table, an illustration, a graphic, an image, an animation, an audio clip, and a video clip. A communication media type may include a chat session, a group (e.g., a newsgroup, a team, a class, and a group of peers), an email, a short message service (SMS), and an instant message. An interactive media type may include a computer based training, a simulation, and a test. An access right may be used to determine whether to give access to a learner or other individual (e.g., a course author, an instructor, and/or a tutor).

A knowledge item 140 also may be described by the attribute of knowledge type. For example, knowledge types include knowledge of orientation, knowledge of action, knowledge of explanation, and knowledge of source/reference. Knowledge types may differ in learning goal and content. For example, knowledge of orientation offers a point of reference to the learner, and, therefore, provides general information for a better understanding of the structure of interrelated structural elements. Each of the knowledge types is described in further detail below.

Knowledge items 140 may be generated using a wide range of technologies, however, a browser (including plug-in applications) should be able to interpret and display the appropriate file formats associated with each knowledge item. For example, markup languages (such as a Hypertext Markup language (HTML), a standard generalized markup language (SGML), a dynamic HTML (DHTML®), or an extensible markup language (XML)), JAVASCRIPT® (a client-side scripting language), and/or FLASH® may be used to create knowledge items 140 and their associated data. In addition, collaborative tools, such as, chat rooms, email, instant message, audio/visual conferencing and white/black boards may be implemented using knowledge items for course collaboration activities.

HTML may be used to describe the logical elements and presentation of a document, such as, for example, text, headings, paragraphs, lists, tables, or image references.

FLASH® may be used as a file format for FLASH® movies and as a plug-in for playing FLASH® files in a browser. For example, FLASH® movies using vector and bitmap graphics, animations, transparencies, transitions, MP3 audio files, input forms, and interactions may be used. In addition, FLASH® allows a pixel-precise positioning of graphical elements to generate impressive and interactive applications for presentation of course material to a learner.

Learning units 130 may be assembled using one or more knowledge items 140 to represent, for example, a distinct, thematically-coherent unit. Consequently, learning units 130 may be considered containers for knowledge items 140 of the same topic. A learning unit 130 also may be considered relatively small in size (e.g., of limited duration) though larger than a knowledge item 140.

Sub-courses 120 may be assembled using other sub-courses 120, learning units 130, and/or knowledge items 140. The sub-course 120 may be used to split up an extensive course into several smaller subordinate courses. Sub-courses 120 also may be used to build an arbitrarily deep nested structure by referring to other sub-courses 120.

Courses may be assembled from all of the subordinate structural elements including sub-courses 120, learning units 130, and knowledge items 140. To foster maximum reuse and flexibility, all structural elements should be self-contained and context free.

Structural elements also may be tagged with metadata that is used to support adaptive delivery, reusability, and search/retrieval of content associated with the structural elements. For example, learning object metadata (LOM) defined by the IEEE “Learning Object Metadata Working Group” may be attached to individual course structure elements. The metadata also may be used to indicate learner competencies associated with the structural elements. Other metadata may include a number of knowledge types (e.g., orientation, action, explanation, and resources) that may be used to categorize structural elements.

As shown in FIG. 2, structural elements may be categorized using a didactical ontology 200 of knowledge types 201 that include orientation knowledge 210, action knowledge 220, explanation knowledge 230, and reference knowledge 240. Orientation knowledge 210 helps a learner to find their way through a topic without being able to act in a topic-specific manner and may be referred to as “know what.” Action knowledge 220 helps a learner to acquire topic related skills and may be referred to as “know how.” Explanation knowledge 230 provides a learner with an explanation of why something is the way it is and may be referred to as “know why.” Reference knowledge 240 teaches a learner where to find additional information on a specific topic and may be referred to as “know where.”

The four knowledge types (orientation, action, explanation, and reference) may be further divided into a fine grained ontology as shown in FIG. 2. For example, orientation knowledge 210 may refer to sub-types 250 that include a history, a scenario, a fact, an overview, and a summary. Action knowledge 220 may refer to sub-types 260 that include a strategy, a procedure, a rule, a principle, an order, a law, a comment on law, and a checklist. Explanation knowledge 230 may refer to sub-types 270 that include an example, a intention, a reflection, an explanation of why or what, and an argumentation. Resource knowledge 240 may refer to sub-types 280 that include a reference, a document reference, and an archival reference.

Dependencies between structural elements may be described by relations when assembling the structural elements at one aggregation level. A relation may be used to describe the natural, subject-taxonomic relation between the structural elements. A relation may be directional or non-directional. A directional relation may be used to indicate that the relation between structural elements is true in one direction or two directions (e.g., bi-directional). Directional relations should be followed.

Relations may be divided into two categories: subject-taxonomic and non-subject taxonomic. Subject-taxonomic relations may be further divided into hierarchical relations and associative relations. Hierarchical relations may be used to express a relation between structural elements that have a relation of subordination or superordination. For example, a hierarchical relation between the knowledge items A and B exists if B is part of A. Hierarchical relations may be divided into two categories: the part/whole relation (i.e., “has part”) and the abstraction relation (i.e., “generalizes”). For example, the part/whole relation “A has part B,” describes that B is part of A. The abstraction relation “A generalizes B” implies that B is a specific type of A (e.g., an aircraft generalizes a jet or a jet is a specific type of aircraft).

Associative relations may be used refer to a kind of relation of relevancy between two structural elements. Associative relations may help a learner obtain a better understanding of facts associated with the structural elements. Associative relations describe a manifold relation between two structural elements and are mainly directional (i.e., the relation between structural elements is true only in one direction). Examples of associative relations include “determines,” “side-by-side,” “alternative to,” “opposite to,” “precedes,” “context of,” “process of,” “values,” “means of,” and “affinity.”

The “determines” relation describes a deterministic correlation between A and B (e.g., B causally depends on A). The “side-by-side” relation may be viewed from a spatial, conceptual, theoretical, or ontological perspective (e.g., A side-by-side with B is valid if both knowledge objects are part of a superordinate whole). The side-by-side relation may be subdivided into relations, such as “similar to,” “alternative to,” and “analogous to.” The “opposite to” relation implies that two structural elements are opposite in reference to at least one quality. The “precedes” relation describes a temporal relationship of succession (e.g., A occurs in time before B (and not that A is a prerequisite of B)). The “context of” relation describes the factual and situational relationship on a basis of which one of the related structural elements may be derived. An “affinity” between structural elements suggests that there is a close functional correlation between the structural elements (e.g., there is an affinity between books and the act of reading because reading is the main function of books).

Non Subject-Taxonomic relations may include the relations “prerequisite of” and “belongs to.” The “prerequisite of” and the “belongs to” relations do not refer to the subject-taxonomic interrelations of the knowledge to be imparted. Instead, these relations refer to the progression of the course in the learning environment (e.g., as the learner traverses the course). The “prerequisite of” relation is directional whereas the “belongs to” relation is non-directional. Both relations may be used for knowledge items 140 that cannot be further subdivided. For example, if the size of the screen is too small to display the entire content on one page, the page displaying the content may be split into two pages that are connected by the relation “prerequisite of.”

Another type of metadata is competencies. Competencies may be assigned to structural elements, such as, for example, a sub-course 120 or a learning unit 130. The competencies may be used to indicate and evaluate the performance of a learner as the learner traverse the course material. A competency may be classified as a cognitive skill, an emotional skill, an senso-motorical skill, or a social skill.

Course Graphs

The content structure associated with a course may be represented as a set of graphs. A structural element may be represented as a node in a graph. Node attributes are used to convey the metadata attached to the corresponding structural element (e.g., a name, a knowledge type, a competency, access rights, device type, and/or a media type). A relation between two structural elements may be represented as an edge.

For example, FIG. 3 shows a graph 300 for a course. The course is divided into four structural elements or nodes (310, 320, 330, and 340): three sub-courses (e.g., knowledge structure, learning environment, and tools) and one learning unit (e.g., basic concepts). A node attribute 350 of each node is shown in brackets (e.g., the node labeled “Basic concepts” has an attribute that identifies it as a reference to a learning unit). In addition, an edge 380 expressing the relation “context of” has been specified for the learning unit with respect to each of the sub-courses. As a result, the basic concepts explained in the learning unit provide the context for the concepts covered in the three sub-courses.

FIG. 4 shows a graph 400 of the sub-course “Knowledge structure” 350 of FIG. 3. In this example, the sub-course “Knowledge structure” is further divided into three nodes (410, 420, and 430): a learning unit (e.g., on relations) and two sub-courses (e.g., covering the topics of methods and knowledge objects). The edge 440 expressing the relation “determines” has been provided between the structural elements (e.g., the sub-course “Methods” determines the sub-course “Knowledge objects” and the learning unit “Relations”.) In addition, the attribute 450 of each node is shown in brackets (e.g., nodes “Methods” and “Knowledge objects” have the attribute identifying them as references to other sub-courses; node “Relations” has the attribute of being a reference to a learning unit).

FIG. 5 shows a graph 500 for the learning unit “Relations” 450 shown in FIG. 4. The learning unit includes six nodes (510, 515, 520, 525, 530, 535, 540, and 545): six knowledge items (i.e., “Associative relations (1)”, “Associative relations (2)”, “Test on relations”, “Hierarchical relations”, “Non subject-taxonomic relations”, and “The different relations”). An edge 547 expressing the relation “prerequisite” has been provided between the knowledge items “Associative relations (1)” and “Associative relations (2).” In addition, attributes 550 of each node are specified in brackets (e.g., the node “Hierarchical relations” includes the attributes “Example” and “Picture”).

E-Learning Strategies

The above-described content aggregation and structure associated with a course does not automatically enforce any sequence that a learner may use to traverse the content associated with the course. As a result, different sequencing rules may be applied to the same course structure to provide different paths through the course. The sequencing rules applied to the knowledge structure of a course are learning strategies. The learning strategies may be used to pick specific structural elements to be suggested to the learner as the learner progresses through the course. The learner or supervisor (e.g., a tutor) may select from a number of different learning strategies while taking a course. In turn, the selected learning strategy considers both the requirements of the course structure and the preferences of the learner. As a result, the progression of learners through the course may differ.

Learning strategies may be created using macro-strategies and micro-strategies. A learner may select from a number of different learning strategies when taking a course. The learning strategies are selected at run time of the presentation of course content to the learner (and not during the design of the knowledge structure of the course).

Macro-strategies are used in learning strategies to refer to the coarse-grained structure of a course (i.e., the organization of sub-courses 120 and learning units 130). The macro-strategy determines the sequence that sub-courses 120 and learning units 130 of a course are presented to the learner. Basic macro-strategies include “inductive” and “deductive,” which allow the learner to work through the course from the general to the specific or the specific to the general, respectively. Other examples of macro-strategies include “goal-based, top-down,” “goal-based, bottom-up,” and “table of contents.”

Micro-strategies, implemented by the learning strategies, target the learning progression within a learning unit. The micro-strategies determine the order that knowledge items of a learning unit are presented. Micro-strategies refer to the attributes describing the knowledge items. Examples of micro-strategies include “orientation only”, “action oriented”, “explanation-oriented”, and “table of contents”).

E-Learning System

As shown in FIG. 6, an e-learning architecture 600 may include a learning station 610, a learning system 620, and a course author station. The learner may access the learning system 620 and courses using the learning station 610. The learning station 610 may implemented using a general-purpose computer capable of responding to and executing instructions in a defined manner. Examples of learning stations 610 include a special-purpose computer, a personal computer (“PC”), a workstation, a server, a laptop, a Web-enabled personal digital assistant (“PDA”), an interactive television set, a set top box, an on-board (i.e., vehicle-mounted) computer, or a combination of two or more these devices capable of responding to, generating, and/or executing instructions. The learning station 610 also may include any number of other devices, components, and/or peripherals, such as memory/storage devices, input devices, output devices, user interfaces, and/or communications interfaces.

The learning station 610 also may include one or more software applications (e.g., an operating system, a browser application, a microbrowser application, a server application, a proxy application, a gateway application, a tunneling application, and a distributed conferencing application, among others) loaded on the learning station 610 to command and direct the learning station 610. Applications may include a computer program, a piece of code, an instruction, or some combination thereof, for independently or collectively instructing the learning station 610 to interact and operate as desired.

In particular, the learning station 610 includes an application that is configured to access, interpret, and present courses and related information to a learner. For example, the learning station 610 may include a browser to implement a learning portal that allows a learner to access the learning system 620. The communications link 621 is configured to send and receive signals relating to the course and data used by the learning system 620.

The applications may be embodied permanently or temporarily in any type of machine, component, physical or virtual equipment, storage medium, or propagated signal or wave capable of providing instructions to the learning station 610. In particular, the applications may be stored on a storage medium or device (e.g., a read only memory (ROM), a random access memory (RAM), a volatile/non-volatile memory, a magnetic disk, or a propagated signal) readable by the learning station 610, such that if the storage medium or device is read by the learning station 610, the specified step or instructions are performed.

The learning station 610 also may include one or more communications interfaces that allow the client device to send and receive information using the communications path 621. The communications path 621 may be configured to send and receive signals (e.g., electrical, electromagnetic, or optical) that convey or carry data streams representing various types of analog and/or digital content. For example, the communications paths 621 may be implemented using various communications media and one or more networks comprising one or more network devices (e.g., servers, routers, switches, hubs, repeaters, and storage devices). The one or more networks may include a WAN, a LAN, a plain old telephone service (POTS) network, a digital user line (DSL) network, an integrated services digital network (ISDN), and a synchronous optical network (SONNET), or a combination of two or more of these networks. In addition, the communications paths 621 may include one or more wireless links that transmit and receive electromagnetic signals, such as, for example, radio, infrared, and microwave signals to convey information.

The learning system 620 also may include one or more network devices (e.g., servers, routers, switches, hubs, repeaters, and storage devices) and communications media configured to provide an e-learning infrastructure to learners. As shown in FIG. 6, the learning system 620 may include a learning management system 623, a content management system 625, and an administration management system 627. Each of these systems may be implemented using one or more servers, processors, and/or other network devices.

In addition, an authoring station 630 may be provided to create courses.

As shown in FIG. 7, the administration management system 627 may be implemented using a server, such as, for example, the SAP® R/3 4.6C+LSO Add-On. The administration management system 627 includes one or more databases, including a database of learner accounts and a database of course information. The learner account may include demographic data (e.g., a name, an age, a sex, an address, a company, a school, an account number, and a bill) for a learner and his/her progress through the course material (e.g., places visited, tests completed, skills gained, knowledge acquired, properties, and competencies using the material). The administration management system 627 also may provide a database of course material including additional information about courses, such as course title, description, courses offered, a course catalog the author/instructor of a course, and the most popular courses and offer services to search and book courses.

The content management system 625 may include a learning content server 730. The learning content server 730 may be implemented using a WebDAV server. The learning content server 730 may include a content repository. The content repository stores course files and media files that are used to present a course to a learner at the learning station 610. The course files may include the structural elements that make up a course and may be stored as XML files. The media files may be used to store the content that is included in the course and assembled for presentation to the learner at the learning station 610.

The learning management system 623 may include a content player 720. The content player 720 may be implemented using a server, such as an SAP® J2EE Engine. The content player 720 is used to obtain course material from the content repository. The content player 720 also applies the learning strategies to the obtained course material to generate a navigation tree or path for the learner. The navigation tree or path is used to suggest a route through the course material for the learner and to generate a presentation of course material to the learner based on the learning strategy selected by the learner.

The learning management system 623 also may include an interface for exchanging information with the administration management system 627. For example, the content player 720 may update the learner account information as the learner progresses through the course material to indicate, for example, competencies gained, tests passed, courses completed.

Learning Station

The learner may access information about a course, content associated with a course, information about the learning system 620, and information about the learner (e.g., stored in the learner account) using the learning station 610. As shown in FIG. 7, the learning station 610 may include a processor, a communications interface, and a storage device. The learning station 610 also may include any number of peripherals or integrated devices (e.g., displays, memory/storage devices, input devices, ports/interfaces, printers, communication interfaces, microphones, and speakers) that facilitate access to, presentation of, and interaction with the course, its content, and associated course information.

The processor may be used to implement a learning interface. For example, the processor may execute any number of software applications including a learning interface that is configured to access, interpret, and present a course and associated information to a learner, and to allow a learner to interact with the content and the learning system 620.

The learning station 610 may be provided with a number of software applications. The software may include a browser, such as, for example, NETSCAPE® COMMUNICATOR, MICROSOFT INTERNET EXPLORER®, or any other software application that may be used to interpret and process a markup language, such as HTML, SGML, DHTML®, XML, or XHTML®. The browser also may include software plug-in applications that allow the browser to interpret, process, and present different types of information. The browser may include any number of application tools, such as, for example, JAVA®, ACTIVE X®, JAVASCRIPT®, AND FLASH®.

The communications interface may facilitate the exchange of data and information between the learning station 610 and the learning system 620. For example, the communications interface may be a communications card, a modem, a port, a wireless transceiver or a device that is able to transmit and receive data using the communications link 621. Data may be received from the learning system 620 and processed by the processor and/or stored in the storage. Similarly, data processed by the processor and/or stored in the storage may be transmitted to the learning system 620.

As described above, the learner may contact the learning system 620 using the learning station 610 to access a course. The learning interface and associated browser may be used to implement a graphical user interface that accepts information input from the learner and presents information received from the learning system 620. The learning interface also may be provided with a content player to present courses that are downloaded from the learning system 620 to the storage 760.

The Author Station

As shown in FIGS. 6 and 7 an e-learning system may also include an author station 630. The author station 630 may be implemented using a workstation, a computer, a portable computing device, or any intelligent device capable of executing instructions and connecting to a network. The author station 630 may include any number of devices and/or peripherals (e.g., displays, memory/storage devices, input devices, interfaces, printers, communication cards, and speakers) that facilitate access to, presentation of, and creation of courses and their associated content.

The author station 630 may execute any number of software applications including an author tool 740 that is configured to create, access, interpret, and present courses (and related course data/information). The author tool 740 may include a course editor 750 and a browser, such as, for example, NETSCAPE® COMMUNICATOR®, MICROSOFT® INTERNET EXPLORER®, or any other software application that may be used to interpret and process a markup language, such as HTML, SGML, DHTML®, or XML. The browser also may include software plug-in applications that allow the browser to interpret, process, create, and present different types of information. The browser may include any number of application tools, such as, for example, JAVA, ACTIVE X®, JAVASCRIPT®, AND FLASH®.

The course author tool 740 may access content and associate the content with structural elements. The author tool 740 also may associate knowledge types, relations, and metadata with the structural elements. The author tool 740 may be used to build the structure of a course, i.e., its structural elements and relations. The author tool 740 may save the structural elements and metadata as course files and the associated content as media files.

The author station 630 also may include an embedded learning management system 760. The embedded learning management system 760 is an application program that is similar to the learning management system 623 and enables the author to preview a course by applying learning strategies to the course (e.g., that is being created/modified by the author) in order to view the navigation path that is suggested to a learner based on the applied strategy. Based on the different suggested navigation paths, the author may determine how to create structure for the course and how the created structure is interpreted by the learning management system 623. As a result, the author may edit, modify, or add structure to the course before publishing the course to the learning system 620.

The author station 630 also may include a communications interface 631. After a course is created, the author station 630 may use the communication interface 631 to connect to the learning system 620 to publish the course so that a learner may book and take the course. In particular, the communication interface of the author station 630 may connect to the content management system 625 using a communications link 635. To publish the course on the learning system 620, the author station 630 transfers the course structure and content (e.g., the course files and media files) to the content management system 625. As previously described, the course files may be formatted according to a markup language (e.g., XML). The communications link 635 may be implemented using any permanent or temporary communications link configured to transfer the course files and associated media files (e.g., a communications medium configured to transfer data signals as electrical, electromagnetic, or optical waves). The content management system 625 stores the course files and associated media files in the content repository for access by the content player 720.

The communication interface 631 of the author station 630 also may connect to the administration management system 627 using a communication link 637. The communication link may be implemented by any communication medium that may be configured to send and receive signals (e.g., electrical, electromagnetic, or optical). The author station 630 provides the administration management system 627 with course information (e.g., title, author, description, credits, prerequisites, and competencies gained/required) that is used by a learner, for example, to book a course. Once the course is published, the administration management system 627 makes the course information available to the learning station 610 using the learning portal.

The author tool 740 and author station 630 may include a course editor 750 that can be used in conjunction with a browser to create, modify, build, assemble, and preview course structures and their associated content. The course editor 750 may be used to structure content for use in a course. The course editor 750 includes a course editor interface. The course editor 750 may be used to create the structure for the course content. The structure may be saved as metadata. The metadata may be interpreted by the content player 720 of the learning management system 623 to present a course to a learner according to a learning strategy selected at run time. In particular, the course editor 750 enables the author to classify and describe structural elements, assign attributes to structural elements, assign relations between structural elements, and build a subject-taxonomic course structure. The course editor 750 primarily generates the structure of the course and not structure of the content (although structure of content may be provided for as well).

Collaborative E-Learning

As previously described, conventional computer systems offer collaborative tools, such as, for example, chat rooms, email, online conferences, instant messages, message boards, and an online black/whiteboards. Such systems are limited in or devoid of the use of a learner's context or a learner's current status in conjunction with the collaborative tools. However, the learning system 620 may provide a course with one or more structural elements that facilitate collaboration between two or more learners that use the learning system. The collaboration may be provided by a collaboration tool (e.g., email, instant messages, a chat room, audio/video conferencing, or a modified version of one or more of these tools) that provides communication between two or more learners. The learning system 620 may suggest structural elements to a learner based on a selected learning strategy. As a result, the collaboration may be provided based on the learner's context within a course and/or the learner's individual learning style (e.g., as indicated by the selected learning strategy).

A structural element may be provided to allow two or more users (e.g., learners, tutors, and instructors) to participate in a cooperative activity or collaboration using the learning system 620. The structural element may facilitate communication between two or more learners to engage in collaboration activity. The structural element may provide or facilitate the use of a communication tool (e.g., an instant messaging tool, and e-mail tool, a chat tool, or an audio/video conferencing tool). In one implementation the structural element is knowledge item 140.

Providing a collaboration activity using a structural element allows users (e.g., learners, tutors, and instructors) to participate in a cooperative activity (e.g., a collaboration scenario) that is logically and/or didactically associated with the course containing the structural element because the structural element is associated with a specific context of a learner and/or a specific location in a course.

A structural element may provide for a collaboration activity between learners. The collaboration activities guide the participants and may be used for later evaluation of the participants. The activities may be executed if there are a sufficient number of participants; although, the learner is not prohibited or hindered from continuing in the course because there are insufficient numbers of participants available to conduct the scenario. In fact, the collaboration activity does not have to be executed at a particular time or to complete the course.

In one implementation, an intentional point of collaboration, may be characterized by a goal, a collaboration process, participant information, and a dataflow. The goal may include development of knowledge, reflection on knowledge, application of knowledge, and transfer of knowledge. The goal may be attained after the intentional point of collaboration has been satisfactorily completed.

The collaboration process defines the way in which the goal is accomplished. The collaboration process may be used to structure the dialog, the actions, and/or the cooperative activities between participants of the collaboration. For example, the collaboration process may define the roles of the participants (e.g., a moderator, a proponent, a commentator, a tutor, an administrator, a judge, a juror, and a facilitator), the type of interaction (e.g., synchronous and asynchronous), the states of the process (and transitions between states), rules (what and when participants may do and how they may do it), and types of communicative contributions (e.g., reverberation, interaction, initiation, objective movement, meta operation, and social movement). The collaboration process also may include a time of participation (e.g., the maximum and/or minimum duration of the process or a suggested length of the process). A collaboration tool may be provided to implement the collaboration process.

The participant information may define who may participate and/or is needed to perform the collaborative process. For example, the participants may be defined as having certain skills, competencies, knowledge, and/or attributes. The participants also may be determined based on a skill and/or competency that need to be acquired by a learner. The participant information also may define how many participants (e.g., a maximum and/or a minimum number of participants) are required for the collaborative process.

The dataflow may define how data is transferred within the cooperative activity. For example, the activity may include a number of data inputs and produce a number of outputs. Inputs may include task data and background knowledge needed or used in the collaborative activity. Outputs may include skills, competencies, and/or properties obtained by the learner from completing the cooperative activity. Outputs also may include a collaboration product (e.g., a document, a text, and a group determination or conclusion).

A course author may develop, create, and/or associate a collaboration activity or an intentional point of collaboration with a structural element of a course. Using the authoring station 630, the course author may then create the structural element and designate the collaborative tools provided and/or supported by the structural element. In one implementation, the structural element corresponding to the collaboration activity is created as a knowledge item 140.

In one implementation, collaboration templates (e.g., brainstorming, cooperative text, explanation discourse, pro/contra, and answer-to-tutor) may be used to describe the abstract collaboration scenarios motivated by an instructional theory. The template provides a readymade guide for the course author to create an intentional point of collaboration. The template also provides a built-in strategy for the progress of and the interaction between the participants. After selecting a template, the author may edit the template to provide an intentional point of collaboration that is customized for a specific course.

As described above, the course is composed of a number of structural elements. The basic or lowest level structural element of the course is the knowledge item 140. Once a knowledge item 140 is created, it is stored with the course material in the course repository. When a learner takes a course, the content player 720 provides a suggested path to the learner according to a selected learning strategy. The selected strategy may be used by the content player 720 to suggest to a learner when the knowledge item 140 (e.g., the cooperative activity) may be engaged in (e.g., to provide maximum benefit to the learner). If the knowledge item 140 includes a collaboration activity, the learning content player may suggest that the learner engage in a collaboration activity. However, the learner ultimately may determine when (and possibly whether) to participate in the collaboration activity. As described above, the learner is not required to immediately participate in a collaboration activity but may choose when it is appropriate (e.g., based on considerations, such as time and the availability of participants).

When a learner elects to explore a knowledge item 140 that includes a collaboration activity or an intentional point of collaboration, the content player 720 informs the learner that the learner may participate in the collaboration activity associated with the structural element or intentional point of collaboration. The content player 720 also adds the learner to a collaboration pool managed by the learning management system 623.

The collaboration pool includes a list of all the collaboration activities that are available for a learner to participate in. The collaboration pool is maintained by the learning management system 623. The learner may use the collaboration pool to determine information about a collaboration (e.g., type, topic, duration, and participants), to determine the state of a collaboration (running, ready, completed, or cancelled), and to determine if sufficient participants are available to establish the collaboration. The collaboration pool also may be used by the learner to view results of interaction with a collaboration. A collaboration stays in the point of collaboration pool until deleted (e.g., the collaboration is removed by the learner or other individual, such as a tutor, an author, or an instructor) or the system removes the collaboration (e.g., a time period after the course is completed by the learner).

If the learner elects to initiate a collaboration activity, the learning management system 623 determines whether there are enough participants to establish the collaboration activity. The learning management system 623 determines eligible participants from the learners who are online and have selected to initiate a collaboration activity (or are eligible to participate in the collaboration activity). The learning management system 623 uses properties of the learners (e.g., stored in the learner account of administration system 627) when determining eligible participants for the collaboration activity.

If there are not enough learners available at a given time, the learner may wait until enough learners are available. The learning management system 623 also may wait a predetermined amount of time before taking an alternative action to provide enough eligible participants (e.g., asking a online tutor to participate or asking a learner who has already completed the collaboration to participate) in order to minimize the amount of time a learner who is ready to initiate a collaboration has to wait.

If enough learners are online and have indicated they are ready to participate in the collaboration, the corresponding collaboration process and/or collaboration tool may be launched and provided with any necessary information defined by the structural element or intentional point of collaboration. In addition, all necessary connections with group members are established. The learner proceeds to interact in accordance with the format and tools established by the collaboration until the collaboration is completed and/or the learners decide to stop. The learning management system 623 may record various user actions and results, which may be used to evaluate the learners. The recorded actions and results may be stored by the administration management system 627.

Once the learners are finished, the learning management system 623 or an individual (e.g., a tutor, teacher, or course instructor/administrator) may evaluate each learner's performance and/or determine whether the structural element or intentional point of collaboration has been successfully completed. In addition, the learner, peer learners, or a learning group also may complete an evaluation. The evaluation may determine that the learner has gained certain skills and/or competencies as a result of interacting with the collaboration activity.

Any gained experience, skills, and/or competencies may be stored in the learner account of the administration management system 627 and used to evaluate the learner by the administration system or the learning management system 623. In addition, the competencies may be used in conjunction with the selected learning strategy to present structural elements to the learner.

A learner also may gain or be assigned one or more collaboration properties by the learning management system 623. The collaboration property may be used to describe the behavior or manner in which the learner has interacted with the structural element. For example, if a collaboration includes one or more roles, the collaboration property may record which role (e.g., a moderator in a group discussion) the learner has performed and the number of times the learner has performed the role.

A collaboration property is different than a competency. For example, the fact that a learner has performed the role of moderator does not necessarily mean that the learner is a competent moderator. The collaboration property may be used by the learning management system 623 in the formation of a collaboration activity (e.g., to assign a role to a learner that the learner has performed). The collaboration properties also may be stored in a collaboration history (e.g., in the learner account of the administration system 627) and used to evaluate the learner or for administration/planning purposes. The collaboration property also may be used to suggest structural elements for presentation to the learner by the content player 720.

Learning Templates

As described above, the author of a course may choose from one or more readymade templates to facilitate the creation of a intentional point of collaboration. Some examples of collaboration templates include a brainstorming activity, a cooperative text processing activity, an explanation discourse activity, an answer-to-tutor activity, and a pro-contra dispute. The templates may include a number of parameters (a type, a min/max number of learners, content/documents/material, tools, and other parameters specific to the template) that are defined by the course author when creating the collaboration. Each of the templates is described in further detail below.

The goal pro/contra template is to allow two or more participants to debate and defend a critical position for an assigned topic. According to the underlying learning process each participant is assigned the role of proponent (arguing in favor of a position) or the opponent (arguing against or challenging a position). A collaboration tool (e.g., and enhanced chat tool) indicates which role is assigned to each participant, which participant has the right to speak, and controls time constraints for each speaker. A tutor may moderate, comment on, or evaluate the exchange between participants.

The goal of the brainstorming template is to structure a knowledge area. The underlying learning process defines phases of individual and collaborative generation of ideas and a phase of collaborative structuring of the collected ideas. Typically a brainstorming group may have two to ten participants. A collaboration tool such as chat, audio/video conferencing, whiteboard, and/or a specific brainstorming collaboration tool is specified and/or provided. The collaboration tool provides the learners with instructions, a topic, and/or seed words to begin the intentional point of collaboration. The collaboration tool grants the right of free speech to each participant. Each participant has the same role, and the interaction of each participant is synchronous.

The goal of the cooperative text processing template is acquisition of new knowledge. As input, a text consisting of a sequence of sections is provided. The learning process defines a process to proceed through the text section by section. For each section, one participant is given the role of summarizer and the other-participants are assigned the role of commentators. All participants read the section. The summarizer produces a summary, which is then commented on by the other participants. This interaction type is synchronous.

The goal of the explanation discourse template is to reflect on and deepen previously acquired knowledge. A chat tool and/or audio/video conferencing tool may be provided. An initial explanation, instructions, and/or topic are presented by a collaboration tool. Participating learners can request a tutor for the right to speak. The learners and the tutor each select a type of contribution (e.g., an explanation, a question, or a comment). This interaction type is synchronous.

The goal of the answer to tutor template is to apply and evaluate knowledge. According to the learning protocol, a tutor may present a question that is answered by a learner. The tutor may comment on and/or evaluate the learner's answer and further discussion may occur between the tutor and the learner. A chat tool and/or audio/video conferencing tool may be provided. This interaction type is asynchronous.

The course author may create a structural element using the course editor 750 provided by the course author station 631. Using the course editor 750, the author may create a structural element (e.g., a knowledge item 140) that includes a collaboration activity. When creating the structural element, the course editor 750 may associate content and/or collaboration tools (e.g., various types of interactive tools, such as, chat, e-mail, instant messages, and audio/video conferencing, or modified interactive tools tailored to a collaboration) with the structural element. The structural element also may be imported from another course. The course author also may specify any competencies, skills, and/or collaborative properties that are gained by successfully completing or interacting with the structural element.

An intentional point of collaboration may be created by specifying a goal, a collaboration process, participants, and a dataflow. The author also may specify any collaborative tools used or supported by the intentional point of collaboration. The intentional point of collaboration also may be created by importing a knowledge item from another course (e.g., including an intentional point of collaboration). The course author also may specify any competencies, skills, and/or collaborative properties that are gained by successfully completing the intentional point of collaboration.

A course author also may create an intentional point of collaboration by selecting a template (e.g., pro/contra dispute, brainstorming, cooperative text, explanation discourse, and answer-to-tutor) using the course author station 631 and editor 750. The template provides the author with inputs for the selected template to define the collaborative activity. The author may input and associate any required learning material with the template. The course author may create a knowledge item 140 and associate the template with the knowledge item 140 when creating or editing the course 110.

User Interface

The learning user interface provided by the learning station for an intentional point of collaboration depends on the collaborative tool used to carry out the collaborative activity. Many of the intentional points of collaboration use a modified or enhanced chat tool. The collaboration tool provides a user interface to implement the process to carry out the collaborative activity between the collaboration participants. For example, the collaboration tool may provide an enhanced chat interface that provides a display 800 including one or more windows as shown in FIG. 8.

The display 800 may include a title bar 810 to identify the type of intentional point of collaboration and the particular intentional point of collaboration in which the learner is participating. In one implementation, the interface may include an input portion or window 815, where text is input by the learner. The text may be input using a user input device of the learning station 610 and edited in the window 815. When the learner is ready to participate, an input 820 (e.g., an virtual send button) may be selected. The input text is then displayed in a dialog window 850 that displays a running commentary of the dialog between the collaboration participants. The input text may be associated with an identifier and role of each participant.

A participant list 830 may be shown. The list 830 may include an identifier for each participant and a role of each participant. An information area 840 may include information about the collaboration, such as roles of each participant, the role of the participant using the window 800, and the participant currently speaking. In another implementation, the participant list may be included or combined with other windows or areas (e.g., information area 840 may include or be combined with the participation list 830).

Other modifications and features also may be included. For example, various timers (e.g., a duration, a time remaining, and a time per speaker) may be included in display 800. Other windows may be provided to display learning material, a group text, video, and images, to be used in the collaborative activity.

A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, advantageous results may be achieved if the steps of the disclosed techniques are performed in a different order and/or if components in a disclosed system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components. Accordingly, other implementations are within the scope of the following claims.

Claims

1. A method, performed by one or more processing devices, for creating an electronic learning (e-learning) course, the method comprising: generating, via a processing device, content associated with the e-learning course, the content comprising two or more structural elements, at least one structural element enabling a learner to engage in a collaboration activity, the collaboration activity being suggested, without learner input, only at one or more predefined points in the at least one structural element in order to support an effort to achieve a goal associated with the at least one structural element, the collaboration activity being defined via a collaboration template, the collaboration template corresponding to one of plural different types of collaboration deemed suitable to achieving the goal, the collaboration template defining a strategy for progress through the collaboration activity and interaction between participants of the collaboration activity;organizing, via a processing device, the structural elements into two or more levels, where a higher level structural element refers to a lower level structural element;assembling, via a processing device, the structural elements to create the e-learning course; andmaintaining, via a processing device, a collaboration pool containing a state of the collaboration activity and information on whether there are sufficient participants to engage in the collaboration activity.

2. The method of claim 1, further comprising: providing, via a processing device, the at least one structural element to the learner; andreceiving, via a processing device, an indication from the learner to participate in the collaboration activity.

3. The method of claim 2, wherein the collaboration activity comprises collaboration between two or more learners.

4. The method of claim 1, wherein the at least one structural element comprises a knowledge item.

5. The method of claim 4, wherein the structural elements do not enforce a sequence of structural elements that the learner uses to traverse the e-learning course.

6. The method of claim 4, further comprising: associating, via a processing device, metadata with the structural elements.

7. The method of claim 1, further comprising: associating, via a processing device, a competency with the at least one structural element; anddetermining, via a processing device, how to present course material contained in the structural elements to the learner based on the competency.

8. The method of claim 1, further comprising: associating, via a processing device, a collaboration property with the at least one structural element.

9. The method of claim 8, wherein the collaboration property relates to interaction of the learner with the at least one structural element.

10. The method of claim 8, further comprising, via a processing device, determining how to present structural elements to the learner based on the collaboration property.

11. One or more machine-readable media that store an electronic learning (e-learning) course data structure, the e-learning course data structure comprising: a plurality of structural elements aggregated into two or more levels, where a higher level structural element refers to a lower level structural element, at least one structural element enabling a learner to engage in a collaboration activity, the collaboration activity being suggested, without learner input, only at one or more predefined points in the at least one structural element in order to support an effort to achieve a goal associated with the at least one structural element, the collaboration activity being defined via a collaboration template, the collaboration template corresponding to one of plural different types of collaboration deemed suitable to achieving the goal, the collaboration template defining a strategy for progress through the collaboration activity and interaction between participants of the collaboration activity;metadata to describe the structural elements;relations to indicate dependencies between the structural elements; anddata defining a collaboration pool that contains a state of the collaboration activity and information on whether there are sufficient participants to engage in the collaboration activity.

12. The machine-readable media of claim 11, wherein the collaboration activity comprises collaboration between two or more learners.

13. The machine-readable media of claim 11, wherein the at least one structural element comprises a knowledge item.

14. The machine-readable media of claim 11, wherein the structural elements do not enforce a sequence of the structural elements that the learner uses to traverse the course.

15. The machine-readable media of claim 11, wherein a competency is associated with the at least one structural element.

16. The machine-readable media of claim 11, wherein a collaboration property is associated with the at least one structural element.

17. The machine-readable media of claim 16, wherein the collaboration property indicates interaction of the learner with the at least one element.

18. The machine-readable media of claim 16, wherein the collaboration property enables a learning system to determine how to present the structural elements to the learner.

19. A method, performed by one or more processing devices, for use with an electronic learning system, the method comprising: obtaining, via a processing device, structural elements that define at least a portion of an electronic course, at least one structural element defining a collaboration activity, the collaboration activity comprising a cooperative process that engages two or more participants;maintaining, via a processing device, a collaboration pool that allows a learner to determine a state of the collaboration activity and information on whether there are sufficient participants to engage in the collaboration activity; andpresenting, via a processing device, the structural elements to the learner, the learner participating in the collaboration activity if the state and the information permit;wherein the collaboration activity is suggested, without learner input, only at one or more predefined points in the at least one structural element in order to support an effort to achieve a goal associated with the at least one structural element, the collaboration activity being defined via a collaboration template, the collaboration template corresponding to one of plural different types of collaboration deemed suitable to achieving the goal, the collaboration template defining a strategy for progress through the collaboration activity and interaction between participants of the collaboration activity.

20. The method of claim 19, wherein the state indicates that the collaboration activity is running, ready, completed or cancelled, and wherein the learner is permitted to participate in the collaboration activity if the state indicates that the collaboration activity is running or ready.

21. The method of claim 19, wherein, if the information indicates that there are not sufficient participants to engage in the collaboration activity, the method further comprises: taking action, via a processing device, to obtain sufficient participants to engage in the collaboration activity.

22. The method of claim 21, wherein the action comprises asking a learner to participate in the collaboration activity.

23. The method of claim 21, further comprising: waiting a predetermined amount of time before taking action.

24. The method of claim 19, wherein the collaboration pool indicates that the learner can participate in the collaboration activity.

25. The method of claim 19, wherein the collaboration pool further comprises data identifying at least one of a type, a topic, and a duration of the collaboration activity.

26. The method of claim 19, further comprising: assigning the learner a collaboration property via a processing device, the collaboration property indicating how the learner interacted with the at least one structural element.

27. The method of claim 26, wherein the collaboration property defines a role of the learner vis-à-vis the at least one structural element.

28. The method of claim 26, further comprising: storing, via a processing device, collaboration properties assigned to the learner, the collaboration properties indicating how the learner interacted with one or more of the structural elements; andusing the collaboration properties, via a processing device, to evaluate the learner.

29. One or more machine-readable media that store instructions for use in an electronic learning system, the instructions causing a machine to: obtain structural elements that define at least a portion of an electronic course, at least one structural element defining a collaboration activity, the collaboration activity comprising a cooperative process that engages two or more participants;maintain a collaboration pool that allows a learner to determine a state of the collaboration activity and information on whether there are sufficient participants to engage in the collaboration activity; andpresent the structural elements to the learner, the learner participating in the collaboration activity if the state and the information permit;wherein the collaboration activity is suggested, without learner input, only at one or more predefined points in the at least one structural element in order to support an effort to achieve a goal associated with the at least one structural element, the collaboration activity being defined via a collaboration template, the collaboration template corresponding to one of plural different types of collaboration deemed suitable to achieving the goal, the collaboration template defining a strategy for progress through the collaboration activity and interaction between participants of the collaboration activity.

30. The machine-readable media of claim 29, wherein the state indicates that the collaboration activity is running, ready, completed or cancelled, and wherein the learner is permitted to participate in the collaboration activity if the state indicates that the collaboration activity is running or ready.

31. The machine-readable media of claim 29, wherein, if the information indicates that there are not sufficient participants to engage in the collaboration activity, the machine-readable media further comprise instructions to: take action to obtain sufficient participants to engage in the collaboration activity.

32. The machine-readable media of claim 31, wherein the action comprises asking a learner to participate in the collaboration activity.

33. The machine-readable media of claim 31, further comprising instructions to: wait a predetermined amount of time before taking action.

34. The machine-readable media of claim 29, wherein the collaboration pool indicates that the learner can participate in the collaboration activity.

35. The machine-readable media of claim 29, wherein the collaboration pool further comprises data identifying at least one of a type, a topic, and a duration of the collaboration activity.

36. The machine-readable media of claim 29, further comprising instructions to: assign the learner a collaboration property, the collaboration property indicating how the learner interacted with the at least one structural element.

37. The machine-readable media of claim 36, wherein the collaboration property defines a role of the learner vis-à-vis the at least one structural element.

38. The machine-readable media of claim 36, further comprising instructions to: store collaboration properties assigned to the learner, the collaboration properties indicating how the learner interacted with one or more of the structural elements; anduse the collaboration properties to evaluate the learner.