The present invention is directed generally to a method for gathering distributed content evaluations and specifically to a method for capturing a user's real-time evaluation of distributed content pages.
Distributed content is a general term used to describe electronic media that is distributed to end users. Examples of distributed content include webpages and websites, dynamically generated content, cellular telephones using wireless application protocol (WAP) to serve content on the cellular telephone screen, and so forth. Other examples of distributed content are known to persons of ordinary skill in the art. Because there is a high demand for adapting distributed content to the end users' needs, distributed content administrators (administrators) are constantly seeking feedback on the distributed content pages they administer. Due to the anonymity of distributed content users, reliable user feedback regarding the distributed content pages can be difficult to obtain.
One of the problems associated with obtaining user evaluations of distributed content is that distributed content users do not consistently give feedback on the distributed content that they view or use. Often, a user will only give feedback when the user has had a particularly difficult time navigating the distributed content. While these types of comments are useful to administrators in removing distributed content that is difficult to use, they do not convey any information regarding the distributed content that is easy to use. Therefore, a need exists for a method for a user to evaluate distributed content in which the user can identify the distributed content that is difficult to use and distributed content that is easy to use.
A second problem associated with user evaluation of distributed content is that the user is sometimes presented with a single user evaluation form or survey to use in evaluating a plurality of distributed content pages. When a user evaluates a plurality of distributed content pages on a single survey, the user tends to remember more information about the most recently navigated distributed content pages and less information about the first distributed content pages that he navigated. Thus, the survey does not adequately represent the user's evaluation of the entire distributed content, but rather the user's evaluation of the distributed content pages immediately preceding the survey. A survey that weighs the user's evaluation of more recently navigated content is called a back-loaded survey. Back-loaded surveys are not preferable because they do not adequately reflect the user's evaluation of the entire distributed content. Therefore, a need exists for a method of capturing a user's evaluation of distributed content in which the user's evaluation evenly reflects the user's experience in navigation of the entire set of distributed content.
A third problem associated with user evaluation of distributed content is that sometimes the survey is presented before the user has completed his navigation of the distributed content. When the survey is placed at the end of the user's navigation of the distributed content (i.e. after user selection of service, payment, and receipt of the confirmation number), users frequently do not complete the survey. Rather than complete the survey, the majority of users choose to close the distributed content application. In order to increase the number of completed surveys, administrators position the survey so that it appears before the user has completed his navigation of the distributed content (i.e. after user selection of services but prior to payment). When a survey is completed prior to conclusion of the user navigation of the distributed content, the evaluation is said to be front-loaded. Front-loaded evaluations are not preferable because they do not capture a complete picture of the user's evaluation of the distributed content. Therefore, a need exists for a method of capturing a user's evaluation of distributed content after the user has completed his navigation of the distributed content.
In addition to the disadvantages discussed above, surveys also have another disadvantage: the survey is a standard document applied to a wide variety of distributed content users. In other words, the surveys cannot be configured for specific users in the United States, Mexico, Asia, or Europe. The prior art surveys also cannot differentiate users who view one version or type of the distributed content from users who view another version or type of distributed content. If a survey were able to differentiate between different types of users and the distributed content they view or use, then the survey could be customized for each type of user. Customizing the survey to each type of user would make the responses in the survey more meaningful. Therefore, a need exists for a method for surveying distributed content users in which the survey can be configured according to the characteristics and navigation experiences of individual users or groups of users.
Consequently, a need exists in the art for an improved method for user evaluation of distributed content. A need exists for a method in which the user can identify the distributed content that is difficult to use and distributed content that is easy to use. A need exists for a method of capturing a user's evaluation of distributed content in which the user's evaluation evenly reflects the user's experience in navigation of the entire distributed content. A need exists for a method of capturing a user's evaluation of distributed content after the user has completed his navigation of the distributed content. Finally, a need extends to a method for surveying distributed content users in which the survey can be configured for individual users.
The present invention, which meets the needs identified above, is a method for capturing a user evaluation of distributed content. The user evaluation is saved with other information such as the time and date of the evaluation, the user's personal information, and the navigation path the user used to access the distributed content page. The software embodiment of the present invention comprises an Evaluation Program (EP) that creates a user session when a user accesses distributed content. The EP records the user's navigation of the distributed content in the user session. The EP gives the user the opportunity to rate distributed content if the distributed content page has a content rating window and if the user meets the minimum evaluation criteria for the distributed content page. The EP can be combined with various incentive programs to entice the user to rate the distributed content pages. The user also has the option to forgo rating the distributed content page, if desired. If the user decides to rate the distributed content page, the EP displays a content rating window that allows the user to rate the distributed content page. The EP saves the user's evaluation with the user session data. If the user accesses another distributed content page, the EP repeats the process described above. The EP closes the user session when the user leaves the distributed content. The EP can optionally reopen the user session when the user returns to the distributed content.
The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
As used herein, the term “computer” shall mean a machine having a processor, a memory, and an operating system, capable of interaction with a user or other computer, and shall include without limitation desktop computers, notebook computers, tablet computers, personal digital assistants (PDAs), servers, handheld computers, and similar devices.
As used herein, the term “content rating window” shall mean a graphical user interface (GUI) that allows a user to rate a distributed content page.
As used herein, the term “distributed content” shall mean electronic content distributed to a plurality of end users over a computer network. Examples of distributed content include webpages and websites, dynamically generated content, and cellular telephones using wireless application protocol (WAP) to serve content on the cellular telephone screen. Other examples of distributed content are known to persons of ordinary skill in the art.
As used herein, the term “distributed content page” shall mean a single distributed content document, file, script, view of content, or database.
As used herein, the term “evaluate” shall mean for a user to rate the distributed content page.
As used herein, the term “incentive program” shall mean a program in which a user receives miles, points, or gifts in exchange for buying, using, selecting, or evaluating a good, a service, or a distributed content page.
As used herein, the term “minimum evaluation criteria” shall mean a group of criteria that defines a type of user who may evaluate a distributed content page.
As used herein, the term “navigation” shall mean to browse, select options from, and/or click hyperlinks on a distributed content page.
As used herein, the term “user ratings” shall mean a database containing a user evaluation of a distributed content page, the version of the distributed content page, and optionally incentive gifts earned by the user for evaluating the distributed content page.
As used herein, the term “user session” shall mean a database of the user information and the user's navigation history through a distributed content page.
The internal configuration of a computer, including connection and orientation of the processor, memory, and input/output devices, is well known in the art. The present invention may be a method, a stand alone computer program, or a plug-in to an existing computer program. Persons of ordinary skill in the art are aware of how to configure computer programs, such as those described herein, to plug into an existing computer program. Referring to
Distributed content 120 is electronic content distributed to a plurality of end users over a computer network. Distributed content 120 comprises a plurality of distributed content pages. Examples of distributed content include webpages and websites, dynamically generated content, and cellular telephones using wireless application protocol (WAP) to serve content on the cellular telephone screen. Other examples of distributed content are known to persons of ordinary skill in the art. Distributed content 120 contains at least one distributed content page accessible by a user. User sessions 140 are computer files that track the user's navigation history within distributed content 120. Each user session 140 contains the time and date of the user access, the user's IP address, the distributed content pages accessed by a user, the hyperlinks clicked by the user, and the user's personal information, if available. User ratings 160 contain the users' evaluations of the distributed content pages coupled with user session 140. User ratings 160 can optionally contain the incentive plan chosen by the user and/or a description of the incentives received for evaluating the distributed content page. In addition, user ratings 160 may optionally be reopened by the user to add a follow-up survey. Content ratings windows 180 are windows that allow the users to rate the distributed content pages. Minimum evaluation criteria 190 is the minimum criteria that a user must meet in order to rate distributed content 120. Minimum evaluation criteria 190 can be used to vary the content rating window 180 for different types of users. Minimum evaluation criteria 190 can include the user's personal information (i.e. if the user is male/female, the user's physical location, and so forth), the access time, the access date, the user's IP address, the selected incentive plan, and whether the user accesses the Internet via a computer, PDA, or cellular telephone. The present invention may interface with distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and minimum evaluation criteria 190 through memory 100.
As part of the present invention, the memory 100 can be configured with EP 200, distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and/or minimum evaluation criteria 190. Processor 106 can execute the instructions contained in EP 200. Processor 106 is also able to display data on display 102 and accept user input on user input device 104. Processor 106, user input device 104, display 102, and memory 100 are part of a computer such as local computer 95 in
In alternative embodiments, EP 200, distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and/or minimum evaluation criteria 190 can be stored in the memory of other computers. Storing EP 200, distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and/or minimum evaluation criteria 190 in the memory of other computers allows the processor workload to be distributed across a plurality of processors instead of a single processor. Further configurations of EP 200, distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and/or minimum evaluation criteria 190 across various memories, such as client memory and server memory, are known by persons of ordinary skill in the art.
If the user does not meet the minimum evaluation criteria, then EP 200 proceeds to step 222. If the user meets the minimum evaluation criteria, then EP 200 gives the user an opportunity to evaluate the content of the present distributed content page (212). EP 200 can give the user the opportunity to rate the distributed content page by displaying a button that launches a content rating window. Alternatively, EP 200 can display the content rating window as a pop-up window or as a window adjacent to the distributed content page. Displaying the content rating window as a pop-up window or as an adjacent window allows the user to review the distributed content page while completing the evaluation form on the content rating window.
EP 200 can be optionally configured to offer incentives to the user in exchange for evaluating the distributed content page. Possible incentives include free gifts, points, or miles in an incentive program such as the AMERICAN EXPRESS® or the AMERICAN AIRLINES(® AADVANTAGE® incentive programs. The incentives may also be stair-stepped such that the user receives an additional gift or bonus points or miles for completing a certain number of evaluations.
EP 200 then makes a determination whether the user wants to rate the distributed content page (214). The user can indicate that he wants to rate the distributed content page by clicking the button to launch the content rating window or by rating the distributed content page on the content rating window. The user can indicate that he does not want to rate the distributed content page by not clicking the button to launch the content rating window or by closing the content rating window without evaluating the content. If the user does not want to rate the distributed content page, EP 200 proceeds to step 222. If the user wants to rate the distributed content page, then EP 200 displays the content rating window, if not already displayed (216). The present invention does not need to display the content rating window if the content rating window was displayed as part of step 212. The user then rates the present distributed content page (218). In evaluating the distributed content page, the user completes a user rating file by answering a plurality of questions regarding the distributed content page. The user ratings file may be like user ratings 160 depicted in
At step 222, EP 200 then determines whether the user has accessed a new distributed content page (222). If the user has accessed a new distributed content page, then EP 200 returns to step 208. If the user has not accessed a new distributed content page, then EP 200 closes the user session and saves the user session in the user sessions file (224). EP 200 then ends (226). In an alternative embodiment, when the user returns to the distributed content, EP 200 reopens the user session and continues to track the user's access throughout the distributed content. Maintaining a single user session for a single user allows the present invention to develop a more accurate history of a specific user's navigation through the distributed content.
The configuration of EP 200, distributed content 120, user sessions 140, user ratings 160, content rating windows 180, and minimum evaluation criteria 190 of the present invention offers many advantages over the prior art solutions. For example, because user ratings 160 are saved in conjunction with specific information about the user in user session 140, user ratings 160 may be categorized by any of the fields in user session 140 or user ratings 160. The present invention also resolves the problem of front-loaded and back-loaded evaluations by gathering information within the context of a complete visit to the distributed content page by the user. The present invention provides the user with an opportunity to evaluate a plurality of distributed content pages within a plurality of different types of distributed content. Through the incentive program, the present invention encourages user evaluation of the distributed content pages. The present invention can be easily implemented with existing incentive programs. The users are able to refresh their memory about the distributed content page by flipping back and forth between the distributed content page and content rating window 180 while evaluating the distributed content page.
The present invention is also extensible. The invention allows the administrators to analyze the duration data in user session 140 to differentiate between distributed content page requests created by stray mouse clicks and deliberate distributed content page requests. The present invention allows the user to launch and re-launch content rating window 180 when desired. The present invention can be configured to allow a user to update his evaluation by reopening his user rating 160. The user can then complete his users rating 160 via email, web browser, telephone, or any other communicative means. The present invention allows for integration of a company's complaint management, support, and similar systems. Finally, the present invention can be cross-referenced with other survey data.
With respect to the above description, it is to be realized that the optimum dimensional relationships for the parts of the invention, to include variations in size, materials, shape, form, function, manner of operation, assembly, and use are deemed readily apparent and obvious to one of ordinary skill in the art. The present invention encompasses all equivalent relationships to those illustrated in the drawings and described in the specification. The novel spirit of the present invention is still embodied by reordering or deleting some of the steps contained in this disclosure. The spirit of the invention is not meant to be limited in any way except by proper construction of the following claims.