The technical field pertains generally to systems and methods for administering and managing online surveys and, more particularly, to creating, facilitating, and evaluating such surveys by way of electronic devices such as personal computers and mobile electronic devices, e.g., smartphones and tablet computing devices.
Online surveys have become increasingly valuable to individuals, companies, and virtually all types of organizations by enabling such entities to quickly and efficiently obtain various types of information from any number of target populations. Such information may include customer preferences, feedback on products and/or services, and customer service-related information. Companies may incorporate such information in making various business and/or strategic or otherwise tactical decisions, for example. Also, the continued prevalence of mobile electronic devices, such as smartphones and tablet devices, in today's society provides individuals and groups with even greater access to virtually every type of target populations for electronic surveys and other information-gathering mechanisms. Indeed, millions of people use the Internet or other networks on a regular—often daily—basis, both at home and at their workplace. Accordingly, there remains a need for further improvements in facilitating the administering and management of—and collecting information and data in association with—online surveys.
Embodiments of the disclosed technology generally pertain to systems and methods for managing online surveys and evaluating results thereof. In certain embodiments, an online survey is created based on a set of questions retrieved from a repository of questions. Once created, the survey is administered to a population. The population may be a targeted group of individuals or open to the public. Data and information collected from the creator of the survey may be evaluated as well. A benchmarking module may be used to make comparisons based on information from the creator of the survey and information from other creators of other, previously-generated or concurrently-created surveys. The comparing may also be based at least in part on semantic modifier portions of questions in the survey.
The system 100 also includes three mobile electronic devices 108-112. Two of the mobile electronic devices 108 and 110 are communications devices such as cellular telephones or smartphones. Another of the mobile devices 112 is a handheld computing device such as a personal digital assistant (PDA), tablet device, or other portable device. A storage device 114 may store some of all of the data that is accessed or otherwise used by any or all of the computers 104 and 106 and mobile electronic devices 108-112. The storage device 114 may be local or remote with regard to any or all of the computers 104 and 106 and mobile electronic devices 108-112.
In the example, the electronic device 200 includes a housing 202, a display 204 in association with the housing 202, a user interaction module 206 in association with the housing 202, a processor 208, and a memory 210. The user interaction module 206 may include a physical device, such as a keyboard, mouse, microphone, speaking, or any combination thereof, or a virtual device, such as a virtual keypad implemented within a touchscreen. The processor 208 may perform any of a number of various operations. The memory 210 may store information used by or resulting from processing performed by the processor 208.
As used herein, superficial modifiers generally pertain to any type of superficial change that does not alter the substance, or semantic meaning, of the question. An example of a superficial modifier is changing “he” to “she” in a question whose answer is wholly unrelated to gender. Semantic modifiers, as used herein, generally pertain to data fields or descriptions that are more than superficial, such as how somebody might feel about a certain type of object or thing, e.g., whether he or she likes or dislikes a certain product or service or otherwise loves or hates the product/service. Open-ended modifiers, as used herein, generally pertain to data fields or descriptions that can be provided directly by the creator of the question or survey. An example of an open-ended modifier is a dropdown box having a listing of job titles and a blank space in which the survey-creator can type a title that is not in the list, or type a person's name.
At 304, information about the survey-creator is collected. Such information may be stored in a profile corresponding to the user, as indicated at 306. In certain embodiments, a profile may be created for each survey-creator and updated accordingly after the creation of each additional survey by the corresponding survey-creator.
At 308, the online survey is analyzed or otherwise processed. For example, the system may compare information about the survey and survey-creator to other survey-generating individuals or groups and surveys that were previously and/or concurrently generated by such entities. A benchmarking feature as described here may be used to visually display or otherwise present to a user such comparisons.
At 310, results of the analysis may be optionally stored. The results may be stored locally, e.g., by the user's device, remotely such as by an external server, or both. In certain embodiments, each analysis may be named or otherwise identified based on the analysis for easy and efficient cataloging and subsequent access.
A bar graph portion 406 of the user interface 402 provides the user with a visual representation of information about the survey based on previously-generated surveys by other survey-creators that asked the same semantic question. In the example, the bar graph portion 406 provides a visual indication as to what percentage of survey-takers answered each of the seven possible responses to the originally-presented question as indicated by the question portion 404. It should be noted that, while the results that are visually presented in the illustrated example are presented by way of bar graphs and expressed percentages, any of a number of other suitable techniques may be used to present the results to the user or other viewer.
A table portion 408 of the user interface 402 provides an alternative displaying of the responses to the question as indicated by the question portion 404. In the example, the table portion 408 includes a table that lists the possible responses to the question in a first column and an indication as to what percentage of survey-makers selected each of the possible responses. In certain embodiments, either or both of the display portions 406 and 408 may include an indication as to how many survey-takers selected each of the possible responses, how many survey-creators there were that asked the same semantic question in total, or both. Alternatively or in addition thereto, such information may be presented elsewhere within or in connection with the user interface 402.
A benchmarking button 410, when selected by the user, may cause the system to enable a benchmarking feature as described herein.
The user may select a desired one of the selections 412 and, responsive thereto, the system may enable a feature corresponding to the selected option. Responsive to the user selection “National Average,” for example, the system may provide a comparison of the currently-presented survey to those of survey-creators that asked the same semantic question nationwide. Responsive to the user selection “Industry Average,” however, the system may provide a comparison of the currently-presented survey to those of average answers to semantically identical questions asked by survey-creators that are within a certain industry, e.g., the same industry as the survey-creator(s) whose results are currently presented by the user interface 403.
The entirety of survey-creators may be determined on the basis of modifiers, such as superficial modifiers, semantic modifiers, and/or open-ended modifiers, within the corresponding questions. For example, questions from other surveys that are similar—but not identical—to other questions may be included for purposes of the analysis as long as the question has not been semantically altered. The total pool of responses and associated information may be adjusted as surveys are added, removed, or altered. Such adjusting may happen responsive to a user request, at certain intervals, or real-time as survey changes occur.
In certain embodiments, a visual key (not shown) such as a certain color, pattern, or icon may be displayed to allow the user or other viewers to more quickly identify correlations between information presented in the bar graph portion 406 and information presented in the table portion 408.
A survey management module 704 allows a user to select a set of questions from the question repository 702 for use as or otherwise with an online survey. The survey management module 704 may also provide semantic modifier options for each question having a semantic modifier portion.
A benchmarking module 706 may group questions and surveys by semantic modifiers and provide an analysis of the survey questions based on properties of the survey-creator and other, previously-created surveys by other survey-creators with different or similar properties as described herein.
A storage module 708 may be used to store results of the analysis. A user interaction module 710 may be used to control a user interface, such as the user interface 402 of
Having described and illustrated the principles of the invention with reference to illustrated embodiments, it will be recognized that the illustrated embodiments may be modified in arrangement and detail without departing from such principles, and may be combined in any desired manner. And although the foregoing discussion has focused on particular embodiments, other configurations are contemplated. In particular, even though expressions such as “according to an embodiment of the invention” or the like are used herein, these phrases are meant to generally reference embodiment possibilities, and are not intended to limit the invention to particular embodiment configurations. As used herein, these terms may reference the same or different embodiments that are combinable into other embodiments.
Consequently, in view of the wide variety of permutations to the embodiments described herein, this detailed description and accompanying material is intended to be illustrative only, and should not be taken as limiting the scope of the invention. What is claimed as the invention, therefore, is all such modifications as may come within the scope and spirit of the following claims and equivalents thereto.