The entire disclosure of Japanese patent Application No. 2021-196009, filed on Dec. 2, 2021, is incorporated herein by reference in its entirety.
The present disclosure relates to information processing, and more specifically, to a technique of correcting the bias of answers of questionnaire results.
The answer format of questionnaires and other questions includes a free answer format and an answer choice format. For example, there are a person who selects and answers an extreme number (1 or 10) and a person who selects and answers an average number (5 or 6) to a question of selecting an answer from an answer field including 1 to 10 choices in the answer choice format. As described above, there is a problem that the answer result is affected by the personality and psychological factors of a respondent.
In addition, in a case where the same respondent regularly answers the same questionnaire, there are a case where the respondent answers with an extreme number and a case where the respondent answers with an average number depending on a psychological situation at the time of answer. There is a problem that answer results vary even in the same respondent when the times are different, and the objectivity of the questionnaire is lowered. Therefore, there is a need for a method capable of excluding personality and psychological factors of the respondent of the questionnaire and accurately evaluating the questionnaire
Regarding a questionnaire evaluation method, for example, JP 2004-287736 A discloses a technique of proposing “calculating a pattern indicating a psychological tendency of a respondent on the basis of answer results of a question group and a dummy question group obtained from the respondent to calculate a coefficient, correcting the answer results using the coefficient and proposing the answer results, and obtaining objective questionnaire results reflecting the psychological tendency of the respondent”. This technique is a technique of “providing an answer result table for collecting answer results of a question and a dummy question of a questionnaire, calculating a pattern indicating a psychological tendency on the basis of one or both of the answer result of the question and the answer result of the dummy question in the answer result table, and calculating a coefficient corresponding to the pattern and correcting the answer result” (see [Abstract of the Disclosure]).
However, according to the technique disclosed in JP 2004-287736 A, it is difficult to determine the psychological error tendency of a respondent from one dummy question, and the number of questions increases if a plurality of dummy questions is inserted, and thus the burden for the respondent to answer increases. In addition, in the technique, since the method of calculating a correction coefficient is different for each of three patterns of a lenient tendency, a central tendency, and a comparison bias tendency, the pattern needs to be recognized before the calculation. Furthermore, the technique cannot correct tendencies other than three patterns.
In addition, the technique includes the past answer results in the formula for calculating the correction coefficient of each of the lenient tendency and the central tendency. The comparison bias tendency is on condition that the answer result of the dummy question of the respondent falls within the range of the past answer results. Therefore, the technique cannot calculate the correction coefficient of each of the lenient tendency, the central tendency, and the comparison bias tendency without the past answer results.
Therefore, there is a need for a technique of obtaining a highly objective answer result of a questionnaire without increasing the burden on the respondent. In addition, there is a need for a technique capable of correcting variations in answer results without depending on a specific pattern. Furthermore, there is a need for a technique capable of correcting variations in answer results without requiring past answer results.
The present disclosure has been made in view of the background described above, and an object of one aspect is to provide a technique of extracting a highly objective answer result of a questionnaire without increasing a burden on a respondent of the questionnaire. An object of another aspect is to provide a technique capable of correcting variations in answer results without depending on a specific pattern. Furthermore, another object of the present disclosure is to provide a technique capable of correcting variations in answer results without requiring past results.
To achieve at least one of the abovementioned objects, according to an aspect of the present invention, there is provided a non-transitory recording medium storing a computer readable questionnaire correction program, and the program reflecting one aspect of the present invention causes a computer to perform: accessing each of answer results in which an answer to each of a plurality of questions constituting a questionnaire is selected from a plurality of choices of a plurality of numerical values; calculating a variation in the answer results; and correcting each of the answer results on a basis of the variation calculated.
The advantages and features provided by one or more embodiments of the invention will become more fully understood from the detailed description given hereinbelow and the appended drawings which are given by way of illustration only, and thus are not intended as a definition of the limits of the present invention:
Hereinafter, one or more embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments. In the following description, the same components are denoted by the same reference numerals. This holds true for names and functions. Therefore, detailed descriptions thereof will not be repeated.
An aspect of counting a questionnaire will be described with reference to
In one aspect, the questionnaire count device 130 displays a questionnaire on each terminal 110. Each of the respondents inputs answers to the questionnaire from the terminal 110 that can be used by each of the respondents. The questionnaire count device 130 counts the individual answers, displays a count result, or outputs the count result to another information processing device.
In another aspect, a plurality of respondents may answer the questionnaire using one terminal 110. In this case, for example, by individually logging in to the account held by each of the respondents and answering the questionnaire presented in the account, a plurality of respondents can answer the questionnaire while sharing one terminal 110.
[Configuration of Computer System]
A configuration of an information processing device constituting the system 100 will be described with reference to
The computer system 200 includes, as main components, a central processing unit (CPU) 1 that executes a program, a mouse 2 and a keyboard 3 that receive an input of an instruction from a user of the computer system 200, a RAM 4 that stores data generated by the execution of the program by the CPU 1 or data input via the mouse 2 or the keyboard 3 in a volatile manner, a hard disk 5 that stores data in a nonvolatile manner, an optical disk drive 6, a communication interface (I/F) 7, and a monitor 8. The components are connected to each other by a data bus. A compact disc-read only memory (CD-ROM) 9 or another optical disk can be mounted on the optical disk drive 6.
The processing in the computer system 200 is implemented by each piece of hardware and software performed by the CPU 1. Such software may be stored in advance in the hard disk 5. The software may be stored in the CD-ROM 9 or another recording medium and distributed as a computer program. Alternatively, the software may be provided as an application program that can be downloaded by an information provider connected to a so-called Internet. Such software is read from the recording medium by the optical disk drive 6 or another reading device, or is downloaded via the communication interface 7, and then is once stored in the hard disk 5. The software is read from the hard disk 5 by the CPU 1 and stored in the RAM 4 in the form of an executable program. The CPU 1 executes the program.
The individual components constituting the computer system 200 illustrated in
Note that the recording medium is not limited to a CD-ROM, a flexible disk (FD), or a hard disk, and may be a medium that fixedly carries a program, such as a solid state drive (SSD), a magnetic tape, an optical disk (Magnetic Optical Disc (MO)/Mini Disc (MD)/Digital Versatile Disc (DVD)), an integrated circuit (IC) card (including a memory card), an optical card, a semiconductor memory such as a mask ROM, an electronically programmable read-only memory (EPROM), an electronically erasable programmable read only memory (EEPROM), or a flash ROM.
The program referred to herein includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.
The computer system 200 can be implemented as a notebook computer device, a desktop computer device, or other computer devices, or a portable information communication terminal such as a smartphone or a tablet terminal.
[Display Example of Screen]
An example of a screen displayed on the terminal 110 will be described with reference to
As shown in a screen of
Specifically, as shown in a screen of
For example, in another aspect, as shown in a screen of
Note that, instead of another aspect, the screen of
[Data Structure of Questionnaire Count Device 130]
The data structure of the questionnaire count device 130 will be described with reference to
In the example of
On the other hand, the respondent with a respondent number 2 or n selects second to fourth choices as an answer to a question. Therefore, this respondent can be determined to tend to avoid an extreme answer as compared to other respondents.
In the example of
When the answer results are corrected, the values (1, 2, 3, 4, and 5) of the answer results before correction are respectively corrected to values (2.24, 3.24, 3.40, 3.56, and 4.56). The degree of deviation (σcorrection) of the corrected answer result is “1.04”. The average value (μ*) of the answer results is “3.17”.
The control structure of the questionnaire count device 130 will be described with reference to
In step S1010, the CPU 1 accesses answers to a questionnaire. For example, the CPU 1 accesses a database of the answers to the questionnaire (
In step S1020, the CPU 1 extracts a numerical value of a choice selected as the answer. For example, in a case where the answer is in five levels of 1 to 5, the numerical value of the choice is any of 1, 2, 3, 4, or 5. In a case where the answer is in ten levels of 1 to 10, the numerical value of the choice is any of 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10.
In step S1030, the CPU 1 calculates an average value of numerical values of the choices of the individual answers.
In step S1040, the CPU 1 calculates a variation in the values of the individual answers (also referred to as “degree of deviation”). Details of the calculation of the degree of deviation will be described later.
In step S1050, the CPU 1 corrects the numerical value of the choice selected as the answer using the calculated variation.
In step S1060, the CPU 1 determines whether or not the correction processing has been completed for all the questions in the questionnaire. If it is determined that the correction processing has been completed for all the questions (YES in step S1060), the CPU 1 switches the control to step S1070. Otherwise (NO in step S1060), the CPU 1 returns the control to step S1010.
In step S1070, the CPU 1 counts the corrected numerical values.
In step S1080, the CPU 1 outputs the result of counting. For example, the CPU 1 displays the result on the monitor 8 of the questionnaire count device 130. Alternatively, the CPU 1 can convert the result into a predetermined data format and transmit the data format to another information processing device.
[Comparison of Degree of Deviation Before and After Correction]
The data structure before and after the correction by the questionnaire count device 130 will be described with reference to
<Comparison of Variations (Degree of Deviation) Before and After Correction of Answer Result>
The calculation of the degree of deviation in the present embodiment will be described with reference to
[Before Correction of Answer Result]
The state in
That is, the CPU 1 calculates the degree of deviation (σcurrent) using Formula (1).
n denotes number of questions.
x denotes answer result.
In the example of
[After Correction of Answer Result]
The state in
Specifically, the CPU 1 corrects the numerical value of the choice selected as the answer using an arithmetic expression “numerical value of answer to each question+(degree of deviation−target value of degree of deviation)”. Here, it is assumed that the target value of the degree of deviation is 1, and the degree of deviation from the average value of the answer field is 1.84.
For example, the numerical value (=1) of the choice selected as the answer of Suzuki to the question A becomes 1+(1.84-1)=1.84 from the arithmetic expression. Therefore, the numerical value in the answer field is corrected from “1” before the correction to “1.84”. The same applies to the numerical values (2 to 5) of other questions and other answer fields. As a result, the numerical values (1, 2, 3, 4, and 5) of the choices for Suzuki are respectively corrected to numerical values (1.84, 2.84, 3.00, 3.16, and 4.16). The average value of the numerical values of the individual choices in the corrected answer field is 2.77 (=(1.84+1.84+2.84+4.16+1.84+4.16+4.16+1.84+1.84+3.16/10)).
Furthermore, the CPU 1 calculates the degree of deviation using Formula (1) to obtain the degree of deviation (=1.04).
For other respondents, the values in the answer field are corrected on the basis of the arithmetic expression described above, and the degree of deviation can be derived.
<Degree of Deviation from Average Value of Answers>
Another method will be described with reference to
[Before Correction of Answer Result]
The state in
The simple average value of the numerical values of the choices selected by the respondent is “2.6”. Therefore, the CPU 1 calculates the difference between the choice and the simple average value as “deviation from average” for each of ten questions (see column (1)). The CPU 1 calculates a value by squaring the calculated value (see column (2)). Furthermore, the CPU 1 calculates the square root (1.80) of the average value of the values obtained by squaring as the degree of deviation of the answers by the respondent from the average value.
[After Correction of Answer Result]
The state in
The CPU 1 calculates a simple average value 2.76 (=(1.80+1.80+2.80+4.20+1.80+4.20+4.20+1.80+1.80+3.20)/10) of ten answers using the corrected numerical values as the numerical values of the choices obtained by the respondent (Suzuki). The CPU 1 calculates the difference (the deviation) between the answer and the arithmetic mean value (2.76) for the answer to each question (column (1)). The CPU 1 calculates each of the square values of the differences (column (2)). Furthermore, the CPU 1 calculates the square root (=1.05) of the average value of the square values as the degree of deviation from the average value of the respondent.
For other respondents, the values in the answer field are corrected on the basis of the arithmetic expression described above, and the degree of deviation can be derived.
<Correction of Difference Between Average Value of Respondent and Median Value of Answer Field>
Another method will be described with reference to
[Before Correction of Answer Result]
Referring to
For each answer, the CPU 1 calculates the difference (the deviation) between the value of the choice selected as the answer and the median value (the value of the third choice (=3)) of the answer field (see “deviation from 3” in column (1)). In this case, the difference S between the median value (=3) of the answer field and the average value (=2.6) of the respondent is 0.4.
The CPU 1 calculates the square value of the difference (see “square of (1)” in column (2)). Furthermore, the CPU 1 calculates the square root of the average value of the square values, and derives the degree of deviation (=1.843909) from the average value of the answer field.
[After Correction of Answer Result]
The state in
[Mathematical Formula 2]
δ={umlaut over (x)}−μ (2)
δ denotes difference between median value of answer field and average value of respondent.
μ denotes answer average value of respondent.
The CPU 1 selects one of Expressions (3) to (5) in accordance with the magnitude relationship between the answer result (the numerical value of the choice selected by the respondent) and the average value (=3) of the answer field.
[Mathematical Formula 3]
In case of x>
y
i
=x
i+(σcurrent−σgoal)+δ (3)
[Mathematical Formula 4]
In case of x=
y
i
=x
i+δ (4)
[Mathematical Formula 5]
In case of x<
y
i
=x
i+(σcurrent−σgoal)+6 (5)
[Calculation Example]
The CPU 1 corrects the numerical values of the individual choices as follows. First, the CPU 1 calculates the difference S using Formula (2).
Difference δ=3−2.6=0.4
In the case of the questions A, B, E, H, and I, the numerical value (1) of the first choice is selected as the answer. The numerical value, that is, answer result (1)<average value (3) of the answer field. Therefore, the CPU 1 corrects the numerical value of the choice using Formula (5) to derive a corrected answer result y. Specifically, the corrected numerical value y1 of the numerical value (1) of the first choice is the following value.
y
1=1+(1.84-1)+0.4=2.24
In the case of the question C, the numerical value (2) of the second choice is selected as the answer. The magnitude relationship between the answer result and the average value of the answer field is the same as that in the case of the first choice. Therefore, the CPU 1 corrects the numerical value (2) of the second choice using Formula (5). Specifically, the corrected numerical value y3 of the numerical value (2) of the second choice is the following value.
y
3=2+(1.84-1)+0.4=3.24
In the case of the question J, the numerical value (4) of the fourth choice is selected as the answer. The numerical value, that is, answer result (4)>average value (3) of the answer field. Therefore, the CPU 1 corrects the numerical value (4) of the fourth choice using Formula (3). Specifically, the corrected numerical value y4 of the numerical value (4) of the fourth choice is the following value.
y
4=4−(1.84−1)+0.4=3.56
In the case of questions D, F, and G, the numerical value (5) of the fifth choice is selected as the answer. The magnitude relationship between the answer result and the average value of the answer field is the same as that in the case of the fourth choice. Therefore, the CPU 1 corrects the numerical value (5) of the fifth choice using Formula (3). Specifically, the corrected numerical value y5 of the numerical value (5) of the fifth choice is the following value.
y
5=5−(1.84−1)+0.4=4.56
Although the third choice is not selected by on the respondent (Suzuki), the CPU 1 corrects the numerical value (3) of the third choice using Formula (4). If the option is selected, the answer result (3)=the average value (3) of the answer field. Therefore, the CPU 1 corrects the numerical value of the choice using Formula (4). Specifically, the corrected numerical value y3 of the numerical value (3) of the third choice is the following value.
y
3=3+0.4=3.4
The CPU 1 calculates the corrected degree of deviation (σcorrection) using Formula (6).
That is, the CPU 1 calculates the difference (the deviation) between the corrected numerical value (=3.4) of the median value (3) of the choices in the answer field and the corrected numerical value of the choice selected by the respondent (see “deviation from 3” in column (1)). The CPU 1 calculates the square value of the difference (see “square of (1)” in column (2)). Furthermore, the CPU 1 calculates the square root of the average value of the square values, and derives the degree of deviation (=1.04) from the average value of the answer field.
The CPU 1 calculates the corrected average value of the answers using Formula (7).
For example, in the example of
Note that the degree of deviation (σcurrent) is not limited to that calculated by the method described above, and may be derived as follows. For example, the CPU 1 can calculate the average value of the differences between the maximum value and the minimum value of each of the answer results as the degree of deviation (σcurrent) using Formula (8).
xmax denotes maximum value of answer result.
xmin denotes minimum value of answer result.
Alternatively, the CPU 1 can calculate, as the degree of deviation degree (σcorrection), the average value of the differences between the maximum value and the minimum value of each of the corrected answer results using Formula (9).
ymax denotes maximum value of corrected answer result.
ymin denotes minimum value of corrected answer result.
In still another aspect, the CPU 1 can calculate, as the degree of deviation (σcurrent), the average value of the differences between the first quantile and the third quantile of each of the answer results using Formula (10).
Qx1 denotes first quantile of answer result.
Qx3 denotes third quantile of answer result.
Alternatively, the CPU 1 can calculate, as the degree of deviation (σcorrection), the average value of the differences between the first quantile and the third quantile of each of the corrected answer results using Formula (11).
Qy1 denotes first quantile of corrected answer result.
Qy3 denotes third quantile of corrected answer result.
<Case where Number of Choices is not Constant>
Note that the number of choices may varies from question to question depending on the content of the questionnaire Therefore, counting in a case where the number of choices varies t will be described with reference to
The monitor 8 displays a screen including a questionnaire Question 1 or question 2 has five choices as answers. On the other hand, question 3 has four choices. Question 9 has three choices.
In this case, the CPU 1 performs normalization to equalize the numerical values of the upper limits of the choices before performing the processing of correcting variations in answers, which has been described above. As an example, a case where the numerical value of the first choice is 1, the numerical value of the second choice is 2, the numerical value of the third choice is 3, the numerical value of the fourth choice is 4, and the numerical value of the fifth choice is 5 will be described.
In the example of
For example, the CPU 1 performs processing of correcting the answers to question 3 and question 9 to the maximum value (=5). The number of choices for question 3 is 4, and the maximum value is 4. Therefore, the CPU 1 corrects the answer result to question 3 (the numerical value of the choice selected by the respondent) as follows. y=4/3x−1/3x
x denotes the answer result before correction. y denotes the corrected result.
On the other hand, the number of choices for question 9 is 3, and the maximum value is 3. Therefore, the CPU 1 corrects the answer result to question 9 as follows.
y=2x−1 In this manner, the CPU 1 makes the width (the maximum value) of the numerical values of the choices constant, and then performs the correction processing to correct variations in the answer results. As a result, even in the case of questionnaires with different numbers of choices, the CPU 1 can correct variations in answers.
As described above, the questionnaire count device 130 according to the present embodiment can present highly objective results to questions in a questionnaire while reducing the burden on respondents. Since the questionnaire count device 130 adopts the same calculation method in any pattern, it is not necessary to recognize a pattern in advance, and the results can be corrected without depending on the type of the pattern. In addition, since the questionnaire count device 130 makes a correction using the result of the questionnaire answered by the respondent at that time, it is possible to correct even a questionnaire that has no past results.
The technical features disclosed above can be summarized as follows.
[Configuration 1] According to an embodiment, a program to be executed by a computer (for example, the computer system 200) is provided. This program causing a processor (for example, the CPU 1) of the computer to perform accessing each of answer results in which an answer to each of a plurality of questions constituting a questionnaire is selected from a plurality of choices of a plurality of numerical values, calculating a variation in the answer results, and correcting each of the answer results on the basis of the variation calculated.
[Configuration 2] In another aspect, the accessing includes the CPU 1 accessing each of answer results (for example, numerical values of choices selected as answers) by each of a plurality of respondents, the answer results being stored in the hard disk 5. The program further causes the computer to perform, for each of the plurality of respondents, calculating a variation in the answer results, correcting the answer results on the basis of the variation calculated, and counting corrected answer results for each of the plurality of respondents. As a result, variations in the answer results of the individual respondents can be suppressed.
[Configuration 3] In another aspect, the accessing includes the CPU 1 accessing each of answer results of a same questionnaire answered at different times by a same respondent, the answer results being stored in the hard disk 5. The program causes the computer to perform, for each of the answer results by the same respondent, calculating and correcting and counting corrected answer results of the answers. As a result, it is possible to grasp the tendency of answers to the same question made at different timings by the same respondent.
[Configuration 4] In another aspect, the correcting includes correcting a value of a choice selected as an answer to each of the questions.
[Configuration 5] In another aspect, the variation includes a degree of deviation between a value of each of the choices selected as an answer and an average value of the plurality of numerical values.
[Configuration 6] In another aspect, the correcting includes correcting the answer result by using a difference between an average value of the answer results and an average value of the plurality of numerical values.
[Configuration 7] In another aspect, each of questions of the questionnaire includes a question with an ordinal scale or a Likert scale.
[Configuration 8] In another aspect, the number of questions in the questionnaire is equal to or larger than five.
[Configuration 9] In another aspect, the number of the choices is equal to or larger than four.
[Configuration 10] In another aspect, calculating the variation includes calculating, for questions with a same number of choices, a variation in answer results to the questions. For example, the CPU 1 can individually calculate variations in answers to a question having five choices and variations in answers to a question having four choices.
[Configuration 11] In still another aspect, the program causes the computer system 200 to, in a case where a number of choices is different for each question, equalize an upper limit of a question with a small upper limit of a numerical value of a choice to a largest numerical value of the upper limit of the choice to correct an answer result of the question with a small upper limit of the numerical value. Calculating the variation includes calculating the variation by using the corrected answer result instead of an answer result before correction for the question with a smaller upper limit of the numerical value. For example,
[Configuration 12] A method performed by a computer in order to correct a variation of a questionnaire result, the method including accessing, by the CPU 1, each of answer results in which an answer to each of a plurality of questions constituting a questionnaire is selected from a plurality of choices of a plurality of numerical values, calculating, by the CPU 1, a variation in the answer results, and correcting, by the CPU 1, each of the answer results on the basis of the variation calculated.
With such a configuration, for example, variations in answers obtained by a questionnaire performed online can be corrected, and thus a questionnaire using a portable terminal device such as a smartphone or a tablet terminal can be easily implemented.
[Configuration 13] The questionnaire count device 130 includes a memory (for example, the hard disk 5 or the RAM 4) storing the questionnaire correction program according to any one of the above, and a processor (CPU 1) for executing the program. As a result, the computer system 200 in which the program is installed can function as the questionnaire count device 130.
The disclosed technical features are applicable to an online questionnaire, a cloud-based questionnaire, and the like.
Although embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are made for purposes of illustration and example only and not limitation. The scope of the present invention should be interpreted by terms of the appended claims, and it is intended that meanings equivalent to the claims and all modifications within the scope are included.
Number | Date | Country | Kind |
---|---|---|---|
2021-196009 | Dec 2021 | JP | national |