This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2019-233897 filed Dec. 25, 2019.
The present disclosure relates to an information processing device and a non-transitory computer readable medium.
A stress evaluation method that acquires biological data from a wearable sensor worn by a measurement subject and evaluates the stress felt by the measurement subject on the basis of the biological data has been proposed (for example, see
https://www.jstage.jst.go.jp/article/pjsai/JSAI2018/0/JSAI20 18_2F3OS4b05/_pdf).
The stress evaluation method described above (https://www.jstage.jst.go.jp/article/pjsai/JSAI2018/0/JSAI2 018_2F3OS4b05/_pdf) carries out a stress-related survey once a month on measurement subjects, collects acceleration (ACC), electrodermal activity (EDA), and skin temperature (ST) from 33 people every day for a month as biological data, creates features from the collected biological data, selects a maximum of 10 features by multiple regression analysis to create a stress estimation model, and uses the stress estimation model to calculate a stress evaluation value.
Aspects of non-limiting embodiments of the present disclosure relate to outputting stress evaluation values accumulated in an observation period with high accuracy compared to a case of calculating a collective stress evaluation value for a certain relatively long ongoing period.
Aspects of certain non-limiting embodiments of the present disclosure address the above advantages and/or other advantages not described above. However, aspects of the non-limiting embodiments are not required to address the advantages described above, and aspects of the non-limiting embodiments of the present disclosure may not address advantages described above.
According to an aspect of the present disclosure, there is provided an information processing device provided with a processor configured to output an evaluation value of stress accumulated in an observation period on a basis of information indicating a first stress feature accumulated up to before the observation period and a second stress feature received during the observation period.
Exemplary embodiment of the present disclosure will be described in detail based on the following figures, wherein:
Hereinafter, an exemplary embodiment of the present disclosure will be described with reference to the drawings. Note that in the drawings, structural elements that have substantially the same function are denoted with the same signs, and duplicate description thereof will be reduced or omitted.
The information processing device according to the exemplary embodiment is provided with a processor that outputs an evaluation value of stress accumulated in an observation period on the basis of information indicating a first stress feature accumulated up to before the observation period and a second stress feature received during the observation period.
“Stress” refers to information indicating an internal state or a psychological state of a person. In the exemplary embodiment, the observation period is set to a single day as an example, and a specific observation period is also referred to as the current day. For example, the single day treated as the observation period may be the day when the stress evaluation value is output or a day farther in the past than the day when the stress evaluation value is output. The stress accumulated on the day of observation includes a first stress that is accumulated over a relatively long period up to the previous day before the day of observation and still remains on the day of observation, and a second stress that is received on the day of observation. The period of accumulating features of stress or data for computing the features up to the previous day before the day of observation may be set appropriately to a relatively long period, such as a week, a month, or six months, that makes it possible to estimate the normal state of the person.
The information processing system 1 is applied to an activity area, which may be a workplace such as an office (including rental offices and shared offices) or a factory, a school, or a place of learning such as a classroom, for example.
When the measuring device 2 is connected to the charger 3, the charger 3 charges a power supply unit 26 described later in the measuring device 2.
For the user terminal 4, a personal computer or a mobile information processing device such as a multifunctional mobile phone (that is, a smartphone) may be used, for example. An IP address is assigned to the user terminal 4.
The network 5 is a communication network such as a wireless local area network (LAN) or the Internet, for example.
(Configuration of Measuring Device)
The measuring device 2 is provided with a control unit 20 that controls each unit of the measuring device 2, a storage unit 21 that stores various information, a first biological information measuring unit 22 that measures first biological information, a second biological information measuring unit 23 that measures second biological information, a measure button 24 that issues an instruction to start and stop measurement, a wireless communication unit 25, and a power supply unit 26 that supplies power to each unit of the measuring device 2.
The control unit 20 includes a processor such as a central processing unit (CPU), an interface, and the like. The functions of the control unit 20 will be described later.
The storage unit 21 includes memory such as read-only memory (ROM) and random access memory (RAM), and stores information such as a program 210 for the processor and user information 211. Also, the storage unit 21 is provided with a biological information storage area 212 where the biological information for a single day is stored. The user information 211 includes information such as a user ID that identifies the user and a measuring device ID that identifies the measuring device 2.
The first biological information measuring unit 22 uses an acceleration sensor, for example. A three-axis acceleration sensor may be used as the acceleration sensor. Hereinafter, time-series data of an acceleration detection signal output by the acceleration sensor is also referred to as acceleration data. The acceleration data is one example of the first biological information.
Note that the first biological information measuring unit 22 may also acquire a movement pattern of a measurement subject on the basis of the detection signal from the acceleration sensor. In this case, a detection signal that acts as a reference for the acceleration sensor is stored in the storage unit 21 for each movement pattern, and the first biological information measuring unit 22 acquires the movement pattern corresponding to the detection signal from the acceleration sensor by referencing the content stored in the storage unit 21. Movement patterns include movements such as sitting, walking, and running, for example.
The second biological information measuring unit 23 uses a pulse wave sensor, for example. An optical pulse wave sensor may be used as the pulse wave sensor. Note that an electrocardio sensor may also be used instead of the pulse wave sensor. Hereinafter, time-series data of a pulse wave signal measured by the pulse wave sensor is also referred to as pulse wave data. The pulse wave data is one example of the second biological information. Information such as the pulse interval and the pulse wave amplitude is acquired from the pulse wave data on the information processing device 6 side, for example. In the case of using an electrocardio sensor, information such as the cardiac interval and the electrocardio amplitude is acquired from the electrocardio data on the information processing device 6 side, for example.
When the measure button 24 is first operated after power-on, the measure button 24 outputs a start signal indicating the start of measurement to the control unit 20, and every time the measure button 24 is operated thereafter, the measure button 24 alternates between outputting a stop signal that indicates the end of measurement and outputting the start signal to the control unit 20.
When the start signal is output from the measure button 24, the control unit 20 controls the first biological information measuring unit 22 and the second biological information measuring unit 23 to start measurement of the first biological information and the second biological information. When the stop signal is output from the measure button 24, the control unit 20 controls the first biological information measuring unit 22 and the second biological information measuring unit 23 to stop measurement of the first biological information and the second biological information.
Also, the control unit 20 stores the first biological information and the second biological information measured between the start signal and the stop signal in the biological information storage area 212 of the storage unit 21. Also, when a predetermined time (for example, 9 PM) is reached, the control unit 20 transmits the first biological information and the second biological information stored in the biological information storage area 212 together with the user information 211 stored in the storage unit 21 to the information processing device 6 over the network 5 using the wireless communication unit 25.
Note that the control unit 20 may also transmit the first biological information and the second biological information measured from a first time (such as a time of arriving at a workplace, a time of taking a seat, a time of starting work duties, or a time when a lecture starts, for example) to a second time (for example, a time of leaving the workplace, a time of leaving the seat, a time of ending work duties, or a time when the lecture ends, for example) in a single workday or day of study to the information processing system 1 at the second time (for example, 6 PM) or at a predetermined time (for example, 9 PM) later than the second time.
The wireless communication unit 25 transmits and receives information with respect to the information processing device 6 over the network 5 using wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), for example.
The power supply unit 26 uses a secondary battery such as a lithium-ion secondary battery, for example. Note that a primary battery, a solar cell, or the like may also be used.
(Configuration of Information Processing Device)
The information processing device 6 is provided with a control unit 60 that controls each unit of the information processing device 6, a storage unit 61 that stores various information, and a wireless communication unit 62.
The control unit 60 includes a processor 60a such as a central processing unit (CPU), an interface, and the like. The processor 60a executes a program 610 stored in the storage unit 61 and thereby functions as modules such as a reception module 600, a biological data calculation module 601, a model creation module 602, and an evaluation value calculation module 603. Details about each of the modules 600 to 603 will be described later.
The storage unit 61 includes memory such as read-only memory (ROM), random access memory (RAM), and a hard disk, and stores various information such as the program 610, a user table 611 (see
The stress subjective evaluation data 613 includes survey results answered by users as a subjective evaluation in response to a stress-related survey (hereinafter also referred to as “a stress subjective evaluation value”), and is stored for each user ID in the storage unit 61. In the stress-related survey, each user answers multiple questions by selecting a degree of stress felt on a five-degree scale.
In
In the TP field, the combined value (hereinafter also referred to as the “TP value”) of the VLF value, the LF value, and the HF value described later is recorded. In the PP field, the pulse wave amplitude (hereinafter also referred to as the “PP value”) (see
The TP value, PP value, PI value, LF value, HF value, and ACC value are calculated by the biological data calculation module 601 on the basis of the acceleration data and the pulse wave data. The TP value, PP value, PI value, LF value, HF value, and ACC value are an example of biological data. Note that the biological data calculation module 601 may also calculate other biological data, such as an LF/HF value.
Performing a spectrum analysis of the time-series data of the pulse interval yields the power spectrum. The LF component domain reflects the activity of the sympathetic nerves and the parasympathetic nerves. The HF component domain reflects the activity of the parasympathetic nerves. The LF/HF value indicates the activity of the sympathetic nerves, and serves as an indicator of stress. The sum of the values VLF+LF+HF indicates the total power of the autonomic nervous system as a whole.
Next, each of the modules 600 to 603 of the control unit 60 will be described.
When the first biological information (for example, acceleration data), the second biological information (for example, pulse data), and the user information 211 are received from the measuring device 2, the reception module 600 generates a biological information ID, records the biological information ID in the biological information ID field of the biological information table 612 corresponding to the user ID included in the user information 211, records the date when the first biological information and the second biological information are received in the measurement date field, records the acceleration data in the first biological information field, and records the pulse data in the second biological information field.
The biological data calculation module 601 calculates biological data such as the TP value, PP value, PI value, LF value, HF value, and ACC value on the basis of the acceleration data and the pulse wave data recorded in the biological information table 612, and records the calculation results in the corresponding fields of the biological information table 612.
The model creation module 602 transmits the stress-related survey to the user terminals 4 of multiple test subjects over the network 5, receives the survey results responding to the survey transmitted from each user terminal 4, and stores the survey results in the storage unit 61 as the stress subjective evaluation data 613. The model creation module 602 performs multiple regression analysis treating the stress subjective evaluation values included in the stress subjective evaluation data 613 as response variables and features as explanatory variables to create the stress estimation model 614. The model creation module 602 stores the created stress estimation model 614 in the storage unit 61.
When creating the stress estimation model 614, the model creation module 602 specifies the following features, for example. The stress estimation model 614 extracts features correlated with the stress subjective evaluation values from among approximately 400 features, and performs multiple regression analysis to specify nine features effective that are effective for estimating stress. The nine specified features are described next. Note that the features used to estimate stress are not limited to the following nine features.
The diurnal difference in the TP value refers to the difference between the maximum value and the minimum value of the TP value in a single day. The TP value expresses the liveliness of the autonomic nervous system, and when a high level of stress is experienced, the autonomic nervous system is exhausted, and the TP value does not take a high value. Exhaustion of the autonomic nervous system on a previous day is not fully recovered, and still remains on the next day. The previous day is one day before the current day. The current day is an example of a day of observation.
The ratio of the PP value exceeding a threshold value refers to the ratio of the number of times that the PP value exceeds a threshold value in a single day. When stress is experienced, the PP value spikes.
(iii) Diurnal Average Crossing Rate of Previous Day TP Value
The diurnal average crossing rate of the TP value refers to the ratio of the TP value intersecting the average value of the TP value in a single day. When a high level of stress is experienced, this indicator indicates a high value.
The diurnal average crossing rate of the TP value has the same meaning as the diurnal average crossing rate of the previous day TP value.
The diurnal coefficient of variation of the current day TP value is an indicator expressed as the standard deviation divided by the average of the TP value. The diurnal coefficient of variation of the TP value increases with lower levels of stress.
The diurnal difference in the TP value has the same meaning as the diurnal difference in the previous day TP value.
(vii) Minimum Current Day LF/HF Value
The LF/HF value is the value obtained by dividing the LF value by the HF value. When stress is experienced, the sympathetic nervous system activates, and the LF/HF value rises.
(viii) Diurnal Difference in ACC Value
The diurnal difference in the ACC value refers to the difference between the maximum value and the minimum value of the peaks in acceleration in a single day. When stress is high, sudden movements occur, and the diurnal difference in the ACC value increases.
The diurnal average crossing rate of the HF value refers to the ratio of the HF value intersecting the average value of the HF value in a single day. The HF value expresses the activity of the parasympathetic nervous system. On a high-stress day, the parasympathetic nervous system is activated and deactivated frequently.
The evaluation value calculation module 603 substitutes the calculated values of the features specified by the model creation module 602 into the stress estimation model 614 created by the model creation module 602, and calculates an evaluation value of the stress of a specific user. In other words, the evaluation value calculation module 603 calculates an evaluation value Estress of the stress accumulated on the current day by using the stress estimation model 614 expressed in the following Formula (1).
E
stress=(previous day stress features)+(current day stress features)−(current day stress recovery feature)+constant (w0)
=(w1x1+w2x2+w3x3)+(w4x4+w5x5+w6x6+w7x7+w8x8)−(w9x9)+(w0) (1)
The previous day stress features are the diurnal difference in the previous day TP value, the diurnal average crossing rate of the previous day TP value, and the ratio of the previous day PP value exceeding the threshold value, for example, and the features are taken to be x1 to x3 with coefficients w1 to w3, respectively.
The current day stress features are the diurnal average crossing rate of the TP value, the diurnal coefficient of variation of the TP value, the diurnal difference in the TP value, the minimum LF/HF value, and the diurnal difference in the ACC value, for example, and the features are taken to be x4 to x8 with coefficients w4 to w8, respectively.
The current day stress recovery feature is the diurnal average crossing rate of the HF value, for example, and is taken to be x9 with a coefficient w9.
(Operations by Information Processing Device)
Next, an example of operations by the information processing device 6 will be described with reference to
(1) Creation of Stress Estimation Model
The reception module 600 receives the acceleration data, the pulse wave data, and the user information 211 from the measuring device 2 worn by each of multiple users (for example, 18 people) treated as test subjects (S1).
Next, the reception module 600 removes the pulse wave data in segments of large body motion from the received pulse wave data on the basis of the acceleration data (S2). For example, the pulse wave data in segments where the acceleration exceeds a threshold may be removed, or user movement patterns may be estimated on the basis of the acceleration data and the pulse wave data in walking and running segments may be removed.
Next, the reception module 600 generates a biological information ID and records the biological information ID, the measurement date, the acceleration data, and the pulse wave data in the biological information table 612 corresponding to the user ID included in the user information 211. In other words, the biological information ID is recorded in the biological information ID field, the date when the biological information is received is recorded in the measurement date field, the acceleration data is recorded in the first biological information field, and the pulse wave data is recorded in the second biological information field of the biological information table 612.
For example, the biological information and the like of multiple test subjects measured on a workday over a certain period (for example, one week, two weeks, or more) is recorded in the biological information table 612. Note that the biological information may also be measured every day, including days off, over a certain period.
The biological data calculation module 601 calculates the pulse wave amplitude (PP value) and the pulse wave interval (PI value) from the pulse wave data (S3), and acquires the peak value (ACC value) of the acceleration from the acceleration data (S4). Also, the biological data calculation module 601 calculates values such as the TP value, LF value, and HF value in addition to the PP value, PI value, and ACC value. The biological data calculation module 601 records the values such as the TP value, PP value, PI value, LF value, HF value, and ACC value in the corresponding fields of the biological information table 612.
The model creation module 602 references the biological information table 612 and calculates the previous day features x1 to x3 and the current day features x4 to x9 from the TP value, PP value, PI value, LF value, HF value, and ACC value (S5).
The model creation module 602 acquires the survey results from the test subjects in response to the stress-related survey, and stores the survey results in the storage unit 61 as the stress subjective evaluation data 613 (S6).
The model creation module 602 performs multiple regression analysis treating the stress subjective evaluation values included in the stress subjective evaluation data 613 as response variables and the features x1 to x9 as well as the constant w0 as explanatory variables to create the stress estimation model 614, and stores the created stress estimation model 614 in the storage unit 61 (S7).
(2) Output of Stress Evaluation Value
The reception module 600 receives the acceleration data, the pulse wave data, and the user information 211 from the measuring device 2 worn by a specific user (S11).
Next, as described earlier, the reception module 600 removes the pulse wave data in segments of large body motion from the received pulse wave data on the basis of the acceleration data (S12).
Next, as described earlier, the reception module 600 generates a biological information ID and records the biological information ID, the measurement date, the acceleration data, and the pulse wave data in the biological information table 612 corresponding to the user ID of the specific user included in the user information 211.
The biological information and the like of the specific user treated as the test subject measured on a workday over a certain period (for example, one week, two weeks, or more) is recorded in the biological information table 612 of the specific user. Note that the biological information may also be measured every day, including days off, over a certain period.
The biological data calculation module 601 calculates the pulse wave amplitude (PP value) and the pulse wave interval (PI value) from the pulse wave data (S13), and acquires the peak value of the acceleration from the acceleration data (S14). Also, as described earlier, the biological data calculation module 601 calculates values such as the TP value, LF value, and HF value in addition to the PP value, PI value, and ACC value. The biological data calculation module 601 records the values such as the TP value, PP value, PI value, LF value, HF value, and ACC value in the corresponding fields of the biological information table 612.
The reception module 600 receives a specific day corresponding to the current day from an administrator or the user terminal 4 of the specific user. The evaluation value calculation module 603 references the biological information table 612 corresponding to the user ID of the specific user, calculates the previous day features x1 to x3 from the previous day TP value, and calculates the current day features x4 to x9 from the current day TP value, LF/HF value, ACC value, and HF value (S15).
The evaluation value calculation module 603 substitutes the features x1 to x9 and the constant value w0 into the stress estimation model 614, and calculates an evaluation value of the stress that the specific user has accumulated on the current day (S16). Note that the stress evaluation value may also be transmitted to an administrator or the user terminal 4 of the specific user.
Model 1 and Model 2 in
(Exemplary Modification 1)
The exemplary embodiment above calculates the stress evaluation value Estress by using Formula (1), but the following formula may also be used.
E
stress=(previous day stress estimation result)+(current day stress features)−(current day stress recovery feature)+constant (w0) (2)
The previous day stress estimation result is obtained by multiplying the previous day stress features (w1x1+w2x2+w3x3) used to calculate the stress evaluation value for the day before the previous day by a coefficient. In the case of using Formula (2), the process of calculating the individual features w1x1, w2x2, and w2x3 may be omitted.
(Exemplary Modification 2)
The exemplary embodiment above calculates the stress evaluation value Estress by using Formula (1), but the following formula may also be used.
E
stress=(stress features up to current day=features from N days ago+features from (N−1) days ago+ . . . previous day features)+(current day stress features)−(current day stress recovery feature)+constant (w0) (3)
In the case of using Formula (3), it is possible to compute a more accurate evaluation value compared to the case of using Formula (1).
(Exemplary Modification 3)
The exemplary embodiment above calculates the stress evaluation value Estress by using Formula (1), but the following formula may also be used.
E
stress=(stress estimation result up to previous day=features from N days ago+features from (N−1) days ago+ . . . previous day features)+(current day stress features)−(current day stress recovery feature)+constant (w0) . . . (4)
The stress estimation result up to the previous day is obtained by multiplying the features (features from N days ago+features from (N−1) days ago+ . . . previous day features) by corresponding coefficients according to the number of days before the current day. In the case of using Formula (4), the process of calculating the individual features from N days ago, from (N−1) days ago, and so on up to the previous day features may be omitted.
(Exemplary Modification 4)
For example, as illustrated in
Also, as illustrated in
Also, as illustrated in
Also, as illustrated in
The above describes an exemplary embodiment of the present disclosure, but an exemplary embodiment of the present disclosure is not limited to the foregoing exemplary embodiment, and various modifications are possible within a scope that does not depart from the gist of the present disclosure. For example, to reduce the load on the information processing device 6, all or part of the biological data or the features calculated on the information processing device 6 side may also be calculated on the measuring device 2 side.
Each module of the processor may also be realized by a hardware circuit such as a field-programmable gate array (FPGA) that is partially or fully reconfigurable, or an application-specific integrated circuit (ASIC).
Furthermore, it is also possible to omit or change some of the structural elements of the foregoing exemplary embodiment, within a scope that does not depart from the gist of the present disclosure. In addition, in the flows of the foregoing exemplary embodiment, steps may be added, removed, changed, rearranged, or the like, within a scope that does not depart from the gist of the present disclosure. Also, a program used by the foregoing exemplary embodiment may be provided by being recorded on a computer-readable recording medium such as a CD-ROM, or may be stored on an external server such as a cloud server and used over a network.
In the embodiment above, the term “processor” refers to hardware in a broad sense. Examples of the processor includes general processors (e.g., CPU: Central Processing Unit), dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiment above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiment above, and may be changed.
The foregoing description of the exemplary embodiment of the present disclosure has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiment was chosen and described in order to best explain the principles of the disclosure and its practical applications, thereby enabling others skilled in the art to understand the disclosure for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the disclosure be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2019-233897 | Dec 2019 | JP | national |