This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2020-158715 filed Sep. 23, 2020.
The present disclosure relates to an information processing apparatus and a non-transitory computer readable medium.
With aging of skilled technicians, a transfer of their skills is an urgent issue. In addition, in order to improve an efficiency of sports practice, it is contemplated to extract characteristics of body movements of athletes. Thus, various methods are tried to analyze body movements of the technicians, the athletes, and the like.
For example, WO 2005/122900 discloses a method and a device that calculate a physically and physiologically appropriate muscle tension based on a musculoskeletal model. JP-A-2003-244027 discloses a muscle activity amount measurement device that estimates a muscle activity amount in a body by such adjustment that a surface myoelectric potential measured by surface electrodes arranged in a ring shape around an approximately cylindrical part of the body matches a surface myoelectric potential simulation value. JP-A-2017-159103 discloses a muscle activity audible method that outputs an acoustic signal representing information obtained from a relationship among plural values derived from plural myoelectric potentials.
It is known that people unconsciously put strength into a body during movements such as various skills and sports. However, it is difficult to measure such unconscious strength directly.
Aspects of non-limiting embodiments of the present disclosure relate to estimating unconscious strength in a movement of a person under measurement based on the movement and a muscle activity state.
Aspects of certain non-limiting embodiments of the present disclosure address the above advantages and/or other advantages not described above. However, aspects of the non-limiting embodiments are not required to address the advantages described above, and aspects of the non-limiting embodiments of the present disclosure may not address advantages described above.
According to an aspect of the present disclosure, there is provided an information processing apparatus including: a preparation device configured to prepare information on a posture of a body; a myoelectric potential meter configured to measure a myoelectric potential from a surface of the body; and a processor configured to acquire the information on the posture prepared by the preparation device, acquire information on the myoelectric potential measured by the myoelectric potential meter, specify a movement of the body based on the acquired information on the posture, estimate a muscle activity state required for a muscle to implement the specified movement, and output information indicating a difference between (i) a muscle activity state determined based on the myoelectric potential and (ii) the estimated muscle activity state.
Exemplary embodiment(s) of the present disclosure will be described in detail based on the following figures, wherein:
The processor 11 controls each unit of the information processing apparatus 1 by reading and executing a program stored in the memory 12. The processor 11 is, for example, a central processing unit (CPU).
The operation unit 14 includes an operation element (such as operation buttons, a keyboard, a mouse, and a touch panel) for giving various instructions. The operation unit 14 receives an operation, and transmits a signal to the processor 11 according to an operation content thereof.
The display 15 displays a designated image under control of the processor 11. The display 15 shown in
The interface 13 connects various devices to the processor 11 and causes the processor 11 to control those devices. The interface 13 shown in
The camera 131 shown in
Here, the “information on a posture” may be a position and an orientation of a head, shoulders, arms, torso, and feet of the person under measurement. The camera 131 is a video camera that periodically captures the body B. In this case, the processor 11 specifies a change in the posture of the body B from plural images captured periodically. That is, the camera 131 is an example of a preparation device that prepares information on the posture of the body B by capturing an appearance of the body B and generating image data indicating the appearance of the body B.
The camera 131 is not limited to the digital still camera as long as the camera 131 is a device that prepares the information on the posture of the body B. For example, the preparation device may be a contact type micro electro mechanical systems (MEMS) sensor or the like instead of the camera 131. In this case, the contact type MEMS sensors are attached to plural parts that do not affect the work on the body B of the person under measurement, and acceleration or the like of those parts is measured. Then, this contact type MEMS sensor may supply information such as the measured acceleration to the processor 11 as the “information on a posture”.
The myoelectric potential meters 132 shown in
The memory 12 shown in
The bone model table 1211 is a table that describes information on the bones of the human body. The bone model table 1211 shown in
The muscle model table 1212 is a table that describes information on the muscles of the human body. The muscle model table 1212 shown in
The user table 1213 is a table that describes information on bones and muscles unique to each user who is the person under measurement. The user table 1213 shown in
The parameters may include, for example, a factor by which the shape data of the bone is multiplied to calculate a size of the bone of an individual user. Further, the parameters may include, for example, a maximum value of a tension (referred to as a “muscle tension”) output by the muscle of the individual user.
The parameters may be numerical values, nominal scales, or the like that indirectly indicate the information on the bones and the muscles of the user. For example, the parameters may include information such as a gender, an age, and genetic characteristics of the user. The information processing apparatus 1 specifies, for example, (i) characteristics such as laterality and strain of the bones and the muscles of the user and (ii) an ability such as an instantaneous force and endurance, with reference to the user table 1213, the bone model table 1211, and the muscle model table 1212 described above.
The movement ID list 1221 lists movement IDs which are identification information for identifying movements performed by the person under measurement. Each bone movement table 1222 is stored in association with a corresponding one of the movement IDs included in the movement ID list 1221.
The bone movement table 1222 is a table that stores one or more bones moved by a movement identified by the corresponding movement ID and information on a movement of each bone when the bone moves. In the bone movement table 1222, the bone IDs are identification information common to the bone IDs in the above musculoskeletal model DB 121, and identify the bones of the human body.
Translational movement information is information on a translational movement applied to the bone identified by the corresponding bone ID. The translational movement is indicated in a combination of an x-axis direction, a y-axis direction, and a z-axis direction. Rotational moment information is information on a rotational moment applied to the bone identified by the corresponding bone ID. The rotational moment is indicated in a combination of a yaw, a pitch, and a roll.
Load information is information on a load exerted on the bone identified by the corresponding bone ID. The load may include gravity derived from a mass of the bone itself. Further, for example, when the person under measurement holds an object such as a dumbbell, a racket, or a bat by hands in the above movement, the load may include gravity derived from a mass of such an object.
For example, when the movement ID indicating the movement performed by the person under measurement is designated, the information processing apparatus 1 extracts the bone movement table 1222 corresponding to the movement ID with reference to the movement DB 122. The information processing apparatus 1 specifies shapes and masses of the bones identified by the bone IDs described in the extracted bone movement table 1222, and masses of the muscles that adhere to and move the bones. Then, the information processing apparatus 1 refers to the above musculoskeletal model DB 121 and calculates the muscle tensions generated in the muscles when these bones perform the movement indicated by the translational movement information and the rotational moment information while the load indicated by the load information exerts on the bones.
There may be many combinations of muscle tensions that muscles needs to produce in order to achieve a movement.
When the muscle M1 contracts and the muscle M2 relaxes, the bone B2 moves from a position P1 to a position P2 (this movement will be referred to as a “movement W1”). This movement W1 is implemented, for example, by an action of a force of 7 Newtons in an arrow direction shown in
The information processing apparatus 1 calculates a minimum muscle tension that needs to be applied to those bones based on the movements of the bones that constitute the movement. For example, in the example shown in
The user ID list 1231 lists user IDs. The user IDs listed in the user ID list 1231 are identification information common to the user IDs in the musculoskeletal model DB 121 described above, and identify the user who is the person under measurement. Each relationship table 1232 is stored in association with a respective one of the user IDs included in the user ID list 1231.
The relationship table 1232 is a table that stores, for each muscle of the user identified by the corresponding user ID, information showing a relationship between the myoelectric potential generated in the muscle and the muscle tension exerted by the muscle when the myoelectric potential is generated. The muscle IDs in the relationship table 1232 are identification information common to the muscle IDs in the musculoskeletal model DB 121 described above, and identify the muscles of the body of the person under measurement.
Information on a relationship between a myoelectric potential and a muscle tension in the relationship table 1232 is stored in association with the muscle ID, and includes data showing the relationship between the myoelectric potential and the muscle tension which are generated in the muscle identified by the muscle ID.
That is, the information on the relationship between the myoelectric potential and the muscle tension may be a set including (i) a measured value of the myoelectric potential generated in the muscle and (ii) a measured value of the muscle tension exerted by the muscle when the myoelectric potential is generated. Alternatively, the information on the relationship between the myoelectric potential and the muscle tension may be a calibration curve specified from the set of these measured values. The information processing apparatus 1 specifies, for each user and each muscle, the relationship between the myoelectric potential and the muscle tension in the muscle with reference to the relationship table 1232 of the myoelectric potential DB 123, and for example, calculates the myoelectric potential corresponding to the muscle tension.
The first acquiring unit 111 acquires the information on the posture of the body B prepared by the camera 131 which is the example of the preparation device. The information acquired by the first acquiring unit 111 is, for example, image data indicating images periodically captured by the camera 131.
The second acquiring unit 112 acquires information on the myoelectric potentials measured by the myoelectric potential meter 132.
The specifying unit 113 specifies the movement of the body based on the information on the posture acquired by the first acquiring unit 111.
The estimation unit 114 estimates a minimum activity state required for a muscle to implement the movement of the body specified by the specifying unit 113. The estimation is performed by referring to the musculoskeletal model DB 121, the movement DB 122, and the myoelectric potential DB 123 stored in the memory 12.
The calculator 115 calculates a numerical value indicating a difference between (i) the muscle activity state determined based on the information on the myoelectric potentials acquired by the second acquiring unit 112 and (ii) the minimum activity state of the muscle estimated by the estimation unit 114. The muscle activity state determined based on the information on the myoelectric potentials may be the muscle tension or the myoelectric potential itself. The “numerical value indicating the difference” calculated by the calculator 115 is an example of information indicating the difference.
The output unit 116 outputs the numerical value indicating the difference calculated by the calculator 115 by displaying the numerical value on the display 15.
After specifying the movement performed by the person under measurement, the processor 11 estimates the minimum activity state required for the muscle to implement the movement (step S103).
The processor 11 acquires measured values of the myoelectric potentials from the myoelectric potential meter 132 via the interface 13 (step S104). Then, the processor 11 calculates the muscle activity state of the person under measurement based on the acquired measured values of the myoelectric potentials (step S105).
The processor 11 calculates the difference between the muscle activity state calculated in step S105 and the minimum activity state of the muscle estimated in step S103 (step S106) and outputs the difference (step S107).
For example, the movement W1 is a movement in which a person under measurement in a standing posture holds an object having a predetermined mass with a hand, moves the forearm without moving the humerus, and lifts the object to a height of the elbow. For example, the movement W2 is a movement in which the person under measurement is stationary while holding the object at the height of the elbow. For example, the movement W3 is a movement in which the person under measurement extends the forearm and lowers the object grasped by the hand downward. The hand is an end portion of the forearm.
A curve A0 is a curve showing the change with time of the estimated value of the minimum activity amount required for the muscle of the person under measurement to implement the above series of movements. The processor 11 of the information processing apparatus 1 reads the information on the bones and the muscles unique to the person under measurement from the musculoskeletal model DB 121, and constructs a physical model thereof. Then, the processor 11 analyzes the image data acquired from the camera 131 to specify the series of movements of the person under measurement, and analyzes the movements to calculate a direction and a magnitude of a minimum force required to implement this movement.
The processor 11 assigns the calculated direction and the magnitude of the force to each muscle of the person under measurement, and estimates the minimum activity amount required for each muscle. This activity amount may be, for example, the myoelectric potential representing one muscle or the muscle tension generated by the muscle.
A curve A1 is a curve showing the change with time of the activity amount of the muscle of the person under measurement, which is calculated from the measured values such as the myoelectric potentials measured when the series of movements are actually performed. The person under measurement at this time is a skilled worker in this movement.
The processor 11 of the information processing apparatus 1 acquires the information on the myoelectric potentials of the person under measurement from the myoelectric potential meter 132 via the interface 13. Then, the processor 11 calculates the activity amount of the muscle of the person under measurement based on the acquired information on the myoelectric potentials.
At this time, as shown in
Here, the activity amount may be the myoelectric potential itself. In this case, the processor 11 of the information processing apparatus 1 is an example of a processor configured to estimate a myoelectric potential required for the muscle to implement the movement, and display, in a graph form, a change with time of a difference between (i) the myoelectric potential acquired from the myoelectric potential meter 132 and (ii) the estimated myoelectric potential.
In general, “unconscious strength” reduces a speed of a movement, limits a range of motion, and therefore the “unconscious strength” is an inhibition factor of the movement thereof. However, the “unconscious strength” is also an element necessary to control the body and perform the movement thereof accurately. Therefore, skilled movements are often characterized by a timing, a magnitude, or the like of the “unconscious strength”.
From the displayed difference D1 shown in
The information processing apparatus 1 may display the activity amount difference in the movement of the skilled worker and the activity amount difference in the movement of the beginner, and allow the user who is the beginner to compare. The information processing apparatus 1 may also calculate and display a difference between the activity amount in the movement of the skilled worker and the activity amount in the movement of the beginner.
The processor 11 determines whether a predetermined end condition is satisfied, for example, the operation unit 14 receives an end instruction from the user (step S108). When the processor 11 determines that the end condition is not satisfied (step S108, NO), the processor 11 returns the processing to step S101. On the other hand, when the processor 11 determines that the end condition is satisfied (step S108, YES), the processor 11 ends the processing.
By the operation, the information processing apparatus 1 estimates and outputs the unconscious strength in the movement of the person under measurement based on the movement and the muscle activity state. Therefore, the user of the information processing apparatus 1 knows an unconscious strength component in the movement of the person under measurement by distinguishing the unconscious strength from a minimum muscle tension required for the movement.
The above is the description of the exemplary embodiment, and this exemplary embodiment may be modified as follows. In addition, the following modifications may be combined with each other.
<1>
In the above exemplary embodiment, the information processing apparatus 1 includes the processor 11 configured with the CPU. Alternatively, a controller that controls the information processing apparatus 1 may have another configuration. For example, the information processing apparatus 1 may include various processors or the like in addition to the CPU.
In the embodiments above, the term “processor” refers to hardware in a broad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
<2>
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively.
The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
<3>
In the above exemplary embodiment, the processor 11 displays, in the graph form, the change with time of the difference between the acquired myoelectric potential and the estimated myoelectric potential. Alternatively, the processor 11 may output a timing at which this difference satisfies a predetermined condition. For example, when obtaining the change with time of the activity amount difference shown in
<4>
In the above exemplary embodiment, the information processing apparatus 1 includes the display 15 that displays information indicating the difference between (i) the muscle activity state determined based on the myoelectric potentials and (ii) the estimated muscle activity state, to the user. Alternatively, the information processing apparatus 1 may include another output device. For example, the information processing apparatus 1 may include an output device that is attached to a part of the body of the user and that stimulates the part of the body.
In this case, when the processor 11 of the information processing apparatus 1 calculates the above difference, the processor 11 may control this output device and stimulate a part corresponding to a muscle related to this difference with a strength corresponding to the magnitude of this difference. In this case, the processor 11 is an example of a processor configured to, when generating the information indicating the difference between (i) the muscle activity state determined based on the myoelectric potentials on the user and (ii) the estimated muscle activity state, control an output device to stimulate a part corresponding to the muscle with a strength corresponding to a magnitude of the difference indicated by the generated information.
With this configuration, the body of the user is stimulated using the data obtained by measuring the skilled worker, so that the user can know (i) the part into which the skilled worker puts strength in the movement, (ii) the magnitude of the strength, and (iii) the timing at which the skilled worker puts the strength.
<5>
In the above exemplary embodiment, the information processing apparatus 1 includes the interface 13, and the camera 131 and the myoelectric potential meter 132 which are connected via the interface 13. The information processing apparatus 1 may not include these devices. In this case, these devices may be communicably connected to the information processing apparatus 1 via the interface 13 as external devices of the information processing apparatus 1.
That is, the processor 11 of the information processing apparatus 1 is an example of a processor provided in an information processing apparatus, the processor being configured to acquire information on a posture of a body, acquires information on a myoelectric potential on a surface of the body, specify a movement of the body based on the acquired information on the posture, estimate a muscle activity state required for a muscle to implement the specified movement, and output information indicating a difference between (i) a muscle activity state determined based on the myoelectric potential and (ii) the estimated muscle activity state.
<6>
In the above exemplary embodiment, the program executed by the processor 11 of the information processing apparatus 1 is an example of a program that causes a computer including a processor to execute: acquiring the information on a posture of a body; acquiring information on a myoelectric potential measured from a surface of the body; specifying a movement of the body based on the acquired information on the posture; estimating a muscle activity state required for a muscle to implement the specified movement; and outputting information indicating a difference between (i) a muscle activity state determined based on the myoelectric potential and (ii) the estimated muscle activity state.
This program may be provided in a state of being stored in a computer readable recording medium, such as a magnetic recording medium (for example, a magnetic tape and a magnetic disk), an optical recording medium (for example, an optical disc), an magneto-optical recording medium, and a semiconductor memory. Further, the program may be downloaded via a communication line such as the Internet.
The foregoing description of the exemplary embodiments of the present disclosure has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical applications, thereby enabling others skilled in the art to understand the disclosure for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the disclosure be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2020-158715 | Sep 2020 | JP | national |