Patent Application
20170061818
The disclosure of Japanese Patent Application No. 2015-165435 filed on Aug. 25, 2015 including the specification, drawings and abstract is incorporated herein by reference in its entirety.
The present invention relates to a skill teaching verification system and a skill teaching verification program, and relates to, for example, a technique used when trying a teaching method for various skills represented by sports.
For example, Japan Patent No. 5300426 discloses a guidance system for physical checkups. The technique provides a system in which data obtained by associating results of physical checkups of a plurality of patients with effective guidance given by a doctor is prepared and effective health guidance in the past is output when the result of physical checkups of a desired patient is input.
Further, “Motion synthesizer of pitching motion: utilization of statistical model aimed at disability prevention, written by Takeo Ishii, Journal of the Society of Biomechanisms, Vol. 39, No. 1, pp. 5-10, 2015” discloses an advice system targeting sports. In the system, attempt results of a plurality of (baseball) pitchers are obtained by motion capture in advance, and a motion as a main factor of the attempt results (ball speeds, control, lesions, and the like) is obtained by a principal component analysis. In addition, when a user inputs the motion data of the user obtained by the motion capture and a desired performance into the system, the system obtains an ideal motion for achieving the desired performance, and presents the same to the user.
For example, the technique disclosed in Japan Patent No. 5300426 is a technique in which one of effective guidance methods patterned with a certain degree is extracted from past achievements of a database. In the medical industry, in particular, a clinical trial is necessary when giving new medical guidance. Thus, the technique cannot be sufficiently utilized in some cases in a situation where a new guidance method with no past achievements is tried. On the other hand, there are many situations in which a new teaching method is tried in skill teaching, and a technique that can be utilized in the situations has been required.
Further, the technique disclosed in “Motion synthesizer of pitching motion: utilization of statistical model aimed at disability prevention, written by Takeo Ishii, Journal of the Society of Biomechanisms, Vol. 39, No. 1, pp. 5-10, 2015” is a technique useful when limited subjects with a clear goal (for example, increasing a ball speed) who can use the motion capture and the like receive teaching. However, in a situation where an instructor of the skill teaching tries a teaching method, there is a case that the technique cannot be sufficiently utilized. Further, a motion of a subject and a desired performance are input and an ideal motion is output in the technique. Therefore, there is a case that the user cannot clearly understand any points for improvement in the current motion even when viewing an ideal motion.
Embodiments to be described later have been achieved in view of the foregoing, and the other objects and novel features will become apparent from the description of the specification and accompanying drawings.
A skill teaching verification system according to an embodiment includes a storing unit, an analyzing unit, a motion template generation unit, a motion synthesizing unit, and a verification unit. The storing unit stores a plurality of pieces of sample data including a combination of data representing an actual human body motion in association with a predetermined skill and data of an attempt result obtained from the human body motion. The analyzing unit analyzes the pieces of sample data using a predetermined multivariate analyzing method. The motion template generation unit generates a standard human body motion model on the basis of an analysis result by the analyzing unit. The motion synthesizing unit generates a corrected human body motion model obtained by correcting the standard human body motion model on the basis of an instruction of a user. The verification unit predicts an attempt result obtained from the corrected human body motion model on the basis of the analysis result by the analyzing unit.
According to the embodiment, it is possible to provide a skill teaching verification system and a skill teaching verification program that can verify an effect of a teaching method for a skill.
The present invention will be described using the following embodiments while being divided into a plurality of sections or embodiments if necessary for convenience sake. However, except for a case especially specified, the sections or embodiments are not irrelevant to each other, and one has a relationship as a part of a modified example or a complete modified example, or a detailed or supplementary explanation of the other. Further, if the specification refers to the number of elements (including the number of pieces, values, amounts, ranges, and the like) in the following embodiments, the present invention is not limited to the specific number, but may be smaller or larger than the specific number, except for a case especially specified or a case obviously limited to the specific number in principle.
Furthermore, it is obvious that the components (including elemental steps and the like) are not necessarily essential in the following embodiments, except for a case especially specified or a case obviously deemed to be essential in principle. Likewise, if the specification refers to the shapes or positional relationships of components in the following embodiments, the present invention includes those that are substantially close or similar to the components in shapes and the like, except for a case especially specified or a case obviously deemed not to be close or similar in principle. The same applies to the values and ranges.
Hereinafter, embodiments of the present invention will be described in detail on the basis of the drawings. It should be noted that the same members are given the same reference numerals in principle in the all drawings for explaining the embodiments, and the explanations thereof will be omitted.
In
Next, the user USR inputs the teaching method the user thought of into the skill teaching verification system SYS. For example, the user USR inputs a teaching method such as changing the angle of the elbow at a certain point into the angle desired by the user. In response to this, the skill teaching verification system SYS verifies an effect obtained by the teaching method on the basis of the sample DB, and presents the same to the user USR. For example, in the case where a desired effect cannot be obtained, the user USR thinks of another teaching method. As described above, the skill teaching verification system SYS is a system that verifies an effect of a teaching method for a skill, and the user USR can seek an effective teaching method by using the skill teaching verification system SYS.
For example, as one of media through which many and unspecified users provide content, media called CGM (Consumer Generated Media) have been widely spread. In particular, many and unspecified users propose various teaching methods through such media, and it has been difficult from the past to objectively verify the benefit of each teaching method. Using the skill teaching verification system SYS of the first embodiment, for example, a mechanism of verifying the benefit of a teaching method can be provided to such many and unspecified users.
The pieces of sample data SP are obtained by a sample obtaining unit SPA. The sample obtaining unit SPA obtains actual human body motion data in association with a predetermined skill (a pitching motion in this case) using existing various methods. As a concrete method of obtaining the human body motion data, there is, for example, a method using optical motion capture, or a method using a dynamic sensor using an infrared ray pattern or ToF (Time of Flight). Alternatively, a method in which an inertial sensor (an accelerating sensor or a gyro sensor) is attached to the body of a subject to obtain motion data may be used. Alternatively, data obtained by quantifying, using computer software or the like, motion trajectories of video data taken by a high-speed camera or a video camera may be used.
Further, the sample obtaining unit SPA obtains attempt result data that can be obtained from each human body motion data using existing various methods. The attempt result data is, for example, ball speed data, rotation speed data, lesion data, and the like. In addition, the attempt result data may be data such as a strikeout average or an opponents batting average. As a concrete method of obtaining the attempt result data, there is, for example, a method using a speed gun or a ball incorporating an inertial sensor (an accelerating sensor or a gyro sensor). Alternatively, the result may be extracted from moving images taken by a high-speed camera or a video camera. Alternatively, a user who attempted may manually input the attempt result. The lesion data may be obtained by a method using, for example, clinical data of a subject measured with medical equipment such as MRI (Magnetic Resonance Imaging) or diagnostic data containing opinions of a doctor.
The analyzing unit ANA analyzes the pieces of sample data stored in the first storing unit MEM1 using a predetermined multivariate analyzing method. As a representative multivariate analyzing method, there is a principal component analysis, a multiple regression analysis, a factor analysis, or a cluster analysis. As an example in the specification, an outline operation of the principal component analysis as shown in “Motion synthesizer of pitching motion: utilization of statistical model aimed at disability prevention, written by Takeo Ishii, Journal of the Society of Biomechanisms, Vol. 39, No. 1, pp. 5-10, 2015” will be described.
As described above, the pitching motion data Spa is configured using, for example, thousands of parameters in accordance with the pitch width of time and the number of joints at each time. On the other hand, attempt result data SPb is configured using a few to tens of parameters such as, for example, a ball speed Xu, a rotation speed Xv, a lesion Xw, and the like. A series of pitching motion and the attempt result in association with the pitching motion are defined by one operating point on the real axis using the parameters configuring the pitching motion data Spa and the parameters configuring the attempt result data SPb.
The analyzing unit ANA conducts the principal component analysis for the pieces of sample data SP1, SP2, and the like containing such parameters, and calculates, for example, principal component information PCIM, correlation information CCIM, and the like. Specifically, the analyzing unit ANA calculates unique vectors (ai, aj, and the like) associating the parameters (Xi, Xj, and the like) of each sample data with a first principal component PC1 as the principal component information PCIM. Likewise, the analyzing unit ANA calculates unique vectors associating the parameters of each sample data with each of second to x-th principal components as the principal component information PCIM.
Further, the analyzing unit ANA calculates a correlation (specifically, a correlation coefficient) between each of first to x-th principal components PC1 to PCx and each parameter (a ball speed Xu, a rotation speed Xv, a lesion Xw, and the like) of the attempt result data SPb as the correlation information CCIM. Accordingly, the principal component highly correlated with each parameter of the attempt result data SPb can be clarified. It should be noted that the number of parameters of the sample data (in other words, the real axis) can reach thousands of pieces as described above. However, if the principal component analysis is conducted, the number (x) of parameters of the principal component (in other words, the principal component axis) can be compressed to, for example, tens of parameters in accordance with the contribution ratio.
In
The input unit INU provides an interface that allows a user to input a teaching method for the motion template. As a concrete input method, there is, for example, a method in which the motion of the motion template is displayed on a PC (Personal Computer), a smartphone, a tablet device, or the like using software such as 3D-CAD, and the user operates on the software (for example, the user changes the angle of the elbow in the example of
The motion synthesizing unit SYN generates a corrected human body motion model obtained by correcting the motion template (standard human body motion model) on the basis of an instruction of the user input through the input unit INU. The verification unit SIM expects an attempt result to be obtained from the corrected human body motion model generated by the motion synthesizing unit SYN on the basis of the analysis result by the analyzing unit ANA. In addition, the verification unit SIM outputs the expected attempt result (namely, the presence or absence of the effect of improvement by the input teaching method) to the output unit OTU.
It should be noted that the output unit OUT in the skill teaching verification system SYS1 of
Namely, the skill teaching verification system SYS1 of
However, there is such a case in a realistic motion of a human body that if the angle Xi of the joint A is corrected, the angle of another joint C is changed in conjunction with the correction of the joint A at the same time, and further the angles of the joints A and C are changed before and after the time. Accordingly, it is difficult in some cases to actually execute the motion obtained as a result of operating the parameter values on the rea axis.
On the other hand, each principal component can be regarded as a meaning of a series of motion patterns obtained by combining the angles of the joints in conjunction with each other to time-series changes, and the principal components can be regarded as a meaning of motion patterns having no correlation with each other. Accordingly, for example, in the case where the parameter values (namely, principal component scores) are moved on the principal component axis, the motion corresponding to the parameter values can be regarded as an actually-executable motion if the parameter values fall within a predetermined range. The predetermined range can be set as, for example, a range between the minimum value and the maximum value of the principal component scores. However, when the standard deviation of the principal component scores is σ, −2σ to +2σ or −1σ to +1σ is desirable in an actual case.
In view of the foregoing, the verification unit SIM performs the following outline processes. Namely, the verification unit SIM generates a human body motion model for verification (referred to as a motion model for verification in the specification) for each parameter value while changing the parameter values on the principal component axis, and searches for the motion model for verification whose motion trajectories are closest to the corrected motion model. Namely, the verification unit SIM searches for the motion model for verification on the principal component axis that is closest to the corrected motion model and can be possibly executed in an actual case. Each principal component axis is associated with the attempt result on the basis of the correlation information CCIM of
More specifically, as shown in
The verification unit SIM calculates a difference d of the motion trajectories between the corrected motion model and the motion model for verification every time the motion model for verification is generated (Step S104), and searches for the dimension (n) of the principal component having the smallest difference d and the parameter value (k) of the n-th principal component in the process (Steps S105 and S106). On the basis of the search result, the verification unit SIM generates a minimum error model in which the parameter value of the n-th principal component is set to k (Step S111), and displays the attempt result (specifically, for example, a difference from an average attempt result) by the minimum error model on the output unit OTU (Step S112).
It should be noted that the process of Step S104 is performed by, for example, an image analysis. Further, jmin and jmax are, as described above, the minimum value and the maximum value of the corresponding principal component scores, or −2σ and +2σ or −1σ and +1σ of the corresponding principal component scores, respectively. As Δj is smaller, the search accuracy is enhanced. On the other hand, as Δj is smaller, the processing load is increased. Thus, it is necessary to appropriately set Δj in consideration of the balance.
The sample data obtained by the sample obtaining units SPA is sequentially accumulated into the first storing unit (sample DB) MEM1 of the server device SV. The analyzing unit ANA of the skill teaching verification system SYS1 conducts the principal component analysis for the sequentially-accumulated sample data. On the other hand, many and unspecified users access the server device SV through the user terminal devices TM, and use the skill teaching verification system SYS1 through the user interface UIF of the server device SV.
A user x of the skill teaching verification system SYS′ inputs a target attempt result through an input unit INU′ together with sample data (pitching motion data) SPx of the user. For example, the motion synthesizing unit SYN′ converts the input sample data SPx into parameter values on the principal component axis using unique vectors obtained by an analyzing unit ANA, moves the parameter values on the principal component axis on the basis of the target attempt result, and outputs the motion obtained as a result to an output unit OTU′ as an ideal motion.
However, in a situation where instructors (for example, many and unspecified users) of skill teaching try a teaching method, it is not easy to utilize such a skill teaching verification system SYS′ as described above. Specifically, it is difficult to verify the effect of the teaching method for the skill. Further, when the parameter values are moved on the principal component axis, many parameter values can be changed on the real axis. Therefore, there is a case that the user cannot clearly understand any points for improvement in the current motion even when viewing an ideal motion.
On the other hand, if the method of the first embodiment is used, it is possible to verify the effect of the teaching method for the skill. Accordingly, the instructors (many and unspecified users) of skill teaching can try an effective teaching method. In this case, the user inputs the parameter values not on the principal component axis but on the real axis.
Thus, for example, it is possible to verify the effect of the teaching method while paying attention to only a part of the body. Namely, it is possible to provide a user-friendly (in other words, improved convenience) system to the user.
Accordingly, human body model data on the basis of the inverse kinematics is stored in the third storing unit MEM3 in advance. To a correction on the basis of a teaching method (in other words, an instruction of a user) in a motion synthesizing unit SYN, the inverse kinematics calculation unit IVCAL further adds a correction in conjunction with the correction on the basis of the inverse kinematics to generate a corrected motion model. Here, in response to motion trajectories generated by the motion synthesizing unit SYN, the inverse kinematics calculation unit IVCAL further calculates motion trajectories other than a region corrected by the teaching method on the basis of the human body model data stored in the third storing unit MEM3. In response to the corrected motion model generated by the inverse kinematics calculation unit IVCAL, a verification unit SIM performs the process of
In addition to various effects described in the first embodiment, the effect of improvement by the teaching method can be further verified on the basis of the corrected motion model closer to an actual motion by using the skill teaching verification system of the second embodiment. Thus, the effect of improvement by the teaching method can be more accurately verified. Further, side effects and the like caused by the teaching method can be presented in some cases on the basis of a difference between the effect of improvement by the corrected motion model from the motion synthesizing unit SYN and the effect of improvement by the corrected motion model from the inverse kinematics calculation unit IVCAL.
However, for example, in the case where the skill level of each subject that is a base of the sample data is relatively high when the sample data is accumulated in the first storing unit MEM1, it is possibly difficult to visibly find an improvement in the motion of the average motion model. Namely, the skill teaching verification system according to the embodiment is a system that can be used by not only professional instructors, but also many and unspecified users. Accordingly, it is desirable in some cases to provide a motion template with which a teaching method can be easily tried from the viewpoints of many and unspecified users.
Accordingly, for example, the user designates a site on the human body motion of interest of the user in advance, so that the motion template generation unit TMPG generates, in addition to the average motion model, a characteristic human body motion model in which the site is characteristically moved as shown in
Next, the motion template generation unit TMPG generates the motion trajectories in which the parameter value of the n-th principal component is set to the lowest performance (namely, the worst attempt result) in the average motion model (Step S204). Specifically, the motion template generation unit TMPG can determine, on the basis of the correlation information CCIM of
Next, the motion template generation unit TMPG calculates a difference d related to the point of interest designated in Step S201 between the motion trajectories of the average motion model generated in Step S203 and the motion trajectories generated in Step S204 (Step S205). The difference d is calculated by, for example, an image analysis. The motion template generation unit TMPG performs the processes of Steps S204 and S205 every time the dimension (n) of the principal component is changed in the range of 1 to the maximum value (PC1 to PCx in the example of
In addition, the motion template generation unit TMPG generates a motion model (motion template) in which the parameter value of the m-th principal component as the search result is set to the values of the lowest performance, and the parameter values of the other principal components are set to the values of the highest performance (Step S210). Roughly speaking, the motion template generation unit TMPG searches for the principal component having the highest correlation with the point of interest (namely, the site on the human body motion on the basis of the instruction of the user), sets the parameter value of the principal component as the search result to the parameter value leading to the worst attempt result, and sets the parameter values of the other principal components to the parameter values leading to the best attempt result. Accordingly, the motion template generation unit TMPG generates the motion template.
The following effects in addition to various effects described in the first embodiment can be further obtained by using the skill teaching verification system of the third embodiment. First, a motion template with which a teaching method can be more easily tried or a motion template with which an effect by the teaching method of the user can be more easily obtained can be provided to the user. Further, it is possible to verify a teaching method using a standard motion model having various characteristics (in other words, assuming various people to be taught). As a result, the convenience of the user can be further improved.
For example, in the case where the parameter values of the other principal components are set to the highest performance as in Step S210, the following problem possibly arises. Namely, the levels of the “performance” for each principal component contradict each other depending on the type of performance in some cases. For example, in the case where a ball speed in the pitching motion and a lesion are set as the “performance”, when the parameter value of a principal component is the maximum value, the ball speed becomes the highest performance, but the lesion becomes the lowest performance in some cases.
In this case, it is necessary to allow the user to sequentially select whether the highest performance of a principal component is set on the basis of the ball speed (in this case, the parameter value becomes the maximum value) or the lesion (in this case, the parameter value becomes the minimum value). On the other hand, using the method of the fourth embodiment, various effects as described in the third embodiment can be obtained by setting the parameter values other than the point of interest to an average value without causing such a problem.
Specifically, as shown in
There are various concrete determination methods. For example, the determination unit JGE converts the parameter value on the real axis corresponding to the corrected motion model to the parameter value of the principal component on the basis of the principal component information PCIM of
When it is determined that the motion trajectories of the corrected motion model are out of range of the sample DB, the determination unit JGE outputs a message to prompt re-input of the teaching method or an alert message notifying out of range of the sample DB to the output unit OTU (Step S405). In response to this, for example, the user re-inputs the teaching method through the input unit INU.
For example, the skill teaching verification system shown in the first or second embodiment verifies the effect of improvement by the teaching method by generating the minimum error model in the process of
The invention achieved by the inventors has been described above in detail on the basis of the embodiments. However, the present invention is not limited to the above-described embodiments, but can be variously changed without departing from the scope of the invention. For example, the above-described embodiments have been described in detail to understandably explain the present invention, and are not necessarily limited to those having the all configurations described above. Further, a part of the configuration in one embodiment can be replaced by a configuration of another embodiment, and the configuration in one embodiment can be added to another embodiment. In addition, a part of the configuration in each embodiment can be added to or replaced by another, or deleted.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015-165435 | Aug 2015 | JP | national |
