The present disclosure relates to an estimating device, an estimating method, an estimating program, and a learning model generating device.
Conventionally, changes in shape arising at an object are detected, and the state of a person or a thing that imparts deformation to the object is estimated by using the results of detection. In an aspect in which changes in shape arising at an object are detected, it is difficult to detect deformation of the object without obstructing the deformation. Further, because it is difficult to use strain sensors, which are used in detecting deformation of rigid bodies made of metal or the like, in products, a special detecting device is needed in order to detect deformation of an object. For example, there is known a technique in which displacement and vibrations of an object are measured by using a camera, images of the deformation are acquired, and the deformation amount is extracted therefrom (see, for example, International Publication No. 2017/029905). Further, techniques relating to flexible touch sensors that estimate the amount of deformation from the amount of transmitted light also are known (see, for example, Japanese Patent Application Laid-Open (JP-A) No. 2013-101096).
However, in an aspect in which changes in shape that arise at a target object, which is an object or the like, are detected, if the deformation amount such as the displacement or the like of the target object is detected by using a camera and an image analysis method, the system that includes the camera and the image analysis and the like becomes a large-scale system, which leads to an increase in the size of the device and therefore is not preferable. Further, on the other hand, at target objects that are objects and are formed of a flexible material that is flexible and at which deformation and post-deformation restoration are possible, the flexibility/repulsion force/restoring force deteriorate due to changes over time and the like. However, the evaluation of flexibility depends on the subjectivity of the inspector that is due to the feel, such as the softness and the hardness and the like, at the time when the target object is deformed, and is insufficient for identifying the flexibility of a target object. Accordingly, the time of identifying a deteriorated state in which, for example, the softness of the target object becomes harder than the initial softness and the flexibility decreases due to changes over time or the like, is unclear. Accordingly, there is room for improvement in identifying the deteriorated state of a target object.
An object of the present disclosure is to provide an estimating device, an estimating method, an estimating program, and a learning model generating device that can estimate the deteriorated state of a target object that has a flexible material that is electrically-conductive, by using electrical characteristics of the target object and without using a special detecting device.
An estimating device relating to a technique of the present disclosure comprises: a detecting section detecting electrical characteristics between a plurality of predetermined detection points at a flexible material, which is electrically conductive and which has electrical characteristics that vary in accordance with deformation, of a target object that has the flexible material; and an estimating section that inputs time-series electrical characteristics, which were detected by the detecting section, of an object of estimation to a learning model that is trained by using, as learning data, time-series electrical characteristics that vary in accordance with deformation of the flexible material, and deteriorated state information expressing a deteriorated state relating to deformation of the flexible material, such that the time-series electrical characteristics are inputs of the learning model and the learning model outputs the deteriorated state information, and the estimating section estimates deteriorated state information expressing a deteriorated state corresponding to inputted time-series electrical characteristics.
Embodiments that realize the technique of the present disclosure are described in detail hereinafter with reference to the drawings. Note that structural elements and processings whose operations and functions have the same workings are denoted by the same reference numerals throughout all of the drawings, and repeat description may be omitted as appropriate. Further, the present disclosure is not limited in any way to the following embodiments, and can be implemented by appropriate changes being made thereto within the scope of the object of the present disclosure.
Note that a figure in the present disclosure is a concept including at least one of a human body and an object that can apply a stimulus by a physical amount to a target object. In the following explanation, description will be given by collectively calling the concept, which includes humans and things, a figure without differentiating between at least one of a human body and an object. Namely, respective human bodies and objects themselves, and combined structures in which human bodies and objects are combined, are collectively called figures.
First, a flexible material, which applies the technique of the present disclosure and to which electrical conductivity is imparted, and state estimating processing that, by using the flexible material, estimates a state of an applying side with respect to the flexible material, are described with reference to
The “flexible material” in the present disclosure is a concept that includes materials at which at least a portion thereof can deform such as bend or the like, and includes flexible elastic bodies such as rubber materials or the like, structures having a skeleton that is least one of fiber-like and mesh-like, and structures in whose interior plural, minute air bubbles are scattered. Polymer materials such as urethane and the like are examples of these structures. Further, in the present disclosure, a flexible material to which electrical conductivity is imparted is used. A “flexible material to which electrical conductivity is imparted” is a concept including materials that are electrically conductive, and includes materials in which an electrically-conductive material has been applied to a flexible material in order to impart electrical conductivity thereto, and materials in which a flexible material is electrically conductive. Polymer materials such as urethane materials and the like are suitable as flexible materials to which electrical conductivity is imparted. In the following explanation, description is given by calling a member, which is formed by compounding or infiltrating (also called impregnating) or the like an electrically-conductive material into all of or some of a urethane material, an “electrically-conductive urethane” as an example of the flexible material to which electrical conductivity is imparted. The electrically-conductive urethane can be formed by any method among compounding and infiltrating (impregnating) an electrically-conductive material, and can be formed by compounding or infiltrating (impregnating) an electrically-conductive material, or can be formed by combining the compounding and the infiltrating (impregnating) of an electrically-conductive material. For example, in a case in which the electrical conductivity of an electrically-conductive urethane formed by infiltration (impregnation) is higher than that of an electrically-conductive urethane formed by compounding, it is preferable to form the electrically-conductive urethane by infiltration (impregnation).
The electrically-conductive urethane has the feature that the electrical characteristics thereof vary in accordance with a physical amount applied thereto. A stimulus value in accordance with a pressure value that expresses a stimulus (hereinafter called pressure stimulus) that is due to pressure that deforms the structure such as bending or the like, is an example of the physical amount that gives rise to the feature of the electrical characteristics varying. Note that pressure stimuli include the application of pressure in accordance with the distribution of pressure that is applied to a predetermined region and pressure of a predetermined range. Further, other examples of the physical amount are stimulus values such as the percentage of contained water, or the moisture content that expresses a stimulus (hereinafter called material stimulus) that changes (alters) the properties of the material due to the application of moisture or the like, and the like. The electrical characteristics of the electrically-conductive urethane vary in accordance with the physical amount that is applied. Electrical resistance value is an example of a physical amount that expresses the electrical characteristics. Further, a voltage value and a current value are other examples.
Due to electrical conductivity being imparted to a flexible material that has a predetermined volume, electrical characteristics corresponding to the applied physical amount (i.e., changes in the electrical resistance values) appear at the electrically-conductive urethane, and the electrical resistance values can be understood as being the volume resistance values of the electrically-conductive urethane. In the electrically-conductive urethane, the electrical paths cooperate in a complex manner, and, for example extend/contract or expand/contract in accordance with deformation. Further, there are also cases in which the behavior of the electrical paths being temporarily cut-off, and the behavior of connection that is different than that previously arising, are exhibited. Accordingly, the electrically-conductive urethane exhibits the behavior of having electrical characteristics that differ due to deformation or alteration that corresponds to the magnitude or the distribution of a stimulus (a pressure stimulus or a material stimulus) that is in accordance with an applied physical amount, at positions that are a predetermined distance apart from one another (e.g., positions of detection points where electrodes are disposed). Therefore, the electrical characteristics vary in accordance with the magnitude or the distribution of the stimulus that is in accordance with the physical amount applied to the electrically-conductive urethane.
Note that, by using the electrically-conductive urethane, there is no need to provide detection points such as electrodes or the like at places that are targets of deformation and alteration. It suffices to provide detection points such as electrodes or the like at at least two arbitrary places that sandwich therebetween a place where a stimulus that is in accordance with a physical amount is applied to the electrically-conductive urethane (
A number of detection points that is greater than two detection points may be used in order to improve the accuracy of detecting the electrical characteristics of the electrically-conductive urethane. Further, an electrically-conductive urethane 22 illustrated in
An example of an estimating device, which utilizes the electrically-conductive urethane and estimates the state of an applying side with respect to the electrically-conductive urethane, is described next.
An example of the structure of an estimating device 1, which can execute estimating processing that estimates the state of an applying side, is illustrated in
Deformation and alteration of the above-described electrically-conductive urethane arise due to a physical amount that is applied in time-series to the electrically-conductive urethane. This physical amount that is applied in time series depends on the state of the applying side. Accordingly, the electrical characteristics of the electrically-conductive urethane that vary in time series correspond to the state of the applying side of the physical amount that is applied to the electrically-conductive urethane. For example, in a case in which a pressure stimulus that deforms the electrically-conductive urethane or a material stimulus that alters the electrically-conductive urethane is applied, the electrical characteristics of the electrically-conductive urethane that vary in time series correspond to the state of the applying side, which expresses the position, the distribution and the magnitude of the pressure stimulus. Accordingly, the state of the applying side with respect to the electrically-conductive urethane can be estimated from the electrical characteristics of the electrically-conductive urethane that vary in time series.
At the estimating device 1, the state of an unknown applying side is estimated and outputted by an estimating processing that is described later, by using a learning model 51 that has been trained. Due thereto, the state of the applying side with respect to the target object 2 can be identified without using a special device or a large device and without directly measuring deformation and alteration of the electrically-conductive urethane 22 that is included in the target object. The learning model 51 is trained by using, as the inputs thereof, the state of the applying side with respect to the target object 2, and electrical characteristics of the target object 2 (i.e., electrical characteristics such as electrical resistance values or the like of the electrically-conductive urethane 22 disposed at the target object 2). The training of the learning model 51 is described later.
Note that the target object 2 can be structured by placing the electrically-conductive urethane 22 at a member 21 that is flexible (
As illustrated in
In the present embodiment, the electrically-conductive urethane 22 is used as a sensor, and therefore, in a case in which a figure is interposed for example, the strange feeling that is imparted to the figure is extremely small as compared with a conventional sensor. Therefore, the state of the applying side in relation to the figure is not impeded during measurement, and measurement and estimation of the state of the applying side can be carried out simultaneously. This is advantageous as compared with conventional sensors that separately carry out measurement and estimation of the state of the applying side, and the merits are great particularly in estimation in accordance with long-term measurement/evaluation that follows time-series variations.
The estimating section 5 is a functional section that is connected to the target object 2 and that, on the basis of electrical characteristics that vary in accordance with at least one of deformation and alteration of the electrically-conductive urethane 22, estimates the state of the applying side by using the learning model 51. Specifically, time-series input data 4, which expresses magnitudes of electrical resistances (electrical resistance values or the like) at the electrically-conductive urethane 22, is inputted to the estimating section 5. The input data 4 corresponds to state data 3 that expresses a state of the applying side with respect to the target object 2, e.g., a state relating to the posture of the figure that contacts the target object 2, or the behavior of the figure such as movement or the like. For example, at a time of contacting the target object 2, the figure contacts in a predetermined state such as a posture or the like, and, in accordance with this state, a stimulus (at least one of a pressure stimulus and a material stimulus) is applied as a physical amount to the electrically-conductive urethane 22 that structures the target object 2, and the electrical characteristics of the electrically-conductive urethane 22 vary. Accordingly, the electrical characteristics of the electrically-conductive urethane 22, which vary in time series and are shown by the input data 4, correspond to the state of the applying side with respect to the target object 2, i.e., the electrically-conductive urethane 22. Further, the estimating section 5 outputs, as the results of the estimation using the trained learning model 51, output data 6 that expresses the state of the applying side corresponding to the electrical characteristics of the electrically-conductive urethane 22 that vary in time series.
The learning model 51 is a model that has been trained and that derives the output data 6 expressing the state of the applying side, from the electrical resistances (the input data 4) of the electrically-conductive urethane 22 that vary due to the stimulus (pressure stimulus or material stimulus) that is applied as the physical amount. The learning model 51 is, for example, a model that prescribes a trained neural network, and is expressed as a collection of information of the weights (strengths) of the connections between the nodes (neurons) that structure the neural network.
The learning processing that generates the learning model 51 is described next.
In the learning data collecting processing, the learning processing section 52 collects, as learning data, a large amount of the input data 4 that is obtained by measuring in time series the electrical characteristics (e.g., the electrical resistance values) at the electrically-conductive urethane 22 and whose labels are the state data 3 that express states of the applying side. Accordingly, the learning data includes a large number of sets of the input data 4 expressing the electrical characteristics, and the state data 3 expressing states of the applying side that correspond to those input data 4.
Specifically, in the learning data collecting processing, electrical characteristics (e.g., electrical resistance values) that vary due to a stimulus (a pressure stimulus or material stimulus) corresponding to the state of the applying side at the time when a state at the target object 2 (i.e., a state of the applying side with respect to the electrically-conductive urethane 22) is formed, are acquired in time series. Next, the state data 3 is applied as a label to the electrical characteristics that were acquired in time series (the input data 4), and the processings are repeated until the sets of the state data 3 and the input data 4 reach a predetermined number that has been set in advance or a predetermined time that has been set in advance. These sets of the state data 3 that express states of the applying side, and the time-series electrical characteristics of the electrically-conductive urethane 22 that are acquired per state of the applying side (the input data 4), are used as the learning data. Note that the state data 3 of the learning data are stored in an unillustrated memory so as to be treated as the output data 6 that express states of the applying side at which the estimation results are the correct answers in the learning processing that is described later.
Note that, in the learning data, time-series information may be set in correspondence by applying information expressing the time of measurement to each of the electrical resistance values of the electrically-conductive urethane 22 (the input data 4). In this case, the time-series information may be set in correspondence by applying information expressing the time of measurement to sets of time-series electrical resistance values at the electrically-conductive urethane 22, in a time period that is set as the state of the applying side.
An example of the above-described learning data is shown in a table next. Table 1 is an example of data sets in which time-series electrical resistance value data (r) and state data (R) expressing states of the applying side are set in correspondence with one another as learning data relating to the state of the applying side with respect to the electrically-conductive urethane 22.
Note that the electrical characteristics detected at the electrically-conductive urethane 22 (the time characteristics in accordance with the time-series electrical resistance value data) can be considered as distinctive patterns relating to the states of the applying side with respect to the electrically-conductive urethane 22. Namely, different stimuli are applied to the electrically-conductive urethane 22 in time series, depending on the state of the applying side with respect to the electrically-conductive urethane 22. Accordingly, it is thought that time-series electrical characteristics within a predetermined time period appear as distinctive electrical characteristics with respect to the state of the applying side. Accordingly, patterns (e.g., the shape of the distribution of the time-series electrical resistance values in the electrical characteristics), which are shown in the electrical characteristics detected at the electrically-conductive urethane 22 (the time characteristics in accordance with time-series electrical resistance value data), correspond to the states of the applying side, and function effectively in the learning processing that is described later.
Learning model generating processing is described next. The learning model generating device illustrated in
The learning processing section 52 holds, as the learning data and in an unillustrated memory, a large number of sets of the above-described input data 4 (e.g., electrical resistance values), and the output data 6 that are the state data 3 expressing states of the applying side that applied a stimulus to the electrically-conductive urethane 22.
The generating unit 54 includes an input layer 540, an intermediate layer 542 and an output layer 544, and structures a known neural network (NN). Because neural networks themselves are known technology, detailed description thereof is omitted. However, the intermediate layer 542 includes a large number of node groups (neuron groups) having inter-node connections and feedback connections. Data from the input layer 540 is inputted to the intermediate layer 542, and the data that is the results of calculation of the intermediate layer 542 is outputted to the output layer 544.
The generating unit 54 is a neural network that generates generated output data 6A that serves as data expressing the state of the applying side or data close to the state of the applying side, from the inputted input data 4 (electrical resistance values). The generated output data 6A is data in which the state of the applying side that applied a stimulus to the electrically-conductive urethane 22 is estimated from the input data 4. The generating unit 54 generates the generated output data that expresses a state close to the state of the applying side, from the input data 4 that was inputted in time series. By learning by using a large number of the input data 4, the generating unit 54 can generate the generated output data 6A that is close to the state of the applying side such as a figure or the like that applied a stimulus to the target object 2, i.e., the electrically-conductive urethane 22. In another aspect, the electrical characteristics that are the input data 4 inputted in time series can be considered as patterns, and, by learning these patterns, the generating unit 54 can generate the generated output data 6A that is close to the state of the applying side such as a figure or the like that applied a stimulus to the target object 2, i.e., the electrically-conductive urethane 22.
The computing unit 56 is a computing unit that compares the generated output data 6A and the output data 6 of the learning data, and computes the error of these results of comparison. The learning processing section 52 inputs the generated output data 6A and the output data 6 of the learning data to the computing unit 56. In accordance therewith, the computing unit 56 computes the error between the generated output data 6A and the output data 6 of the learning data, and outputs a signal expressing these computational results.
On the basis of the error computed at the computing unit 56, the learning processing section 52 carries out training of the generating unit 54, which is the tuning of the weighting parameters of the connections between the nodes. Specifically, the learning processing section 52 feeds-back, to the generating unit 54, the weighting parameters of the connections between the nodes of the input layer 540 and the intermediate layer 542, the weighting parameters of the connections between the nodes within the intermediate layer 542, and the weighting parameters of the connections between the nodes of the intermediate layer 542 and the output layer 544, respectively at the generating unit 54 by using, for example, a method such as the gradient descent method or backpropagation or the like. Namely, the learning processing section 52 optimizes all of the connections between the nodes such that the errors between the generated output data 6A and the output data 6 of the learning data are minimized, with the target thereof being the output data 6 of the learning data.
Note that the generating unit 54 may use a regression neural network having the function of generating the outputs while taking the before-after relationships of the time-series inputs into consideration, or may use another method.
The learning processing section 52 generates the learning model 51 by learning model generating processing by using the above-described learning data. The learning model 51 is expressed as a collection of information of weighting parameters (weights or strengths) of the connections between the nodes, which are the results of learning, and is stored in an unillustrated memory.
Specifically, the learning processing section 52 executes the learning model generating processing in accordance with the following processes. In a first learning processing, the learning processing section 52 acquires the input data 4 (electrical characteristics) that are the learning data that are results of time-series measurement, and whose labels are information expressing the state of the applying side. In a second learning processing, the learning processing section 52 generates the learning model 51 by using the learning data that are the results of time-series measurement. Namely, the learning processing section 52 obtains the collection of information of the weighting parameters (weights or strengths) of the connections between the nodes that are the results of learning that have been learned by using a large number of learning data as described above. Then, in a third learning processing, the learning processing section 52 stores, as the learning model 51, data that is expressed as a collection of information of the weighting parameters (weights or strengths) of the connections between the nodes that are the results of learning.
Then, the above-described estimating device 1 uses, as the learning model 51, the trained generating unit 54 (i.e., data that is expressed as a collection of information of the weighting parameters of the connections between the nodes that are the results of learning). If the learning model 51 that has been sufficiently trained is used, it is possible to identify the state of the applying side from the target object 2, i.e., the time-series electrical characteristics of the electrically-conductive urethane 22 (e.g., the characteristics of the electrical resistance values that vary in time series).
By the way, as described above, at the electrically-conductive urethane 22, the electrical paths cooperate in a complex manner, and the electrically-conductive urethane 22 exhibits behavior corresponding to variations (deformation) such as extension/contraction, expansion/contraction, temporary cutting-off, new connections and the like of the electrical paths, and variations (alteration) in the properties of the material. As a result, the electrically-conductive urethane 22 exhibits the behavior of having electrical characteristics that differ in accordance with the applied stimulus (e.g., pressure stimulus). With regard to this point, the electrically-conductive urethane 22 can be treated as a reservoir that accumulates data relating to deformation of the electrically-conductive urethane 22. Namely, the estimating device 1 can apply the electrically-conductive urethane 22 to a network model (hereinafter called a PRCN) that is called physical reservoir computing (PRC). Because PRCs and PRCNs themselves are known techniques, detailed description thereof is omitted. However, PRCs and PRCNs are suitable for estimating information relating to deformation and alteration of the electrically-conductive urethane 22. Note that there are cases in which the reservoir is called a reservoir or a reservoir.
Next, an example of specific structures of the above-described estimating device 1 is further described.
The computer that functions as the estimating device 1 has a computer main body 100. The computer main body 100 has a CPU 102, a RAM 104 such as a volatile memory or the like, a ROM 106, an auxiliary storage device 108 such as a hard disk device (HDD) or the like, and an input/output interface (I/O) 110. These CPU 102, RAM 104, ROM 106, auxiliary storage device 108 and input/output I/O 110 are structures that are connected via bus 112 so as to be able to transfer data and commands to and from one another. Further, a communication section 114 for communicating with external devices, an operation/display portion 116 such as a display and a keyboard or the like, and a detecting section 118 are connected to the input/output I/O 110. The detecting section 118 functions to acquire the input data 4 (the electrical characteristics that are the time-series electrical resistance values or the like) from the target object 2 that includes the electrically-conductive urethane 22. Namely, the detecting section 118 includes the target object 2 at which the electrically-conductive urethane 22 is disposed, and can acquire the input data 4 from the electrical characteristic detecting section 76 that is connected to the detection points 75 at the electrically-conductive urethane 22. Note that the detecting section 118 may be connected via the communication section 114.
A control program 108P, which is for causing the computer main body 100 to function as the estimating device 1 that serves as an example of the estimating device of the present disclosure, is stored in the auxiliary storage device 108. The CPU 102 reads-out the control program 108P from the auxiliary storage device 108, and expands the control program 108P in the RAM 104, and executes processings. Due thereto, the computer main body 100 that executes the control program 108P operates as the estimating device 1.
Note that learning models 108M that include the learning model 51, and data 108D that includes various data, are stored in the auxiliary storage device 108. The control program 108P may be provided by a recording medium such as a CD-ROM or the like.
Next, the estimating processing at the estimating device 1 that is realized by a computer is further described.
First, the CPU 102 acquires the learning model 51 by reading-out the learning model 51 from the learning models 108M of the auxiliary storage device 108 and expanding the learning model 51 in the RAM 104 (step S200). Specifically, the learning model 51, in which the connections between the nodes in accordance with weighting parameters are realized, is constructed due to the CPU 102 expanding, in the RAM 104, the network model (refer to
Next, the CPU 102 acquires, in time series and via the detecting section 118, the unknown input data 4 (electrical characteristics) that are subjects in estimating the state of the applying side that is due to the stimulus applied to the electrically-conductive urethane 22 (step S202). Next, by using the learning model 51, the CPU 102 estimates the output data 6 (the state of the unknown applying side) that corresponds to the acquired input data 4 (step S204). Then, the CPU 102 outputs the output data 6 (the state of the applying side) that is the results of estimation via the communication section 114 (step S206), and ends the present processing routine.
In this way, in accordance with the estimating device 1, the state of the unknown applying side can be estimated from electrical resistance values of the electrically-conductive urethane 22. Specifically, at the estimating device 1, the state of the applying side such as a figure or the like can be estimated from the input data 4 (electrical characteristics) that vary in accordance with the stimulus applied to the electrically-conductive urethane 22 due to the state of the applying side. Namely, the state of the applying side such as a figure or the like can be estimated without using a special device or a large device and without directly measuring deformation of a flexible member.
By the way, at a flexible material at which at least a portion thereof can deform such as bend or the like, the softness and the hardness (flexibility/repulsion force/restoring force) deteriorate due to the number of times of deformation, changes over time, and the like. Note that the number of times of deformation may be the deformation frequency, or the number of times of deformation and the deformation frequency may be combined. Deformation frequency may be used so as to have the same meaning as the number of times of deformation, or the number of times of deformation per unit time period may be used as the deformation frequency. Hereinafter, description will be given by collectively calling the number of times of deformation, and the number of times of deformation per unit time, the deformation frequency. At the above-described electrically-conductive urethane 22, features relating to the state of the applying side are expressed as electrical characteristics in the time-series electrical characteristics. Accordingly, features, which express the state of deterioration of the flexibility that arises in accordance with the deformation frequency or changes over time or the like, are expressed by patterns (e.g., the shape of the distribution of the time-series electrical resistance values in the electrical characteristics) that are shown in the electrical characteristics detected at the electrically-conductive urethane 22 (the time characteristics in accordance with the time-series electrical resistance value data). Thus, in the present embodiment, deterioration of a flexible material that is deformable is estimated by the estimating device 1 that includes the above-described electrically-conductive urethane 22.
Note that, hereinafter, in order to simplify explanation, description is given of an example in which a flexible material that is not electrically-conductive and is deformable is included in the target object 2 as the member 21, and the electrically-conductive urethane 22 is disposed on the reverse surface side of the member 21 (target object cross-section 2-5 in
“Deterioration” and “deteriorated state” in the present embodiment are a concept including states in which softness has changed from a predetermined time, e.g., from the initial formation of the flexible material, in relation to deformation of the flexible material at the time when a pressure stimulus is applied thereto, and restoration from the deformation. Specifically, for example, from the standpoint of the structure and the shape of the flexible material, states in which the restoring force, by which the post-deformation structure and shape return to the pre-deformation structure and shape, has changed (increased or decreased) from that of the time when the flexible material was originally manufactured, and states in which the pressure that can be applied at the time of deformation has changed (increased or decreased) from the pressure of the time when the flexible material was originally manufactured, are included.
An example of a deteriorated state estimating device, which estimates the deteriorated state of the target object 2 that includes the electrically-conductive urethane 22, is described next.
An example of the structure of an estimating device 1A that serves as the deteriorated state estimating device relating to the present embodiment is illustrated in
By using the trained learning model 51, the estimating processing at the deteriorated state estimating device 1A estimates and outputs the deteriorated state of an unknown product (object of estimation). The learning model 51 is trained by learning data that includes electrical characteristics of the electrically-conductive urethane 22 and deteriorated states of the target object 2 that includes the electrically-conductive urethane 22.
The learning processing that generates the learning model 51 relating to the present embodiment is described next. Learning is carried out by using, as learning data, electrical characteristics of the electrically-conductive urethane 22 (the input data 4) whose labels are deteriorated state information (the state data 3) expressing deteriorated states of the target object 2.
First, the learning data that is used in the learning processing is described.
At the measuring device 8, a pressure applying section 83 for applying a pressure stimulus to the target object 2 is mounted to a fixed portion 82 that is fixed to a base 81. The pressure applying section 83 has a pressure applying main body 83A, an arm 83B that can extend and retract with respect to the pressure applying main body 83A, and a distal end portion 83C mounted to the distal end of the arm 83B. The pressure applying main body 83A is fixed to the fixed portion 82. The arm 83B is extended and retracted in accordance with an input signal, and the distal end portion 83C is moved in a predetermined direction (the arrow Z direction and the direction opposite thereto). Due thereto, a pushing member 84 can contact the target object 2 that is set on the base 81 and can push the target object 2 after contacting it, and can move away from the target object 2.
At the target object 2, the electrically-conductive urethane 22 is disposed on the base 81, and the member 21 that is flexible such as urethane or the like is disposed on the electrically-conductive urethane 22. The pushing member 84 that is a predetermined shape is mounted to the distal end portion 83C of the pressure applying section 83. The target object 2 is disposed such that the pushing member 84, which is mounted to the distal end portion 83C of the pressure applying section 83, can at least contact the target object 2. Note that, in the present embodiment, the pushing member 84 whose distal end is shaped as a curved surface (e.g., a portion of a sphere) is used as an example of the pushing member 84 of a predetermined shape. The pushing member 84 is a member that applies a pressure stimulus by a predetermined pressure to the target object 2. Note that, as the cross-sectional shape of the pushing member 84, the shape may be any of quadrangular, trapezoidal, circular, oval and polygonal, or may be another shape.
The pressure applying section 83 operates such that, due to the arm 83B extending, the distal end portion 83C pushes the pushing member 84 against the target object 2.
The pressure applying main body 83A has a force sensor 85 having the function of detecting forces in six axial directions for example. The force sensor 85 has the function of detecting the pushing state of the pushing member 84 with respect to the target object 2, and the function of detecting the pressure applied to the target object 2, from the detected forces. Due to this force sensor 85, it is possible to detect, in time series, physical amounts in states in which the pushing member 84 is pushing the target object 2, and it is possible to detect, in time series, pressures applied to the target object 2. Note that the force sensor 85 can be omitted in cases in which only the deteriorated state is tested.
The measuring device 8 has a controller 80 that is connected to the pressure applying section 83 and the force sensor 85. The controller 80 has an unillustrated CPU, carries out control of the pressure applying section 83 by the unillustrated CPU, applies a pressure stimulus to the target object 2, and acquires and stores the time-series electrical characteristics that are due to the pressure stimulus applied to the target object 2.
In the present embodiment, the controller 80 carries out control of the pressure applying section 83 so as to carry out reciprocal movement that extends and retracts the arm 83B, and apply and cancel a pressure stimulus with respect to the target object 2. Further, synchronously with the application and canceling of the pressure stimulus with respect to the target object 2, the controller 80 acquires electrical characteristics of the electrically-conductive urethane 22. Accordingly, the measuring device 8 can acquire, in time-series, electrical characteristics relating to deformation of the target object 2 to which deformation is applied intermittently (e.g., periodically), as one learning data.
The deteriorated state of the target object 2 is described next. At the target object 2, the softness deteriorates in accordance with at least one of the frequency of deformation and changes over time. For example, as the frequency of deformation increases, the softness deteriorates, and, as the elapsed time, such as the time that the target object 2 is left alone or the like, increases, the softness deteriorates. Further, there are also cases in which, as the frequency of deformation and the elapsed time respectively increase, the softness deteriorates. With regard to the deteriorated state that expresses the deterioration of the target object, in relation to geometric aspects such as the structure and the shape and the like of the target object 2, the time that is from a pressure stimulus being applied and the target object 2 deforming until the target object 2 is restored to the structure and the like of before the application of the pressure stimulus, and the extent of the structural difference between the original structure or the like and the structure or the like after restoration, are considered. Further, in relation to mechanical aspects that arise at the target object 2, the extent to which the repulsion force of the target object 2 at the time when a pressure stimulus is applied and the target object 2 deforms, and the restoring force of the target object 2 at the time when the pressure stimulus is cancelled and the deformation is restored, differ is considered. However, at the target object 2 that is flexible, because both the geometric aspect and the mechanical aspect are closely related, in the present embodiment, no distinction is made therebetween, and both are treated as the deteriorated state of the target object 2.
Note that, with regard to the frequency of the deformation, plural samples (the target object 2) of the same size were prepared, and deformation of respectively different numbers of times were applied to the respective materials in the same environment and within a predetermined time period, and when the deformed states were measured, it was confirmed that, the greater the number of times of deformation, i.e., the greater the deformation frequency within the predetermined time period, the greater the extent of the deterioration. Further, with regard to the elapsed time, samples (the target object 2) were prepared, and when the deformation states were measured each predetermined time in the same environment, it was confirmed that, the longer the time that had elapsed, i.e., the longer the elapsed time, the greater the extent of the deterioration.
As illustrated in
With regard to a first feature, the deteriorated state of the target object 2 is expressed by the resistance values that gradually decrease in the electrical characteristics of the target object 2 (
A second feature is expressed in the electrical characteristics of one cycle of application and cancellation of a pressure stimulus, or in the electrical characteristics of a predetermined cycle. Specifically, the deteriorated state of the target object 2 is expressed by the change in the electrical resistance values in the electrical characteristics of the application and cancellation of a pressure stimulus.
As illustrated in
Accordingly, in the second feature, the change in the electrical resistance values in the electrical characteristics of the application and cancellation of the pressure stimulus are used as the deteriorated state of the target object 2. Specifically, for example, the tendency of the change (e.g., the rate of change) of the electrical resistance values, or the difference in the minimum values of the change in the electrical resistance values, is used as the degree of deterioration that expresses the tendency of the deterioration. Note that, in the same way as the degree of deterioration that uses the first feature, as described above, the degree of deterioration that uses the second feature may be associated with a message that is intuitive to a user, and a threshold value for judging the deteriorated state may be determined in advance, and undeteriorated states and deteriorated states may be set with respect to the threshold value. Further, for the degree of deterioration, the amount of change that is expressed by the current value with respect to the value of the initial stage may be used as a deterioration index for judging deterioration.
As compared with the degree of deterioration that uses the first feature, the degree of deterioration, which uses the second feature, being affected by fluctuations in the absolute values of the electrical characteristics can be suppressed, and the deteriorated state of the target object 2 can be identified.
In a third feature, the deteriorated state of the target object 2 is expressed by changes in the frequency of the electrical characteristics of the target object 2, i.e., changes in the frequency of the time characteristics of the time-series electrical resistance values detected at the target object 2.
As illustrated in
Specifically, in the frequency characteristics (the power spectra) of the electrical characteristics, difference Ps in the powers of first frequency f1 and second frequency f2, which is further toward the high frequency side than the first frequency f1, is considered. There is the tendency for difference Ps2 between the powers at the elapsed time (the characteristics 47) to be larger than the difference Ps1 in powers in the initial stage of measurement (the characteristics 46).
Accordingly, in the third feature, the change of the frequency in the electrical characteristics of the target object 2 is used as the deteriorated state of the target object 2. Specifically, for example, the tendency of the change (e.g., the amount of change or the rate of change) of the frequency in the electrical resistance values is used as the degree of deterioration that expresses the tendency of the deterioration. Note that, as described above, the degree of deterioration that uses the third feature may be associated with a message that is intuitive to users, or a threshold value for judging the deteriorated state may be determined in advance, and undeteriorated states and deteriorated states may be set with respect to the threshold value. Further, for the degree of deterioration, the amount of change that is expressed by the current value with respect to the value in the initial stage may be used as a deterioration index for judging deterioration.
As compared with the degree of deterioration that uses the first feature or the second feature, the degree of deterioration, which uses the third feature, being affected by fluctuations in the absolute values of the electrical characteristics and relative fluctuations in the electrical characteristics can be suppressed, and the deteriorated state of the target object 2 can be identified even more precisely.
Deteriorated state information (the state data 3) that expresses the deteriorated state of the target object 2 can be set in accordance with the above-described degree of deterioration. Accordingly, by deriving the above-described feature that is shown in the electrical characteristics of the target object 2, the deteriorated state of the target object 2 with respect to the time-series electrical characteristics relating to deformation of the target object 2 can be set in correspondence as another one learning data.
Accordingly, the set that is formed by the information, which express respectively the time-series electrical characteristics at the target object 2 (i.e., the electrically-conductive urethane 22) and the deteriorated state of the target object 2 with respect to the electrical characteristics, is used as the learning data. An example of the learning data is illustrated as a table next. Table 2 is an example of data sets in which time-series electrical resistance value data (r) and state data (R) expressing deteriorated states are set in correspondence, as learning data relating to the deteriorated state of the target object 2 that includes the electrically-conductive urethane 22.
In Table 2, the state data (R) in above-described Table 1 are set in correspondence with deteriorated states and are shown in detail. It suffices for the state data (R) to be set in correspondence with any of the above-described features that are expressed in the electrical characteristics. For example, it suffices to utilize the degree of deterioration (E) that uses the first feature. Examples of the degree of deterioration that uses the first feature are base resistance values, the difference from or the ratio with respect to the initial electrical resistance values, a message expressing the degree of deterioration, and a deterioration index derived from these degrees of deterioration. With the second feature, it suffices to use the change in the electrical resistance values in the electrical characteristics, e.g., the change tendency (W) such as the rate of change of the electrical resistance values or the like, as the degree of deterioration that expresses the tendency of the deterioration. With regard to the degree of deterioration that uses the third feature, it suffices to use the change in the frequency of the electrical characteristics, e.g., the change tendency (F) of the frequency such as the amount of change or the rate of change or the like of the electrical resistance values, as the degree of deterioration that expresses the tendency of the deterioration. Accordingly, because the deteriorated state of the target object 2 is expressed distinctively in the time-series electrical characteristics of the target object 2 (the electrically-conductive urethane 22), this functions effectively in the learning processing.
The learning processing that generates the learning model 51 that relates to the deteriorated state of the target object 2 relating to the present embodiment is described next.
In step S110, the electrical characteristics of the target object 2 (the input data 4) are acquired. In next step S111, first, the state data 3 expressing the deteriorated state of the target object 2 is acquired by analyzing the electrical characteristics of the target object 2 (the input data 4) and deriving the degree of deterioration that exhibits a feature described above. In this step S111, the input data 4 that are the electrical characteristics of the target object 2, and the state data 3 that expresses the deteriorated state of the target object 2 that is the results of analysis, are set in correspondence with one another, and the set of the input data 4 (electrical resistances), whose label is the state data 3 (the degree of deterioration), is acquired as learning data. Next, in step S212, the learning model 51 is generated by using the acquired learning data. Namely, the collection of the information of the weighting parameters (weights or strengths) of the connections between the nodes, which are the results of learning that have been learned by using a large number of learning data as described above, are obtained. Then, in step S114, data, which is expressed as the collection of the information of the weighting parameters (weights or strengths) of the connections between the nodes which are the results of learning, is stored as the learning model 51.
The processing of estimating the deteriorated state of the target object 2 by using the learning model 51 relating to the present embodiment is described next.
As described above, at the deteriorated state estimating device 1A, by using the trained learning model 51 that has been generated by the method exemplified above, it is possible to identify the deterioration of the target object 2 from the electrical characteristics at the target object 2, if the learning model 51 that has been sufficiently trained is used. Note that the deteriorated state estimating device 1 of the target object is an example of the estimating section and the estimating device of the present disclosure.
An example of the flow of the processing of estimating the deteriorated state of the target object 2 in accordance with the control program 108P executed at the computer main body 100 is illustrated in
First, in step S201, the learning model 51 is acquired and the learning model 51 is constructed due to the learning model 51, which has been trained for the above-described deteriorated state estimation, being read-out from the learning models 108M of the auxiliary storage device 108 and being expanded in the RAM 104.
Next, in step S203, the time-series input data 4 (electrical characteristics) at the unknown target object 2 (object of estimation) is acquired via the detecting section 118.
Next, in step S205, by using the learning model 51 acquired in step S201, the output data 6 (the deteriorated state of the object of estimation), which corresponds to the input data 4 (the electrical characteristics) acquired in step S203, is estimated. Then, in next step S207, the output data 6 (the deteriorated state of the object of estimation) that is the results of estimation is outputted via the communication section 114, and the present processing routine is ended.
Note that, in step S207, it is possible to also output assisting information such as a notification of the time for replacement or the like. For example, the above-described message that is intuitive to a user may be outputted to the communication section 114 or the operation/display portion 116 as the degree of deterioration. Specifically, a message expressing either of an undeteriorated state in a case in which the deterioration degree is less than the threshold value for judging the deteriorated state, or a deteriorated state in which it is preferable to carry out replacement in a case in which the deterioration degree is greater than or equal to the threshold value, may be outputted as information. Due to assisting information being outputted in this way, the user can carry out replacement at an appropriate time, which is when a predetermined state of deterioration is reached.
The estimating processing illustrated in above-described
As described above, in accordance with the present disclosure, it is possible to estimate the deteriorated state of an object of estimation whose deteriorated state is unknown, from electrical characteristics at the object of estimation. Namely, it is possible to estimate the deteriorated state of an object of estimation by using electrical characteristics of a time when the target object 2 deforms, without using a special detecting device.
Further, by outputting the results of estimation of the deteriorated state of the object of estimation, the deteriorated state, including the flexibility, at the electrically-conductive urethane 22 that functions as a sensor included in the target object 2 is estimated. Due thereto, even in a case in which the function as a sensor in the initial stage of formation of the target object 2 deteriorates, replacement can be carried out at an appropriate time that is when a predetermined state of deterioration is reached.
The above-described deteriorated state estimating section 10 can be structured per function, in correspondence with the features that are included in the above-described electrical characteristics.
The deteriorated state analyzing section is a functional section that analyzes the deteriorated state of the target object 2 that includes the electrically-conductive urethane 2 by using time-series electrical characteristics (the input data 4) that vary in accordance with deformation of the electrically-conductive urethane 22. The deteriorated state analyzing section derives the degree of deterioration that is expressed by a feature that is included in the electrical characteristics as any of the above-described first feature through third feature. The comparing/judging section is a functional section that is connected to the threshold value storing section that stores a threshold value for judging the deteriorated state, and compares the deteriorated state that is the results of analysis and the threshold value for judging the deteriorated state, and outputs the results of comparison as the degree of deterioration. For example, it suffices for the threshold value storing section to store, in the ROM 106 or the auxiliary storage device 108, a threshold value for judging the deteriorated state so as to correspond to messages that are intuitive to users, or the like. Further, it suffices for the comparing/judging section to, by using the threshold value for judging the deteriorated state for example, judge that there is an undeteriorated state in a case in which the derived degree of deterioration is less than the threshold value, and that there is a deteriorated state in a case in which the derived degree of deterioration is greater than or equal to the threshold value. By structuring the deteriorated state estimating section 10 per function in correspondence with the features included in the electrical characteristics in this way, the deteriorated state estimating section 10 can easily be applied to hardware structures such as independent device structures, electrical circuit structures and the like.
The present disclosure describes a case in which an electrically-conductive urethane is used as an example of the flexible member. However, it suffices for the flexible member to be flexible, and the flexible member is, of course, not limited to the above-described electrically-conductive urethane.
Further, the technical scope of the present disclosure is not limited to the scopes described in the above embodiments. Various changes and improvements can be made to the above-described embodiments within a scope that does not depart from the gist, and forms to which such changes and improvements are made also are included in the technical scope of the present disclosure.
Further, the above embodiments describe cases in which the estimating processing and the learning processing are realized by software structures in accordance with processings using flowcharts. However, the present disclosure is not limited to this, and may be a form in which the respective processings are realized by hardware structures for example.
Further, portions of the estimating device, e.g., the neural network of the learning model or the like, may be structured by hardware circuits.
Further, although the above embodiments describe processings that are carried out by the execution of programs stored in the auxiliary storage device, at least some of the processings of the programs may be realized by hardware. Further, the flows of the processings of the programs described in the above embodiments also are examples, and unnecessary steps may be deleted therefrom, new steps may be added thereto, or the order of processings may be changed, within a scope that does not depart from the gist.
Moreover, in order to cause the processings in the above embodiments to be executed by a computer, programs, in which the above-described processings are written in code that can be processed by a computer, may be stored on a storage medium or the like such as an optical disc or the like, and distributed.
The above embodiments describe using a CPU as an example of a generic processor. However, in the above embodiments, processor means a processor in the broad sense and includes generic processors (e.g., CPUs: Central Processing Units, and the like), and dedicated-use processors (e.g., GPUs: Graphics Processing Units, ASICs: Application Specific Integrated Circuits, FPGAs: Field-Programmable Gate Arrays, programmable logic devices, and the like). The operations of this processor may be carried out not only by a single processor, but by plural processors cooperating with one another, and may be carried out by plural processors that exist at locations, which are apart from one another physically, cooperating with one another.
All publications, patent applications, and technical standards mentioned in the present specification are incorporated by reference into the present specification to the same extent as if such individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
The above-described embodiments include aspects relating to the technique of the present disclosure.
A first aspect is an estimating device comprising:
In a second aspect, in the estimating device of the first aspect,
In a third aspect, in the estimating device of the second aspect,
In a fourth aspect, in the estimating device of the third aspect,
In a fifth aspect, in the estimating device of any one of the second aspect through the fourth aspect,
In a sixth aspect, in the estimating device of any one of the first aspect through the fifth aspect,
A seventh aspect is an estimating method in which a computer:
An eighth aspect is an estimating program for causing a computer to execute processings of:
A ninth aspect is a learning model generating device comprising:
In accordance with the present disclosure, there is the effect that the deteriorated state of a target object, which has a flexible material that is electrically-conductive, can be estimated by using electrical characteristics of the target object, without using a special detecting device.
Number | Date | Country | Kind |
---|---|---|---|
2021-202865 | Dec 2021 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2022/027487 | 7/12/2022 | WO |