The present disclosure relates to a diagnosis system, a diagnosis method, and a program.
At many sites using factory automation (FA), the states of equipment and devices in a factory are diagnosed using sensor data from sensors attached to the equipment and the devices. Such diagnosis is performed to detect abnormalities such as the states in which a diagnosis target device operates abnormally and in which a diagnosis target device has any other abnormality signs, and one or more specific types of abnormalities among multiple types of abnormalities.
Such diagnosis using sensor data is usually performed manually by skilled workers. However, checking such data is time-consuming also for skilled workers. Thus, the equipment and devices may determine their states in real time, and inform any detected abnormality to an operator. Techniques have been developed for acquiring data from a sensor to determine the machine operating state and detecting an abnormality (for example, see Patent Literature 1).
Patent Literature 1 describes a technique for determining the operating state of a machine tool by clustering the feature quantity calculated from data and assigning, to each cluster, a label indicating the operating state. This technique can detect abnormalities through calculation of the abnormality level from the feature quantity based on the clustering result or the assigned label. The technique described in Patent Literature 1 can inform the abnormality in a machine tool to a user.
Patent Literature 1 describes alerting a user upon detecting an unknown cluster that cannot be labeled using available knowledge and leaving the labeling to an operator's discretion, and also describes an example procedure performed by a user for correcting a determination result of the operating state. However, Patent Literature 1 describes a user changing labels to be assigned to clustering results, without describing updating of the clustering procedure. Once wrong clustering different from that intended by a user is performed, such clustering may be retained. Thus, the accuracy of diagnosing presence or absence of an abnormality is to be improved.
An objective of the present disclosure is to improve the accuracy of diagnosing presence or absence of an abnormality.
To achieve the above objective, a diagnosis system according to an aspect of the present disclosure is a diagnosis system for diagnosing presence or absence of an abnormality from data pieces collected in a factory. The diagnosis system includes (i) diagnosis means for diagnosing presence or absence of an abnormality by classifying, in accordance with a model defining a plurality of groups, the collected data pieces into at least one of the plurality of groups, (ii) extraction means for extracting, from the collected data pieces, a candidate for a data piece to belong to a new group different from the plurality of groups, (iii) reception means for providing candidate information relating to the candidate extracted by the extraction means, and receiving addition information indicating whether the new group is to be added to the plurality of groups, and (iv) learning means for learning a new model including the new group when the addition information received by the reception means indicates that the new group is to be added to the plurality of groups. The diagnosis means diagnoses presence or absence of an abnormality with the new model after the learning means learns the new model.
In the present disclosure, the extraction means extracts a candidate for a data piece to belong to a new group from collected data pieces, and the learning means learns a new model when the addition information received by the reception means indicates that the new group is to be added to the plurality of groups. Thus, the diagnosis system can learn a new model when addition of the new group is appropriate, and diagnose presence or absence of an abnormality with the new model. Thus, the diagnosis system can improve the accuracy of diagnosing presence or absence of an abnormality.
A diagnosis system 100 according to one or more embodiments of the present disclosure is described in detail with reference to drawings.
The diagnosis system 100 according to the present embodiment diagnoses presence or absence of an abnormality from data pieces collected in a factory, and is built as part of a processing system such as a manufacturing system, a machining system, or an inspection system. A factory may include a plant. Abnormalities result from deviation of the operating state of equipment, devices, apparatuses, and a combination of these installed at a factory, from a normal state intended by a factory manager. Examples of abnormalities may include detection of defectives in a manufacturing line, breakage of mechanical components, errors in executing software, and communication errors.
As shown in
The devices 21 and 22 are sensor devices, actuators, or robots installed on a factory manufacturing line, and periodically transmit, to the diagnosis device 10, sensing results from, for example, a pressure sensor, an ultrasonic sensor, a magnetic sensor, or an infrared sensor. Data indicating the sensing results transmitted from the devices 21 and 22 are monitored by the diagnosis device 10 to be used for diagnosing presence or absence of an abnormality. Instead of the two devices, the diagnosis system 100 may include one device, or more than two devices similar to the devices 21 and 22.
The diagnosis device 10 is, for example, an industrial personal computer (IPC) or a programmable logic controller (PLC). The diagnosis device 10 may be a control device that operates a manufacturing line by controlling multiple devices including the devices 21 and 22.
As shown in
The processor 11 includes a central processing unit (CPU). The processor 11 executes a program P1 stored in the auxiliary storage 13 to perform various functions of the diagnosis device 10 and performs processes described later.
The main storage 12 includes a random-access memory (RAM). The program P1 is loaded on the main storage 12 from the auxiliary storage 13. The main storage 12 is used as a work area for the processor 11.
The auxiliary storage 13 includes a nonvolatile memory such as an electrically erasable programmable read-only memory (EEPROM) and a hard disk drive (HDD). In addition to the program P1, the auxiliary storage 13 stores various types of data used for performing processes of the processor 11. In accordance with an instruction from the processor 11, the auxiliary storage 13 provides data to be used by the processor 11 to the processor 11 and stores data provided from the processor 11.
The input device 14 includes an input device such as an input key and a pointing device. The input device 14 acquires information input by a user of the diagnosis device 10 and informs the acquired information to the processor 11.
The output device 15 includes an output device such as a liquid crystal display (LCD) and a speaker. The output device 15 provides various items of information to a user in accordance with an instruction from the processor 11. The output device 15 serves as a graphical user interface (GUI) together with the input device 14.
The communication device 16 includes a network interface circuit for communicating with external devices. The communication device 16 receives a signal from an external device and outputs data indicated by the signal to the processor 11. The communication device 16 transmits a signal indicating the data output from the processor 11 to an external device.
The diagnosis device 10 performs various functions including diagnosis of the operating states of the devices 21 and 22 with the hardware components shown in
The collector 110 is mainly implemented by the processor 11 and the communication device 16 operating in cooperation. At an initial activation of the diagnosis device 10, the collector 110 acquires data transmitted from the devices 21 and 22 and stores the acquired data into the learning data storage 120. The data stored in the learning data storage 120 is used as learning data for generating the diagnosis model 141. After learning of the diagnosis model 141 is complete, the collector 110 sequentially receives data transmitted from the devices 21 and 22 and transmits the received data to the diagnoser 140 as collected data. The collector 110 in the diagnosis system 100 corresponds to an example of collection means for collecting data pieces in a factory.
The learning data storage 120 is mainly implemented by at least one of the main storage 12 or the auxiliary storage 13. As illustrated in
At the initial activation of the diagnosis device 10, instead of actual values transmitted from the devices 21 and 22, learning data may include values prepared by a user as values possibly transmitted from the devices 21 and 22. The learning data prepared by the user may be received by the reception device 190 from the user and stored into the learning data storage 120.
Referring back to
Referring back to
Referring back to
The extractor 160 extracts a data piece to be possibly classified into an unknown group based on the diagnosis result from the diagnoser 140. More specifically, the extractor 160 calculates the belonging level of each data piece included in the diagnosis result to the group into which the data piece is classified by the diagnoser 140. The belonging level indicates the degree of appropriateness for each data piece to be classified into a certain group. For example, when the diagnosis model 141 is learned through k-means clustering, the belonging level of a data piece decreases as the distance from the cluster center to the data piece increases, and thus the data piece is determined as having a possibility to be classified into an unknown group. When the diagnosis model 141 is learned through a GMM, the likelihood calculated from each Gaussian distribution may be used as the belonging level.
In the example shown in
The new-group candidate storage 170 is mainly implemented by at least one of the main storage 12 or the auxiliary storage 13. As illustrated in
Referring back to
When the amount of data stored in the new-group candidate storage 170 increases to some extent, the new-group generator 180 generates candidate information, whereas when the amount of data is small, the new-group generator 180 waits and avoids generating a new group from mere outliers. Instead of being generated from all the data pieces read from the new-group candidate storage 170, the candidate information may be generated by the new-group generator 180 from some of read data pieces. Instead of information indicating a new group, the candidate information may be the data pieces as the candidates.
The new-group generator 180 transmits the generated candidate information to the reception device 190 shown in
The reception device 190 is a GUI including a display 191 that displays, to a user, candidate information transmitted from the new-group generator 180, and an input device 192 that receives inputs of the addition information indicating whether a new group is to be added after the user evaluates the appropriateness of the new group based on the candidate information. The display 191 is mainly implemented by the output device 15, and the input device 192 is implemented by the input device 14. The reception device 190 in the diagnosis system 100 corresponds to an example of reception means for performing a receiving step of providing candidate information relating to the candidate extracted by the extraction means and receiving the addition information indicating whether a new group is to be added to multiple groups. The display 191 corresponds to an example of display means for displaying the candidate information, and the input device 192 corresponds to an example of input means for acquiring addition information input by the user.
When receiving addition information indicating that a new group is to be added, the reception device 190 causes the new-group generator 180 to store the data pieces as the candidates into the learning data storage 120, receives the title of a new label from the user, and assigns the received new label to the data pieces as the candidates.
When the reception device 190 further receives an instruction for learning the diagnosis model 141 including a new group from the user, the reception device 190 causes the learner 130 to learn the diagnosis model 141.
The learner 130 in the diagnosis system 100 corresponds to an example of learning means for performing a learning step of learning a new model including a new group when the addition information received by the reception means indicates that the new group is to be added to a plurality of groups.
A diagnosis model updating process performed by the diagnosis system 100 is described with reference to
In the diagnosis-model initialization process in step S1, data used for learning of the diagnosis model 141 is stored into the learning data storage 120 from the collector 110 and the reception device 190, and the learner 130 learns the diagnosis model 141.
As shown in
The diagnoser 140 then determines whether any data piece is left for state diagnosis (step S22). More specifically, the diagnoser 140 determines whether the amount of data pieces transmitted from the collector 110 is sufficient for diagnosis. When the diagnoser 140 determines that no data piece is left for diagnosis (No in step S22), the processing performed by the diagnosis device 10 returns to step S21.
When the diagnoser 140 determines that one or more data pieces are to be diagnosed (Yes in step S22), the diagnoser 140 diagnoses presence or absence of an abnormality in accordance with the diagnosis model 141 and assigns a label to the data piece (step S23). For example, the diagnoser 140 classifies the data piece into any of the normal, abnormal-1, and abnormal-2 groups in accordance with the diagnosis model 141 shown in
The diagnoser 140 then determines whether any data piece has an abnormality (step S24). More specifically, the diagnoser 140 determines whether any data piece is classified into the abnormal-1 or abnormal-2 group. Abnormalities to be determined in step S24 correspond to the presence of a data piece labeled as a predetermined group. When the diagnoser 140 determines that one or more data pieces have an abnormality (Yes in step S24), the diagnoser 140 outputs the diagnosis result to the diagnosis output device 150 to inform the abnormality details to the user (step S25). When informing the abnormality details, the diagnosis output device 150 may also inform the data value, detailed information on the abnormality, and a method for recovering from the abnormality.
After step S25 and when the diagnoser 140 determines that no data piece has an abnormality in step S24 (No in step S24), the extractor 160 extracts the candidates for a data piece to belong to a new group (step S26). The extractor 160 then stores the candidates for a data piece to belong to a new group into the new-group candidate storage 170 (step S27). Thus, the data pieces as the candidates are accumulated in the new-group candidate storage 170.
Subsequently, whether the diagnoser 140 has completed diagnosing all the data pieces to be diagnosed is determined (step S28). When the diagnoser 140 has not completed diagnosing all the data pieces (No in step S28), the processing performed by the diagnosis device 10 returns to step S23. When the diagnoser 140 has diagnosed all the data pieces (Yes in step S28), the processing performed by the diagnosis device 10 returns from the diagnosis process to a diagnosis model updating process shown in
A new-group generation process in step S3 is described. In the new-group generation process, as shown in
When the reception device 190 has received the generation instruction (Yes in step S31), the new-group generator 180 reads the data pieces as the candidates from the new-group candidate storage 170 (step S32) and determines whether a new group is to be generated (step S33). A method for generating a new group may be the same as or different from a classification method using the diagnosis model 141. For example, after an attempt to generate a new group through hierarchical clustering such as k-means clustering or Ward's method, the new-group generator 180 determines whether a group satisfying certain conditions has been generated. Examples of certain conditions include elements included in a new group reaching a certain number. Defining such conditions for generating a new group enables distinguishing mere outliers from data pieces belonging to a significant group.
When a new group is not to be generated (No in step S33), the processing performed by the diagnosis device 10 returns from the new-group generation process to the diagnosis model updating process shown in
The input device 192 in the reception device 190 then receives a result of evaluation on the new group from the user (step S35). More specifically, the input device 192 receives a result of determination as to whether the new group is to be added to the diagnosis model 141 (step S36). In addition to the determination result, the evaluation of the user may also include information about a group to which the generated new group belongs among the existing groups, whether the new group is different from the existing groups, or whether the group substantially has no value and is thus not to be added. Examples of the group not to be added include a group for mere outliers and a group including intended groups to be distinguished. When a new group is to be added, the reception device 190 receives, from the user, a label title to be assigned to the new group.
The reception device 190 then determines whether a result of evaluation indicating that the new group is appropriate has been received (step S37). When no result of evaluation indicating that the new group is appropriate has been received (No in step S37), the diagnosis device 10 advances the processing to step S39. When a result of evaluation indicating that the new group is appropriate has been received from a user (Yes in step S37), the reception device 190 assigns a label to the data piece to belong to the new group and adds the data piece to the learning data storage 120 (step S38).
The diagnosis device 10 then deletes the data piece belonging to the generated new group from the new-group candidate storage 170 (step S39). This avoids regeneration of the same group. The processing performed by the diagnosis device 10 then returns from the new-group generation process to the diagnosis model updating process shown in
A model updating process in step S4 is described. In the model updating process, as shown in
When the update instruction has been received (Yes in step S41), the learner 130 reads data from the learning data storage 120 to learn the diagnosis model 141 (step S42). In this case, the learner 130 does not use all the data pieces stored in the learning data storage 120 for learning. For example, the data pieces used for learning may be limited to 100 pieces in order from the newest in each group. Information used for learning may be selected. For example, data pieces of at least one of multiple devices may be used for learning. In some embodiments, the update instruction from the user may include settings on data selection.
The diagnoser 140 then updates the diagnosis model 141 to a new diagnosis model 141 learned in step S42 (step S43). The processing performed by the diagnosis device 10 then returns from the model updating process to the diagnosis model updating process shown in
In the diagnosis system 100 according to the present embodiment, as described above, when the extractor 160 extracts a candidate for a data piece to belong to a new group from the data pieces collected from the devices 21 and 22, and the reception device 190 receives information indicating that the new group is to be added to multiple groups, the learner 130 learns a new model. Thus, the diagnosis system 100 can learn a new model simply when addition of the new group is appropriate, and thus can diagnose presence or absence of an abnormality with the new model. The diagnosis system 100 can thus improve the accuracy of diagnosing presence or absence of an abnormality.
The diagnosis system 100 separately performs the diagnosis process and the new-group generation process. Thus, while diagnosing presence or absence of an abnormality using a diagnosis model corresponding to the data characteristics, the diagnosis system 100 can generate a new group with various methods without being affected by the diagnosis model.
Embodiment 2 is described focusing on the differences from Embodiment 1. The components that are the same as or similar to those in Embodiment 1 are assigned the same reference sign and are not described or are described briefly. As shown in
Similarly to the diagnosis device 10 in Embodiment 1, the learning device 60 includes a collector 110, a learning data storage 120, a learner 130, an extractor 160, a new-group candidate storage 170, a new-group generator 180, and a reception device 190. The learning device 60 also includes a transmitter 601 that transmits the learned diagnosis model 141 to the diagnosis devices 61 and 62, and a receiver 602 that receives diagnosis results from the diagnosis devices 61 and 62. The transmitter 601 in the diagnosis system 100 corresponds to an example of transmission means for transmitting the new model learned by the learning means to a plurality of diagnosis devices. The extractor 160 acquires the data pieces collected by the diagnosis devices 61 and 62 through the receiver 602 and extracts a candidate to belong to the new group from the acquired collected data pieces.
Each of the diagnosis devices 61 and 62 includes a collector 110, a diagnoser 140, a receiver 611 that receives the diagnosis model 141 transmitted from the learning device 60, and a transmitter 612 that transmits a diagnosis result from the diagnoser 140 to the learning device 60. When the transmitter 601 in the learning device 60 transmits the new diagnosis model 141, the diagnoser 140 diagnoses presence or absence of an abnormality with the new diagnosis model 141.
As described above, multiple diagnosis devices 61 and 62 each including the diagnoser 140 are used for the single learning device 60 including the learner 130 in the present embodiment. Thus, the diagnosis system 100 can collect more data pieces of diagnosis targets and distribute the diagnosis models 141 at once, and thus facilitate management of the diagnosis models 141. The diagnosis system 100 can also transmit the diagnosis model 141 after adjusting the diagnosis model 141 for each of the diagnosis devices 61 and 62.
Although embodiments of the present disclosure have been described above, the present disclosure is not limited to the above embodiments.
In the above embodiments, for example, the learning data storage 120 and the new-group candidate storage 170 are separate components. In some embodiments, a single storage device may include a storage area corresponding to the learning data storage 120 and a storage area corresponding to the new-group candidate storage 170.
Data pieces determined as belonging to an existing group by the extractor 160 and excluded from extraction of candidates to belong to a new group may be stored into the learning data storage 120 and appear on the display 191. When the user finds an error in a diagnosis result after evaluating the appropriateness of the diagnosis result, the user may operate the input device 192 to correct the diagnosis result. For example, as shown in
In addition to a data piece determined as belonging to an unknown group, the new-group generator 180 may also classify, into multiple new groups, data pieces stored in the learning data storage 120 and belonging to a single one of the existing groups excluded from extraction performed by the extractor 160. For example, as shown in
Instead of those described in the above embodiment, information stored in the learning data storage 120 and the new-group candidate storage 170 may be in any form. For example, when the collector 110 collects image data, link data used for referring to the image data may be stored into the learning data storage 120.
An example method for learning the diagnosis model 141 may be any supervised learning method. For example, a classification method using a decision tree as shown in
The model updating process may be started at a timing other than the timing of an update instruction from a user. For example, the model updating process may be automatically started immediately after the completion of the new-group generation process or after the elapse of a predetermined time after the update of the previous diagnosis model. Additionally, the display 191 may display information stored in the learning data storage 120 as support information that supports the user to determine the details of the update instruction.
To improve the accuracy of diagnosis in accordance with the diagnosis model 141, the learner 130 and the diagnoser 140 may perform preprocessing on data as appropriate, such as normalization or interpolation of missing values.
The functions of the diagnosis system 100 can be performed by either dedicated hardware or a common computer system.
For example, the program P1 executed by the processor 11 may be stored into a non-transitory computer-readable recording medium for distribution. The program P1 is installed on a computer to provide a device that performs the above processing. Examples of such a non-transitory recording medium include a flexible disk, a compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), and a magneto-optical disk (MO).
In some embodiments, for example, the program P1 may be stored in a disk device included in a server on a communication network, typically the Internet, and may be, for example, superimposed on a carrier wave to be downloaded to a computer.
The above processing may also be performed by the program P1 being activated and executed while being transferred through a communication network.
The above processing may also be performed by the program P1 being entirely or partially executed on a server with a computer transmitting and receiving information on the processes through a communication network.
In the system with the above functions implementable partly by the operating system (OS) or through cooperation between the OS and applications, portions executable by applications other than the OS may be stored in a non-transitory recording medium that may be distributed or may be downloaded to the computer.
Means for implementing the functions of the diagnosis system 100 is not limited to software. The functions may be partly or entirely implemented by dedicated hardware including circuits.
The foregoing describes some example embodiments for explanatory purposes. Although the foregoing discussion has presented specific embodiments, persons skilled in the art will recognize that changes may be made in form and detail without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. This detailed description, therefore, is not to be taken in a limiting sense, and the scope of the invention is defined only by the included claims, along with the full range of equivalents to which such claims are entitled.
The present disclosure is appropriate for detecting abnormality in a factory.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/014646 | 3/30/2020 | WO |