The present disclosure relates to a display data generation device, a display data generation method, and a program.
In a facility such as a factory, monitoring signals collected in the facility is commonly performed in order to promptly resolve an abnormality occurring in the facility. Therefore, applying a technique for monitoring signals and notifying a user of the occurrence of an abnormality to such a facility is conceivable (refer to, for example, Patent Literature 1).
Patent Literature 1 describes a device that overlaps a plurality of waveforms cut out from received digital signals and displays the overlapped waveforms. Since this device displays the overlapped waveforms obtained by overlapping both normal waveforms and abnormal waveforms without distinguishing between the normal and abnormal waveforms, the user can visually recognize the abnormal waveforms.
Patent Literature 1: Unexamined Japanese Patent Application Kokai Publication No. 2007-333391
The device disclosed in Patent Literature 1 is effective in a case in which the normal waveforms are uniformly determined. However, even in a situation where no abnormality occurs, signals collected in the facility generally vary in waveform due to various factors, and there is a case in which a plurality of waveforms may be allowed as a normal waveform. For this reason, when the device of Patent Literature 1 is used for monitoring an abnormality in a facility, normal waveforms of a plurality of patterns are overlapped and the overlapped waveforms are displayed, and thus the abnormal waveforms are difficult to recognize. Therefore, there is room to present a method for displaying waveforms enabling the user to easily recognize whether the waveforms are abnormal.
In order to solve the aforementioned problem, an objective of the present disclosure is to present waveforms in a manner enabling a user to easily recognize whether the waveform is abnormal.
In order to achieve the aforementioned objective, a display data generation device according to the present disclosure includes: acquisition means for acquiring an input signal; waveform generation means for (i) extracting, from waveform patterns predetermined as normal waveform patterns, a waveform pattern having the highest degree of similarity to the input signal for each interval of the input signal by using a degree of similarity that is a degree to which waveforms are similar to each other and (ii) generating a comparison waveform based on the waveform pattern extracted for each interval; and data generation means for generating and outputting display data for displaying a waveform of the input signal and the comparison waveform.
According to the present disclosure, display data for displaying the waveform of the input signal and the comparison waveform is generated. The comparison waveform is generated from a waveform pattern similar to the input signal. Therefore, the comparison waveform has a shape close to the input signal and the shape is based on a predetermined waveform pattern. Accordingly, even if the waveform of the input signal changes to some extent in a situation where no abnormality occurs, the comparison waveform has a fixed shape. If such a comparison waveform is compared with the input signal, it is considered that the user can easily recognize the abnormal waveform of the input signal. Therefore, the waveform can be displayed such that the user can easily recognize whether there is an abnormality in the waveform.
A display data generation device 10 according to an embodiment of the present disclosure is described below in detail with reference to drawings.
The display data generation device 10 according to the present embodiment is a factory automation (FA) device installed in a factory and is included in a production system that produces products. This production system has a function of using sensors to monitor a plurality of types of workpieces flowing on a production line. The display data generation device 10 acquires outputs of the sensors, and when an abnormality occurs, the display data generation device 10 displays to a user, in addition to signals actually output from the sensors, a signal that is supposed to be displayed when there is no abnormality, thereby presenting to the user a signal corresponding to the abnormality in an easily understandable way.
Operation modes of the display data generation device 10 include (i) an analysis mode for analyzing a signal during normal operation and detecting an abnormality and (ii) a learning mode for learning a normal waveform pattern as preparation for detecting the abnormality. In order to make the display data generation device 10 operate in these operation modes, as illustrated in
The acquisition unit 11 includes an input terminal for inputting a signal from the exterior of the display data generation device 10. The acquisition unit 11 acquires the signal input from outside of the display data generation device 10 and transmits the signal to the processing unit 12. Hereinafter, a signal acquired by the acquisition unit 11 in the learning mode is referred to as a learning signal, and a signal acquired by the acquisition unit 11 in the analysis mode is referred to as an input signal. These signals acquired by the acquisition unit 11 are digital signals and are signals indicating time-series voltage values sampled at fixed intervals. The fixed interval is, for example, 1 ms, 10 ms, or 100 ms. The acquisition unit 11 functions as acquisition means specified in the Claims.
The processing unit 12 performs processing such as noise removal on the signal received from the acquisition unit 11. The processing by the processing unit 12 is executed as preprocessing for (i) learning performed by the learning unit 13 described later and (ii) a determination made by the determination unit 15. The processing unit 12 processes the learning signal, transmits the processed learning signal to the learning unit 13, processes the input signal, and transmits the processed input signal to the determination unit 15.
The learning unit 13 learns a normal pattern from a waveform of the learning signal received from the processing unit 12. Usually, in a production system, a signal indicating the output of a sensor has a plurality of waveforms having normal patterns corresponding to a sensing target. The learning unit 13 classifies the waveform of the learning signal having such a waveform and stores a classification result in the storage unit 14 as waveform pattern information 141 indicating a normal pattern. The learning unit 13 functions as learning means specified in the Claims.
The storage unit 14 stores the waveform pattern information 141 stored by the learning unit 13 and supplies the waveform pattern information 141 to the determination unit 15 and the generation unit 16 as necessary.
The determination unit 15 determines, based on the waveform pattern information 141, whether the input signal received from the processing unit 12 is abnormal. Specifically, the determination unit 15 (i) determines that the waveform of the input signal is normal when the waveform of the input signal is similar to one of the waveform patterns indicated by the waveform pattern information 141 or (ii) determines that the waveform of the input signal is abnormal when the waveform of the input signal is not similar to any of waveform patterns indicated by the waveform pattern information 141. The determination unit 15 transmits the input signal and a determination result to the generation unit 16. The determination unit 15 functions as determination means specified in the Claims.
The generation unit 16 includes (i) a waveform generation module 161 to generate a comparison waveform with which the waveform of the input signal is compared and (ii) a data generation module 162 to generate display data for displaying the waveform of the input signal, the comparison waveform, and the determination result by the determination unit 15. The comparison waveform is a waveform obtained by inferring, from the normal waveform patterns indicated in the waveform pattern information 141, a normal waveform of a signal supposed to be displayed when there is no abnormality.
The waveform generation module 161 generates the comparison waveform from (i) the input signal received from the determination unit 15 and (ii) the waveform pattern information 141 read from the storage unit 14. Specifically, the waveform generation module 161 synthesizes a synthesis pattern by combining waveform patterns similar to the input signal and generates the comparison waveform by sequentially executing this synthesis. The waveform generation module 161 does not use the result of the determination made by the determination unit 15 when generating the comparison waveform. The waveform generation module 161 functions as waveform generation means specified in the Claims.
The data generation module 162 generates display data for displaying, side by side, the waveform of the input signal received from the determination unit 15, the comparison waveform generated by the waveform generation module 161, and the determination result by the determination unit 15. The data generation module 162 outputs the generated display data to the display unit 17. The data generation module 162 functions as data generation means specified in the Claims.
The display unit 17 displays to the user a screen image generated using the display data output from the generation unit 16.
In order to achieve the above-described functions, as illustrated in
The processor 21 includes a micro processing unit (MPU). The processor 21 realizes various functions of the display data generation device 10 by executing a program P1 stored in the auxiliary storage unit 23 and executes processing described below.
The main storage unit 22 includes a random access memory (RAM). The program P1 is loaded from the auxiliary storage unit 23 into the main storage unit 22. The main storage unit 22 is used as a work area for the processor 21.
The auxiliary storage unit 23 includes a nonvolatile memory such as an electrically erasable programmable read-only memory (EEPROM). The auxiliary storage unit 23 stores various types of data used for processing by the processor 21 in addition to the storing of the program P1. The auxiliary storage unit 23 supplies, to the processor 21, data to be used by the processor 21 and stores data supplied from the processor 21 in accordance with instructions from the processor 21.
The input unit 24 includes an input device such as input keys and a pointing device. The input unit 24 acquires information input by the user of the display data generation device 10 and notifies the processor 21 of the acquired information.
The output unit 25 includes output devices such as a liquid crystal display (LCD) and a speaker. The output unit 25 presents various types of information to the user in accordance with instructions from the processor 21.
The communication unit 26 includes an input terminal or a network interface circuit for communicating with an external device. The communication unit 26 receives a signal from the outside and outputs, to the processor 21, data of a voltage value indicated by this signal. Also, the communication unit 26 may transmit, to the external device, a signal indicating data output from the processor 21.
Among these components of the hardware configuration, the processor 21 realizes the processing unit 12, the learning unit 13, the determination unit 15, and the generation unit 16 that are illustrated in
Subsequently, display data generation processing executed by the display data generation device 10 is described in detail with reference to
In the display data generation processing, the display data generation device 10 executes learning processing (step S1). The execution of the learning processing is equivalent to operation in the learning mode. The details of the learning processing are described below with reference to
In the learning processing illustrated in
Again with reference to
Next, the learning unit 13 classifies the waveform patterns of the learning signal processed by the processing unit 12 (step S13). Specifically, the learning unit 13 uses a so-called pattern recognition technique to classify the waveform pattern included in the learning signal. The pattern recognition technique is, for example, a support vector machine (SVM) or deep learning of a neural network. Three waveform patterns A, B, and C classified by the learning unit 13 are illustrated in the lower portion of
Again with reference to
Again with reference to
Next, the processing unit 12 processes the input signal (step S3). This processing is processing that is equivalent to the processing performed on the learning signal in the learning processing. As a result, the noise is removed from the input signal as illustrated in the middle portion of
Again with reference to
The results of determinations made by the determination unit 15 are schematically illustrated in the lower portion of
The determination by the determination unit 15 is described in more detail with reference to
As illustrated in
D=1/(1+Σ(L(t)−W(t))2) (1)
According to the above-described equation (1), the degree of similarity D is a value in the range from 0 to 1. The degree of similarity is 1 for a waveform pattern that completely matches the input signal. For this reason, the similarity evaluated by the degree of similarity includes the case where the waveforms completely match the wave form of the input signal. A technique for calculating the degree of similarity is not limited to the above-described equation (1) and the above-described equation (1) may be optionally changed to another one.
As illustrated in
Again with reference to
Next, the generation unit 16 generates display data (step S6). Specifically, the data generation module 162 generates display data for displaying, side by side, (i) the waveform of the input signal, (ii) the comparison waveform generated in step S5, and (iii) the determination results obtained in step S4.
When the degree of similarity D is calculated by the equation (1), the abnormality degree F. can be calculated by using a equation F=1−D. The degree of abnormality indicates a degree to which the waveform of the input signal deviates from the normal waveform patterns and the input signal is abnormal. However, a method of calculating the degree of abnormality is not limited to this, and the above-described method may be optionally changed to another method. Further, the screen image displayed based on the display data may include the degree of similarity instead of the degree of abnormality or may include the degree of similarity in addition to the degree of abnormality.
Again with reference to
Afterward, the display data generation device 10 shifts the processing to step S2. For this reason, results of analysis of the input signal sequentially input to the display data generation device 10 are displayed in real time. As a result, the user can observe the presence or absence of abnormality at the current time in the production line.
Subsequently, the details of the waveform generation processing in step S5 is described with reference to
The upper left portion of
Again with reference to
In the lower left portion of
As illustrated in the upper left portion and the lower left portion of
Again with reference to
In
Again with reference to
Again with reference to
As illustrated in
As described above, the display data generation device 10 generates display data for displaying the waveform of the input signal and the comparison waveform. The comparison waveform is generated by synthesizing a synthesis pattern from a waveform pattern similar to the waveform of the input signal. Therefore, the comparison waveform has a shape close to the shape of the input signal and this shape is based on the predetermined waveform patterns. As a result, even if the waveform of the input signal changes to some extent in a situation where no abnormality occurs, the comparison waveform has a fixed shape. If such a comparison waveform is compared with the input signal, the user is considered to be able to easily recognize the abnormal waveform of the input signal. Therefore, the display data generation device 10 can present a screen image enabling the user to easily recognize whether there is an abnormality in the waveform.
Also, the determination unit 15 determines, for the waveform pattern having the highest degree of similarity to the input signal, whether this highest degree of similarity is equal to or greater than the threshold. In other words, the determination unit 15 determines, for each portion cut out from the input signal at the interval, whether a degree of similarity between each portion cut out from the input signal and every waveform pattern indicated by the waveform pattern information 141 is lower than the threshold. The display data generated by the display data generation device 10 is data for displaying the determination results obtained by the determination unit 15 as to the presence or absence of abnormality in addition to the waveform of the input signal and the comparison waveform. For this reason, the user can reliably recognize the presence or absence of abnormality of a signal. As a result, the user can quickly achieve a recovery from an abnormal state and easily find the cause of the abnormality.
Also, the display data generation device 10 includes the learning unit 13 that learns the normal patterns. By learning the normal patterns, the comparison waveform attains a shape that matches the normal waveform pattern when there is no abnormality in the input signal. If the input signal is abnormal, the comparison waveform, in a range similar to the input signal, attains a shape that the input signal is supposed to have when the input signal is not abnormal. In other words, the comparison waveform can be regarded as a normal waveform inferred from the input signal. For this reason, it is expected that the user will be able to easily recognize the abnormality by referring to the comparison waveform.
Also, the display data generation device 10 repeats the processing in steps S2 to S7 as illustrated in
Also, as illustrated in
Although the embodiment of the present disclosure is described above, the present disclosure is not limited to the above-described embodiment.
For example, although the display data generation device 10 is installed in a factory, the display data generation device 10 may be installed in a facility other than a factory. Moreover, although the display data generation device 10 is included in the production system, the display data generation device 10 may be included in a manufacturing system, a processing system, an inspection system, or another system. Alternatively, the display data generation device 10 may be an independent device without being included in a system. Furthermore, the signal input to the display data generation device 10 is a time-series signal of the output value of the sensor. However, the present disclosure is not limited to this, and it is sufficient as long as the signals used for the present disclosure indicate a pattern.
Also, the learning signal and the input signal are not limited to digital signals. In a case in which the learning signal and the input signal are analog signals, when the processing unit 12 performs an analog-to-digital (A/D) conversion, the display data generation device 10 can be configured to be equivalent to the above-described embodiment.
Additionally, although the example in which the acquisition unit 11 acquires the learning signal and the input signal input from the outside to the input terminal and the display data is updated in real time with respect to the input signal is described above, the present disclosure is not limited to this. The acquisition unit 11 may acquire the learning signal and the input signal by reading data whose address is specified by the user and display data may be generated by batch processing for the input signal.
Additionally, although the display data generation device 10 generates the waveform pattern information 141 by the learning processing performed by the learning unit 13, the present disclosure is not limited to this. The display data generation device 10 may be configured without the learning unit 13 and the waveform pattern information 141 stored in the storage unit 14 may be used by the user.
Also, as illustrated in
Also, as illustrated in
Also, a method of synthesizing the synthesis pattern is not limited to a method performed by taking the average of the waveform patterns as illustrated in
The method of synthesizing the synthesis pattern includes adopting one of the waveform patterns. For example, a waveform pattern having a high degree of similarity may be used as a synthesis pattern as is.
Also, in the above-described embodiment, the value of the synthesis pattern in the range where intervals overlap each other is used as the value of the comparison waveform. However, a value outside the overlapping range may be used.
In the above-described embodiment, as illustrated in
In the above-described embodiment, the previous interval is an interval obtained by shifting the latest interval back by one sampling period. However, the present disclosure is not limited to this. That is, an amount by which the interval is shifted may be optionally changed to another amount, and the width of the portion where the intervals overlap each other may be optionally set.
In addition, although two intervals are defined for synthesizing the synthesis pattern, the present disclosure is not limited to this. The waveform generation module 161 may synthesize a synthesis pattern from waveform patterns similar to the input signal in each of three or more intervals.
In the above-described embodiment, the case where the intervals overlap each other is described. However, if the intervals do not overlap each other, the comparison waveform may be formed by connecting waveform patterns each having the highest degree of similarity in each interval without synthesizing the synthesis pattern.
In the above-described embodiment, steps S2 to S7 illustrated in
Also, the functions of the display data generation device 10 can be realized by dedicated hardware or by a normal computer system.
For example, the program P1 executed by the processor 21 is stored in a non-transitory computer-readable recording medium, the recording medium storing the program P1 is distributed, and the program P1 is installed in the computer, thereby configuring a device that executes the above-described processing. For example, a flexible disk, a compact disc-read-only memory (CD-ROM), a digital versatile disc (DVD), and a magneto-optical disc (MO) can be considered as such a recording medium.
Also, the program P1 may be stored in a disk device included in a server device on a communication network such as the Internet and may be downloaded onto a computer, for example, by superimposing the program on a carrier wave.
Also, the above-described processing can be achieved by starting and executing the program P1 while transferring the program P1 through the communication network.
Additionally, the above-described processing can also be achieved by executing all of or a portion of the program P1 on the server device and executing the program while the computer are transmitting and receiving information on the processing via the communication network.
When the above-described functions are realized (i) by sharing tasks with an operating system (OS) or (ii) by cooperation between the OS and an application, only portions of the program P1 other than a portion of the program P1 executed by the OS may be stored in the medium and the medium may be distributed. Alternatively, such portions of the program P1 may be downloaded to a computer.
Also, the means for realizing the functions of the display data generation device 10 is not limited to software, and a part of or all of the functions may be realized by dedicated hardware including a circuit.
The foregoing describes some example embodiments for explanatory purposes. Although the foregoing discussion has presented specific embodiments, persons skilled in the art will recognize that changes may be made in form and detail without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. This detailed description, therefore, is not to be taken in a limiting sense, and the scope of the invention is defined only by the included claims, along with the full range of equivalents to which such claims are entitled.
The present disclosure is suitable for monitoring the presence or absence of an abnormality.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2018/005524 | 2/16/2018 | WO | 00 |