The present disclosure relates to an anomaly diagnosis device, an anomaly diagnosis method, and an anomaly diagnosis program each for diagnosing an anomaly of an electrical device.
In a typical assembly process of an electrical device, an operation test is performed on the electrical device during or after completion of the assembly process. In addition, a sensory test is performed during the operation test to confirm acceptability of the electrical device in terms of whether there is no anomaly in a vibration or an operation sound generated from the electrical device. Such sensory test is performed using auditory sense or tactile sense of the operator, and is therefore characterized in dependency on the sense of the operator. Thus, to quantify information concerning a vibration or an operation sound used as the basis for determining acceptability, the sensory test is sometimes performed using a diagnostic device that converts the information concerning the vibration or the operation sound obtained by a device such as a microphone or a vibration sensor, into waveform data, and performs signal processing on the waveform data.
Patent Literature 1 described below discloses a technology in which a comparison is made between a spectrum pattern obtained by performing fast Fourier transform (FFT) processing on waveform data of a vibration generated from an electrical device and a preset known spectrum pattern in an anomalous case, and a diagnosis is made of whether the electrical device is in an anomalous condition on the basis of the comparison result.
As described above, the technology of Patent Literature 1 mentioned above makes a determination of an anomaly using only a spectrum pattern. The technology of Patent Literature 1 accordingly presents a problem in difficulty in determination of the type of anomaly in a case where different types of anomalies show a same spectrum pattern, for example, when anomalies have a same spectrum pattern as each other, but occur at intervals different from each other. In addition, the technology of Patent Literature 1 mentioned above allows a determination to be made about a known anomaly such as one having a spectrum pattern of waveform data that changes over time, but presents a problem in difficulty in making a determination about an unknown anomaly different from an anomaly usually sensed by the operator.
The present disclosure has been made in view of the foregoing, and it is an object of the present disclosure to provide an anomaly diagnosis device capable of determining known and unknown anomalies different from a usual anomaly.
To solve the problem and achieve the object described above, an anomaly diagnosis device according to the present disclosure includes a microphone that converts a sound from a determination target into an analog electrical signal, and a signal converter that converts the analog electrical signal into a digital signal. A signal processing device that receives the digital signal and performs signal processing includes a signal processing unit, a data storage unit, and a determination unit. The signal processing unit performs short-time fast Fourier transform on waveform data of an input signal, and calculates feature quantities. The data storage unit stores feature quantity data based on data of a known normal waveform. The determination unit compares first feature quantity data with second feature quantity data, and determines acceptability of the waveform data of the input signal, where the first feature quantity data consists of multiple ones of the feature quantities calculated by the signal processing unit, and the second feature quantity data is the feature quantity data stored in the data storage unit. The feature quantities are each a quantity representing a degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in waveform data.
An anomaly diagnosis device according to the present disclosure provides an advantage in capability of determining known and unknown anomalies different from a usual anomaly.
An anomaly diagnosis device, an anomaly diagnosis method, and an anomaly diagnosis program according to embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the embodiments described below are provided as examples, and the scope of the present disclosure is not limited by the following embodiments.
The microphone 2 converts a sound including an operation sound of a determination target 1 into an analog electrical signal. The signal converter 3 is an analog-to-digital (AD) converter, which converts the analog electrical signal output from the microphone 2 into a digital signal. The signal processing device 10 receives the digital signal output from the signal converter 3 and performs signal processing described later. Note that the anomaly diagnosis device 100 may include multiple ones of the signal processing device 10.
In the signal processing device 10, the signal processing unit 4 performs necessary computation on waveform data of an input signal to calculate feature quantities. The feature quantities are each a quantity representing the degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in the waveform data, in other words, how greatly the amount of change in spectral intensity of a specific frequency band varies in a time elapse direction.
The data storage unit 5 stores feature quantity data based on data of a known normal waveform. The determination unit 6 compares feature quantity data consisting of multiple ones of the feature quantities calculated by the signal processing unit 4 with the feature quantity data based on data of a known normal waveform, stored in the data storage unit 5, and determines acceptability of the waveform data of the input signal input to the signal processing device 10.
Note that a data group consisting of multiple ones of the feature quantities calculated by the signal processing unit 4 may be referred to herein as “first feature quantity data”, and the feature quantity data, or a set of the feature quantity data, based on data of a known normal waveform, stored in the data storage unit 5 may be referred to herein as “second feature quantity data”.
The microphone 2 can be a commonly-used general-purpose microphone, but desirably prevents an ambient noise from being included to a maximum possible extent in the operation sound generated from the determination target 1. This can be achieved by use of a sound collecting microphone having sound collection directivity, use of a parabolic-type sound collecting microphone combining a commonly-used microphone and a parabolic reflection plate, or use of an appropriate combination of these types of sound collecting microphones.
The signal converter 3 can be a commonly-used audio interface. In this respect, use of an audio interface having a high sampling frequency is desirable because this allows a wide range in the frequency direction to be used in an FFT operation performed in the signal processing described later. Note that when the signal processing device 10 has functionality equivalent to the functionality of the signal converter 3, such functionality may be used.
Processing of the signal processing device 10 can be performed using a commonly-used computer or programmable logic controller (PLC). A PLC is also called sequencer. Alternatively, processing of the signal processing device 10 may be performed using an electronic circuit board including a device for signal processing and a storage medium. Examples of the device for signal processing include a microcomputer and a field programmable gate array (FPGA), and examples of the storage medium include non-volatile and volatile semiconductor memories such as a random access memory (RAM), a flash memory, an erasable programmable read-only memory (EPROM), and an electrically erasable programmable read-only memory (EEPROM) (registered trademark). The signal processing device 10 is capable of performing a sequence of operations according to a procedural process, from reception of waveform data up to the determination. The signal processing device 10 may further include a screen that allows specification of, and can display, the status of determination. In this case, the operator is allowed to configure settings required for determination processing using the screen, and the state of determination and a result thereof can be displayed on the screen for informing the operator of such information.
An algorithm of determination processing for use in the signal processing device 10 will next be described. The signal processing unit 4 performs short-time fast Fourier transform (STFT) on the waveform data obtained by the conversion performed by the signal converter 3. In STFT, the waveform data is divided into an arbitrary number of blocks in each of a frequency direction and a time direction. The result of the STFT processing is expressed by a matrix F having “i” frequency dimensions and “j” time dimensions expressed by Equation (1) below.
In Equation (1) above, “i” represents the number of divisions of the waveform data in the frequency direction, and “j” represents the number of divisions of the waveform data in the time direction.
In addition, the signal processing unit 4 calculates a feature quantity vector T expressed by Equation (2) below, whose elements are feature quantities, which are the standard deviations of spectral intensity in the time direction in the matrix F, on the basis of the matrix F, which is the result of the STFT processing.
In Equation (2) above, a feature quantity t at an arbitrary frequency i among the elements t1, . . . , and ti of the feature quantity vector T is calculated by Equation (3) below.
In Equation (3) above, “f−” is an alternative expression representing a character “f” having a symbol “−” thereabove. In addition, “f−l” represents the average value of the j elements fi,l, . . . , and fi,j of the i-th row of Equation (1) above.
As described above, the data storage unit 5 stores the feature quantity data based on data of a known normal waveform. The feature quantity data stored in the data storage unit 5 is also calculated by STFT. Now, let k denote the number of sets of the data of a known normal waveform, and let T′k denote a set of feature quantities based on the multiple sets of the data of a known normal waveform. T′l is a feature quantity vector calculated using waveform data 1, which is first waveform data, and T′k is a feature quantity vector calculated using waveform data k, which is k-th waveform data. In addition, data of an average υ and of a standard deviation σ of the set T′k is referred to herein as second feature quantity data. The average υ and the standard deviation σ can be expressed by Equations (4) and (5) below. In this respect, the value of k, which is the number of sets of the data of a known normal waveform, is desirably at least 100 or higher.
Note that the average υ and the standard deviation σ expressed by Equations (4) and (5) above are herein given as an example of the second feature quantity data. A statistic other than the average υ and the standard deviation σ may be stored in the data storage unit 5 as the second feature quantity data.
As described above, the determination unit 6 determines acceptability of the waveform data of the input signal that has been input. This determination processing uses a determination metric Zi expressed by Equation (6) below.
The determination metric Zi is used to determine the degree of discrepancy between the first feature quantity data and the second feature quantity data. The determination unit 6 compares the value of the determination metric Zi with a predetermined threshold on a per-frequency band basis, and when at least one or some of the values of the determination metric Zi is greater than the threshold, the determination unit 6 determines that the waveform data subjected to determination has an anomaly or is in a state deviating from a normal state.
Note that, in the STFT processing described above, a filter bank operation illustrated in
The filter bank operation is an operation in which the matrix F, which is the result of the STFT processing, is divided into i′ (i′<i) blocks of the waveform data in the frequency direction, and is divided into j′ (j′<j) blocks of the waveform data in the time direction. Specifically,
As illustrated in the left-side diagram of
Note that the operation illustrated in
Appropriately setting the numbers of divisions i′ and j′ allows the feature of the sound from the determination target 1 to be emphasized in the reunified matrix F′. Thus, use of the reunified matrix F′ obtained using the filter bank operation can improve accuracy of the determination of acceptability of the waveform data.
The computer stores the second feature quantity data, i.e., data of feature quantities each representing the degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in the data of a known normal waveform. The computer further stores a program for providing the functionality of each of the microphone 2, the signal converter 3, and the signal processing device 10 described above. Alternatively, the computer is configured to enable such program to be loaded externally thereof and executed.
The computer converts an operation sound of an electrical device into an analog electrical signal (step S11). The computer converts the analog electrical signal obtained by the conversion at step S11 into a digital signal (step S12). The computer performs STFT on the waveform data obtained by the conversion at step S12, and calculates feature quantities (step S13).
The computer compares a value of the determination metric Zi with a threshold. The determination metric Zi is based on first feature quantity data consisting of multiple ones of the feature quantities calculated at step S13 and on second feature quantity data stored in the computer (step S14). Details of the operation at step S14 is as follows. As described above, the feature quantity vector T representing the first feature quantity data is expressed by Equation (2) above, and the feature quantity vector T has elements each expressed by Equation (3) above. In addition, an example of the determination metric Zi is expressed by Equation (6) above.
The computer determines whether any value of the determination metric Zi is greater than the threshold (step S15). When no value of the determination metric Zi is greater than the threshold (step S15, No), the computer determines that the electrical device is in a normal condition (step S16). Alternatively, when at least one value of the determination metric Zi is greater than the threshold (step S15, Yes), the computer determines that the electrical device is not in a normal condition or may be in an anomalous condition (step S17).
Use of the flowchart of
As also described in the section of “Problem to be solved by the Invention”, the conventional technology makes a determination of an anomaly using only a spectrum pattern, which presents a problem in difficulty in determining the type of anomaly for anomalies having a same spectrum pattern as each other, but occurring at intervals different from each other. The conventional technology also presents a problem in difficulty in making a determination about an unknown anomaly different from an anomaly usually sensed by the operator. In contrast, the anomaly diagnosis method according to the first embodiment determines whether the waveform data subjected to determination has an anomaly on the basis of the degree of discrepancy between a feature quantity of the waveform data subjected to determination and a feature quantity of data of a known normal waveform stored in the computer. This enables determination of acceptability of the waveform data to be made even for an unknown anomaly.
Note that although the above description has been provided assuming that the computer stores feature quantities of the data of a known normal waveform, the present disclosure is not limited thereto. It is sufficient that feature quantities of the data of a known normal waveform can be referred to by the computer, and such feature quantities may be held in a storage unit or in a storage area that is no component of the computer. That is, it is sufficient that the computer be configured to be able to refer to the feature quantities of the data of a known normal waveform.
As described above, the anomaly diagnosis device according to the first embodiment includes a microphone that converts a sound from a determination target into an analog electrical signal, and a signal converter that converts the analog electrical signal into a digital signal. The signal processing device, which receives the digital signal and performs signal processing, includes a signal processing unit, a data storage unit, and a determination unit. The signal processing unit performs short-time fast Fourier transform on waveform data of an input signal, and calculates feature quantities. The data storage unit stores feature quantity data based on data of a known normal waveform. The determination unit compares first feature quantity data with second feature quantity data, and determines acceptability of the waveform data of the input signal, where the first feature quantity data consists of multiple ones of the feature quantities calculated by the signal processing unit, and the second feature quantity data is the feature quantity data stored in the data storage unit. The feature quantities are each a quantity representing the degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in the waveform data. The anomaly diagnosis device configured in such a manner determines whether the waveform data subjected to determination has an anomaly on the basis of the degree of discrepancy between the feature quantities of the waveform data subjected to determination and the feature quantities of the data of a known normal waveform, stored in the data storage unit. This enables determination of known and unknown anomalies different from a usual anomaly such as one in which the spectrum pattern changes over time.
Note that, in the foregoing operation, the signal processing device may perform a filter bank operation on the feature quantities generated through short-time fast Fourier transform, and then generate the first feature quantity data on the basis of the feature quantities obtained through the filter bank operation. This enables the width in the time direction or the width in the frequency direction to be arbitrarily changed in obtaining the first feature quantity data. This can improve accuracy of the determination of acceptability of the waveform data.
In addition, the anomaly diagnosis method according to the first embodiment is a method for diagnosing an anomaly of an electrical device using a computer configured to be able to refer to a feature quantity representing the degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in data of a known normal waveform. This anomaly diagnosis method includes first through fourth steps described below. The first step is a step of converting an operation sound of the electrical device into an analog electrical signal. The second step is a step of converting the analog electrical signal into a digital signal. The third step is a step of performing short-time fast Fourier transform on waveform data obtained by the conversion performed in the second step, and of calculating feature quantities. The fourth step is a step of comparing first feature quantity data consisting of multiple ones of the feature quantities calculated in the third step with second feature quantity data stored in the computer, and of determining acceptability of the waveform data. Causing the computer to perform the first through fourth steps enables determination of known and unknown anomalies different from a usual anomaly such as one in which the spectrum pattern changes over time.
Moreover, an anomaly diagnosis program according to the first embodiment is a program that causes a computer to diagnose an anomaly of an electrical device, where the computer is configured to be able to refer to a feature quantity representing a degree of non-uniformity in temporal change of spectral intensity of a specific frequency band included in data of a known normal waveform. This anomaly diagnosis program includes first through fourth steps described below. The first step is a step of converting an operation sound of the electrical device into an analog electrical signal. The second step is a step of converting the analog electrical signal into a digital signal. The third step is a step of performing short-time fast Fourier transform on waveform data obtained by the conversion performed in the second step, and of calculating feature quantities. The fourth step is a step of comparing first feature quantity data consisting of multiple ones of the feature quantities calculated in the third step with second feature quantity data stored in the computer, and of determining acceptability of the waveform data. Causing the computer to execute the program including the first through fourth steps enables determination of known and unknown anomalies different from a usual anomaly such as one in which the spectrum pattern changes over time.
The configuration of the anomaly diagnosis device according to the first embodiment illustrated in
An operation of the anomaly diagnosis device according to the second embodiment will next be described. As described above, the configuration in the first embodiment may allow an ambient noise to enter, and may cause the noise to be misidentified as an anomalous sound. The anomaly diagnosis device according to the second embodiment accordingly estimates the time section in which ambient noise is present, using waveform data collected using the noise collecting microphones 11. The technique described in the first embodiment is then applied to waveform data obtained by removal of the time section estimated. Such operation can provide a determination technique that reduces the effect of ambient noise.
An algorithm of an estimation process to be used in the second embodiment will next be described with reference to
First, assume that the matrix F expressed by Equation (1) above and the feature quantity vector T expressed by Equation (2) above have been obtained from waveform data of audio signals collected by the microphone 2 and by the noise collecting microphones 11. In this situation, let s(t) denote a feature vector obtained from the microphone 2, and n1(t), n2(t), and n3(t) denote respective feature vectors obtained from the three noise collecting microphones 11.
In
In Equation (7) above, the symbol “∘” is an operator of multiplication of each element of the vector. Note that the constant vector w representing the characteristics of the filter 22 is a vector whose elements are constants obtained by appropriately calculating the attenuation rate of each element. The attenuation rate of each element may be calculated in any manner.
Equation (7) above means that a feature quantity of the noise can be calculated by multiplication of a sum of sound pressure levels of the three noise collecting microphones 11, by a constant. Thus, a period in which a feature quantity of the noise calculated by Equation (7) above is greater than a predetermined threshold can be estimated to be the period in which a noise is present. Accordingly, making a determination using the above-mentioned algorithm after removing the estimated period, i.e., the period in which a noise is present, enables determination of acceptability of the waveform data having a reduced effect of noise that has entered.
Characteristics of the filter 22 will next be discussed. First, having good characteristics of the filter 22 is equivalent to a small error between the actual noise d(t) observed by the microphone 2 and the estimated value set d˜(t) thereof. To consider this error, an observation signal matrix N expressed by Equation (8) below is defined.
In Equation (8) above, the symbol “T” indicates transpose. In addition, L represents the number of frames in the observation signal matrix N. Note that the number of frames L corresponds to the number of short-time frames in STFT.
A noise matrix D expressed by Equation (9) below is further defined, which represents actual noise observed by the microphone 2.
Now let Ni denote an operation of extracting an i-th column of the observation signal matrix N expressed by Equation (8) above to generate a column vector, and let Di denote an operation of extracting an i-th column of the noise matrix D expressed by Equation (9) above to generate a column vector. Furthermore, let wi denote an operation of extracting an i-th value of the constant vector w. With this notation, a square error “e” can be expressed as Equation (10) below, where “e” represents the square error for an i-th frequency in the matrix F, which represents the result of the STFT processing.
A value of wi that minimizes Equation (10) above is next calculated. This value of wi is the value of wi that causes (de/wi), which is the derivative of Equation (10) above with respect to wi, to reach zero, that is, the value of wi satisfying de/wi=0. This value is expressed by Equation (11) below.
Performing the operation of Equation (11) above on all values of “i” enables the constant vector w having optimum parameter values to be obtained. Note that the operation processing described above requires information about the noise d(t) collected by the microphone 2 and information about the feature vectors n1(t), n2(t), and n3(t) collected by the noise collecting microphones 11. Instead of this, an alternative technique can be used. An example of alternative technique is to use data recorded when only noise is present and no operation sound to be measured is present. In this technique, data may be used that has been generated by recording only noise in an actual noise environment, or data may be used that has been generated by recording a sound reproduced in a laboratory by a speaker from a signal corresponding to the noise. An example of the signal of the latter case can be an experimental signal having energy in all frequency bands and changing over time. An example of such experimental signal is a time-stretched-pulse (TSP) signal for use in a TSP method.
As described above, the anomaly diagnosis device according to the second embodiment further includes a noise collecting microphone for collecting ambient noise. The signal processing device estimates the time section in which ambient noise is present, using waveform data collected using the noise collecting microphone, performs short-time fast Fourier transform on waveform data obtained by removal of the time section estimated, and calculates feature quantities. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly.
In addition, the anomaly diagnosis method according to the second embodiment includes, between the second step and the third step of the anomaly diagnosis method described in the first embodiment, an estimation step of estimating the time section in which ambient noise is present, using waveform data collected using a noise collecting microphone for collecting ambient noise. Then, in the third step, short-time fast Fourier transform is performed on waveform data obtained by removal of the time section estimated in the estimation step, and the feature quantities are calculated. Such operation can provide a determination technique that reduces the effect of ambient noise. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly. Third Embodiment.
In the configuration of
In the third embodiment, the technique of determining whether waveform data has an anomaly is basically similar to that of the first embodiment. However, the configuration of the first embodiment may allow ambient noise to enter. In addition, when in an environment where ambient noise cannot be completely removed or noise enters continuously, the configuration of the second embodiment may cause misidentification of the noise as an anomalous sound. In contrast, the configuration of the third embodiment can attenuate the ambient noise by the sound insulation walls 12. The technique of the third embodiment is simple, but can provide a determination technique that reduces the effect of ambient noise.
As described above, the anomaly diagnosis device according to the third embodiment includes sound insulation walls arranged to surround the determination target. The sound insulation walls attenuate ambient noise, thereby enabling a determination technique that reduces the effect of ambient noise to be provided. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly.
In this configuration, the movable unit 13 can be a multi-joint robot, a linear robot, an air cylinder, an oil-hydraulic pressure cylinder, or the like. In addition, the movable control unit 14 can be a computer, a sequencer, or the like. The movable control unit 14 may include a position detection sensor, a camera, or the like for determining the movement of the movable unit 13.
In the fourth embodiment, the technique of determining whether waveform data has an anomaly is basically similar to that of the first embodiment. However, in a case where, for example, the determination target 1 is in motion in the first embodiment, a fixed position of the microphone 2 causes the distance between the determination target 1 and the microphone 2 to vary, thereby presenting a difficulty in stably measuring a sound from the determination target 1. The case where the determination target 1 is in motion is, for example, a case where the determination target 1 is placed on a belt conveyor and moving on a production line.
In contrast, the configuration of the fourth embodiment can cause the movable unit 13 to move according to the movement of the determination target 1 by the movable control unit 14. This can reduce or eliminate the change in the distance between the determination target 1 and the microphone 2, thereby enabling a sound from the determination target 1 to be stably measured.
Moreover, when the determination target 1 has a complex structure, it is likely that a long distance between the determination target 1 and the microphone 2 prevents obtaining a sufficient sound volume. Failure to obtain a sufficient sound volume means that waveform data having a sufficient amplitude is unobtainable. When waveform data having a sufficient amplitude is unobtainable, the waveform data may include no sound data required for the determination, which may result in a false determination. When the determination is made by the operator, the operator performs an inspection by bringing his or her ear close to the operation sound generating portion of the determination target 1. The configuration of the first embodiment has a difficulty in bringing the microphone 2 close to the operation sound generating portion of the determination target 1. In contrast, the configuration of the fourth embodiment can cause the movable unit 13 to move by the movable control unit 14 to allow the microphone 2 to be placed sufficiently near the operation sound generating portion of the determination target 1. This enables the microphone 2 to be placed to a closer position where a sufficient amplitude is obtainable to perform measurement. This enables waveform data having a sufficient amplitude to be obtained, and acceptability of the waveform data to be accurately determined.
As described above, the anomaly diagnosis device according to the fourth embodiment includes a movable unit for moving the microphone, and a movable control unit, which controls movement of the movable unit. This configuration allows the microphone to be brought close to the operation sound generating portion of the determination target. This enables waveform data having a sufficient amplitude to be obtained, and acceptability of the waveform data to be accurately determined.
The configuration of the anomaly diagnosis device according to the first embodiment illustrated in
An algorithm of an estimation process to be used in the fifth embodiment will next be described. First, the signal processing unit 4 performs STFT on the waveform data obtained by the conversion performed by the signal converter 3. In STFT, the waveform data is divided into an arbitrary number of blocks in each of the frequency direction and the time direction. This operation is the same as the operation performed in the first embodiment. The matrix F, i.e., the result of the STFT processing, is again given below by Equation (12) below.
In Equation (12) above, “i” represents the number of divisions of the waveform data in the frequency direction, and “j” represents the number of divisions of the waveform data in the time direction.
The signal processing unit 4 calculates a matrix R expressed by Equation (13) below for the matrix F, which is the result of the STFT processing.
In Equation (13) above, & represents a matrix including the elements of the vector of the average υ expressed by Equation (4) above, and is expressed by Equation (14) below.
As given by Equation (14) above, the matrix ε is a diagonal matrix, and the diagonal elements thereof are expressed by Equation (15) below.
As given by Equation (15) above, a diagonal element ei,i of the matrix ε is expressed by a reciprocal of the average υi.
The matrix R is calculated as information about the frequency of noise from a known normal product. In addition, the matrix R is expressed as a product of the matrix F and the matrix ε including the reciprocals of the averages υ as given by Equations (13) to (15) above, and is calculated as estimated values with respect to non-stationary noise. Note that when a sufficient number of averages υ have not been obtained, a unit matrix may be used instead of the matrix ε.
The signal processing unit 4 calculates a sum for each specific time period for each element of the matrix R, which represents an estimated value of non-stationary noise. A sum vector R′ can be expressed as Equation (16) below, where R′ represents a vector whose elements are the sums for each specific time period.
The signal processing unit 4 calculates the total average value of the sum vector R′, and identifies an element having a value greater than the total average value among the elements of the sum vector R′. The signal processing unit 4 then estimates that the section to which the element having a value greater than the total average value belongs is the time section in which non-stationary noise is present, i.e., the time section in which noise other than the operation sound is present. The techniques described in the first and second embodiments are applied to waveform data obtained by removal of the time section estimated. Such operation can provide a determination technique that reduces the effect of ambient noise.
Note that the above technique uses, but not limited to, the total average value of the sum vector R′ as the reference value, i.e., the threshold, for the comparison, but the threshold may instead be a product of multiplication of the total average value of the sum vector R′ by any factor.
As described above, according to the anomaly diagnosis device according to the fifth embodiment, the signal processing device estimates, using waveform data of an operation sound of a determination target, the time section in which noise other than the operation sound is present, performs short-time fast Fourier transform on waveform data obtained by removal of the time section estimated, and calculates feature quantities. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly.
In addition, the anomaly diagnosis method according to the fifth embodiment includes, between the second step and the third step of the anomaly diagnosis method described in the first embodiment, an estimation step of estimating, using waveform data of an operation sound of an electrical device, the time section in which noise other than the operation sound is present. Then, in the third step, short-time fast Fourier transform is performed on waveform data obtained by removal of the time section estimated in the estimation step, and the feature quantities are calculated. Such operation can provide a determination technique that reduces the effect of ambient noise. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly. Sixth Embodiment.
The configuration of the anomaly diagnosis device 100 according to the first embodiment illustrated in
An algorithm of an estimation process to be used in the sixth embodiment will next be described. First, the preprocessing unit 30 performs STFT on the waveform data obtained by the conversion performed by the signal converter 3 and on the known noise data. In STFT, the waveform data and the noise data are each divided into an arbitrary number of blocks in each of the frequency direction and the time direction. The preprocessing unit 30 also performs pattern matching between the matrices that are the respective results of the STFT processing.
Pattern matching can be performed using a commonly-used algorithm.
In this respect, the matrix representing the result of STFT from the waveform data obtained by the conversion performed by the signal converter 3 is denoted by I, and is referred to as “first signal matrix”. In addition, the matrix representing the result of STFT from the known noise data is denoted by T, and is referred to as “first noise matrix”. In pattern matching, normalized cross-correlation (RNCC) expressed by Equation (17) below can be used, where M and N represent the respective sizes of the first noise matrix T in the time direction and in the frequency direction.
When the normalized cross-correlation RNCC obtained by pattern matching has, at a certain index pair (i, j), a value greater than a certain threshold ThNear with respect to the degree of proximity, the preprocessing unit 30 presumes an index pair that provides the maximum value of the normalized cross-correlation RNCC in the first signal matrix I obtained by the conversion performed by the signal converter 3 to be indicative of the start time, and then determines that data from this start time to the time corresponding to the size of the first noise matrix T in the time direction is the section in which known noise is present.
A procedure of removal of known noise will next be described with reference to
The preprocessing unit 30 determines whether the waveform data obtained by the conversion performed by the signal converter 3 includes known noise data. In the example of
When the preprocessing unit 30 has determined that there is a section in which known noise is present, the preprocessing unit 30 replaces each of the values of elements of the first noise matrix T greater than an element replacement threshold Thpow with a value of a noise removal parameter Prep obtained through pattern matching, and generates a second noise matrix T′ having part of elements obtained by replacement of corresponding elements of the result of STFT from the known noise data. In the example of
Finally, the preprocessing unit 30 replaces the data of the portion of the section in which known noise is present in the first signal matrix I with the second noise matrix T′ to thus generate the second signal matrix I′ having the effect of presence of the known noise having been eliminated. The processing of one of the first through fifth embodiments described above is thereafter performed using this second signal matrix I′.
Note that the sixth embodiment has been described in which the configuration additionally including the preprocessing unit 30 upstream of the signal processing unit 4 is applied to the configuration of the anomaly diagnosis device 100 according to the first embodiment illustrated in
As described above, according to the anomaly diagnosis device according to the sixth embodiment, the signal processing device includes a preprocessing unit that estimates, using known noise data, the time section in which the known noise data is present on the basis of the result of short-time fast Fourier transform, and the signal processing unit performs processing of calculating feature quantities from data excluding noise data. This enables avoidance of misidentifying a known noise included in a sound from the determination target as an anomaly.
In the anomaly diagnosis device according to the sixth embodiment, the preprocessing unit performs short-time fast Fourier transform on waveform data obtained by conversion performed by a signal converter and on known noise data. In STFT, the waveform data and the noise data are each divided into an arbitrary number of blocks in each of the frequency direction and the time direction. The preprocessing unit then performs pattern matching between matrices that are the respective results of processing of the short-time fast Fourier transform. In addition, the signal processing unit calculates first feature quantity data using data generated on the basis of the result of processing of the pattern matching performed by the preprocessing unit. Such operation can provide an anomaly diagnosis device that reduces the effect of ambient noise.
In addition, the anomaly diagnosis method according to the sixth embodiment includes, between the second step and the third step of the anomaly diagnosis methods described in the first through fifth embodiments, an estimation step of estimating the time section in which known noise data is present on the basis of the result of short-time fast Fourier transform. Then, in the third step, short-time fast Fourier transform is performed on waveform data obtained by replacement of data of the time section estimated in the estimation step with another data, and the feature quantities are calculated. Such operation can provide a determination technique that reduces the effect of ambient noise. This enables avoidance of misidentifying a noise included in a sound from the determination target as an anomaly.
The configurations described in the foregoing embodiments are merely examples. These configurations may be combined with another known technology, and configurations of different embodiments may be combined together. Moreover, part of such configurations may be omitted and/or modified without departing from the spirit thereof.
Number | Date | Country | Kind |
---|---|---|---|
2022-064158 | Apr 2022 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2023/008102 | 3/3/2023 | WO |