The present invention relates to a device that detects the state of a machine.
The relevant art in the present technical field includes Patent Literature 1, Patent Literature 2, and Patent Literature 3 indicated below. In Patent Literature 1, a device is described that learns the operational tendency of a machine when an anomaly occurred in the machine. In Patent Literature 2, a detection device is described that detects an interval on the time axis in which stress applied to a machine occurred, or an interval at the position in which the machine was present. In Patent Literature 3, a damage estimation device is described that estimates the damage amount received by a machine, from the result of recognizing the operation performed by the machine.
Patent Literature 1: JP 2018-97616 A
Patent Literature 2: JP 6215446
Patent Literature 3: JP 6458055
The techniques described in Patent Literatures 1 to 3 noted above have problems, such as follows.
The present invention has been made in view of the foregoing, and aims to provide a machine state detecting device that can easily detect the state of a machine, regardless of whether an unknown operation that is not expected to cause damage is performed.
In order to solve the problem, a machine state detecting device of the present invention includes a collection device that collects, at a plurality of times, state information indicating a state of a machine that changes chronologically, and an arithmetic processing device that detects the state of the machine by processing a plurality of pieces of the state information collected at the plurality of times. The arithmetic processing device includes: a classification process section that identifies a plurality of feature amount vectors having a type of the state information as a feature amount by temporally dividing the plurality of pieces of the state information collected by the collection device, classifies the identified feature amount vectors into any of a plurality of prescribed sets, and, to the feature amount vectors that have been classified, provides a classification ID identifying the set to which the feature amount vectors belong; a detection process section that detects a damage received by the machine based on the state information, collected by the collection device, indicating the state of the machine that chronologically changes; and a tying process section that ties an interval in which the damage was detected by the detection process section to the classification ID provided in the interval by the classification process section.
According to the present invention, the state of a machine can be easily detected, regardless of whether an unknown operation that is not expected to cause damage is performed.
Other problems, components, and effects will become apparent from the following description of embodiments.
In the following, embodiments of the present invention will be described with reference to the drawings. The components in the embodiments that are denoted by the same reference signs have similar functions throughout the embodiments unless specifically noted, and descriptions thereof may be omitted.
With reference to
The state detecting device 100 is a device that detects the state of various machines, typically work machines such as construction machines or industrial robots. In particular, the state detecting device 100 is a device that detects the state of a machine (for example, the operation state of a machine) that changes chronologically. In
The state detecting device 100 can be largely divided into a collection device 1a that collects information for detecting the state of the machine, and an arithmetic processing device 1b that performs a process for detecting the state of the machine using the collected information. That is, the state detecting device 100 is provided with: the collection device 1a that collects, at a plurality of times, state information indicating the state of the machine that changes chronologically; and the arithmetic processing device 1b that processes a plurality of pieces of the state information collected at the plurality of times to detect the state of the machine.
The collection device 1a is made up of a device provided in the machine to store various sensor information, and is constructed of a controller or the like mounted on the machine. Each of the collection device 1a and the arithmetic processing device 1b may be constructed of a general- or industrial-purpose computer, or may be constructed of dedicated hardware using a microcomputer. Each of the collection device 1a and the arithmetic processing device 1b is constructed including a CPU, a ROM, and a RAM, and achieves the respective functions as the CPU executes a program stored in the ROM. The arithmetic processing device 1b may feed the information collected by the collection device 1a to an external cloud computer using a communication line, so that processing can be performed using the cloud computer. While in
The collection device 1a is provided with a state classification sensor/control information collection section 1f and a damage detection sensor/control information collection section 1g that respectively collect state classification sensor/control information 1f and damage detection sensor/control information 1g as state information indicating the state of the machine that changes chronologically. The state classification sensor/control information 1f include sensor measurement information that is used for classifying the state of the machine, and information for controlling the portions of the machine. The damage detection sensor/control information 1g includes sensor measurement information that is used for detecting damage the machine received, and information for controlling the portions of the machine. The state classification sensor/control information 1f and the damage detection sensor/control information 1g may be information of the same type or information of different types. In the present embodiment, the state classification sensor/control information 1f may also be referred to as “state information 1f”. In the present embodiment, the damage detection sensor/control information 1g may also be referred to as “state information 1g”.
The collection device 1a can collect the sensor measurement information included in the state information if and the state information 1g directly from a strain gauge, an angle sensor, and the like attached to the machine, or by acquiring information flowing through a network such as a Controller Area Network (CAN) mounted on the machine. The collection device 1a can acquire the control information included in the state information if and the state information 1g directly from a control device or the like of the machine, or by acquiring information flowing through a network mounted on the machine.
The arithmetic processing device 1b is provided with: a detection process section 1j that performs a detection process 1j for damage the machine received; a determination process section 1k that performs a determination process 1k for the damage amount the machine received; a classification process section 1i that performs a classification process 1i for classifying the state of the machine at each time based on the state information if collected by the collection device 1a; a tying process section 1l that performs a tying process 1l between the processing result of the detection process 1j (and the determination process 1k) and the processing result of the classification process 1i; a determination process section 1m that performs a determination process 1m as to whether a classification ID tied by the tying process 1l is an unknown classification ID; a display process section 1n that performs a display process 1n for displaying that the classification ID tied by the tying process 1l is an unknown classification ID; and a registration process section 1p that performs a registration process 1p for registering the classification ID that has been determined to be an unknown classification ID by the determination process 1m in a classification ID database 1o. Further, the arithmetic processing device 1b is provided with the classification ID database 10 for the damage state and the classification model database 1h as recording devices.
For purposes of explanation, the components of the respective sections in the collection device 1a and the arithmetic processing device 1b, and the processes in the respective sections are represented by the same reference signs.
The arithmetic processing device 1b, as described above, is provided with the function (detection process section 1j) of performing the detection process 1j for damage the machine received. The detection process section 1j performs a process of detecting damage the machine received based on the state information 1g collected by the collection device 1a. The detection process 1j detects an interval (period) on a time axis in which the damage the machine received is large. The damage of interest to the detection process 1j is, for example, a damage due to stress fatigue received by various portions of the machine, such as a hydraulic cylinder and a hydraulic motor. The damage of interest to the detection process 1j may also include, for example, other than the physical damage such as stress fatigue damage, conditions that may cause safety problems, such as a condition in which the machine's balance is poor. The condition in which the machine's balance is poor can be detected by means of an inclinometer mounted to the machine.
For the damage detection process 1j, there is a technique described in Patent Literature 2. This technique uses a stress value measured by a strain gauge attached to a dump truck to detect the start time and end time of a repeated stress.
An operation to load earth/sand onto a dump truck involves a flow in which: the dump truck moves in an empty-load state (3d); earth/sand is loaded multiple times onto the dump truck at rest (3e); the dump truck moves in loaded state (3f); and earth dumping is performed to discharge the loaded earth/sand (3g). In
The technique described in Patent Literature 2 is an example of the technique for detecting the magnitude of the damage the machine received and the interval in which the machine received the damage. Other techniques may be used for the detection process 1j as long as the magnitude of the damage the machine received and the interval in which the machine received the damage can be detected.
In the present embodiment, the magnitude of the damage the machine received (magnitude of the amplitude of repeated stress) may also be referred to as “damage amount”. In the present embodiment, the interval on the time axis in which the machine received damage (period from the start time to the end time of damage) may also be referred to as “damage interval”. In the present embodiment, the state of the machine when the machine received damage (damage interval) may also be referred to as “damage state”. In the present embodiment, the damage amount the machine received in the damage interval may also be referred to as “individual damage amount”.
Further, the arithmetic processing device 1b, as described above, is provided with the function of performing the determination process 1k for the damage amount the machine received (determination process section 1k). The determination process section 1k performs a process of determining whether the damage amount detected by the detection process 1j is such a damage amount that the life of the portions of the machine is affected. The determination process 1k for the damage amount determines that the damage amount is such that the life is affected if the damage amount detected by the detection process 1j is more than or equal to a predetermined threshold value, or determines that the damage amount does not affect the life if less than the threshold value. If the damage amount detected by the detection process 1j is such a damage amount that the life is not affected, a process of acquiring the state information 1g and the state information if is performed (corresponding to “NO” at 2a in
The arithmetic processing device 1b may not set the threshold value in the determination process 1k, and may perform the tying process 1l at all damage amounts detected by the detection process 1j. For example, even when the damage amount is small, it may be difficult to set the threshold value for determining the damage amount that will affect the life if the number of occurrences of the damage state is large. In such a case, the arithmetic processing device 1b may perform the tying process 1l at all damage amounts detected by the detection process 1j without performing the determination process 1k.
Further, the arithmetic processing device 1b, as described above, is provided with the function (classification process section 1i) of performing the classification process 1i for classifying the state of the machine at each time, based on the state information if collected by the collection device 1a. The classification process section 1i performs a process of temporally dividing a plurality of pieces of the state information if collected by the collection device 1a at a plurality of times to identify a plurality of feature amount vectors having the type of the state information if as feature amounts. Then, the classification process section 1i performs a process of classifying the identified feature amount vectors into any of a plurality of prescribed sets (clusters), and providing the classified feature amount vectors with classification IDs that identify the set (cluster) to which the feature amount vectors belong.
Specifically, the classification process 1i is performed based on the information that is recorded in advance in the classification model database 1h. In the classification model database 1h, for each of various states of the machine, a feature amount vector indicating the state and classification ID identifying the feature amount vector are recorded in advance in association with each other, the feature amount vector having the items (types) of the state information if as the items thereof (vector components defined as feature amounts) (where, if the state classification sensor/control information has n items, the feature amount vector has n dimensions).
The classification ID indicates one state (or scene) of the machine. For example, the classification ID in the case of a dump truck as the machine may indicate the state in which the vessel of the dump truck is raised and earth dumping is being performed, or, in the case of an excavator as the machine, may indicate the state in which the front arm is raised and excavation is being performed. Further, the state of the machine is indicated by the feature amount vector. The classification model database 1h records the feature amount vector indicating the state of the machine and the classification IDs identifying the feature amount vectors in association with each other. The classification model database 1h of Embodiment 1 does not record natural language indicating the state of the machine, such as the “state in which the vessel of the dump truck is raised and earth dumping is being performed” described above by way of example, in direct association with the classification ID.
The classification process 1i performs a process of searching the feature amount vectors recorded in the classification model database 1h for the classification ID of a feature amount vector that is the most similar to the feature amount vector of the state information if to be classified. Being similar means that the distance (for example, Euclidean distance) between the feature amount vectors is shorter than those between the others. The classification process 1i searches the feature amount vectors recorded in the classification model database 1h for the feature amount vector that has the closest distance to the feature amount vector to be classified, and determines that the classification ID of the feature amount vector obtained by the search is the classification ID that indicates the state of the machine at the time the state information if on which the feature amount vector to be classified is based was collected.
The classification process 1i searches for the feature amount vector of the classification model that is the most similar to the feature amount vector of the collected data at each time illustrated in
Further, the arithmetic processing device 1b, as described above, is provided with the function (tying process section 1l) of performing the tying process 1l between the processing result of the detection process 1j (and determination process 1k) and the processing result of the classification process 1i. The tying process section 1l performs the process of tying the damage interval, which is the interval in which damage was detected by the damage detection process 1j, and the classification ID provided by the classification process 1i in the damage interval to each other. In this way, the arithmetic processing device 1b can identify the damage state that is the state of the machine in the damage interval, by means of the classification ID provided by the classification process 1i.
The processing result of the classification process 1i is obtained as a chronologically arranged row of classification IDs. The chronologically arranged row of classification IDs includes the following two types. One is the type in which, as indicated by 7b of
Further, the arithmetic processing device 1b, as described above, is provided with the function (determination process section 1m) of performing the determination process 1m as to whether the classification ID tied by the tying process 1l is an unknown classification ID. The determination process section 1m performs the process to determine whether, based on the classification IDs recorded in the damage state classification ID database 1o, the classification ID tied by the tying process 1l is an unknown classification ID.
The determination process 1m performs different processes depending on the above-described type of the row of classification IDs obtained as the processing result of the classification process 1i. If the row of classification IDs is of the type consisting of the same classification ID, the determination process 1m references the records in the classification ID database 1o in which only one classification ID is recorded. In the example of 7b in
The determination process 1m, if the row of classification IDs is of the type composed of a pattern, references the records in the classification ID database 1o in which items as illustrated in
The DP matching is a pattern matching technique using dynamic programming, and is a technique that takes elastic matching of patterns into consideration. Elastic matching is a technique for performing a matching process in which, for example, the multiple and successive appearance of the classification ID (6) or (7) in 7c of
If it is determined that the classification ID tied by the tying process 1l is a known classification ID, a process of acquiring the state information 1g and the state information if is performed (corresponding to “NO” in 2b of
Further, the arithmetic processing device 1b, as described above, is provided with the function (display process section 1n) of performing the display process 1n for displaying that the classification ID tied by the tying process 1l is an unknown classification ID. That the classification ID tied by the tying process 11 is an unknown classification ID means that an unknown damage state occurred. The display process section 1n performs a process of either displaying information indicating the occurrence of the unknown damage state on a display device such as a display, or issuing a notice by means of an audio output device, such as a speaker. The arithmetic processing device 1b may omit the performing of the display process 1n.
Further, the arithmetic processing device 1b, as described above, is provided with the function (registration process section 1p) of performing the registration process 1p for registering the classification ID that was determined by the determination process 1m to be an unknown classification ID in the classification ID database 1o. In the example of 7b of
Thus, the state detecting device 100 of Embodiment 1 is provided with the collection device 1a that collects, at a plurality of times, the state information if indicating the state of the machine that changes chronologically, and the arithmetic processing device 1b that processes a plurality of pieces of the state information if collected at the plurality of times to detect the state of the machine. The arithmetic processing device 1b is provided with the classification process section 1i that temporally divides the plurality of pieces of the state information if collected by the collection device 1a, classifies the feature amount vectors having the type of the state information if as feature amounts into any of a plurality of clusters (sets), and provides the classification ID. Further, the arithmetic processing device 1b is provided with the detection process section 1j that detects the damage the machine received, based on the state information 1g collected by the collection device 1a indicating the state of the machine that changes chronologically. Further, the arithmetic processing device 1b is provided with the tying process section 1l that ties the interval in which damage was detected by the detection process section 1j, to the classification ID provided by the classification process section 1i in the interval.
With such configuration, the state detecting device 100 of Embodiment 1 can identify the damage state, which is the state of the machine in the interval in which the machine received damage, by means of the classification ID provided by the classification process section 1i. In this way, the state detecting device 100 can easily detect the occurrence of the damage state in the damage interval tied to the classification ID, by simply referencing the classification ID provided by the classification process section 1i. Further, the state detecting device 100, by having the classification IDs identifying damage states recorded, can easily determine, based on the recorded classification IDs, whether the detected damage state is an unknown state that is not expected to provide damage. Accordingly, the state detecting device 100 of Embodiment 1 can easily detect the state of the machine, regardless of whether an unknown operation that is not expected to cause damage was performed.
Further, in the state detecting device 100 of Embodiment 1, the arithmetic processing device 1b is provided with the classification ID database 10 in which the classification IDs identifying damage states are recorded in advance. Further, the arithmetic processing device 1b is provided with the determination process section 1m that determines whether, based on the classification IDs recorded in the classification ID database 1o, the classification ID tied by the tying process section 1l is an unknown classification ID. Further, the arithmetic processing device 1b is provided with the registration process section 1p that registers the classification ID determined to be an unknown classification ID by the determination process section 1m in the classification ID database 1o.
With such configuration, the state detecting device 100 of Embodiment 1 can easily expand the classification ID database 1o in which the classification IDs identifying the damage states are recorded, and can more reliably and easily determine whether the detected damage state is an unknown state. Because the state detecting device 100 can reduce the frequency of occurrence of an unknown damage state, it becomes easier to detect the current state of the machine accurately. Thus, the state detecting device 100 of Embodiment 1 can easily detect the state of the machine regardless of whether an unknown operation that is not expected to cause damage is performed, and can also facilitate timely execution of machine maintenance, for example, thereby making it easier to sustain the health of the machine.
In the foregoing description, the example in which the detection process 1j detects damage by means of the amplitude and wavelength of repeated stress has been described. However, the detection process 1j may detect damage only by means of the strength/weakness of a waveform related to stress. In
The tying process 1l may not just tie the damage interval detected by the detection process 1j to the classification ID provided by the classification process 1i in the damage interval, but may also tie the damage amount (individual damage amount) the machine received in the damage interval. Then, in the classification ID database 1o, as illustrated in
With such configuration, the state detecting device 100 of Embodiment 1 can not only identify the damage state by means of the classification ID provided by the classification process section 1i, but can also identify the individual damage amounts. In this way, the state detecting device 100 can easily detect not just the occurrence of the damage state by simply referencing the classification ID provided by the classification process section 1i, but can also easily detect how much damage the machine received in the damage interval. In this way, the state detecting device 100 can more accurately detect the current fatigue damage degree and the like of the machine. Thus, the state detecting device 100 of Embodiment 1 can easily and accurately detect the state of the machine, and can also perform machine maintenance in a timelier manner, thereby making it possible to further sustain the health of the machine.
The function provided in the arithmetic processing device 1b to perform the detection process 1j corresponds to an example of a “detection process section” set forth in the claims. The classification model database 1h provided in the arithmetic processing device 1b corresponds to an example of a “second recording section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the classification process 1i corresponds to an example of a “classification process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the determination process 1m corresponds to an example of a “first determination process section” set forth in the claims. The damage state classification ID database to provided in the arithmetic processing device 1b corresponds to an example of a “first recording section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the registration process 1p corresponds to an example of a “first registration process section” set forth in the claims.
With reference to
In the state detecting device 100 of Embodiment 1, the feature amount vectors that are recorded in the classification model database 1h in advance are searched for a feature amount vector that has the closest distance to the feature amount vector to be classified that has been identified by the classification process 1i. Then, in the state detecting device 100 of Embodiment 1, the classification ID of the feature amount vector obtained by the search is provided to the feature amount vector to be classified as the classification ID indicating the state of the machine at the time the state information if on which the feature amount vector to be classified is based was collected.
In this case, a problem illustrated in
Accordingly, the state detecting device 100 of Embodiment 2 is provided with the process functions illustrated in
The determination process 12a computes the distance between the feature amount vector to be classified and the feature amount vectors recorded in the classification model database 1h, as described in Embodiment 1. Then, the determination process 12a, if the computed distance is less than or equal to a preset threshold value, determines that the classification ID of a feature amount vector similar to the feature amount vector to be classified is recorded in the classification model database 1h. That is, in this case, the determination process 12a determines that the classification ID that should be provided to the feature amount vector to be classified is recorded in the classification model database 1h. Thereafter, the tying process 1l is performed as in Embodiment 1. On the other hand, the determination process 12a, if the computed distance is greater (farther) than the preset threshold value, determines that the classification ID of a feature amount vector similar to the feature amount vector to be classified is not recorded in the classification model database 1h. That is, in this case, the determination process 12a determines that the classification ID that should be provided to the feature amount vector to be classified is not recorded in the classification model database 1h. Thereafter, in Embodiment 2, a generation process 12b and a registration process 12c are performed as will be described below.
The arithmetic processing device 1b of Embodiment 2 is provided with the function (generation process section 12b) of performing the generation process 12b for generating a new classification model if the classification ID of the feature amount vector similar to the feature amount vector to be classified is not recorded in the classification model database 1h. That is, the generation process section 12b performs the process of generating a new classification ID if the classification ID that should be provided to the feature amount vector to be classified is not recorded in the classification model database 1h.
Further, the arithmetic processing device 1b of Embodiment 2 is provided with the function (registration process section 12c) of performing the registration process 12c for registering the new classification model generated by the generation process 12b in the classification model database 1h. That is, the registration process section 12c performs the process of registering the new classification ID, generated by the generation process section 12b, and the feature amount vector to which the classification ID should be provided, in the classification model database 1h in association with each other.
The generation process 12b and the registration process 12c may be performed according to either of the following two techniques (technique 1 or technique 2). In technique 1, the generation process 12b performs a process in which the group of the feature amount vectors to be classified that have been identified in the newly detected damage interval is added to the learning interval for building the classification model database 1h, and the classification model database 1h is rebuilt using a classification technique, such as clustering. In this way, the generation process 12b, as shown in 13f of
In technique 2, the generation process 12b computes, from the group of the feature amount vectors to be classified that have been identified in the newly detected damage interval, the representative coordinate values of the group of the feature amount vectors. The representative coordinate values of the group of the feature amount vectors may be computed by, for example, calculating the center of gravity coordinate values or average coordinate values of the group of feature amount vectors. The generation process 12b generates the new classification ID that should be provided to the representative feature amount vector having the computed representative coordinate values. The registration process 12c registers the representative feature amount vector having the computed representative coordinate values, and the generated new classification ID in the classification model database 1h in association with each other. The registration process 12c registers the generated new classification ID in the classification ID database 1o as the classification ID identifying the damage state.
With such technique 1 or technique 2 described above, the state detecting device 100 of Embodiment 2 can solve the problem described above with reference to
Thus, the state detecting device 100 of Embodiment 2, if the classification ID that should be provided to the feature amount vector identified by the classification process 1i is not recorded, generates a new classification ID and registers the new classification ID and the feature amount vector in the classification model database 1h in association with each other.
In this way, the state detecting device 100 of Embodiment 2 can easily expand the classification model database 1h in which the feature amount vectors identifying the states of the machine are recorded, and can further reliably and easily classify the state of the machine. In addition, because the state detecting device 100 can reduce the frequency of the occurrence of the non-recording of the classification ID that should be provided to the feature amount vector identified by the classification process 1i, it becomes easier to accurately detect the current state of the machine. Thus, the state detecting device 100 of Embodiment 2 can easily detect the state of the machine regardless of whether an unknown operation that is not expected to cause damage is performed, and can facilitate timely execution of machine maintenance, for example, making it easier to sustain the health of the machine.
The function provided in the arithmetic processing device 1b to perform the determination process 12a corresponds to an example of a “second determination process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the generation process 12b corresponds to an example of a “generation process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the registration process 12c corresponds to an example of a “second registration process section” set forth in the claims.
With reference to
In Embodiment 3, a technique for visualizing the state of the machine will be described. The arithmetic processing device 1b of Embodiment 3 is provided with the function (cutting-out process section 14a) of performing a cutting-out process 14a for cutting out the classification ID provided by the classification process 1i in a predetermined interval that includes the interval tied to the classification ID by the tying process 1l. That is, the cutting-out process section 14a performs a process of cutting out the classification ID provided by the classification process 1i in the predetermined interval. The classification ID cut out by the cutting-out process 14a is used when generating an animation in a reenactment process 14b, as will be described below. The predetermined interval cut out by the cutting-out process 14a may be the damage interval itself that is the interval tied to the classification ID by the tying process 1l, or may be an interval including times before and after the damage interval.
For example, if the row of classification IDs obtained as the processing result of the classification process 1i as described above is of the type consisting of the same classification ID, as in 7b of
On the other hand, if the row of classification IDs obtained as the processing result of the classification process 1i is of the type composed of a pattern, as in 7c of
The arithmetic processing device 1b of Embodiment 3 is provided with the function (reenactment process section 14b) of performing the reenactment process 14b for generating an animation (moving image) that reenacts the state of the machine in the predetermined interval from which the classification IDs have been cut out by the cutting-out process 14a. The reenactment process section 14b performs the process of generating the animation (moving image) that reenacts the state of the machine in the predetermined interval, based on the feature amount vectors corresponding to the classification IDs cut out by the cutting-out process 14a.
The reenactment process 14b utilizes keyframe animation, which is used in computer graphics, to generate the animation that reenacts the state of the machine in the predetermined interval.
Accordingly, the reenactment process 14b, in order to perform smooth reenactment of the movements of the excavator using keyframe animation, generates frames that reenact the states of the excavator between the frames 16a, 16b, and 16c, thereby performing keyframe interpolation. In the example of
The arithmetic processing device 1b of Embodiment 3 is provided with the function (display process section) of performing the display process for causing the display device to display the animation (moving image) generated by the reenactment process 14b. While the function of performing this display process is not illustrated in
Thus, the state detecting device 100 of Embodiment 3 cuts out the classification IDs provided by the classification process 1i in the predetermined interval that includes the interval tied to the classification IDs by the tying process 1l. Then, the state detecting device 100, based on the feature amount vectors corresponding to the cut-out classification IDs, generates the animation that smoothly reenacts the state of the machine, and causes the display device to display the animation.
In this way, the state detecting device 100 of Embodiment 3 can show what state the machine was in during the damage interval, in a visually easily understandable manner, thereby allowing the user to intuitively know the damage state. Further, in the state detecting device 100 of Embodiment 3, because the animation is generated using the feature amount vectors corresponding to the classification IDs, it is possible to generate the animation using less information than the state information if that has been actually collected.
It is noted that the state detecting device 100 of Embodiment 3 may generate the animation based on the state information 1g, rather than generating the animation based on the feature amount vectors corresponding to the cut-out classification ID, i.e., based on the state information if constituting the feature amount vectors. Further, the state detecting device 100 of Embodiment 3 may convert the content of the generated animation into text and register the text in the classification ID database 1o as a text-display character string, as shown in 17a of
Further, the function provided in the arithmetic processing device 1b to perform the cutting-out process 14a corresponds to an example of a “cutting-out process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the reenactment process 14b corresponds to an example of a “reenactment process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the animation display process that is included in the function to perform the reenactment process 14b or the display process 1n corresponds to an example of a “display process section” set forth in the claims.
With reference to
In Embodiment 4, a technique for utilizing the damage state classification ID database 1o to recognize the damage state will be described. The state detecting device 100 of Embodiment 4 recognizes the damage state without using the state information 1g. In order to acquire the state information 1g, a sensor retrofitted to the machine and a device for acquiring control information have been required. However, it is possible to recognize the damage interval and the damage state without using such information.
The arithmetic processing device 1b of Embodiment 4 is provided with the function (recognition process section 18a) of performing a recognition process 18a for recognizing the damage state identified by the classification ID provided by the classification process 1i. The recognition process section 18a performs the process of recognizing the damage state identified by the classification ID provided by the classification process 1i, based on the classification ID provided by the classification process 1i and the classification IDs recorded in the classification ID database 1o.
The recognition process 18a performs the process of a search as to whether the row of classification IDs obtained as the processing result of the classification process 1i as described above is recorded in the classification ID database 1o as a classification ID pattern, as shown in 8a of
Further, the arithmetic processing device 1b of Embodiment 4 is provided with the function (display process section 18b) of performing a display process 18b for causing the display device to display the result of recognizing the damage state by the recognition process 18a. If the search by the recognition process 18a indicates that the row of classification IDs obtained as the processing result of the classification process 1i as described above is recorded in the classification ID database 1o, the display process section 18b can acquire the animation-display classification ID 15a and the text-display character string 17a shown in
Thus, the state detecting device 100 of Embodiment 4 can recognize the damage state without using the state information 1g. Accordingly, even if the sensor and the like for acquiring the state information 1g has failed, the state detecting device 100 of Embodiment 4 can easily detect the damage state by means of the classification ID provided by the classification process section 1i. The state detecting device 100 of Embodiment 4 can easily determine whether the detected damage state is an unknown state that is not expected to provide damage, based on the classification IDs recorded in the classification ID database 1o. Thus, the state detecting device 100 of Embodiment 4 can easily detect the state of the machine regardless of whether an unknown operation that is not expected to cause damage is performed.
The function provided in the arithmetic processing device 1b to perform the recognition process 18a corresponds to an example of a “recognition process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the display process 18b corresponds to an example of a “display process section” set forth in the claims.
With reference to
In the state detecting device 100 of Embodiment 5, the arithmetic processing device 1b is provided with the function (estimation process section 19a) of performing an estimation process 19a for the damage amount, based on the processing result of the recognition process 18a of Embodiment 4. In the classification ID database 1o, as illustrated in
If the damage amount is a measurement value of stress or a value with which it is possible to estimate stress, the estimation process 19a can use an S-N diagram to convert the individual damage amounts into damage levels. The S-N diagram shows the relationship between repeated stress and the number of repetitions of stress before the material ruptures. The damage level is calculated from a single repeated stress (stress amplitude) using the S-N diagram. When the cumulative damage level, which is the cumulative value of damage levels, is 1, this indicates that the material will rupture. That is, the damage level may be considered the amount consumed of the life of the machine. Therefore, the estimation process 19a can use the S-N diagram to convert the individual damage amounts shown in
Further, the arithmetic processing device 1b of Embodiment 5 is provided with the function (display process section 19b) of performing a display process 19b for causing the display device to display the estimation result of the estimation process 19a. The display process section 18b performs the process of visualizing, for example, the influence of a single damage state on the life of the machine, the consumed amount of life or the remaining amount of life of the portions of the machine, and the prediction result of the life of each portion of the machine, as estimated by the estimation process 19a.
Thus, the state detecting device 100 of Embodiment 5 can estimate the individual damage amounts from the processing result of the recognition process 18a. Accordingly, the state detecting device 100 of Embodiment 5 can calculate the damage level and the cumulative damage level from the estimated individual damage amounts. The state detecting device 100 of Embodiment 5 can estimate the influence a single damage state has on the life of the machine; estimate the consumed amount of life or the remaining amount of life for each portion of the machine; and predict the life of the machine from chronological changes in the cumulative damage level. Thus, the state detecting device 100 of Embodiment 5 can detect not just what state the machine was in in the damage interval, but can also detect, from various points of view, how the state of the machine will change in the future.
The function provided in the arithmetic processing device 1b of Embodiment 5 to perform the estimation process 19a may be provided in the arithmetic processing device 1b of Embodiments 1 to 3. For example, the arithmetic processing device 1b of Embodiments 1 to 3 may be provided with the function to perform the estimation process 19a for calculating the damage level and the cumulative damage level from the individual damage amounts to estimate the consumed amount of life or the remaining amount of life for each portion of the machine, and to predict the life of each portion of the machine from a chronological change in the cumulative damage level. In Patent Literature 3 discussed above, because it was possible to calculate the damage level only with regard to damage states that are determined in advance, it was not possible to estimate the damage level of an unexpected damage state. However, by providing the arithmetic processing device 1b of Embodiments 1 to 3 with the function to perform the estimation process 19a, it becomes possible to estimate the damage level of an unexpected damage state.
The function provided in the arithmetic processing device 1b to perform the estimation process 19a corresponds to an example of an “estimation process section” set forth in the claims. The function provided in the arithmetic processing device 1b to perform the display process 19b corresponds to an example of a “display process section” set forth in the claims.
With reference to
In Embodiment 6, a technique for identifying and visualizing the state of the machine that is the main cause of the damage amount received by each portion of the machine will be described. In Embodiment 5, the arithmetic processing device 1b is provided with the function to perform the estimation process 19a and the display process 19b, and can calculate and visualize the damage level and the cumulative damage level for each portion of the machine, from the individual damage amounts recorded in the classification ID database 1o illustrated in
That is, the estimation process 19a of Embodiment 6, based on the classification ID identifying the damage state recognized by the recognition process 18a and the classification IDs recorded in the classification ID database 1o, identifies the individual damage amount corresponding to the damage state recognized by the recognition process 18a. Then, the estimation process 19a of Embodiment 6, based on the identified individual damage amount and the number of occurrences of the damage state corresponding to the individual damage amount (i.e., the number of times the individual damage amount is received), calculates the integrated value of the individual damage amount for each classification ID. Then, the estimation process 19a of Embodiment 6 accumulates a plurality of the integrated values calculated for each classification ID, and estimates a cumulative damage amount the machine received. Then, the display process 19b of Embodiment 6 causes the display device to display the processing result of the estimation process 19a.
Specifically, the estimation process 19a of Embodiment 6, by multiplying the individual damage amount tied to a certain classification ID by the number of occurrences of the damage state corresponding to the individual damage amount, calculates the integrated value of the individual damage amount for each classification ID. The estimation process 19a, by calculating the sum of each of a plurality of the integrated values calculated for each classification ID, estimates the cumulative damage amount. Then, the estimation process 19a of Embodiment 6, based on the proportion of each of the plurality of integrated values estimated for each classification ID in the cumulative damage amount, identifies the damage state that is the main cause of the cumulative damage amount received by the machine.
For example, assume that, in
The estimation process 19a of Embodiment 6, as in Embodiment 5, can convert the cumulative damage amount into a cumulative damage level. Then, the estimation process 19a of Embodiment 6, as in Embodiment 5, can estimate the consumed amount of life or the remaining amount of life for each portion of the machine, and predict the life of each portion of the machine from a chronological change in the cumulative damage level. Further, in the examples of
In the foregoing description, the estimation process 19a has been described as calculating the integrated value of the individual damage amount for each classification ID. However, as illustrated in
Thus, in the state detecting device 100 of Embodiment 6, the integrated value of the individual damage amount is calculated for each classification ID, a plurality of the integrated values calculated for each classification ID are accumulated, and the cumulative damage amount received by the machine is estimated. In this way, in the state detecting device 100 of Embodiment 6, it is possible to identify the damage state constituting the main cause of the cumulative damage amount received by the machine, from the proportion of each of the plurality of the integrated values estimated for each classification ID in the cumulative damage amount. Accordingly, the state detecting device 100 of Embodiment 6 can, e.g., control the machine or take appropriate measures to prevent the occurrence of the damage state constituting the main cause, thereby making it possible to further sustain the health of the machine.
The function provided in the arithmetic processing device 1b of Embodiment 6 to perform the estimation process 19a and the display process 19b may be provided in the arithmetic processing device 1b of Embodiments 1 to 3. For example, the arithmetic processing device 1b of Embodiments 1 to 3 may be provided with the function for performing the estimation process 19a to calculate the integrated value of the individual damage amount for each classification ID based on the individual damage amount detected by the detection process 1j and the number of detections of the individual damage amount (i.e., the number of occurrences of the damage state), and to accumulate a plurality of the integrated values calculated for each classification ID to estimate the cumulative damage amount received by the machine. In this way, the arithmetic processing device 1b of Embodiments 1 to 3 can appropriately estimate the cumulative damage amount even if an unexpected damage state is the main cause thereof.
With reference to
In Embodiment 7, visualization of various processing results described in Embodiments 1 to 6 will be described. The arithmetic processing device 1b of Embodiment 7 is provided with the function of performing the cutting-out process 14a and the reenactment process 14b, and is also provided with the function of performing the display process for causing the display device to display the animation (moving image) generated by the reenactment process 14b. The display process of Embodiment 7 causes the display device to display, together with the animation generated by the reenactment process 14b, at least one of the chronological change in the state information 1f collected in the predetermined interval in which the classification ID was cut out by the cutting-out process 14a; the chronological change in the individual damage amount in the predetermined interval; the cumulative damage amount; the chronological change in the cumulative damage amount; and the prediction result of the life of the machine.
If the machine is a construction machine such as a hydraulic excavator, the display device that displays the display screen 24a may be a display device installed in the cabin of the construction machine, or a display device installed in a monitoring room for the machine. The display screens 25a, 26a that will be described below are also displayed on a similar display device. The display process of Embodiment 7 may cause the display screen 24a to be displayed immediately in real time when the machine receives the damage, or may cause the display at a predetermined timing, such as at the end of the work of the machine. Alternatively, the display process of Embodiment 7 may cause the display screen 24a to be displayed upon the user operating a display button or the like. The display screens 25a, 26a are also similarly displayed in real time or at a predetermined timing, for example.
The display process of Embodiment 7 can cause the display device to display the display screen 24a when the machine receives damage. In this case, the display process of Embodiment 7 can cause displays of information indicating the occurrence of the damage state, such as “Damage state occurred” and information about the time the machine received the damage, as shown in 24c and 24e in
In this case, the highlighted display may be varied depending on the cumulative damage level. For example, when the cumulative damage level of the portion of the machine that received the damage is high, the highlighted display may be in “red”; if the cumulative damage level is not so high as “red” but requires caution, “yellow”; and “blue” if none of the above. Of course, the colors that are displayed are not limited to the three colors of red, yellow, and blue, which are merely examples.
The display process of Embodiment 7 is not limited to the highlighted display of the portion of the machine that received the damage, but may display the animation 24f displaying the entire machine with the major portions of the machine (such as, if the machine is an excavator, the boom, the arm, the bucket, and the travel body) color-coded. In this way, the display process of Embodiment 7 can let the user easily know the cumulative damage level of the entire machine with regard also to portions other than the highlighted portions, in terms of, i.e., which portion has a high cumulative damage level and which portion requires caution each time damage is received.
The display process of Embodiment 7, as shown in 24b and 24i of
The display process of Embodiment 7 can cause the display device to display the display screen 25a when the remaining amount of life of a certain portion of the machine is decreased. In this case, the display process of Embodiment 7, as shown in 25d and 25e of
The display process of Embodiment 7, if the remaining amount of life of the certain portion of the machine is decreased, can predict the life thereof and cause the display device to display the display screen 26a. In this case, the display process of Embodiment 7 can display in text information indicating that the cumulative damage level is increased, and information indicating the remaining life, as shown in 26c and 26d of
Thus, the state detecting device 100 of Embodiment 7 displays, together with the animation reenacting the damage state, at least one of the chronological change in the sensor/control information if collected in the predetermined interval including the damage interval; the chronological change in the individual damage amount; the cumulative damage amount; the chronological change in the cumulative damage amount; and the prediction result of the life of the machine. In this way, the state detecting device 100 of Embodiment 7 can visualize the damage state, and can also visualize and let the user know future changes in the state of the machine from various points of view, in an intuitive manner.
The present invention is not limited to the foregoing embodiments and may include various modifications. For example, the foregoing embodiments have been described to facilitate an understanding of the present invention, and are not limited to those provided with all of the components described. Some of the components of a certain embodiment may be substituted by components of another embodiment, or a component of the other embodiment may be incorporated into the components of the certain embodiment. Further, with respect to some of the components of each embodiment, addition, deletion, or substitution of another component may be made.
The components, functions, process sections, process means and the like described above may be partly or entirely designed on an integrated circuit, for example, for hardware implementation. Further, for the components, functions and the like described above, a program for implementing the respective functions may be interpreted and executed by a processor for software implementation. The information of a program for implementing the functions, tables, files, and the like may be placed in a recording device such as a memory, a hard disk, a solid-state drive (SSD), and the like, or in a recording medium such as an IC card, an SD card, a DVD, and the like.
The control lines and information lines that are illustrated are those considered necessary for description purposes, and not all of the control lines and information lines found in a product are necessarily illustrated. It may be considered that in reality, almost all of the elements are interconnected.
Number | Date | Country | Kind |
---|---|---|---|
2021-063255 | Apr 2021 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2022/014895 | 3/28/2022 | WO |
Number | Date | Country | |
---|---|---|---|
20240134367 A1 | Apr 2024 | US |