The present disclosure relates to a processing device, an abnormality detection system, an abnormality detection method, and a computer-readable medium.
A LiDAR (Light Detection and Ranging) device is one of devices that acquire three-dimensional position information of an object to be measured. The LiDAR device acquires three-dimensional position information of an object to be measured by using the distance from the LiDAR device to the object to be measured, the intensity of reflection, and the current position of the LiDAR device.
Patent Literature 1 discloses a technique related to a surveillance device that recognizes an object existing in a surveillance area. The technique disclosed in Patent Literature 1 extracts a change region by using a measurement result of the surveillance area measured by a three-dimensional laser scanner and a measurement result measured in the past.
Patent Literature 2 discloses a technique related to an image detection device that can improve the capability of responding to the deformation of an object by optimizing a template shape when detecting the object using template matching.
Patent Literature 1: Japanese Unexamined Patent Application Publication No. 2019-046295
Patent Literature 2: International Patent Publication No. WO 2017-170087
When detecting an abnormal part in an object to be measured by using the LiDAR device, a reference point group of the object to be measured is acquired by measuring the three-dimensional position information of the object to be measured in advance. Then, an inspection point group of the object to be measured is acquired by measuring the three-dimensional position information of the object to be measured at the time of inspection. After that, a difference between the inspection point group and the reference point group of the object to be measured is calculated, and a part where the calculated difference is equal to or more than a predetermined threshold is identified as an abnormal part.
However, in the case of identifying an abnormal part by using this technique, there is a possibility that an object that is displaced during measurement or displaced with time is also identified as an abnormal part. Thus, a part that is not an abnormal part can be wrongly detected as an abnormal part, which hinders accurate identification of an abnormal part.
An object of the present disclosure is to provide a processing device, an abnormality detection system, an abnormality detection method, and a computer-readable medium that solve any of the above-described problems.
A processing device according to the present disclosure includes a first difference calculation unit configured to calculate a difference between a plurality of reference point groups corresponding to three-dimensional position information of an object to be measured; a dynamic point group extraction unit configured to extract a dynamic point group being a point group involving a change from the reference point groups on the basis of a calculation result in the first difference calculation unit; a second difference calculation unit configured to calculate a difference between an inspection point group acquired after the reference point group and corresponding to three-dimensional position information of the object to be measured and the reference point group, and generate a differential point group; a point group removal unit configured to remove a point group corresponding to the dynamic point group from the differential point group generated in the second difference calculation unit; and an abnormal part identification unit configured to identify an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed.
An abnormality detection system according to the present disclosure includes a position information acquisition device configured to acquire three-dimensional position information of an object to be measured; and a processing device configured to identify an abnormal part of the object to be measured by using three-dimensional position information acquired in the position information acquisition device. The processing device includes a first difference calculation unit configured to calculate a difference between a plurality of reference point groups corresponding to three-dimensional position information of the object to be measured; a dynamic point group extraction unit configured to extract a dynamic point group being a point group involving a change from the reference point groups on the basis of a calculation result in the first difference calculation unit; a second difference calculation unit configured to calculate a difference between an inspection point group acquired after the reference point group and corresponding to three-dimensional position information of the object to be measured and the reference point group, and generate a differential point group; a point group removal unit configured to remove a point group corresponding to the dynamic point group from the differential point group generated in the second difference calculation unit; and an abnormal part identification unit configured to identify an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed.
An abnormality detection method according to the present disclosure includes calculating a difference between a plurality of reference point groups corresponding to three-dimensional position information of an object to be measured; extracting a dynamic point group being a point group involving a change from the reference point groups on the basis of a result of the calculation; calculating a difference between an inspection point group acquired after the reference point group and corresponding to three-dimensional position information of the object to be measured and the reference point group, and generating a differential point group; removing a point group corresponding to the dynamic point group from the generated differential point group; and identifying an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed.
A computer-readable medium according to the present disclosure is a non-transitory computer readable medium storing a program causing a computer to execute an abnormality detection process including calculating a difference between a plurality of reference point groups corresponding to three-dimensional position information of an object to be measured; extracting a dynamic point group being a point group involving a change from the reference point groups on the basis of a result of the calculation; calculating a difference between an inspection point group acquired after the reference point group and corresponding to three-dimensional position information of the object to be measured and the reference point group, and generating a differential point group; removing a point group corresponding to the dynamic point group from the generated differential point group; and identifying an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed.
According to the present disclosure, there are provided a processing device, an abnormality detection system, an abnormality detection method, and a computer-readable medium capable of accurately identifying an abnormal part.
An example embodiment of the present invention will be described hereinafter with reference the drawings.
As shown in
The reference point groups A and B are point groups corresponding to three-dimensional position information of an object to be measured, which are point groups acquired in advance in order to obtain a point group (dynamic point group) involving a change in the object to be measured. The inspection point group is a point group corresponding to three-dimensional position information of an object to be measured, which is a point group acquired when inspecting an abnormal part of the object to be measured (i.e., acquired after the reference point groups). The point group corresponds to three-dimensional position information of an object to be measured, and it contains information such as the distance from the position information acquisition device (LiDAR device) 10 to the object to be measured, the intensity of reflection, and three-dimensional coordinates.
The processing device 1 according to this example embodiment calculates a difference between the inspection point group and the reference point group of an object to be measured and identifies an abnormal part by using the calculated difference. In this processing, the processing device 1 according to this example embodiment extracts a point group (dynamic point group) involving a change from the reference point group by using the reference point groups A and B. The processing device 1 then calculates a difference between the inspection point group and the reference point group and generates a differential point group, removes a point group corresponding to the dynamic point group from this generated differential point group, and identifies an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed. The processing device 1 according to this example embodiment is described hereinafter in detail.
The first difference calculation unit 11 shown in
The dynamic point group extraction unit 15 extracts a point group (dynamic point group) involving a change from the reference point group on the basis of the calculation result in the first difference calculation unit 11. To be specific, the dynamic point group extraction unit 15 extracts a displaced part (dynamic point group) between the reference point groups A and B on the basis of the calculation result of a difference between the reference point group A and the reference point group B at each coordinates. For example, in this example embodiment, the dynamic point group extraction unit 15 may extract a displaced part on the basis of the presence or absence of a point group in voxels of the two reference point groups A and B.
The second difference calculation unit 12 calculates a difference between an inspection point group corresponding to three-dimensional position information of the object to be measured and the reference point group, and generates a differential point group. The inspection point group is a point group acquired after the reference point group, and it is a point group acquired when inspecting an abnormal part of the object to be measured, for example. The reference point group used at this time may be any one of the reference point group A and the reference point group B. In this specification, an example where the second difference calculation unit 12 calculates a difference between the inspection point group and the reference point group A is shown. The inspection point group and the reference point group A are three-dimensional point groups, and the second difference calculation unit 12 calculates a difference between the inspection point group and the reference point group A at each coordinates.
The point group removal unit 16 removes a point group corresponding to the dynamic point group extracted in the dynamic point group extraction unit 15 from the differential point group generated in the second difference calculation unit 12. For example, the point group removal unit 16 removes a point group corresponding to the dynamic point group from the differential point group when the distance between the differential point group and the dynamic point group is equal to or less than a predetermined threshold. The details of the point group removal unit 16 are described later.
The abnormal part identification unit 17 identifies an abnormal part of the object to be measured on the basis of a differential point group from which the point group corresponding to the dynamic point group is removed in the point group removal unit 16. For example, the abnormal part identification unit 17 may identify, as an abnormal part, a part where a difference between the inspection point group and the reference point group A (excluding the point group removed in the point group removal unit 16) of the object to be measured is equal to or more than a predetermined threshold. Specifically, a difference between the inspection point group and the reference point group A of the object to be measured corresponds to a position where a change has occurred from the timing of measuring the reference point group A to the timing of measuring the inspection point group. Thus, the abnormal part identification unit 17 may identify, as an abnormal part, a part where such a change (difference) is equal to or more than a predetermined threshold.
An operation (abnormality detection method) of the processing device according to this example embodiment will be described hereinafter.
In this example embodiment, an example of measuring an object 20 to be measured shown in
In this example embodiment, the reference point groups A and B, which are point groups corresponding to three-dimensional position information of the object to be measured, are acquired in advance by using the position information acquisition device 10 (see
After that, a difference between the reference point group A and the reference point group B is calculated using the first difference calculation unit 11 of the processing device 1 (Step S4). The reference point group A and the reference point group B are three-dimensional point groups, and the first difference calculation unit 11 calculates a difference between the reference point group A and the reference point group B at each coordinates. To be specific, as shown in
Next, the dynamic point group extraction unit 15 extracts a dynamic point group, which is a point group involving a change, from the reference point group on the basis of the calculation result (the differential point group 114) in the first difference calculation unit 11 (Step S5). In other words, the dynamic point group extraction unit 15 extracts a displaced part between the reference point groups A and B on the basis of the calculation result (the differential point group 114) of a difference between the reference point group A and the reference point group B at each coordinates. To be specific, as shown in the differential point group 114 of
By performing the above-described processing of Steps S1, S2, S4 and S5 in advance, the point group (dynamic point group) of the part that is displaced during measurement can be extracted from the object 20 to be measured shown in
After that, in this example embodiment, the object 20 to be measured is inspected using the position information acquisition device 10 (see
Then, the second difference calculation unit 12 of the processing device 1 calculates a difference between the inspection point group and the reference point group corresponding to three-dimensional position information of the object to be measured, and generates a differential point group (Step S11). The inspection point group and the reference point group are three-dimensional point groups, and the second difference calculation unit 12 calculates a difference between the inspection point group and the reference point group at each coordinates. To be specific, as shown in
After that, the point group removal unit 16 removes a point group corresponding to the dynamic point group extracted in the dynamic point group extraction unit 15 from this differential point group generated in the second difference calculation unit 12 (Step S12). For example, the point group removal unit 16 removes a point group corresponding to the dynamic point group from the differential point group when the distance between the differential point group and the dynamic point group is equal to or less than a predetermined threshold. To be specific, as shown in
After that, the abnormal part identification unit 17 identifies an abnormal part of the object to be measured on the basis of the differential point group from which the point group corresponding to the dynamic point group is removed in the point group removal unit 16 (Step S12). To be specific, as shown in
As described above, in this example embodiment, the dynamic point groups 26 and 27 are extracted from the reference point group by using the reference point groups A and B (see the differential point group 114). Then, the differential point group 115 is generated by calculating a difference between the inspection point group and the reference point group A, and the point groups 31 and 32 corresponding to the dynamic point groups 26 and 27 included in the differential point group 114 are removed from this generated differential point group 115. After that, the abnormal part 33 of the object 20 to be measured is identified on the basis of the differential point group 116 from which the point groups 31 and 32 involving a change are removed.
As described above, in this example embodiment, the point groups 31 and 32 involving a change are removed from the differential point group 115 between the inspection point group and the reference point group A. This prevents the point groups 31 and 32 involving a change from being wrongly detected as an abnormal part. This allows providing a processing device, an abnormality detection system, an abnormality detection method, and a computer-readable medium capable of accurately identifying an abnormal part.
Note that a point group (dynamic point group) involving a change is an object that is displaced during measurement or displaced with time, and it may be a plant leaf, a tree branch, looseness of equipment or the like, for example.
In this example embodiment, the point group removal unit 16 may set the predetermined threshold to be larger as the distance from a point of measurement (the position of the position information acquisition device 10; which is referred to also as a measurement point 10) to the object 20 to be measured is longer.
To be more specific, referring to
Specifically, since laser light of the position information acquisition device 10 is emitted radially from the position information acquisition device 10, the interval between point groups increases in proportion to the distance from the measurement point 10 to the object 41, 42 to be measured. In this case, if a predetermined threshold dth is set to a constant value, a point group involving a change of the object 42 to be measured that is farther from the measurement point becomes less likely to be removed.
For example, since the object 42 to be measured is far from the measurement point 10, the interval d1 of point groups tends to be large. In this case, the interval d1 of point groups tends to be larger than the predetermined threshold d0, (dth<d1), and a point group involving a change of the object 42 becomes less likely to be removed. Further, in the case of the object 41 to be measured that is closer to the measurement point 10, the predetermined threshold dth is smaller than an interval d2 from an adjacent point group (dth<d2). In this case, there is a possibility that the point group of the object 41 to be measured is wrongly determined as a point group involving a change.
In view of this point, in this example embodiment, as shown in
Further, in this example embodiment, the point group removal unit 16 may set the predetermined threshold to be larger as the density of the reference point group is lower.
To be more specific, referring to
Therefore, if the predetermined threshold dth is set to a constant value, a point group with low density is less likely to be removed as a point group involving a change. For example, when the predetermined threshold dth is smaller than the interval d1 of point groups of the object 46 to be measured (dth<d1), plants with low density are not removed as a point group involving a change. Further, when the predetermined threshold dth is smaller than the interval d2 from an adjacent point group (dth<d2), there is a possibility that another structure is wrongly determined as a point group involving a change.
In view of this point, in this example embodiment, as shown in
When the density of the object 45 to be measured is ρ0, the predetermined threshold dth is set so that the interval d0 of point groups, the predetermined threshold dth and the interval d2 from an adjacent point group satisfy d0<dth<d2. Further, when the density of the object 45 to be measured is pi, the predetermined threshold dth is set so that the interval d1 of point groups and the predetermined threshold dth satisfy dth<d1 For example, the predetermined threshold dth may be set so that the predetermined threshold dth is proportional to the density p of the object to be measured.
By setting the predetermined threshold dth with use of the above-described method, a point group corresponding to the dynamic point group is accurately removed from the differential point group 115 (see
A second example embodiment will be described next.
As shown in
For example, the grouping unit 13 groups together the objects of the same type, the objects of the same color, the objects with the same density of point groups (see
The reference point group A after being grouped by the grouping unit 13 is supplied to the dynamic point group extraction unit 15. The dynamic point group extraction unit 15 extracts a dynamic point group, which is a point group involving a change, from the reference point group on the basis of the reference point group A after being grouped by the grouping unit 13 and the calculation result in the first difference calculation unit 11. The other elements of the processing device 2 are the same as those of the processing device 1 according to the first example embodiment, and therefore redundant description thereof is omitted.
An operation (abnormality detection method) of the processing device according to this example embodiment will be described hereinafter.
The operation of the processing device 2 according to this example embodiment shown in the flowchart of
In this example embodiment also, the reference point groups A and B, which are point groups corresponding to three-dimensional position information of an object to be measured, are acquired in advance by using the position information acquisition device 10 (see
After that, the grouping unit 13 groups point group elements that constitute the reference point group A so as to include the similar point group elements (Step S3). To be specific, as shown in
Then, the dynamic point group extraction unit 15 extracts a dynamic point group, which is a point group involving a change, from the reference point group on the basis of the grouped reference point group A(121) and the calculation result (the differential point group 114) in the first difference calculation unit 11 (Step S5). To be specific, as shown in
In the example shown in
After that, in Step S12, the point group removal unit 16 removes, from the differential point group 115 (see
After that, the abnormal part identification unit 17 identifies an abnormal part of the object to be measured on the basis of the differential point group from which the point group corresponding to the dynamic point group is removed in the point group removal unit 16 (Step S13 in
As described above, in this example embodiment, the grouping unit 13 groups point group elements that constitute a reference point group so as to include the similar point group elements. Then, the dynamic point group extraction unit 15 extracts a dynamic point group from the reference point group on the basis of the grouped reference point group A(121) and the calculation result (the differential point group 114) in the first difference calculation unit 11. In this manner, since the dynamic point group is extracted by referring to the grouped reference point group A(121) in this example embodiment, the dynamic point group is extended to the similar point group elements. This ensures accurate removal of the point group corresponding to the dynamic point group from the differential point group 115 (see
A third example embodiment will be described next.
Specifically, since a predetermined time elapses after acquiring a reference point group until acquiring an inspection point group, there is a possibility that the position of the position information acquisition device 10 is deviated during this time. Further, in some cases, the position information acquisition device 10 is removed after acquiring a reference point group, and then the position information acquisition device 10 is installed again when acquiring an inspection point group. In such cases, there is a possibility that the installation position of the position information acquisition device 10 is slightly different between when acquiring a reference point group and when acquiring an inspection point group, which causes an acquisition range of the reference point group 63 and an acquisition range of the inspection point group 64 to be deviated from each other.
In this example embodiment, when the acquisition range of the inspection point group 64 and the acquisition range of the reference point group 63 are not the same, a range 65 that is obtained by subtracting the acquisition range of the reference point group 63 from the acquisition range of the inspection point group 64 is removed from the acquisition range of the inspection point group 64.
For example, in this example embodiment, as shown in
Further, a point group outside the acquisition range (X to Y degrees) of the reference point group 63 may be removed by setting configuration information at the time of acquisition of the reference point group 63 to the position information acquisition device 10 when acquiring the inspection point group 64. The configuration information at the time of acquisition of the reference point group 63 may be the position information of the position information acquisition device 10 and the acquisition range (X to Y degrees) of the reference point group 63, for example.
In this example embodiment also, the reference point groups A and B, which are point groups corresponding to three-dimensional position information of an object to be measured, are acquired in advance by using the position information acquisition device 10 (see
After that, as shown in
Note that the operations of Steps S4 and S5 and Steps S10 and S11 are the same as the operation (
After that, in Step S12, the point group removal unit 16 removes a point group corresponding to the dynamic point group extracted in the dynamic point group extraction unit 15 from the differential point group generated in the second difference calculation unit 12. In this step, the point group removal unit 16 performs processing of removing the point group 65 (see
After that, the abnormal part identification unit 17 identifies an abnormal part of the object to be measured on the basis of the point group corresponding to the dynamic point group and the differential point group from which the point group 65 (see
As described above, in this example embodiment, the point group 65 (see
In the above-described first to third example embodiments, the case of extracting a dynamic point group by using a differential point group between two reference point groups A and B is described. However, in this example embodiment, a dynamic point group may be extracted by using a differential point group among three or more reference point groups. In this case, a differential point group is generated using three or more reference point groups (Step S4 in
For example, in the case of generating a differential point group among three reference point groups A, B and C, each of a difference between the reference point group A and the reference point group B, a difference between the reference point group B and the reference point group C, and a difference between the reference point group C and the reference point group A is calculated, and a differential point group is generated by using those differences.
Although the present invention is described as a hardware configuration in the above example embodiment, it is not limited thereto. The present invention may be implemented by causing a CPU (Central Processing Unit) to execute a computer program to perform given processing.
In the above-described example embodiments, the program can be stored using any type of non-transitory computer readable media and provided to a computer. The non-transitory computer readable media include any type of tangible storage media. Examples of non-transitory computer readable media include magnetic storage media (to be specific, flexible disks, magnetic tapes, and hard disk drives), optical magnetic storage media (to be specific, magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R/W, and semiconductor memories (to be specific, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, and RAM (Random Access Memory)). The program may be provided to a computer using any type of transitory computer readable media. Examples of transitory computer readable media include electric signals, optical signals, and electromagnetic waves. Transitory computer readable media can provide the program to a computer via a wired communication line such as electric wires and optical fibers, or a wireless communication line.
Although the present invention is described above with reference to the example embodiments, the present invention is not limited to the above-described example embodiments. Various changes and modifications as would be obvious to one skilled in the art may be made to the structure and the details of the present invention without departing from the scope of the disclosure.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2020/032595 | 8/28/2020 | WO |