The disclosure relates generally to event or anomaly detection, and more particularly, to detecting anomalies related to transportation operations using acoustic sensing.
Current systems for monitoring and detecting events, anomalies, or vehicle flaws along a path or thoroughfare, such as, a railroad track, by using distributed acoustic sensing methods are described in U.S. Pat. Nos. 10,281,300 and 10,850,754, among others. However, these prior art methods do not sufficiently address the needs for the monitoring of transportation lines due to the need to either determine the speed of a vehicle to make certain determinations, or these prior art methods lack the use of the vehicle signatures for providing additional event monitoring and detections, such as, in U.S. Pat. No. 10,281,300.
In U.S. Pat. No. 10,850,754, the inventor describes methods and apparatus for monitoring of rail networks using fiber optic distributed acoustic sensing (DAS), especially for condition monitoring. However, the requirement of the methods disclosed the 754 patent to measure the speed of the train prior to applying a correction window is a significant shortcoming of this prior art, as determining speed would require additional hardware thereby making the invention disclosed in the 754 patent virtually useless in train applications.
In order to overcome the significant limitations of this and other prior art, aspects of the present invention may not require a speed-based correction of the data, since, among other things, more sophisticated data analysis algorithms are used to extract vehicle flaw data.
Aspects of the invention provide a solution for monitoring and detecting various events of interest on or along an object or interest, such as a transportation path, including roads or railways. These events of interest may include anomalies in vehicle operation, hardware damage, obstructions on the path or tracks, and/or pedestrian trespassing, among other, undesirable events. Data regarding the event can be collected near the source of the event and transmitted to a data collection or processing object, for example, a computer or PLC, for analysis or storage. These events or anomalies may include, but not limited to, rock falls, wheel flat spots, and/or other acoustic generating events.
A first embodiment of the invention is a system having interrogating and receiving units spaced along an optical fiber cable deployed alongside an object of interest, such as a transportation path or railroad track, a road, or an assembly line. In one aspect, the receiving units allow the acoustic emission to modify the light propagation attributes of the optical fiber and these modifications are transmitted to an object to analyze, process, and determine identifiable characteristics for the events.
The receiving units incorporate advanced processing algorithms and heuristics that allow the system of the invention to accurately detect and identify key events along the length of the fiber. These algorithms may also eliminate potential false positives—for example, discriminating between flat spots and wheel flanging. Other embodiments are also described.
Another embodiment of the invention is a system for monitoring a transportation path such as a road, railroad track, and others, the system comprising or including: at least one fiber optic fiber extending along at least a portion of a targeted path, the fiber optic fiber having a plurality of imperfections; an interrogator operatively connected to the at least one fiber optic fiber, the interrogator configured to detect variations in reflections from the plurality of imperfections in the at least one fiber optic fiber due to the effect of signals generated by an anomaly along the path; a processor operatively connected to the interrogator, the processor having software adapted to: receive signals from the interrogator corresponding to the detected variations; associate the received signals with one or more anomalies; and depending upon the anomaly, execute one of a plurality of protocols. In one aspect, the signals generated by the anomaly may be acoustic signals or vibration signals. In one aspect, at least one fiber optic fiber may be positioned on a first side of the path, road, or railroad track, and at least one fiber optic fiber positioned on a second side of the path, road, or railroad track, opposite the first side of the path, road, or railroad track.
In one aspect, the detected variations may correspond to wheel anomalies, for example, wheel flats, or out-of-round wheels. In another aspect, the detected variations may correspond to an obstruction on the path, road, or tracks, for example, a rock or a log or tree limb. In one aspect, the detected variations may correspond to foot steps, for example, of a human trespasser or animal intrusion.
In one aspect, the system may include an inspection vehicle, for inspection of the detected anomaly, for example, an unmanned inspection vehicle, such as, an unnamed aerial drone.
Another embodiment of the invention is a method for monitoring a transportation path, the method comprising or including: with at least one fiber optic fiber extending along at least a portion of a targeted transportation path, the fiber optic fiber having a plurality of imperfections, varying the reflections from the plurality of imperfections due to the effect of signals generated by an anomaly along the transportation path; detecting the variations in the reflections: generating electrical signals corresponding to the detected variations; analyzing the generated electrical signals to extract at least one feature of the generated signals; comparing at least one feature to a plurality of features and recognizing at least one feature as one of a plurality of anomalies; and based upon the one of the plurality of anomalies recognized, executing at least one protocol.
In one aspect, the method may further include filtering the generated electrical signals. In another aspect, analyzing the generated electrical signals to extract at least one feature may be implemented by time domain signal analysis, for example, peak-to-peak signal analysis, thresholding signal analysis, FFT signal analysis, and wavelet signal analysis, among others. In another aspect, comparing and recognizing may be practiced by template recognition, rule based behavior recognition, or deep learning based feature signature recognition, among other methods.
In one aspect, the plurality of anomalies may be an anomaly in vehicle operation, derailment, hardware damage, an obstruction on the transportation path, pedestrian trespassing, or animal intrusion, among others.
In one aspect, at least one protocol may be initiating an alert, storing data associated with the detected variations, activating a camera in a vicinity of the anomaly; dispatching an inspection vehicle, or taking no action, among other protocols.
In another aspect, the method may further include detecting a speed of a vehicle traveling along the transportation path with a plurality of sensors, for example, with a plurality of wheel sensors. In another aspect, the method may further include detecting at least one datum for a train traveling along the transportation path with at least one sensor, for example, a vehicle ID, or a vehicle wheel size. The detected wheel size may be used when analyzing the generated electrical signals to extract at least one feature of the generated signals.
These and other aspects of the invention provide methods and systems for generating and monitoring events near an object of interest, such as, a transportation path, road, or railroad track, and others, for the purpose of making an action that provides an advantage, which include and/or implement some or all of the actions described herein. The illustrative aspects of the invention are designed to solve one or more of the problems herein described and/or one or more other problems not discussed.
These and other features of the disclosure will be more readily understood from the following detailed description of the various aspects of the invention taken in conjunction with the accompanying drawings that depict various aspects of the invention.
It is noted that the drawings may not be to scale. The drawings are intended to depict only typical aspects of the invention, and therefore should not be considered as limiting the scope of the invention. In the drawings, like numbering represents like elements between the drawings.
As indicated above, aspects of the invention provide a solution for monitoring and detecting various events of interest, such as, operating anomalies or track flaws, on or along an object of interest, such as a transportation path, road, or railway. For descriptive purposes the example of a railway will be used, although the invention applies to transportation paths in general.
Data regarding one or multiple types of effects being generated by events and vehicle operations can be acquired and analyzed. In an illustrative application, the effect-generating events or operations include acoustic, vibration, and other continuous or pulse emissions. The effect data can be monitored and analyzed to determine aspects of the rail vehicles operational health, the health of the rail, and associated events occurring at or near the vehicle, rail, or its surroundings.
In
As known in the art, the fiber 14 typically includes various imperfections inherent in the manufacturing process that produce Rayleigh scattering when light passes through the fiber 14. This Rayleigh scattering reflects light back down the fiber 14 and the arrival of this reflected light can be measured accurately in time, allowing the sites of scattering to serve as vibration or acoustic sensors 16.
The cable 14 with its sensors 16 may typically be laid substantially parallel to and within reasonable distance of a set of railroad tracks 18, or other path of interest. A train 20 may travel along the tracks 18 on trucks or bogies 22, and in so doing the wheels 24 of trucks 22, being in contact with the rail of the tracks 18, produce vibrations 26. A flawed wheel, such as one with a slid flat, may typically produce different vibration attributes 28, for example, compared to the vibration attributes of a non-flawed wheel.
A crack or break 30 in the track 18 may also produce specific vibration attributes 32 as a train approaches and passes over the break 30. A large item, such as a rock 34, may fall or roll onto the track 18, also producing vibrations 36 which can be detected by at least one of the sensors 16. In addition, if the rock 34 remains on the track 18, the rock 34 may also produce a permanent strain on one or more portions of track 18 from its mass 38, which may also be detected by the local sensors 16.
A human being 40, or other animal of significant size, may also produce characteristic vibrations 42 when, for example, moving, allowing the intrusion by the human or animal to be monitored and evaluated.
According to aspects of the invention, the data collected by the interrogator 10 from the sensors 16 is transmitted through a wired or wireless connection 44 to a central data storage and/or processing facility 46.
Note also that the fiber 14 may be continuous, as indicated at 48, thereby providing continuous coverage of the track 18 for the length of the optical fiber 14.
The processing of the data may take place onboard the interrogator 10 or at the central data storage and/or processing facility 46.
In an embodiment of the invention, the ability to locate and track events is enhanced by using at least two sensing arrays, positioned on opposite sides of the rail track 18 as illustrated in
The rotating wheel frequency, illustrated by waveform 104 in
Falling rocks 34 may roll or bounce to their positions on track 18, as shown by one example pathway 106. The rolling or impacts are also limited in speed and exhibit a lower frequency emission. The fall of a rock 34 onto the track 18, or near it, may also have a residual attribute from strain imparted to any sensors 16 by the addition of weight to the track 18 or nearby area.
The intrusion of human beings 40 or other animals is also detectable by the vibration signals based on speed and method of locomotion. A human being 40 walking in a straight line 108 may show their presence as a series of low-g impacts at frequencies matching the step rate of the human being 40.
The events or anomalies shown in
As shown earlier in
Time-domain signal analysis 138 which may include measuring peak-to-peak variation, thresholding levels, change over time, Kalman filters, and other common signal analysis techniques 140, which may include Fast Fourier Transform (FFT) analysis, wavelet analysis, and others. Time-domain signal analysis 138 and/or signal analysis techniques 140 are the feature extraction 142 component of the invention.
Following feature extraction 142, the extracted feature data may be sent for analysis by various algorithmic or heuristic analysis methods 144, such as template recognition or rule-based behavior recognition, or to artificial intelligence/deep learning analysis 146, which may include learned feature signature detection, behavioral recognition and prediction, and other more complex analyses based on training a deep learning system on a wide variety of inputs. Together, algorithmic or heuristic analysis methods 144 and/or artificial intelligence/deep learning analysis 146 are the feature recognition subsystem 148 of an aspect the present invention.
Following feature recognition 148 analysis, the results are processed for decision-making 150, which may involve involves determining, based on what events or features have been recognized, what the appropriate response of the system should be. This overall operation is called the decision engine 152 of the system of an aspect the present invention.
Once a decision is reached, some form of response may be made. This response may range from sending an alert 154 to a train or remote location, to simply storing the data 156 for reference if no real threat is seen, to taking direct action 158, such as stopping a train, if the situation warrants it.
Another consideration with respect to one aspect of the invention is the physical division of the operations or steps described in
The interrogator 10, therefore, could perform the pre-filtering 136, amplification, and other processes 142, 148, and/or 152 for all of the sensors 16, and pass that data on to the other portions of the software.
An embodiment of the invention includes the use of a plurality of fibers 14. One aspect of the invention may uses a single fiber 14 to detect the events of interest. In
An embodiment of the invention includes the use of a system with at least one mobile component such as an unmanned ground or air vehicle. In this embodiment, the system may detect such an event, and then may dispatch an autonomous vehicle to the location to gather additional information, which may be wirelessly relayed to the system for additional analysis and decision making.
An embodiment of the invention includes the use of a system with integrated wheel sensors. Wheel sensors positioned along the track 18 can provide real time train speed, which allows the frequency from the detected vibrations to be determined for any potential flat spots to be monitored. Incorporating wheel sensors permits the system to reduce power of operations when no train is operating in the area. The wheel sensors may provide a “wakeup” method as well as additional data for processing.
This embodiment and
An embodiment of the invention includes the use of phase difference measurement. The ranging approach shown in
When the rock 34 falls onto the tracks at a specific location 240, rock 34 may produce acoustic vibrations that are picked up by specific sensors 16a-d. These vibrations must travel various distances 242a-d respectively to the corresponding sensors 16a-d. Because the distances 242 vary, both the time for the actual acoustic vibration to arrive, and its amplitude, vary, producing individual waveforms 244, 246, 248, and 250, respectively. In the case presented, the rock 34 is closest to virtual sensor 16d, meaning that waveform 250 is the first produced, with the others arriving later. This is illustrated in
These signals all originate from the same event, the boulder 34 falling onto the tracks 18, their separations in time are purely due to the distance of each of the sensors 16a-d from the landing point 240 of the rock 34. As the speed of transmission of sound through the environment can be known, these differences in time can be converted to distances. Since the distances of the sensors from each other can be determined directly from the system's measurements, this allows an accurate pinpointing of the location 240 of the rock 34.
Applying these techniques and those previously described to sequences of events allows for tracking, behavior analysis, and size estimation. As also shown in
The discussed technique of distance and location measurement relies on matching the peaks and measuring the phase difference between one peak in the sequence and the corresponding peak in the other sequence. In some cases, it may be challenging to prevent aliasing, cases in which the interval between the arrivals of a given signal may overlap with the arrival of an earlier but nearer signal. There are a number of methods to disambiguate this; one, which also lends itself to estimating the size, is to compare the amplitudes of the signals, both between sequences (260 compared to 262) and within sequences (260a compared with b, c, d, e). For example, in sequence 260, we see that the amplitudes of 260a-e follow a pattern of increase from a-b, then from b-c, then a decrease from c-d, and another from d-e. Taken together, and with the assumption that the target is not changing in overall size or method of generating vibrations/impacts, we conclude that the person 40 was coming closer to sensor 16e, reached a closest approach (crossing the fiber 14) at the point 258c represented by peak 260c, and continued on. By contrast, the amplitudes seen in 262 increases reasonably steadily, showing that the person 40 is walking towards the fiber 14 on the side where 16f is located.
An aspect of the invention includes the use as derailment detection. When a car derails, it will cause damage to the infrastructure of the rail line (ties, etc.) and likely to itself, and may cause the entire train to derail with catastrophic results. The present invention can be used to detect such derailments, as illustrated in
In
These vibrations, like those produced by flat spots, will be repeating and related to the speed of the train. However, unlike flat spots or other defects of wheels, the repetition rate will not match that of a single wheel rotation, but rather the interval between ties. Using this timing information, and difference in the vibrational signature, the invention can therefore detect derailments. Even if the derailed wheels 24 can no longer be detected by previously described wheel sensors 210, the wheels of the other cars of the train which remain properly on the rails will be; all cars of the train, being physically connected, must travel at the same speed, and thus the speed from the nearest active wheel sensor may be used for this purpose. Other methods of measuring the speed of the train may also be used.
An aspect of the invention includes the use of the system with cameras and other sensors. If an event occurs, analyzing video of the location could provide invaluable information. The system could have, as one of the actions 158 options (see
An aspect of the invention includes the use of the system for security monitoring. It is not necessary for the described system to be used exclusively for railroad monitoring. In another embodiment, existing or new fiber optic fibers may be installed around and through a location—a military base, a manufacturing area, etc.—and monitored specifically to detect intrusion by persons and vehicles, tracking them, gauging their activity, and performing alerts and actions as appropriate. In one aspect, road monitoring may be practiced by using either an existing dark fiber or custom installed fiber, a network of interrogators may be installed to monitor total traffic including speed, and direction. The aspects of the invention provide for determining individual vehicle speeds. Additionally, aspects of the invention may provide a system adapted to detect intrusion on the road, monitor asset condition, and/or provide automatic incident alerts.
An aspect of the invention includes the use for mine operation monitoring. Mining operations are often constant, dangerous, and noisy, with many challenges in properly monitoring the operations and events happening. The presented invention may be embodied in several ways to assist in this type of operation: This may include operational, environmental, critical asset, and safety situational awareness advantages.
The foregoing description of various aspects of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and obviously, many modifications and variations are possible. Such modifications and variations that may be apparent to an individual in the art are included within the scope of the invention as defined by the accompanying claims.
The current application claims the benefit of U.S. Provisional Application No. 62/976,479, filed on 14 Feb. 2020; U.S. Provisional Application No. 63/004,065, filed on 2 Apr. 2020; and U.S. Provisional Application No. 63/024,073, filed on 13 May 2020, the disclosures of each of which are hereby incorporated by reference herein in their entirety.
Number | Date | Country | |
---|---|---|---|
63024073 | May 2020 | US | |
63004065 | Apr 2020 | US | |
62976479 | Feb 2020 | US |