Autonomous track assessment system

Information

  • Patent Grant
  • 11377130
  • Patent Number
    11,377,130
  • Date Filed
    Monday, May 18, 2020
    4 years ago
  • Date Issued
    Tuesday, July 5, 2022
    a year ago
Abstract
An autonomous railway track assessment apparatus includes: a railway track assessment platform including a boxcar including an enclosed space formed therein; one or more power sources located on the boxcar; a controller; a first sensor assembly in electronic communication with the controller oriented to capture data from the railway track; an air handling system located on the rail car, the air handling system including an air blower and a heater/chiller; a set of air ducts in fluid communication with the air handling system and the first sensor assembly for supplying heated or cooled blown air from the air from the handling system to the first sensor assembly. Data from the railway track is autonomously collected by the first sensor assembly controlled by the controller and such data is stored on the data storage device.
Description
FIELD

This disclosure relates to the field of railway track inspection and assessment systems. More particularly, this disclosure relates to a railway track inspection and assessment system and platform that is autonomous and includes various sensors oriented relative to a railway track for gathering data from the railway track.


BACKGROUND

Railway tracks must be periodically inspected to assess a condition of the railway track and various individual components of the track. Traditional methods and systems of assessing a railway track may require significant labor by on-track workers and require that sections of railway track be obstructed during assessment. Traditional methods of track inspection further enhance risk for on-track workers and may slow or prevent other traffic along a section of railway track during inspection, such as when a section of railway track is occupied by hi-rail based systems.


Further, current track assessment systems require significant resources to operate and to review data captured from assessment of a section of railway track. Existing systems may only be able to capture limited stretches of a railway track at a given time, further increasing costs and an amount of time required to assess sections of railway track. Existing systems may further suffer from drawbacks including obstructions to sensors by debris building up on optics of the sensors or by extreme conditions, such as extreme temperatures or temperature variations along a section of railway track.


What is needed, therefore, is a railway track inspection and assessment system and platform that is autonomous and that prevents obstruction of sensors, such as by debris on the railway track.


SUMMARY

Embodiments herein include a railway track inspection and assessment system and platform that is autonomous and that prevents obstruction of sensors, such as by debris on the railway track. In a first aspect, an autonomous railway track assessment apparatus for gathering, storing, and processing profiles of one or both rails on a railway track includes: railway track assessment platform including a boxcar including an enclosed space formed therein; one or more power sources located on the boxcar; a controller in electrical communication with the one or power sources including at least one processor and a data storage device in communication with the processor; a first sensor assembly in electronic communication with the controller, the first sensor assembly including a first sensor enclosure, a light emitting device, and one or more first sensors oriented to capture data from the railway track; an air handling system located on the rail car, the air handling system including an air blower and a heater/chiller; and a set of air ducts in fluid communication with the air handling system and the first sensor assembly for supplying heated or cooled blown air from the air from the handling system to the first sensor assembly. Data from the railway track is autonomously collected by the first sensor assembly controlled by the controller and such data is stored on the data storage device.


In one embodiment, the autonomous railway track assessment apparatus further includes: a second sensor assembly in electronic communication with the controller, the second sensor assembly including a second sensor enclosure, a second light emitting device, and one or more second sensors oriented to capture data from the railway track; the set of air ducts in fluid communication with the air handling system, the first sensor assembly, and the second sensor assembly for supplying heated or cooled blown air from the air handling system to the first sensor assembly and the second sensor assembly. Data from the railway track is autonomously collected by both the first sensor assembly controlled by the controller and the second sensor assembly controlled by the controller and such data is stored on the data storage device.


In another embodiment, the first sensor assembly is oriented at a substantially perpendicular angle relative to the railway track. In yet another embodiment, the second sensor assembly is oriented at an oblique angle α relative to the undercarriage of the rail vehicle.


In one embodiment, the autonomous railway track assessment apparatus further includes a first LiDAR sensor configured to gather data of a rail corridor along a first scan plane and a second LiDAR sensor configured to gather data of a rail corridor along a second scan plane wherein the first LiDAR sensor and the second LiDAR sensor are in electrical communication with the controller and are physically connected to on an outer rear surface of the boxcar.


In another embodiment, the autonomous railway track assessment apparatus further includes a temperature controller in communication with the air handling system wherein the blower and heater/chiller are activated or deactivated by the temperature controller based on environmental conditions of the autonomous railway track assessment apparatus.


In yet another embodiment, the autonomous railway track assessment apparatus further includes one or more valves within ducts between the air handling system and each of the first sensor assembly and the second sensor assembly.


In a second aspect, an air handling system for an autonomous track assessment apparatus includes: a railroad data gathering assembly including a sensor and a light emitter inside a sensor enclosure wherein the railroad data gathering assembly is operable to gather data from a railroad track using the sensor and the light emitter; an air blower; a heater/chiller in fluid communication with the air blower; a temperature controller in electronic communication with the air blower and the heater/chiller; a temperature sensor in communication with the temperature controller. The temperature controller activates and deactivates the air blower and heater/chiller to provide conditioned air to the railroad data gathering assembly based on data received from the temperature sensor wherein the conditioned air is blown out of the sensor enclosure proximate to the sensor and the light emitter to divert debris or precipitation from the sensor and the light emitter.


In one embodiment, the air handling system for an autonomous track assessment apparatus further includes: at least one sensor assembly comprising a LiDAR sensor mounted on an outer surface of a rail car; the air handling system further including at least one duct formed through a side of the rail car for communicating air from the air blower and heater/chiller to the at least one sensor assembly.


In another embodiment, the LiDAR sensor further including a LiDAR sensor housing having a plurality of apertures formed therethrough for emitting air from the air handling system towards a sensor surface of the LiDAR sensor. In yet another embodiment, the plurality of apertures are arranged radially around the LiDAR sensor housing.


In one embodiment, the LiDAR sensor housing further includes at least one camera located on the LiDAR sensor housing, wherein air flowing through the LiDAR sensor housing towards the plurality of apertures passes proximate to a lens of the at least one camera.


In another embodiment, air from the air blower passes through a computer hardware rack prior to passing through the sensor enclosure.


In a third aspect, an air handling system for an autonomous track assessment apparatus includes: a railroad data gathering assembly including a LiDAR sensor mounted on a LiDAR sensor housing on a boxcar, the LiDAR sensor housing including a plurality of apertures formed therethrough proximate to sensors of the LiDAR sensor; an air blower; a heater/chiller in fluid communication with the air blower; a temperature controller in electronic communication with the air blower and the heater/chiller; a temperature sensor in communication with the temperature controller. The temperature controller activates and deactivates the air blower and heater/chiller to provide conditioned air to the railroad data gathering assembly based on data received from the temperature sensor wherein the conditioned air is blown out of the sensor enclosure proximate to the sensor and the light emitter to divert debris or precipitation from the sensor and the light emitter.


In one embodiment, air from the air blower passes through a computer hardware rack prior to passing through the sensor enclosure.





BRIEF DESCRIPTION OF THE DRAWINGS

Further features, aspects, and advantages of the present disclosure will become better understood by reference to the following detailed description, appended claims, and accompanying figures, wherein elements are not to scale so as to more clearly show the details, wherein like reference numbers indicate like elements throughout the several views, and wherein:



FIG. 1 shows a side view of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 2 shows a schematic view of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 3 shows a bottom view of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 4 shows a sensory assembly of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 5 shows a schematic diagram of a sensor assembly of an autonomous track assessment system including sensors oriented at an oblique angle which are capable of gathering data from rail webs and sides of rails;



FIG. 6 shows a schematic of a 3D sensor and light emitter oriented at an oblique angle, gathering data from the side of a rail;



FIG. 7 shows a sensor enclosure including a sensor and a light emitter attached adjacent to an internal frame inside the sensor enclosure as well as a heating and cooling device for maintaining the operating temperature inside the sensor enclosure to within specific temperature limits;



FIG. 8 shows the sensor enclosure of FIG. 7 including a cover plate covering the sensor and the light emitter and enclosing the sensor enclosure;



FIG. 9A shows a side view of the internal frame from FIG. 7 which is located inside the sensor enclosure;



FIG. 9B is a plan view of the internal frame shown in FIG. 9A;



FIG. 9C shows an end view of the internal frame shown in FIGS. 9A and 9B;



FIG. 9D shows a frame base which forms the base of the internal frame shown in FIGS. 9A-9C;



FIG. 10 shows a sensor pod including the sensor enclosure confined therein;



FIG. 11A shows a first side bracket of the sensor pod;



FIG. 11B shows a second side bracket of the sensor pod;



FIG. 12 shows a sill mount of the sensor pod which is used to engage sensor pod with the undercarriage of a rail vehicle;



FIG. 13 shows a pair of sensor pods oriented at oblique angles α on either side of a rail so that data can be gathered from both sides of the rail;



FIG. 14A shows a perspective view of an air distribution lid for covering the cover plate from FIG. 10 and providing air flow to such cover plate to remove debris from cover plate glass panels through which the sensor has a field of view and through which the light emitter emits light;



FIG. 14B shows a plan view of the air distribution lid from FIG. 14A;



FIG. 14C shows an end view of the air distribution lid shown in FIGS. 14A-14B;



FIG. 14D shows a bottom view of the air distribution lid shown in FIGS. 14A-14C;



FIG. 15 shows a sensor pod including the air distribution lid from FIGS. 14A-14D attached adjacent to the cover plate of the sensor enclosure from FIG. 10 wherein ducts are attached adjacent to the air distribution lid;



FIG. 16 shows an array of four sensor pods, each pod including an air distribution lid, wherein each air distribution lid is receiving air flow through a plurality of ducts originating from an air blower;



FIG. 17 shows a schematic of the air blower from FIG. 16 and the plurality of ducts leading to the various air distribution lids;



FIG. 18 shows a close-up bottom view of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 19 shows a side view of a sensor assembly of an autonomous track assessment system according to one embodiment of the present disclosure;



FIGS. 20 and 21 show a first sensor assembly, a second sensor assembly, and a blower of an autonomous track assessment system according to one embodiment of the present disclosure;



FIG. 22 shows a cross-sectional side view of a LiDAR sensor enclosure according to one embodiment of the present disclosure;



FIG. 23 shows an end view of a LiDAR sensor enclosure according to one embodiment of the present disclosure; and



FIG. 24 shows a cross-sectional side view of an air blower and conduits of an autonomous track assessment system according to one embodiment of the present disclosure.





DETAILED DESCRIPTION

Various terms used herein are intended to have particular meanings. Some of these terms are defined below for the purpose of clarity. The definitions given below are meant to cover all forms of the words being defined (e.g., singular, plural, present tense, past tense). If the definition of any term below diverges from the commonly understood and/or dictionary definition of such term, the definitions below control.


“Track”, “Railway track”, “track bed”, “rail assembly”, or “railway track bed” is defined herein to mean a section of railway including the rails, crossties (or “ties”), components holding the rails to the crossties, components holding the rails together, and ballast material.


A “processor” is defined herein to include a processing unit including, for example, one or more microprocessors, an application-specific instruction-set processor, a network processor, a vector processor, a scalar processor, or any combination thereof, or any other control logic apparatus now known or later developed that is capable of performing the tasks described herein, or any combination thereof.


The phrase “in communication with” means that two or more devices are in communication with one another physically (e.g., by wire) or indirectly (e.g., by wireless communication).


When referring to the mechanical joining together (directly or indirectly) of two or more objects, the term “adjacent” means proximate to or adjoining. For example, for the purposes of this disclosure, if a first object is said to be attached “adjacent to” a second object, the first object is either attached directly to the second object or the first object is attached indirectly (i.e., attached through one or more intermediary objects) to the second object.


Referring to FIG. 1, embodiments herein include an autonomous track assessment platform 10 for inspecting railway track 12 and components thereof. The autonomous track assessment platform 10 provides for a fully integrated autonomous platform capable of inspecting sections of a railway track. The autonomous track assessment platform 10 is capable of inspecting and gathering data from long stretches of the railway track 12 and high speeds and of providing real-time reporting and archiving of data collected from the railway track 12.


Embodiments of the autonomous track assessment platform 10 include a boxcar 14 on which a plurality of sensor systems are installed as discussed in greater detail below. The boxcar 14 includes an enclosed space 16 located within the boxcar 14 for housing various sensor components and hardware discussed in greater detail below. The boxcar 14 may have dimensions substantially similar to a common boxcar or a hi-roof boxcar typically used to carry freight or other items. The boxcar 14 is preferably suspended on bogies 18 including pairs of wheels 20 that allow the boxcar 14 to travel along the railway track 12. The boxcar 14 further preferably includes couplings 22 located at opposing ends of the rail car 14 such that the railcar 14 may be secured at either or both ends to a locomotive or other railcars of a train. The boxcar 14 may include ballast, such as a ballast concrete slab, to improve stability of the rail car 14.


Referring now to FIG. 2, the autonomous track assessment platform 10 preferably includes a plurality of sensor assemblies mounted on the boxcar 14 for capturing data for the assessment of a condition of the railway track 12 as the boxcar 14 travels along the railway track 12. In one embodiment, a plurality of sensor assemblies and other hardware components are installed on the autonomous track assessment platform 10 for automatically capturing data related to conditions of the railway track 12 and a surrounding environment without requiring substantial human intervention or labor to assess the railway track 12.


In one embodiment, the autonomous track assessment platform 10 includes an onboard power supply for powering various sensors and hardware components of the autonomous track assessment platform 10. A power supply is preferably onboard the track assessment platform 10 such that the autonomous track assessment platform 10 may be operated independent of a train to which the boxcar 14 is connected. For example, an electrical generator 24 may be located on the boxcar along with a fuel source 26 for powering the electrical generator 24. Additional power supply components may be included such as one or more batteries 28. The one or more batteries 28 may be in electrical communication with the electrical generator 24. One or more solar panels 30 may be mounted on the rail car 14 and in electrical communication with the one or more batteries 28. A power controller 32 is in electrical communication with the electrical generator 24, one or more batteries 28, and the one or more solar panels 30 for managing generation, storage, and distribution of electricity to components of the autonomous track assessment platform 10.


The autonomous track assessment platform 10 preferably includes a plurality of sensors and sensor assemblies for gathering data from the railway track 12 for further assessment and determination of a condition of the railway track 12 and surrounding objects. Various sensor assemblies may be mounted below the boxcar 14 and oriented towards the railway track 12 such that the sensor assemblies capture data from the railway track 12. Sensors may further be mounted on other external surfaces of the boxcar 14 for capturing data from the railway track 12 and a rail corridor including objects located around the railway track.


In one embodiment, a first sensor assembly 34 is mounted on the boxcar 14 for assessing a condition of the railway track 12 on which the boxcar 14 is travelling. The first sensor assembly 34 preferably includes a 3D Track Assessment System or “3DTAS” available from Tetra Tech, Inc. and disclosed in U.S. Patent Application Publication Number 2016/0249040 for a “3D Track Assessment System and Method,” the contents of which are incorporated herein by reference in their entirety. The first sensor assembly 34 is directed straight down towards the railway track 12 and components thereof.


Referring to FIG. 3, the first sensor assembly 34 includes a sensor housing 36 including a shroud 37 mounted underneath the boxcar 14 containing one or more sensors that are oriented to capture the railway track 12 as the boxcar 14 moves along the railway track 12. As shown in FIG. 4, the first sensor assembly may include components of a track assessment system 200 preferably including a processor 202, an onboard computer readable storage medium 204, a data storage device 206 in communication with the processor 202, computer executable instructions stored on one of the onboard computer readable storage medium 204 or the data storage device 206, optionally one or more light emitters 208 (e.g., a laser line emitter) via an optional light emitter interface 210, one or more sensors 212 in communication with the processor 202 via a sensor interface 214, and an optional wheel mounted shaft encoder 216 in communication with the processor 202 via an optional encoder interface 220. In a preferred embodiment, the one or more sensors 212 are Time of Flight (“ToF”) sensors. However, it is also understood that various other suitable sensors including three-dimensional or “3D” sensors 212 may be used. The track assessment system 200 further preferably includes a display and user interface 218 in communication with the processor 202 to display data to or receive input from an operator. Components of the track assessment system 200 are preferably mounted on the boxcar 14 of the autonomous track assessment system 10. The track assessment system 200 may be powered by the boxcar 14 or may be powered by a battery or other local power source. The data storage device 206 may be onboard the boxcar 14 or may be remote from the vehicle, communicating wirelessly with the processor 202.


For embodiments employing one or more light emitters 208, such light emitters 208 are used to project a light, preferably a laser line, onto a surface of an underlying rail assembly to use in association with three-dimensional sensors to three-dimensionally triangulate the rail assembly. In a preferred embodiment, a camera 224 in communication with the processor 202 via a camera interface 226 is oriented such that a field of view 228 of the camera 224 captures the rail assembly including the light projected from the light emitter 208. The camera 224 may include a combination of lenses and filters and using known techniques of three-dimensional triangulation a three-dimensional elevation map of an underlying railway track bed can be generated by the processor 202 after vectors of elevations are gathered by the camera 224 as the boxcar 14 moves along the rail. Elevation maps generated based on the gathered elevation and intensity data can be interrogated by the processor 202 or other processing device using machine vision algorithms. Suitable cameras and sensors may include commercially available three-dimensional sensors and cameras, such as three-dimensional cameras manufactured by SICK AG based in Waldkirch, Germany.


ToF sensors are preferably based on pulsed laser light or LiDAR technologies. Such technologies determine the distance between the sensor and a measured surface by calculating an amount of time required for a light pulse to propagate from an emitting device, reflect from a point on the surface to be measured, and return back to a detecting device. The ToF sensors may be a single-point measurement device or may be an array measurement device, commonly referred to as a ToF camera, such as those manufactured by Basler AG or pmdtechnologies AG.


Referring again to FIG. 2, a second sensor assembly 36 is mounted on the rail car 14 for assessing a condition of the railway track 12 on which the rail car 14 is travelling. The second sensor assembly 36 preferably includes one or more sensors oriented at an oblique angle relative to the railway track 12 to capture side view of the railway track. An exemplary embodiment of the second sensor assembly 36 is shown in FIG. 5, which may include components of a 3D track assessment system 500 and can be used as shown schematically in FIG. 5 which includes a plurality of 3D sensors 502 wherein the system 500 and sensors 502 are attached adjacent to a rail vehicle 504 configured to move along a railway track. The sensors 502 are oriented downward from the rail vehicle 504 but at an oblique angle looking at a rail from the side as shown in FIG. 5. Suitable sensors may include commercially available 3D sensors and cameras, such as Ranger cameras manufactured by SICK AG based in Waldkirch, Germany. The 3D track assessment system 500 further includes a plurality of structured light generators 506 (similar or identical to light emitters 208). The 3D track assessment system uses a combination of sensors 502, structured light generators 506, a specially configured processor 508, a data storage device 510, a power supply 512, a system controller 514, an operator interface 516, and a Global Navigation Satellite System (GNSS) receiver 518. Although single components are listed, it is understood that more than one of each component may be implemented in the 3D track assessment system 500 including, for example, more than one processor 508 and more than one controller 514. These and other system components help provide a way to gather high resolution profiles of the sides of rails including the heads, the bases and rail webs of rails 520 (including a first rail 520A and a second rail 520B) on a railway track. The 3D sensors 502 are preferably configured to collect four high resolution substantially vertical profiles at programmable fixed intervals as the system 500 moves along a railway track. The current implementation can collect 3D profiles (or scanlines) every 1.5 millimeters (mm) while the autonomous track assessment system 10 is moving along the railway track 12 at speeds up to 70 miles per hour. The system autonomously monitors sensor 502 operation, controls and configures each sensor 502 independently, and specifies output data storage parameters (directory location, filename, etc.). The system 500 further provides rail web manufacturer mark inventory capabilities, and various rail features inventory, exception identification and reporting capabilities. Typical exceptions include rail head and joint bar defects or dimensional anomalies. When identified, these exceptions can be transmitted based on specific thresholds using exception prioritization and reporting rules.


In a preferred embodiment, the 3D track assessment system 500 includes a first sensor 502A, a first structured light generator 506A, a first heating and cooling device 522A (e.g., solid state or piezo electric), and a first thermal sensor 524A all substantially sealed in a first enclosure 526A forming part of a first sensor pod 528A; a second sensor 502B, a second structured light generator 506B, a second heating and cooling device 522B, and a second thermal sensor 524B all substantially sealed in a second enclosure 526B forming part of a second sensor pod 528B; a third sensor 502C, a third structured light generator 506C, a third heating and cooling device 522C, and a third thermal sensor 524C all substantially sealed in a third enclosure 526C forming part of a third sensor pod 528C; and a fourth sensor 502D, a fourth structured light generator 506D, a fourth heating and cooling device 522D, and a fourth thermal sensor 524D all substantially sealed in a fourth enclosure 526D forming part of a fourth sensor pod 528D. FIG. 6 shows an image of the first sensor 502A and the first light generator 506A (without the first enclosure 526A for illustrative purposes) oriented at an oblique angle to the plane of the railway track bed surface allowing a view of the side of the first rail 520A. FIG. 7 shows the first sensor 502A, the first light generator 506A, and the first heating and cooling device 522A inside the first enclosure 526A.


The controller 514 further includes a 3D sensor controller 530 in communication with the 3D sensors 502, a sensor trigger controller 532 in communication with the 3D sensors 502, a structured light power controller 534 in communication with the structured light generators 506, and a temperature controller 536 in communication with the heating and cooling devices 522 and the thermal sensors 524. The system controller 514 further includes a network interface 537 in communication with the processor 508 and the 3D sensor controller 530, sensor trigger controller 532, structured light power controller 534, and the temperature controller 536. The triggering for the 3D sensors 502 is generated by converting pulses from an encoder 538 (e.g., a quadrature wheel encoder attached adjacent to a wheel 540 on the survey rail vehicle 504 wherein the encoder 538 is capable of generating 12,500 pulses per revolution, with a corresponding direction signal) using the dedicated sensor trigger controller 532, a component of the dedicated system controller 514, which allows converting the very high resolution wheel encoder pulses to a desired profile measurement interval programmatically. For example, the wheel 540 could produce encoder pulses every 0.25 mm of travel and the sensor trigger controller 532 would reduce the sensor trigger pulse to one every 1.5 mm and generate a signal corresponding to the forward survey direction, or a different signal for a reverse survey direction.


The configuration of the four 3D sensors 502 and light generators 506 ensure that the complete rail profile is captured by combining the trigger synchronized left and right 3D sensor profiles of both rails 520 on a railway track simultaneously to produce a single combined scan for each rail. These scans can be referenced to geo-spatial coordinates using the processor 508 by synchronizing the wheel encoder 538 pulses to GNSS receiver positions acquired from the GNSS satellite network (e.g., GPS). This combined rail profile and position reference information can then be saved in the data storage device 510.


The 3D sensors 502 and structured light generators 506 are housed in the substantially sealed watertight enclosures 526. Because of the heating and cooling devices 522, thermal sensors 524, and the dedicated temperature controller 536, the inside of the enclosures 526 can be heated when the ambient temperature is below a low temperature threshold and cooled when the ambient air temperature is above a high temperature threshold. The thermal sensors 524 provide feedback to the temperature controller 536 so that the temperature controller can activate the heating function or the cooling function of the heating and cooling devices on an as-needed basis. These sealed and climate-controlled enclosures 526 ensure the correct operation and extend the operational life of the sensitive sensors 502 and light generators 506 by maintaining a clean and dry environment within acceptable ambient temperature limits. The temperature control function is part of the system controller 514 with a dedicated heating and cooling device interface inside each enclosure.



FIG. 8 shows the first enclosure 526A including a cover plate 542 forming one side of the first enclosure 526A. The cover plate 542 includes a first cover plate aperture 543A through which the first sensor 502A views outside of the first enclosure 526A and a second cover plate aperture 543B through which the light generator casts light outside of the first enclosure 526A. The first cover plate aperture 544A is covered by a first glass panel 544A and the second cover plate aperture 544B is covered by a second glass panel 544B. The glass panels 544 are preferably impact resistant and have optical transmission characteristics that are compatible with the wavelengths of the light generators 506. This helps avoid broken aperture glass and unnecessary heat buildup inside the enclosures 526 from light reflected back into the enclosures 526 during operation. The first sensor 502A and the first light generator 506A are preferably mounted to an internal frame 545 preferably using bolts. The frame 545 is shown in FIG. 9A-9C and such frame is preferably bolted to the inside of the first enclosure 526A. The frame 545 includes a frame base 546 (shown by itself in FIG. 9D), a laser alignment panel 547 to which the first structured light generator 506A is attached, and a sensor alignment panel 548 to which the first 3D sensor 502A is attached. Each additional enclosure (526B, 526C, and 526D) includes a cover plate (like the cover plate 542) with apertures (like the apertures 544) as well as a frame (like the frame 545) for attaching and optically aligning sensors and light generators together inside the enclosures.



FIG. 10 shows the first sensor pod 528A including the first enclosure 526A. The first sensor pod 528 includes a sill mount 548 and side brackets 550 (including a first side bracket 550A shown in FIG. 11A and a second side bracket 550B shown in FIG. 11B). The sill mount 548 is shown by itself in FIG. 12. The sill mount 548 is preferably attached adjacent to the undercarriage of the rail vehicle 504 by mechanical fastening using bolts or welding the sill mount 548 directly to the rail vehicle undercarriage. The first side bracket 550A is attached adjacent to the sill mount 548 preferably by bolts through a first side bracket first aperture 552A, and the second side bracket 550B is attached adjacent to the sill mount 548 preferably by bolts through a second side bracket first aperture 554A. The first enclosure 526A is attached adjacent to the side brackets 550 preferably using bolts through first side bracket second apertures 552B and second side bracket second apertures 554B extending into tapped holes on the sensor enclosure. As an example, the first side bracket second apertures 552B are elongated so that the first enclosure 526A can be rotated plus or minus up to about 5° relative to the side brackets 550 before being bolted, screwed or otherwise attached tightly adjacent to the side brackets 550. The flexibility to slightly rotate the first enclosure 526A inside the first pod 528A is helpful to compensate for mounting height variations which can occur from rail vehicle to rail vehicle since not all vehicles are the same height. FIG. 13 shows the first sensor pod 528A and the second sensor pod 528B attached adjacent to the undercarriage of the rail vehicle 504 in a configuration that allows for data to be gathered from both sides of the first rail 520A using a combination of the first sensor 502A and the second sensor 502B. In FIG. 13, the first side bracket 550A is removed to show the first enclosure 526A. The orientation of the sensor pods 528 is at an angle α relative to the undercarriage of the rail vehicle 504. Angle α preferably ranges from about 10° to about 60°, more preferably from about 25° to about 55°, and most preferably from about 40° to about 50°. The value for a in FIG. 13 is about 45°. The lowest point of the first sensor pod is preferably at least 75 mm above the rail being scanned by the first sensor 502A. The first sensor 502A is oriented at an oblique angle θ relative to the railway track bed surface 555 wherein angle θ preferably ranges from about 30° to about 60° and more preferably from about 40° to about 50°.



FIG. 14A shows the cover plate 542 with a first air distribution lid 556A attached adjacent to the cover plate 542 preferably by bolts or screws. FIG. 14B-14D show different views of the first air distribution lid 556A by itself. The first air distribution lid 556A includes a first duct mount 557A which directs air through a first enclosed channel 558A to a first walled enclosure 559A at an area proximate to a first air distribution lid first aperture 560A which overlaps the first cover plate aperture 544A. The first air distribution lid 556A includes a second duct mount 557B which directs air through a second enclosed channel 558B to a second walled enclosure 559B at an area proximate to a second air distribution lid second aperture 560B which overlaps the second cover plate aperture 544B. FIG. 15 shows a perspective view of the first sensor pod 528A including the cover plate 542 and the first air distribution lid 556A. A first air duct 562A is engaged with the first duct mount 557A to supply air to the first walled enclosure 559A. A second air duct 562B is engaged with the second duct mount 557B to supply air to the second walled enclosure 559B. FIG. 16 shows a full array of the sensor pods 528 and shows an air blower 564 supplying air through a plurality of ducts 566. FIG. 17 shows schematically how air is supplied from the air blower 564 to the first air distribution lid 556A, a second air distribution lid 556B, a third air distribution lid 556C, and a fourth air distribution lid 556D. The air blower 564 is in communication with the system controller 514 so that when the 3D sensors 502 are activated, the system controller 514 causes the air blower 564 to be activated also. The air flowing through the plurality of ducts 566 to the air distribution lids 556 is used to clear debris from the area proximate to the enclosure cover plate apertures through which the sensors 502 view rails and through which the light generators 506 shine light. As the rail vehicle 504 moves along a railway track, debris that would otherwise cover the view of the sensors 502 or block the light of the light generators 506 is dislodged by the air flow through the air distribution lids 556.


Referring now to FIG. 18, one or more of the plurality of air ducts 566 are further in fluid communication with the first sensor assembly 34 for directing air from the air blower 564 towards sensors of the first sensor assembly 34. The plurality of air ducts 566 in fluid communication with the first sensor assembly 34 are connected to a plurality of duct mounts 40A and 40B of the first sensor assembly 34. As shown in FIGS. 18-19, the plurality of duct mounts 40 are in fluid communication with enclosed channels 42. Enclosed channels 42 are in fluid communication with walled ducts 44. Walled ducts 44 are located proximate to windows or lenses of the sensors on the enclosure 48 containing the one or more light emitters 208 and the camera 224 of the first sensor assembly 34 such that air flowing through the enclosed channels 42 the walled ducts 44 is substantially directed towards the sensors of the first sensor assembly 34.


The air blower 564 preferably includes a plurality of outlets 50 for connecting the plurality of ducts 566 to the air blower 564. For example, the air blower 564 may include a number of outlets 50 corresponding to a number of sensors on both the first sensor assembly 34 and the second sensor assembly 36 such that air from the air blower 564 is imparted proximate to sensors of the first sensor assembly 34 and the second sensor assembly 36. The air blower 564 preferably includes a blower motor 52 located within a blower housing 54. The blower motor 52 is in fluid communication with the plurality of outlets 50.


The air blower 564 further preferably includes a chiller/heater 58 (FIG. 2) for heating or cooler air through the air blower 564. The chiller/heater 58 is preferably in fluid communication with the air blower 564 such that air from the air blower 564 provided to the first sensor assembly 34 and the second sensor assembly 36 may be heated or cooled depending on external environmental conditions. The chiller/heater 58 may be in electronic communication with a controller, such as the temperature controller 536 (FIG. 5) for controlling a heated or cooled temperature of air through the air blower 564.


As shown in FIGS. 2 and 23-24, the first sensor assembly 34, the second sensor assembly 36, and the blower 564 are preferably located proximate to each other underneath the rail car 14 to minimize a required length of the plurality of air ducts 566. The first sensor assembly 34 and the second sensor assembly 36 are preferably arranged underneath the rail car 14 such that sensors of the first sensor assembly 34 and the second sensor assembly 36 are oriented to capture data from the railway track 12 at multiple angles.


Referring again to FIG. 1, the autonomous track assessment system 10 further preferably includes a weather station 60 mounted on exterior of the rail car 14 for detecting external environmental conditions around the autonomous track assessment system 10 such as precipitation, temperature, and other environmental conditions. One or more telemetry components 62A and 62B are also preferably mounted on the rail car 14 and may include, for example, cellular or WiFi antennas for communicating data collected on the autonomous track assessment system 10 to a location that is remote from the rail car 14. The one or more telemetry components 62A and 62B are preferably in communication with a telemetry controller 63 (FIG. 2). One or more cameras 64 may be mounted to record the enclosed space of the rail car 14 for security.


The autonomous track assessment system 10 further preferably includes one or more LiDAR sensors 66 located on an exterior of the rail car 14 for capturing data including a corridor through which the rail car 14 is travelling along the railway track 12. The one or more LiDAR sensors 66 are preferably mounted towards an upper portion of a rear side of the boxcar 14 and are preferably mounted in an enclosure 68. A plurality of digital cameras 70 are also located in the enclosure 68. The autonomous track assessment system 10 preferably includes at least two LiDAR sensors 66 mounted on opposing sides of ends of the rail car, as shown in FIG. 22.



FIG. 22 shows a side cross-sectional view of the sensor enclosure 68 wherein the one or more LiDAR sensors 66 are exposed to collect data. The sensor enclosure 68 includes a sensor enclosure outer cap 72 including a plurality of cap apertures 74 (FIGS. 22 and 23) through which blown air may exit the enclosure 68 to prevent dirt, debris, or precipitation from interfering with the one or more LiDAR sensors 66 as explained in greater detail below. As shown in FIG. 24, a blower 76 is included for blowing air through the enclosure cap 72 and out of the plurality of cap apertures 74. A heater/chiller 78 is provided to heat or cool air from the blower 76 to the one or more LiDAR sensors 66. Air from the blower 76 flows through one or more ducts 80 in the boxcar 14 and through ducts formed through exterior of the boxcar 14, the ducts being in alignment with the sensor enclosure 68 when the sensor enclosure 68 is mounted on the boxcar 14. In one embodiment, air from the blower 76 flows through a computer rack 84 (FIG. 24) located within the rail car 14 for cooling or heating components installed on the computer rack 84. Further, air from the blower 76 may be heated as it passes through the computer rack 84 prior to passing through the enclosure cap 72.


Embodiments further include controlling desirable environmental conditions within the enclosed space of the rail car 14. For example, when various components of controllers including processors and other hardware are located within the rail car 14, conditions such as temperature and humidity may be monitored and a desirable temperature may be maintained using the blower 76 and heater/chiller 78.


Although reference herein is made to the blower 564 shown mounted beneath the rail car 14 proximate to the first sensor assembly 34 and the second sensor assembly 36 and the blower 76 installed within the rail car 14, in one embodiment a single blower may be utilized for heating or cooling the first sensor assembly 34, the second sensor assembly 36, and the one or more LiDAR sensors 66.


The autonomous track assessment system 10 provides for autonomous collection of data from the railway track 12 and a surrounding environment on a platform that is readily compatible with existing railway vehicles. For example, the autonomous track assessment system 10 may be located along an existing train that is transporting freight or other goods without compromising operation of the train. The autonomous track assessment system 10 provides for autonomous collection of data 24 hours per day each day of the year using various sensor assemblies without requiring manual operation or control of the sensor assemblies. Embodiments of the autonomous track assessment system 10 described herein further preferably enable operation of the autonomous track assessment system 10 in harsh environments, such as in extreme cold or heat, without compromising an ability of sensor assemblies of the autonomous track assessment system 10 from capturing data during extreme weather conditions. For example, in extreme cold, it s not uncommon for ice to form on various sensor assemblies. Using the blowers described herein blowing warm air across the outer surfaces of the various sensor assemblies allows the system 10 to keep operating when other systems would be rendered ineffective because of ice build-up or, in the case of extreme hot weather, overheating.


The foregoing description of preferred embodiments of the present disclosure has been presented for purposes of illustration and description. The described preferred embodiments are not intended to be exhaustive or to limit the scope of the disclosure to the precise form(s) disclosed. Obvious modifications or variations are possible in light of the above teachings. The embodiments are chosen and described in an effort to provide the best illustrations of the principles of the disclosure and its practical application, and to thereby enable one of ordinary skill in the art to utilize the concepts revealed in the disclosure in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the disclosure as determined by the appended claims when interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.

Claims
  • 1. An autonomous railway track assessment apparatus for gathering, storing, and processing profiles of one or both rails on a railway track, the apparatus comprising: railway track assessment platform including a boxcar including an enclosed space formed therein;one or more power sources located on the boxcar;a controller in electrical communication with the one or power sources including at least one processor and a data storage device in communication with the processor;a first sensor assembly in electronic communication with the controller, the first sensor assembly including a first sensor enclosure, a light emitting device, and one or more first 3D sensors oriented to capture data from the railway track;a first LiDAR sensor configured to gather data of a rail corridor along a first scan plane and a second LiDAR sensor configured to gather data of a rail corridor along a second scan plane wherein the first LiDAR sensor and the second LiDAR sensor is in electrical communication with the controller and is physically connected to on an outer rear surface of the boxcar;an air handling system located on the boxcar, the air handling system including an air blower and a heater/chiller;a set of air ducts in fluid communication with the air handling system, the first sensor assembly, the first LiDAR sensor, and the second LiDAR sensor for supplying heated or cooled blown air from the air from the handling system to the first sensor assembly the first LiDAR sensor, and the second LiDAR sensor;wherein data from the railway track is autonomously collected by the first sensor assembly, the first LiDAR sensor, and the second LiDAR sensor controlled by the controller and such data is stored on the data storage device.
  • 2. The autonomous railway track assessment apparatus of claim 1 further comprising: a second sensor assembly in electronic communication with the controller, the second sensor assembly including a second sensor enclosure, a second light emitting device, and one or more second sensors oriented to capture data from the railway track;the set of air ducts in fluid communication with the air handling system, the first sensor assembly, and the second sensor assembly for supplying heated or cooled blown air from the air handling system to the first sensor assembly and the second sensor assembly;wherein data from the railway track is autonomously collected by both the first sensor assembly controlled by the controller and the second sensor assembly controlled by the controller and such data is stored on the data storage device.
  • 3. The autonomous railway track assessment apparatus of claim 2 wherein the second sensor assembly is oriented at an oblique angle α relative to the undercarriage of the rail vehicle.
  • 4. The autonomous railway track assessment apparatus of claim 1, wherein the first sensor assembly is oriented at a substantially perpendicular angle relative to the railway track.
  • 5. The autonomous railway track assessment apparatus of claim 1, further comprising a temperature controller in communication with the air handling system wherein the blower and heater/chiller are activated or deactivated by the temperature controller based on environmental conditions of the autonomous railway track assessment apparatus.
  • 6. The autonomous railway track assessment apparatus of claim 5, further comprising one or more valves within ducts between the air handling system and each of the first sensor assembly and the second sensor assembly.
  • 7. An air handling system for an autonomous track assessment apparatus, the air handling system comprising: a railroad data gathering assembly including a sensor and a light emitter inside a sensor enclosure wherein the railroad data gathering assembly is operable to gather data from a railroad track using the sensor and the light emitter;an air blower;a heater/chiller in fluid communication with the air blower;a temperature controller in electronic communication with the air blower and the heater/chiller;a temperature sensor in communication with the temperature controller;at least one sensor assembly comprising a LiDAR sensor mounted on an outer surface of a boxcar;at least one duct for communicating air from the air blower and heater/chiller to the at least one sensor assembly;wherein the temperature controller activates and deactivates the air blower and heater/chiller to provide conditioned air to the railroad data gathering assembly based on data received from the temperature sensor wherein the conditioned air is blown out of the sensor enclosure proximate to the sensor and the light emitter to divert debris or precipitation from the sensor and the light emitter.
  • 8. The air handling system for an autonomous track assessment apparatus of claim 7, the LiDAR sensor further including a LiDAR sensor housing having a plurality of apertures formed therethrough for emitting air from the air handling system towards a sensor surface of the LiDAR sensor.
  • 9. The air handling system for an autonomous track assessment apparatus of claim 8, wherein the plurality of apertures are arranged radially around the LiDAR sensor housing.
  • 10. The air handling system for an autonomous track assessment apparatus of claim 8, wherein the LiDAR sensor housing further includes at least one camera located on the LiDAR sensor housing, wherein air flowing through the LiDAR sensor housing towards the plurality of apertures passes proximate to a lens of the at least one camera.
  • 11. The air handling system for an autonomous track assessment apparatus of claim 7, wherein air from the air blower passes through a computer hardware rack prior to passing through the sensor enclosure.
  • 12. An autonomous railway track assessment apparatus for gathering, storing, and processing profiles of one or both rails on a railway track, the apparatus comprising: railway track assessment platform including a boxcar including an enclosed space formed therein;one or more power sources located on the boxcar;a controller in electrical communication with the one or power sources including at least one processor and a data storage device in communication with the processor;a first sensor assembly in electronic communication with the controller, the first sensor assembly including a first sensor enclosure, a light emitting device, and one or more first sensors oriented to capture data from the railway track wherein the first sensor assembly is oriented at a substantially perpendicular angle relative to the railway track;a second sensor assembly in electronic communication with the controller, the second sensor assembly including a second sensor enclosure, a light emitting device, and one or more second sensors oriented to capture data from the railway track wherein the second sensor assembly is oriented at an oblique angle relative to the undercarriage of the boxcar;a first LiDAR sensor inside a first LiDAR sensor housing, the first LiDAR sensor configured to gather data of a rail corridor along a first scan plane wherein the first LiDAR sensor is in electrical communication with the controller and is physically connected to on an outer rear surface of the boxcar;wherein data is autonomously collected by the first sensor assembly, the second sensor assembly, and the first LiDAR sensor controlled by the controller and such data is stored on the data storage device.
  • 13. The autonomous railway track assessment apparatus of claim 12, further comprising: an air handling system comprising: an air blower;a heater/chiller in fluid communication with the air blower;a temperature controller in electronic communication with the air blower and the heater/chiller; anda temperature sensor in communication with the temperature controller;wherein the temperature controller activates and deactivates the air blower and heater/chiller to provide conditioned air to the first sensor assembly, the second sensor assembly, and the first LiDAR sensor based on data received from the temperature sensor wherein the conditioned air is blown out of the sensor enclosure proximate to the sensor and the light emitter to divert debris or precipitation from the sensor and the light emitter.
  • 14. The autonomous railway track assessment apparatus of claim 13 wherein the first LiDAR sensor housing comprises a plurality of apertures formed therethrough for emitting air from the air handling system towards a sensor surface of the first LiDAR sensor.
  • 15. The autonomous railway track assessment apparatus of claim 14 wherein the plurality of apertures are arranged radially around the first LiDAR sensor housing.
  • 16. The autonomous railway track assessment apparatus of claim 14 wherein the first LiDAR sensor housing further includes at least one camera located on the first LiDAR sensor housing, wherein air flowing through the first LiDAR sensor housing towards the plurality of apertures passes proximate to a lens of the at least one camera.
  • 17. The autonomous railway track assessment apparatus of claim 14 wherein air from the air blower passes through a computer hardware rack prior to passing through the sensor enclosure.
  • 18. The autonomous railway track assessment apparatus of claim 12, further comprising a second LiDAR sensor inside a second LiDAR sensor housing, the second LiDAR sensor configured to gather data of a rail corridor along a second scan plane wherein the second LiDAR sensor is in electrical communication with the controller and is physically connected to on an outer rear surface of the boxcar and wherein data is autonomously collected by the second LiDAR sensor controlled by the controller and such data is stored on the data storage device.
CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to U.S. Provisional Patent Application Ser. No. 62/848,630 for an “Autonomous Track Assessment System” filed on May 16, 2019, Provisional Patent Application Ser. No. 62/988,630 for an “Autonomous Track Assessment System” filed on Mar. 12, 2020, and Provisional Patent Application Ser. No. 63/016,661 for an “Autonomous Track Assessment System” filed on Apr. 28, 2020, and is a continuation-in-part and claims priority to U.S. application Ser. No. 16/255,928 for an “Apparatus and Method for Gathering Data From Sensors Oriented at an Oblique Angle Relative to a Railway Track” filed on Jan. 24, 2019, which is a continuation-in-part of and claims priority to U.S. application Ser. No. 16/127,956 entitled “APPARATUS AND METHOD FOR CALCULATING WOODEN CROSSTIE PLATE CUT MEASUREMENTS AND RAIL SEAT ABRASION MEASUREMENTS BASED ON RAIL HEAD HEIGHT” which was filed on Sep. 11, 2018, which claims priority to U.S. Provisional Patent Application Ser. No. 62/679,467 entitled “APPARATUS AND METHOD FOR CALCULATING WOODEN TIE PLATE CUT MEASUREMENTS AND RAIL SEAT ABRASION MEASUREMENTS” which was filed on Jun. 1, 2018, the entireties of which are incorporated herein by reference in their respective entireties.

US Referenced Citations (449)
Number Name Date Kind
3562419 Stewart et al. Feb 1971 A
3942000 Dieringer Mar 1976 A
4040738 Wagner Aug 1977 A
4198164 Cantor Apr 1980 A
4265545 Slaker May 1981 A
4330775 Iwamoto et al. May 1982 A
4490038 Theurer et al. Dec 1984 A
4531837 Panetti Jul 1985 A
4554624 Wickham et al. Nov 1985 A
4600012 Kohayakawa et al. Jul 1986 A
4653316 Fukuhara Mar 1987 A
4676642 French Jun 1987 A
4691565 Theurer Sep 1987 A
4700223 Shoutaro et al. Oct 1987 A
4731853 Hata Mar 1988 A
4775238 Weber Oct 1988 A
4781060 Berndt Nov 1988 A
4899296 Khattak Feb 1990 A
4900153 Weber et al. Feb 1990 A
4915504 Thurston Apr 1990 A
4974168 Marx Nov 1990 A
5199176 Theurer et al. Apr 1993 A
5203089 Trefouel et al. Apr 1993 A
5221044 Guins Jun 1993 A
5245855 Burgel et al. Sep 1993 A
5247338 Danneskiold-Samsoe et al. Sep 1993 A
5275051 De Beer Jan 1994 A
5353512 Theurer et al. Oct 1994 A
5433111 Hershey et al. Jul 1995 A
5487341 Newman Jan 1996 A
5493499 Theurer et al. Feb 1996 A
5612538 Hackel et al. Mar 1997 A
5623244 Cooper Apr 1997 A
5627508 Cooper et al. May 1997 A
5671679 Straub et al. Sep 1997 A
5721685 Holland et al. Feb 1998 A
5743495 Welles Apr 1998 A
5744815 Gurevich et al. Apr 1998 A
5757472 Wangler et al. May 1998 A
5786750 Cooper Jul 1998 A
5787815 Andersson et al. Aug 1998 A
5791063 Kesler et al. Aug 1998 A
5793491 Wangler et al. Aug 1998 A
5793492 Vanaki Aug 1998 A
5804731 Jaeggi Sep 1998 A
5808906 Sanchez-Revuelta et al. Sep 1998 A
5912451 Gurevich et al. Jun 1999 A
5969323 Gurevich Oct 1999 A
5970438 Clark et al. Oct 1999 A
5986547 Korver et al. Nov 1999 A
6025920 Dec Feb 2000 A
6055322 Salganicoff Apr 2000 A
6055862 Martens May 2000 A
6062476 Stern et al. May 2000 A
6064428 Trosino et al. May 2000 A
6069967 Rozmus et al. May 2000 A
6128558 Kernwein Oct 2000 A
6243657 Tuck et al. Jun 2001 B1
6252977 Salganicoff Jun 2001 B1
6324912 Wooh Dec 2001 B1
6347265 Bidaud Feb 2002 B1
6356299 Trosino et al. Mar 2002 B1
6357297 Makino et al. Mar 2002 B1
6405141 Carr et al. Jun 2002 B1
6416020 Gronskov Jul 2002 B1
6496254 Bostrom Dec 2002 B2
6523411 Mian et al. Feb 2003 B1
6540180 Anderson Apr 2003 B2
6570497 Puckette, IV May 2003 B2
6600999 Clark et al. Jul 2003 B2
6615648 Ferguson et al. Sep 2003 B1
6647891 Holmes et al. Nov 2003 B2
6665066 Nair et al. Dec 2003 B2
6681160 Bidaud Jan 2004 B2
6698279 Stevenson Mar 2004 B1
6715354 Wooh Apr 2004 B2
6768551 Mian et al. Jul 2004 B2
6768959 Ignagni Jul 2004 B2
6804621 Pedanckar Oct 2004 B1
6854333 Wooh Feb 2005 B2
6862936 Kenderian et al. Mar 2005 B2
6873998 Dorum Mar 2005 B1
6909514 Nayebi Jun 2005 B2
7023539 Kowalski Apr 2006 B2
7034272 Leonard Apr 2006 B1
7036232 Casagrande May 2006 B2
7054762 Pagano et al. May 2006 B2
7084989 Johannesson et al. Aug 2006 B2
7130753 Pedanekar Oct 2006 B2
7152347 Herzog et al. Dec 2006 B2
7164476 Shima et al. Jan 2007 B2
7208733 Mian et al. Apr 2007 B2
7213789 Matzan May 2007 B1
7298548 Mian Nov 2007 B2
7328871 Mace et al. Feb 2008 B2
7355508 Mian et al. Apr 2008 B2
7357326 Hattersley et al. Apr 2008 B2
7392117 Bilodeau et al. Jun 2008 B1
7392595 Heimann Jul 2008 B2
7403296 Farritor et al. Jul 2008 B2
7412899 Mian et al. Aug 2008 B2
7463348 Chung Dec 2008 B2
7499186 Waisanen Mar 2009 B2
7502670 Harrison Mar 2009 B2
7516662 Nieisen et al. Apr 2009 B2
7555954 Pagano et al. Jul 2009 B2
7564569 Mian et al. Jul 2009 B2
7602937 Mian et al. Oct 2009 B2
7616329 Villar et al. Nov 2009 B2
7659972 Magnus et al. Feb 2010 B2
7680631 Selig et al. Mar 2010 B2
7681468 Verl et al. Mar 2010 B2
7698028 Bilodeau et al. Apr 2010 B1
7755660 Nejikovsky et al. Jul 2010 B2
7755774 Farritor et al. Jul 2010 B2
7769538 Rousseau Aug 2010 B2
7832281 Mian et al. Nov 2010 B2
7869909 Harrison Jan 2011 B2
7882742 Martens Feb 2011 B1
7899207 Mian et al. Mar 2011 B2
7920984 Farritor Apr 2011 B2
7937246 Farritor et al. May 2011 B2
7942058 Turner May 2011 B2
8006559 Mian et al. Aug 2011 B2
8079274 Mian et al. Dec 2011 B2
8081320 Villar et al. Dec 2011 B2
8111387 Douglas et al. Feb 2012 B2
8140250 Mian et al. Mar 2012 B2
8150105 Mian et al. Apr 2012 B2
8155809 Bilodeau et al. Apr 2012 B1
8180590 Szwilski et al. May 2012 B2
8188430 Mian et al. May 2012 B2
8190377 Fu May 2012 B2
8209145 Paglinco et al. Jun 2012 B2
8263953 Fomenkar et al. Sep 2012 B2
8289526 Kilian et al. Oct 2012 B2
8326582 Mian et al. Dec 2012 B2
8335606 Mian et al. Dec 2012 B2
8345948 Zarembski et al. Jan 2013 B2
8345099 Bloom et al. Feb 2013 B2
8365604 Kahn Feb 2013 B2
8405837 Nagle, II et al. Mar 2013 B2
8412393 Anderson Apr 2013 B2
8418563 Wigh et al. Apr 2013 B2
8423240 Mian et al. Apr 2013 B2
8424387 Wigh et al. Apr 2013 B2
8478480 Mian et al. Jul 2013 B2
8485035 Wigh et al. Jul 2013 B2
8490887 Jones Jul 2013 B2
8514387 Scherf et al. Aug 2013 B2
8577647 Farritor et al. Nov 2013 B2
8615110 Landes Dec 2013 B2
8625878 Haas et al. Jan 2014 B2
8649932 Mian et al. Feb 2014 B2
8655540 Mian et al. Feb 2014 B2
8682077 Longacre, Jr. Mar 2014 B1
8700924 Mian et al. Apr 2014 B2
8711222 Aaron et al. Apr 2014 B2
8724904 Fujiki May 2014 B2
8806948 Kahn et al. Aug 2014 B2
8818585 Bartonek Aug 2014 B2
8820166 Wigh et al. Sep 2014 B2
8868291 Mian et al. Oct 2014 B2
8875635 Turner et al. Nov 2014 B2
8887572 Turner Nov 2014 B2
8903574 Cooper et al. Dec 2014 B2
8925873 Gamache et al. Jan 2015 B2
8934007 Snead Jan 2015 B2
8942426 Bar-am Jan 2015 B2
8958079 Kainer et al. Feb 2015 B2
9036025 Haas et al. May 2015 B2
9049433 Prince Jun 2015 B1
9050984 Li et al. Jun 2015 B2
9111444 Kaganovich Aug 2015 B2
9121747 Mian et al. Sep 2015 B2
9134185 Mian et al. Sep 2015 B2
9175998 Turner et al. Nov 2015 B2
9177210 King Nov 2015 B2
9187104 Fang et al. Nov 2015 B2
9195907 Longacre, Jr. Nov 2015 B1
9205849 Cooper et al. Dec 2015 B2
9205850 Shimada Dec 2015 B2
9212902 Enomoto et al. Dec 2015 B2
9222904 Harrison Dec 2015 B2
9234786 Groll et al. Jan 2016 B2
9255913 Kumar et al. Feb 2016 B2
9297787 Fisk Mar 2016 B2
9310340 Mian et al. Apr 2016 B2
9336683 Inomata et al. May 2016 B2
9340219 Gamache et al. May 2016 B2
9346476 Dargy et al. May 2016 B2
9347864 Farritor et al. May 2016 B2
9389205 Mian et al. Jul 2016 B2
9415784 Bartonek et al. Aug 2016 B2
9423415 Nanba et al. Aug 2016 B2
9429545 Havira et al. Aug 2016 B2
9441956 Kainer et al. Sep 2016 B2
9446776 Cooper et al. Sep 2016 B2
9454816 Mian et al. Sep 2016 B2
9469198 Cooper et al. Oct 2016 B2
9518947 Bartonek et al. Dec 2016 B2
9533698 Warta Jan 2017 B2
9562878 Graham et al. Feb 2017 B2
9571796 Mian et al. Feb 2017 B2
9575007 Rao et al. Feb 2017 B2
9580091 Kraeling et al. Feb 2017 B2
9581998 Cooper et al. Feb 2017 B2
9607446 Cooper et al. Mar 2017 B2
9618335 Mesher Apr 2017 B2
9619691 Pang et al. Apr 2017 B2
9619725 King Apr 2017 B2
9628762 Farritor Apr 2017 B2
9664567 Sivathanu et al. May 2017 B2
9669852 Combs Jun 2017 B2
9671358 Cooper et al. Jun 2017 B2
9689760 Lanza di Scalea et al. Jun 2017 B2
9714043 Mian et al. Jul 2017 B2
9744978 Bhattacharjya et al. Aug 2017 B2
9752993 Thompson et al. Sep 2017 B1
9771090 Warta Sep 2017 B2
9796400 Puttagunta et al. Oct 2017 B2
9810533 Fosburgh et al. Nov 2017 B2
9825662 Mian et al. Nov 2017 B2
9849894 Mesher Dec 2017 B2
9849895 Mesher Dec 2017 B2
9860962 Mesher Jan 2018 B2
9873442 Mesher Jan 2018 B2
9921584 Rao et al. Mar 2018 B2
9922416 Mian et al. Mar 2018 B2
9950716 English Apr 2018 B2
9950720 Mesher Apr 2018 B2
9981671 Fraser et al. May 2018 B2
9981675 Cooper et al. May 2018 B2
9983593 Cooper et al. May 2018 B2
9989498 Lanza di Scalea et al. Jun 2018 B2
10035498 Richardson et al. Jul 2018 B2
10040463 Singh Aug 2018 B2
10043154 King Aug 2018 B2
10077061 Schmidt et al. Sep 2018 B2
10081376 Singh Sep 2018 B2
10086857 Puttagunta et al. Oct 2018 B2
10167003 Bilodeau Jan 2019 B1
10286877 Lopez Galera et al. May 2019 B2
10322734 Mesher Jun 2019 B2
10349491 Mesher Jul 2019 B2
10352831 Kondo et al. Jul 2019 B2
10362293 Mesher Jul 2019 B2
10384697 Mesher Aug 2019 B2
10392035 Berggren Aug 2019 B2
10408606 Raab Sep 2019 B1
10414416 Hampapur Sep 2019 B2
10502831 Eichenholz Dec 2019 B2
10518791 Singh Dec 2019 B2
10543861 Bartek et al. Jan 2020 B1
10582187 Mesher Mar 2020 B2
10611389 Khosla Apr 2020 B2
10613550 Khosla Apr 2020 B2
10616556 Mesher Apr 2020 B2
10616557 Mesher Apr 2020 B2
10616558 Mesher Apr 2020 B2
10618537 Khosla Apr 2020 B2
10625760 Mesher Apr 2020 B2
10730538 Mesher Aug 2020 B2
10796192 Fernandez Oct 2020 B2
10816347 Wygant et al. Oct 2020 B2
10822008 Wade Nov 2020 B2
10829135 Anderson et al. Nov 2020 B2
10908291 Mesher Feb 2021 B2
10989694 Kawabata et al. Apr 2021 B2
11001283 Dick et al. May 2021 B2
11169269 Mesher Nov 2021 B2
20010045495 Olson et al. Nov 2001 A1
20020065610 Clark et al. May 2002 A1
20020070283 Young Jun 2002 A1
20020093487 Rosenberg Jul 2002 A1
20020099507 Clark et al. Jul 2002 A1
20020150278 Wustefeld Oct 2002 A1
20020196456 Komiya et al. Dec 2002 A1
20030059087 Waslowski et al. Mar 2003 A1
20030062414 Tsikos et al. Apr 2003 A1
20030072001 Mian et al. Apr 2003 A1
20030075675 Braune et al. Apr 2003 A1
20030140509 Casagrande Jul 2003 A1
20030160193 Sanchez Revuelta et al. Aug 2003 A1
20030164053 Ignagni Sep 2003 A1
20040021858 Shima et al. Feb 2004 A1
20040084069 Woodard May 2004 A1
20040088891 Theurer May 2004 A1
20040122569 Bidaud Jun 2004 A1
20040189452 Li Sep 2004 A1
20040247157 Lages Dec 2004 A1
20040263624 Nejikovsky Dec 2004 A1
20050121539 Takada et al. Jun 2005 A1
20050244585 Schmeling Nov 2005 A1
20050279240 Pedanekar et al. Dec 2005 A1
20060017911 Villar Jan 2006 A1
20060098843 Chew May 2006 A1
20060171704 Bingle Aug 2006 A1
20060231685 Mace et al. Oct 2006 A1
20070136029 Selig et al. Jun 2007 A1
20070150130 Welles Jun 2007 A1
20070211145 Kilian et al. Sep 2007 A1
20070265780 Kesler et al. Nov 2007 A1
20070289478 Becker et al. Dec 2007 A1
20080007724 Chung Jan 2008 A1
20080177507 Mian et al. Jul 2008 A1
20080212106 Hoffmann Sep 2008 A1
20080298674 Baker Dec 2008 A1
20080304065 Hesser Dec 2008 A1
20080304083 Farritor et al. Dec 2008 A1
20090040503 Kilian Feb 2009 A1
20090073428 Magnus Mar 2009 A1
20090196486 Distante et al. Aug 2009 A1
20090250533 Akiyama et al. Oct 2009 A1
20090273788 Nagle et al. Nov 2009 A1
20090319197 Villar et al. Dec 2009 A1
20100007551 Pagliuco Jan 2010 A1
20100026551 Szwilski Feb 2010 A1
20100106309 Grohman et al. Apr 2010 A1
20100207936 Minear Aug 2010 A1
20100289891 Akiyama Nov 2010 A1
20110064273 Zarembski et al. Mar 2011 A1
20110209549 Kahn Sep 2011 A1
20110251742 Haas et al. Oct 2011 A1
20120026352 Natroshvilli et al. Feb 2012 A1
20120051643 Ha et al. Mar 2012 A1
20120062731 Enomoto et al. Mar 2012 A1
20120192756 Miller et al. Aug 2012 A1
20120218868 Kahn et al. Aug 2012 A1
20120222579 Turner et al. Sep 2012 A1
20120245908 Berggren Sep 2012 A1
20120263342 Haas Oct 2012 A1
20120300060 Farritor Nov 2012 A1
20130070083 Snead Mar 2013 A1
20130092758 Tanaka et al. Apr 2013 A1
20130096739 Landes et al. Apr 2013 A1
20130155061 Jahanashahi et al. Jun 2013 A1
20130170709 Distante et al. Jul 2013 A1
20130191070 Kainer Jul 2013 A1
20130202090 Belcher et al. Aug 2013 A1
20130230212 Landes Sep 2013 A1
20130231873 Fraser Sep 2013 A1
20130276539 Wagner et al. Oct 2013 A1
20130313372 Gamache et al. Nov 2013 A1
20130317676 Cooper et al. Nov 2013 A1
20140069193 Graham et al. Mar 2014 A1
20140129154 Cooper May 2014 A1
20140142868 Bidaud May 2014 A1
20140151512 Cooper Jun 2014 A1
20140177656 Mian et al. Jun 2014 A1
20140200952 Hampapur et al. Jul 2014 A1
20140333771 Mian et al. Nov 2014 A1
20140339374 Mian et al. Nov 2014 A1
20150106038 Turner Apr 2015 A1
20150131108 Kainer et al. May 2015 A1
20150219487 Maraini Aug 2015 A1
20150225002 Branka et al. Aug 2015 A1
20150268172 Naithani et al. Sep 2015 A1
20150269722 Naithani et al. Sep 2015 A1
20150284912 Delmonic et al. Oct 2015 A1
20150285688 Naithani et al. Oct 2015 A1
20150375765 Mustard Dec 2015 A1
20160002865 English et al. Jan 2016 A1
20160039439 Fahmy et al. Feb 2016 A1
20160059623 Kilian Mar 2016 A1
20160082991 Warta Mar 2016 A1
20160121912 Puttagunta et al. May 2016 A1
20160159381 Fahmy Jun 2016 A1
20160207551 Mesher Jul 2016 A1
20160209003 Mesher Jul 2016 A1
20160212826 Mesher Jul 2016 A1
20160221592 Puttagunta Aug 2016 A1
20160249040 Mesher Aug 2016 A1
20160282108 Martinod Restrepo et al. Sep 2016 A1
20160304104 Witte et al. Oct 2016 A1
20160305915 Witte et al. Oct 2016 A1
20160312412 Schrunk, III Oct 2016 A1
20160318530 Johnson Nov 2016 A1
20160321513 Mitti et al. Nov 2016 A1
20160325767 LeFabvre et al. Nov 2016 A1
20160368510 Simon et al. Dec 2016 A1
20170029001 Berggren Feb 2017 A1
20170034892 Mesher Feb 2017 A1
20170066459 Singh Mar 2017 A1
20170106885 Singh Apr 2017 A1
20170106887 Mian et al. Apr 2017 A1
20170182980 Davies et al. Jun 2017 A1
20170203775 Mesher Jul 2017 A1
20170205379 Prince et al. Jul 2017 A1
20170219471 Fisk et al. Aug 2017 A1
20170267264 English et al. Sep 2017 A1
20170297536 Giraud et al. Oct 2017 A1
20170305442 Viviani Oct 2017 A1
20170313286 Giraud et al. Nov 2017 A1
20170313332 Paget et al. Nov 2017 A1
20170336293 Kondo et al. Nov 2017 A1
20180038957 Kawazoe et al. Feb 2018 A1
20180039842 Schuchmann et al. Feb 2018 A1
20180057030 Puttagunta et al. Mar 2018 A1
20180079433 Mesher Mar 2018 A1
20180079434 Mesher Mar 2018 A1
20180106000 Fruehwirt Apr 2018 A1
20180120440 O'Keefe May 2018 A1
20180127006 Wade May 2018 A1
20180220512 Mesher Aug 2018 A1
20180222504 Birch et al. Aug 2018 A1
20180276494 Fernandez Sep 2018 A1
20180281829 Euston et al. Oct 2018 A1
20180339720 Singh Nov 2018 A1
20180370552 Puttagunta et al. Dec 2018 A1
20180372875 Juelsgaard et al. Dec 2018 A1
20190039633 Li Feb 2019 A1
20190054937 Graetz Feb 2019 A1
20190107607 Danziger Apr 2019 A1
20190135315 Dargy et al. May 2019 A1
20190156569 Jung et al. May 2019 A1
20190179026 Englard et al. Jun 2019 A1
20190248393 Khosla Aug 2019 A1
20190310470 Weindorf Oct 2019 A1
20190349563 Mesher Nov 2019 A1
20190349564 Mesher Nov 2019 A1
20190349565 Mesher Nov 2019 A1
20190349566 Mesher Nov 2019 A1
20190357337 Mesher Nov 2019 A1
20190367060 Mesher Dec 2019 A1
20190367061 Mesher Dec 2019 A1
20200025578 Wygant et al. Jan 2020 A1
20200034637 Olson et al. Jan 2020 A1
20200086903 Mesher Mar 2020 A1
20200156677 Mesher May 2020 A1
20200160733 Dick et al. May 2020 A1
20200164904 Dick et al. May 2020 A1
20200180667 Kim et al. Jun 2020 A1
20200198672 Underwood et al. Jun 2020 A1
20200221066 Mesher Jul 2020 A1
20200231193 Chen et al. Jul 2020 A1
20200239049 Dick et al. Jul 2020 A1
20200302592 Ebersohn et al. Sep 2020 A1
20200346673 Mesher Nov 2020 A1
20200363532 Mesher Nov 2020 A1
20200400542 Fisk et al. Dec 2020 A1
20210019548 Fernandez Jan 2021 A1
20210041398 Van Wyk et al. Feb 2021 A1
20210041877 Lacaze et al. Feb 2021 A1
20210049783 Saniei et al. Feb 2021 A1
20210061322 Dick et al. Mar 2021 A1
20210072393 Mesher Mar 2021 A1
20210078622 Miller et al. Mar 2021 A1
20210229714 Dick et al. Jul 2021 A1
Foreign Referenced Citations (155)
Number Date Country
2061014 Aug 1992 CA
2069971 Mar 1993 CA
2574428 Feb 2006 CA
2607634 Apr 2008 CA
2574428 Oct 2009 CA
2782341 Jun 2011 CA
2844113 Feb 2013 CA
2986580 Sep 2014 CA
2867560 Apr 2015 CA
2607634 Jun 2015 CA
2945614 Oct 2015 CA
2945614 Oct 2015 CA
2732971 Jan 2016 CA
2996128 Mar 2016 CA
2860073 May 2016 CA
2867560 Jul 2017 CA
2955105 Jul 2017 CA
104751602 Jul 2015 CN
106291538 Jan 2017 CN
106364503 Feb 2017 CN
106373191 Feb 2017 CN
106384190 Feb 2017 CN
1045356526 Jun 2017 CN
107688024 Feb 2018 CN
206984011 Feb 2018 CN
108009484 May 2018 CN
108657222 Oct 2018 CN
113626975 Nov 2021 CN
19831176 Jan 2000 DE
19831215 Jan 2000 DE
10040139 Jul 2002 DE
19826422 Sep 2002 DE
60015268 Mar 2005 DE
19943744 Jan 2006 DE
19919604 Aug 2009 DE
102012207427 Jul 2013 DE
102009018036 Feb 2014 DE
102014119056 Jun 2016 DE
0274081 Jul 1988 EP
1079322 Feb 2001 EP
1146353 Oct 2001 EP
1158460 Nov 2001 EP
1168269 Jan 2002 EP
1197417 Apr 2002 EP
1236634 Sep 2002 EP
1098803 Jan 2003 EP
1600351 Jan 2007 EP
1892503 Jul 2007 EP
1918702 May 2008 EP
1964026 Sep 2008 EP
1992167 May 2016 EP
3024123 May 2016 EP
2806065 Sep 2016 EP
3138753 Mar 2017 EP
3138754 Mar 2017 EP
2697738 Aug 2017 EP
2697738 Aug 2017 EP
2998927 Sep 2018 EP
3431359 Jan 2019 EP
3561501 Oct 2019 EP
3105599 Apr 2020 EP
3433154 Jun 2020 EP
3689706 Aug 2020 EP
3685117 Nov 2021 EP
2674809 Oct 1992 FR
3049255 Sep 2017 FR
3077553 Feb 2018 FR
304925561 Apr 2018 FR
3052416 Jul 2019 FR
3077553 Aug 2019 FR
2419759 Jun 1985 GB
2265779 Oct 1993 GB
2378344 Feb 2003 GB
2383635 Jun 2005 GB
2403861 Mar 2006 GB
2536746 Sep 2016 GB
2536746 Mar 2017 GB
51001138 Jan 1976 JP
60039555 Mar 1985 JP
63302314 Dec 1988 JP
6011316 Jan 1994 JP
06322707 Nov 1994 JP
H07146131 Jun 1995 JP
7280532 Oct 1995 JP
H07294443 Nov 1995 JP
H07294444 Nov 1995 JP
10332324 Dec 1998 JP
11172606 Jun 1999 JP
2000221146 Aug 2000 JP
2000241360 Sep 2000 JP
H0924828 Jul 2002 JP
2002294610 Oct 2002 JP
2003074004 Mar 2003 JP
2003121556 Apr 2003 JP
2004132881 Apr 2004 JP
2007240342 Sep 2007 JP
4008082 Nov 2007 JP
2010229642 Oct 2010 JP
5283548 Sep 2013 JP
5812595 Nov 2015 JP
2015209205 Nov 2015 JP
2016191264 Nov 2016 JP
6068012 Jan 2017 JP
2017020862 Jan 2017 JP
6192717 Sep 2017 JP
7327413 May 2018 JP
6425990 Nov 2018 JP
2019065650 Apr 2019 JP
6530979 Jun 2019 JP
101562635 Oct 2015 KR
101706271 Feb 2017 KR
1020180061929 Jun 2018 KR
2142892 Dec 1999 RU
101851 Jan 2011 RU
1418105 Aug 1988 SU
200005576 Feb 2000 WO
200008459 Feb 2000 WO
2000-73118 Dec 2000 WO
2001066401 Sep 2001 WO
3186227 Nov 2001 WO
2001066401 May 2003 WO
2005036199 Apr 2005 WO
2005036199 Apr 2005 WO
2005098352 Oct 2005 WO
2006008292 Jan 2006 WO
2006014893 Feb 2006 WO
2010091970 Aug 2010 WO
2011002534 Jan 2011 WO
2011126802 Oct 2011 WO
2012142548 Oct 2012 WO
2013146502 Mar 2013 WO
2013177393 Nov 2013 WO
2014017015 Jan 2014 WO
2015160300 Oct 2015 WO
2015165560 Nov 2015 WO
2016008201 Jan 2016 WO
2016027072 Feb 2016 WO
2016007393 Jul 2016 WO
2016168576 Oct 2016 WO
2016168623 Oct 2016 WO
2017159701 Sep 2017 WO
2018158712 Sep 2018 WO
2018207469 Nov 2018 WO
2018208153 Nov 2018 WO
2018210441 Nov 2018 WO
2019023613 Jan 2019 WO
2019023658 Jan 2019 WO
2019023613 Jan 2019 WO
2019023658 Jan 2019 WO
WO-2019023658 Jan 2019 WO
2019086158 May 2019 WO
2019212693 Nov 2019 WO
2020078703 Apr 2020 WO
2020232431 Nov 2020 WO
2020232443 Nov 2020 WO
Non-Patent Literature Citations (140)
Entry
US 8,548,242 B1, 10/2013, Longacre, Jr. (withdrawn)
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/255,928 dated Oct. 18, 2019.
US Patent and Trademark Office, Final Office Action for U.S. Appl. No. 16/127,956 dated Jul. 9, 2019.
US Patent and Tademark Office, Non-Final Office Action for U.S. Appl. No. 17/076,899 dated Jan. 29, 2021.
T. Kanade, ed., Three-Dimensional Machine Vision, Kluwer Academic Publishers (1987) [Part 1].
T. Kanade, ed., Three-Dimensional Machine Vision, Kluwer Academic Publishers (1987) [Part 2].
D.D. Davis et al., “Tie Condition Inspection a Case Study of Tie Failure Rate, Mods, and Clustering,” Report No. R-714, Association of American Railroads Research and Test Department (Jul. 1989).
John Choros et al., “Prevention of Derailments due to Concrete Tie Rail Seat Deterioration,” Proceedings of ASME/IEEE Joint Rail Conference & Internal Combustion Engine Spring Technical Conference. No. 40096 (2007).
“Laser Triangulation for Track Change and Defect Detection”, U.S. Department of Transportation, Federal Railroad Administration (Mar. 2020).
“Extended Field Trials of LRAIL for Automated Track Change Detection”, U.S. Department of Transportation, Federal Railroad Administration (Apr. 2020).
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/725,490 dated Feb. 23, 2018.
Shawn Landers et al., “Development and Calibration of a Pavement Surface Performance Measure and Prediction Models for the British Columbia Pavement Management System” (2002).
Zheng Wu, “Hybrid Multi-Objective Optimization Models for Managing Pavement Assetts” (Jan. 25, 2008).
“Pavement Condition Index 101”, OGRA's Milestones (Dec. 2009).
“Rail Radar Bringing the Track Into the Office” presentation given to CN Rail Engineering on Jan. 21, 2011.
Rail Radar, Inc. Industrial Research Assistance Program Application (IRAP) (Aug. 10, 2012).
“Rail Radar Automated Track Assessment” paper distributed at the Association of American Railways (AAR) Transportation Test Center in Oct. 2010 by Rail Radar, Inc.
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/725,490 dated Mar. 30, 2017.
US Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/725,490 dated Aug. 16, 2017.
Kantor, et al., “Automatic Railway Classification Using Surface and Subsurface Measurements” Proceedings of the 3rd International Conference on Field and Service Robitics, pp. 43-48 (2001).
Magnes, Daniel L., “Non-Contact Technology for Track Speed Rail Measurements (ORIAN)” SPIE vol. 2458, pp. 45-51 (1995).
Ryabichenko, et al. “CCD Photonic System For Rail Width Measurement” SPIE vol. 3901, pp. 37-44 (1999).
Gingras, Dennis, “Optics and Photonics Used in Road Transportation” (1998).
Liviu Bursanescu and Francois Blais, “Automated Pavement Distress Data Collection and Analysis: a 3-D Approach” (1997).
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/724,925 dated Feb. 26, 2016.
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/724,890 dated Jul. 29, 2016.
US Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/724,890 dated Nov. 10, 2016.
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/724,890 dated Mar. 24, 2017.
Korean Intellectual Property Office, International Search Report for Int. App. No. PCT/IB2018/058574 dated Feb. 27, 2019.
Korean Intellectual Property Office, Written Opinion of the International Searching Authority for Int. App. No. PCT/IB2018/058574 dated Feb. 27, 2019.
US Patent and Trademark Office, Final Office Action for U.S. Appl. No. 16/255,928 dated Apr. 27, 2020.
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/742,057 dated May 26, 2020.
Invitation to Pay Additional Fees, PCT App. Ser. No. PCT/US2020/033449 dated Jul. 9, 2020.
International Report on Patentability, PCT App. Ser. No. PCT/IB2018/058574 dated Aug. 6, 2020.
International Reporton Patentability, PCT App. Ser. No. PCT/US2020/033374 dated Aug. 14, 2020.
Espino et al., “Rail and Turnout Detection Using Gradient Information and Template Matching”, 2013 IEEE Interntiojnal Conference on Intelligent Rail Transportation Proceedings (2013).
U.S. Patent and Tademark Office, Non-Final Office Action for U.S. Appl. No. 17/243,746 dated Aug. 27, 2021.
Paul et al., “A Technical Evaluation of Lidar-Based Measurement of River Water Levels”, Water Resources Research (Apr. 4, 2020).
Ahn et al., “Estimating Water Reflectance at Near-Infrared Wavelengths for Turbid Water Atmospheric Correction: A Preliminary Study for GOCI-II”, Remote Sensing (Nov. 18, 2020).
Hart et al., “Automated Railcar and Track Inspection Projects: A Review of Collaborations Between CVRL and RailTEC”, presentation by Computer Vision and Robotics Laboratory and Railroad Engineering Program (RailTEC) University of Illinois at Urbana-Champaign (2017).
International Search Report and Written Opinion of the International Searching Authority, PCT App. Ser. No. PCT/US2020/033449 dated Sep. 14, 2020 (including Kovalev et al. “Freight car models and their computer-aided dynamic analysis”, Multibody System Dynamics, Nov. 2009).
Julio Molleda et al., “A Profile Measurement System for Rail Manufacturing using Multiple Laser Range Finders” (2015).
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/802,763 dated Jun. 29, 2021.
Yang et al., “Automated Extraction of 3-D Railway Tracks from Mobile Laser Scanning Point Clouds”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 7, No. 12, Dec. 2014.
Li et al., “Rail Component Detection, Optimization, and Assessment for Automatic Rail Track Inspection”, IEEE Transactions of Intelligent Transportation Systems, vol. 15, No. 2, Apr. 2014.
International Preliminary Report on Patentability, PCT Application No. PCT/US2020/033449, completed May 24, 2021 and dated Aug. 12, 2021.
US Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/127,956 dated Dec. 31, 2018.
D.D. Davis et al., “Tie Performance—A Progress Report of the Des Plaines Test Site,” Report No. R-746, Association of American Railroads Research and Test Department (Apr. 1990).
Mattias Johanneson, “Architectures for Sheet-of-Light Range Imaging,” Report No. LiTH-ISY-I-1335, Image Processing Group, Department of Eleclrical Engineering, Linköping University (Feb. 27, 1992).
U.S. Appl. No. 60/584,769, “System & Method For Inspecting Railroad Track” by John Nagle & Steven C. Orrell.
Mattias Johannesson, “Sheet-of-light Range Imaging,” Linköping Studies in Science and Technology. Dissertations No. 399 (1995).
M. Johannesson, SIMD Architectures for Range and Radar Imaging, PhD thesis, University of Linköping (1995).
Erik Åstrand, “Automatic Inspection of Sawn Wood,” Linköping Studies in Science and Technology. Dissertations. No. 424 (1996).
Mattias Johannesson, “Sheet-of-Light range imaging experiments with MAPP2200,” Report No. LiTH-ISY-I-1401, Image Processing Group, Department of Electrical Engineering, Linköping University (Sep. 28, 1992).
M. de Bakker et al., “A Smart Range Image Sensor,” Proceedings of the 24th European Solid-State Circuits Conference (1998):208-11;xii+514.
Dr. Mats Gokstorp et al., “Smart Vision Sensors,” International Conference on Image Processing (Oct. 4-7, 1998), Institute of Electrical and Electronics Engineers, Inc.
Mattias Johanneson, et al., “An Image Sensor for Sheet-of-Light Range Imaging,” IAPR Workshop on Machine Vision Applications (Dec. 7-9, 1992).
Mattias Johannesson, “Can Sorting using sheet-of-light range imaging and MAPP2200,” Institute of Electrical and Electronics Engineers; International Conference on Systems, Man and Cybernetics (Oct. 17-20, 1993).
Michiel de Bakker, et al., “Smart PSD array for sheet-of-light range imaging,” The International Society for Optical Engineering. Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications (Jan. 24-26, 2000).
Umayal Chidambaram, “Edge Extraction of Color and Range Images,” (Dec. 2003).
Franz Pernkopf et al., “Detection of surface defects on raw milled steel blocks using range imaging” The International Society for Optical Engineering. Machine Vision Applications in Industrial Inspection X (Jan. 21-22, 2002).
Murhed, Anders, “IVP Integrated Vision Products,” Pulp and Paper International 44.12 (Dec. 1, 2002).
Anders Åstrand, “Smart Image Sensors,” Linköping Studies in Science and Technology Dissertations No. 319 (1993).
Mattias Johannesson et al., “Five Contributions to the Art of Sheet-of-light Range Imaging on MAPP2200,” Report No. LiTH-ISY-R-1611, Image Processing Group, Department of Electrical Engineering, Linköping University (Apr. 14, 1994).
Federal Register, vol. 73 (70695-70696).
Newman et al., “A Survey of Automated Visual Inspection,” Computer Vision an Image Understanding vol. 61, No. 2, March, pp. 231-262, 1995.
J. Velten et al., “Application of a Brightness-Adapted Edge Detector for Real-Time Railroad Tie Detection in Video Images,” Institute of Electrical and Electronics Engineers (1999).
R. Gordon Kennedy, “Problems of Cartographic Design in Geographic Information Systems for Transportation,” Cartographic Perspectives (Jul. 20, 1999).
Richard Reiff, “An Evaluation of Remediation Techniques for Concrete Tie Rail Seat Abrasion in the Fast Environment,” American Railway Engineering Association, Bulletin 753 (1995).
Russell H. Lutch et al., “Causes and Preventative Methods for Rail Seat Abrasion in North America's Railroads,” Conference Paper (Oct. 2014).
Nigel Peters and Steven R. Mattson, “CN 60E Concrete Tie Development,” AREMA: 25 (2003).
Federal Register, vol. 76, No. 175, pp. 55819-55825.
National Transportation Safety Board, “Railroad Accident Brief” (NTSB/RAB—Jun. 2003).
Arthur L. Clouse et al. “Track Inspection Into the 21st Century” (Sep. 19, 2006).
Federal Register, vol. 76, No. 63, pp. 18001-18346 (18073).
Railroad Safety Advisory Committee (RSAC), Minutes of Meeting, Dec. 10, 2008, Washington, D.C.
Dennis P. Curtin, “An Extension to The Textbook of Digital Photography, Pixels and Images” (2007).
Holland L.P.'s Combined Motion for Early Markman Claim Construction and Summary Judgment of Non-Infringement in Georgetown Rail Equipment Company v. Holland L.P., (E.D. Tex.) (Tyler) (6:13-cv-366).
Georgetown Rail Equipment Company's Response to Holland L.P.'s Combined Motion for Early Markman Claim Construction and Summary Judgment of Non-Infringement in Georgetown Rail Equipment Company v. Holland L.P., (E.D. Tex.) (Tyler) (6:13-cv-366).
Georgetown Rail Equipment Company's P.R. 4-5(a) Opening Markman Claim Construction Brief in Georgetown Rail Equipment Company v. Holland L.P., (E.D. Tex) (Tyler) (6:13-cv-366).
Holland L.P.'s Responsive Markman Claim Construction Brief Under P R. 4-5 in Georgetown Rail Equipment Company v. Holland L.P., (E.D. Tex.) (Tyler) (6:13-cv-366).
Claim Construction Memorandum Opinion and Order in Georgetown Rail Equipment Company v. Holland L.P., (E.D. Tex.) (Tyler) (6:13-cv-366).
Public Judgment and Reasons in Georgetown Rail Equipment Company v. Rail Radar Inc. and Tetra Tech EBA Inc. (T-896-15) (2018 FC 70).
Pavemetrics' Compulsory Counterclaim for Declaratory Judgment, Pavemetrics Systems, Inc. v. Tetra Tech, Inc. (case 2:21-cv-1289) (Mar. 24, 2021).
Handbook of Computer Vision and Applications, vol. 2, Academic Press, “Signal Processing and Pattern Recognition” (1999).
International Advances in Nondestructive Testing, vol. 16, Gordon and Breach Science Publishers, S.A. (1991).
Babenko, Pavel, dissertation entitled “Visual Inspection of Railroad Tracks”, University of Central Florida (2009).
Shah, Mubarak, “Automated Visual Inspection/Detection of Railroad Track”, Florida Department of Transportation (Jul. 2010).
Metari et al., “Automatic Track Inspection Using 3D Laser Profilers to Improve Rail Transit Asset Condition Assessment and State of Good Repair—A Preliminary Study”, TRB 93rd Annual Meeting (Nov. 15, 2013).
Laurent, John et al., “Implementation and Validation of a New 3D Automated Pavement Cracking Measurement Equipment” (2010).
Final Written Judgment, U.S. Patentent Trial and Appeal Board, Inter Partes Review, Tetra Tech Canada, Inc. v. Georgetown Rail Equipment Company, (2020).
Tetra Tech, Inc. Annual Report excerpts (2020).
Federal Railroad AdminisliaLion Track Safety Standards Fact Sheet.
Declaration of David Drakes, Pavemetrics Systems, Inc. v. Tetra Tech, Inc. (case 2:21-cv-1289) (Mar. 22, 2021).
Declaration of John Laurent, Pavemetrics Systems, Inc. v. Tetra Tech, Inc. (case 2:21-cv-1289) (Mar. 22, 2021).
“An Automated System for Rail Transit Infrastructure Inspection”, 1st Quarterly Report, USDOT and University of Massachusetts Lowell (Sep. 30, 2012).
IRI Measurements Using the LCMS presentation, Pavemetrics (2012).
High-speed 3D imaging of rail YouTube URL link and associated image.
LCMS for High-speed Rail Inspection video URL link and image.
“An Automated System for Rail Transit Infrastructure Inspection”, 2d Quarterly Report, USDOT and University of Massachusetts Lowell (Jan. 15, 2013).
RITARS 3rd Quarterly Meeting Minutes, “An Automated System for Rail Transit Infrastructure Inspection” (May 14, 2013).
“An Automated System for Rail Transit Infrastructure Inspection”, 5th Quarterly Report, USDOT and University of Massachusetts Lowell (Oct. 15, 2013).
25th Annual Road Profile User's Group Meeting agenda, San Antonio, Texas (Sep. 16, 2013).
“LCMS—Laser Crack Measurement System” presentation, PAVEMETRICS Systems Inc. (Sep. 2013).
Metari, et al., “An Automatic Track Inspection Using 3D Laser Profilers to Improve Rail Transit Asset Condition Assessment and State of Good Repair: A Preliminary Study” presentation, Transportation Research Board 93rd Annual Meeting (given Jan. 14, 2014).
Lorent, et al., “Detection of Range-Based Rail Gage and Missing Rail Fasteners: Use of High-Resolution Two- and Three-dimensional Images” (Jan. 2014).
“3D Mapping of Pavements: Geometry and DTM” presentation, PAVEMETRICS Systems Inc. (Sep. 2014).
“Laser Rail Inspection System (LRAIL)” datasheet, PAVEMETRICS Systems Inc. (Oct. 2014).
PAVEMETRICS Systems Inc. webpage screenshot (Dec. 18, 2014).
PAVEMETRICS Systems Inc. LRAIL webpage (Feb. 20, 2015).
Pavemetrics' Memorandum in Opposition to motion for Preliminary Injunction, Pavemetrics Systems, Inc. v. Tetra Tech, Inc. (case 2:21-cv-1289) (Mar. 22, 2021).
MVTec Software GmbH, HALCON Solution Guide I: Basics, available at http://download.mvtec.com/halcon-10.0-solution-guide-i.pdf (2013)(“HALCON Solution Guide”).
National Instruments, NI Vision for LabVIEW User Manual, available at https://www.ni.com/pdf/manuals/371007b.pdf (2005) (“LabVIEW 2005 Manual”).
Wenbin Ouyang & Bugao Xu, Pavement Cracking Measurements Using 3D Laser-Scan Images, 24 Measurement Sci. & Tech. 105204 (2013) (“Ouyang”).
Chris Solomon & Toby Breckon, Fundamentals of Digital Image.
Processing: A Practical Approach With Examples in Matlab (2011)(“Solomon”).
Ça{hacek over (g)}lar Aytekin et al., Railway Fastener Inspection by Real-Time Machine Vision, 45 IEEE Transactions on Sys., Man, and Cybernetics: Sys. 1101 (Jan. 2015) (“Aytekin”).
Jinfeng Yang et al., An Efficient Direction Field-Based Method for the Detection of Fasteners on High-Speed Railways, 11 Sensors 7364 (2011) (“Yang”).
Urszula Marmol & Slawomir Mikrut, Attempts at Automatic Detection of Railway Head Edges from Images and Laser Data, 17 Image Processing & Commc'n 151 (2012) (“Marmol”).
Xaxier Gibert-Serra et al., A Machine Vision System for Automated Joint Bar Inspection from a Moving Rail Vehicle, Droc. 2007 Asme/IEEE Joint Rail Conf. & Internal Combustion Engine Spring Tech. Conf. 289 (2007) (“Gibert-Serra”).
SICK Sensor Intelligence, Product Catalog 2014/2015: Vision, available at https://www.sick.com/media/docs/2/02/302/Product_catalog_Vision_en_IM005 0302.PDF (2013) (“SICK Catalog”).
SICK Sensor Intelligence, Application: 3D Vision for Cost-Efficient Maintenance of Rail Networks, TETRATECH_0062963-64 (Jan. 2015) (“SICK Article”).
Matrox Electronic Systems, Ltd., Matrox Imaging Library version 9 User Guide, available at https://www.matrox.com/apps/imaging_documentation_files/mil_userguide.pdf (2008) (“Matrox MIL 9 User Guide”).
MVTec Software GmbH, HALCON: the Power of Machine Vision, available at https://pyramidimaging.com/specs/MVTec/Halcon%2011.pdf (2013)(“HALCON Overview”).
Tordivel AS, Scorpion Vision Software: Version X Product Data, available at http://www.tordivel.no/scorpion/pdf/Scorpion%20X/PD-2011-0005%20Scorpion%20X%20Product%20Data.pdf (2010) (“Scorpion Overview”).
OpenCV 3.0.0.-dev documentation, available at https://docs.opencv.org/3.0-beta/index.html (2014) (“OpenCV”).
Mathworks Help Center, Documentation: edge, available https://www.mathworks.com/help/images/ref/edge.html (2011) (“Matlab”).
National Instruments, NI Vision for LabVIEW Help, available https://www.ni.com/pdf/manuals/370281w.zip (2014) (“LabVIEW”).
Intel Integrated Performance Primitives for Intel Architecture, Reference Manual, vol. 2: Image and Video Processing, available at http://www.nacad.ufrj.br/online/intel/Documentation/en_US/ipp/ippiman.pdf (Mar. 2009).
Andrew Shropshire Boddiford, Improving the Safety and Efficiency of Rail Yard Operations Using Robotics, UT Elec. Theses and Dissertations, available at http://hdl.handle.net/2152/2911 (2013).
Leszek Jarzebowicz & Slawomir Judek, 3D Machine Vision System for Inspection of Contact Strips in Railway Vehicle Durrent Collectors, 2014 Int'l Conf. on Applied Elecs. 139 (2014).
Peng Li, A Vehicle-Based Laser System for Generating High-Resolution Digital Elevation Models, K-State Elec. Theses, Dissertations, and Reports, available at http://hdl.handle.net/2097/3890 (2010).
Pavemetrics' Preliminary Invalidity Contentions in Case No. 2:21-cv-1289, dated Jul. 15, 2021.
Exhibits 2-9 to Pavemetrics' Preliminary Invalidity Contentions in Case No. 2:21-cv-1289, dated Jul. 15, 2021.
Pavemetrics' Invalidity Contentions and Preliminary Identification in Case No. 2:21-cv-1289, dated Sep. 13, 2021.
Exhibit 2 to ,Pavemetrics' Invalidity Contentions and Preliminary Identification in Case No. 2:21-cv-1289, dated Sep. 13, 2021.
Exhibit 3 to ,Pavemetrics' Invalidity Contentions and Preliminary Identification in Case No. 2:21-cv-1289, dated Sep. 13, 2021.
U.S. Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/889,016 dated Sep. 23, 2021.
U.S. Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 16/898,544 dated Sep. 24, 2021.
International Preliminary Report on Patentability, PCT App. No. PCT/US2020/033374 dated Nov. 16, 2021.
Related Publications (1)
Number Date Country
20200346673 A1 Nov 2020 US
Provisional Applications (4)
Number Date Country
63016661 Apr 2020 US
62988630 Mar 2020 US
62848630 May 2019 US
62679467 Jun 2018 US
Continuation in Parts (2)
Number Date Country
Parent 16255928 Jan 2019 US
Child 16877106 US
Parent 16127956 Sep 2018 US
Child 16255928 US