Not Applicable
Not Applicable
Not Applicable
Pyrophilous jewel beetles, Melanophila acuminata, are attracted to forest fires from distances of more than 60 km. Their bodies are equipped with infrared (IR) receptors. Scientists estimate that in the great Coalinga fire of 1924 the beetles were attracted from a distance of 130 km (80 miles.) At that distance IR light should be attenuated to the point of getting lost in stochastic sensor noise, assuming the sensitivity of existing IR sensing technology.
The beetle IR receptors, however, do not detect light. Sometimes mistaken for complex eyes, each group is composed of about 70 dome-shaped sensilla, and each group is on a leg facing a direction different from other groups on other legs. Each sensillum is a cuticular lens-like sphere, with a 12-15 μm diameter, covered by a thin membrane of about 1 μm. Each sphere is innervated by one bipolar neuron. The receptors are thermal detectors, in which slight warming causes membrane deformation of 1-10 nm, which elicits a nerve response (Vondran, et al., 1995, 1.) Membrane deformation, not light perception, triggers response.
M. acuminata's sensilla contain Zinc phosphide proteins sensitive to IR. This inspired U.S. patent application Ser. No. 14/272,801 of Israelowitz et al. (P1) to use them as a model for synthetic proteins for an infrared microchip. Their goal was to create multiple electrode gaps on a chip with these proteins. Because Zinc phosphide absorbs most of the infrared spectrum, the authors posit their proteins will be highly sensitive to many emission sources, ideal for infrared cameras. The '801 application teaches “single needles of Zinc phosphide crystals” grown as nanowires and placed in a “preformed electrode gap” to form semiconductors.
There is a need to utilize M. acuminata's strategy of heat detection for forest fire detection. The key component is not the identity of a particular protein, but the evolutionary strategy of a multi-directional IR detector. Current wildland IR fire detection, whether earth, atmospheric, or space-based, use IR cameras. Contemporary IR cameras configure thermoresistors across a two dimensional surface (sometimes called a focal plane array.) Each resistor is precisely positioned so that the ensemble generates a 2D image. For example, U.S. Pat. No. 12,069,387 to Sano & Ye (P2) teaches that its focus is not in a narrow direction, but a scenic one. Their components, manufacturing, and operation are expensive. They consume a lot of energy. The intention of an IR camera is to generate a picture of the incoming intensity of a range of frequencies. IR sensors based on indium gallium arsenides (InGaAs) provide good responsivity from about 900 nm to 1700 nm. Because of this range, they are used in IR cameras. InGaA is expensive, low-resolution, and requires low temperatures to function. They require a cooling system, such as a Peltier cooler, which increases electricity consumption.
The cost, operational complexity, and energy requirements of IR cameras limits their deployment in wildland fire detection purposes. University of California San Diego developed AlertCalifornia with Cal Fire, training a program to detect smoke and other early indications of fire on a feed from a network of more than 1,050 cameras placed in forests across the state. The system faces a bottleneck, however. Images with adequate rendition require high-cost IR cameras with detection capacity of about one mile. 1,050 cameras can cover around 0.05% of California's forests. Delicate IR camera operations are not suited to wildland climate conditions, which have wide temperature fluctuations, precipitation, wind, and biotic forces. Isolated, expensive equipment is vulnerable to theft. The resale market for IR cameras is large and unregulated (Govil, et al., 2020, 2.)
IR cameras are not particularly sensitive to the particular IR wavelengths that fires produce. Their scenic view reduces the sensitivity in a specific direction. IR cameras array thermocouples in parallel, each information quota separately displayed. Besides their costs and special operating procedures, IR cameras require transmission of their entire detection to management facilities, usually via satellite. As cameras are limited to line-of-sight detection, only a fraction of forested, fire-prone areas can be monitored.
Affordable fire detection systems have only been invented for residential or commercial buildings and their environments, as described in U.S. patent application Ser. No. 15/905,377 of Toland (P3). There is a need to detect wildfires before they spread, using a low cost, robust, resilient, IR detector source.
This invention uses thermopiles, and thermoelectric sensors generally, as energy detecting sensors. A thermopile is an instrument consisting of 10 to 103 thermocouples assembled in series, not on a planar focal array. The thermocouples are bundled on the same small surface, serially connected to increase signal to noise ratios. Thermocouples use two materials in a junction pair. Each material responds differently to heat. One, called the reference, is kept at a known temperature, the other, called the active, varies in response to heat. The measured difference (in voltage) detects incident radiation. As described in U.S. Pat. No. 5,288,147 to Schaefer & Danley (P4) connecting junction pairs in series increases their responsivity by the number of pairs; if each thermocouple produces 2 volts, a thermopile with 100 thermocouples produces 200 volts. Themopiles distribute incident thermal energies efficiently to each thermocouple. They are particularly sensitive to IR radiation, but their measurement is usually limited to a narrow range within it. This is not suitable for image-making, but is optimal for detecting specific radiation sources, such as fires, which radiate a narrow spectral range (Bordbar, et al. 2022, 3.) The thermopiles used in this invention amplify the specific wavelengths that fires emit.
The thermocouples arrayed in series in a thermopile are summed as a “stack”. Compared to an IR camera, it's as if all the thermocouples are pointing at the same landscape point, at the same pixel of planar data. The root mean square error of stacked sensors is reduced by about the square root of the number of thermocouples in the thermopile, compared to a single resistor on a planar image plane. For a 200 resistor thermopile, RMS is reduced by about 14 times compared to the single resistor; for an 800 resistor stack, RMS is reduced 28 times, compared to a resistor in a parallel camera array. Thermopiles are able to detect signals attenuated 102 more than the lowest threshold of IR cameras.
Thermopiles have not been deployed in outdoor IR fire detection. They are generally dismissed for outdoor purposes because if the difference between reference and active temperatures exceeds tens of degrees, junctions can fail. But detection of distant wildland fire does not increase the active junction by anywhere near this amount. There are two other problems with thermopiles. 1) The response time of thermopiles is considered slow, compared to other thermometer systems. It may take 10 milliseconds or longer for a thermopile to register an IR signal. While important in emergency or industrial operations, such a lag is irrelevant for wildland fire detection. 2) Because humans and animals emit IR, devices can easily be affected by their presence. However biological IR sources are limited in radiation extent; mounting thermopiles well above ground, with attributes that discourage bird landing, prevents animals and people from interfering with thermopile response.
This invention is a fire detector, not a camera. Humans understand visual information quickly, which IR cameras provide. IR cameras produce precise pictures, but attenuation loss limits these to about one mile line of sight distances. Thermopiles do not provide a precisely targeted source of IR radiation at distances greater than three miles, but can detect the general orientation of the signal an order of magnitude more distant. The logic of jewel beetles used in this invention compares IR detectors oriented in different three-dimensional directions to estimate a fire's location. There are a number of statistical methods to reduce noise and isolate a signal in the output of multiple sensors in the same orientation direction. There is a need to apply statistical methods to analyze energy detected from sensors facing different directions.
Further, although not a subject of published scientific research, the inventor's personal research suggests it is likely that some IR transmittance through leaves occurs. Satellites do not detect this, yet this may be because most temperate trees have planar, horizontal leaf orientations. IR obliquely reflects off these, whereas visible light deflects, up, down, or backscatters. Fire sources emit mid-infrared light (MIR) rather than near-infrared light (NIR.) When a leaf presents to a light wave at an oblique angle, more of the surface is intersected. Surface roughness increases. Visible & NIR wavelengths deflect more than MIR, because wavelengths larger than roughness features do not deflect.
Light transmittance studies measure visible light. Models showed limited transmittance through dense tree stands, especially structurally heterogeneous stands. However MIR may transmit through stands of trees with horizontal (planophile) or plagiophile (oblique) leaf angles. The leaf angles of 58 common deciduous tree species over several seasons were measured, at multiple heights. 30 had planophile leaves, 13 had plagiophile. Only 5 were close to spherical, with as many vertically as horizontal Reflectance off relatively planar leaf distributions increases more or less linearly with wavelength (Pisek, et al., 2013, 4.) Tabulating average planophile leaf angle found in the literature, transmittance more than doubles for MIR compared to visible and NIR. Leaf canopies may serve as conduits for long wavelengths, extending the range of the invention.
In the following, the invention is referred to as a Multilevel Fire Detector (MFD), or MFD system. Thermopiles and thermopile variants such as thermopile bolometers or pyrodetectors are referred to as “thermoelectric sensors” “sensors” or “thermopile sensors”, and thermocouples are referred to as “thermocouples” or “resistors”. The phrases “interacts” or “interactions” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term “controller” means any device, system or part thereof that controls at least one operation, such a device may be implemented in hardware, firmware or software, or some combination of at least two of the same. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely, including off-site through a communication system. The term “communication system” refers to a wired, wireless, optical, or other communication link that transports transitory electrical or other signals. Descriptive and directional terms such as “common spatial orientation” or “spatial orientation” or “orientation” or “facial direction” or “direction” as well as derivatives thereof, refer to a physical direction faced by vessel sides or sensors relative to a three dimensional surface of the earth. The terms “fire signals” or “signals” or “IR energy pattern data stream” or “wavelengths” or “data” or “data stream” or “radiation” or “energy” or “energies” or “IR energies” as used herein refer to any data that contains information or noise whether in electromagnetic, physical, numeric, alphanumeric, or other form that may be transmitted through space. In particular, an “IR energy pattern data stream” refers to a recurring structure, trend, or behavior in an IR data stream over time, or a familiar pattern of multiple IR data streams at the same time.
The term “typical data”, “typical IR energy pattern data” and “stored data” refer to data generated by a record of IR energy pattern data in a specific direction, correlated with time of day, year, weather, etc., as well as selected data which may be provided by sources such as weather stations and weather prediction models, the selected data transformed using statistical features to predict IR energy pattern data. Satellite IR data is commonly transformed to predict weather; for example, specific IR wavelengths correlate with raindrops, with the phase state of water condensate, with atmospheric and land temperature; these data provide a database of IR energies that predict different weather, which may be used in the generation of typical data. A sensor fusion controller collects data outputs from resistors and sensors, and a processor algorithm fuses the data outputs, which may include typical data, to generate an initial estimation of the probability of a fire risk or heat surge.
In an embodiment, an MFD system detects a fire risk or heat surge by measuring a plurality of IR energies incident upon a first plurality of sensors that are pointed in at least a first common spatial orientation, and a second plurality of sensors that are pointed in at least a second common spatial orientation. The sensor fusion controller compares a pattern of IR energies measured by the sensors pointed in the first common spatial orientation with a pattern of IR energies of the sensors pointed in the second common spatial orientation. The sensor fusion controller calculates if a difference in measured IR energy patterns is determinative of a fire risk or heat surge. The MFD system transmits information through a communication system to parties concerned with fire risk or heat surge, such as a management center.
In an embodiment, an MFD system is a vessel, with at least a first side facing a first common spatial orientation, with multiple IR sensors disposed on each side pointing in a generally facial direction of that side, with a direction measurement system such as a magnetic compass, GPS compass, an inclinometer, a gyroscope or multiple gyroscopes, the direction measurement system providing a measurement of compass azimuth and altitude that ensures the direction faced by each side of the vessel is updated in an orientation data, the multiple sensors disposed on each side each producing an IR energy pattern data stream associated with the orientation data and transmitted to a controller, the controller stores typical IR energy pattern data associated with the orientation data, the controller includes a sensor fusion algorithm that processes the IR energy pattern data streams, the orientation data, and the typical IR energy pattern data, and determines if there is a detection of a fire risk or heat surge.
In an embodiment, an MFD system compares a pattern of IR energy pattern data detected by IR sensors pointing in specific directions, with a pattern of typical IR energy pattern data oriented in those specific directions stored in a controller, to detect a fire risk. Patterns of typical IR energy pattern data are generated by a record of IR energy pattern data in a direction, as well as time of day, time of year, solar and luna cycles, weather, climate, cloud cover, atmospheric conditions, and the like. In an embodiment, the typical IR energy pattern data is updated with the IR energy pattern data detected by IR sensors.
In an embodiment, an MFD system may use spectral analysis, particularly in the sensor fusion controller, especially to confirm a detected fire. This is much more cost-effective and energy-efficient than applying spectral analysis to every data stream from an IR camera or sensor.
In an embodiment an MFD system is a 360 degree sensory system that detects wavelength patterns, regardless of illumination. A 3D array of sensors, with thousands of resistors recording redundant, overlapping signals, can detect fire signals from a radius of >10 miles. The cost of such an array is 1/10th of a camera; it is a robust system resilient to movement or precipitation.
In an embodiment, the sides of the vessel to which sensors are attached are configured to be directionally oriented at an angle of between 5° and 120° relative to each other. The angle at which a side is configured with respect to the other sides is chosen to allow detection of energy signals, and thus can be adapted to a particular wildland location, depending on the landscape, slope, vegetation, or other factors. The directional orientation of each side is continuously or periodically measured by onboard or distant orientation sensors. In this way, it is ensured that the direction of a reported energy signal is accurate. Because of low cost and onboard power, multiple MFD systems can be deployed to triangulate, validate, verify, and query reported energy signals.
In an embodiment, a predetermined “fire fingerprint algorithm” is applied to sensor data. Fire sources emit a unique radiation spectra in the MIR range, broadband but not random, which are used to generate an intelligent detection algorithm. A “fire fingerprint” of a small fire is determined, known to be much stronger for fires than other hot emitters. In an embodiment the MFD system retains the aggregated data from the resistors and sensors on each one of the multiple sides of a vessel as separate, distinct aggregated data. Noise cancellation techniques are applied to increase signal to noise ratios. Detected emission intensities from each of the aggregated sensor data streams are compared to the “fire fingerprint,” and a fire may be detected.
In an embodiment at least one frequency filter is applied to the individual or aggregated resistor or sensor data. The at least one frequency filter detects and isolates at least one radiation spectrum range known to be associated with the radiation that fires emits.
An embodiment with multiple sides facing different directions produces IR energy pattern data as a single panoramic window stitched together, with dimensional reduction methods such as autoencoders to distinguish noise and increase a signal to noise ration. A further embodiment uses a reference dataset to isolate a signal, and continuously or periodically updates the reference dataset with the IR energy pattern data.
Given the infrared radiation of fire is a specific spectrum, an embodiment uses log periodic antennas, sized to be applicable for the expected wavelengths, to maximize energy incident on an infrared sensor. A log-periodic antenna is a broadband antenna with a series of dipoles whose length and separation decrease toward the emission direction. The design of a log-periodic antenna is fundamentally known, as described in U.S. Pat. No. 9,007,271 to Harscher et al. (P5). Another embodiment uses a transparent material that doesn't absorb in the infrared wavelength range as a lens to concentrate IR light on a sensor. Such materials include Yttrium Oxides and Yttrium Aluminum Garnet.
An embodiment uses polished flanges to reflect electromagnetic energy towards the aggregated sensors. An embodiment uses a polished cone surrounding the area approaching each plurality of sensors, thereby collecting electromagnetic radiation that funnels into the plurality of sensors.
The invention also includes methods of mounting the MFD system vessel to an infrastructure by providing a support system according to any of the embodiments of the invention.
According to the invention, the MFD system may be mounted to a tower or pole on which electrical transmission lines are linked, the MFD system preferably positioned near the top of the tower or pole, thereby increasing panoramic detection of IR radiation, and reducing the impact of animals. There is a great need to monitor the environment around such transmission lines for incipient fire events, which the MFD system can provide.
According to the invention, the MFD system may comprise a number of sections, to facilitate its mounting to the tower or pole.
In an embodiment the MFD system obtains operating power with an energy harvester that is proximal to an electrical transmission lines on the tower or pole. This may be a stable resource for the MFD system to operate without interruption. Such energy harvesters are known in the art (Riba, et al. 2022, 5.) In a further embodiment the MFD system interacts with telephone lines that may be linked on the pole or tower. This may be a stable method for the MFD system to report signal detections.
In an embodiment the MFD system may be mounted on the tower or pole on a platform with electrically insulated supports. To prevent an electrical field from the tower or pole from entering the detection system, a plate may be secured under the MFD system, the plate extending away from the tower or pole on a boom or arm.
In the embodiment where the MFD system is composed of the plurality of sections, a first section may be the vessel that supports individual sensors and a second section may contain information processing hardware. In an embodiment the MFD system is operated by batteries disposed in a container. Thermoelectric sensors are energy efficient, operating off a small solar panel or infrequently replaced batteries. In an embodiment the MFD system is operated by a regenerative power system. This may include solar power, wind power, or triboelectrical power.
High voltage transmission lines may transmit electricity between locations at voltages above 50 to 765 kV. Transmission lines, when damaged or when their supporting structures fail, have been implicated in wildland fire generation. To avoid hazardous energized conductors, and prevent their voltage from influencing IR sensing, an embodiment mounts the MFD system on a boom or arm that extends to the side of a tower or pole. The boom or arm may be insulated, and have a plate to prevent untoward energy from influencing sensors.
In an embodiment the MFD system is mounted on its own pole or tower, with its own power source and communication system, such as an antenna.
In an embodiment the MFD system is mounted in a tall tree. In an embodiment the MFD system is attached to a pole attached to a tall tree. The pole is attached to a trunk, either at or above ground level. A goal may be to have the system 50 or 100 feet above the tallest trees in a forested area. Either the pole is that much longer than tree height, or it is attached above ground sufficiently to elevate the system that much.
In an embodiment more than one controller is used in the MFD system, as a first plurality of thermoelectic sensors is deployed in a first module, the first module oriented in a first direction, and at least one second plurality of thermoelectric sensors is deployed in at least one second module, the at least one second module oriented in at least one second direction, the first plurality of thermoelectric sensors configured to receive a first energy that contains that contains a first signal and a first noise, and the at least one second plurality of thermoelectric sensors is configured to receive at least one second energy that contains at least one second signal and at least one second noise, and a first controller is configured to receive the first signal and the first noise and uncorrelates the first signal as a first data output, and at least one second controller is configured to receive the at least one second signal and the at least one second noise and uncorrelates the at least one second signal as at least one second data output, and the first data output and the at least one second data output are received by at least one second controller that includes a sensor fusion algorithm that compares the first data output and the at least one second data output, and may also compare the first data output with a first typical data for the first direction, and may also compare the at least one second data output with an at least one second typical data for the at least one second direction, and may also compare the results of the comparison of the first data output and the at least one second data output with a comparison of the first typical data and the at least one second typical data.
There are a number of statistical methods to reduce noise and isolate a signal in the output of multiple thermocouples or multiple thermopiles that have the same orientation direction. Multiple data inputs can be represented as a grid with reductions to a mean. An idealized error grid, such as from a reference, may reveal mean errors due to insufficient averaging. Further transformation can apply a high-pass filter and a directional filter to the data. This enhances wavelength features considered to be mean errors; these may help isolate longer-wavelength IR signals. In an embodiment the controller regroups thermoelectric sensor IR energy pattern data in different groups, to calculate different transformations and comparisons that isolate signals of fire risk and heat surges.
Like the AlertCalifornia system, the MFD system's data can be communicated to a model trained to detect fire, that is housed in a management center. The MFD system is configured to increase signal/noise ratios and preprocess signals; it is not necessary that the system emit a continuous data stream to the management center. Only a threshold-exceeding signal, redundantly measured, may warrant communicating a warning signal.
Some embodiments of the present invention are illustrated as an example and are not limited by the figures of the accompanying drawings, in which like references may indicate similar elements and in which:
This invention is directed to a method and device for an MFD system with a vessel in which are positioned a plurality of thermoelectric sensors oriented in specific directions that provide data to sensor fusion algorithms that detect signals of fire risk and heat surges. Referring to
In
In
In
In
In
In
Such a pole may be any conventional electrical transmission infrastructure, such as a metal transmission tower, a wood pole, or a structure made from concrete or composites, whereby the infrastructure may have conductors, insulators 807, Stockbridge dampers 809, and transformers thereon, and also other forms of transmission lines, such as for telephone or internet, as well as antennas for cell phones. Electrical transmission lines typical have a unique power-handling capacity and the heights of poles and transmission towers varies accordingly. Electrical transmission lines carrying higher voltages may induce greater concern for fire risk and heat surges; because these towers are higher, the MFD system mounted on them will have a greater panoramic extent of IR energy detection. In the United States standard utility poles are around 35 ft (10 m) in height and are often spaced 300 ft (100 m) apart in non-urban areas. MFD systems will reliably detect fire risk and heat surges over this distance, from that height.
As illustrated by
MFD system 1301 controller 1307 further processes risk determination algorithm 1309 adapted for use in IR energy pattern data sensor fusion, and associates IR energy pattern data streams with orientation data in sensor orientation determination 1311. For example, if the algorithm 1309 receives an IR energy pattern data stream indicating a fire risk or heat surge, comparison with prior stored typical IR energy pattern data for that orientation, and/or comparison with other IR energy pattern data streams from other thermoelectric sensors facing other orientations, triggers a warning signal that may be transmitted via communication system 1313. MFD system 1301 may include an wavelength detector that operates regardless of visibility, and methods to stabilize incoming IR energies, as appreciated by those having ordinary skill in the art. MFD system 1301 further includes power supply 1315.
The present invention is not limited to the above described embodiments, and it goes without saying that various modifications can be made without departing from the scope of the invention. For example, in the above described embodiments, the MFD system is mounted on infrastructure such as utility poles, transmission towers, and on stand-alone poles; however the present invention is not limited thereto, but can be employed in any circumstance for which a low-cost, long-range detector of fire risk and heat surges are desired. MFD vessels may be placed on the ground, or in trees, or employed in balloons, drones, or other airborne systems. The MFD system may be deployed anywhere that an inexpensive, energy-efficient, long-distance detector of fire risk and heat surges is needed, including industrial sites, educational sites, institutional sites, transportation corridors and lines, airports, suburban and rural communities, and other places.
The present application claims benefit under 35 USC § 119(e) of U.S. Provisional Patent Application Ser. No. 63/538,287 filed on 14 Sep. 2023. The present application is based on and claims priority from this application, the disclosure of which is hereby expressly incorporated herein by reference.