The present invention relates to the detection of deleterious insects. More specifically, it relates to automated detection of insect-generated vibro-acoustic signals, and processing methods and systems for detecting the presence of unwanted wood boring insects in wood packing material, trees and the like, by acoustic and vibrational means.
It is estimated that exotic invasive species cost the American economy over $138 billion per year. The United States Department of Homeland Security Customs and Border Protection (CBP) facilitates yearly processing of about $2 trillion in legitimate trade, both imports and exports, while enforcing United States trade laws that protect the economy, health, and safety of people worldwide. Currently, CBP agriculture specialists rely mostly on manual techniques to inspect shipments. These methods are time-consuming and are generally not 100% effective, as available personnel resources typically allow for less than 2% of cargo to be examined. Wood boring pests are especially difficult and time-consuming to detect, as they burrow and feed inside the wood, and often leave few or no visual cues to their presence. Particularly destructive wood boring pests include the Asian longhorn beetle (i.e., Anoplophora glabripennis (Motchulsky), “ALB”) and the emerald ash borer (i.e., Agrilus planipennis Fairmaire, “EAB”).
Insect borers can produce significant damage to a wide range of agricultural, ornamental, landscape, and forest trees that have a significant impact on the US economy. In many publications it was stated that EAB is the most destructive and economically costly forest insect to ever invade North America. Simulations predict an expanding EAB infestation that will likely encompass most of the 25 affected states and warrant treatment, removal, and replacement of more than 17 million ash trees with a mean discounted cost of $10.7 billion.
Currently, the inspection of host trees within infested areas is conducted individually for signs of attack (e.g., oviposition pits and emergence holes) by using binoculars, hydraulic lifts and tree climbers. These approaches are time-consuming and expensive. Destructive sampling of plants has become necessary because visual inspections led to false negative decisions on several occasions, and therefore infested plants were released. However, destructive sampling is not ideal as it is costly to the importer and time-consuming for the inspector. Effective non-destructive techniques could ensure that the inspection process remains as effective while providing significant efficiencies to both the inspectors and the importers.
The development of vibro-acoustic detection methods for wood boring insects started decades ago. For example, vibro-acoustic/vibrational methods of detecting termites and other wood boring larvae have been investigated over the last three decades. However, reliable commercial products that can be used for inspections at United States ports of entry and trees require automated signal processing that can discriminate between larva-induced sound/vibration and sound/vibration resulting from background noise. Background noise contains many unwanted signals: sounds and vibration of machinery, noise and vibration from equipment (conditions, refrigerators, fans . . . etc.), human speech, etc. Currently, commercially available devices for detection of adult wood boring insects (e.g., such as termites) are available, e.g., the AED-2010 (from Acoustic Emission Consulting, Fair Oaks, Calif.). These systems can detect all types of sounds and vibrations; however, the separation of insect sounds and vibrations from ambient noise needs to be performed manually by a trained listener.
Accordingly, there exists a need for a sensor system that can be used in commercial and forest environments that detects the presence of wood boring insects in wood packing materials and trees.
The present invention involves a system and method for detecting pulses potentially belonging to wood-boring pests, such as insect larvae, within a structure (e.g., wood product) while separating the pulses from external noise. In an embodiment, the system has a multi-component design, one component of which is a sensor assembly adapted to be positioned on a structure to be tested for insect infestation. In an embodiment, the sensor assembly includes a primary sensor adapted for placement in contact with the structure and functioning to sense (i.e., detect) vibro-acoustic signals emanating internally and/or externally of the structure, and a reference sensor adapted for placement near, but out of contact with, the structure and functioning to sense (i.e., detect) acoustic noise signals emanating externally of the structure. Each of the sensors (i.e., the primary sensor and the reference sensor) can provide a respective electric signal to a signal conditioning unit, which amplifies the electric signals and, in turn, transmits the amplified electric signals to a data acquisition unit, which transforms the amplified electric signals into respective digital signals (i.e., digital data streams). The digital signals in turn are sent to a processor adapted to execute program logic in order to analyze the digital signals to discriminate between any signals emanating from wood-boring insects and those emanating from ambient noise sources. The signal conditioning unit, along with the data acquisition unit and the processor, comprise additional components of the aforementioned system.
In an embodiment, the processor is configured to be coupled to a non-transitory, computer-readable storage medium with program logic for execution by the processor. The program logic includes a logic module executable by the processor for receiving electric signals from the primary and reference sensors, wherein the logic module is configured to provide an automatic insect detection algorithm, which can execute one or more of the following three methods (i.e., steps) to discriminate between potential insect signals and extraneous noise: (1) the comparison of detected primary sensor pulses with pulses from the reference sensor to eliminate pulses produced by external noise; (2) signal discrimination based on acoustic features, including (a) pulse duration, (b) frequency with the maximal amplitude in the pulse frequency spectrum (i.e., main frequency), and (c) frequency with the maximal amplitude in the pulse envelope spectrum (i.e., main envelope frequency); and (3) counting the number of insect-like pulses occurring within a definite time window and making a determination that the tested structure (e.g., wood product) is infested when the number of detected insect pulses for a definite time window exceeds a pre-defined threshold.
In an embodiment, the primary sensor is an accelerometer sensor. In other embodiments, the primary sensor could be a displacement sensor, a capacitor sensor, a velocity transducer, a laser doppler vibrometer, a fiber optical vibrometer, an ultrasonic vibrometer, a geophone, or any other type of the vibration sensor. Regardless of the embodiment, the contact between the primary sensor and the structure can be improved by providing the sensor assembly with a weighted casing or housing.
In an embodiment, the reference sensor is a microphone, or another type of the acoustic sensor. The reference sensor (e.g., microphone) can be configured to be sensitive to ambient noise and insensitive to the vibro-acoustic signals generated by one or more wood boring species in the structure (e.g., wood product). For example, and as indicated above, the reference sensor can be positioned near, but out of contact with, the structure to be tested. By way of further example, the reference sensor can be isolated from the primary sensor by a physical, sound-proof barrier, such as a flexible skirt which surrounds the primary sensor and acoustically insulates it from ambient noise. In another embodiment, the sound-proof barrier can surround the reference sensor, in addition to or in place of surrounding the primary sensor.
In an embodiment, the program logic can be configured to discriminate between noise generated by one or more wood boring species in the structure to be tested and extraneous noise unrelated to the wood boring species by operating N primary sensors, M reference sensors, N+M signal conditioning and acquisition devices to generate N+M signal streams based on input from the N+M primary and reference sensors.
It is an object of the present invention to construct an algorithm that makes an informed decision about whether or not an inspected wood structure is infested.
It is a further object of the present invention to develop vibro-acoustic methods of wood boring insect detection in trees.
It is an additional object of the present invention to provide a tool for fast and reliable tree surveys that will allow for wood boring insect detection, while increasing the insect detection rate significantly.
An object of the present invention is to allow for early detection of wood boring insects as compared with current methods.
Yet another object of the present invention is to provide software for automated insect sound detection that provides high probability of detection with a low false alarm rate.
Future applications may include implementation of the developed system and algorithms for detection of wood boring insects in wood packaging materials and wood products at U.S. ports of entry and development of methods to detect wood boring insects in live trees.
For a more complete understanding of the present invention, reference is made to the following detailed description of various embodiments considered in conjunction with the accompanying drawings, in which:
Before any embodiments of the invention are explained in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The invention is capable of other embodiments and of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” “coupled” and “uncoupled,” as well as variations of such terms, are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.
The following discussion is presented to enable a person skilled in the art to make and use embodiments of the present invention. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the generic principles herein can be applied to other embodiments and applications without departing from the disclosed embodiments of the present invention. Thus, embodiments of the present invention are not intended to be limited to the embodiments disclosed herein, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements, if any, in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of embodiments of the present invention. Skilled artisans will recognize the examples provided herein have many useful alternatives that fall within the scope of embodiments of the present invention.
Some embodiments of the invention include a detection system that utilizes one or more vibration and/or acoustic sensors to detect deleterious insects in living trees, felled trees, and/or man-made products such as logs, shaped wood products, and/or wood assemblies such as trusses and wooden shipping pallets. More specifically, embodiments of the present invention relate to systems and methods of signal processing of vibro-acoustic signals from materials of the structure for the purpose of detecting the presence of unwanted insects by acoustic and vibrational means.
Referring to
In an embodiment, contact between the vibration sensor and the wood surface being tested can be enhanced by housing the sensor assembly 12 in a case 26 which is weighted down by, for instance, lead pellets 28 (see
In an embodiment, the lower surface of sensor assembly 12 can include a soft, sound-proofed skirt 34 that creates an acoustic barrier which decreases the penetration of external sound (i.e., ambient acoustic waves) to the primary sensor 14. In this illustrated embodiment, the skirt 34 surrounds the primary sensor 14.
In an alternate embodiment depicted in
Electrical signals from the sensors 114, 114, 118, 118 may be received by the data acquisition system 122 and then can be sent to a processor (not shown), after digitization, for signal processing and analysis. Data processing and analysis of the recorded data is conducted by a non-transitory, computer-readable storage medium with program logic for execution by the processor. The program logic includes a logic module executable by the processor for recorded signals from the primary and reference sensors, wherein the logic module is configured to provide an automatic insect detection algorithm. The system 110 provides high quality and low noise recordings, and real-time data analysis of tree vibrations. Alternatively, the data processing and analysis can be done at a remote location and/or at a later time.
In an embodiment, the signal processing can include one or more steps for the separation of the wood boring insect signals from external noise by way of an automatic detection algorithm which combines three methods to discriminate between potential insect signals and extraneous noise: (1) comparison to a reference sensor, (2) discrimination based on acoustic features, including (a) pulse duration, (b) frequency with the maximal amplitude in the pulse spectrum (main signal frequency), and (c) frequency with the maximal amplitude in the pulse envelope spectrum (main envelope frequency), and (3) discrimination based on the number of detected insect pulses for a definite time window.
In an embodiment of the present invention, the primary sensor pulses are compared with any corresponding reference pulses, and if a pair of pulses took place in close temporal proximity and each had a similar duration, the pulse from the primary sensor is considered as a noise pulse and is not included in further steps, such as the counting of any potential insect-generated pulses.
In an embodiment of the present invention, the main frequency of detected vibro-acoustic pulses, main frequency of the pulse envelopes and duration of the received pulses can be measured, and only signals having main frequency, main envelope frequency and pulse duration close to a previously obtained reference database of insect signals can be chosen for analysis.
Further, in an embodiment, statistical properties of the noise and wood boring insect signals are used to determine the required time of data collection and threshold for decision as to if the tested pallet is infested or not. In some embodiments, the decision that a wood sample is infested is made when the number of detected insect pulses for a definite time window exceeds a pre-defined threshold.
With continued reference to the insect detection algorithm flowchart of
A further embodiment of the present invention includes a third step 96, where a pulse detector finds all the pulses with an envelope greater than the detection threshold and estimates the parameters of every ith pulse, including start time tStarti, end time tEndi and duration
Still further embodiments of the present invention involve a fourth step 98, where detected pulses are compared with noise signal to noise suppression. The rejection is done for pulses where timing coincides with pulses found in a reference channel. In some embodiments, the decision on time coincidence can take into account possible pulse propagation delay Δmax between the primary and reference sensors. The idea is that pulse start/end times in the primary sensor may occur earlier or later than in the reference sensor by Δmax=R/cmin, where cmin is a minimal possible sound propagation speed (which is the speed of sound in air of 343 m/s), and R is the distance between the sensors.
Other embodiments of the present invention involve a fifth step 100, where a spectral analysis provides spectra of signal sx(f) and spectra of envelope se(f) for every pulse detected by steps 1-4 as described hereinabove, while yet other embodiments include a sixth step 102 where the developed algorithm finds the peaks in spectra and estimate main frequency of signal foi, and main frequency of envelope fmod i for every ith detected pulse.
Additional embodiments of the present invention involve a sixth step 102, including pulse discrimination based on pulse duration and spectral features where every pulse is analyzed individually and the pulse is classified as “insect” if the main signal frequency, envelope frequency and duration are in the limits established from a pre-compiled database 104 of vibro-acoustic signatures from one or more wood boring insects.
Yet another embodiment of the present invention involves a seventh step 106, where the number of insect-like pulses is counted within a definite time window and the decision that a wood sample is infested is made when the number of detected insect pulses for a definite time window exceeds a pre-defined threshold. An optional eighth step 108 involves providing an indicator of the product under test being infested, intact, or unclear.
Although one or more of the earlier-described method operations can include a specific or defined order, it should be understood that other housekeeping operations can be performed in between operations, or operations can be adjusted so that they occur at slightly different times, or can be distributed in a system which allows the occurrence of the processing operations at various intervals associated with the processing, as long as the processing of the overlay operations are performed in the desired way. Further, it is understood that one or more of the earlier-described method operations can be performed out of order, or not performed, skipped, and/or delayed.
Additional details on the present system and its associated methods of detecting wood boring insects can be found in the publication by Alexander Sutin et al., titled “Towards an Automated Acoustic Detection Algorithm for Wood-Boring Beetle Larvae (Coleoptera: Cerambycidae and Buprestidae),” Journal of Economic Entomology, Vol. 112, No. 3, May 22, 2019, pp. 1327-1336, <URL: https://academic.oup.com/jee/article/112/3/1327/5316748><DOI: 10.1093/jee/toz016>, the entire disclosure of which publication is incorporated herein by reference in its entirety and made part of the present disclosure.
It will be appreciated by those skilled in the art that while the present invention has been described above in connection with particular embodiments and examples, the present invention is not necessarily so limited, and that numerous other embodiments, examples, uses, modifications and departures from the embodiments, examples and uses are intended to be encompassed by the claims attached hereto. The entire disclosure of each patent and publication cited herein is incorporated by reference, as if each such patent or publication were individually incorporated by reference herein. Various features and advantages of the present invention are set forth in the following claims.
This application claims priority to U.S. Provisional Application Ser. No. 62/804,129, filed on Feb. 11, 2019, the entire contents of which are incorporated herein by reference.
This invention was made with government support under Grant No. HSHQDC-13-J-00133 awarded by the U.S. Department of Homeland Security's Science and Technology Directorate. This invention was also made with government support from the U.S. Department of Agriculture, Animal and Plant Health Inspection Service. The government has certain rights in the invention.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2020/017792 | 2/11/2020 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62804129 | Feb 2019 | US |