Termite inspectors may use visual cues and poking tools to identify termite activity and a degree of infestation. However, about 75 percent of the building structure may be visually inaccessible [IEEE Ultrasonic Symposium, 1991, pp. 1047-1051]. And, successful visual detection usually means that infestation is advanced, such as seeing multiple termite tunnels on the outside of framing members, or even hearing rustling or clicking sounds that may indicate a type of activity or an alarm message. Treatment may require that occupants vacate the building.
Technical tools may provide a deeper look into the structures for signs of early infestation, such as the thermal imaging of US20090046759 which scans for changes in interior wood condition (
In non-analogous prior art, Krisp™ (
More frequent and thorough inspections using a combination of the most sophisticated tools may increase a success rate for catching an early infestation. However, there's still a risk of forgetting to schedule an inspection, and the house or building may sometimes be empty for months, such as when the occupants leave for a winter home.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key aspects or essential aspects of the claimed subject matter. Moreover, this Summary is not intended for use as an aid in determining the scope of the claimed subject matter.
In an embodiment, there is disclosed a method of using a portable sampling device for early detection of termite activity within a suspect zone of a building made with wood. The suspect zone may contain environmental noise maskable of at least one sound pattern of the termite activity discoverable in the building. The method may further comprise collecting an environmental knowledge base representing a variety of environmental noises potentially present in the suspect zone. The method may further comprise establishing a termite pattern library representing a variety of termite sound patterns discoverable during a termite inspection of the suspect zone without the noise. At least a portion of the pattern library may be accessible by or storable within the sampling device. A deep learning model based on an artificial neural network may be provided for learning to discern the at least one sound pattern from the variety of sound patterns in the presence of the variety of environmental noises.
The method may further comprise training the deep learning model on the variety of sound patterns in the termite pattern library in order to produce an intelligent algorithm installable in the sampling device for detecting the termite activity. During the termite inspection, a primary audio transducer may be configured to the sampling device and directed toward a sample location in the suspect zone. An audio sample may be collected from the sample location and be substantially within the human frequency range of 20 Hz-20 kHz. The method may further include evaluating the audio sample, using the intelligent algorithm, for a match with at least one of the variety of sound patterns in the termite pattern library. The sampling device may be configured to indicate an intensity of the termite activity if the intensity is greater than an activity threshold.
In a further embodiment, there is disclosed a method of continuously monitoring a building made with wood for an early detection of termite activity within one or more suspect zones of the building. Each of the suspect zones may include environmental noise maskable of at least one sound pattern of the termite activity discoverable in the building. The method may comprise establishing a termite sound pattern library representing a variety of identified termite sound patterns discoverable during a termite inspection. A deep learning model based on an artificial neural network may be provided for learning to discern the at least one sound pattern from the variety of sound patterns and the environmental noises. The method may further comprise collecting environmental training data consisting of many samples of identified termite activity in representative buildings including the environmental noises of their respective suspect zones.
The method may further comprise training the deep learning model on the environmental training data and the identified sound patterns in the pattern library for producing an intelligent algorithm capable of detecting the termite activity. The intelligent algorithm may be independent of the deep learning model. A weather-resistant stationary monitoring unit operable of the intelligent algorithm may be positioned at a sample location within each of the one or more suspect zones. Each of the monitoring units may include an alert output and a primary audio transducer configured to listen to the corresponding suspect zone.
The method may further include periodically collecting a zone sample from one or more of the sample locations and substantially within the human frequency range of 20 Hz-20 kHz. Each of the collected zone samples may be then evaluated, using the intelligent algorithm, for a match with at least one of the variety of sound patterns in the termite pattern library. The alert output may be activated when an intensity of the termite activity exceeds an activity threshold of one or more of the monitoring units.
In another embodiment, there is disclosed a system for detecting early termite activity within a suspect zone of a building made with wood. The suspect zone may include environmental noise maskable of at least one sound pattern of the termite activity discoverable in the building. The system may comprise a sampling device having a primary audio transducer configured to collect a zone sample of the termite activity within the suspect zone. The system may further comprise a termite sound pattern library representing a variety of identified termite sound patterns discoverable during a termite inspection of the suspect zone without the noise. The system may further comprise an environmental training database including many samples of identified termite activity in representative buildings including the environmental noises in their respective suspect zones.
The system may further comprise a deep learning model based on an artificial neural network and communicable with the sampling device, the pattern library, and the training database. The learning model may be configured to train on the variety of sound patterns and the environmental noises. The training of the deep learning model may produce an intelligent algorithm operable on the sampling device for evaluating the zone sample collected in the suspect zone. The intelligent algorithm may detect the presence of one or more of the variety of sound patterns in the termite pattern library.
Additional objects, advantages and novel features of the technology will be set forth in part in the description which follows, and in part will become more apparent to those skilled in the art upon examination of the following, or may be learned from practice of the technology.
Non-limiting and non-exhaustive embodiments of the present invention, including the preferred embodiment, are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified. Illustrative embodiments of the invention are illustrated in the drawings, in which:
Embodiments are described more fully below in sufficient detail to enable those skilled in the art to practice the system and method. However, embodiments may be implemented in many different forms and should not be construed as being limited to the embodiments set forth herein. The following detailed description is, therefore, not to be taken in a limiting sense.
When elements are referred to as being “connected” or “coupled,” the elements can be directly connected or coupled together or one or more intervening elements may also be present. In contrast, when elements are referred to as being “directly connected” or “directly coupled,” there are no intervening elements present.
The subject matter may be embodied as devices, systems, methods, and/or computer program products. Accordingly, some or all of the subject matter may be embodied in hardware and/or in software (including firmware, resident software, micro-code, state machines, gate arrays, etc.) Furthermore, the subject matter may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media.
Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by an instruction execution system. Note that the computer-usable or computer-readable medium could be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, of otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.
When the subject matter is embodied in the general context of computer-executable instructions, the embodiment may comprise program modules, executed by one or more systems, computers, or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.
As may be appreciated, based on the disclosure, there exists a need in the art for a sensitive and non-invasive method of termite inspection that can discern a type and an intensity of termite activity that is subaudible, thereby discerning an early infestation. Also, there exists a need in the art for a portable device that acoustically detects a variety of signatures of the termite activity which conduct through wooden structures that otherwise appear undamaged. Additionally, there exists a need in the art for the acoustic detector to filter out environmental noises present in an inspection area, especially given the prevalence of beeping electronic devices and more work-at-home inhabitants. Further, there exists a need in the art for a small stationary monitor to automatically and periodically listen for early termite infestation in several key locations around the house.
Referring now to
The variety of sound patterns storable in the pattern library 31 may comprise different types of termite activity indicative of a degree of infestation, and which may be useful in discerning an early infestation from an advanced infestation. The sound patterns (
Continuing with
The deep learning model 30 may include one or more of a convolutional neural network (CNN), a recurrent neural network algorithms, a connectionist temporal classification (CTC), attention mechanisms, an autoencoder, a variable autoencoder, transfer learning, and a traditional machine learning technique including one or more of a support vector machine, random forests, and a k-nearest-neighbor model.
Referring still to
Continuing with
The combination of various stationary and non-stationary termite signatures may trend, cycle, or randomly walk. This non-stationarity suggests that substantial training of the deep learning model may be required, using a large number of training data samples. At least hundreds or thousands of training samples, classified (identified) into particular termite activities by human experts, may be fed to the model 30 for developing the algorithm 25. The complexity and meandering of a colony's sound pattern may be akin to a human conversation having distinct and repeated ‘words’ as well as complex ‘phrases’, and a swelling and receding of intensity and spectral tonality that characterize emotional human speech.
Training data and termite sound patterns may need to include samples across local geography, climate, time of year, temperature, humidity, varieties of wood, and age of a colony. The model 30 may also make use of graphical processing units (GPU) and spectrograms 38 (
Referring again to
The primary transducer 22 may be a microphone (not shown) built into the portable sampling device 20 or a smart phone. The primary transducer 22 may also be a contact transducer 22a (e.g. stethoscope or piezoelectric transducer) placeable against a solid surface in the suspect zone 14 for improving a signal-to-noise (SNR) ratio between the termite activity and the environmental noise. In a preferred embodiment, the primary transducer 22 may be a directional microphone for maximizing the receipt of the termite sound pattern.
Alternatively, the sampling device 20 and primary audio transducer 22 may be configured to sample substantially in the ultrasonic range above 20 kHz, and which may extend up to 100 kHz. A length of the zone sample may be a matter of seconds, or may be a matter of minutes. The zone samples may also be accumulated by the sampling device 20 and uploaded to the termite pattern library 31 and environmental database 32 for further ‘lab learning’ and training of the deep learning model 30. The uploading may take place over the wireless link 33.
Continuing with
The indicating 24 may also include one or more of the following status outputs: a time-waveform image (not shown) of the sound pattern, a spectral image 38 of the sound pattern, a confidence indicator 39, and a recording 36 of the termite activity for playback to an operator of the sampling device 20. For example, a sound of the collected zone sample played back may help the operator assess one or more of a degree of infestation and a type of the at least one sound pattern. Indications of the type and the intensity 34 may be displayed on a screen 24 of the sampling device 30, and together may suggest the degree of infestation. The indicated type may describe a termite species and/or a type of activity (e.g. dry rattle alarm).
If there is an ambiguous result 46 (“Maybe”), the sampling device 20 may recommend moving to another sampling location 15 in the same suspect zone 14, repeating the zone sample, varying the microphone distance at the same sample location 15 in order to get a different SNR, reducing the environmental noise at a source in the suspect zone 14, or collecting a purely environmental noise sample. For example, referring to
The link 33 between the portable sampling device 20 and the centralized deep learning model 30 may be maintained in order to update the intelligent algorithm 25, upload zone samples, upload test results, download termite sound patterns (signatures), and/or further train the deep learning model 30 with new zone samples. The portable sampling device 20 may operate independently of the deep learning model and may run the intelligent algorithm on an application in order to provide real-time results. Alternatively, the portable device may include a wireless link to the model 30, training data 32, and termite library 31 in order to support an interactive mode of sample evaluation.
Continuing with
Referring now to
Continuing with
The GPU (graphics processing unit)-CPU controlled instrument 60 may enable a kind of edge computing, integrating data collection and analysis close to the source. In one embodiment, the unit 60 may also be configured to operate the intelligent algorithm 25 and function thereby as the portable sampling device 20, collecting zone samples during the termite inspection 10. Advantageously, the specialized training data collector 60 may be able to devote all of its processing power to training data collection, and potentially to the portable sampling, as compared to a smart phone which may need to reserve much of its processing power and memory for cellular communication and multiple other applications. This additional computing power of the GPU-CPU 62 may eliminate the need to move large (spectral) image files to the cloud 19 when the complexity of running the intelligent algorithm 25 exceeds that handleable by a smart phone.
Continuing with
Referring now to
Additionally, in an embodiment not shown, the stationary monitoring system 11 may include one or more battery-powered test transmitters configured to emit a simulated termite sound pattern. The test transmitter may be mountable to, or placeable near, wooden members of the building 21. The termite transmitters may be scheduled to periodically and acoustically radiate one or more sound patterns simulating early termite infestation in order to verify that the network of stationary monitoring units 51 are operating correctly by producing an alert output 56. The test pattern could be broadcast, for example. at 10 am every Monday morning so that each monitoring unit 51 knows to send out a “confirm test” signal to the alarm center instead of “termites detected” signal.
Although the above embodiments have been described in language that is specific to certain structures, elements, compositions, and methodological steps, it is to be understood that the technology defined in the appended claims is not necessarily limited to the specific structures, elements, compositions and/or steps described. Rather, the specific aspects and steps are described as forms of implementing the claimed technology. Since many embodiments of the technology can be practiced without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended.
This patent application claims priority to U.S. Provisional Application No. 63/407,741 filed on Sep. 19, 2022 and entitled METHOD OF ACOUSTICALLY DETECTING EARLY TERMITE INFESTATION, the entire contents of Application 63/407,741 being expressly incorporated by reference herein.
Number | Date | Country | |
---|---|---|---|
63407741 | Sep 2022 | US |