This disclosure relates generally to sensor systems, and in particular but not exclusively, relates to systems for monitoring beehives.
A beehive is a manmade enclosure in which certain honeybee species can live, raise their brood, and generate honey. The beehive operates as the nest for the colony. Beehives are often used for commercial production of honey and pollination of commercial crops. As such, large groups of beehives are often transported around the country to different sites for pollination and honey production. Unfortunately, honeybees are suffering from a crisis that appears to be affecting bee colonies around the world. This crisis is referred to as colony collapse disorder. The reasons for this disorder are not fully understood, but environmental factors such as pollution (e.g., pesticides) or other manmade interferences are believed to be contributing factors. Accordingly, a platform that is capable of monitoring the health of a beehive to help a beekeeper better understand the health status of a bee colony and address those needs in a timely manner is desirable.
Non-limiting and non-exhaustive embodiments of the invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified. Not all instances of an element are necessarily labeled so as not to clutter the drawings where appropriate. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles being described.
Embodiments of an apparatus, system, and method of operation for a beehive monitoring system that includes a sensor bar shaped to form a frame bar of a honeybee frame are described herein. In the following description numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Embodiments of a beehive monitoring system disclosed herein include a sensor bar set in a form factor that fits a frame bar (e.g., top bar) of a honeybee frame that slides into a chamber of a beehive. The sensor bar may include a variety of different interior environmental sensors and a microphone for monitoring the health (including activity) of the colony and the interior of the beehive. In particular, the microphone records soundtracks that are related to the level of activity of the hive. In some embodiments, the sensor bar is coupled to a base unit containing a battery, a microcontroller and memory, wireless communications (e.g., cellular radio, near-field communication controller, etc.), exterior environmental sensors for monitoring the exterior environment around the beehive, as well as other sensors (e.g., global positioning sensor). The data collected from both the interior and exterior of the beehive may be collected and combined with ground truth data from a knowledgeable beekeeper using a mobile application installed on a mobile computing device. Alternatively (or additionally), the data can be sent to a cloud-based application, which is accessed remotely. The data provides the beekeeper with real-time health status of the colony and the beehive. In one embodiment, machine learning (ML) models may be trained using the interior and exterior sensor data, soundtracks, and the ground truth data collected. Once trained, ML classifiers may be incorporated into the cloud-based application and/or mobile application to monitor, track, and diagnose the health of the colony and identify stresses or other activity negatively affecting the colony. In some embodiments, the ML classifiers may even provide the beekeeper with advance warning of health issues (e.g., colony collapse disorder, loss of the queen, number of mites per 100 bees, pesticide exposure, presence of American foulbrood, etc.) and provide recommendations for prophylactic or remedial measures. In one embodiment, wireless bandwidth and battery power may be conserved by installing the ML classifier onboard the base module and only transmitting summary analysis, as opposed to the raw data, to the cloud-based application or the mobile application. These and other features of the beehive monitoring system are described below.
Sensor bar 110 has a form factor (e.g., size and shape) to function as a frame bar of a honeybee frame 145 that slides into a chamber 150 of a beehive (see
The sensor readings and soundtracks acquired by sensor bar 110 may be recorded to memory, prior to transmission to either mobile application 130 and/or cloud-based application 135. In the illustrated embodiment, sensor bar 110 is coupled to a base unit 115 via cable 125. Cable 125 is coupled to sensor bar 110, extends out of chamber 150 and couples to base unit 115. In the illustrated embodiment, base unit 115 is attached to the exterior side of chamber 150 via a mount 120. In one embodiment, cable 125 fixes to mount 120, which includes a data/power port that connects to base unit 115 when mated to mount 120. In one embodiment, mount 120 is permanently (or semi-permanently) attached to chamber 150 and includes an identifier 270 (e.g., serial number, RFID tag, etc.) that uniquely identifies chamber 150 and/or the entire beehive, of which chamber 150 is a member. When base unit 115 slides into, or otherwise mates to mount 120, base unit 115 reads identifier 270 (or is otherwise associated therewith) and associates the sensor data and soundtracks with that particular identifier.
Base unit 115 may include a number of circuitry components for storing, analyzing, and transmitting the sensor data and soundtracks. For example, base unit 115 may include one or more of: memory 205 (e.g., non-volatile memory such as flash memory), a general purpose microcontroller 210 to execute software instructions stored in the memory, a battery 213, a cellular radio 215 (e.g., long-term evolution machine type communication or “LTE-M” radio, or another low power wide area networking technology) for cellular data communications, a global positioning sensor (GPS) 220 to determine a location of the beehive, a near-field communication (NFC) controller 225 (e.g., Bluetooth Low Energy or “BLE”) to provide near-field data communications with portable computing device 131, and one or more external environmental sensors. For example, the external environmental sensors may include a temperature sensor 230 to monitor an exterior temperature around the beehive, a humidity sensor 235 to measure exterior humidity, one or more chemical sensors 237 to measure pollution exterior to the beehive, one or more chemical sensors 239 to measure exterior pheromones, or otherwise. In one embodiment, base unit 115 may also include an accelerometer to detect movements of the chamber or the beehive. These movements can be used to track beehive maintenance and even provide theft detection or detection of interference by wild animals.
During operation, base module 115 stores and transmits the sensor data and soundtracks, and in some embodiments may also provide local data processing and analysis. Mobile application 130 may help the beekeeper or other field technician find and identify a particular beehive via the wireless communications and the GPS sensor disposed onboard base unit 115. The onboard NFC controller may be used to provide tap-to-communicate services to a beekeeper carrying portable computing device 131. The stored sensor data and soundtracks may be wirelessly transferred to mobile application 130 using NFC protocols. In some embodiments, mobile application 130 may solicit ground truth data from a knowledgeable beekeeper and associate that ground truth data with the sensor data and soundtracks, as well as with other ancillary data (e.g., date, time, location, weather, local vegetation/crops being pollinated, etc.). The sensor data, soundtracks, ground truth data, and ancillary data may be analyzed with a trained ML classifier integrated with mobile application 130 or even by a trained ML classifier 140 disposed onboard base unit 115. By locally executing a trained ML classifier 140 either onboard base unit 115 or one integrated with mobile application 130, classified results may be pushed up to cloud-based application 135, as opposed to the raw data, which saves bandwidth and reduced power consumption on battery 213.
Cloud-based application 135 may be provided as a backend cloud-based service for gathering, storing, and/or analyzing data received either directly from base unit 115 or indirectly from mobile application 130. Initially, the raw data and ground truth data may be transmitted to cloud-based application 135 and used to train a ML model to generate one or more trained ML classifiers, such as ML classifier 140. However, once sufficient data has been obtained and a ML classifier trained, ML classifier 140 may be installed directly onto base unit 140 (or integrated with mobile application 130). The onboard ML classifiers can then locally analyze and classify the health status of each beehive and merely provide summary data or analysis to cloud-based application 135 or mobile application 130, thereby reducing bandwidth and power consumption. The summary data or analysis may provide a beekeeper with real-time tracking of data and health statuses, environmental stress alerts, prophylactic or remedial recommendations, etc. The ML classifiers (e.g., ML classifier 140) or ML models may take soundtracks, interior sensor data (e.g., interior temperature, humidity, carbon dioxide, chemical pollution, pheromone levels, etc.) and exterior sensor data (e.g., exterior temperature, humidity, carbon dioxide, chemical pollution, pheromone levels, GPS location, weather conditions, etc.) along with ground truth data and ancillary data, as input for both training and real-time classifying. The ground truth data may include the observations, conclusions, and informed assumptions of a knowledgeable beekeeper or field technician observing or managing a given beehive. The combined data input from the carbon dioxide sensors, temperature sensors, humidity sensors, audio sensors, and chemical sensors may be used by the ML classifier to make predictions about colony collapse disorder, loss of a queen bee, the presence of American foulbrood bacteria, the number of mites per bee population, as well as other colony stresses.
As illustrated in
Main member 405 and top member 410 collectively form an elongated enclosure, which in the illustrated embodiment is held together with mechanical fasteners (e.g., screws). The elongated enclosure houses circuit board 445 upon which one or more microphones and various interior environmental sensors (e.g., humidity sensor, temperature sensor, carbon dioxide sensor, chemical sensors for pollution detection, chemical sensors for pheromone detection, etc.) are disposed. In one embodiment, main member 405, top member 410, and side members 415 are fabricated of food grade plastic (e.g., polypropylene, high density polyethylene, etc.), metal (e.g., stainless steel, aluminum, etc.), wood, or otherwise.
The elongated enclosure has a form factor to function as a bar (e.g., top bar) of a honeybee frame 500 (see
Returning to
Turning to
In a process block 605, sensor bar 110 operates to monitor (e.g., continuously, periodically, or on-demand) the interior of a beehive, such as beehive 300. In various embodiments, monitoring the interior environment includes recording hive activity via microphone 240 and/or monitoring various other interior environmental characteristics using interior environmental sensors 245-265. In one embodiment, the data (e.g., recorded soundtracks and sensor readings) are recorded into memory 205 of base unit 115 for storage and/or processing. In a process block 610, base unit 115 operates to monitor (e.g., continuously, periodically, or on-demand) the exterior environment surrounding the beehive. In various embodiments, monitoring the exterior environment includes monitoring various exterior environments characteristics using exterior environmental sensors 230-239. Again, the exterior sensor data may be temporarily stored into onboard memory 205. Along with the sensor data, base unit 115 may identify the geographical location of the beehive using GPS 220 (process block 615). Since commercial beehives are often transported great distances throughout the year, location tracking can help correlate sensor readings to geographic location, local weather, local crops/vegetation, known sources of pollution, etc.
In one embodiment, a beekeeper (or other field technician) can physically inspect individual beehives using mobile computing device 131 equipped with NFC capabilities and mobile application 130. For example, the beekeeper can tap or scan base unit 115 with mobile computing device 131 (decision block 620) to obtain the data and sensor readings related to the status and health of a particular beehive. If the beekeeper is knowledgeable, ground truth data related to the beekeeper's own observations of the hive may also be solicited by mobile application 130 (process block 630). After collecting the data (e.g., sensor readings, soundtracks, ground truth data, and any other ancillary data), mobile application 130 may transmit the data (or summarized analysis thereof) to cloud-based application 135. Alternatively (or additionally), base unit 115 may be physically removed from mount 120 for charging and large data download to a computer via a wired connection (e.g., USB-C, etc.), and then base unit 115 is subsequently mated back to mount 120.
If a remote query of a particular beehive (or group of beehives) is desired (decision block 635), then the health status of the beehive may be obtained via cellular data communications. For examples, the remote query may come from cloud-based application 135 as part of a routine, periodic, or on-demand retrieval of data. Alternatively, a user of mobile application 130 may request a remote query of the health status of a particular beehive or group of beehives. A remote query from mobile application 130 may come indirectly via cloud-based application 135, or operate as a direct peer-to-peer communication session with base unit 115.
In embodiments using machine learning to model and classify the health status of a beehive (decision block 645), the collected data (e.g., interior and exterior environmental sensor data, GPS location, soundtracks, etc.) is combined with the collected ground truth data and other ancillary data as input into a ML model or neural network for training (process block 650) to generate a trained ML classifier (process block 655). In a decision block 660, the ML classifier may be operated remotely by cloud-based application 135 (process block 665) and the analysis sent to mobile application 130 for review by the beekeeper (process block 670). Alternatively (or additionally), the classification may be executed locally onboard base unit 115 by ML classifier 140 (process block 675). In this embodiment, base unit 115 sends the classifications and/or recommendations to cloud-base application 135 and/or mobile application 130 without sending some or all of the underlying raw data (process block 680). This embodiment has the benefit of conserving power and bandwidth due to continuous, large volume transfers of the raw data. Of course, ML application 140 may also be integrated with mobile application 130 as a sort of semi-local classification.
The processes explained above are described in terms of computer software and hardware. The techniques described may constitute machine-executable instructions embodied within a tangible or non-transitory machine (e.g., computer) readable storage medium, that when executed by a machine will cause the machine to perform the operations described. Additionally, the processes may be embodied within hardware, such as an application specific integrated circuit (“ASIC”) or otherwise.
A tangible machine-readable storage medium includes any mechanism that provides (i.e., stores) information in a non-transitory form accessible by a machine (e.g., a computer, network device, personal digital assistant, manufacturing tool, any device with a set of one or more processors, etc.). For example, a machine-readable storage medium includes recordable/non-recordable media (e.g., read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).
The above description of illustrated embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
This application claims the benefit of Provisional Application No. 63/004,100, filed Apr. 2, 2020, the contents of which are hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
63004100 | Apr 2020 | US |