Correlation of sensory inputs to identify unauthorized persons

Information

  • Patent Grant
  • 11747430
  • Patent Number
    11,747,430
  • Date Filed
    Wednesday, August 20, 2014
    10 years ago
  • Date Issued
    Tuesday, September 5, 2023
    a year ago
Abstract
A networked system for managing a physical intrusion detection/alarm includes an upper tier of server devices, comprising: processor devices and memory in communication with the processor devices, a middle tier of gateway devices that are in communication with upper tier servers, and a lower level tier of devices that comprise fully functional nodes with at least some of the functional nodes including an application layer that execute routines to provide node functions, and a device to manage the lower tier of devices, the device instantiating a program manager that executes a state machine to control the application layer in each of the at least some of the functional nodes.
Description
BACKGROUND

This description relates to operation of sensor networks such as those used for security, intrusion and alarm systems installed on commercial or residential premises.


It is common for businesses and homeowners to have a security system for detecting alarm conditions at their premises and signaling the conditions to a monitoring station or to authorized users of the security system. Security systems often include an intrusion detection panel that is electrically or wirelessly connected to a variety of sensors. Those sensors types typically include motion detectors, cameras, and proximity sensors (used to determine whether a door or window has been opened). Typically, such systems receive a very simple signal (electrically open or closed) from one or more of these sensors to indicate that a particular condition being monitored has changed or become unsecure.


Typical intrusion systems can be set up to monitor entry doors in a building. When the door is secured, the proximity sensor senses a magnetic contact and produces an electrically closed circuit. When the door is opened, the proximity sensor opens the circuit, and sends a signal to the panel indicating that an alarm condition has occurred (e.g., an opened entry door). Government entities, companies, academic institutions, etc. issue credentials to employees, contractors, students, etc. to control access to buildings and facilities, indoors and outdoors. Individuals who bypass security systems to gain access, either intentionally or unintentionally, are difficult to identify and locate.


SUMMARY

Prior solutions regarding credentials have focused on technologies such as video surveillance to address access problems. Once a person has gained access, however, it is difficult to impossible to distinguish between those with valid credentials and those without valid credentials.


According to an aspect of a system for physical intrusion detection/alarm monitoring includes one or more computing devices, including processor devices and memory in communication with the processor devices, configured to correlate sensory input from credentials or badges with video, receive sensory inputs from credentials or badges within a monitored premises, receive video information from cameras and other image capture devices disposed throughout the premises, and continually correlate the received sensory inputs from these credentials or badges with the received video.


One or more of the following are some of the embodiments within the scope of this aspect. system is further configured to apply one or more algorithms to detect the presence of a possible non-credentialed individual and track at least the non-credentialed individual and produce an alert to send to a control center to alert authorities to the location of the non-credentialed individual. The system is further configured to apply video recognition to identify the number of people in a certain area and correlate that data with data from one or more remote badge readers to identify the appropriately number of badged individuals in a group of individuals within a monitored area. The system is further configured to determine a mismatch between the number of individuals in the area and a number of read badges or credentials. The system is further configured to continually track all individuals and their movements throughout the premises, correlate those movements with different readings of valid credentials or badges to isolate one or more non-credentialed individuals. The one or more computing devices include an application layer that executes routines to provide node functions that can be dynamically changed. At least some of the nodes are cameras and others are credential readers. Certain of the nodes are configured to apply video recognition to frames of captured video to recognize features that correspond to individuals appearing in the captured frames and determine a number of people within the image. In one or more of the certain nodes, the one or more of the certain nodes are configured to change the video recognition algorithm that is applied to find features that correspond to a number of individuals. The system is further configured to correlate paths taken by different individuals with different readings of valid credentials or badges from the same or different sets of cameras/readers.


One or more aspects may provide one or more of the following advantages.


By correlating sensory input from credentials or badges that use technologies such as RFID, Bluetooth low energy (BLE), MAC addresses from cell phones, NFC, etc. with video; individuals without valid credentials can be identified and tracked. Video recognition is used to identify the number of people in a certain area. A remote reading badge is used to identify the appropriately badged employees by tracking the personnel movement and correlating that with the movement of the valid ID. Once the non-badged individual is segregated from the valid personnel, biometrics such as face, iris or just video recognition are used to track the individual(s) and allow authorities to intervene.


The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the invention is apparent from the description and drawings, and from the claims.





DESCRIPTION OF DRAWINGS


FIG. 1 is a schematic diagram of an exemplary networked security system.



FIG. 2 is a flow chart of a correlation algorithm.



FIG. 3 is flow chart of an example tracking process.



FIG. 4 is a block diagram of components of an example networked security system.





DETAILED DESCRIPTION

Described herein are examples of network features that may be used in various contexts including, but not limited to, security/intrusion and alarm systems. Example security systems may include an intrusion detection panel that is electrically or wirelessly connected to a variety of sensors. Those sensors types may include motion detectors, cameras, and proximity sensors (used, e.g., to determine whether a door or window has been opened). Typically, such systems receive a relatively simple signal (electrically open or closed) from one or more of these sensors to indicate that a particular condition being monitored has changed or become unsecure.


For example, typical intrusion systems can be set-up to monitor entry doors in a building. When a door is secured, a proximity sensor senses a magnetic contact and produces an electrically closed circuit. When the door is opened, the proximity sensor opens the circuit, and sends a signal to the panel indicating that an alarm condition has occurred (e.g., an opened entry door).


Data collection systems are becoming more common in some applications, such as home safety monitoring. Data collection systems employ wireless sensor networks and wireless devices, and may include remote server-based monitoring and report generation. As described in more detail below, wireless sensor networks generally use a combination of wired and wireless links between computing devices, with wireless links usually used for the lowest level connections (e.g., end-node device to hub/gateway). In an example network, the edge (wirelessly-connected) tier of the network is comprised of resource-constrained devices with specific functions. These devices may have a small-to-moderate amount of processing power and memory, and may be battery powered, thus requiring that they conserve energy by spending much of their time in sleep mode. A typical model is one where the edge devices generally form a single wireless network in which each end-node communicates directly with its parent node in a hub-and-spoke-style architecture. The parent node may be, e.g., an access point on a gateway or a sub-coordinator which is, in turn, connected to the access point or another sub-coordinator.


Referring now to FIG. 1, an exemplary (global) distributed network 10 topology for a Wireless Sensor Network (WSN) is shown. In FIG. 1 the distributed network 10 is logically divided into a set of tiers or hierarchical levels 12a-12c.


In an upper tier or hierarchical level 12a of the network are disposed servers and/or virtual servers 14 running a “cloud computing” paradigm that are networked together using well-established networking technology such as Internet protocols or which can be private networks that use none or part of the Internet. Applications that run on those servers 14 communicate using various protocols such as for Web Internet networks XML/SOAP, RESTful web service, and other application layer technologies such as HTTP and ATOM. The distributed network 10 has direct links between devices (nodes) as shown and discussed below.


The distributed network 10 includes a second logically divided tier or hierarchical level 12b, referred to here as a middle tier that involves gateways 16 located at central, convenient places inside individual buildings and structures. These gateways 16 communicate with servers 14 in the upper tier whether the servers are stand-alone dedicated servers and/or cloud based servers running cloud applications using web programming techniques. The middle tier gateways 16 are also shown with both local area network 17a (e.g., Ethernet or 802.11) and cellular network interfaces 17b.


The distributed network topology also includes a lower tier (edge layer) 12c set of devices that involve fully-functional sensor nodes 18 (e.g., sensor nodes that include wireless devices, e.g., transceivers or at least transmitters, which in FIG. 1 are marked in with an “F”) as well as constrained wireless sensor nodes or sensor end-nodes 20 (marked in the FIG. 1 with “C”). In some embodiments wired sensors (not shown) can be included in aspects of the distributed network 10.


Constrained computing devices 20 as used herein are devices with substantially less persistent and volatile memory other computing devices, sensors in a detection system. Currently examples of constrained devices would be those with less than about a megabyte of flash/persistent memory, and less than 10-20 kbytes of RAM/volatile memory). These constrained devices 20 are configured in this manner; generally due to cost/physical configuration considerations.


In a typical network, the edge (wirelessly-connected) tier of the network is comprised of highly resource-constrained devices with specific functions. These devices have a small-to-moderate amount of processing power and memory, and often are battery powered, thus requiring that they conserve energy by spending much of their time in sleep mode. A typical model is one where the edge devices generally form a single wireless network in which each end-node communicates directly with its parent node in a hub-and-spoke-style architecture. The parent node may be, e.g., an access point on a gateway or a sub-coordinator which is, in turn, connected to the access point or another sub-coordinator.


Each gateway is equipped with an access point (fully functional node or “F” node) that is physically attached to that access point and that provides a wireless connection point to other nodes in the wireless network. The links (illustrated by lines not numbered) shown in FIG. 1 represent direct (single-hop network layer) connections between devices. A formal networking layer (that functions in each of the three tiers shown in FIG. 1) uses a series of these direct links together with routing devices to send messages (fragmented or non-fragmented) from one device to another over the network.


The WSN 10 implements a state machine approach to an application layer that runs on the lower tier devices 18 and 20. Discussed below is an example of a particular implementation of such an approach. States in the state machine are comprised of sets of functions that execute in coordination, and these functions can be individually deleted or substituted or added to in order to alter the states in the state machine of a particular lower tier device.


The WSN state function based application layer uses an edge device operating system (not shown, but such as disclosed in the above mentioned provisional application) that allows for loading and execution of individual functions (after the booting of the device) without rebooting the device (so-called “dynamic programming”). In other implementations, edge devices could use other operating systems provided such systems allow for loading and execution of individual functions (after the booting of the device) preferable without rebooting of the edge devices.


Referring now to FIG. 2 a process 30 that executes on one or more computers disposed within the distributed network 10 is shown. In alternative arrangements, the process 30 can be used in any other arrangement besides the distributed network 10 described above provided that video data and sensed credential data are supplied to the computer(s). The process 30 correlates sensory input from credentials or badges that use technologies such as RFID, Bluetooth low energy (BLE), MAC addresses from cell phones, NFC, etc. with captured video.


The process 30 executes on the one or more computers, and receives 32 sensory inputs from credentials or badges within a monitored premises. Sensors such as some of the nodes in FIG. 1 sense the presence of a credential tag typically carried by an individual passing through a range of the sensor. These sensors receive signals from badge/tag devices that incorporate circuitry operative using radio frequency identification (RFID), Bluetooth® low energy peer to peer devices, MAC addresses from cell phones, and near field communication (NFC) devices operative using a set of standards for smartphones and similar devices to establish radio communication with each other by touching them together or bringing them into proximity, etc. that are dispersed throughout a monitored premises. The process 30 also receives 34 video information from cameras and other image capture devices that are disposed throughout the premises. The process 30 continually applies one or more algorithms to detect the presence of a possible non-credentialed individual to continually correlate the received sensory inputs from these credentials or badges, etc. with the received video.


The process 30 seeks to track individuals, especially individuals without valid credentials or badges for a particular monitored area. The process 30 applies one or more algorithms that detect the presence of a possible non-credentialed individual, tracks 38 at least the non-credentialed individual, alerts 40 authorities of the presence of a non-credentialed individual within the premises, and continually processing of inputs to isolate tracking of the non-credentialed individual to a particular, e.g., pinpoint location and alert 42 authorities to the isolated location of the non-credentialed individual.


During processing in FIG. 2, various ones of the nodes in FIG. 1 can be brought to bear on tracking of the non-credentialed individual or generally tracking of credentialed individuals. Thus, the servers of FIG. 1 or other systems can generate updates to functions (not shown) that are performed at the lower tiers, these nodes can receive 46 these new or updated functions and apply 48 the changed function to processing of FIG. 2.


Referring now to FIG. 3 an example of algorithmic processing 60 for the tracking process 30 of FIG. 3, is shown. Cameras dispersed without the premises being monitored. Generally, the processing 36 of FIG. 2 is shown with details. One camera in an area captures video and applies 62 video recognition to frames of captured video. The video recognition is used to recognize features that correspond to, e.g., individuals appearing in the captured frames. The video recognition determines a number of people with the image, where the image is correlated to the area captured by the camera. At this junction the video recognition that is applied can be rather coarse to conserve processing or allow such processing to be performed at nodes within the lower tier, as it merely needs to find features that correspond to a number of individuals.


A remote badge reader that can be one of the nodes in the network 10 has a range that coincides, or overlaps or otherwise can be correlated to the area that was captured in the video frames. This remote badge reader and camera can be considered as a current set.


The computer(s) receives 64 badge/tag data from those individuals that are within the range of operation of the badge reader. The remote badge reader and/or computer(s) determines 66 the number of badged individuals that pass through the region within the range of operation of the remote badge reader. If the area captured by the remote badge reader coincides with the area captured by the camera, this data can be processed, otherwise they may be some correlation (not shown) need to correlate the area captured in the video frames with the area within the range of the card reader.


The computer compares the number of recognized individuals in frames to the number of received badges from the reader. If the process 60 determines that there is a mismatch between the number of individuals in the area and a number of badges (or credentials), the process 60 continues (generally, the processing 38 of FIG. 2) to track 68 all of those individuals and their movements throughout the premises by continually applying 62 video recognition to frames of captured video, receive 64 badge/tag and determining 66 the number of badged individuals that pass through the region within the range of badge readers with respect to the number of recognized individuals, using either the current set of cameras/readers or different sets of cameras/readers, as needed. At this juncture, the process could send requests for updated algorithms, as is discussed below for both the overall process (as in FIG. 2) or to update nodes for different node-level processing and sensing (FIG. 3).


The process 60 correlates the paths taken by different individuals with different readings of valid credentials or badges from the same or different sets of cameras/readers.


For example, at this junction more sophisticated recognition algorithms, e.g., facial recognition, etc. can be used. In addition, processing algorithms can be sent to other nodes in the network to train process on the tracked individuals where the nodes that are send these algorithms are selected based on an estimation or prediction of direction/paths of travel through the premises.


At some point as individuals come and go, a non-badged/credentialed individual can be isolated individually or to a small group, and then the process will focus tracking on that individual. At any point in processing where there is a discrepancy an alarm can be raised. As the process detects the presence of new individuals and detects the departure of previously tracked individuals from the group of individuals, the process is still continually tracking the one or more individuals without valid credentials. Newly added individuals can be recognized in the video captured, especially if more intensive algorithms are used, and departing individuals can be noted by a valid reading of their tags/credentials. If an individual departs without a valid tag read, when is should have been read, that person is most likely the non-credentialed individual.


As previously mentioned, using the network 10 of FIG. 1, it is possible during processing that various ones of the nodes in FIG. 1 are brought to bear on tracking of FIG. 2. Thus, the servers of FIG. 1 or other systems can generate updates to functions (not shown) that are performed at the lower tiers e.g., such nodes. These nodes at the lower tier receive 46 these new or updated functions and apply 48 the changed function to the processing performed by the nodes within processing of FIG. 2.


Examples of updated processing include sending more sophisticated recognition algorithms to video cameras or nodes that process the video information. Other examples are that certain ones of the nodes in FIG. 1 can be IP address reading sensors that are brought to bear on tracking of the non-credentialed individual or generally tracking of credentialed individuals.


Thus, the servers of FIG. 1 or other systems can generate updates to functions (not shown) that are performed at the lower tiers, these nodes can receive 46 these new or updated functions and apply 48 the changed function to processing of FIG. 2. As previously tracked individuals the depart, card readers can determine/sense credentials and the process can determine if they were validly credentialed and if so, terminate tracking on those departed individuals. On the other hand as new tracked individuals join, card readers can determine/sense credentials and the process can determine if they are validly credentialed and if so, terminate tracking on those new individuals. At some point the non-credentialed individual can be isolated to one or a few individuals, and his/their location(s) identified. The process produces and sends a message that notifies authorities to physically intervene with the message including available location information.


The nodes may be implemented using any appropriate type of computing device, such as a mainframe work station, a personal computer, a server, a portable computing device, or any other type of intelligent device capable of executing instructions, connecting to a network, and forwarding data packets through the network. The nodes can execute any appropriate computer programs to generate, receive, and transmit data packets for use on the network.



FIG. 4 shows an example of a security system having features of the WSN described with respect to FIGS. 1 to 3 and having the various functionalities described herein. As shown in FIG. 4, correlation processing receives inputs from certain constrained nodes (although these can also be fully functional nodes). These inputs may include credential information and video information, and the correlation processing may produce correlated results that are sent over the network. Context management processing receives inputs from certain constrained nodes (although these can also be fully functional nodes) e.g., credential information and video and grouping information, and performs context processing with results sent over the network. The network supports operation of emergency exit indicators; emergency cameras as well as distributed rule processing and rule engine/messaging processing. Range extenders are used with e.g., gateways, and a real time location system receives inputs from various sensors (e.g., constrained type) as shown. Servers interface to the WSN via a cloud computing configuration and parts of some networks can be run as sub-nets.


The sensors provide in addition to an indication that something is detected in an area within the range of the sensors, detailed additional information that can be used to evaluate what that indication may be without the intrusion detection panel being required to perform extensive analysis of inputs to the particular sensor.


For example, a motion detector could be configured to analyze the heat signature of a warm body moving in a room to determine if the body is that of a human or a pet. Results of that analysis would be a message or data that conveys information about the body detected. Various sensors thus are used to sense sound, motion, vibration, pressure, heat, images, and so forth, in an appropriate combination to detect a true or verified alarm condition at the intrusion detection panel.


Recognition software can be used to discriminate between objects that are a human and objects that are an animal; further facial recognition software can be built into video cameras and used to verify that the perimeter intrusion was the result of a recognized, authorized individual. Such video cameras would comprise a processor and memory and the recognition software to process inputs (captured images) by the camera and produce the metadata to convey information regarding recognition or lack of recognition of an individual captured by the video camera. The processing could also alternatively or in addition include information regarding characteristic of the individual in the area captured/monitored by the video camera. Thus, depending on the circumstances, the information would be either metadata received from enhanced motion detectors and video cameras that performed enhanced analysis on inputs to the sensor that gives characteristics of the perimeter intrusion or a metadata resulting from very complex processing that seeks to establish recognition of the object.


Sensor devices can integrate multiple sensors to generate more complex outputs so that the intrusion detection panel can utilize its processing capabilities to execute algorithms that analyze the environment by building virtual images or signatures of the environment to make an intelligent decision about the validity of a breach.


Memory stores program instructions and data used by the processor of the intrusion detection panel. The memory may be a suitable combination of random access memory and read-only memory, and may host suitable program instructions (e.g. firmware or operating software), and configuration and operating data and may be organized as a file system or otherwise. The stored program instruction may include one or more authentication processes for authenticating one or more users. The program instructions stored in the memory of the panel may further store software components allowing network communications and establishment of connections to the data network. The software components may, for example, include an internet protocol (IP) stack, as well as driver components for the various interfaces, including the interfaces and the keypad. Other software components suitable for establishing a connection and communicating across network will be apparent to those of ordinary skill.


Program instructions stored in the memory, along with configuration data may control overall operation of the panel.


The monitoring server includes one or more processing devices (e.g., microprocessors), a network interface and a memory (all not illustrated). The monitoring server may physically take the form of a rack mounted card and may be in communication with one or more operator terminals (not shown). An example monitoring server is a SURGARD™ SG-System III Virtual, or similar system.


The processor of each monitoring server acts as a controller for each monitoring server, and is in communication with, and controls overall operation, of each server. The processor may include, or be in communication with, the memory that stores processor executable instructions controlling the overall operation of the monitoring server. Suitable software enable each monitoring server to receive alarms and cause appropriate actions to occur. Software may include a suitable Internet protocol (IP) stack and applications/clients.


Each monitoring server of the central monitoring station may be associated with an IP address and port(s) by which it communicates with the control panels and/or the user devices to handle alarm events, etc. The monitoring server address may be static, and thus always identify a particular one of monitoring server to the intrusion detection panels. Alternatively, dynamic addresses could be used, and associated with static domain names, resolved through a domain name service.


The network interface card interfaces with the network to receive incoming signals, and may for example take the form of an Ethernet network interface card (NIC). The servers may be computers, thin-clients, or the like, to which received data representative of an alarm event is passed for handling by human operators. The monitoring station may further include, or have access to, a subscriber database that includes a database under control of a database engine. The database may contain entries corresponding to the various subscriber devices/processes to panels like the panel that are serviced by the monitoring station.


All or part of the processes described herein and their various modifications (hereinafter referred to as “the processes”) can be implemented, at least in part, via a computer program product, i.e., a computer program tangibly embodied in one or more tangible, physical hardware storage devices that are computer and/or machine-readable storage devices for execution by, or to control the operation of, data processing apparatus, e.g., a programmable processor, a computer, or multiple computers. A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.


Actions associated with implementing the processes can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the processes can be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) and/or an ASIC (application-specific integrated circuit).


Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only storage area or a random access storage area or both. Elements of a computer (including a server) include one or more processors for executing instructions and one or more storage area devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from, or transfer data to, or both, one or more machine-readable storage media, such as mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks.


Tangible, physical hardware storage devices that are suitable for embodying computer program instructions and data include all forms of non-volatile storage, including by way of example, semiconductor storage area devices, e.g., EPROM, EEPROM, and flash storage area devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks and volatile computer memory, e.g., RAM such as static and dynamic RAM, as well as erasable memory, e.g., flash memory.


In addition, the logic flows depicted in the figures do not require the particular order shown, or sequential order, to achieve desirable results. In addition, other actions may be provided, or actions may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Likewise, actions depicted in the figures may be performed by different entities or consolidated.


Elements of different embodiments described herein may be combined to form other embodiments not specifically set forth above. Elements may be left out of the processes, computer programs, Web pages, etc. described herein without adversely affecting their operation. Furthermore, various separate elements may be combined into one or more individual elements to perform the functions described herein.


Other implementations not specifically described herein are also within the scope of the following claims.

Claims
  • 1. An intrusion system comprising: one or more computing devices, the one or more computing devices comprising one or more processor devices and one or more memory devices in communication with the one or more processor devices, wherein the one or more processor devices are configured to: receive from reader devices, sensory inputs associated with credentials or badges, wherein the reader devices are associated with one or more first areas of a monitored premises;receive video data from camera devices, wherein the video data comprises a video feed of the one or more first areas and one or more second areas of the monitored premises;correlate the sensory inputs of the reader devices with the video data of the camera devices;determine from the sensory inputs, a number of the credentials or the badges within the one or more first areas of the monitored premises;determine from the video data, a number of individuals within the one or more first areas of the monitored premises;track a group of individuals based on the video data in response to a determination that the group of individuals have moved from the one or more first areas to the one or more second areas and in response to a determination that the number of the credentials or the badges does not match the number of the individuals;determine that a first individual of the group of individuals is an authorized individual by determining, based on the video data and first sensory inputs of the reader devices, that the first individual has departed the monitored premises with a first authorized credential or a first authorized badge;determine that a second individual of the group of individuals is unauthorized by determining, based on the video data and data of the reader devices, that the second individual has departed the monitored premises without an authorized credential or an authorized badge; anddetermine that one or more remaining individuals of the group of individuals that are within the monitored premises are unauthorized individuals based on the first individual of the group of individuals being the authorized individual and the second individual of the group of individuals being unauthorized.
  • 2. The system of claim 1, wherein the one or more processor devices are configured to: apply one or more recognition algorithms to the video data to coarsely recognize features identifying the number of the individuals; andproduce an alert to send a control center to alert authorities to a particular location of a non-credentialed individual, the particular location being based on device locations of the camera devices and the reader devices.
  • 3. The system of claim 1, wherein the one or more processor devices are configured to apply video recognition to identify the number of the individuals.
  • 4. The system of claim 3, wherein the one or more processor devices are configured to determine a mismatch between the number of the individuals and the number of the credentials or the badges.
  • 5. The system of claim 4, wherein the one or more processor devices are configured to: continually track the group of individuals and movements of the group of individuals throughout the monitored premises; andcorrelate the movements of the group of individuals with different readings of valid credentials or valid badges to isolate the unauthorized individuals.
  • 6. The system of claim 1, wherein the one or more computing devices include an application layer configured to execute routines to provide node functions, the application layer operating under an operating system allowing loading and execution of individual node functions after an initial booting of the one or more computing devices without requiring a rebooting of the one or more computing devices to execute routines dynamically changed after the initial booting of the one or more computing devices.
  • 7. The system of claim 1, wherein the system receives updated routines from server systems, the updated routines being updates for recognition algorithms.
  • 8. The system of claim 1, wherein the system comprises a plurality of nodes, wherein at least one of the plurality of nodes is configured to: apply video recognition to frames of captured video to recognize features that correspond to the individuals appearing in the captured video; anddetermine the number of the individuals within the frames.
  • 9. The system of claim 8, wherein the at least one of the plurality of nodes is configured to update a video recognition algorithm configured to recognize the features that correspond to the number of individuals.
  • 10. The system of claim 1, configured to correlate paths taken by different individuals with different readings of valid credentials or valid badges from same or different sets of the reader devices and the camera devices.
  • 11. A security system of a building, the system comprising: a network comprising a plurality of computing device nodes, wherein each of the plurality of computing device nodes comprises one or more processor devices and one or more memory devices in communication with the one or more processor devices, the network of the plurality of computing device nodes executing an application layer to perform node functions, wherein the network of the plurality of computing device nodes is configured to: receive from reader device nodes, sensory inputs associated with credentials or badges, wherein the reader device nodes are associated with one or more first areas of the building;receive video data information from camera device nodes, wherein the video data comprises a video feed of the one or more first areas and one or more second areas of the building;correlate the sensory inputs of the reader device nodes with the video data of the camera device nodes;determine from the sensory inputs, a number of the credentials or the badges within the building;determine from the video data, a number of individuals within the one or more first areas of the building;track a group of individuals based on the video data in response to a determination that the group of individuals have moved from the one or more first areas to the one or more second areas and in response to a determination that the number of the credentials or the badges does not match the number of the individuals;determine that a first individual of the group of individuals is an authorized individual by determining, based on the video data and first sensory inputs of the reader device nodes that the first individual has departed the building with a first authorized credential or a first authorized badge;determine that a second individual of the group of individuals is unauthorized by determining, based on the video data and data of the reader device nodes, that the second individual has departed the building without an authorized credential or an authorized badge; anddetermine that one or more remaining individuals of the group of individuals that are within the building are unauthorized individuals based on the first individual of the group of individuals being the authorized individual and the second individual of the group of individuals being unauthorized.
  • 12. The system of claim 11, wherein the network of the plurality of computing device nodes is configured to dynamically change first algorithms configured to detect presence of a particular number of the individuals to second algorithms configured to apply video recognition to recognize the individuals.
  • 13. The system of claim 11, wherein one or more computing device nodes of the plurality of computing device nodes are configured to dynamically update a video recognition algorithm to find features to a particular number of the individuals.
  • 14. The system of claim 11, wherein the network of the plurality of computing device nodes is configured to: dynamically change recognition algorithms; andcorrelate paths taken by different individuals with different readings of valid credentials or valid badges from a same or different set of the camera device nodes and the reader device nodes.
  • 15. The system of claim 11, wherein the network of the plurality of computing device nodes is configured to dynamically change one or more algorithms of one or more of the plurality of computing device nodes while tracking the group of individuals by the one or more of the plurality of computing device nodes by executing an operating system allowing loading and execution of individual algorithms after an initial booting stage without requiring a rebooting of the one or more of the plurality of computing device nodes to dynamically change the one or more algorithms.
  • 16. A method of a security system of a monitored premises, the method comprising: receiving, by one or more processing circuits, from reader devices, sensory inputs associated with credentials or badges, wherein the reader devices are associated with one or more first areas of the monitored premises;receiving, by the one or more processing circuits, video data from camera devices, wherein the video data comprises a video feed of the one or more first areas and one or more second areas of the monitored premises;determining, by the one or more processing circuits, from the sensory inputs, a number of the credentials or the badges within the one or more first areas of the monitored premises;determining, by the one or more processing circuits, from the video data, a number of individuals within the one or more first areas of the monitored premises;tracking, by the one or more processing circuits, a group of individuals based on the video data in response to a determination that the group of individuals have moved from the one or more first areas to the one or more second areas and in response to a determination that the number of the credentials or the badges does not match the number of the individuals;determine that a first individual of the group of individuals is an authorized individual by determining, based on the video data and first sensory inputs of the reader devices, that the first individual has departed the monitored premises with a first authorized credential or a first authorized badge;determining, by the one or more processing circuits, that a second individual of the group of individuals is unauthorized by determining, based on the video data and data of the reader devices, that the second individual has departed the monitored premises without an authorized credential or an authorized badge; anddetermining, by the one or more processing circuits, that one or more remaining individuals of the group of individuals that are within the monitored premises are unauthorized individuals based on the first individual of the group of individuals being the authorized individual and the second individual of the group of individuals being unauthorized.
  • 17. The method of claim 16, comprising: receiving, by the one or more processing circuits, updated operating routines from server systems, the updated routines updating object based image recognition algorithms executed by the one or more processing circuits.
  • 18. The method of claim 16, comprising: executing, by the one or more processing circuits, an application layer for one or more devices to provide node functions, with the application layer operating under an operating system allows for loading and execution of individual node functions after an initial booting of the one or more devices without requiring a rebooting of the one or more devices to execute routines dynamically changed after the initial booting of the one or more devices.
  • 19. The method of claim 16, comprising: applying, by the one or more processing circuits, one or more recognition algorithms to the video data to coarsely recognize features to identify the number of the individuals; andproducing, by the one or more processing circuits, an alert to send a control center to alert authorities to a particular location of a non-credentialed individual, the particular location being based on device locations of the camera devices and the reader devices.
  • 20. The method of claim 19, comprising: continually tracking, by the one or more processing circuits, the group of individuals and movements of the group of individuals throughout the monitored premises; andcorrelating, by the one or more processing circuits, the movements of the group of individuals with different readings of valid credentials or valid badges to isolate the unauthorized individuals.
CLAIM OF PRIORITY

This application claims priority under 35 U.S.C. § 119(e) to provisional U.S. Patent Application 61/973,962, filed on Apr. 2, 2014, entitled: “Wireless Sensor Network”, and provisional U.S. Patent Application 61/946,054, filed on Feb. 28, 2014, entitled: “Wireless Sensor Network”, the entire contents of which are hereby incorporated by reference.

US Referenced Citations (404)
Number Name Date Kind
4581634 Williams Apr 1986 A
5406327 Guarnotta Apr 1995 A
5414812 Filip et al. May 1995 A
5727055 Ivie et al. Mar 1998 A
5977913 Christ Nov 1999 A
6012150 Bartfai et al. Jan 2000 A
6032239 Beelitz Feb 2000 A
6112237 Donaldson et al. Aug 2000 A
6208247 Agre et al. Mar 2001 B1
6272621 Key et al. Aug 2001 B1
6313549 Moisan et al. Nov 2001 B1
6335688 Sweatte Jan 2002 B1
6513108 Kerr et al. Jan 2003 B1
6531963 Nyfelt Mar 2003 B1
6636900 Abdelnur Oct 2003 B2
6658234 Dogan et al. Dec 2003 B1
6741165 Langfahl et al. May 2004 B1
6757008 Smith Jun 2004 B1
6771385 Iizuka et al. Aug 2004 B1
6804790 Rhee et al. Oct 2004 B2
6812970 McBride Nov 2004 B1
6836843 Seroussi et al. Dec 2004 B2
6838992 Tenarvitz Jan 2005 B2
6867683 Calvesio et al. Mar 2005 B2
6873260 Lancos et al. Mar 2005 B2
6888459 Stilp May 2005 B2
6924732 Yokoo Aug 2005 B2
6933849 Sawyer Aug 2005 B2
6952574 Tealdi et al. Oct 2005 B2
6970183 Monroe Nov 2005 B1
6972683 Lestienne et al. Dec 2005 B2
6976032 Hull et al. Dec 2005 B1
7003291 Zhnag Feb 2006 B2
7005971 Stewart et al. Feb 2006 B2
7017171 Horlander et al. Mar 2006 B1
7028018 Kocher Apr 2006 B2
7176808 Broad et al. Feb 2007 B1
7212563 Boyd et al. May 2007 B2
7222239 Smith May 2007 B2
7286158 Griebenow Oct 2007 B1
7295106 Jackson Nov 2007 B1
7313399 Rhee et al. Dec 2007 B2
7327251 Corbett, Jr. Feb 2008 B2
7365645 Heinze et al. Apr 2008 B2
7382895 Bramblet Jun 2008 B2
7441043 Henry et al. Oct 2008 B1
7474330 Wren et al. Jan 2009 B2
7477154 Braunstein Jan 2009 B2
7512406 Dorfman Mar 2009 B2
7525594 Tatamiya et al. Apr 2009 B2
7535687 Costa May 2009 B2
7545326 Caliri et al. Jun 2009 B2
7564357 Baranowski et al. Jul 2009 B2
7636046 Caliri et al. Dec 2009 B2
7664481 Braunstein Feb 2010 B2
7688808 Ren et al. Mar 2010 B2
7689221 Gazzard Mar 2010 B1
7705736 Kedziora Apr 2010 B1
7756828 Baron et al. Jul 2010 B2
7804849 Mahany et al. Sep 2010 B2
7834766 Sawyer Nov 2010 B2
7855635 Cohn et al. Dec 2010 B2
7884712 Nierenberg et al. Feb 2011 B2
7899006 Boyd Mar 2011 B2
7907053 Wildman et al. Mar 2011 B2
7907753 Wilson et al. Mar 2011 B2
7908020 Pieronek Mar 2011 B2
7916026 Johnson et al. Mar 2011 B2
7920843 Martin et al. Apr 2011 B2
7956746 Truscott et al. Jun 2011 B2
7966660 Yermal et al. Jun 2011 B2
7978082 Braunstein Jul 2011 B2
8009034 Dobson et al. Aug 2011 B2
8073964 Dunk Dec 2011 B2
8089910 Doh et al. Jan 2012 B2
8107397 Bagchi et al. Jan 2012 B1
8115622 Stolarczyk et al. Feb 2012 B2
8115862 Umeyama et al. Feb 2012 B2
8310364 Harry et al. Feb 2012 B2
8149849 Osborn et al. Apr 2012 B2
8164443 Alston et al. Apr 2012 B2
8171524 Micali et al. May 2012 B2
8207814 Biles et al. Jun 2012 B2
8260893 Bandhole et al. Sep 2012 B1
8305196 Kennedy et al. Nov 2012 B2
8305842 Holdsworth Nov 2012 B2
8311558 Davidson et al. Nov 2012 B2
8319635 Perkins et al. Nov 2012 B2
8331544 Kraus et al. Dec 2012 B2
8335164 Liu Dec 2012 B2
8350700 Fast et al. Jan 2013 B2
8380558 Sharma et al. Feb 2013 B1
8390442 Burns et al. Mar 2013 B2
8395494 Trundle et al. Mar 2013 B2
8400268 Malik et al. Mar 2013 B1
8406480 Grigsby et al. Mar 2013 B2
8428550 Larsen Apr 2013 B2
8457656 Perkins et al. Jun 2013 B2
8463619 Scarola Jun 2013 B2
8467763 Martin et al. Jun 2013 B2
8477687 Iwasa Jul 2013 B2
8487762 McMullen et al. Jul 2013 B1
8488589 Rudnick et al. Jul 2013 B2
8499164 Ortiz et al. Jul 2013 B2
8502644 Newman et al. Aug 2013 B1
8502670 Cha et al. Aug 2013 B2
8525665 Trundle et al. Sep 2013 B1
8527640 Reisman Sep 2013 B2
8537714 Liu Sep 2013 B2
8559344 Abusch-Magder et al. Oct 2013 B2
8566413 Horvitz Oct 2013 B2
8572290 Mukhopadhyay et al. Oct 2013 B1
8572600 Chung et al. Oct 2013 B2
8572677 Bartholomay et al. Oct 2013 B2
8578153 Johansson et al. Nov 2013 B2
8582431 Johansen Nov 2013 B2
8587670 Wood et al. Nov 2013 B2
8599011 Schantz et al. Dec 2013 B2
8611323 Berger et al. Dec 2013 B2
8618916 Gravelle et al. Dec 2013 B2
8624733 Cusack, Jr. Jan 2014 B2
8629755 Hashim-Waris Jan 2014 B2
8630820 Amis Jan 2014 B2
8633803 Mo et al. Jan 2014 B2
8633829 Cavanaugh Jan 2014 B2
8634788 Wright et al. Jan 2014 B2
8635126 Risnoveanu et al. Jan 2014 B2
8643719 Vian et al. Feb 2014 B2
8644165 Saarimaki et al. Feb 2014 B2
8659417 Trundle et al. Feb 2014 B1
8659420 Salvat, Jr. Feb 2014 B2
8667571 Raleigh Mar 2014 B2
8670873 Shloush et al. Mar 2014 B2
8675920 Hanson et al. Mar 2014 B2
8676930 Foisy Mar 2014 B2
8682541 Best et al. Mar 2014 B2
8686851 Davis Apr 2014 B2
8689290 Buer Apr 2014 B2
8694275 Wang et al. Apr 2014 B2
8696430 Wells Apr 2014 B2
8699377 Veillette Apr 2014 B2
8700747 Spitaels et al. Apr 2014 B2
8700749 Elliott et al. Apr 2014 B2
8707397 Wilkinson et al. Apr 2014 B1
8707431 Stephens et al. Apr 2014 B2
8711197 Dickerson et al. Apr 2014 B2
8711704 Werb et al. Apr 2014 B2
8715178 Price et al. May 2014 B2
8723972 Hinkel et al. May 2014 B2
8725175 Altman et al. May 2014 B2
8727225 Zumsteg et al. May 2014 B2
8730838 Liang et al. May 2014 B2
8731689 Platner et al. May 2014 B2
8732255 Odio et al. May 2014 B2
8732292 Tokunaga et al. May 2014 B2
8737957 Raleigh May 2014 B2
8739176 Darling May 2014 B1
8742908 Boudy Jun 2014 B2
8742929 Sawyer Jun 2014 B2
8750513 Renkis Jun 2014 B2
8752106 Renkis Jun 2014 B2
8848721 Turunen et al. Sep 2014 B2
8989053 Skaaksrud et al. Mar 2015 B1
9037152 Herrera et al. May 2015 B1
9277352 Ward Mar 2016 B1
9384607 Copeland Jul 2016 B1
9892574 Schlechter Feb 2018 B2
9905101 Billau Feb 2018 B1
9996997 Lambert Jun 2018 B2
10282852 Buibas May 2019 B1
10692364 Rao Jun 2020 B1
11024105 Brand Jun 2021 B1
20020057204 Bligh May 2002 A1
20020067259 Fufidio Jun 2002 A1
20020113879 Battle et al. Aug 2002 A1
20020121979 Smith Sep 2002 A1
20030023874 Prokupets Jan 2003 A1
20030043763 Grayson Mar 2003 A1
20030075287 Weik, III Apr 2003 A1
20030086591 Simon May 2003 A1
20030097464 Martinez et al. May 2003 A1
20030097586 Mok May 2003 A1
20030099221 Rhee May 2003 A1
20030169337 Wilson Sep 2003 A1
20030187612 Miyake Oct 2003 A1
20030216144 Roese et al. Nov 2003 A1
20040017929 Bramblet Jan 2004 A1
20040027242 Venetianer Feb 2004 A1
20040027243 Carrender Feb 2004 A1
20040090329 Hitt May 2004 A1
20040103164 Tabuchi et al. May 2004 A1
20040103165 Nixon et al. May 2004 A1
20040105006 Lazo Jun 2004 A1
20040109059 Kawakita Jun 2004 A1
20040135694 Nyfelt Jul 2004 A1
20040153671 Schuyler Aug 2004 A1
20040169587 Washington Sep 2004 A1
20040199785 Pederson Oct 2004 A1
20050018049 Falk Jan 2005 A1
20050052281 Bann Mar 2005 A1
20050104727 Han May 2005 A1
20050143133 Bridgelall Jun 2005 A1
20050162515 Venetianer Jul 2005 A1
20050179553 Fujie Aug 2005 A1
20060022816 Yukawa Feb 2006 A1
20060031838 Chrabieh Feb 2006 A1
20060035205 Dobson Feb 2006 A1
20060039356 Rao Feb 2006 A1
20060047666 Bedi et al. Mar 2006 A1
20060059557 Markham et al. Mar 2006 A1
20060064477 Renkis Mar 2006 A1
20060143439 Arumugam et al. Jun 2006 A1
20060171570 Brendley et al. Aug 2006 A1
20060240818 McCoy et al. Oct 2006 A1
20060258427 Rowe et al. Nov 2006 A1
20060268901 Choyi et al. Nov 2006 A1
20060282886 Gaug Dec 2006 A1
20060285579 Rhee et al. Dec 2006 A1
20070011683 Helander Jan 2007 A1
20070013776 Venetianer Jan 2007 A1
20070018826 Nowak et al. Jan 2007 A1
20070028119 Mirho Feb 2007 A1
20070040672 Chinigo Feb 2007 A1
20070058634 Gupta et al. Mar 2007 A1
20070073861 Amanuddin et al. Mar 2007 A1
20070086626 Mariani Apr 2007 A1
20070093975 Hoogenboom Apr 2007 A1
20070094716 Farino et al. Apr 2007 A1
20070106775 Wong May 2007 A1
20070112574 Greene May 2007 A1
20070112943 Fisher et al. May 2007 A1
20070130589 Davis et al. Jun 2007 A1
20070136102 Rodgers Jun 2007 A1
20070147425 Lamoureux et al. Jun 2007 A1
20070176779 Braunstein Aug 2007 A1
20070182818 Buehler Aug 2007 A1
20070185788 Dillon Aug 2007 A1
20070186106 Ting et al. Aug 2007 A1
20070198997 Jacops et al. Aug 2007 A1
20070223451 Ren et al. Sep 2007 A1
20070226314 Eick et al. Sep 2007 A1
20070239350 Zumsteg et al. Oct 2007 A1
20070248065 Banerjea et al. Oct 2007 A1
20070252001 Kail Nov 2007 A1
20070260470 Bornhoevd et al. Nov 2007 A1
20080002599 Yau et al. Jan 2008 A1
20080010631 Harvey et al. Jan 2008 A1
20080056261 Osborn et al. Mar 2008 A1
20080068150 Nguyen et al. Mar 2008 A1
20080068267 Huseth Mar 2008 A1
20080083018 Prokupets Apr 2008 A1
20080100704 Venetianer May 2008 A1
20080130949 Ivanov Jun 2008 A1
20080136620 Lee et al. Jun 2008 A1
20080137624 Silverstrim et al. Jun 2008 A1
20080144587 Gupta et al. Jun 2008 A1
20080186180 Butler et al. Aug 2008 A1
20080204267 Luterotti et al. Aug 2008 A1
20080246613 Linstrom Oct 2008 A1
20080259919 Monga Oct 2008 A1
20080291017 Yermal et al. Nov 2008 A1
20080291855 Bata et al. Nov 2008 A1
20080297346 Brackmann et al. Dec 2008 A1
20090002155 Ma Jan 2009 A1
20090021634 Chang Jan 2009 A1
20090027225 Farley Jan 2009 A1
20090115570 Cusack, Jr. May 2009 A1
20090135007 Donovan et al. May 2009 A1
20090135762 Veillette May 2009 A1
20090146833 Lee et al. Jun 2009 A1
20090153333 Zhang et al. Jun 2009 A1
20090153660 Liu Jun 2009 A1
20090174547 Greene et al. Jul 2009 A1
20090179742 Takeshima Jul 2009 A1
20090222921 Mukhopadhyay et al. Sep 2009 A1
20090243844 Ishidera Oct 2009 A1
20090285213 Chen et al. Nov 2009 A1
20090319267 Kurki-Suonio Dec 2009 A1
20090322510 Berger et al. Dec 2009 A1
20100013711 Bartlett Jan 2010 A1
20100019901 Tsai Jan 2010 A1
20100026802 Titus Feb 2010 A1
20100052867 Kwok et al. Mar 2010 A1
20100061272 Veillette Mar 2010 A1
20100087188 Griff Apr 2010 A1
20100090829 Pujol Apr 2010 A1
20100124209 In et al. May 2010 A1
20100157062 Baba Jun 2010 A1
20100185773 Dunk Jul 2010 A1
20100194545 Wong Aug 2010 A1
20100194566 Monden Aug 2010 A1
20100214058 Walker Aug 2010 A1
20100217651 Crabtree et al. Aug 2010 A1
20100226342 Colling et al. Sep 2010 A1
20100238286 Boghossian Sep 2010 A1
20100295943 Cha et al. Nov 2010 A1
20100298010 Roth Nov 2010 A1
20100324958 Stiles et al. Dec 2010 A1
20100328443 Lynam Dec 2010 A1
20110001606 Charych Jan 2011 A1
20110001812 Kang Jan 2011 A1
20110035491 Gelvin et al. Feb 2011 A1
20110051656 Hethuin et al. Mar 2011 A1
20110069687 Rezvani et al. Mar 2011 A1
20110102171 Raji et al. May 2011 A1
20110109434 Hadsall, Sr. May 2011 A1
20110137614 Wheeler et al. Jun 2011 A1
20110298619 O'Hare et al. Dec 2011 A1
20110304437 Beeler et al. Dec 2011 A1
20110310779 De Poorter et al. Dec 2011 A1
20110310791 Prakash et al. Dec 2011 A1
20120008836 Bobbitt Jan 2012 A1
20120014567 Allegra Jan 2012 A1
20120038456 Pikkarainen et al. Feb 2012 A1
20120039235 Chen et al. Feb 2012 A1
20120082062 McCormack Apr 2012 A1
20120092183 Corbett et al. Apr 2012 A1
20120092502 Knasel Apr 2012 A1
20120124367 Ota et al. May 2012 A1
20120127314 Clements May 2012 A1
20120130632 Bandyopadhyay et al. May 2012 A1
20120131115 Levell et al. May 2012 A1
20120148102 Moriguchi Jun 2012 A1
20120158161 Cohn et al. Jun 2012 A1
20120159579 Pineau et al. Jun 2012 A1
20120160613 Friedli Jun 2012 A1
20120182123 Butler et al. Jul 2012 A1
20120197986 Chen et al. Aug 2012 A1
20120201472 Blanchflower et al. Aug 2012 A1
20120266168 Spivak et al. Oct 2012 A1
20120286929 Kline Nov 2012 A1
20120297049 Alexander Nov 2012 A9
20120307051 Welter Dec 2012 A1
20120310423 Taft Dec 2012 A1
20120311614 Deanna et al. Dec 2012 A1
20120324245 Sinha et al. Dec 2012 A1
20130003645 Shapira et al. Jan 2013 A1
20130035090 Moshfeghi Feb 2013 A1
20130041646 Farley et al. Feb 2013 A1
20130042314 Kelley Feb 2013 A1
20130055282 Yi Feb 2013 A1
20130064233 Hethuin et al. Mar 2013 A1
20130070745 Nixon et al. Mar 2013 A1
20130079028 Klein Mar 2013 A1
20130086195 Hiniker Apr 2013 A1
20130099919 Cai et al. Apr 2013 A1
20130117078 Weik, III May 2013 A1
20130163466 Hughes et al. Jun 2013 A1
20130219050 Park et al. Aug 2013 A1
20130239192 Linga et al. Sep 2013 A1
20130241744 Erdos et al. Sep 2013 A1
20130277430 Zumsteg et al. Oct 2013 A1
20130279409 Dublin et al. Oct 2013 A1
20130317659 Thomas et al. Nov 2013 A1
20130318529 Bishop et al. Nov 2013 A1
20130336230 Zou et al. Dec 2013 A1
20130346229 Martin et al. Dec 2013 A1
20140006165 Grigg et al. Jan 2014 A1
20140006586 Hong et al. Jan 2014 A1
20140015978 Smith Jan 2014 A1
20140035726 Schoner Feb 2014 A1
20140052463 Cashman Feb 2014 A1
20140052832 Dina et al. Feb 2014 A1
20140063256 Mongeon Mar 2014 A1
20140071837 Werb et al. Mar 2014 A1
20140112126 Claessens et al. Apr 2014 A1
20140129135 Holden et al. May 2014 A1
20140139678 Moriarty May 2014 A1
20140159910 Lee et al. Jun 2014 A1
20140173583 Follis Jun 2014 A1
20140203071 Eggert Jul 2014 A1
20140222892 Lee et al. Aug 2014 A1
20140231502 Marsico et al. Aug 2014 A1
20140253706 Noone et al. Sep 2014 A1
20140267598 Drouin Sep 2014 A1
20140285315 Wiewiora Sep 2014 A1
20140324224 Dolinshek Oct 2014 A1
20150074178 Hong et al. Mar 2015 A1
20150248299 Rasband et al. Sep 2015 A1
20150249588 Leon et al. Sep 2015 A1
20150257301 Morgan et al. Sep 2015 A1
20150287301 Locke Oct 2015 A1
20150356848 Hatch Dec 2015 A1
20160057048 Boudreaux Feb 2016 A1
20160132653 Baralay May 2016 A1
20160241815 Baxter Aug 2016 A1
20160277261 Ansari et al. Sep 2016 A9
20160293218 Hanis Oct 2016 A1
20160344841 Wang et al. Nov 2016 A1
20170193772 Kusens Jul 2017 A1
20170225321 Deyle Aug 2017 A1
20170270722 Tse Sep 2017 A1
20180107880 Danielsson Apr 2018 A1
20180130556 Dobai May 2018 A1
20180181794 Benini Jun 2018 A1
20190043281 Aman Feb 2019 A1
20190141294 Thorn May 2019 A1
20200019921 Buibas Jan 2020 A1
20200066129 Galvez Feb 2020 A1
20200394568 Chuaypradit Dec 2020 A1
20210110666 Thomas Apr 2021 A1
20210174952 Leong Jun 2021 A1
20230009081 Paripally Jan 2023 A1
20230206711 Pinheiro Jun 2023
Foreign Referenced Citations (51)
Number Date Country
1217078 May 1999 CN
1353849 Jun 2002 CN
1672060 Sep 2005 CN
1871782 Nov 2006 CN
1922576 Feb 2007 CN
1981313 Jun 2007 CN
101067843 Nov 2007 CN
101199187 Jun 2008 CN
101364734 Feb 2009 CN
101764759 Jun 2010 CN
101951341 Jan 2011 CN
101976377 Feb 2011 CN
101977124 Feb 2011 CN
102035738 Apr 2011 CN
102170360 Aug 2011 CN
102316053 Jan 2012 CN
102325075 Jan 2012 CN
102438333 May 2012 CN
102665196 Sep 2012 CN
202475489 Oct 2012 CN
103139019 Jun 2013 CN
103170071 Jun 2013 CN
203057531 Jul 2013 CN
103282886 Sep 2013 CN
203368600 Dec 2013 CN
103813408 May 2014 CN
104168648 Nov 2014 CN
724235 Jul 1996 EP
0 814 393 Dec 1997 EP
1 718 095 Nov 2006 EP
1 885 039 Feb 2008 EP
1 885 039 Feb 2008 EP
2 037 426 Mar 2009 EP
2005-292942 Oct 2005 JP
2007193558 Aug 2007 JP
2008-090861 Apr 2008 JP
10-2005-0054914 Apr 2007 KR
10-2007-0105430 Oct 2007 KR
10-2013-0143262 Dec 2013 KR
WO-0106401 Jan 2001 WO
WO-0126329 Apr 2001 WO
WO-2004068855 Aug 2004 WO
WO-2007002763 Jan 2007 WO
WO-2007018523 Feb 2007 WO
WO-2008139203 Nov 2008 WO
WO-2009017687 Feb 2009 WO
WO-2009079036 Jun 2009 WO
WO-2012138133 Oct 2012 WO
WO-2013091678 Jun 2013 WO
WO-201 3159217 Oct 2013 WO
WO-2015130654 Sep 2015 WO
Non-Patent Literature Citations (160)
Entry
International Search Report and Written Report, PCT/US/15/17450.
Chinese Office Action dated May 30, 2018 in corresponding application No. 201580016948.9.
Cheng, Research on AODV Routing Protocol of Wireless Network, Chinese Master's Theses Full-Text Database, Information Technology Division, Jul. 15, 2007, 79 pages.
First Office Action for Chinese Application No. 201580015282.5, dated Sep. 4, 2018, 18 pages.
Office Action for U.S. Appl. No. 15/402,423, dated Jul. 26, 2018, 10 pages.
Office Action for Chinese Application No. 201580013946.4, dated Jul. 31, 2018, 15 pages.
Office Action on U.S. Appl. No. 15/366,036 dated May 31, 2018. 5 pages.
U.S. Appl. No. 61/946,054.
U.S. Appl. No. 61/973,962.
Asada et al, Wireless Integrated Network Sensors (WINS) Proceedings of the Spie, Spie, Bellingham, VA, vol. 3673, dated Mar. 1, 1999, pp. 11-18.
Atchley, Scott, Routing Heterogeneous CCI Subnets, 2013 8 pages.
Bhatti et al., MANTIS OS: An Embedded Multithreaded Operating System for Wireless Micro Sensor Platforms, Aug. 1, 2005, 14 pages.
C. Perkins et al: Ad hoc On-Demand Distance Vector (AODV) Routing, RFC3561, Jul. 2007(Jul. 1, 2007), pp. 1-37.
Communication pursuant to Article 94(3) EPC, 15754691.2, Tyco Fire & Security GmbH, Dec. 9, 2018.
Depoorter, Eli, et al., Enabling Direct Connectivity Between Heterogeneous Objections in the Internet of Things Through a Network Service Oriented Architecture, http://jwcn.eurasigjournals.com/content/pdf/1687-1499-2011-61.pdf, dated Aug. 31, 2011, 14 pages.
Dong et al., “SenSpire OS: A Predictable, Flexible, and Efficient Operating System for Wireless Sensor Networks,” IEEE Transactions on Computers, IEEE, USA, vol. 60, No. 12, Dec. 1, 2011, pp. 1788-1801.
Dunkels et al., “Contiki—a lightweight and flexible operating system for tiny networked sensors”, Computational Systems Bioinformatics Conference, 2004. CSB 2004. Proceedings. 2004 IEEE Tampa, FL, USA, Nov. 16-18, 2004, Los Alamitos, CA, USA, IEEE (Comput. Soc, US), Nov. 16, 2004, pp. 455-462.
Eugster et al., “The many faces of publish/subscribe,” ACM computing surveys (CSUR) 35.2, 2003, pp. 114-131.
Examination Report for European Application No. 15754691.2, dated Sep. 12, 2018, 7 pages.
Extended European Search Report on EP 15755330.6, dated Oct. 25, 2017, 11 pages.
FIREWALL.CX Subnet Routing & Communications, http://www.firewall.cx/networkinq-topics/protocols/ip-subnettinq/170-subnetting-routing.html, 2000-2014, 9 pages.
Galos et al., “Dynamic reconfiguration inwireless Sensor Networks,” Electronics, Circuits, and Systems (ICECS), 2010 17th IEEE International Conference on, IEEE, Dec. 12, 2010, pp. 918-921.
Gopinath et al, A Gateway Solution for IPV6 Wireless Sensor Networks, International Conference on Ultra Modern Communications (ICUMT), Oct. 12-14, 2009, IEEE, pp. 1-6.
Hill et al, The Platforms Enabling Wireless Sensor Networks, Communications of the ACM, dated Jun. 2004, vol. 47, No. 6, 6 pages.
Hunkeler et al., “MQTT-S—A publish/subscribe protocol for Wireless Sensor Networks,” 2008 3rd International Conference on Communication Systems Software and Middleware and Workshops (COMSWARE'08), IEEE, 8 pages.
IEI International Electronics, Tech Note 4.1, dated Nov. 28, 2005, 2 pages.
International Extended Search Report on PCT/US00/27515, dated Oct. 18, 2001, 14 pages.
International Search Report and Writt4en Opinion on PCT/US2015/017470, dated Jun. 9, 2015 13 pages.
International Search Report and Written Opinion on PCT/US15/017251, dated May 29, 2015, 21 pages.
International Search Report and Written Opinion on PCT/US15/17470, dated Jun. 9, 2016, 39 pages.
International Search Report and Written Opinion on PCT/US15/17477, dated Jun. 10, 2015, 11 pages.
International Search Report and Written Opinion on PCT/US15/17481, Jun. 10, 2015, 11 pages.
International Screen Report and Written Opinion on PCT/US15/17491, dated Jun. 10, 2015, 16 pages.
International Search Report and Written Opinion on PCT/US15/17680, dated Jun. 24, 2015, 12 pages.
International Search Report and Written Opinion on PCT/US15/17688, dated Jun. 8, 2015, 10 pages.
International Search Report and Written Opinion on PCT/US15/17696 dated Jun. 8, 2015, 12 pages.
International Search Report and Written Opinion on PCT/US15/17702 dated Jun. 17, 2015, 16 pages.
International Search Report and Written Opinion on PCT/US15/17924, dated Jun. 5, 2015, 7 pages.
International Search Report and Written Opinion on PCT/US15/17931 dated Jun. 10, 2015, 11 pages.
International Search Report and Written Opinion on PCT/US2015/017212, dated Jun. 2, 2015.
International Search Report and Written Opinion on PCT/US2015/017212, dated Jun. 2, 2015, 10 pages.
International Search Report and Written Opinion on PCT/US2015/017251, dated May 29, 2015, 19 pages.
International Search Report and Written Opinion on PCT/US2015/017251, dated May 29, 2015, 35 pages.
International Search Report and Written Opinion on PCT/US2015/017477, dated Jun. 10, 2015, 11 pages.
International Search Report and Written Opinion on PCT/US2015/017481, dated Jun. 10, 2015, 10 pages.
International Search Report and Written Opinion on PCT/US2015/017491, dated Jun. 10, 2015, 15 pages.
International Search Report and Written Opinion on PCT/US2015/017688, dated Jun. 8, 2015, 10 pages.
International Search Report and Written Opinion on PCT/US2015/017696, dated Jun. 8, 2015, 16 pages.
International Search Report and Written Opinion on PCT/US2015/017702, dated Jun. 17, 2015, 16 pages.
International Search Report and Written Opinion on PCT/US2015/017924, dated Jun. 5, 2015, 12 pages.
International Search Report and Written Opinion on PCT/US2015/0I7221, dated May 26, 2015, 11 pages.
Koshy et al. “Remote incremental linking for energy-efficient reprogramming of sensor networks,” Wireless Sensor Networks, 2005, Proceeedings of the Second European Workshop on Istanbul, Turkey, Jan. 31-Feb. 2, 2005, Piscataway, NJ, USA, IEEE, US, Jan. 31, 2005, pp. 354-365.
Marron et al., “FlexCup: A Flexible and Efficient Code Update Mechanism for Sensor Networks,” Jan. 1, 2006, Wireless Sensor Networks Lecture Notes in Computer Science; LNCS, Springer, Berlin, DE, pp. 212-227.
McIntire et al, “The low power energy aware processing (LEAP) embedded networked sensor system,” Information Processing in Sensor Networks, 2006. IPSN 2006. The Fifth International Conference, Nashville, TN, USA, Apr. 19-21, 2006, Piscataway, NJ, USA, IEEE, 2 Penn Plaza, Suite 701 New York, NY, 10121-0701, USA, Apr. 19, 2006, pp. 449-457.
Microsoft, IPv6 Traffic Between Nodes on Different Subnets of an IPv4 Internetwork, Microsoft Windows XP, http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/sag_ip_v6_imp_conf6.mspx?mfr=true, dated Jun. 15, 2014, 5 pages.
Office Action on Chinese Patent Application No. 201580019697, dated May 17, 2018. 1 page.
Office Action on CN 201580013943.0, dated Mar. 21, 2019, 20 pages with translation.
Office Action on CN 201580013946.4, dated May 8, 2019, 9 pages with translation.
Office Action on CN 201580015274.0, dated Feb. 3, 2019, 13 pages with translation.
Office Action on CN 201580015274.0, dated Jul. 3, 2019, 11 pages with translation.
Office Action on CN 201580016167.X, dated May 2, 2018, 20 pages with translation.
Office Action on CN 201580016167.X, dated Sep. 3, 2019, 18 pages with translation.
Office Action on CN 201580016167.X, dated Mar. 18, 2019, 26 pages with translation.
Office Action on CN 201580019382.5, dated Jul. 31, 2019, 17 pages with translation.
Office Action on CN 201580019386.3, dated Jun. 4, 2019, 34 pages with translation.
Office Action on CN 201580019691.2, dated Apr. 29, 2019, 15 pages with translation.
Office Action on CN 201580019691.2, dated Oct. 29, 2019, 10 pages with translation.
Office Action on CN 201580019697.X, dated Feb. 26, 2019, 20 pages with translation.
Office Action on CN 201580020164.3 dated Mar. 27, 2019, 24 pages with translation.
Office Action on CN 201580021841.3, dated Jun. 26, 2019, 16 pages with translation.
Office Action on EP 15754691.2, dated May 10, 2019, 5 pages.
Office Action on EP 15754909.8, dated May 20, 2019, 6 pages.
Office Action on EP 15754909.8, dated Sep. 11, 2018, 5 pages.
Office Action on EP 15755018.7, dated Jul. 9, 2019, 6 pages.
Office Action on EP 15755018.7, dated Sep. 11, 2018, 5 pages.
Office Action on EP 15755117.7, dated Aug. 9, 2019, 6 pages.
Office Action on EP 15755117.7, dated Oct. 4, 2018, 6 pages.
Office Action on EP 15755330.6, dated Jun. 19, 2019, 6 pages.
Office Action on EP 15755330.6, dated Oct. 1, 2018, 5 pages.
Office Action on EP 15755456.9, dated Mar. 7, 2019, 5 pages.
Office Action on EP 15755880.0, dated Jan. 30, 2019, 5 pages.
Shah Bhatti et al., “MANTIS OS: An Embedded Multithreaded Operating System for Wireless Micro Sensor Platforms,” Mobile Networks and Applications, Kluwer Academic Publishers, BO, vol. 10, No. 4, Aug. 1, 2005, pp. 563-579.
Supplementary European Search Report on EP 15754419.8, dated Nov. 14, 2017, 6 pages.
Supplementary European Search Report on EP 15754691.2, dated Nov. 3, 2017, 26 pages.
Supplementary European Search Report on EP 15754818.1, dated Dec. 14, 2017, 8 pages.
Supplementary European Search Report on EP 15754909.8, dated Nov. 7, 2017, 10 pages.
Supplementary European Search Report on EP 15755117.7, dated Nov. 7, 2017, 10 pages.
Supplementary European Search Report on EP 15755215.9, dated Nov. 20, 2017, 6 pages.
Supplementary European Search Report on EP 15755293.6, dated Sep. 5, 2017, 15 pages.
Supplementary European Search Report on EP 15755456.9, dated Nov. 22, 2017, 5 pages.
Supplementary European Search Report on EP 15755714.1, dated Oct. 25, 2017, 11 pages.
Supplementary European Search Report on EP 15755714.1, dated Oct. 25, 2017, 8 pages.
Supplementary European Search Report on EP 15755880.0, dated Nov. 24, 2017, 7 pages.
Supplementary European Search Report on EP 15756099.6, dated Oct. 26, 2017, 18 pages.
The Internet Society, Transmission of IP over InfiniBand (IPoIB), http://www.networksorcery.com/enp/rfc/rfc439l.txt, dated Apr. 2006, 15 pages.
Zhou, Ying et al., “Mobile Agent-based Policy Management for Wireless Sensor Networks,”, Wireless Communications, Networking and Mobile Computing, 2005, Proceedings 2005 Int'l Conference on Wuhan, China, vol. 2, Sep. 23, 2005, pp. 1207-1210.
Zoumboulakis et al., “Active rules for sensor databases,” Proceedings of the 1st international workshop on Data management for sensor networks, in conjunction with VLDB 2004, ACM, 2004, 6 pages.
Chen et al., Enix: a lightweight dynamic operating system for tightly constrained wireless sensor platforms, Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems, dated Nov. 3, 2010, 14 pages. http://sensys.acm.org/2010/Papers/p183-Chen.pdf.
International Search Report and Written Opinion on PCT/US15/017450, dated Jun. 10, 2015, 6 pages.
International Search Report and Written Opinion on PCT/US15/017477, dated Jun. 10, 2015, 7 pages.
International Search Report and Written Opinion on PCT/US15/017481, dated Jun. 10, 2015, 6 pages.
International Search Report and Written Opinion on PCT/US15/017491, dated Jun. 10, 2015, 6 pages.
International Search Report and Written Opinion on PCT/US15/017931, dated Jul. 10, 2015, 6 pages.
International Search Report and Written Opinion on PCT/US15/024050, dated Jul. 20, 2015, 8 pieces.
International Search Report and Written Opinion on PCT/US2015/017221, dated May 26, 2015, 11 pages.
International Search Report and Written Opinion on PCT/US2015/017450, dated Jun. 10, 2015, 11 pages.
Office Action on CN 201580019691.2, dated May 4, 2018, 14 pages including translation.
Office Action on CN 201580026024.7, dated Jun. 4, 2019, 12 pages with translation.
Office Action on JP 2016-560736, dated Aug. 27, 2019, 5 pages with translation.
Office Action on JP 2016-560736, dated Feb. 5, 2019, 5 pages with translation.
International Search Report and Written Opinion on PCT/US2015/024050, dated Jul. 20, 2015, 12 pages.
Supplementary European Search Reporton EP 15755018.7, dated Oct. 26, 2017, 9 pages.
Supplementary European Search Reporton EP 15755417.1, dated Oct. 23, 2017, 14 pages.
Supplementary European Search Reporton EP 15774423, dated Nov. 17, 2017, 1 page.
Supplementary European Search Reporton EP 15774423.6, dated Nov. 28, 2017, 10 pages.
Office Action on CN 201580013946.4, dated Jan. 19, 2020, 18 pages with English language translation.
Office Action on CN 201580015274.0, dated Feb. 7, 2020, 6 pages with English language translation.
Office Action on CN 201580016167.X, dated Mar. 2, 2020, 13 pages with English language translation.
Office Action on CN 201580019382.5, dated Apr. 24, 2020, 12 pages with English language translation.
Office Action on CN 201580019386.3, dated May 7, 2020, 10 pages with English language translation.
Office Action on CN 201580021841.3, dated Mar. 16, 2020, 10 pages with English language translation.
Office Action on CN 201580022068.2, dated Jan. 22, 2020, 15 pages with English language translation.
Office Action on EP 15754818.1, dated Dec. 19, 2019, 6 pages.
Office Action on EP 15755714.1, dated Jan. 17, 2020, 5 pages.
Office Action on EP 15774423.6, dated Jan. 7, 2020, 6 pages.
Office Action on JP 2016-560736, dated Jan. 15, 2020, 4 pages with English language translation.
Pu, Performance Analysis and Application Research on Wireless Network Coding System based on broadcast advantage, Chinese Doctoral Theses Full-text Database, Information Technology Division, Mar. 2010, pp. 25-79.
Qiang, Research on Wireless Sensor Network Routing Algorithm based on Dense Deployment. Chinese Master's Theses Full-text Database, Information Technology Division, May 2011, pp. 6-33.
Extended European Search Report on EP 20168200.2, dated Jul. 13, 2020, 11 pages.
Office Action on EP 15755018.7, dated Jun. 23, 2020, 5 pages.
Office Action on JP 2016-560736, dated Aug. 25, 2020, 6 pages with translation.
Bhatti et al., “MANTIS OS: An Embedded Multithreaded Operating System for Wireless Micro Sensor Platforms,” Mobile Networks and Applications (MONET) Journal, Special Issue on Wireless Sensor Networks, Aug. 2005, 14 pages.
Office Action on CN 201580019386.3, dated Jan. 6, 2021, 18 pages, with English language translation.
Office Action on KR 10-2016-7026932, dated Dec. 21, 2020, 5 pages.
Office Action on KR 10-2016-7026940, dated Dec. 18, 2020, 8 pages.
Office Action on KR 10-2016-7026962, dated Dec. 18, 2020, 3 pages.
Zhou Ying et al., “Mobile Agent-based Policy Management for Wireless Sensor Networks,” 2005 International Conference on Wireless Communications, Networking and Mobile Computing, Sep. 26, 2005, 4 pages.
Office Action on CN 201580013946.4, dated Sep. 25, 2020, 13 pages with English translation.
Office Action on KR 10-2016-7026933 dated Oct. 13, 2020, 12 pages with English translation.
Liang, “Social Network Service,” Mar. 31, 2013, pp. 137-138. English language translation unavailable.
Office Action on CN 201580022068.2, dated Aug. 26, 2020, 13 pages with English translation.
Office Action on EP 15774423.6, dated Oct. 6, 2020, 5 pages.
Office Action on KR 10-2016-7030734, dated Mar. 25, 2021, 16 pages with English language translation.
Office Action on EP 15755293.6, dated Feb. 3, 2021, 10 pages.
Office Action on CN 201580021841.3, dated Mar. 8, 2021, 15 pages with English language translation.
Office Action on CN 201580022068.2, dated Mar. 2, 2021, 7 pages, with English translation.
Office action on KR 10-2016-7026929, dated Mar. 16, 2021, 34 pages with English translation.
Yu, Zhaochun, “Development of Study on Data Storage and Access in Wireless Sensor Network,” Chinese Journal of Electronics, vol. 36, No. 10, 10 pages.
Zhang, Huixiang, “Network Control and Application,” Press of Northwest Polytechnical University, p. 41, Aug. 2013, 4 pages.
Office Action on EP 15755117.7, dated Jan. 13, 2021, 4 pages.
Dunkels et al., “Conticki—a lightweight and flexible operating system for tiny networked sensors,” 29th Annual IEEE International Conference on Local Computer Networks, Nov. 16-18, 2004, pp. 455-462.
Office Action on KR 10-2016-7026981, dated May 30, 2021, 11 pages with English language translation.
Office Action on KR 10-2016-7026998, dated Jun. 30, 2021, 18 pages with English language translation.
European Office Action on EP Appl. No. 15755714.1 dated Mar. 9, 2023 (3 pages).
European Office Action on EP Appl. No. 20168200.2 dated Feb. 28, 2022 (5 pages).
European Office Action on EP Appl. No. 15755714.1 dated Jan. 25, 2022 (5 pages).
Korean Office Action on KR Appl. No. 10-2016-7026934 dated Jan. 10, 2022 (12 pages with English language translation).
Korean Office Action on KR Appl. No. 10-2016-7026946 dated Jan. 17, 2022 (10 pages with English language translation).
Korean Office Action on KR Appl. No. 10-2016-7026964 dated Jan. 12, 2022 (12 pages with English language translation).
European Office Action on EP Appl. No. 20168200.2 dated Jun. 5, 2023 (5 pages).
Related Publications (2)
Number Date Country
20150287301 A1 Oct 2015 US
20170323546 A9 Nov 2017 US
Provisional Applications (2)
Number Date Country
61973962 Apr 2014 US
61946054 Feb 2014 US