Patent Application
20170263092
The present invention relates to threat monitoring, and more specifically to systems and methods of monitoring threats in a defined monitoring zone.
Bad actors in an interior environment such as a building present a difficult challenge for threat monitoring, threat assessment, and threat response relative to open air environments. Line of sight is often limited. Radio frequency propagation is also often limited, relative to unimpeded omnidirectional propagation, due to walls and other internal structures. Building occupants' exit paths are often limited, thus occupants' ability to exit may be impeded. Limited radio frequency transmission can limit occupants' ability contact people outside the building. Furthermore, emergency responders' and law enforcement's ability to monitor a bad actors and direct victims is limited due to inability to actively view the situation and communicate. Those factors work to a bad actor's advantage. For the above reasons, it would therefore be advantageous to have systems and methods to monitor potential threats in interior environments.
The present invention is directed to systems and processes for monitoring threats in a defined monitoring zone including a server, a radio frequency transmitter positioning system, a position database. The radio frequency transmitter positioning system includes one or more radio frequency receivers and a location module configured to provide location of radio frequency transmitters within the defined monitoring zone. The position database is configured to store radio frequency transmitter fingerprint data and associated person information. The system is configured to determine threat risk by comparison of the stored radio frequency transmitter fingerprint data with the fingerprints of active radio frequency transmitter fingerprint data within the defined monitoring zone.
These and other features, aspects, and advantages of the invention will become better understood with reference to the following description, and accompanying drawings.
Detailed descriptions of the preferred embodiment are provided herein. It is to be understood, however, that the present invention may be embodied in various forms. Therefore, specific details disclosed herein are not to be interpreted as limiting, but rather as a basis for the claims and as a representative basis for teaching one skilled in the art to employ the present invention in virtually any appropriately detailed system, structure or manner.
Exemplary embodiments of the current invention are directed to systems and processes for threat monitoring and communication by radio frequency (RF) transmitter monitoring. The present invention includes embodiments for identification, position monitoring, and communication with RF transmitters, such as those in mobile computers 11, associated with one or more persons, in a defined monitoring zone 12.
Exemplary systems are deployed where the defined monitoring zone 12 is a closed interior environment 08, commonly a building 08. A building 08 is a structure with a roof and walls standing more or less permanently in one place. Buildings 08 may be built in a variety of shapes, dimensions, and functions, such as homes, schools, or offices. The building 08 is commonly enclosed by walls and subdivided into rooms, and having a limited number of exits 04. Building materials or later additions to the roof or walls vary and often impede weak radio frequency (RF) signals such as GPS. As a result, the mobile computers 11 of interior occupants may not receive GPS signals. Alternatively, the time of flight of the GPS signal may be altered, with the mobile computers 11 receiving an attenuated, scattered, reflected, or multipath GPS signals. In turn, the GPS signal is not sufficiently reliable for relative position tracking in the defined monitoring zone 08.
Exemplary embodiments of systems 10 track the locations of RF transmitters in the defined monitoring zone 12. One such RF transmitter is one within a mobile computer 11, such as a smartphone. A smartphone can have one or more RF transmitters, such as Bluetooth, WiFi, and cellular radios. A mobile computer 11, server 14, smartphone, tablet as used in this specification is a computer. A computer generally refers to a system which includes a central processing unit (CPU), memory, a screen, a network interface, and input/output (I/O) components connected by way of a data bus. The I/O components may include for example, a mouse, keyboard, buttons, or a touchscreen. The network interface enables data communications with the computer network. A server is a computer containing various server software programs and preferably contains application server software. A mobile computer is a computer such as a smartphone or tablet PC with smaller dimensions, such as iPhone, iPod Touch, iPad, Blackberry, or Android based device. A mobile computer also includes a “geo tag,” a stripped down computer with a process with a single purpose to transmit RF for position monitoring. Those skilled in the art will appreciate that computer may take a variety of configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based electronics, network PCs, minicomputers, mainframe computers, and the like. Additionally, a computer may be part of a distributed computer environment where tasks are performed by local and remote processing devices that are linked. Although shown as separate devices, one skilled in the art can understand that the structure of and functionality associated with the aforementioned elements can be optionally partially or completely incorporated within one or the other, such as within one or more processors. As noted above, the processes of this invention, or subsets thereof, may exist in on one or more computers such as a client/server approach.
The process, or subsets thereof, may exist in a machine-readable medium which causes a computer to carry out instructions. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, propagation media or other type of media/machine-readable medium suitable for storing electronic instructions. For example, the present invention or aspects thereof may be downloaded as a computer program or “app” which may be transferred from a remote computer to a requesting computer by way of data signals embodied in a carrier wave or other propagation medium via a communication link.
In certain embodiments, the computers communicate over a network 18, which may include one or more local area networks (LANs), wide area networks (WANs), all or a portion of the Internet, and/or any other communication system or systems at one or more locations. Network 18 may be all or a portion of an enterprise or secured network, while in another instance at least a portion of the network 18 may represent a connection to the Internet. Further, all or a portion of network may comprise either a wireline or wireless link. In other words, network 18 encompasses any internal or external network, networks, sub-network, or combination thereof operable to facilitate communications between various computing components inside and outside the illustrated environment. The network 18 may communicate, for example, Internet Protocol (IP) packets, Frame Relay frames, Asynchronous Transfer Mode (ATM) cells, voice, video, data, and other suitable information between network addresses. The exemplary mobile computers 11 for monitoring within the defined monitoring zone 08 have wireless local area network radios, such as the IEEE 802.11 standards, or bluetooth radios, such as the IEEE 802.15.1 standard.
The illustrated embodiment includes RF transmitter positioning system, such as an indoor positioning system 20. The indoor positioning system 20 is one or more components operable to determine position objects or people inside the building 08 using radio waves, magnetic fields, acoustic signals, or other sensory information collected by mobile devices. An exemplary indoor positioning system 20 is one which employs radio waves, more specifically cellular, WiFi, or Bluetooth radio waves. Corresponding receivers are disposed within the defined monitored zone 12. One such configuration includes a plurality of spaced apart WiFi access points 22, each at a known fixed location. In certain embodiments, the illustrated indoor positioning system 20 includes one or more WiFi access points 22 and a module for processing received RF data and characteristics on the server 14. The module on the server 14 employs time of flight/time of arrival, time difference of arrival, round trip delay, received signal strength indication, and triangulation, and other approaches to determine the position of a given mobile computer 11.
Time of arrival and time of flight is known in the art and not discussed in detail here. Time of arrival/time of flight is the amount of time a signal takes to propagate from transmitter to receiver. Using the signal propagation rate, the travel time of a signal is used to calculate distance. Multiple measurements can be combined with triangulation to find and improve location.
Time difference of arrival is known in the art and not discussed in detail here. Time difference of arrival includes an antenna array. The time difference of arrival is typically determined by measuring the time difference of arrival between multiple antennas in the sensor array. In other receivers, it is determined by an array of highly directional sensors, the angle can be determined by which sensor received the signal. Angle of arrival is usually used with triangulation and a known base line to find the location relative to two anchor transmitters.
Received signal strength indication is known in the art and not discussed in detail here. Received signal strength indication is a measurement of the power level received by a sensor. Using the inverse-square law of RF propagation, distance is approximated based on the relationship between transmitted and received signal strength where the transmission strength is a relatively constant based on the equipment being used.
Each of the above approaches has a certain range of error. For example, Wi-Fi signal strength measurements can be noisy, so certain embodiment may use statistics to filter out the inaccurate input data. The inside of buildings 08 is not free space, so accuracy is impacted by reflection and absorption from walls. Objects such as doors, furniture, and people can pose an accuracy problem, as they can affect the signal strength in dynamic, unpredictable ways. Certain embodiments may employ algorithms and equipment for improved accuracy. Certain embodiments employ enhanced Wi-Fi infrastructure improved accuracy. Certain embodiments employ enhanced synchronization improved accuracy.
A representative suitable indoor positioning system 20 is the Cisco's Connected Mobile Experiences system (CMX). Certain configurations of the CMX indoor positioning system 20 employ one or more access points 22, an application/module on the mobile device 11, and server 20 modules for mobile device 11 location processing.
Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 11/682,649, entitled “Determining the time of arrival of a wireless signal”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 10/803,367, entitled “Radiolocation in a wireless network using time difference of arrival”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 12/405,383, entitled “Clock synchronization”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 11/619,939, entitled “Locally adjusted radio frequency coverage maps in wireless networks”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 11/543,747, entitled “Radio frequency coverage map generation in wireless networks”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 11/542,720, entitled “Location inspector in wireless networks”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 13/453,642, entitled “Generating Accurate Dynamic Heat Maps”, which is hereby incorporated by reference. Additional disclosure of indoor positioning systems is include in U.S. patent application Ser. No. 12/875,680, entitled “Location Estimation for Wireless Devices”, which is hereby incorporated by reference.
In certain configurations, the system 10 includes specialized storage in the form of a position database 17 configured to store location data of mobile computers 11 within the building 08. In exemplary configuration, position information for mobile computers 11, mobile computer 11 identifying information, associated user information, and defined monitoring zone 0812 are received for storage. For example, an X, Y, Z coordinate may be received for storage in the position database 17. One skilled in the art would appreciated that the data may reside in one or more databases, tables, or computers. Representative suitable database systems include text, SQL, noSQL, or other repositories known in the art.
Certain embodiments of the system 10 include one or more cameras 28 for placement in the building 08, at known positions and orientations. An exemplary camera 28 is operable to provide electronic image acquisition and transmission to the server 14 over the network 18 for storage in the position database 17 or other processing. The system optionally provides a facial recognition module for processing of camera 28 input, identification of individuals, association with the position of the camera 28, and/or association with a mobile device.
Certain embodiments of the system 10 include one or more sound sensors 26 for placement in the building 08. The exemplary sound sensors 26 is operable to provide electronic audio acquisition and transmission to the server 14 over the network 18 for storage in the position database 17 or other processing. A suitable sound sensor 26 can include a microphone which captures the broad audio spectrum. Other suitable sound sensors 26 are tuned for specific function such as gunshots or crowd noise, by band, amplitude filtering, and/or other sound characteristics. In certain configurations, the sound sensors 26 are integral with the cameras 28.
Referring to
At step 110, the monitoring zone 12 is defined. Commonly, this will be one or more buildings 08, such a campus or office, or a part of the building 08. A map 40 for the monitoring zone 12 is received or generated.
At step 120, a positioning system 20 such as an indoor positioning system 20 is deployed to the defined monitoring zone 12. In certain configurations, spaced apart wifi access points 22, or other receiver types, are deployed throughout the monitoring zone 12. In certain configurations, the wifi access points 22 are deployed with density such that mobile device 11 signals can be received at a threshold number of wifi access points 22 for improved position accuracy. Wifi access point 22 communication with the position analysis module on the server 14 is established over the network 18. The position of each wifi access point 22 is stored in the position database 17. Similarly configured receivers may be setup for cellular, bluetooth, or other protocols.
In some processes, cameras 28 and sound sensors 26 are deployed at known positions within the monitoring zone 12. The position and other information for each of the cameras 28 and sound sensors 26 is stored in the position database 17. Communication over the network 18 is established for the cameras 28 and sound sensors 26.
At step 130, known devices within the monitoring zone are associated with persons. In expected operation, there will be a set of regular occupants entering the defined monitoring zone 12. The occupants normally carry a mobile computer 11 on their person. The system 10 receives and stores the association of the person to their mobile computer 11. The RF transmitter of the person's mobile computer 11 is fingerprinted, wherein transmission data and characteristics of the person's mobile computer 11 are acquired and stored for processing and later comparison. In exemplary process, a unique identifier of the mobile computer 11 is acquired. Commonly, each radio within a mobile computer 11 has a media access control address (MAC address) or other identifier, which is a unique identifier assigned to the radio of the mobile computer 11 for communications. MAC addresses are often used and can be acquired as a network address for network protocols. In certain processes, one or more transmissions are captured and processed for fingerprinting.
In order to associate the mobile computer 11 with a person, various approaches may be used. In certain process, the person may download an application to their mobile computer 11 or the system 10 may present a portal such as a webpage to the person. The downloaded application can accept input as to the identity of the person. In other processes, as part of the process of registration at the campus or office, identity may be established as part of the employment or registration process. The unique identifier and identity are stored in the position database 17. Other identifying information of the person such as images, facial or otherwise, or voice may be received and stored. In addition to identity, each person may be assigned to a group. For example, in a campus environment, people might be assigned to student, parent, faculty, or security groups. In an office environment, people might be assigned to employee or security groups.
At step 140, the monitoring zone 12 is monitored for threshold threat risk devices. The indoor position system 20 is activated. The indoor position system 20 is activated and identifies the mobile computers 11 within the defined monitoring zone 12. The position of each mobile computer 11 within the monitoring zone 12 is determined as previously disclosed, with the presence and location for each mobile device 11 being determined. The positions of each mobile computer 11 within the monitoring zone 12 are visually overlaid on the map 40 of the building 08 resulting in a composite map 42.
At step 150, the threat associated with the unknown device 32 presence is assessed. Various configurations can employ different threat assessment procedure. In certain configurations, the threat level is set by mere presence of an unknown device in the building 08. In certain configurations, the threat level is assessed by personnel 50 in the building 08. For example, the person holding the unknown device 32 may display threatening or potentially threatening behavior. In such a situation, another building occupant may input a threat assessment in the system for current or future use. In other configurations, the unknown device's identifier may be compared to one or more lists of device identifiers for association with an individual and, in turn, a threat level.
A threshold threat condition may be triggered. In such a condition, the fingerprint information, such as the radio identifier, associated with the person is flagged. The position of that threat actor 45 may be further monitored. Additionally, projections of the threat actor 45 may be calculated, based on the threat actor's 45 speed and direction of travel, the travel paths 41, intent, and other information.
At step 160, conditional messages 48 are broadcast in response to a threshold threat condition. The message 48 format and content can vary according to the group. In various configurations, the messages 48 are sent by SMS/MMS, email, in-app messaging, or other available communication channels. In certain processes, the system 10 sends messages to predetermined groups.
Insofar as the description above, and the accompanying drawing disclose any additional subject matter that is not within the scope of the single claim below, the inventions are not dedicated to the public and the right to file one or more applications to claim such additional inventions is reserved.
The present invention claims priority to provisional application 62/306,539, which has a filing date of Mar. 10, 2016 and is incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62306539 | Mar 2016 | US |
