1. Technical Field
Embodiments consistent with the presently-claimed invention relate to systems adapted to detect energy emission events and to methods for detecting and locating the origin of explosive reactions within a geographic region.
2. Discussion of Related Art
Systems for detecting and locating the origin of energy emission events have been used in a broad range of applications, including chemical processing, gunshot detection, and other law enforcement applications. These systems may use any one of a number of detection techniques. Some techniques, for example, use sensors to detect the pressure resulting from an explosive reaction or to detect the pressure generated by the movement of a projectile through the air. Other techniques may include acoustic detection systems that utilize a distributed network of sensors to measure the characteristics of sound waves radiating outward from an explosive reaction, such as a gunshot.
Acoustic detection systems are commonly used by law enforcement to detect, locate, and alert law enforcement to incidents of gunshots. Some acoustic detection systems use a series of acoustic sensors placed throughout a protected area to determine the location of the gunshot. Using a technique called acoustic triangulation, the differences in the arrival times of sound waves measured at three different acoustic sensors are used to calculate the origination of a gunshot.
The effectiveness and the accuracy of acoustic detection systems, however, can be limited by a number of factors. For example, the ability to accurately detect a gunshot may be dependent on the number and the spatial arrangement of acoustic sensors in a given area. Sensors placed too close together may not be able to distinguish a gunshot from a ball bouncing or a car backfiring. If the sensors are placed too far apart, no three sensors may be close enough to one another to perform acoustic triangulation. Further, in urban environments, high rise buildings and other structures may reflect the radiating sound waves before the waves reach an acoustic sensor, creating a delayed measurement. In some cases, the delayed measurement may result in a missed or inaccurate gunshot detection and/or location identification. Finally, although many acoustic detection systems can locate the origin of the explosion or gunshot, many of these systems fail to identify the particular source that created the detected event. In other words, many acoustic detection systems lack the ability to provide imagery of the location and the source where the gunshot or explosion was detected coincident with detecting the event.
Methods for detecting an energy emission event are provided. In a method for detecting an energy emission event, a reference event signal is compared with a received event signal. In some embodiments, the reference event signal is associated with radiated energy having a predetermined temporal response. A detection signal is output when the received event signal corresponds to the reference event signal. In response to outputting the detection signal, imagery of a location in proximity to where the received event signal originated is captured or processed. Using the captured imagery and the detection signal, a determination of where the received event signal originated is made.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. Further embodiments and aspects of the presently-claimed invention are described with reference to the accompanying drawings, which are incorporated in and constitute a part of this specification.
Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
As shown in
Exemplary imaging device 106 is a device capable of acquiring data, such as imagery and sound, of a location associated with the origin of a detected energy emission event. The origin of the detected energy emission event may be a location or a location in proximity to the source of the detected energy emission. In some embodiments, imaging device 106 may be a sensor having a focal plane array with a high pixel count, such as one million pixels or more. The focal plane array may be comprised of charged-coupled devices (CCDs), complementary metal oxide semiconductor (CMOS) image sensors, or similar image sensing technologies.
Imaging device 106 may also be an instrumentation-grade digital video camera, or like device capable of receiving sequential image data, digitizing the image data, and outputting the image data to system processor 108 for processing. In some embodiments, imaging device 106 may be a device having a focal plane array comprised electron multiplying charged-coupled devices (EMCCDs) or a device comprised of a short-wave or a mid-wave infrared focal plane. In some embodiments, imaging device 106 may be configured to acquire images at frame rates of five times greater than the signal duration. In other embodiments, imaging device 106 may be configured to acquire images at frame rates at video or near video frequency, or as required for detection of the energy emission event.
In some embodiments, imaging device 106 may be coupled to receive commands or data from system processor 108. For example, imaging device 106 may receive commands or settings from system processor 108 related to frame capture rate, aperture settings, or other common digital imaging device controls. Alternatively or additionally, imaging device 106 may be coupled to receive commands from sensor 104. For example, imaging device 106 may receive commands from sensor 104 to control image capture or transmission based on a detected energy emission event. In other cases, sensor 104 may provide operational or status information of sensor 104 to imaging device 106 to improve power management or to reduce processing demands of system 100. In some embodiments, imaging device 106 may be combined with sensor 104. In other embodiments, sensor 104 and imaging device 106 may be located remotely from other components of system 100. Located remotely, sensor 104 and imaging device 106 may include a wireless transceiver (not shown) to communicate with system 100 using a peripheral interface (not shown) coupled to bus 102 capable of communicating with the wireless transceiver.
Exemplary memory 110 may be one or more memory devices that store data as well as software, firmware, assembly, or micro code. Stored data may include, but is not limited to, data received from sensor 104, reference event signals used to process the data received from sensor 104, and data associated with a detected energy emission event received by imaging device 106. Memory 110 may include one or more of volatile or non volatile semiconductor memories, magnetic storage, or optical storage. In some embodiments, memory 110 may be a portable computer-readable storage medium, such as a portable memory card, including, for example Compact Flash cards (CF cards), Secure Digital cards (SD cards), Multi-Media cards (MMC cards), or Memory Stick cards (MS cards). Portable memory devices may include those equipped with a connector plug such as, a Universal Serial Bus (USB) connector or a FireWire® connector for uploading or downloading data and/or media between memory 110 and external computing devices (not shown) coupled to communicate with system 100.
Exemplary system processor 108 may be a general purpose processor, application specific integrated circuit (ASIC), embedded processor, field programmable gate array (FPGA), microcontroller, or other like device. System processor 108 may act upon instructions and data to process data output from sensor 104 and imaging device 106. That is, system processor 108 may exchange commands, data, and status information with sensor 104 and imaging device 106 to detect and to locate the source and the origin of an energy emission event. For example, system processor 108 may execute code to time correlate a detected energy emission event from sensor 104 with data from imaging device 106, such as imagery and sound received from imaging device 106 or data associated with a sensor or a sensor array. In some embodiments, system processor 108 may be coupled to exchange data or commands with memory 110. For example, system processor 108 may contain code operable to perform frame capture on captured sequential data, such as video data. In other embodiments, system processor 108 can exchange data, including control information and instructions with other devices or functional modules coupled to system 100 using bus 102.
Amplifier 210 may be a general purpose amplifier or a transimpedance amplifier adapted to amplify the voltage output from sensor pixel 200. In some embodiments, amplifier 210 may be alternating current (AC) coupled to the output of sensor pixel 200. In certain embodiments, amplifier 210 and sensor pixel 200 may be combined in a single device. The output of amplifier 210 may be coupled to ADC 220 to convert the analog output of amplifier 210 to digital values that may be received and processed by sensor processor 240. Sensor processor 240 may be a general purpose processor, application specific integrated circuit (ASIC), embedded processor, field programmable gate array (FPGA), microcontroller, or other like device capable of executing code to process digitized detector data received from ADC 220. For example, sensor processor 240 may execute code to compare a received event signal with a reference event signal to determine whether the received event signal is an energy emission event. In some embodiments, the reference event signal may be stored on sensor processor 240 or on computer-readable storage media accessible by sensor processor 240. Sensor processor 240 may then execute code to send a signal indicating a detected energy emission event to system processor 108 for additional processing.
In some embodiments, sensor pixels 200 may be logically coupled to operate as a quad detector. For example, sensor pixel 200 located in row R1310 and column C1 may be coupled to sensor pixel 200 located in row R1310 and column C2, row R2320 and column C1, and row R2320 and column C2. In other embodiments, a quad detector comprising more than four sensor pixels 200 may be similarly configured. Coupled to operate as a quad detector, sensor pixels 200 may detect the direction of incident radiation generated by an energy emission event based on the amount of radiation detected by each sensor within the quad detector.
Ring 410 may be composed of metal, plastic, or any other material sufficient to support multiple series lenses 420 and associated sensor pixels 200 or sensor pixel arrays 300. In some embodiments, system 100 may include multiple sensor arrays 400 placed in a location or on a vehicle to provide temporal and spatial detection of energy emission events surrounding the location or vehicle. For example, multiple sensor arrays 400 may be mounted on a law enforcement vehicle or aircraft, an unmanned aerial vehicle, or a robotically-controlled device. Each sensor array 400 may be configured to have a particular horizontal and/or vertical field of view, which when combined with each sensor array 400 provide a desired composite field of view as measured from the vehicle, the device, or the fixed location.
In step 610, a reference event signal is compared with a received event signal. For example, the comparison may operate on parametric characteristics of the received event signal and the reference event signal, such as rise time and fall time. Alternatively or additionally, the comparison may utilize image processing techniques. In some embodiments, the reference event signal may have pre-defined temporal or spectral characteristics corresponding to a particular type of radiated energy. For example, in certain embodiments, the reference event signal may be similar to the waveform illustrated in
In step 620, a detection signal is output when the received event signal corresponds to the reference event signal. The determination as to whether the received event signal corresponds to the reference event signal may be based on, for example, a graphical comparison of the waveforms, or on certain temporal characteristics, such as rise time and fall time. Other temporal characteristics may include, but are not limited to, pulse width, amplitude, frequency, period, the number of peaks, or a ratio of peaks. The type of comparison used may be based on any one of several factors, such as, for example, the computational capabilities of the processing device, the desired comparison accuracy of the system, and the processing time budget allocated to performing the comparison. In some embodiments, a detection signal may be an analog output or a digital output capable of being processed by a general purpose computing device, such as system processor 108 as shown in
The detection signal may include a time stamp or other temporal meta-data corresponding to when the received event signal was detected. For example, the time stamp may be added by sensor processor 240. In other embodiments, the time stamp may be added by system processor 108 upon receipt of the detection signal.
In step 630, imagery or data of a location in proximity to the origin of the received event signal is captured or processed in response to the generation of the detection signal. In some embodiments, the imagery may be a still image or moving images, such as those captured by a digital video camera or like imaging device. In some embodiments, still image may be captured in response to the generation of the detection event. In other embodiments, imagery may be captured continuously at periodic rates and processed in response to the generation of the detection signal. Processing may include executing code to perform frame capture from a video stream. Imagery may be captured using imaging device 106, at frame rates of five times the duration of the received event signal. In other embodiments, imagery may be captured using other frame rates sufficient to provide adequate temporal resolution based on the system requirements. In some embodiments, the captured imagery may be time stamped to facilitate time correlating the imagery with the detected energy emission event. For example, the imagery may be time stamped by the imaging device using generally available techniques, such as those used in digital still and digital video cameras. Alternatively or additionally, the imagery may be time stamped by a computing device independent from the imaging device, like system processor 108, as shown in
In step 640, a location corresponding to where the received event signal originated may be determined, based on the captured imagery and the event detection signal. That is, by comparing the time stamps associated with the event detection signal and the captured imagery, a location associated with the origin of the received event signal may be determined. For example, the detection signal and its associated time stamp may provide an indication of when a particular energy emission event was detected. Each detected signal and its associated time stamp may be stored in memory and/or processed directly by a processor. An imaging device coupled to the processor may continuously capture imagery, such as imagery and sound, at a fixed or a variable rate. In some embodiments, the imaging device may be configured to acquire imagery at video or near video rate or frequency, which can be, but is not limited to, a range 2 to 30 frames per second. Captured imagery may also be time stamped and stored and/or processed directly by a processor. In some embodiments, the time stamp associated with the detected energy emission event and the time stamp associated with imagery or data captured from the imaging device may be based on a common clock source, such as a GPS signal, or based on multiple synchronized clock sources. The time stamp associated with a detected energy emission event may then be compared with the time stamps associate the imagery or data captured by the imaging device. Captured imagery or data having the same time stamp or a range of time stamps occurring before and/or after the time stamp of the detected energy emission event may provide data, such as image data and/or sound, about the origin of the received event signal that produced the detection signal. For example, using the image containing the origin of the received event signal, the location of any point within the image may be calculated by a processor using the location of the imaging device as a reference to determine the azimuth and elevation associated with origin of the event.
In step 730, a sensor in an associated sensor array that generated the detection signal are identified to provide an indicator of temporal and spatial detection of an energy emission event. For example, each sensor pixel 200 may have a fast high temporal resolution with a comparatively lower spatial resolution as compared imaging device 106. In contrast, imaging device 106 may have a high spatial resolution and a comparatively lower temporal resolution as compared to sensor pixel 200. In other words, methods using a combination of sensor pixels 200 and imaging device 106 may be used to detect when and where an energy emission event occurred with high temporal and spatial accuracy.
In some embodiments, each sensor and each sensor array may be identified or addressable. For example, in some embodiments, a system may include three independently addressable sensor arrays operating together to provide a wide field of view for spatial detection of energy emission events. Each sensor array may include a plurality of sensor pixels or a plurality of sensor pixel arrays. In some embodiments, each sensor pixel array may be organized in rows and columns, as shown
In step 740, geo-spatial information associated with origin of the received event signal may be determined based in part on the sensor array associated with the sensor that detected the energy emission event. As previously discussed, in some embodiments, a plurality of sensor arrays may be assigned or located at different pre-determined locations. Each sensor array may have a distinct field of view based on its location. Combined, the plurality of sensor arrays may provide a wide field of view to perform spatial detection of energy emission events. In operation, the identification of which one of a plurality of sensor arrays is associated with the sensor that generated the detection signal defines the field of view that includes the origin of the received event signal. In some embodiments, the field of view may be transformed into geo-spatial information based in part on the location of the sensor array and the physical boundaries defined by the field of view of the sensor array. For example, the location of the sensor array combined with the field of view of the detecting sensor may be used as a reference to approximate the azimuth and elevation associated with the origin of the received event signal.
Other embodiments of the present invention will be apparent to those skilled in the art from consideration of the specification and practice of one or more embodiments of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
The present application claims the benefit of priority of U.S. Provisional Application No. 60/986,586 filed Nov. 8, 2007, entitled “Low Cost Gunshot Detection System,” the disclosure of which is expressly incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60986586 | Nov 2007 | US |