Patent Application
20080043101
The foregoing summary, as well as the following detailed description of certain embodiments of the present invention, will be better understood when read in conjunction with the appended drawings. To the extent, that the figures illustrate diagrams of the functional blocks of various embodiments, the functional blocks are not necessarily indicative of the division between hardware circuitry. Thus, for example, one or more of the functional blocks (e.g., processors or memories) may be implemented in a single piece of hardware (e.g., a general purpose signal processor or a block or random access memory, hard disk, or the like). Similarly, the programs may be stand alone programs, may be incorporated as subroutines in an operating system, may be functions in an installed software package, and the like. It should be understood that the various embodiments are not limited to the arrangements and instrumentality shown in the drawings.
The system 100 has one or more surveillance units, such as first surveillance unit 104, second surveillance unit 106 and N surveillance unit 108. Each of the first through N surveillance units 104-108 may have a visible light camera and an infrared (IR) imager housed within a single cover. Each of the first through N surveillance units 104-108 detect image data and IR data within a single field of view (FOV). IR data results from the detection of IR radiation. The FOV of each surveillance unit may be different from any other surveillance unit, or a surveillance unit may have a FOV which at least partially overlaps with the FOV of at least one other surveillance unit.
Alarm condition detectors 118, 120 and 122 may be connected on the network 110 and are monitored by the system control panel 102. The detectors 118-122 may detect fire, smoke, temperature, chemical compositions, or other hazardous conditions. When an alarm condition is sensed, the system control panel 102 transmits an alarm signal to one or more notification device 124, 126 and/or 128 through the network 110. The notification devices 124, 126 and 128 may be horns and/or strobes, for example, and may be addressable or non-addressable notification devices as discussed further below.
The system control panel 102 is connected to a power supply 130 which provides one or more levels of power to the system 100. One or more batteries 132 may provide a back-up power source for a predetermined period of time in the event of a failure of the power supply 130 or other incoming power. Other functions of the system control panel 102 include showing the status of the system 100, resetting a part or all of the system 100, silencing signals, turning off strobe lights, and the like.
The network 110 is configured to carry power and communications to the addressable notification devices from the system control panel 102. Each addressable notification device 124-128 has a unique address and both sends and receives communications to and from the system control panel 102. The addressable notification devices 124-128 may communicate their status and functional capability to the system control panel 102 over the network 110. In contrast, a notification signal sent on the network 110 from the system control panel 102 will be received and processed by each non-addressable notification device. The first through N image surveillance units 104-108 also each have a unique address and send acquired video and IR data to the system control panel 102. The system control panel 102 may processor 164 transmits the video data and the IR data to the control panel 102 over the network 110. The processor 164 may acquire video and IR data in frames or snapshots at predetermined time intervals depending upon a desired configuration. For example, it may be desirable to acquire a frame of data every second or 5 seconds when no trouble condition is being investigated, then acquire frames of data more frequently, such as every half second, when analysis and processing is desired. Alternatively, the video and IR data may be acquired as streaming data or other data format, the resolution of the video data may be varied based on desired configuration or setting, and the like.
The control panel 102 may have one or both of the DSP module 156 and IR detection module 158. The IR detection module 158 processes the IR data from the IR imager 152 to determine whether a heat generating object is present within the FOV. For example, any body having a temperature above absolute zero will radiate at least a minimal amount of radiation. The intensity and frequency distribution of the radiation depends on the detailed structure of the body. Humans radiate a portion of their energy as electromagnetic radiation, most of which is in the infrared range, which has a wavelength longer than visible light and shorter than radio waves. Optionally, the IR detection module 158 may filter the IR data with filter 159 to determine if IR radiation having desired intensity, wavelength and/or frequency is detected.
The DSP module 156 analyzes and processes the video data from the visible light camera 150 based on input from the IR detection module 158. Alternatively, the processor 140 may transmit the video and IR data to the central monitoring station 146 for analysis and/or processing by the DSP module 180 and IR detection module 182, or may transmit the video and IR data after a heat generating object is detected by the IR detection module 158.
The system control panel 102 has a control module 134 which provides control software and hardware to operate the system 100. Operating code 136 may be provided on a hard disk, ROM, flash memory, stored and run on a CPU card, or other memory. An input/output (I/O) port 138 provides a communications interface at the system control panel 102 with a central monitoring station 146 which may be connected wirelessly, by telephone link, LAN, WAN, internet, and the like. The I/O port 138 may also provide communication with external devices such as laptop computers.
The central monitoring station 146 is typically located remote from the system 100 and may monitor multiple alarm systems. The central monitoring station 146 may receive communications from the system control panel 102 regarding security problems and alarm conditions as well as real-time video and IR data acquired by the first through N surveillance units 104-108. The central monitoring station 146 may have one or more DSP modules 180 and one or more IR detection modules 182 for analyzing and processing video and IR data from one or more systems 100.
The visible light camera 150 and the IR imager 152 have the same FOV which defines the area the first surveillance unit 104 monitors and detects visible images and IR radiation within. An IR value detection module 153 may be separate from or integrated with the IR imager 152 and used to detect a level of IR sensed by the IR imager 152. The visible light camera 150 and the IR imager 152 operate simultaneously to acquire video data and long wave IR radiation data, respectively. A that IR radiation is received or detected but not transmitted. A lens 174 may be comprised of materials such as silicon, zinc selenide, or germanium, and is used to focus FOV 176 onto the focal plane array 160.
The IR sensors 162 receive or detect any long wave IR radiation within the FOV 176, which may also be referred to as black body radiation. Each of the IR sensors 162 produces an IR value, such as a voltage level, which reflects the amount of IR energy hitting the IR sensor 162. If dual element IR sensors are used, each of the two pixels may produce a separate IR value. The IR value detection module 153 (
The IR imager 152 may produce a high contrast frame 166 having an approximate block outline 178 of an intruder 168 detected within the FOV 176. Face area 170 of the intruder 168 generates a higher temperature (and higher voltage) compared to torso area 172 which is covered with clothing. Clothing reduces the surface temperature a few degrees, and thus less IR radiation is emitted and detected from covered areas. Areas having a higher temperature are displayed as lighter or brighter on the high contrast frame 166 compared to areas having cooler temperatures.
The high contrast frame 166 or image produced by the focal plane array 160 may be segmented, wherein each segment reflects IR data detected by a single IR sensor 162. Because the same FOV 176 is used for both the IR imager 152 and the visible light camera 150 (
For the system 100 of
At 202, the processor 164 transmits the video and IR data frames to the control panel 102 as they are acquired. At 204, if an IR detection module 158 is not available at the control panel 102, the method passes to 206 where the processor 140 transmits the video and IR data frames to the central monitoring station 146 for analysis. It should be understood that some or all of the analysis and processing may be accomplished at the control panel 102, the central monitoring station 146, or a combination of the two. Also, the video and IR data may be transmitted to the central monitoring station 146 regardless of analysis being performed at the control panel 102.
Returning to 204, the analysis and/or processing may be accomplished in the same manner without regard to the location of the IR detection module 158 and the DSP module 156. Thus, the method passes to 208 from both 204 and 206. The method returns to 200 via line 230, indicating that 200-206 are accomplished continually and concurrently with the analysis and processing below.
At 208, the IR detection module 158 analyzes the IR data detected by each of the IR sensors 162 (
At 210, the processor 140 identifies any IR sensors 162 corresponding to areas within the FOV 176 which require further investigation. If no IR sensor 162 is to be investigated, the IR data frame and corresponding video data frame may be discarded or archived.
Returning to
At 214, the processor 140 transfers the first IR ROI 253 to the first video data frame 252 as first video ROI 254. At 216, the DSP module 156 analyzes the video content within the first video ROI 254. This relieves the burden on the DSP module 256 as only a portion of the first video data frame 252 may need to be analyzed. Optionally, the DSP module 256 may analyze image data only when a first video ROI 254 is identified.
At 218, the DSP module 156 may determine whether the data within the first video ROI 254 indicates a false alarm, an intruder, or otherwise meets an alarm condition and warrants further investigation. For example, the DSP module 156 may compare the first video ROI 254 to exemplary heat signatures generated by people or animals. Alternatively, the DSP module 156 may identify that the first video ROI 254 corresponds to a window which has received a large amount of light, resulting in a level of detected IR that is beyond a threshold. If it is during the day, this may be identified as a false alarm. If it is during the night, it may be determined that an unauthorized entry may be attempted. Optionally, the first video ROI 254 may be monitored for movement. If the DSP module 156 determines that a false alarm is indicated, the method returns to 208 to process the next IR data frame. If the DSP module 156 determines that an alarm condition has been met, the method passes to 220.
At 220, if the analysis and processing are accomplished at the control panel 102, the processor 140 may send an alarm signal through the I/O port 138 to the central monitoring station 146 where appropriate action is initiated. If the analysis and processing are accomplished at the central monitoring station 146, the DSP module 180 may initiate an alarm signal locally.
At 222, the processor 140 may transmit all of the IR and video data frames to the central monitoring station 146 if desired or if necessary for analysis and/or processing. Alternatively, at 224, the processor 140 within the control panel 102 may direct the processor 164 within the first surveillance unit 104 to acquire, sample, and/or detect IR and image data frames at an increased rate. The method returns to 208 to evaluate subsequent IR data frames.
Alternatively, once the first video ROI 254 is defined, the processor 140 may process subsequent video data frames based on the first video ROI 254. The processor 140 can thus track the movement of the intruder 168 over time while enhancing the video image to identify whether the intruder 168 is an authorized person. The combined data gathered by the visible light camera 150 and the IR imager 152 allow improved tracking of the intruder 168.
Also, the processor 140 may track the intruder 168 as they move out of the FOV 176 of the first surveillance unit 104 to a FOV of any of the second through N surveillance units 106-108 based on previously acquired data. For example, the first surveillance unit 104 may detect a first set of video data frames and a first set of IR data frames. The second surveillance unit 106 may detect a second set of video data frames and a second set of IR data frames. The processor 140 may track the intruder 168 from the first set of frames to the second set of frames based on processing accomplished on prior data frames.
As discussed previously, if multiple intruders are present, multiple ROIs may be generated and tracked. More than one intruder may be tracked from frame to frame and thus authorities know how many intruders are present, know whether they have an animal such as a dog with them, and know the locations of all intruders.
False positives may be avoided by identifying other heat generating situations, such as sunlight and space heaters. Also, an authorized person may be more easily identified by using the DSP module 156 to enhance the video data frame and thus avoid a false alarm. Knowing the location of authorized personnel with respect to the intruder 168 may improve the safety of the authorized personnel. In addition, the location of any person who may need assistance is better known, such as if they have been attacked or are incapacitated. Also, by using the IR imager 152, time and safety are enhanced by knowing whether an intruder 168 has left the monitored area, eliminating the need for security personnel to wait outside unnecessarily.
While the invention has been described in terms of various specific embodiments, those skilled in the art will recognize that the invention can be practiced with modification within the spirit and scope of the claims.
