The system and method relates to sensor networks and in particular to acoustic sensor networks.
Typically, alarm systems and telephone systems have been separate systems. The alarm/security systems usually have separate wiring, monitoring, and control systems. Many existing telephony systems utilize telephones that have the components necessary (e.g., a microphone and speaker (acoustic sensor)) to provide the same functionality as existing alarm/security systems. However, most alarm/security systems fail to utilize the existing telephone infrastructure. In addition, current systems fail to utilize all of the capabilities of acoustic sensors. Existing systems fail to fully integrate and display notification messages to occupants and the occupants' responses in relation to a physical location.
For example, U.S. Pat. No. 6,529,128 discloses a separate alarm system in which occupants in an area can go to a route indicator. The route indicator provides escape route instructions to building occupants. The escape route is determined based on input from sensors. The problem with this system is that it is separate from existing telecommunications systems, it is not interactive with occupants, it fails to use acoustic sensors, and it fails to use physical maps to display interactive information to aid potential emergency responders.
Other systems, such as disclosed in U.S. Pat. No. 7,366,674, use a hierarchical map for displaying the status of occupants of a building. The system allows occupants to provide location status during emergency conditions. However, this system fails to leverage existing telecommunications system's acoustic sensors and does not provide an integrated solution for displaying status, notifications, and responses on a physical map.
Patent Application Publication 2005/0244014 discloses using an acoustic sensor in a telephone. This system also discloses sending a notification to a user and receiving a response from the user. However, the system does not disclose an integrated solution for displaying status, notification, and responses on a map. Moreover, the system does not disclose utilizing additional capabilities of acoustic sensors to monitor for events in addition to temperature.
The system and method are directed to solving these and other problems and disadvantages of the prior art. The system and method comprises a plurality of communication devices that are located in different physical locations. Each device contains an acoustic sensor for monitoring the physical locations of the communication device. Each communication device reports acoustic sensor events by monitoring its acoustic sensor. The events are sent to a manager. The manager displays a map which shows the physical locations, the events from the acoustic sensor in each communication device, sent notification messages, and received response messages.
These and other features and advantages of the system and method will become more apparent from considering the following description of an illustrative embodiment of the system and method together with the drawing, in which:
Communication devices 110-113 could be any device capable of sending and receiving data, such as a telephone, a cellular telephone, a Personal Digital Assistant (PDA), a Personal Computer (PC), and the like. The acoustic sensor 102 could be any device capable of sending and receiving acoustic signals, such as the combination of a microphone and speaker. The input device 103 could be any device capable of receiving input, such as a key pad, a keyboard, a touch screen, a microphone, and the like. The input device 103 could be a microphone in the acoustic sensor 102. An occupant is any user of the communication device 110-113. In addition, an occupant could be a visitor to the location acoustically monitored by the acoustic sensor 102. The manager 108 could be any device capable of sending and receiving messages, such as a PC, a Private Branch eXchange (PBX), a router, a Session Initiation Protocol (SIP) proxy server, and the like. The manager 108 could comprise multiple devices. The display 109 could be any device capable of displaying images, such as a PC, a telephone, a PDA, a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like. The display 109 could be a remote display using a wireless connection.
The network 107 could be any type of network, such as a wired network, a wireless network, a fiber optic network, and the like. Communications devices 110-113 may communicate with the manager 108 via the network 107 or may be hardwired directly to the manager 108. The communication devices 110-113 can communicate with the manager 108 by using a variety of protocols, such as Internet Protocol (IP), Asynchronous Transfer Protocol (ATM), Time Division Multiplexed (TDM), SIP, 802.11G, and the like.
The communication devices 110-113 are located at different physical locations. The acoustic sensor 102 monitors the physical location around communication device 110 to detect events. The acoustic sensor 102 in communication device 110 can monitor a physical location in a variety of ways to detect an event. For example, the event of temperature monitoring is accomplished by an acoustic sensor as disclosed in U.S. Patent Application Publication 2005/0244014, which is hereby incorporated by reference. The acoustic sensor 102 can monitor for other events, such as a gunshot, the sound of a person, an explosion, an impact (e.g. a car hitting a building), the sound of fire, and the like. Communication device 110 reports the events of the acoustic monitoring to the manager 108. Communication devices 111-113 also monitor their corresponding physical locations and report the events of the acoustic monitoring to the manager 108.
The manager 108 receives the reports of the acoustic monitoring from the communication devices 110-113. Based on the reports of the acoustic monitoring, the manager 108 determines if a first notification message needs to be sent to at least one and/or all of the communication devices 110-113. If it is determined that the first notification message needs to be sent, the first notification message is sent to at least one and/or all of the communication devices 110-113. The manager 108 displays a map 200 in display 109 that contains at least one and/or all of the events of the acoustic monitoring. If the first notification message was sent to one or more of the communication devices 110-113, the manager 108 updates the map 200 in the display 109 to show the notification message(s).
In response to the first notification, one or more of the communication devices 110-113 send a response message containing an occupant status to the manager 108. The response message could be based on the occupant entering information via the input device 103. For example, the occupant could speak a command into a microphone, input a command into a keypad, and/or input a command on a touch screen. The manager 108 updates the map 200 in the display 109 to show the received response message(s) from communication devices 110-113 in conjunction with the locations 201-204. Based on the received response message(s), the manager 108 sends a second notification message to one or more of the communication devices 110-113. The manager 108 updates the map 200 in the display 109 with a second notification message(s) in conjunction with the locations 201-204. The manager 108 can archive the events and notification messages. In addition, the manager 108 could send the map to a remote display (not shown) such as a remote display at fire station and the like.
Each of the rooms 201-204 has an associated communication device 110-113. In this example, communication device 110 is in room 201, communication device 111 is in room 202, communication device 112 is in room 203, and communication device 113 is in room 204. The communication device numbers 110-113 are shown on the map for each room 201-204.
The acoustic sensor 102 in communication device 110 monitors room 201. Likewise, the acoustic sensors in communication devices 111-113 monitor their respective rooms 202-204. The acoustic sensor 102 in communication device 110 has detected a temperature event of 141°, a fire event, and an explosion event in room 201. The acoustic sensor in communication device 111 has detected a temperature event of 75° in room 202. The acoustic sensor in communication device 112 has detected a temperature event of 95°, which is an increase over the prior temperature in room 203. The increase in temperature causes the acoustic sensor in communication device 112 to generate an increase in temperature event. The acoustic sensor in communication device 113 has detected a temperature event of 75° in room 204.
The events from the acoustic sensors in communication devices 110-112 are reported to the manager 108. The manager 108 updates map 200 to indicate a temperature of 141°, detection of a fire, and detection of an explosion in room 201. The manager 108 updates the map 200 to indicate the temperature of 75° in room 202. The manager 108 updates the map 200 to indicate a temperature of 95° and an event of increased temperature in room 203. The manager updates the map 200 to indicate a temperature of 75° in room 204.
Based on the events of a temperature of 141° in room 201, a fire in room 201, an explosion in room 201, and an increased temperature in room 203, the manager 108 sends notification messages containing occupant instructions to communication devices 110-113 indicating that the occupants of rooms 201-204 should evacuate using evacuation route 211. This is because evacuation route 210 is likely blocked due to a fire in room 201 which is next to evacuation route 210. The communication devices 110-113 notify the occupants of each of the rooms 201-204 to use evacuation route 211. Communication devices 110-113 can notify the occupants in various ways, such as: an audio message (e.g. specialized ring tone such as saying “alert”), a video message, a vibration, calling a cell phone, and/or any combination of these.
The manager 108 updates the map 200 in display 109 for each of the rooms 201-204 to indicate that a notification message telling the occupants to use evacuation route 211 was sent to communication devices 110-113. A notification message could also be sent to an emergency response center (e.g. 911 dispatch or a corporate resource). In addition, a second notification message with occupant instructions requesting that the occupant enter a status code is sent to communication devices 110, 112, and 113. The second notification message is not sent to communication device 111 in room 202 because room 202 does not have an occupant. Examples of a status code could be entering a number followed by the # key to indicate how many occupants are in a room 201-204 on a keypad (103). Other status codes could be entering *7 to indicate you are exiting or *8 to indicate you are injured and cannot evacuate. An individual response or combinations of responses can be entered by an occupant in response to a notification message.
In this example, John Smith responded that he is in room 201 and that he is exiting. Likewise, Sally Jones has indicated that she is in room 204 and is exiting. Jack Hammer has indicated that he is in Room 203. However, Jack Hammer has responded that he is injured and has not evacuated. The manager 108 then updates the map 200 in display 109 to indicate the response of each of the occupants in rooms 201, 203, and 204.
The flow of notification and response messages could happen in various orders. For example, a first notification message containing occupant instructions could be sent to devices 110-113 asking the occupant(s) to indicate how many people are in each of the rooms 201-204. The occupant(s) then respond and the manager 108 receives the response(s) which contain the occupant status. The manager 108 then sends a notification message containing occupant instructions to communication devices 110-113 to indicate that the occupants should use evacuation route 211.
The types of events that could be displayed and/or monitored may vary from those described above. For example, the acoustic sensor 102 could detect the event of a decrease in temperature. This could indicate that a window is broken or that a thermostat is broken in a room. Another event could be emergency responders shouting “clear” when they have determined that there are no occupants in a room. Another event could a communication device 110-113 failing to respond to a poll. This could indicate that the device has been damaged due to a fire or perhaps an impact to the building that has destroyed the communication device 110-113. Other events could include recognizing a voice, the breaking of a window, a movement detected by an accelerometer (e.g. an earthquake), and a sound of wind.
The manager 108 waits to receive 302 the reported events from one or more of the communication devices 110-113. If no reported events are received 302, the manager 108 waits to receive 302 the reported events. If the manager 108 receives 302 reported events from acoustic sensor 102, the manager 108 processes 303 the reported event(s) to determine 304 if a notification message based on location should be sent. If the manager 108 determines 304 that a notification message is not necessary, the process goes to step 306. Otherwise, if the manager 108 determines 304 that a notification message is necessary, the manager 108 sends 305 a notification message that may contain occupant instructions to at least one of the plurality of communication devices 110-113. The manager 108 updates 306 the map 200 with at least one of the events and at least one of the notification messages in conjunction with the locations (rooms 201-202). The manager 108 then waits to receive 302 a reported event from communication devices 110-113.
In response to the sending 305 of the notification message to one or more of the communication devices 110-113, the manager 108 waits to receive 401 a response message from one or more of the communication devices 110-113. If no response message is received, the manager 108 determines 405 if the manager 108 has waited too long without receiving a response from one or more of the communication devices 110-113. If the manager 108 determines 405 that the manager 108 has waited too long, the process goes to step 406. Otherwise, if the manager 108 determines 405 that the manager 108 has not waited too long, the process waits to receive 401 a response message from one or more of the communication devices 110-113.
The manager 108, after receiving 401 a response message, optionally determines 402 what type of notification message will be sent. For example, if the response message from step 401 indicates that the occupant is injured, the notification message sent in step 403 could tell the occupant that an emergency responder will be there in five minutes. If the response message received in step 401 indicates that the occupant is not injured, the notification message sent in step 403 informs the occupant to evacuate using a specific route. The manager 108 sends 403 the notification message to the appropriate communication device(s) 110-113. The manager 108 updates 404 the map 200 in the display 109 with the notification message. The process then goes to step 302 in
If the manager 108 determines 405 that it has waited too long and has not received a response message, the manager 108 determines 406 if the acoustic sensor 102 should monitor for an additional event. For example, the manager 108 could determine that the acoustic sensor 102 in communication device 110 should listen for someone talking. If the acoustic sensor 102 needs to monitor 407 for an additional event, the manager 108 instructs 408 the acoustic sensor 102 in communication device 110 to monitor for an additional event. The manager 108 updates 409 the map 200 in display 109 to indicate that no response message was received. The process then goes to step 302 in
Otherwise, if the communication device 110-113 determines 602 that a response is necessary, the communication device 110-113 waits 603 for a response from the occupant. The communication device 110-113 waits 603 until either there is a response from the occupant, or there is a timeout and no response. If there is a timeout before receiving a response from the occupant, the process is done 605. Otherwise, if there is a response from the occupant, the communication device 110-113 sends 604 a response message to the manager 108 and the process is done 605. The response message may include a response from the occupant.
Consider the following example of a process using the combined methods of
The manager 108 receives 302 a report from the acoustic sensor 102 in communication device 110 of a temperature event of 75°. The manager 108 processes 303 the temperature event of 75° and determines 304 that a sending a notification message is not necessary. The manager 108 updates 306 the map 200 in room 201 to indicate a temperature of 75°. The manager 108 determines 400 that since no notification was sent, the manager 108 does not need to wait for a response from communication device 110. The process goes to step 302.
The acoustic sensor 102 in communication device 110 detects 502 a gunshot event in room 201. Communication device 110 reports 503 the gunshot event to the manager 108. The manager 108 receives 302 the gunshot event from communication device 110. The manager 108 process 303 the gunshot event and determines 304 that a notification message containing occupant instructions should be sent to communication device 113. A notification message requesting the occupant (Sally Jones) in room 204 to identify the number of occupants in room 204 is sent 305 to communication device 113. The manager 108 updates 306 the map 200 with the gunshot event in room 201, and the notification message which indicates the number of occupants in room 204.
The manager 108 determines 400 that the notification message sent in step 306 to communication device 113 requires a response message. The manager waits (401, 405) for a response message from communication device 113. Communication device 113 receives 600 the notification message from step 305. Communication device 113 alerts Sally Jones by displaying and/or playing 601 the notification message. Communication device 113 determines 602 that a response is necessary. Communication device 113 instructs Sally Jones to enter a number indicating the number of occupants followed by the # key. Sally Jones enters 1#. After waiting 603 for the response, communication device 113 sends 604 a response message to the manager 108 indicating that there is a single occupant in room 201.
The manager 108 receives 401 the response message sent in step 604 containing the occupant status from communication device 113. The manager 108 determines 402 that a second notification message should be sent 403 based on the fact that a gunshot was detected in room 201. A second notification message containing occupant instructions indicating that Sally Jones should lock the door and hide under the desk is sent 403 to communication device 113. The manager 108 updates the map 200 to show the notification message requesting the occupant to lock the door and hide under the desk.
Communication device 113 receives 600 the second notification message sent in step 403 from the manager 108. Communication device 113 displays and/or plays 601 the notification message. Communication device 113 determines 602 that no response is necessary and the process is done 605.
In the above example, if Sally Jones did not respond (no response and timeout 603) and the manager 108 determined 405 that it had waited long enough for a response, the manager 108 determines 406 that the acoustic sensor in communication device 113 should monitor 407 for a specific event. The manager 108 instructs 408 the acoustic sensor in communication device 113 to acoustically monitor for the additional event of someone talking. The manager 108 updates 409 the map 200 in room 204 to indicate that no response was received to the notification message requesting Sally Jones to enter the number of occupants in room 204. The process goes to step 302 and the manager 108 waits to receive 302 event(s) from the acoustic sensor in communication device 113.
Communication device 113 receives 500 the instruction from step 408 to monitor the additional event of detecting someone talking. The acoustic sensor in communication device 113 monitors 501 the event of someone talking. The acoustic sensor in communication device 113 detects 502 the event of someone talking in room 204. Communication device 113 reports 503 the event of someone talking in room 204 to the manager 108. The manager 108 receives 302 the reported event of someone talking from communication device 113. The manager 108 processes 303 the event of detecting someone talking and determines 304 that a notification is not necessary. The manager 108 updates 306 the map 200 to indicate the event of hearing someone talking in room 204.
At this point, emergency responders know that there has been a gunshot detected in room 201. They also know that there is someone in room 204 who did not respond to the initial notification message. This could indicate that the person in room 204 is injured and cannot respond to the notification message. This allows emergency responders to assess the situation and respond in an informed manner.
Of course, various changes and modifications to the illustrative embodiment described above will be apparent to those skilled in the art. For example, the sound of events could be recorded for playback and/or event notifications could be sent to key people in the enterprise. These changes and modifications can be made without departing from the spirit and the scope of the system and method and without diminishing its attendant advantages. It is therefore intended that such changes and modifications be covered by the following claims except insofar as limited by the prior art.
Number | Name | Date | Kind |
---|---|---|---|
5598456 | Feinberg | Jan 1997 | A |
6529128 | Weng | Mar 2003 | B2 |
6738456 | Wrona et al. | May 2004 | B2 |
6762686 | Tabe | Jul 2004 | B1 |
7366674 | Dione | Apr 2008 | B2 |
7403116 | Bittner | Jul 2008 | B2 |
7627138 | Julia et al. | Dec 2009 | B2 |
20020126009 | Oyagi et al. | Sep 2002 | A1 |
20040233983 | Crawford et al. | Nov 2004 | A1 |
20050146606 | Karsenty et al. | Jul 2005 | A1 |
20050197097 | Mohler | Sep 2005 | A1 |
20050244014 | Elko et al. | Nov 2005 | A1 |
20080258924 | Moss | Oct 2008 | A1 |
20090243852 | Haupt et al. | Oct 2009 | A1 |
Number | Date | Country |
---|---|---|
0454421 | Oct 1991 | EP |