Patent Application
20210166534
This document generally describes technology for automatically determining a floor map of a building and using the floor map for advising how to exit the building during an emergency.
Fire districts strongly urge home residents to create a home fire escape plan, in written document form, that includes a map of a house layout, immediate exterior grounds, and details on windows and doors. Plan recommendation includes taking stock of each member of the household and identifying two pathways (e.g., doors, windows) for escape from each room in the house. Fire districts recommend that families become familiar with their escape plan and to rehearse the escape plan at least twice a year. However, many families fail to create an escape plan, let alone practice the escape plan regularly.
A system for dynamically selecting egress plans during an emergency. A computing device can receive signals indicating an emergency in the building and user presence information, determine a type of the emergency, predict locations of the users within the building, transmit, to an emergency responders computing device, the indication of the emergency and predicted locations of the users within the building, receive, from the emergency responders computing device, an estimated responders arrival time based on a current distance of emergency responders from the building, select one or more of the determined egress plans to direct the users to exit the building, send, to signaling devices in the building, signaling instructions for the signaling devices to emit signals indicating to the users the selected one or more egress plans, and send, to the emergency responders computing device, the selected one or more egress plans.
A peer-to-peer system for providing egress guidance. Each of a plurality of egress advisement devices can receive an indication of an emergency in a building and user presence information, transmit to a cloud data store a request for one or more egress plans, receive from the cloud data store a subset of the egress plans that are identified by matching a location identifier for each of the subset of the plans with the location information of the egress advisement device, locally select one of the subset of the plans that is customized for a location of the egress advisement device, a current location of users in the building in proximity to the egress advisement device, and a location of the emergency, and output the selected plan to guide one or more of the users in proximity to the egress advisement device to exit the building.
A system for centrally managing and executing emergency egress guidance. A first computing device can receive an indication of an emergency and user presence information in a building, retrieve, from a local data store, generated egress instructions for the building, select, for each of a plurality of egress advisement devices and based on the emergency indication, user presence information, and location of each egress advisement device, one of the egress instructions that is customized for each egress advisement device, and transmit, to each egress advisement device, the selected instructions to be outputted to guide users to exit the building. Each egress advisement device can determine that communications are terminated between the egress advisement devices and the computing device, obtain the emergency indication and user presence information, and retrieve, from the local data store, a second of the egress instructions associated with the location of the device.
A system for emergency egress advisement from a building. An egress advisement device can receive a floormap and subset of emergency egress instructions associated with routes within the building, wherein the subset of instructions are associated with a location of the egress advisement device and are used, by the device, to direct users in proximity to the location of the device to egress from that location during an emergency, locally store the floormap and subset of instructions, receive a signal indicative of an emergency, locally select, based on real-time conditions in the building relative to the location of the egress advisement device, one of the subset of instructions, which is customized for users in proximity to the location of the egress advisement device, and output the selected instructions to guide the users in proximity to the location of the egress advisement device to egress from the building.
This document generally describes technology for automatically determining a floor map of a building and using the floor map for advising how to exit the building during an emergency. A monitoring system can automatically create an escape plan, based on pre-disaster and in-disaster motion detection of users within the home, and provide dynamic advisement to guide users out of the home during an emergency. The monitoring system can identify and guide users to essential egress routes, which can be critical if occupants have not created or rehearsed an escape plan. For example, during a fire, strategically placed voice guidance prompts can instruct residents in each room of a home regarding effective egress paths, based on previously automatically identified floor maps and current fire location information. Although fire detection and evacuation are described, the monitoring system can be used to detect and advise for other types of emergencies, such as gas leakage, water leaks, thieves trying to enter a home, and carbon dioxide detection, to name a few examples.
In one implementation, a system includes a central monitoring system for monitoring a building, user detectors, fire detectors, and signaling devices. The user detectors are configured to detect the presence of users within the building. The fire detectors are configured to detect locations of fires within the building. The signaling devices are configured to emit signals to indicate an exit route for exiting the building. The central monitoring system is configured to receive user presence information from the user detectors, and use the user presence information to determine a floormap of the building. The floormap indicates routes within the building, including exits out of the building. The system is further configured to receive fire indication information from the fire detectors located within the building. The fire indication information indicating one or more locations within the building that may have a fire. The system may determine, based on the floormap and the fire indication information, one or more exit routes that can be used by users to exit the building. The exit routes are to avoid the locations within the building that may have the fire. The system may send signaling instructions to the signaling devices for the signaling devices to emit a signal to indicate to the user an exit route to exit the building.
Such a system can optionally include one or more of the following features. Each given user detector may be configured to detect motion of users in proximity to the given user detector. The emitted signals may include voice commands. The emitted signals may include light signals. The light signals may include directional signals that direct users to an exit route. The fire indication information may include temperature readings. The fire indication information may include a rate of change of temperature readings.
In one implementation, a computer-implemented method includes receiving user presence information from user detectors; determining a floormap of the building based on the user presence information, the floormap indicating routes within the building, the routes including exits out of the building; receiving fire indication information from fire detectors located within the building, the fire indication information indicating one or more locations within the building that may have a fire; determining, based on the floormap and the fire indication information, one or more exit routes that can be used by users to exit the building, the exit routes avoiding the locations within the building that may have the fire; and send signaling instructions to signaling devices for the signaling devices to emit a signal to indicate to the user at least one of the exit routes to exit the building.
Such a method can optionally include one or more of the following features. Each given user detector may be configured to detect motion of users in proximity to the given user detector. The emitted signals may include voice commands. The emitted signals may include light signals. The light signals may include directional signals that direct users to an exit route. The fire indication information may include temperature readings. The fire indication information may include a rate of change of temperature readings.
Other embodiments of these aspects include corresponding apparatus and computer programs recorded on one or more computer storage devices, configured to perform the actions of the methods. A system of one or more computers can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes or cause the system to perform the actions. One or more computer programs can be configured to perform particular operations or actions by virtue of including instructions that, when executed by data processing apparatus, cause the apparatus to perform the actions.
The details of one or more implementations are depicted in the associated drawings and the description thereof below. Certain implementations may provide one or more advantages. For example, an emergency plan can be generated, and used in an emergency, even if residents have not previously generated an emergency plan. Dynamic evacuation guidance can be provided that is based on real-time situational information about occupants and compromised location(s) within a building. Real time information about a current incident can be exchanged between a monitoring system and emergency personnel systems. A monitoring system can evaluate possible evacuation routes, determined from automatically generated floor maps, to select recommended evacuation route(s), and instruct signaling devices to inform users of the recommended evacuation route(s).
Other features, objects, and advantages of the technology described in this document will be apparent from the description and the drawings, and from the claims.
Like reference symbols in the various drawings indicate like elements.
A route/floormap determiner 106 included in the central monitoring system 101 can use the user presence information 104 to determine and store a floormap 108 of the building. The floormap 108 indicates routes within the building, including exits out of the building.
The system 100 includes fire detection devices 110 for detecting locations of fires within the building. The fire detection devices 110 can be of various configurations, such as a smoke detector and a heat sensor (e.g., a temperature sensor, an infrared sensor, etc.).
The central monitoring system 101 can receive fire indication information 112 from the fire detection devices 110 that may indicate one or more locations within the building that may have a fire. A fire determiner 114 in the central monitoring system 101 can determine whether the fire indication information 112 indicates the presence of a fire. The fire indication information 112 can be temperature readings for example, as described in more detail below.
The route/floormap determiner 106 can determine, in response to the fire determiner 114 determining a presence of a fire, one or more exit routes 116 that can be used by users to exit the building, based on the floormap 108 and the fire indication information 112. The determined exit routes 116 can be selected so at to avoid the locations within the building that may have a fire (e.g., the fire indication information 112 can indicate location(s) of single or multiple fires within the building).
A notification engine 118 can generate and send signaling instructions 119 to signaling devices 120 located in the building, for the signaling devices 120 to emit signal(s) to indicate to users the determined routes 116 out of the building. The emitted signals can be voice commands, lighted signals, or other signals, as described in more detail below.
The central monitoring system 101 can further include a system improvement engine 130. The improvement engine 130 can employ machine learning to improve various functions of the central monitoring system 101, such as functions performed by the route/floormap determiner 106, the fire determiner 114, and the notification engine 118. In some embodiments, the improvement engine 130 is configured one or more engines that are separate from the other modules or engines (e.g., the route/floormap determiner 106, the fire determiner 114, and the notification engine 118) in the central monitoring system 101. Alternatively, the modules or engines of the central monitoring system 101 (e.g., the route/floormap determiner 106, the fire determiner 114, and the notification engine 118) are configured to operate functions of the improvement engine 130.
In some examples, the improvement engine 130 is configured to process an input, such as the user presence information 104, and generate a floormap 108 based on the input. In addition or alternatively, the improvement engine 130 is configured to process an input, such as the floormap 108 and the fire indication information 112, and generate, based on the input, one or more exit routes 116 which are used to evacuate users in the building.
In some examples, the improvement engine 130 can be trained to generate and update the floormap 108 adapted to changing aspects of occupancy by residents as well as visitors of a building. Further, the improvement engine 130 can be trained to predict presence and whereabouts of users in a building in response to determination of presence of a fire and generate at least one exit route 116. An example method for training the improvement engine 130 is illustrated and described with reference to
The improvement engine 130 operates to bolster functioning and effectiveness of the central monitoring system 101 by adjusting the system 101 for changing circumstances in occupant status or occasions with guests. As such, an egress plan for a building can be modified rapidly with changing occupant circumstances including guest visitation. Such a plan can be stored locally in the system and in a cloud for redundancy. In certain examples, biometric sensing devices are also employed in implementing the improvement engine 130 and/or other operations of the system 101.
In addition to real time exit route guidance, a general home escape plan can be automatically created, based on automatically-determined floor maps, and made available for users, to view and rehearse, before emergencies happen. Generated plans can be stored both locally in the central monitoring system 101 of the house, as well as in the cloud for failsafe redundancy. Generated plans can be viewed and maintained by residents. For example, residents can update a plan, such as when changes in occupancy occur over time, or when changes in family membership occur (e.g., newborns, grown children leaving the household, deaths, and so forth), and occasions with babysitters or house guests in the home.
The system 100 can include features for assisting disabled users. For example, a deaf user could wear or carry a device (e.g., a wearable device or a hand-held device) that uses vibrational signals to guide the user on identified exit routes. As another example, a blind user could wear or carry a device that provides continuous audible verbal messages for egress guidance (e.g., to supplement other fixed audio devices or act as a substitute if fixed audio devices are not functioning).
The system 100 can include other features. For example, some or all devices included in the system 100 can include battery backup (e.g., lithium) for use in case of a power outage affecting some parts or all of a building. The system 100 can employ various hardware and software security measures, to prevent local or remote hacking. Security measures can prevent unauthorized users (e.g., would-be thieves) from obtaining information about a building floor plan, for example. Other features are described in more detail below.
In some embodiments, the system 100 can be used as a stand-alone system for a fire egress and guidance system. Other configurations for the system 100 are also possible.
In addition to motion detectors, the house 200 may include various smart thermostat devices throughout the house 200 that can detect a presence of a fire and communicate other information to the central monitoring system 210, for example. In some implementations, the devices 214, 216, 218, 220, 222, 224, and 226 include both a motion detector and a smart thermostat. In other implementations, other smart thermostat devices that do not include motion detectors are included in the house 200.
In general, devices that communicate with the central monitoring system 210 can include one or more of a smart thermostat, smoke detector, smart outlet covers, and signaling devices located, e.g., on doors and windows. A given device may provide one function or multiple functions (e.g., a smart outlet cover may include a motion detector and one or more signaling devices).
Although one central monitoring system 210 is shown, multiple monitoring devices may be included in the home 200, such as one monitoring device per room. A smart thermostat or a smoke detector can be a secondary monitoring device, for example. A secondary monitoring system (and the central monitoring system 210) can include various sensors (e.g., for fire, smoke, and motion detection) and/or can communicate with other sensors included in an area monitored by the respective monitoring device.
In some implementations, the central monitoring system 210 is a master monitoring system and other monitoring devices are secondary monitoring systems. In some implementations, each secondary monitoring system can take over control as a new master monitoring system if the central monitoring system 210 is out of commission (e.g., consumed by fire). A new master monitoring system can operate using last-received information from the central monitoring system 210 and information received from other secondary monitoring systems. In some implementations, all monitoring systems located in the house 200 can act as peer devices (e.g., pre-disaster and/or during a disaster), with no device designated as a master monitoring device.
As mentioned, devices included in the house 200 can connect to the central monitoring system 210 using one or more wired or wireless connections. Additionally or alternatively, devices in the house 200 can connect to a cloud based service, to upload information and download information provided by other devices, so that a given device can send and receive data even if in an home network is compromised, e.g., by fire. For example, during a disaster, devices may not be able to communicate on a local network, but a smart thermostat in one room and the central monitoring system 210 may each be able to communicate with the cloud service (e.g., using a cellular network) and thereby exchange information with each other, using the cloud service as an intermediary.
Various devices, e.g., secondary monitoring systems or other devices that include motion detection, such as the devices 214, 216, 218, 220, 222, 224, and 226, can provide motion detection information to the central monitoring system 210 and/or to secondary monitoring system(s). Each motion detection device can have a known location within the house 200, and can provide a device identifier along with provided motion detection information. The central monitoring system 210 can use the received motion detection information to determine the floor map 212 of the house 200. The floor map 212 indicates paths into and out of the house 200, and paths into and out of respective rooms or on the stairway 203. The motion detection information can indicate the paths that users frequently use while moving within the house 200. Paths can be identified by time and location of detected motion, as well as direction of motion as indicated by successive motion detection data points. For example, first, second and third motion sensors may detect motion at first, second, and third time points that are one second apart, indicating that a user moved between locations associated with the first, second, and third motion sensors. Frequency of movement, over time, can indicate main paths throughout the house 200. For example, motion detectors may detect occasional movement of a user in a corner of a room (e.g., by a dresser), but may more often detect movement of users in hallways, through doorways, on stairs, etc. The central monitoring system 210 may know which sensors are in proximity to doors (e.g., room doors, exit doors) and windows, and can identify paths that lead into and out of rooms and out of the house 200.
Sensors can be located on doors or windows. The central monitoring system 210 can determine an exit path by detecting movement of user towards a door and then the opening of that door. As a similar example, the central monitoring system 210 can detect a path that includes an exit by detecting the opening of a door when a user enters, and then detecting continuous movement of a user through the house 200 to a location within the house. The central monitoring system 210 can identify path segments within the house 200 that interconnect and that lead to an exit (e.g., door, window).
The central monitoring system 210 (or a secondary monitoring system) can receive information that indicates a presence of a fire within the house 200. For example, the central monitoring system 210 can receive (or can generate) information that indicates the presence of a fire 228 within the lower level 202 of the house 200. The presence of the fire 228 can be determined, for example, based on one or more received temperature readings being more than a threshold temperature. As another example, the central monitoring system 210 can receive a fire indication signal from one or more smoke detection devices. Other fire detection approaches can include IR (Infra-Red) fire detection and rate of rise temperature detection. Fire indication information can indicate which location(s) in the house 200 are on fire (or sufficiently close to a fire so as to be avoided by occupants of the house 200).
The central monitoring system 210 can determine, based on the floor map 212 and the received fire indication information, one or more exit routes that can be used by users to exit the house 200. The exit routes can include portions of the floor map 212 that avoid the locations within the house 200 that have been identified as locations to be avoided. For example, based on the location of the fire 228 being on the left side of the house 200, the central monitoring system 200 can determine that the stairs 203 are currently usable. Accordingly, the central monitoring system 210 can determine an exit path that routes upstairs occupants down the stairs 203 and out a front door 230.
After determining the exit route(s), the central monitoring system 210 can generate and send signaling instructions to various signaling devices located in the house 200, for the signaling devices to emit signal(s) to guide the user to an exit route that will safely lead the user out of the house 200.
Signaling devices can emit multi-colored, strobing, LED (Light Emitting Diode) laser light, and can be mounted low, at exit points (e.g., door, window) in each room. LED guiding lights, can be mounted low in outlet-type components, in pathways leading to egresses from the home. Signaling devices can emit various audio and visual cues to the user, for example. For instance, signaling devices can include flashing lights that may indicate a direction a user is to take to proceed to (or stay one) an exit route. A series of flashing lights (e.g., in a hallway) may indicate a presence and direction of an exit route. Signaling devices can be placed onto doors and windows, to indicate the presence of respective doors and windows, and to indicate whether a given door or window is part of an exit route. Different colors can indicate inclusion or exclusion of a given door, window, or pathway on an exit route. For example, a flashing red signal (e.g., a red “X”) on a doorway may indicate that the doorway is to be avoided (and the door kept shut). A flashing green light may indicate that the given door, window, or path segment is part of the exit route.
Signaling devices can be configured to play audio instructions for a user, for providing directional guidance towards egresses. Audio instructions can include a fire status description (e.g., “a fire has been detected downstairs”), directional clues (e.g., “go out of the door and to your left”), or more detailed instructions (e.g., “place a wet towel under the door and leave the door closed”). Audio instructions can be specific to the particular room in which an audio signaling device is located, based on the location of the room, the location of the detected fire, and a determined exit route.
For the particular example of the fire 228 located in the left of the lower level 202, the central monitoring system 210 can emit a lighted directional signal and an audio instruction 232 directing users located in the lower level 202 to proceed to and exit the front door 230. Signaling instructions can be sent from the central monitoring system 210 to the device 218 located near an entry to the lower level 202, for the device 218 to play an audio instruction 234 directing users to not enter the lower level 202.
Signaling instructions can be sent from the central monitoring system 210 to devices located in the room 206, for the devices to direct users located in the room 206 out of the home 200. For example, the devices 224 and 226 can emit lighted arrows that direct the user to a bedroom door 236 and out of the room 206. Signaling devices located on or near the bedroom door 236 (e.g., a signaling device 237) can emit, in response to received instructions, signals (e.g., lighted) indicating the presence of the bedroom door 236 and that the user is to go through the bedroom door 236. Signaling devices located on or near windows 238 and 240 can emit, in response to received instructions, signals (e.g., lighted) indicating that the windows 238 and 240 are not part of a recommended exit route. The device 226 (or another device) can, in response to a received instruction, emit an audio instruction 242 that directs users in the room 206 to exit the room 206 and proceed to the stairs 203. The device 222, located in the hallway 205, can emit a lighted arrow directing users down the hallway 205 and an audio instruction 244 that directs the users to the stairs 203.
Signaling instructions similar to those sent to devices in the room 206 can be sent to devices in the room 208. Signals emitted by devices in the room 208, including an audio instruction 246 played by the device 220, can direct users out of the room 208 (e.g., through a door 246 and down the stairs 203), rather than out a window 248 or a window 250.
Other types of signaling instructions and corresponding signals can be generated in the house 200. For example, information can be sent to mobile devices of occupants of the house 200, that directs the occupants to and on the determined exit routes. The central monitoring system 210, secondary monitoring systems, and/or an application running on a mobile device may know where the mobile device (and associated user) are within the house 200, with respect to the fire and the determined exit routes. Such knowledge can be used to tailor instructions that are sent to and displayed (or played) on a given mobile device.
Other devices in the home may receive and present information related to the fire 228 and recommended evacuation of the house 200. For example, the central monitoring system 210 can communicate with various computing devices or displays located within the house 200. For example, the central monitoring system 210 can send information or signaling instructions to one or more desktop computing devices, smart televisions, or other devices located within the house 200. The computing devices can be configured to display information (e.g., a fire warning, exit route information), based on information received from the central monitoring system 210. In some implementations, the central monitoring system 210 can remotely control (e.g., turn on) devices that include a display, and instruct the devices to display (and/or play) information useful for evacuation of the home 200, such as exit route information that is specific to the location of the fire 228 and the location of the respective device (e.g., a smart television in the lower level 202 may display different information from a smart television in the room 208).
Signaling instructions can be sent from the central monitoring system 310 to various devices located in the house 300. For example, signaling instructions can be sent to devices in the room 308, for those devices to direct users located in the room 308 out of the home 300. For example, a device 326 can emit a lighted arrow that direct users in the room 308 to the window 324 and the window 322. Signaling devices (e.g., a device 327) located on or near a bedroom door 328 can emit, in response to received instructions, signals (e.g., lighted) indicating that the bedroom door 328 is not part of a recommended exit route. Signaling devices 332 and 334, and 336 and 338, located on or near the window 322 or the window 324, respectively, can emit, in response to received instructions, signals indicating the presence of the window 322 or the window 324 and that the windows are part of a recommended exit route. The device 326 (or another device) can, in response to a received instruction, emit an audio instruction 340 that directs users in the room 308 to exit the room 308 using a window and not the front entrance 314.
Similar signaling instructions sent to devices in the room 308 can be sent to devices in the room 306. The signaling instructions sent to devices in the room 306 can result in an audio instruction 342 being played by a device 344, and emitted (e.g., lighted) signals produced by the device 344, a device 346, and signaling devices 348, 350, 352, 354, and 356 located on or near the window 318, the window 320, or a bedroom door 358, respectively.
A device 360 in the hallway 304 can receive a signaling instruction, and in response, emit a lighted arrow directing users towards the bedroom door 358 (and the windows 318 and 320) and play an audio instruction 362 that directs users to use a window and avoid the front entrance 314. Similarly, a device 364 in the hallway 304 can receive a signaling instruction, and in response, emit a lighted arrow directing users towards the bedroom door 328 (and the windows 322 and 324), and away from the front entrance 314.
The central monitoring system 410 can determine, based on the floor map 412 and the received fire indication information, one or more exit routes that can be used by users to exit the house 400. For example, the central monitoring system 410 can determine that a front entrance 416 is blocked based on the location of the fire 414, and can direct users on the lower level 402 to exit through a window. For instance, a device 418 can play an audio signal 420 and emit directional indicators directing users to a window 422.
The central monitoring system 410 can determine that the fire 414 is blocking the stairway 403, and can determine that no paths on the floor map 412 lead directly to an exit door without using the blocked stairway 403. The central monitoring system 410 can determine exit guidance instructions to send to devices in the upper level, to guide users on how to exit the home 400 without using the blocked stairway 403. For example, instructions can be sent to a device 424 to play an audio message 426 that directs users to use a ladder, if available, to exit through an upstairs window. If a ladder is not available, the device 424 directs the users to get a wet towel, place it under a door 428, close the door 428 (and not subsequently open it), and signal firefighters from a window (e.g., a window 430).
Based on known locations of the fire 414 and the bathroom 409, the central monitoring system 410 may determine that a user has time and access to retrieve a wet towel before closing the door 428. The central monitoring system 410 may know that the door 428 is currently open (e.g., based on information provided by one or more sensors on the door 428), and may direct users to get the wet towel based on the door 428 being currently open. If the central monitoring system 410 knows that the door 428 is currently closed, the central monitoring system 410 may direct the device 424 to play a message that directs users to keep the door 428 closed.
Other signals can be emitted in the bedroom 406. For example, the device 424 and a device 428 can direct users towards the window 430, by emitting directional lights. Devices 436 and 438 can emit signals to indicate the presence of the window 430.
Guidance similar to that provided in the bedroom 406 can be provided in the bedroom 408. For example, devices 440 and 442 and 444 and 446 can indicate the presence of a window 448 or a window 450, respectively. A device 452 can emit a directional signal directing users to the window 448 and the window 450, and can play an audio recording 454 that directs users to not use the stairway 403. A device 456 can emit a signal indicating that a door 458 is not part of a recommended exit route.
Other signals can be played throughout the house 400. For example, devices 460 and 462 in the hallway 405 can play audio messages 464 and 466, respectively, directing users to not use the stairway 403. A device 468 can play an audio message 470 directing users to not enter the lower level 402. The various signals played by various devices in the house 400 can be emitted in response to signaling instructions sent to the various devices by the central monitoring system 410 (or another monitoring device).
In some implementations, fire fighter or other safety personnel can receive information provided by the central monitoring system 410. The central monitoring system 410 can send information to a fire fighter system or device and/or the central monitoring system 410 can send information to a cloud service to enable the fire fighter system or device to retrieve the information from the cloud service.
Information obtained from the central monitoring system 410 can be displayed, for example, on a fire fighter device 472, which can be a mobile device, as shown (e.g., in a fire truck 474 that is en route to the house 400). The fire truck 474 may be en route, based on receiving an alarm from the central monitoring system 410. Information 476 displayed on the fire fighter device 472 includes fire location and stairway blockage information 478, number and location of occupants 480 (e.g., for an occupant 481), last occupant movement information 482, status 484 of doors and windows in the house 400, and a timeframe 486 of when last audio instructions were played for users in the house 400. In addition or alternatively, the information 476 can include location of fire hydrants. The information 476 can be used by the fire fighters to better respond to the fire situation in the house 400.
The number and location of occupants 480 and the last occupant movement information 482 can be generated based on motion detection devices in the house 400. Fire fighters can tailor their emergency response based on information that indicates who may be in the house 400 and where they are located. Occupant movement information can be generated and sent to a cloud service, on a periodic basis, for example. Security measures can be implemented so that occupant movement information is only accessed by authorized personnel, and optionally, only in cases of an emergency (e.g., only fire fighters may be able to view occupant status information and only after an alarm has been received from the central monitoring system 410). For some cases, the central monitoring system 410 may know that no occupant movement has been detected, e.g., within the last forty eight hours, which may indicate that the house 400 is not occupied. Such information may be shared with fire fighter systems, so that fire fighters know that the house 400 may not be occupied and thus can determine whether fire fighters need to endanger themselves if entering the house 400 (or a certain level of the house 400) may be dangerous.
Fire fighter systems can share information with the central monitoring system 410, and the central monitoring system 410 may tailor guidance based on the received information. For example, an estimated fire fighter response time may be sent by a fire fighter system in response to an alarm received from the central monitoring system 410. The central monitoring system 410 may select certain instructions based on the response time. For example, if the expected response time is less than a threshold amount (e.g., less than two minutes), the central monitoring system 410 may direct devices in the upper level to play an audio message directing users in the upper level to open a window and wave a towel or sheet to attract fire fighter attention. In other examples, the central monitoring system 410 can operate to devices to start playing a sound or audio message to draw attention of fire fighters based on an estimated fire fighter response time. Estimated response times may be dynamically received, as mentioned, or may be predetermined and available to the central monitoring system 410 before the emergency.
Occupant movement information and information about known occupants may be used by the central monitoring system 410 to tailor guidance to users in the house 400. For example, an emergency plan, which may have been partially generated by the central monitoring system 410 and manually edited by user(s) in the house 400, may indicate that a child under the age of six generally sleeps in a particular bedroom. The central monitoring system 410 may, based on this information and based on movement detection in that bedroom during an emergency, generate an audio message to be played in other rooms that indicates that the child may still be in the particular bedroom and may need assistance. Similar guidance may be performed if elderly or disabled users are in the house 400.
In some implementations, after fire fighter arrival, movement of fire fighters within the house 400 can be determined by movement detection devices within the house 400. Location information of fire fighters (and occupants) can be made available to and presented on the fire fighter device 472, for assisting the fire fighter team during the emergency response.
The central monitoring system can receive user presence information from user detection devices (502). The user detection devices can detect the presence of users within the building, such as by using motion detection.
The central monitoring system can use the user presence information to determine a floormap of the building (504). The floormap can indicate routes within the building, including exits out of the building.
The central monitoring system can receive fire indication information from the fire detection devices located within the building (506). The fire indication information can indicate one or more locations within the building that may have a fire.
The central monitoring system can determine, based on the floormap and the fire indication information, one or more exit routes that can be used by users to exit the building (508). The exit routes are can be selected to avoid the locations within the building that may have a fire.
The central monitoring system can send signaling instructions to signaling devices for the signaling devices to emit a signal to indicate to the user an exit route to exit the building (510).
The apparatus 600 includes a user detector 602, a fire detector 604, a communication device 606, a speaker 608, and a display device 610. The user detector 602 can be configured for, or be part of, the user detection device 103 as discussed herein. For example, the user detector 602 operates to detect user motion or presence around the apparatus 600 over time. The user motion or presence can be recorded locally in the apparatus 600 and/or in one or more remote computing devices. As described herein, the user detector 602 can be of various types, such as motion sensors and cameras. In addition or alternatively, the user detector 602 can include a door/window sensor, door/window locks, etc.
The fire detector 604 can be configured for, or be part of, the fire detection device 110, and operates to detect presence and location of fire. Information on the fire presence and location can be recorded locally in the apparatus 600 and/or in one or more remote computing devices. As described herein, the fire detector 604 can be of various types, such as a smoke detector and a heat sensor (e.g., a temperature sensor, an infrared sensor, etc.).
The communication device 606 is included in the apparatus 600 and configured to enable data communication with the central monitoring system 101 and/or other computing devices via the network(s) 102. The communication device 606 can include a wireless or wired data communication interface.
The speaker 608 and the display device 610 can be configured for, or be part of, the signaling device 120. The speaker 608 operates to generate sounds, such as audible cues, horns, or verbal messages for egress guidance. The speaker 608 can be used to supplement other fixed audio devices or act as a substitute if fixed audio devices are not functioning. Such sounds can complement visual signs in situations where smoke intensity can diminish or preclude the ability to see the visual signs.
The display device 610 operates to display visual signs that can guide a user along an exit route 116. In some examples, the display device 610 includes a display screen that is provided in the apparatus 600 and displays information with visual signs thereon. In addition or alternatively, the display device 610 operates as a projector that projects a lighted sign on another object, such as a wall, a floor, or a ceiling. In the illustrated example, the display device 610 projects a lighted arrow on the floor to guide the direction in an exist route 116.
The training system 700 includes a training subsystem 706 that can implement the operations of a machine learning model that is designed to generate a floormap 108 from the user presence information 104, and/or generate one or more exit routes 116 from the floormap 108 and the fire indication information 112. The training subsystem 706 includes a plurality of computing devices having software or hardware modules that build one or more statistical models. Where the training subsystem 706 uses a neural network, the training subsystem 706 operates to implement operations of each layer of the neural network according to an architecture of the neural network. Generally, the training subsystem 706 has the same architecture as the improvement engine 130. However, the training system 700 need not use the same hardware to compute the operations of the statistical models. In other words, the training system 700 can use CPUs only, highly parallelized hardware, or some combination of these.
The training subsystem 706 can compute the operations of the statistical models using current parameter values 716 stored in a collection of model parameter values 714. Although illustrated as being logically separated, the model parameter values 714 and the software or hardware modules performing the operations may actually be located on the same computing device or on the same memory device.
The training subsystem 706 can generate, for each training example 704, an output 708 (e.g., a floormap 108 or an exit route 116). A training engine 710 analyzes the output 708 and compares the output 708 to labels in the training examples 704 that indicate target outputs for each training example 704. The training engine 710 then generates updated model parameter values 714 by using an appropriate updating technique, e.g., stochastic gradient descent with backpropagation. The training engine 710 can then update the collection of model parameter values 714 using the updated model parameter values 712.
After training is complete, the training system 700 can provide a final set of parameter values 718 to the central monitoring system 100 for use in generating a floormap 108 or an exit route 116. The training system 700 can provide the final set of model parameter values 718 by a wired or wireless connection to the central monitoring system 101, for example.
The computing devices described in this document that may be used to implement the systems, techniques, machines, and/or apparatuses can operate as clients and/or servers, and can include one or more of a variety of appropriate computing devices, such as laptops, desktops, workstations, servers, blade servers, mainframes, mobile computing devices (e.g., PDAs, cellular telephones, smartphones, and/or other similar computing devices), computer storage devices (e.g., Universal Serial Bus (USB) flash drives, RFID storage devices, solid state hard drives, hard-disc storage devices), and/or other similar computing devices. For example, USB flash drives may store operating systems and other applications, and can include input/output components, such as wireless transmitters and/or USB connectors that may be inserted into a USB port of another computing device.
Such computing devices may include one or more of the following components: processors, memory (e.g., random access memory (RAM) and/or other forms of volatile memory), storage devices (e.g., solid-state hard drive, hard disc drive, and/or other forms of non-volatile memory), high-speed interfaces connecting various components to each other (e.g., connecting one or more processors to memory and/or to high-speed expansion ports), and/or low speed interfaces connecting various components to each other (e.g., connecting one or more processors to a low speed bus and/or storage devices). Such components can be interconnected using various busses, and may be mounted across one or more motherboards that are communicatively connected to each other, or in other appropriate manners. In some implementations, computing devices can include pluralities of the components listed above, including a plurality of processors, a plurality of memories, a plurality of types of memories, a plurality of storage devices, and/or a plurality of buses. A plurality of computing devices can be connected to each other and can coordinate at least a portion of their computing resources to perform one or more operations, such as providing a multi-processor computer system, a computer server system, and/or a cloud-based computer system.
Processors can process instructions for execution within computing devices, including instructions stored in memory and/or on storage devices. Such processing of instructions can cause various operations to be performed, including causing visual, audible, and/or haptic information to be output by one or more input/output devices, such as a display that is configured to output graphical information, such as a graphical user interface (GUI). Processors can be implemented as a chipset of chips that include separate and/or multiple analog and digital processors. Processors may be implemented using any of a number of architectures, such as a CISC (Complex Instruction Set Computers) processor architecture, a RISC (Reduced Instruction Set Computer) processor architecture, and/or a MISC (Minimal Instruction Set Computer) processor architecture. Processors may provide, for example, coordination of other components computing devices, such as control of user interfaces, applications that are run by the devices, and wireless communication by the devices.
Memory can store information within computing devices, including instructions to be executed by one or more processors. Memory can include a volatile memory unit or units, such as synchronous RAM (e.g., double data rate synchronous dynamic random access memory (DDR SDRAM), DDR2 SDRAM, DDR3 SDRAM, DDR4 SDRAM), asynchronous RAM (e.g., fast page mode dynamic RAM (FPM DRAM), extended data out DRAM (EDO DRAM)), graphics RAM (e.g., graphics DDR4 (GDDR4), GDDR5). In some implementations, memory can include a non-volatile memory unit or units (e.g., flash memory). Memory can also be another form of computer-readable medium, such as magnetic and/or optical disks.
Storage devices can be capable of providing mass storage for computing devices and can include a computer-readable medium, such as a floppy disk device, a hard disk device, an optical disk device, a Microdrive, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations. Computer program products can be tangibly embodied in an information carrier, such as memory, storage devices, cache memory within a processor, and/or other appropriate computer-readable medium. Computer program products may also contain instructions that, when executed by one or more computing devices, perform one or more methods or techniques, such as those described above.
High speed controllers can manage bandwidth-intensive operations for computing devices, while the low speed controllers can manage lower bandwidth-intensive operations. Such allocation of functions is exemplary only. In some implementations, a high-speed controller is coupled to memory, display 616 (e.g., through a graphics processor or accelerator), and to high-speed expansion ports, which may accept various expansion cards; and a low-speed controller is coupled to one or more storage devices and low-speed expansion ports, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) that may be coupled to one or more input/output devices, such as keyboards, pointing devices (e.g., mouse, touchpad, track ball), printers, scanners, copiers, digital cameras, microphones, displays, haptic devices, and/or networking devices such as switches and/or routers (e.g., through a network adapter).
Displays may include any of a variety of appropriate display devices, such as TFT (Thin-Film-Transistor Liquid Crystal Display) displays, OLED (Organic Light Emitting Diode) displays, touchscreen devices, presence sensing display devices, and/or other appropriate display technology. Displays can be coupled to appropriate circuitry for driving the displays to output graphical and other information to a user.
Expansion memory may also be provided and connected to computing devices through one or more expansion interfaces, which may include, for example, a SIMM (Single In Line Memory Module) card interfaces. Such expansion memory may provide extra storage space for computing devices and/or may store applications or other information that is accessible by computing devices. For example, expansion memory may include instructions to carry out and/or supplement the techniques described above, and/or may include secure information (e.g., expansion memory may include a security module and may be programmed with instructions that permit secure use on a computing device).
Computing devices may communicate wirelessly through one or more communication interfaces, which may include digital signal processing circuitry when appropriate. Communication interfaces may provide for communications under various modes or protocols, such as GSM voice calls, messaging protocols (e.g., SMS, EMS, or MMS messaging), CDMA, TDMA, PDC, WCDMA, CDMA2000, GPRS, 4G protocols (e.g., 4G LTE), and/or other appropriate protocols. Such communication may occur, for example, through one or more radio-frequency transceivers. In addition, short-range communication may occur, such as using a Bluetooth, Wi-Fi, or other such transceivers. In addition, a GPS (Global Positioning System) receiver module may provide additional navigation and location-related wireless data to computing devices, which may be used as appropriate by applications running on computing devices.
Computing devices may also communicate audibly using one or more audio codecs, which may receive spoken information from a user and convert it to usable digital information. Such audio codecs may additionally generate audible sound for a user, such as through one or more speakers that are part of or connected to a computing device. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.), and may also include sound generated by applications operating on computing devices.
Various implementations of the systems, devices, and techniques described here can be realized in digital electronic circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software, software applications, or code) can include machine instructions for a programmable processor, and can be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms “machine-readable medium” “computer-readable medium” refers to any computer program product, apparatus and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., LCD display screen, LED display screen) for displaying information to users, a keyboard, and a pointing device (e.g., a mouse, a trackball, touchscreen) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, and/or tactile feedback); and input from the user can be received in any form, including acoustic, speech, and/or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (“LAN”), a wide area network (“WAN”), peer-to-peer networks (having ad-hoc or static members), grid computing infrastructures, and the Internet.
The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
The above description provides examples of some implementations. Other implementations that are not explicitly described above are also possible, such as implementations based on modifications and/or variations of the features described above. For example, the techniques described above may be implemented in different orders, with the inclusion of one or more additional steps, and/or with the exclusion of one or more of the identified steps. Additionally, the steps and techniques described above as being performed by some computing devices and/or systems may alternatively, or additionally, be performed by other computing devices and/or systems that are described above or other computing devices and/or systems that are not explicitly described. Similarly, the systems, devices, and apparatuses may include one or more additional features, may exclude one or more of the identified features, and/or include the identified features combined in a different way than presented above. Features that are described as singular may be implemented as a plurality of such features. Likewise, features that are described as a plurality may be implemented as singular instances of such features. The drawings are intended to be illustrative and may not precisely depict some implementations. Variations in sizing, placement, shapes, angles, and/or the positioning of features relative to each other are possible.
This application is a continuation of U.S. application Ser. No. 17/090,088, filed on Nov. 5, 2020, which is a continuation of U.S. application Ser. No. 16/780,056, filed on Feb. 3, 2020, now U.S. Pat. No. 10,872,510, issued on Dec. 22, 2020, which is a continuation of U.S. application Ser. No. 16/258,022, filed on Jan. 25, 2019, now U.S. Pat. No. 10,553,085, issued on Feb. 4, 2020. The disclosure of the prior application is considered part of the disclosure of this application, and is incorporated in its entirety into this application.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17090088 | Nov 2020 | US |
| Child | 17168560 | US | |
| Parent | 16780056 | Feb 2020 | US |
| Child | 17090088 | US | |
| Parent | 16258022 | Jan 2019 | US |
| Child | 16780056 | US |
