Patent Grant
10332059
This patent specification relates to apparatus, systems, methods, and related computer program products for providing home security objectives. More particularly, this patent specification relates to a plurality of devices, including intelligent, multi-sensing, network-connected devices, that communicate with each other and/or with a central server or a cloud-computing system to provide any of a variety of useful home security objectives.
Some homes today are equipped with smart home networks to provide automated control of devices, appliances and systems, such as heating, ventilation, and air conditioning (“HVAC”) systems, lighting systems, home theater, entertainment systems, as well as security systems. Smart home networks may include control panels that a person may use to input settings, preferences, and scheduling information that the smart home network uses to provide automated control of the various devices, appliances, and systems in the home. For example, the person may input a schedule indicating when the person is away from the home, and the smart home network uses this information along with information obtained from various devices in the home to detect unauthorized entry when the user is away.
Various techniques for providing home security objectives are disclosed herein. Embodiments described herein are representative examples of devices, methods, systems, services, and/or computer program products that can be used in conjunction with an extensible devices and services platform that, while being particularly applicable and advantageous for providing security objectives in the smart home context, is generally applicable to any type of enclosure or group of enclosures (e.g., offices, factories, retail stores), vessels (e.g., automobiles, aircraft), or other resource-consuming physical systems that will be occupied by humans or with which humans will physically or logically interact. Thus, although particular examples are set forth in the context of a smart home, it is to be appreciated that the scope of applicability of the described extensible devices and services platform is not so limited.
According to an embodiment, a method may be provided for receiving, at a computing system, home data from a plurality of network-connected smart devices of a smart-home environment, processing, with the computing system, the home data received from the plurality of network-connected smart devices of the smart-home environment, and generating, with the computing system, a security score based on the processed home data, where the processed home data includes at least one of capability data indicative of at least one capability of at least one network-connected smart device of the plurality of network-connected smart devices, opportunity data indicative of at least one opportunity afforded to at least one network-connected smart device of the plurality of network-connected smart devices by at least one influencer of the smart-home environment, and environmental data indicative of at least one behavioral characteristic of the smart-home environment.
According to another embodiment, a system for protecting a home environment may be provided that includes a plurality of network-connected smart devices at the home environment, and a computing system that receives home data from the plurality of network-connected smart devices, processes the home data received from the plurality of network-connected smart devices, and generates a security score based on the processed home data, where the processed home data includes at least one of capability data indicative of at least one capability of at least one network-connected smart device of the plurality of network-connected smart devices, opportunity data indicative of at least one opportunity afforded to at least one network-connected smart device of the plurality of network-connected smart devices by at least one influencer of the home environment, and environmental data indicative of at least one behavioral characteristic of the home environment.
According to yet another embodiment, a non-transitory computer-readable medium may be provided that includes computer-readable instructions recorded thereon for receiving, at a computing system, home data from a plurality of network-connected smart devices of a smart-home environment, processing, with the computing system, the home data received from the plurality of network-connected smart devices of the smart-home environment, and generating, with the computing system, a security score based on the processed home data, where the processed home data includes at least one of capability data indicative of at least one capability of at least one network-connected smart device of the plurality of network-connected smart devices, opportunity data indicative of at least one opportunity afforded to at least one network-connected smart device of the plurality of network-connected smart devices by at least one influencer of the smart-home environment, and environmental data indicative of at least one behavioral characteristic of the smart-home environment.
For a more complete understanding of the nature and advantages of embodiments of the present disclosure, reference should be made to the ensuing detailed description and accompanying drawings. Other aspects, objects and advantages of the present disclosure will be apparent from the drawings and detailed description that follows. However, the scope of the present disclosure will be fully apparent from the recitations of the claims.
Embodiments of the present disclosure generally relate to a plurality of devices, including intelligent, multi-sensing, network-connected devices, that communicate with each other and/or with a central server or a cloud-computing system to provide any of a variety of home-security objectives. The subject matter of this patent specification relates to the subject matter of the following commonly assigned applications, which are incorporated by reference herein: U.S. Ser. No. 61/704,437 filed Sep. 21, 2012, and U.S. Patent Application Publication Nos. 2014/0085092, 2014/0085093, and 2014/0084165.
Various aspects and possible implementations of providing home-security objectives are disclosed herein. Turning to the figures,
The depicted structure 150 includes a plurality of rooms 152, separated at least partly from each other via walls 154. The walls 154 can include interior walls or exterior walls. Each room can further include a floor 156 and a ceiling 158. Devices can be mounted on, integrated with and/or supported by a wall 154, floor 156 or ceiling 158.
In some embodiments, the smart-home environment 100 of
In some embodiments, the smart-home environment 100 of
In some embodiments, the smart-home environment 100 of
In some embodiments, the smart-home environment 100 of
According to embodiments, the smart thermostats 102, the smart hazard detectors 104, the smart doorbells 106, the smart wall switches 108, the smart wall plugs 110, the smart entry detectors 112, the smart doorknobs 122, the keypads, and other devices (collectively referred herein to as “the network-connected smart devices”) of the smart-home environment 100 are connected to each other and to the central server or cloud-computing system 164 to accomplish security-related objectives for the smart home environment. In addition to containing processing and sensing capabilities, each of the network-connected smart devices is capable of data communications and information sharing with any other of the network-connected smart devices, as well as to any central server or cloud-computing system 164 or any other device that is network-connected anywhere in the world to accomplish security-related objectives. The required data communications can be carried out using any of a variety of custom or standard wireless protocols (Wi-Fi, ZigBee, 6LoWPAN, 3G/4G, etc.) and/or any of a variety of custom or standard wired protocols (CAT6 Ethernet, HomePlug, etc.). In some cases, backup means of wireless communication (e.g., 3G/4G) is provided in the event the primary means of communication (e.g., Wi-Fi) becomes disabled, such as due to power outage.
According to embodiments, all or some of the network-connected smart devices can serve as wireless or wired repeaters. For example, a first one of the network-connected smart devices can communicate with a second one of the network-connected smart devices via a wireless router 160. The network-connected smart devices can further communicate with each other via a connection to a network, such as the Internet 162. Through the Internet 162, the network-connected smart devices can communicate with a central server or a cloud-computing system 164. The central server or cloud-computing system 164 can be associated with a manufacturer, support entity, or service provider, such as a home-security provider, associated with the network-connected smart devices. For one embodiment, a user may be able to contact local law enforcement and other emergency or security personnel as well as contact customer support using one of the network-connected smart devices itself rather than needing to use other communication means such as a telephone or Internet-connected computer. Further, software updates and security alerts can be automatically sent from the central server or cloud-computing system 164 to the network-connected smart devices (e.g., when available, when purchased, at routine intervals, when emergency news needs to be broadcasted throughout the home, when the security system needs to be armed, and when the smart-home environment needs to be put on lock down).
According to embodiments, the network-connected smart devices combine to create a mesh network of spokesman and low-power nodes in the smart-home environment 100, where some of the network-connected smart devices are “spokesman” nodes and others are “low-powered” nodes. Some of the network-connected smart devices in the smart-home environment 100 are battery powered, while others have a regular and reliable power source, such as by connecting to wiring (e.g., to 120V line voltage wires) behind the walls 154 of the smart-home environment 100. The network-connected smart devices that have a regular and reliable power source are referred to as “spokesman” nodes. These nodes are equipped with the capability of using any wireless protocol or manner to facilitate bidirectional communication with any of a variety of the other devices in the smart-home environment 100 as well as with the central server or cloud-computing system 164. On the other hand, the network-connected smart devices that are battery powered are referred to as “low-power” nodes. These nodes tend to be smaller than spokesman nodes and communicate using wireless protocol that requires very little power, such as Zigbee, 6LoWPAN, etc. Further, some, but not all, low-power nodes are incapable of bidirectional communication. These low-power nodes send messages, but they are unable to “listen”. Thus, other network-connected smart devices in the smart-home environment 100, such as the spokesman nodes, cannot send information to these low-power nodes.
As described, the network-connected smart devices serve as low-power and spokesman nodes to create a mesh network in the smart-home environment 100. Individual low-power nodes in the smart-home environment regularly send out messages regarding what they are sensing, and the other low-powered nodes in the smart-home environment—in addition to sending out their own messages—repeat the messages, thereby causing the messages to travel from node to node (i.e., network-connected smart device to network-connected smart device) throughout the smart-home environment 100. The spokesman nodes in the smart-home environment 100 are able to “drop down” to low-powered communication protocols to receive these messages, translate the messages to other communication protocols, and send the translated messages to other spokesman nodes and/or the central server or cloud-computing system 164. Thus, the low-powered nodes using low-power communication protocols are able to send messages across the entire smart-home environment 100 as well as over the Internet 162 to the central server or cloud-computing system 164. According to embodiments, the mesh network enables the central server or cloud-computing system 164 to regularly receive data from all of the network-connected smart devices in the smart-home environment, make inferences based on the data, and send commands back to individual one(s) of the network-connected smart devices to accomplish some of the home-security objectives descried herein. For example, in the event the home-security system is armed and one of the nodes, either low- or high-power, detects movement, then the node can send a corresponding message through the mesh network to the central server or cloud-computing system 164, which processes the message and determines the appropriate response, such as contacting authorities and/or the home owner as well as instructing the network-connected smart devices to enter an alarm mode, which may involve activating lights, sounding audible alarms, etc.
As described, the spokesman nodes and some of the low-powered nodes are capable of “listening”. Accordingly, users, other devices, and the central server or cloud-computing system 164 can communicate controls to the low-powered nodes. For example, as discussed below, a user can use the portable electronic device (e.g., a smartphone) 166 to send commands over the Internet to the central server or cloud-computing system 164, which then relays the commands to the spokesman nodes in the smart-home environment 100. The spokesman nodes drop down to a low-power protocol to communicate the commands to the low-power nodes throughout the smart-home environment, as well as to other spokesman nodes that did not receive the commands directly from the central server or cloud-computing system 164.
Examples of spokesman nodes include smart doorbells 106, smart thermostats 102, smart wall switches 108, smart wall plugs 110, keypads, doorknobs 122, etc. These devices 102, 106, 108, 110, and 122 are often located near and connected to a reliable power source, and therefore can include more power-consuming components, such as one or more communication chips capable of bidirectional communication in any variety of protocols.
An example of a low-powered node is a battery-operated version of the smart entry detector 112. These smart entry detectors 112 are often located in an area without access to constant and reliable power, such as in a window or door frame. According to embodiments, the smart entry detector 112 includes a low-power wireless communication chip (e.g., ZigBee chip) that sends instantaneous messages coincident with movement of the door or window or with detection of a nearby person, animal or object. In some embodiments, the low-power wireless communication chip regularly sends messages regarding the position (open, closed, partially open, etc.) of the relevant door or window. These messages may be sent wirelessly, using the mesh network, from node to node (i.e., network-connected smart device to network-connected smart device) within the smart-home environment 100 as well as over the Internet 162 to the central server or cloud-computing system 164.
Another example of a low-power node is a smart nightlight 170. According to embodiments, the nightlight 170 houses a light source having variable intensity. Further, according to embodiments, the color of the light emitted from the nightlight 170 is changeable. In addition to housing a light source, the smart nightlight 170 houses an occupancy sensor, such as an ultrasonic or passive IR sensor, and an ambient light sensor, such as a photoresistor or a single-pixel sensor that measures light in the room. In some embodiments, the smart nightlight 170 is configured to activate the light source when its ambient light sensor detects that the room is dark and/or when its occupancy sensor detects a person's presence or movement. The smart nightlight 170, according to embodiments, is configured to adjust the color and intensity of the light source. For example, the smart nightlight 170 adjusts the intensity of the light source in a manner where intensity is inversely proportional to the amount of natural light detected in the environment. According to embodiments, the smart nightlight 170 includes a low-power wireless communication chip (e.g., ZigBee chip) that regularly sends out messages regarding the occupancy of the room and the amount of light in the room, including instantaneous messages coincident with the occupancy sensor detecting the presence of a person in the room. As mentioned above, these messages may be sent wirelessly, using the mesh network, from node to node (i.e., network-connected smart device to network-connected smart device) within the smart-home environment 100 as well as over the Internet 162 to the central server or cloud-computing system 164.
Yet another example of a low-powered node is a battery-operated version of the smart hazard detector 104. These smart hazard detectors 104 are often located in an area without access to constant and reliable power and, as discussed in detail below, may include any number and type of sensors, such as smoke/fire/heat sensors, carbon monoxide/dioxide sensors, occupancy/motion sensors, ambient light sensors, temperature sensors, humidity sensors, and the like. Furthermore, smart hazard detectors 104, according to some embodiments, include a low-power wireless communication chip (e.g., ZigBee chip) that regularly sends messages that correspond to each of the respective sensors to the other network-connected smart devices and the central server or cloud-computing system 164, such as by using the mesh network as described above.
According to embodiments, the network-connected devices (a.k.a. the low- and high-power nodes) of the smart-home environment 100 are capable of enhancing home security. For example, as discussed, all or some of the network-connected smart devices are equipped with motion sensing, heat sensing, pressure sensing, noise sensing, or other types of sensing capabilities that combine with rules-based inference engines and/or artificial intelligence of the central server or cloud-computing system 164 to detect the presence, movement, and/or identity of people, animals, and objects and trigger various alarms in the event a person, animal, or object is in the wrong place at the wrong time anywhere inside or in the curtilage of the smart-home environment 100.
By virtue of network connectivity, a user can remotely interact with one or more of the network-connected smart devices. For example, a user can communicate with one or more of the network-connected smart devices using a computer (e.g., a desktop computer, laptop computer, or tablet) or other portable electronic device (e.g., a smartphone) 166. A webpage or app can be configured to receive communications from the user and control the one or more of the network-connected smart devices based on the communications and/or to present information about the device's operation to the user. For example, the user can view, arm, or disarm the security system of the home.
As discussed, users can control one or more of the network-connected smart devices in the smart-home environment 100 using a network-connected computer or portable electronic device 166. In some examples, some or all of the occupants (e.g., individuals who live in the home) can register their mobile device 166 with the smart-home environment 100. Such registration can be made at a central server to authenticate the occupant and/or the mobile device 166 as being associated with the smart-home environment 100, and to give permission to the occupant to use the mobile device 166 to control the network-connected smart devices and the security system of the smart-home environment 100. An occupant can use their registered mobile device 166 to remotely control the network-connected smart devices and security system of the smart-home environment 100, such as when the occupant is at work or on vacation. The occupant may also use their registered mobile device 166 to control the network-connected smart devices when the occupant is actually located inside the smart-home environment 100, such as when the occupant is sitting on a couch inside the home or in a bedroom preparing for sleep.
It should be appreciated that instead of or in addition to registering mobile devices 166, the smart-home environment 100 makes inferences about which individuals live in the home and are therefore occupants and which mobile devices 166 are associated with those individuals. As such, the smart-home environment “learns” who is an occupant and permits the mobile devices 166 associated with those individuals to control the network-connected smart devices of the smart-home environment 100. As described herein, various types of notices and other information are provided to occupants via messages sent to the occupants' mobile devices 166 and other electronic devices. It should be appreciated that these messages can be sent via email, short message service (SMS), multimedia messaging service (MMS), unstructured supplementary service data (USSD), as well as any other type of messaging services and/or communication protocols known in the art, including any type of push notification service.
According to embodiments, the network-connected smart devices of the smart-home environment 100 are modular and can be incorporated into older and new houses. For example, the devices are designed around a modular platform consisting of two basic components: a head unit and a backplate, which is also referred to as a docking station. Multiple configurations of the docking station are provided so as to be compatible with any home, such as older and newer homes. However, all of the docking stations include a standard head-connection arrangement, such that any head unit can be removably attached to any docking station. Thus, in some embodiments, the docking stations are interfaces that serve as physical connections to the structure and the voltage wiring of the homes, and the interchangeable head units contain all of the sensors, processors, user interfaces, the batteries, and other functional components of the devices.
Many different commercial and functional possibilities for provisioning, maintenance, and upgrade are possible. For example, after years of using any particular head unit, a user will be able to buy a new version of the head unit and simply plug it into the old docking station. There are also many different versions for the head units, such as low-cost versions with few features, and then a progression of increasingly-capable versions, up to and including extremely fancy head units with a large number of features. Thus, it should be appreciated that the various versions of the head units can all be interchangeable, with any of them working when placed into any docking station. This can advantageously encourage sharing and re-deployment of old head units—for example, when an important high-capability head unit, such as a hazard detector, is replaced by a new version of the head unit, then the old head unit can be re-deployed to a backroom or basement, etc. According to embodiments, when first plugged into a docking station, the head unit can ask the user (by 2D LCD display, 2D/3D holographic projection, voice interaction, etc.) a few simple questions such as, “Where am I” and the user can indicate “living room”, “kitchen” and so forth.
According to embodiments, some of these modular smart devices have security-enhancing features that trigger a notification or an alarm in the event the head is removed from the docking station. For example, as discussed, some smart devices are capable of detecting motion and function as “tripwires” in the security system. Others provide live video feeds and function as security cameras. In the event an intruder attempts to disable a network-connected smart device and therefore avert detection by removing the smart device's head unit from its docking station, an alarm or alert notification is triggered. For example, the smart device sends a message indicating head unit removal to the central server or cloud-computing system 164. Responsive to receiving a message indicating head unit removal, the central server or cloud-computing system 164, according to embodiments, sends a message to the home owner's or other occupants' mobile device(s) 166, indicating the removal and asking whether the removal is authorized. If no response after a timeout period or if the response indicates that removal was not authorized, then the central server or cloud-computing system 164 triggers the alarm. In other embodiments, such as when the alarm is armed (i.e., in security mode), the alarm is triggered immediately upon removal of the head unit. The alarm may be local on the head unit itself and therefore an alert sound is broadcasted from the head unit, or may be centralized and controlled by the central server or cloud-computing system 164 and the other network-connected smart devices are instructed to broadcast an alert sound. In still other embodiments, upon removal, the head unit asks the person to verbally identify themselves and, if the voice is not recognized, then the alarm is triggered.
The smart-home environment 100 may also include communication with devices outside of the smart-home environment 100 but within a proximate geographical range of the home, such as within the home's curtilage. For example, the smart-home environment 100 may include an outdoor lighting system 114 that communicates information through the mesh network or directly to the central server or cloud-computing system 164 regarding detected movement and/or presence of people, animals, and any other objects and receives back commands for controlling the lighting accordingly. The central server or cloud-computing system 164 can control the outdoor lighting system 114 based on information received from the other network-connected smart devices in the smart-home environment. For example, in the event any of the network-connected smart devices, such as smart wall plugs 110 located outdoors, detect movement at night time, the central server or cloud-computing system 164 can “turn on” the outdoor lighting system 114 as well as other lights in the smart-home environment 100. This is advantageous over known outdoor-motion detecting lights because the motion-detection capability is not limited to just the motion sensor attached to the light itself, but extends across all the network-connected smart devices in the smart-home environment 100.
The smart-home environment 100 may include a gated entry 116 that communicates information through the mesh network or directly to the central server or cloud-computing system 164 regarding detected movement and/or presence of people, animals, and any other objects and receives back instructions for controlling the gated entry such an opening, closing, locking, unlocking the gate. According to embodiments, an algorithm is provided for considering the geographic location of the smart-home environment 100, such as based on the zip code or geographic coordinates of the home. The geographic information is then used to obtain data helpful for determining optimal times for turning on/off or otherwise adjusting lighting as well as opening, closing, locking, unlocking gates or otherwise securing the smart-home environment 100.
In some embodiments, the mesh network of low-powered and spokesman nodes can be used to provide exit lighting in the event of an emergency, such as an earthquake, a fire, a detected home invasion, dangerous CO levels, etc. In some instances, to facilitate this, users provide pre-configuration information that indicates exit routes in the smart-home environment 100. For example, for each room in the house, the user provides a map of the best exit route. It should be appreciated that instead of a user providing this information, the central server or cloud-computing system 164 or some other device could automatically determine the routes using uploaded maps, diagrams, architectural drawings of the smart-home environment, as well as using a map generated based on positional information obtained from the nodes of the mesh network (e.g., positional information from the devices is used to construct a map of the house). In operation, when an alarm is activated (e.g., when one or more of the smart hazard detector 104 detects smoke and activates an alarm), the central server or cloud-computing system 164 or some other device uses occupancy information obtained from the low-powered and spokesman nodes to determine which rooms are occupied and then turns on lights (e.g., nightlights 170, wall switches 108, wall plugs 110 that power lamps, etc.) along the exit routes from the occupied rooms so as to provide emergency exit lighting. It should also be appreciated that all or some of the network-connected smart devices, including the smart hazard detector 104 and the smart thermostat 102, include a light that is activated to help occupants evacuate the home. Additionally, in the event of an emergency, such as earthquake or fire, an audible alarm can be sounded in the home giving information about the event. Also, a message, such as an SMS or MMS message, may be sent to the mobile device of the occupants.
In some embodiments, the mesh network of low-powered and spokesman nodes can be used to provide security lighting in the event an unauthorized occupant is detected in the home. In such cases, all lights in and/or outside of the home may be activated. Turning on all light will alert authorized occupants to the danger and will likely cause the unauthorized occupants to flee.
In some embodiments, the smart home environment 100 may include a home safe for storing valuables, such as jewels, money, rare coins, important documents, etc. In the event an individual tampers with the safe, such as if someone attempts to pick the lock, carry it away, or break it open, the safe automatically sends out wireless alarms, SMS, notifies the authorities, etc. The safe also includes a location tracking device, such as a GPS device, so that in the event it is carried away, it can transmit information about its location.
Although in some examples provided herein, the devices and services platform 200 communicates with and collects data from the network-connected smart devices of smart-home environment 100 of
The central server or cloud-computing architecture 164 can further provide one or more services 204, such as security related services described herein. The services 204 can include sensor data collection/logging, where sensor data and other data from network-connected smart devices of smart-home environments 100 is collected and logged. For example, the data collected and logged may include maps of homes, maps of users' in-home movements from room to room as determined by network-connected smart devices equipped with motion and/or identification technology, time spent in each room, intra-home occupancy maps that indicate which rooms are occupied and by whom at different times (including in real time), fire-detection incidents, false alarms, CO data, temperature data, humidity data, etc. According to embodiments, in the event the data collected from the network-connected smart devices of a smart-home environment 100 indicates that an alarm threshold for a particular home is being approached, the services 204 increases the frequency at which it collects and logs data from network-connected devices in that home. For example, in the event the data collected from network-connected devices indicates activity in a kitchen of a smart-home environment 100 while the occupants are asleep, then, instead of collecting data from the network-connected smart devices of the home in thirty-second intervals, the services 204 collects data in ten-second intervals. According to embodiments, the data collected and logged may be provided to investigators after the occurrence of a crime, fire, etc., so that the data may be used to solve the crime, determine the cause of the fire, etc.
The services 204 can further include, for example, remote access, remote or distributed control, security improvement suggestions (e.g., provide suggestions for enhancing security of a home based on collected home data 202, etc.), software updates, customer support, etc. Data associated with the services 204 can be logged at the central server or cloud-computing system 164 and the central server or the cloud-computing system 164 can retrieve and transmit the data at an appropriate time (e.g., at regular intervals, upon receiving request from a user, etc.).
As illustrated in
Results of the analysis or statistics can thereafter be transmitted back to the network-connected smart device(s) that provided home data used to derive the results, to other network-connected smart devices, to a user mobile device 166, to a server providing a webpage to the user's mobile device 166, or to other non-device entities. For example, patterns and statistics summarizing data received from network-connected smart devices can be generated by the processing engine 206 and transmitted. The results or statistics can be provided via the Internet 162. In this manner, the processing engine 206 can be configured and programmed to derive a variety of useful information from the home data 202. A single server can include one or more engines.
The derived data can be highly beneficial at a variety of different granularities for a variety of useful purposes, ranging from explicit programmed control of network-connected smart devices on a per-home, per-neighborhood, or per-region basis (for example, security related statistics unique to particular neighborhoods can be used to control particular network-connected smart devices), to the generation of inferential abstractions that can assist on a per-home basis (for example, an inference can be drawn that the homeowner has left for vacation and so security detection equipment can be put on heightened sensitivity), to the generation of statistics and associated inferential abstractions that can be used for government or charitable purposes. For example, processing engine 206 can generate statistics about network-connected smart device usage across a population of devices and send the statistics to device users, service providers or other entities (e.g., that have requested or may have provided monetary compensation for the statistics).
In some embodiments, to encourage security-related innovation and research and to increase security-related and other products and services available to users, the devices and services platform 200 exposes a range of application programming interfaces (APIs) 210 to third parties, such as law enforcement agencies 222, governmental entities 224 (e.g., the Health and Safety Agencies), academic institutions 226 (e.g., university researchers), businesses 228 (e.g., private security businesses), emergency response providers 230, such as fire and ambulance, and other third parties. The APIs 210 are coupled to and permit third-party systems to communicate with the central server or the cloud-computing system 164, including the services 204, the processing engine 206, the home data 202, and the derived home data 208. For example, the APIs 210 allow applications executed by the third parties to initiate specific data processing tasks that are executed by the central server or the cloud-computing system 164, as well as to receive dynamic updates to the home data 202 and the derived home data 208.
For example, third parties can develop programs and/or applications, such as web or mobile apps, that integrate with the central server or the cloud-computing system 164 to provide services and information to users. Such programs and applications may be, for example, designed to help users secure their homes by performing any of a variety of beneficial functions or tasks now known or hereinafter developed. Examples include providing users with local crime news, information and statistics, safety tips and check lists, such as tips for installing security lights, door and window locks, etc.
According to some embodiments, third-party applications make inferences from the home data 202 and the derived home data 208, such inferences may include when are occupants home, when are they sleeping, when are they in the den watching television, when they shower. The answers to these questions may help third-parties benefit consumers by providing them with interesting security-related information, products and services. In one example, a private security company creates an application that makes inferences regarding when people are away from home. The application uses the inferences to schedule private security officers to stop or drive by the home when people will most likely be away from home, the application may also put the user's network-connected smart devices in alarm mode, notify trusted neighbors that the user is away, etc.
In some embodiments, the devices and services platform 200 exposes APIs 210 to third parties, such as businesses 228 in exchange for revenue, such as for a monthly fee, similar to a subscription service. In one example, the business 228 may be a retail store that sells consumer products and building and construction supplies and materials, including the network-connected smart devices described above with reference to
For example,
Processing engine 206 can further include an advertising/communication paradigm 310b that estimates characteristics (e.g., demographic information, time spent doing particular activities like cooking or watching television), desires and/or products of interest of a user based on data received from network-connected smart devices. Services, promotions, products or upgrades can then be offered or automatically provided to the user. Processing engine 206 can further include a social paradigm 310c that uses information from a social network, provides information to a social network, and/or processes data associated with user and/or device interactions with the social network platform. For example, a user's status as reported to their trusted contacts on the social network could be updated to indicate when they are home or away based on light detection, security system inactivation or device usage detectors.
The processing engine 206 can include a challenges/rules/compliance/rewards paradigm 310d that informs a user of challenges, competitions, rules, compliance regulations and/or rewards and/or that uses operation data to determine whether a challenge has been met, a rule or regulation has been complied with and/or a reward has been earned. The challenges, rules or regulations can relate to efforts to improve security in the home (e.g., regularly lock door, install adequate number of motion detectors or outdoor lights, etc.), to live safely (e.g., reducing exposure to toxins or carcinogens), to conserve equipment life, to improve health, etc. For example, one challenge may involve participants achieve a certain “security score” by properly equipping their home with security devices and services and properly using and maintaining those devices. Those that successfully complete the challenge are rewarded, such as by coupons, virtual currency, status, etc. Regarding compliance, an example involves a parent making a safety and security rule that children are not permitted to leave the home alone after a specified curfew, such as 9:00 PM. The network-connected smart devices in the home could track the movement of the various occupants and send alerts to the parent when a child leaves the home alone after the curfew or when the child is away from home after the curfew.
The processing engine 206 can integrate or otherwise utilize extrinsic information 316 from extrinsic sources to improve the functioning of one or more processing paradigms. Extrinsic information 316 can be used to interpret data received from a network-connected smart device, to determine a characteristic of the environment near the device (e.g., outside a structure that the device is enclosed in), to determine services or products available to the user, to identify a social network or social-network information, to determine contact information of entities (e.g., public-service entities such as an emergency-response team, the police or a hospital) near the device, etc., to identify statistical or environmental conditions, trends or other information associated with a home or neighborhood, and so forth.
An extraordinary range and variety of benefits can be brought about by, and fit within the scope of, the described extensible devices and services platform 200, ranging from the ordinary to the profound. Thus, in one “ordinary” example, each bedroom of the smart-home environment 100 can be provided with a smart wall switch 108, a smart wall plug 110, and/or smart hazard detectors 104, all or some of which include an occupancy sensor, wherein the occupancy sensor is also capable of inferring (e.g., by virtue of motion detection, facial recognition, audible sound patterns, etc.) whether the occupant is asleep or awake. If a home intruder is detected, the remote security/monitoring service or police department is advised of how many occupants there are in each bedroom, and whether those occupants are still asleep (or immobile), and the real time location of the intruder in the home. Further, video from the home can be broadcasted to video-capable devices of the nearest security personnel and police so that the police can monitor the activity in the home while in route to the home. By way of another example, the same data that is being used for home security can also be “repurposed” by the processing engine 206 in the context of a social paradigm of neighborhood security. Thus, for example, the same data discussed in the example above can be collected and made available for processing (properly anonymized) in which the crime patterns and home safety in a particular ZIP code can be tracked.
In some embodiments, the devices and services platform 200 provides a home security services 205 into which users can enroll their smart-home environments 100. The security services 205 can be offered on a non-commitment month-to-month basis. It should also be appreciated that the security services 205 can be offered year-to-year or for lifetime. For example, the security services 205 can provide multi-tiered offerings, including offer basic, plus, and premium services. Basic services, for example, include basic intrusion detection and emergency personnel notification. For example, the basic security services 205 monitor incoming data from the network-connected smart devices of the home to determine when a possible intrusion is occurring, as indicated by motion detection outside the home, information from the smart entry detectors indicating that any one of the doors 186 or windows 182 of the home have been opened, etc. Upon detection, the basic security services 205 contact the occupants of the home and/or local law enforcement. Plus security services 205, for example, monitor dangerous conditions in the home including smoke, CO, in addition to home invasion. Premium services 205 include, for example, availing the home to the many benefits of “neighbor security networks” (described below), detecting when individuals in the home are in distress, mimicking user patterns of turning on lights and appliances when the user is on vacation, providing users with security scores and corresponding tips for improving the security of their home, providing live video stream of activity in the home to the user when the user is away and to local law enforcement, etc.
In some embodiments, pricing for the security services or any suitable type of home insurance may vary depending on the security score of the home. As described below, security score is based on information such as having adequate numbers and placement of network-connected smart devices (e.g., hazard detectors, entry detectors, etc.), percentage of smart devices that have WiFi (rather than low-power communication protocols), percentage of smart devices that are wired (rather than battery powered), number of strangers that visit the home, etc. The higher the security score of the home, the more secure the home and the cheaper the security services and/or insurance may be. The devices and services platform 200, according to embodiments, provides suggestions regarding how to improve security scores and, to intent users to improve their home's score, the platform 200 also indicates what discounts the user will receive if the user's home achieves a particular score.
In some embodiments, upon receiving an enrollment request from a user, the devices and services platform 200 assess the capabilities of the network-connected smart devices in the user's home, and determines whether the requested services are appropriate for the user. For example, if the user requests a premium service, such as the capability to broadcast live video stream to law enforcement, but the user only has but a couple of video enabled smart devices and/or a limited WiFi network, then the devices and services platform 200 recommends that the user upgrade the smart devices in the home or select more basic services.
Examples of security-related objectives will now be provided with reference to
In another security-related example, some or all of the network-connected smart devices are equipped with identification technology (e.g., face recognition, RFID, ultrasonic sensors) that “fingerprints” or creates a “signature” for the people, animals, and objects. The identification technology can be the same as or similar to the fingerprinting and signature creating techniques described in other sections of this application. In this example, based on information received from the network-connected smart devices, the central server or cloud-computing system 164 stores a list of registered occupants and/or guests of the home. When a person whose fingerprint or signature is not recognized by the central server or cloud-computing system 164 as a registered occupant or guest comes “within range” of, or otherwise interacts with, one of the network-connected smart devices of the home, the central server or cloud-computing system 164 logs that person's presence and, if the security system is armed, activates an alarm indicating the presence of an intruder. Further, the central server or cloud-computing system 164 may reference maps of the smart-home environment and schedules to whether the identified person, animal, or object is permitted to be in a particular area (e.g., room of the house) at a particular time and trigger an alarm accordingly.
In yet another security-related example, occupant-location data (e.g., GPS data, IPS data, etc.) is used to achieve home-security objectives. According to embodiments, the occupants of a home (e.g., the individuals who live in or frequently visit the home) register their respective mobile devices 166 as being associated with the home, and the central server or cloud-computing system 164 tracks the occupants' movement inside and outside of the home based on occupant-location data received from the mobile devices 166. The central server or cloud-computing system 164 uses this tracking information to make inferences regarding the current and future occupancy of the home and/or rooms, and to control the network-connected smart devices inside the home in a corresponding manner. For example, outdoor lights 114 can be turned on when it is determined that an occupant is returning home, or the smart doorknobs 122 can be locked and the security system can be armed when the occupant is leaving home. Also for example, the threshold for notifying authorities of an emergency can be adjusted depending on whether an occupant having a registered mobile device 166 is at home. For example, if the registered occupant is at home when an alarm condition (e.g., fire, distressed person, home invasion) is detected, a message can be sent to the occupant's mobile device 166 requesting confirmation that everything is okay. The authorities will only be notified if the registered occupant responds confirming that there is an emergency or if the registered occupant does not respond within a timeout period. On the other hand, if an alarm condition is detected and there are not registered occupants at home, then the authorities are immediately notified and a concurrent message is sent to the mobile devices 166 of the registered occupants.
In some instances the central server or cloud-computing system 164 receives occupant-location data directly from the mobile devices, whereas in other instances the data is received from an intermediary, such as one of the network-connected smart devices in the home. In instances where occupant-location data is received directly from the mobile device, the central server or cloud-computing system 164 can determine if the occupant is “at home” or “away” based on whether the received occupant-location data corresponds with the location of the home. What's more, in some embodiments, the central server or cloud-computing system 164 can use the occupant-location data received directly from the mobile devices to determine the occupant's actual room-location (e.g., bedroom, kitchen, garage, etc.). To do so, for example, the central server or cloud-computing system 164 cross-references the received occupant-location data (e.g., GPS data, IPS data, etc.) with a map of the home. On the other hand, in instances where occupant-location data is received from network-connected smart devices, the central server or cloud-computing system 164 can infer that the occupant is in the room where the network-connected smart device is located. Network-connected smart devices can detect mobile devices via WiFi, Bluetooth, NFC, etc.
It should also be appreciated that passive RFID tags (rather than or in addition to mobile devices) can be used to determine the room-location of occupants (and pets). For example, an RFID is associated with each of the occupants (and pets) of the house, such as by including the tags in wallets, bracelets, wristbands, mobile devices, collars, etc. The network-connected smart devices in the various rooms detect the RFID tags, and send that information to the central server or cloud-computing system 164.
According to an embodiment, the determined room location of an occupant is used determine which user controls to provide to the occupant's mobile device 166 when the occupant uses the mobile device 166 to control the smart-home environment 100. In other words, a different menu is displayed to the occupant depending on the occupant's location in the home. For example, if the occupant is located in the garage, then the displayed menu gives the occupant the option to turn up or down sensitivity of the smart entry detector 112 of the garage door. Also for example, if the occupant is in the kitchen, then the displayed menu gives the occupant the option to adjust the smoke-detection sensitivity of the smart hazard detector 104 in the kitchen. This might enable the occupant to cook without triggering a smoke alarm condition. Further, for example, if the occupant is located in a bedroom, then the displayed menu may give the occupant the option to lock the smart doorknob 122 and arm the alarm system.
In the event all occupants of the smart-home environment 100 register their mobile device 166 as being associated with the home, the central server and cloud-computing systems 164 can infer that strangers are in the home when unknown mobile devices are detected. For example, if the network-connected smart devices detected two people in the home, and both of those people are associated with registered mobile devices 166, then it can be inferred that no strangers are in the home. However, if three people are detected in the home, but only two people are associated with registered mobile devices 166, then it can be inferred that there is one stranger in the home. A home may be considered less secure when there are unregistered mobile devices in the home and when there are more occupants than registered devices. For example, a home that is undergoing a remodel and that has dozens of unregistered construction workers with unregistered mobile devices coming and going is less secure than a home where all occupants are associated with registered mobile devices and where there are no unregistered mobile devices in the home.
According to some embodiments, occupants can use their registered mobile devices 166 to access the smart-home environment 100. For example, the smart doorknob 122 and the mobile device 166 may be capable of communicating via near field communication (NFC), BLUETOOTH, or some other short-ranger wireless protocol. To gain access to the home (e.g., cause the smart doorknob 122 to unlock), the mobile device 166 of the user may transmit an access code to the smart doorknob 122, which then verifies with the server 164 that the person is a registered occupant.
Turning to another security-related example, the mesh network can be used to track a person's movement as the person transitions from room to room. As such, the central server or cloud-computing system 164 knows which room in the smart-home environment is occupied and by whom (e.g., using identification technology) at all times. For example, the low-powered and spokesman nodes (e.g., network-connected smart devices 102, 104, 106, 108, 110, 112, 122, and 170) detect the person's movement through the smart-home environment 100 and communicate corresponding messages through the mesh network. Using the messages that indicate which rooms are occupied, the central server or cloud-computing system 164 logs the information for later use and/or instructs various smart devices in the home to perform certain operations, such as turn on and off lights, lock the smart doorknobs 122, sound alarms, notify public safety authorities and the home owner, etc. as the person enters and exits rooms.
According to embodiments, the central server or cloud-computing system 164 can review the logged information about the occupants' movement in the home to detect signature patterns of movement unique to the various occupants. These signature patterns help the central server or cloud-computing system 164 detect strangers in the home. For example, if an individual is quickly moving from room-to-room at a time when occupants typically are not at home and according to a pattern that is not associated with any of the occupants, the central server or cloud-computing system 164 may infer that this individual is a burglar moving from room to room searching for valuable items.
In yet another security-related example, some or all of the network-connected smart devices are equipped with WiFi, BLUETOOTH, NFC, and/or other wireless communication capability. Accordingly, in the event one or more burglars enter the home carrying on their person their mobile devices (e.g., smart phones), the network-enabled smart home devices, upon detecting the home-invasion condition, automatically “interrogate” a burglar's mobile device to try and extract as much useful information as possible about the burglar including, but not limited to, the MAC address of their phone, their cell number, and/or anything else that their mobile device will divulge about itself or the burglar. In addition, an alarm message could be sent to the occupant's mobile device 166 and also to a security service (or police, etc.) containing some or all of this information. According to embodiments, the smart-home environment 100 and/or the security service that monitors the smart-home environment can automatically connect with a wireless telephone carrier to determine which mobile devices are currently communicating with the cell tower(s) nearest the burglarized home. The wireless telephone carriers could automatically generate a “suspect list” that would necessarily include the burglar's mobile device.
According to embodiments, the smart-home environment includes a small cellular base station, such as a picocell or microcell. Such cellular base stations provide great LTE, 3G, 4G, etc. data rates in the home and, in some cases, could replace or supplement WiFi. This base station could provide a cellular backup to call emergency personnel such as fire/police in the event of an emergency. Also, referring to the scenario above, in the event a burglar is inside the home, the base station could capture all unique IDs (e.g., mac, imei, serial number) from the burglar's mobile device.
In another security-related example, some or all of the network-connected smart devices are equipped with video cameras. In this case, the network-connected smart devices can transmit video to the central server and cloud-computing system 164, which can make the video available to client devices, such as the user device 166, in the form of a live or prerecorded video stream. An occupant, when away from the home, can use their user device 166 to connect to the central server and cloud-computing system 164 to receive live or prerecorded video of activity occurring in the home. In some embodiments, central server and cloud-computing system 164 automatically provides video from the network-connected smart device that is observing the most activity. For example, if there is an intruder in the house, the central server and cloud-computing system 164 can detect which room is experiencing the most activity (e.g., based on noise and motion), and provide video from that room. It should also be appreciated that the central server and cloud-computing system 164 can provide for display on the user device 166 a grid of cameras in the home to choose from. In this case the central server and cloud-computing system 164 can highlight which camera is observing the most activity, so that the user knows that camera is likely the best one to select. It should also be appreciated that the network-connected smart devices have a microphone and speaker and that two-way voice communication can be established between the network-connected smart device and the user device 166. For example, the two-way voice communication can be over internet protocol. This allows users to see and talk to home occupants when the user is away from home.
According to an embodiment, in moments of distress, the network-connected smart devices can broadcast a live video stream to nearby emergency personnel such as police and fire departments. For example, upon detecting an intruder or some other emergency occurring in the home or upon someone pressing a panic button in the home, live video can be broadcast to nearby emergency personnel, such as police, fire, medical, and other first responders. The video, for example, is transmitted from the room where the most activity is occurring or where the button was pressed. In some cases, the video is transmitted directly to the police car that is responding to the call (e.g., the closest police car). It should be appreciated that, rather than broadcast, the video may be provided via a secure stream using secure sockets layer (SSL). It should also be appreciated that the security score of the home may be adjusted based on whether the home has the requisite SSL certificates in place to support the secure video stream to emergency personnel.
According to an embodiment, the network-connected smart devices function as “nanny cams”. In one example, when the nearest network-connected smart device detects that a sleeping child has woken, it will turn on its camera and microphone/speaker. The network-connected smart device will then send a message to the user device 166 of the parent/home occupant, who can accept the message to establish live video of the child and two-way audio communication. It should be appreciated that live two-way video communication can also be established. In the case the network-connected smart device can project a video of the user, include a video screen for display of video of the parent, and/or control a nearby television or monitor to display video of the user. The network-connected smart device can detect when the child goes back to sleep, and can automatically shut down the video and/or audio.
According to embodiments, some or all of the network-connected devices are equipped with pressure sensors, such as digital air pressure sensors, digital barometric pressure sensors, etc. These pressure sensors may be, for example, resonant types that measure changes in air density, thermal types that measure changes in thermal conductivity of air, ionization types that measure changes in the flow of ions in air, and/or force collector types (e.g., bellow, diaphragm, piston) that measure deflection. One example security-related application for these pressure sensors to detect opening and closing of doors as well as occupant movement in the house by sensing pressure variation patterns associated with such activities. For example, when a door opens or closes, the pressure sensors of the network-connected smart devices would record the associated pressure variation. The central server and cloud-computing system 164, upon reviewing the recorded pressure variation, can determine the activity associated with the pressure variation. For example, pressure variation in a first range may indicate that an adult occupant walked through a doorway while transitioning from one room to another, while pressure in a second range may indicate that a particular door, internal or external, opened or closed.
According to embodiments, the smart-home environment 100 learns over time what activity corresponds with particular pressure variations detected by particular network-connected smart devices in the home. For example, a smart hazard detector 104 located in a foyer near the front door of a home can learn that it is located near an external door. For example, during initial installation, the smart hazard detector 104 can ask the installing user to indicate the room (e.g., kitchen, den, foyer, hallway, etc.) in which it is being installed and whether it is proximate to an external door. Later, when it senses a pressure variation, a message can be sent to an occupant's user device 166 asking, “Was the external door near the foyer just opened? [Yes/No]”, “Did an occupant just walk through the foyer? [Yes/No]”. After the smart hazard detector 104 “learns” which pressure differentials are associated with which activities, it can contribute to home security. For example, the smart-home environment 100 automatically goes into security mode when it determines that all occupants are in bed for the night or that all occupants are away from the home. When in this security mode, if the smart hazard detector 104 in the foyer senses a pressure differential that indicates the external door has just been opened, it triggers the alarm.
According to embodiments, the occupants of the home can pre-program the smart-home environment 100 to broadcast specific alarms in response to specific detected conditions. For example, in the event of smoke detection, the smart-home environment 100 can broadcast via the network-connected smart devices and/or the home appliances, such as television and stereos, a pre-recorded message from the occupant notifying the occupants of a possible fire and providing emergency exit instructions. In another example, in case of detected home invasion, the smart-home environment 100 can broadcast a message to the intruders, notifying them that their presence has been detected, that the occupants possess and are trained to use firearms to protect their home, that the police have been notified, etc.
According to embodiments, the thresholds for triggering these alarms can be varied based on activities occurring in the home. More particularly, technologies including the sensors of the network-enabled smart devices in combination with rules-based inference engines or artificial intelligence provided by the central server and cloud-computer system 164 are used to vary alarm thresholds based on the occupants' activities. Inferences about the occupants' activities can be learned based on data received over time. For example, if the smart hazard detector 104 located in the kitchen observes increased temperature, humidity, and motion in the kitchen, then an inference can be made that one or more of the occupants are cooking (“cooking inference”). These data inputs can be considered on a sliding scale based on time of day and day of week. For example, only slight increases in temperature and humidity may invoke the cooking inference at 5 pm on weekdays, when history shows that is when the occupants typically cook. However, much larger increases are required to invoke the cooking inference at 10 am on a weekday, when the occupants are typically away at that time. In some embodiments, the smoke-alarm threshold is varied when the cooking inference is made. For example, the smart hazard detector 104 in the kitchen becomes less sensitive when one of the occupants is cooking, whereas the hazard detectors 104 in other rooms remain in normal operation.
In other embodiments, alarm thresholds are varied based on human population in the home. Inferences about human population in the home can be made based on sensed changes in motion, temperature, CO, noise, air pressure differentials, frequency of door openings and closings, etc. According to one example, in the event of detecting a concurrent increase in temperature, motion, noise, and CO, an inference can be made than there is a higher than normal human population in the home (“high population inference”). Certain alarm thresholds may be adjusted when a high population inference is made. For example, the alarm threshold for CO can be increased to account for the high number of CO-emitting humans in the home and to avoid triggering a false CO alarm. In another example, the security system can be disarmed so that guests can freely transition from room to room and in and out of external doors without triggering the alarm. On the other hand, the alarm threshold for smoke detection can be decreased so that the smoke detectors are more sensitive than usual. This is to protect the large number of people in the home from fire. In other examples, the network-connected thermostat may adjust the temperature of the home to a standard temperature that is comfortable for most people. For example, if the occupants like the house to be cool and “teach” the network-connected thermostat to maintain the home at a cooler temperature, then, in the event of a high-occupancy inference, the network-connected thermostat can adjust up to a temperature that is comfortable for most people. Similarly, for example, if the occupants like the house to be warm and “teach” the network-connected thermostat to maintain the home at a warmer temperature, then, in the event of a high-occupancy inference, the network-connected thermostat can adjust down to a temperature that is comfortable for most people.
According to embodiments, alarm thresholds can be varied based on proximity of law enforcement and other emergency personnel. For example, if a law enforcement office is nearby the threshold for the home invasion alarm condition can be increased. This may be applicable in apartments of buildings that have private security, including a doorman.
According to some embodiments, an “occupancy emulator” can be provided to emulate the occupants of a smart-home environment 100 when the occupants are away, such as on vacation. For example, the smart wall switches 108 and/or the smart wall plugs 110 can function as an “occupancy emulator” by learning the occupants' patterns of turning on and off lights, appliances, etc. and mimicking those patterns when the occupants are away.
According to embodiments, the central server or cloud-computing system 164 processes artificial intelligence algorithms capable of making rules-based or learning-based inferences based on sensed patterns of user control of network-connected smart devices, optionally in conjunction with sensed home conditions or other sensed user behaviors. By way of example, for one embodiment, one or more of the smart wall switches 108 is configured to process information acquired by home occupancy sensing devices in conjunction with information from light-switch-control behaviors of the user to produce a result in which the smart wall switches 108 are automatically self-programmed to help the user turn off and on lights according to a preferred schedule, and to mimic the user's patterns when the user is away. This automatic self-programming can also be applied to smart wall plugs 110, which can learn when to turn on and off lamps 118 as well as appliances such as televisions and stereos. Further, it should be appreciated that all network-connected smart devices can automatically self-program.
In one example, the artificial intelligence algorithms can be configured to sense whether there have been a threshold number of days over the past month (or other evaluation period) for which, at roughly the same time of day (“X o'clock”), the user has turned on or off the same or roughly the same set of smart wall switches 108 and/or smart wall plugs 110 to turn on or off the same or roughly the same lights and/or appliances in the home. If such a pattern has been detected, the user can be sent a message on their smartphone 166 allowing them to opt-in to a setting in which one or more the relevant smart wall switches 108 and/or smart wall plugs 110 will be automatically turned on or off so as to turn on or off the relevant lights and/or appliances at about X-o'clock. It should be appreciated that the smart-home environment could learn and emulate other patterns. For example, it could learn when the dog barks, such as when a person is within 100 feet of the home or when an occupant returns home from work at about X o'clock, and then record and play back barking sounds at appropriate times. It should also learn when to open and close the garage door to give the appearance that the occupant is going and coming to and from the home.
By way of example, the opt-in message can say, “When you are not at home, I can emulate your presence by automatically turning on the lights and television in the den at about X o'clock on weekdays for about two hours, and at about Y o'clock on weekends for about three hours. It might better secure your home by deterring home invasions! Would you like me to do this for you? ‘[YES/NO]’”. The user can then opt in to this functionality and/or modify the schedule and opt in to the modified schedule. If the user's schedule changes, the artificial intelligence algorithms can learn the new schedule and make the proper adjustments. Thus, in accordance with the described embodiment, the collection of smart-home sensors is configured to automatically learn selected user behaviors, to emulate the user's patterns when the user is away, and to automatically learn changes in the user's schedule and make corresponding adjustments.
According to some embodiments, security of the smart-home environment can be further enhanced by predicting through inferences when the user intends to leave the home and raising away preparedness measures. To accomplish this, artificial intelligence algorithms are capable of making rules-based or learning-based inferences about when the user intends to leave the home based on sensed patterns of user control of smart-home devices, optionally in conjunction with sensed home conditions or other sensed user behaviors. By way of example, for one embodiment, one or more of the light switches is configured to process information acquired by home occupancy sensing devices in conjunction with information from light switch control behaviors of the user to predict when the user intends to leave the home. More particularly, the artificial intelligence algorithms can be configured to sense whether there have been a threshold number of weekdays over the past month (or other evaluation period) for which, at roughly the same time of day (“X o'clock”), (i) the user has turned off a same or roughly same set of active light switches in the home, including the front door light switch, over a five-minute period (or other pre-departure period), and (ii) this event was followed by an extended period of non-occupancy, such as at least one hour of non-occupancy. If such a pattern has been detected, the central server and cloud-computing system 164 makes an inference that the user intends to leave the home soon. Responsive to this inference, the sensitivity of the network-connected smart devices can be increased in anticipation of the user's imminent departure from the home. For example, the threshold for triggering an alarm indicating a home invasion can be reduced. It should be appreciated that the pattern of turning off lights is merely an example, and that other patterns exist on which imminent-departure inferences can be made.
According to embodiments, technologies including the sensors of the smart devices located in the mesh network of the smart-home environment in combination with rules-based inference engines or artificial intelligence provided at the central server or cloud-computing system 164 are used to provide a personal “smart alarm clock” for individual occupants of the home. According to embodiments, the smart alarm clock is capable of monitoring weather and traffic data, and adjust the user's wakeup time to account for delays that could be caused by bad traffic and weather. For example, user-occupants can communicate with the central server or cloud-computing system 164 via their mobile devices 166 to access an interface for the smart alarm clock. There, occupants can turn on their “smart alarm clock” and input a wake time for the next day and/or for additional days. In some embodiments, the occupant may have the option of setting a specific time at which the user would like to arrive at a particular destination. The user may input information about the destination and its location, such as its address. Artificial intelligence will be used to determine how long it typically takes the occupant to wake up and get ready to leave the home. This information will be considered in combination with traffic on the route to the occupant's specified destination and weather conditions to determine what time to wake the occupant so that the occupant will arrive at the destination at the specified time.
According to embodiments, the network-connected smart device in the smart-home environment 100 that happens to be closest to the occupant when the occupant falls asleep will be the device that transmits messages regarding when the occupant stopped moving. This closest network-connected smart device will be the device that sounds the alarm to wake the occupant in time to arrive at the specified destination, accounting for traffic and weather conditions and how long it typically takes the occupant to get ready in the mornings. In this manner, the “smart alarm clock” will follow the occupant throughout the house, by tracking the individual occupants based on their “unique signature”, which is determined based on data obtained from sensors located in the smart devices. For example, the sensors include ultrasonic sensors, passive IR sensors, and the like. The unique signature is based on a combination of walking gate, patterns of movement, voice, height, size, etc. It should be appreciated that facial recognition may also be used.
According to embodiments, in the event of bad weather, such as rain, snow, sleet, ice, etc., the smart alarm clock can communicate via the central server and/or could computing system 164 with the occupants automobile and thereby instruct the automobile to automatically shift into all-wheel drive when the user starts up the automobile to drive to the destination. It should also be appreciated that, in cold, winter conditions, the smart-home environment can instruct the automobile to “warm up” and defrost while the occupant is getting ready for work or to leave the home.
“Mapping” the smart-home environment 100 provides a number of advantages. For example, informed by a map of the smart-home environment 100, the central server and cloud-computing system 164 can determine a distressed occupant's or an intruder's location in the home and notify emergency personnel regard the same. This enables emergency personnel to quickly find distressed people or intruders upon entering the home. In other examples, the central server and cloud-computer system 164 determines an emergency exit route for each room of the home. In the event an alarm is activated (e.g., when one or more of the smart hazard detectors 104 detects smoke and activates an alarm), the central server or cloud-computing system 164 uses occupancy information obtained from the network-connected smart devices in the home to determine which rooms are occupied and then turns on lights (e.g., nightlights 170, wall switches 108, wall plugs 110 that power lamps, etc.) along exit routes from the occupied rooms so as to provide emergency exit lighting. These are just a few example advantages of mapping the home, and it should be appreciated that there are an unlimited number of advantages.
According to embodiments, mapping of the home can be done automatically. For example, a map may be generated based on positional information obtained from the nodes of the mesh network (e.g., positional information from the network-connected smart devices is used to construct a map of the house). According to this example, the individual network-smart devices obtain or determine their location upon being installed or at some other time, and send the location information to the central server or cloud computing system 164 or to a mapping application on the mobile device 166 of a user. For example, when installed, a network-connected smart device can ask the user (by 2D LCD display, 2D/3D holographic projection, voice interaction, etc.) a few simple questions such as, “Where am I” and the user can select “bedroom” or “living room” and so forth. In other examples, a smart device can provide the user with instructions, such as “Press button once if I am in the kitchen, press twice if I am in the den, etc.” Also, for example, the smart devices may be capable of determining their GPS coordinates and/or transmitting WiFi location or cellphone tower location information. The central server or cloud computing system 164 or the mapping application on the mobile device 166 uses this information to automatically construct a map of the home. In some examples, a robot 168 (discussed below in detail) ‘roams’ free in the house and sends mapping information to the application on the mobile device 166 or to the central server or cloud-computing system 164, which uses the mapping information to construct a map of the home. For example, the robot 168 could be put into a ‘mapping’ mode where it obtains location data as it moves along the walls of each room in the house, and then sends the location data to the application on the mobile device 166 or to the central server or cloud-computing system 164, which uses the mapping information to construct a map of the home.
According to other embodiments, an indoor positioning system (IPS) could be used to map the smart-home environment 100. For example, a user could launch a mapping application on the mobile device 166 that uses IPS to create a map of the home. In this case the user would walk along the walls of the home and the mobile device would collect location information using IPS and/or other indoor localization techniques, and use that information to construct a map of the home or send the collected information to the central server or could-computer system 164, which creates the map. It should be appreciated that instead of or in addition to using IPS and/or other indoor localization techniques, the application on the mobile device 166 could use the mobile device's gyroscope, magnetometer, accelerometer, and altimeter to obtain location information.
According to still other embodiments, RFID tags are used to map the smart-home environment 100. For example, RFID tags are placed throughout the home. Upon placing the tag, the user could scan the tag using the mobile device 166, which would launch an application, instructing the user to input location information. Also for example, instead of instructing the user to input location information, the mobile device could determine its own location (e.g., using any techniques known to those having skill in the art, such as GPS, at the time of the scan) and associate that location information with the tag.
According to embodiments, in the event of an alarm condition, a map of the smart-home environment 100 is sent to emergency responders. For example, upon detecting the emergency event, such as an intruder or a distressed occupant, the central server and cloud-computing services 164 sends a map (e.g., a map created as described above) of the smart-home environment 100, along with an indication of where on the map the emergency event is occurring. This map can be displayed in the vehicles or on mobile devices of emergency responders, so that they can review the map in advance of entering the home. This will enable them to quickly find the appropriate location upon entering the home.
According to embodiments, smart-home environments can be grouped into “neighborhood security networks” and information can be shared among smart-home environments in the same “neighborhood.” For example, in the event one smart-home environment experiences a fire, an intrusion, a missing child, a medical emergency or some other type of emergency or notable event, notification is sent to other smart-home environments in the same neighborhood. Such neighborhood security networks enable smart-home environments to communicate with one another in real time, or near real time, about emergencies and other important events happening in the neighborhood. This real time communication enables network-connected smart devices in non-affected smart-home environments to make appropriate security- and safety-related responses that minimize or eliminate impact from the emergency event, such as lock the smart doorknob 122, arming security systems, turning on outdoor and indoor lights to deter home invasion, sounding alarms to wake up and warn sleeping occupants of a nearby fire, etc. In some cases, these responses can even resolve or help resolve emergency events, such as by using identification technology to locate a missing child or turning on outdoor lighting so that law enforcement can locate and apprehend fleeing criminals.
A number of different techniques may be used to create neighborhood security networks. According to some embodiments, the central server or cloud-computing architecture 164 automatically creates the “neighborhoods” based on a combination of “neighborhood criteria information”, such as geographic location of the homes, demographic information about occupants of the homes, and “opt-in” information about which types of alerts the homes wish to receive. Geographic location information may include home address, ZIP code, GPS coordinates, WiFi location information, cellular tower location information etc. Demographic information about the occupants may include age, gender, health, special needs, etc. Opt-in information may include fire alerts, home invasion alerts, missing children alerts, missing pets alerts, missing property alerts, earthquake alerts, etc. According to embodiments, the network-connected smart devices of smart-home environments 100 provide the “neighborhood criteria information” to the central server or cloud-computing architecture 164 upon registration and/or during ongoing use, and the central server or cloud-computing architecture 164 logs and stores the neighborhood criteria information as the home data 202, the derived home data 208, and/or other data.
According to some embodiments, the central server or cloud-computer architecture 164 correlates network-connected smart devices using the geographic location information and therefore creates the “neighborhoods” based on geo-proximity, such that homes in close proximity to one another are grouped into the same neighborhood. It is possible that each smart-home environment has its own neighborhood that includes other homes within a predefined radius. This way, each home is in the middle of its neighborhood and benefits from being surrounded by neighbors, rather than being on the edge of a neighborhood. The geographic reach of the neighborhood may vary based on the type of event or emergency in question. For example, in the event a home experiences a fire, the central server or cloud-computer architecture 164 creates a neighborhood that includes all homes within a one-mile radius, whereas if a child goes missing then the neighborhood can include all homes within a ten-mile radius or all homes in a particular ZIP code, city, county, etc.
According to some embodiments, the central server or cloud-computer architecture 164 creates neighborhoods based on demographic information. For example, in the event a teenage child of one smart-home environment is out past his or her curfew, the created neighborhood consists of nearby homes where teenagers are members of the household. This way, notice that the teenager is out past his or her curfew is sent to the homes of the neighborhood, and the teenager can be located if he or she is out visiting another teenager whose home is in the same “neighborhood”. In another example, in the event an occupant of a particular home contracts the flu or some other communicable illness, the created neighborhood consists of nearby homes where small children or elderly adults live. In this example, a notice is sent to the other homes in the neighborhood so that precautionary measure can be taken to help prevent the young children and elderly adults from contracting the illness.
According to embodiments, the central server or cloud-computing architecture 164 automatically identifies smart homes within a radius of the home experiencing the emergency or event and sends an alarm to the identified homes. In such instances, the other homes in the “neighborhood” do not have to sign up for or register to be a part of a safety network, but instead are notified of emergency or event based on their proximity to the location of the emergency or event. This creates robust and evolving neighborhood security watch networks, such that if one person's home is getting broken into, an alarm can be sent to nearby homes, such as by audio announcements via the smart devices located in those homes.
However, it should be appreciated the “neighborhood security networks” can be “opt-in” services and that, in addition to or instead of the central server or cloud-computing architecture 164 selecting which homes to send alerts to, individuals can subscribe to participate in such networks and individuals can specify which homes they want to receive alerts from and the types of alerts to be received. This can include, for example, the homes of family members who live in different cities, such that individuals can receive alerts when their loved ones in other locations are experiencing an emergency or other types of events. In some examples, homes having children can subscribe or “opt in” to be a part of a “neighborhood” that sends alerts when children are missing or out past curfew. Further, homes having elderly people can subscribe or “opt in” to be a part of a “neighborhood” that sends alerts regarding their elderly peers and attempt to form a community that looks out for the security, safety, and health of its members.
According to embodiments, before a smart-home environment 100 is included in a neighborhood security network, an opt-in message is sent to the home owner, such as via the home owner's mobile device 166. The home owner is provided with information about the other homes in the “neighborhood”, the basis on which the neighborhood security network was formed (e.g., geographic location, family relationships, demographic information, etc.), the types of information that will be shared with other homes in the neighborhood security network (e.g., occupants away on vacation, potential invasion, missing child, etc.).
As discussed, notification of an emergency or event occurring in one home can trigger responses in other homes in the “neighborhood”. For example, in the event of a burglary in one home, the central server or cloud-computing architecture 164 instructs the network-connected smart devices of the other smart-home environments 100 in the neighborhood to turn on outside lights, to lock the smart doorknob 122 and window latches, to arm the security system, etc. Also, for example, in the event smoke is detected in one home in the neighborhood, the central server or cloud-computing architecture 164 can increase the sensitivity of the smoke-detecting components of other smart hazard detectors 104 in the neighborhood. In this example, the neighborhood may include all units in the same apartment or condominium building. Further, for example, in the event a dog goes missing in one home, the network-connected smart devices of other homes in the neighborhood can be tuned to detect motions that indicate a dog. In this example, if a dog is detected by an outdoor network-connected smart device that does not typically detect dogs, then a message can be sent to the home of the missing dog indicating that a stray dog was detected and providing the location of the detection. Further, in some examples, a RFID tag may be provided on the dog's collar, and the network-connected smart device of the other homes in the neighborhood may locate the dog by “reading” the RFID tag and give the location of the dog upon request. RFID tags may be placed on other property, too, such as bicycles such that other property may be located in a similar manner.
According to embodiments, individuals may manually broadcast messages to other homes in the “neighborhood”. For example, when a family is leaving for vacation, they can cause the central server and cloud-computing system 164 to send a notification to a network of trusted neighbors. This network can be manually defined or inferred.
According to embodiments, the central server or cloud-computing system 164 may obtain and store identifying information, such as facial recognition data, for the occupants of the smart-home environments 100. In this case, when a “recognized” individual who is an occupant of one of the smart-home environments 100 is approaching an external door, such as the front door, of another smart-home environment, the smart doorbell 106, via the processing capabilities of the central server or cloud-computing system 164, is able to recognize the approaching individual and announce his presence. For example, the approaching individual's name and/or status as being a neighbor may be announced, a video of him approaching may be displayed, and/or his image (such as a photograph taken from his social networking account) may be displayed inside the smart-home environment 100.
According to embodiments, a security score may be calculated for a smart-home environment. In some examples, a security score for a home is calculated by comparing the security features of the home against a list of security criterions to determine how many of the security criterions are satisfied. Higher scores indicate that a home satisfies a high number of security criterions and is therefore relatively secure, whereas lower scores indicate that the home fails to satisfy many of the criterions. According to embodiments, security scores can be normalized and scaled so that occupants of a home can compare the security of their home to other homes. For example, a score of 0 to 100 can be used, where 0 is the lowest possible score and 100 is the highest possible score. Further, for example, the central server or cloud-computing system 164 may generate a report or log that lists the security criterions and provides an indication of whether the home satisfies each of the criterions. Occupants can review this list to determine which criterions are not satisfied and then make the appropriate improvements to the home so as to increase the home's security score. Additionally, the central server or cloud-computing system 164 can use this log to generate a list of suggestions for improving the home. It can prioritize the list based on which criterions are associated with the most points, indicate which creation can be easily and cheaply satisfied with only minor improvement, and indicate which unsatisfied criterions are typically satisfied in other homes. For example, the central server or cloud-computing system 164 can send the following message to an occupant's electronic device 166: “We notice that you often leave the front door unlocked. Most homes in your neighborhood keep the front door locked at all times. Locking your front door at night is an easy and inexpensive way to improve your home's security and to improve your security score.” Example security criterions for assessing the security of and calculating a security score are discussed below. However, it should be appreciated that any number and combination of security criterions can be used when assessing security and calculating a security score for a home.
One example security criterion is whether the home has a requisite number of network-connected smart devices, such as smart hazard detectors 104, smart entry detectors 112, etc. The requisite number can be determined based on the size of the home, the number of bedrooms in the home, the configuration of the home (single story, two-story), the number of occupants living in the home, the laws, rules, and regulations of the jurisdiction(s) where the home is located, etc. In some cases, this information can be automatically obtained from public real estate databases. For example, the central server and/or cloud-computing services 164 can access a public real estate database(s) to obtain the size, location, configuration, number of bedrooms/bathrooms, etc. The central server and/or cloud-computing services 164 can also access the home data 202 to determine how many network-connected smart devices are located in the home, and compare that number to the requisite number to determine whether the criterion is satisfied.
Another example security criterion is whether the various types of network-connected smart devices are properly located in the home. For example, for this criterion, the central server and/or cloud-computing services 164 can determine whether a smart-entry detector 112 is located at each window 182 and external door 186, whether a smart hazard detector 104 with smoke and motion detecting capabilities is located in all of the appropriate locations, such as one in the kitchen and at least one on each floor of the home, whether the doorbell of the home is a smart doorbell 106 with the security capabilities described herein, whether the wall switches are smart wall switches 108, whether the wall plugs are smart wall plugs 110, etc. The central server and/or cloud-computing services 164 can make these determinations by reviewing the home data 202 to obtain information about the location and capabilities of the various network-connected smart devices in the home and comparing that information against a map of the home. The map can be generated according to the example techniques described herein.
In some embodiments, a security criterion is whether the house has been “mapped”. As discussed elsewhere herein, maps of the homes can be created and stored in the home data 202. Mapping improves security not only because it enables the central server and/or cloud-computing services 164 to determine whether the home has an adequate number of appropriate located network-connected smart devices, but it also enables the central server and/or cloud-computing services 164 to pinpoint within the home where a security event is taking place and to provide that information for emergency responders. Another example security criterion is the average amount of time it takes first responders to get to the home after an alarm has been triggered. This information can be averaged based on data from nearby homes. If the response time is fast, then the security score of the home is increased.
Other example security criteria may be related to the capabilities and configurations of the respective network-connected smart devices in the home. For example, the central server and/or cloud-computing services 164 can access and review the home data 202 to determine whether the network-connected smart devices are wired (rather than battery operated), whether the batteries are sufficiently charged, whether they are WiFi enabled and connected to a strong and reliable WiFi network, whether the CO date codes of the smart hazard detectors 104 are up-to-date, whether there is cellular backup in the event WiFi goes down, etc. Another example, criterion is whether the hub spokesman node in the home is wired (rather than battery operated).
In some embodiments, the central server and/or cloud-computing services 164 can review the security logs for the house provided in the home data to assess whether the occupants are keeping the home secure. For example, one security criterion that can be considered during this review is whether a door or window was left unlocked overnight. Another example, criterion is the number of strangers that visit the house on a regular basis. This can be determined, per the discussion above, by detecting strangers based on the number of unregistered mobile device 166 and/or occupants in the home. The more strangers that visit, the less secure the home and the lower the security score. On the other hand, if the home occupants regularly consist of just registered occupants, then the more secure the home and the higher the security score. Another example security criterion is the number of unregistered mobile devices that come into contact with the home on a regular basis. This can be particularly relevant for apartments, condos, and homes in densely populated areas where strangers are frequently nearby. One way the central server and/or cloud-computing services 164 can make this determination is by reviewing the number of unrecognized mac addresses that contact the router of the home's WiFi network. In some examples, for those homes located in apartment and condo buildings and in densely populated areas, the mac addresses of the neighbors' mobile devices can be factored out over time. For example, if the same mac address is seen on a regular basis, then it can be assumed that that device is associated with a neighbor and will not be used to lower the security score of the home.
Other example security criteria involve how readily the occupants, or non-resident individuals who are in a position to confirm whether an alarm condition is false, can be contacted in the event of an alarm condition. Here, for example, the central server and/or cloud-computing services 164 considers whether the occupants of the home have verified their contact information. For example, this may include determining whether and which of the occupants have provided their emergency contact information (e.g., mobile telephone number) to the central server and/or cloud-computing services 164. The security score increases if the occupants have verified their contact information because, in the event of an alarm condition, the occupants can be contacted to verify whether the alarm is false and if not they can help resolve or otherwise address the emergency. The security score increases even more if every occupant of the home verifies their contact information.
Another example security criterion is the quality of “coverage” in the home. For example, the central server and/or cloud-computing services 164 determines whether the home has a comprehensive mesh network of nodes that are capable of sensing conditions at all locations within the home and communicating data regarding the sensed conditions through the mesh network and to the central server and/or cloud-computing services 164. According to one embodiment, to determine whether the home has a comprehensive mesh network, the central server and/or cloud-computing services 164 tracks an occupant's movement through the home to identify “black spots”, which are areas in the home where the central server and/or cloud-computing services 164 was unable to detect the occupant. The security score can be adjusted based on the extent of the black spots in the home.
At 1310, the process 1300 involves comparing the security data of the home against the obtained security criterions to determine which of the security criterions are satisfied. Here, according to an embodiment, the central server and/or cloud-computing service 164 processes the obtained home data against the list of security criterions to determine which of the security criterions are satisfied. At 1314, the security score is calculated. To do so, for example, the central server and/or cloud-computing service 164 determines a security score for the home based on the number of security criterion that were satisfied. The higher the number of satisfied criterion, the higher the security score. At 1320, a security log is generated. For example, the central server and/or cloud-computing service 164 generates a log that lists each of the security criterions and corresponding indications of whether the respective criterions were satisfied. This log can be outputted, for example, by sending the log to the electronic devices 166 of the occupants. In some embodiments, the log includes a written description for each of the security criterions so that occupants can review the descriptions of the unsatisfied criterions to determine what they can do to improve the security of their home. In some examples, the corresponding indications of whether the respective criterions are satisfied are binary indicators, whereas in other examples the corresponding indications are values indicative of a degree of compliance. For example, if the home has fifty percent of the requisite number of smart hazard devices 104, then the indication corresponding to that criterion can indicate that it is fifty percent satisfied. As discussed above, the security criterions can include a “proper sensor location” criterion, a “low sensor battery” criterion, a “low WiFi signal” criterion, a “door open” criterion, a “door closed” criterion, a “door locked” criterion, a “window open” criterion, and a “window locked” criterion.
According to some embodiments, “pre-alarm condition trend detection and notification” services are provided to warn users of potential dangerous conditions. More particularly, technologies including the sensors of the network-enabled smart devices in combination with rules-based inference engines or artificial intelligence provided by the central server and cloud-computer system 164 are used to make inferences about potential security conditions in the home. This may occur in situations where the sensor data is not “strong” enough to support an actual alarm condition, but it is enough to cause an inference that potentially dangerous activity may be occurring in the home and that it is worth investigating whether such activity is indeed occurring.
For example, as discussed above the central server or cloud-computing system 164 can review the logged information about occupants' movement in the home to detect signature patterns of movement unique to the individual occupants of the home. These signature patterns help the central server or cloud-computing system 164 detect strangers in the home. For example, if an individual is quickly moving from room to room at a time when occupants typically are not at home and in a pattern that is not a signature pattern of any of the occupants, the central server or cloud-computing system 164 may infer that this individual is potentially a robber moving from room to room searching for valuable items. While this inference may not rise to the level of a home-invasion alarm condition, it may be worth investigating. Thus, the central server or cloud-computing system 164 sends a “pre-alarm” alert message to the registered occupants' mobile device 166, informing the occupants of the detected pattern that there may be suspicious activity occurring in the home. The message may include an indication of where in the house suspicious activity is occurring. The message may also request that the occupant verify that this is a false alert or that an actual home-invasion-condition exists.
In another example, the smart doorbell 106 may observe the same car parked on a street out front of the smart-home environment 100 over the course of several days. In particular, the smart doorbell 106, in combination with rules-based inference engines or artificial intelligence provided by the central server and cloud-computer system 164, may infer that the comings and goings of the car are consistent with burglars “casing” the home. Upon making this inference, rather than triggering an alarm condition, the central server and cloud-computer system 164 may send a “pre-alarm” message to the occupants' mobile devices 166 and/or to local law enforcement, alerting them to the potential casing and including a description of the car.
According to other embodiments, the pre-alarm condition trend detection and notification can be applied to detect evaluated levels of potentially dangerous substances (e.g., CO, smoke, etc.) in the smart-home environment 100. For example, an alarm condition may be established based at least in part on a predetermined amount of a substance in an environment. The alarm condition may be stored locally by a smart hazard detector or remotely by the central server and cloud-computer system 164. For example, once the concentration level of CO in the air reaches a certain level, an alarm condition will be triggered. Additionally, a “pre-alarm condition” is established based at least in part on a predetermined trend in the amount of the substance in the environment. For example, the pre-determined trend can be at least a twenty-percent increase in the amount of the substance over at least a two-week period. After establishing the alarm and the pre-alarm conditions, the central server and cloud-computer system 164, the smart hazard detector and/or other smart home devices receives sensor data indicating the amount of the substance in the environment and analyzes the sensor data to detect the presence of either the alarm or pre-alarm condition. Responsive to detecting the pre-alarm condition but not the alarm condition, the central server and cloud-computer system 164, the smart hazard detector and/or other smart home devices provides a notification of the pre-alarm condition. For example, the central server and cloud-computer system 164 may send a message to the mobile device 166 of the occupant stating, “The CO level in your home has increased twenty-percent in the last two weeks. You might consider having an expert inspect your home to determine the cause.” Also for example, the smart hazard detector and/or other devices in the home may make a similar audible announcement or display a similar written message.
Additionally, the pre-alarm message may be sent to a repair contractor or a public safety agency, so that they can respond directly. For example, the repair contractor may call the owner to notify the owner of the problem and prepare a plan to repair the problem. According to embodiments, the pre-alarm message giving notification of the pre-alarm condition is sent to a centralized bidding system that solicits bids from repair contractors and selects one of the repair contractors to resolve the problem.
According to some embodiments, sound, vibration, and/or motion sensing components of the smart devices are used to detect sound, vibration, and/or motion created by running water. Based on the detected sound, vibration, and/or motion, the central server or cloud-computing architecture 164 makes inferences about water usage in the home and provides related services. For example, the central server or cloud-computing architecture 164 can run programs/algorithms that recognize what water sounds like and when it is running in the home. According to one embodiment, to map the various water sources of the home, upon detecting running water, the central server or cloud-computing architecture 164 sends a message to an occupant's mobile device asking if water is currently running or if water has been recently run in the home and, if so, which room and which water-consumption appliance (e.g., sink, shower, toilet, etc.) was the source of the water. This enables the central server or cloud-computing architecture 164 to determine the “signature” or “fingerprint” of each water source in the home. This is sometimes referred to herein as “audio fingerprinting water usage.”
In one illustrative example, the central server or cloud-computing architecture 164 creates a signature for the toilet in the master bathroom, and whenever that toilet is flushed, the central server or cloud-computing architecture 164 will know that the water usage at that time is associated with that toilet. Thus, the central server or cloud-computing architecture 164 can track the water usage of that toilet as well as each water-consumption application in the home. This information can be correlated to water bills or smart water meters so as to provide users with a breakdown of their water usage.
According to some embodiments, sound, vibration, and/or motion sensing components of the smart devices are used to detect sound, vibration, and/or motion created by mice and other rodents as well as by termites, cockroaches, and other insects (collectively referred to as “pests”). Based on the detected sound, vibration, and/or motion, the central server or cloud-computing architecture 164 makes inferences about pest-detection in the home and provides related services. For example, the central server or cloud-computing architecture 164 can run programs/algorithms that recognize what certain pests sound like, how they move, and/or the vibration they create, individually and/or collectively. According to one embodiment, the central server or cloud-computing architecture 164 can determine the “signatures” of particular types of pests.
For example, in the event the central server or cloud-computing architecture 164 detects sounds that may be associated with pests, it notifies the occupants of such sounds and suggests hiring a pest control company. If it is confirmed that pests are indeed present, the occupants input to the central server or cloud-computing architecture 164 confirmation that its detection was correct, along with details regarding the identified pests, such as name, type, description, location, quantity, etc. This enables the central server or cloud-computing architecture 164 to “tune” itself for better detection and create “signatures” or “fingerprints” for specific types of pests. For example, the central server or cloud-computing architecture 164 can use the tuning as well as the signatures and fingerprints to detect pests in other homes, such as nearby homes that may be experiencing problems with the same pests. Further, for example, in the event that two or more homes in a “neighborhood” are experiencing problems with the same or similar types of pests, the central server or cloud-computing architecture 164 can make inferences that nearby homes may also have such problems or may be susceptible to having such problems, and it can send warning messages to those home to help facilitate early detection and prevention.
According to some embodiments, sound, vibration, and/or motion sensing components of the smart devices are used to detect sound, vibration, and/or motion created by intruders impermissibly entering the home. Based on the detected sound, vibration, and/or motion, the central server or cloud-computing architecture 164 makes inferences about home invasion and provides related services. For example, the central server or cloud-computing architecture 164 can run programs/algorithms that assess detected sounds, vibrations, and movement in view of whether the home occupants are home or way, sleeping or awake, etc.
For example, in the event the central server or cloud-computing architecture 164 detects sounds proximate to windows, doors, and other external entryways while concurrently receiving information that all registered occupants are away from the home or are accounted for and asleep in their respective rooms, the central server or cloud-computing architecture 164 alerts the occupants to the possible invasion and/or deters the intruders by turning on nearby lights, sounding audible warnings, etc. For example, the audible announcement could be an indication that an intrusion is occurring. This will alert the occupants and hopefully scare away the intruder.
According to some embodiments, sound, vibration, and/or motion sensing components of the smart devices are used to detect sound, vibration, and/or motion created when an occupant of the home is under distress, such as when an individual falls and cannot get up. Based on the detected sound, vibration, and/or motion, the central server or cloud-computing architecture 164 makes inferences about the respective occupants of the home and their patterns of movement. These inferences may be enhanced by providing the central server or cloud-computing architecture 164 with age, health, and other information about the individual occupants. For example, the central server or cloud-computing architecture 164 can identify and track the movement through the home of the respective occupants using techniques described herein, such as based on their “signature” or signals emitted from their tracking devices (e.g., mobile phones), and activate a distress alarm when an occupant's movement indicates distress. For example, an elderly occupant may be in distress immediately after making a very swift movement or causes a strong vibration that an elderly person would be incapable of making unless that person were falling. A distress alarm may also be activated when an occupant remains in one position, such as in bed or in a bath, for a period that exceeds a threshold. Further, a distress alarm may be activated upon receiving a verbal command, such as “help”, from an occupant.
For example, in the event the central server or cloud-computing architecture 164 detects sounds proximate to windows, doors, and other external entryways while concurrently receiving information that all registered occupants are away from the home or are accounted for and asleep in their respective rooms, the central server or cloud-computing architecture 164 alerts the occupants to the possible invasion and/or deters the intruders by turning on nearby lights, sounding audible warnings, etc.
Turning now to
By virtue of being mounting in place of traditional wall switches, the wall switch 108 has access to plentiful electrical operating power, such as by connecting to wiring (e.g., to 120V “hot” line voltage wires) that is behind the walls 154 of the smart-home environment 100 and that is present at virtually all standard home wall light switches. This essentially unlimited power budget, the near-ubiquity of excellent installation locations throughout the home, and the reasonably ample physical space on its face plate and in its housing to fit the necessary components, combine to enable the wall switch 108 to accommodate a rich and wide variety of sensing, interface, and communications capabilities for the smart-home environment 100, as well as a general platform for the provision of even newer sensing, interface, and communications hardware as it becomes available over the coming decades.
A rich variety of new interactions are made possible between wall switch 108 and other devices of the smart-home environment 100. Occupancy sensing, for example, can be significantly enhanced by virtue of the great locations (usually right next to room doorways) of most wall light switches, allowing for easy tracking of occupants as they transition between rooms, predictive occupancy algorithms, and so forth.
As illustrated in
According to some embodiments, the head unit 404 (sometimes referred to herein as “replacement module 404”) actually contains all of the sensors, processors, user interfaces, the rechargeable battery, and so forth. Users can plug and unplug the unit 404 in and out of the docking station 408. Many different commercial and functional possibilities for provisioning, maintenance, and upgrade are possible. For example, after years of using any particular head unit 404, a user will be able to buy a new version of the head unit 404 and simply plug it into the docking station 408. There are also many different versions for the head unit 404, such as an extremely low-cost version that is nothing but a motion/occupancy detector and light switch, and then a progression of increasingly-capable versions, up to and including extremely fancy head units 404 with small OLED televisions and high-fidelity mini-speakers. Thus, it should be appreciated that the various versions of the head units 404 can all be interchangeable, with any of them working when placed into any docking station 408. This can advantageously encourage sharing and re-deployment of old head units 404—for example, when an important high-capability head unit 404 (for the kitchen or living room, for example) can be replaced by a great new version of the head unit 404, then the old head unit 404 can be re-deployed in a bedroom or a basement, etc. When first plugged into a docking station 408, the head unit 404 can ask the user (by 2D LCD display, 2D/3D holographic projection, voice interaction, etc.) a few simple questions such as, “Where am I” and the user can select “bedroom” or “living room” and so forth. In other examples, the head unit 404 can provide instructions, such as “Press button once if I am in the kitchen, press twice if I am in the den, etc.”
According to some embodiments, the head unit 404 contains a main processor 412, storage 416, display and user interface 424, audio speaker 436, microphone 444, power converter 440, GPS receiver 450, RFID locater 454, and general physical module receiver 458. The head unit 404 further contains wireless and wired networking 462. In view of the ample power availability, a variety of communications capabilities can be provided, including Wi-Fi, ZigBee, 3G/4G wireless, CAT6 wired Ethernet, and even optical fiber from the curb. Furthermore, because the wall switch 108 can be connected to the home 120V system, a HomePlug or other powerline-communications capability can be provided.
Also included are sensors 428 such as temperature, humidity, occupancy, ambient light, fire, smoke, carbon monoxide, active proximity, passive infrared motion, ultrasound, CCD/video camera, etc. A rechargeable battery 432 (or equivalently capable onboard power storage medium) is also included. For example, the battery 432 can be a rechargeable Lithium-Ion battery. In operation, the wall switch 108 charges the battery 432 during time intervals in which the hardware power usage is less than what power stealing can safely provide, and that will discharge to provide the needed extra electrical power during time intervals in which the hardware power usage is greater than what power stealing can safely provide.
The user interface 424 can include one or more visual displays (TFT, OLED, etc.), touchscreen and/or button input capabilities, the audio speaker 436, and so forth. According to the embodiment illustrated in
According to one embodiment that is particularly appealing for a lighting control functionality of the described wall switches 108, which are temporarily simply termed ‘light switches’ for this lighting-control-related embodiment, the light switches in the home, such as the smart-home environment 100, are configured such that at least one of them can be used to control (a) all of the light switches in the home, (b) a single selectable one of the other light switches in the home, and/or (c) one or more selectable groups or sub-groups of the other light switches in the home. This can be particularly convenient, for example, for a light switch that is near the front door (or other entryway commonly used for ingress and egress) of the home. For such an exemplary scenario, an occupant who is the last person to leave the home can simply turn off all lights at once by controlling the single light switch nearest the door. Similarly, a returning occupant can turn on a particular subset of lights (for example, the lights corresponding to a pathway from the front door to the kitchen) all at once by controlling that single light switch. As another advantageous example, a light switch that is in an upstairs master bedroom of the home can be used by the parents to control (a) the lights in all downstairs rooms in the home, (b) the lights leading between the master bedroom and the kitchen, and/or (c) the lights in each of the children's bedrooms.
The above-described provision for mutually controllable or selectively mutually controllable light switches can be extended in other embodiments to similar mutual or selectively mutual control of any population of smart-home controllers that are so amenable. Examples can include mutual or selectively mutual control of irrigation controllers, door opening/closing actuating controllers, entertainment device controllers, computing device controllers, portable plug-in heater controllers, window opening/closing controllers, and so on.
In some embodiments a network-connected smart keypad is provided in the smart home environment 100. According to embodiments, an important underlying functionality of the smart keypad is to control the functionality of security features of the smart-home environment 100. It should be appreciated that the smart keypad is enhanced with a variety of multi-sensing capabilities that, while indeed enhancing home safety and security in many ways, can provide additional functionalities relating to controlling the other smart devices in the home, HVAC control, home energy conservation, intra-home communications, entertainment, etc.
According to embodiments, smart keypad includes powering circuitry, including a rechargeable battery, for extracting power as needed from the 120V “hot” line voltage wire. The rechargeable battery can either be used as a conventional back-up source or as a reservoir to supply excess DC power if needed for short periods.
According to some embodiments, like other smart home devices described herein, the smart keypad is split into two parts: a head unit and a backplate. This bifurcation can increase the success and commercial longevity of the smart keypads by making them a modular platform consisting of two basic components. According to some embodiments, the backplate is a permanent interface box (sometimes referred to herein as “docking station”) that serves as a physical connection into the wall and to the 120V line voltage wires or other wiring of the smart-home environment 100, and that contains AC-to-DC powering circuitry. When installed, the docking station may resemble a conventional one-gang or two-gang wall box, except no dangerous high-voltage wires are exposed to the user. According to some embodiments, the docking station also includes a cellular wireless interface.
According to some embodiments, the head unit (sometimes referred to herein as “replacement module”) actually contains all of the sensors, processors, user interfaces, the rechargeable battery, and so forth. Users can plug and unplug the unit in and out of the docking station. Many different commercial and functional possibilities for provisioning, maintenance, and upgrade are possible. For example, after years of using any particular head unit, a user will be able to buy a new version of the head unit and simply plug it into the docking station. There are also many different versions for the head unit, such as an extremely low-cost version that is nothing but a user interface, and then a progression of increasingly-capable versions, up to and including extremely fancy head units with small OLED televisions and high-fidelity mini-speakers. Thus, it should be appreciated that the various versions of the head units of the smart keypads and other smart devices can all be interchangeable, with any of them working when placed into any docking station. This can advantageously encourage sharing and re-deployment of old head units—for example, when an important high-capability head unit (for the kitchen or living room, for example) can replaced by a great new version of the head unit, then the old head unit can be re-deployed in a bedroom or a basement, etc. When first plugged into a docking station, the head unit can ask the user (by 2D LCD display, 2D/3D holographic projection, voice interaction, etc.) a few simple questions such as, “Where am I” and the user can select “bedroom” or “living room” and so forth. In other examples, the head unit can provide instructions, such as “Press button once if I am in the kitchen, press twice if I am in the den, etc.”
According to some embodiments, the smart keypad contains a main processor, storage, display and user interface, audio speaker, microphone, power converter, GPS receiver, RFID locater, and general physical module receiver. The smart keypad further contains wireless and wired networking. In view of the ample power availability, a variety of communications capabilities can be provided, including Wi-Fi, ZigBee, 3G/4G wireless, CAT6 wired Ethernet, and even optical fiber from the curb. Furthermore, because the smart keypad can be connected to the home 120V system, a HomePlug or other powerline-communications capability can be provided. Accordingly, the smart keypad can be connected to and communicate with the other smart home devices of the smart-home environment 100 and to the central server or cloud-computing system 164.
The smart keypad can include any of the components (e.g., temperature sensor, humidity sensor, occupancy sensor, ambient light sensor, communication equipment, processors, memory, etc.) that are included in any of the other smart home devices (e.g., smart doorbells 106, smart thermostats 102, smart wall switches 108, smart wall plugs 110, etc.) described herein. In some embodiments, the smart keypad is hardwired with a battery backup. In some embodiments, the smart keypad is incorporated into the wall switch 108, whereas in other embodiments the smart keypad can be its own device.
The smart keypad also includes sensors such as temperature, humidity, occupancy, ambient light, fire, smoke, carbon monoxide, active proximity, passive infrared motion, ultrasound, CCD/video camera, etc. As mentioned above, a rechargeable battery is also included (or equivalently capable onboard power storage medium). For example, the battery can be a rechargeable Lithium-Ion battery. In operation, the smart keypad charges the battery during time intervals in which the hardware power usage is less than what power stealing can safely provide, and that will discharge to provide the needed extra electrical power during time intervals in which the hardware power usage is greater than what power stealing can safely provide.
The user interface of the smart keypad can include one or more visual displays (TFT, OLED, etc.), touchscreen and/or button input capabilities, the audio speaker, and so forth. According to embodiments, an optional 2D image and/or 3D holographic image projector can also be provided so that the effective dimension of the display is not just limited to the physical size of the smart keypad. The user interface can be user customized by the home occupants.
The smart keypad can be secured by a user-determined passcode. In some embodiments, the passcode can be a PIN comprising any number and combination of letters and/or numbers. In other embodiments, the passcode can be a phrase. In yet other embodiments, the passcode can be a gesture, which the smart keypad senses using ultrasonic sensors, PIR sensors, etc. In still other embodiments, the passcode is in the form of a unique connect-the-dot pattern, where the user interface displays a plurality of dots (e.g., a grid of dots) and the user moves his or her finger from dot to dot in a unique pattern. Any one of these forms of the passcode, including the gesture and the connect-the-dots pattern, can provide users with a quick and easy way to arm and disarm the alarm system of the home. For example when leaving the home, the user can walk up to the smart keypad and make the unique gesture or input the connect-the-dots pattern to arm the alarm. According to some embodiments, the smart keypad manages a user list, which includes a list of users and corresponding times they can control the keypad to arm/disarm the security system and to control other functions of the smart home. In some cases, the various users may identify themselves to the smart keypad using unique identification numbers and access codes, including the passcodes described above. Further, in some cases, the smart keypad may be capable of recognizing a user based on the user's “digital fingerprint”, such as by wirelessly identifying the user's mobile electronic device 166.
According to embodiments, the smart keypad includes a “light your path” feature, whereby the smart keypad activates a light when it senses that a user is approaching in darkness or near darkness. For example, in the event the user approaches the smart keypad in the middle of the night, the smart keypad may activate nearby lights in the home or a light incorporated in the smart keypad itself (e.g., LED) to provide a lighted pathway for the user. In one example, the smart keypad is incorporated in a wall light switch, and the smart keypad activates the light associated with the wall switch when a user is approaching the smart keypad. In some examples, upon detecting an approaching user when the security system is armed, the smart keypad or other devices of the home or the server 164 can send notification to the occupants' mobile devices or other electronic devices. Also, for example, the smart keypad can send a notification message to the occupants' mobile devices any time the alarm system is armed or disarmed by a user.
According to embodiments, the smart keypad is “smash and bash” resistant. For example, in the event the home's alarm system is armed and the smart keypad is smash (e.g., by an intruder attempting to disarm the alarm by bashing the keypad), the alarm remains armed. In some cases, upon being smashed, the smart keypad triggers the alarm and executes pre-configured actions, such as notifying police and/or other emergency personnel.
According to embodiments, the smart keypad or other devices in the home are capable of assigning user-defined gestures to actions or sets of actions. For example, the user may program the smart keypad with a “panic gesture” that causes the smart keypad, other devices in the smart home, or the server 164 to notify authorities, such as by calling or otherwise notifying medical, police, etc. Such a panic gesture may be, for example, the user quickly waving his or her hands in the air. The user may also program the smart keypad or other devices in the home with an audible panic command. For example, when the user yells “help”, then medical, police, etc. may be called or otherwise notified. In other examples, the smart keypad can include a panic button that the user can press to call the police, medical, etc.
According to embodiments, the smart keypad or any of the other smart-home devices have the ability to display customer messages, such as via a display on the device itself or by projection. For example, in the event a child is sleeping, the smart doorbell 106 may display, “Baby is sleeping. Do not ring.” In other embodiments, the smart keypads and other devices are capable of projecting or displaying messages. For example, when a person is at the front door, the keypads may project a message, such as “Someone's at the door”. This would be good for situations where the users have deactivated, or the smart home has automatically deactivated, the doorbell and/or other audible notifications because some or all of the occupants are sleeping. These messages would also be useful for hearing impaired occupants. The smart keypads and other devices could also project or display warning messages, such as “Evacuate” due to possible intruder, fire, CO, etc. The message could be projected in large font on walls, floors, ceilings, etc. And the message could provide additional information. For example, the message could be “Intruder detected in den”, “Fire detected in kitchen”, etc.
According to embodiments, the smart keypad and the other smart devices are used as a platform for running home applications. For example, the smart keypad has the capability of downloading and/or executing applications that enable users to control their smart homes. For example, the user could install a “thermostat” app that can be accessed and controlled from any of the smart devices in the home, including the smart keypads, to control the home's HVAC. The user could also install a “security” app, for example. It should be appreciated that the number and type of apps that could be download and installed are endless.
Turning now to
According to embodiments, the smart hazard detector 104 is a retrofit designed to replace older hazard detectors. Although not shown in the figures, the smart hazard detector 104 may comprise two primary components: a head unit 404 and a backplate or docking station 408. The head unit comprises the sensors, battery, processor, storage, and other components, while the docking station serves as a physical connection into the wall and, if applicable, to the 120V line voltage wires or other wiring of the smart-home environment 100. When installed, the docking station may resemble a conventional backplate for a tradition hazard detector. Users can plug and unplug the head unit in and out of the docking station. Thus, many different commercial and functional possibilities for provisioning, maintenance, and upgrade are possible. For example, after years of using any particular head unit, a user will be able to buy a new version of the head unit and simply plug it into the docking station. There are also many different versions for the head unit 404, such as an extremely low-cost version that is nothing but a smoke detector, and then a progression of increasingly-capable versions, up to and including extremely fancy head units. Thus, it should be appreciated that the various versions of the head units can all be interchangeable, with any of them working when placed into any docking station. This can advantageously encourage sharing and re-deployment of old head units—for example, when an important high-capability head unit (for detecting hazards in the kitchen, for example) can replaced by a newer version, then the old head unit can be re-deployed in a bedroom or a basement, etc. When first plugged into a docking station, the head unit can ask the user (by 2D LCD display, 2D/3D holographic projection, voice interaction, etc.) a few simple questions such as, “Where am I” and the user can select “bedroom” or “living room” and so forth.
There can be substantial overlap between the smart hazard detector 104 and the wall switch 108, as well as the other devices of the smart-home environment 100 with respect to processing, sensing, user interface, and communications capabilities. The smart hazard detector 104 may be a low-power consuming device that is powered by battery 512 and that includes a low-power communication chip (such as a ZigBee chip) and may participate as a low-power node in the mesh network of the smart-home environment 100 by generating and transmitting messages, relay messages from other devices, as well as by “listen” and sometimes making a corresponding response. However, it should be appreciated that instead of or in addition to being battery powered, the smart hazard detector 104 may be powered by AC voltage from the home. In some embodiments, the smart hazard detector 104 includes a WiFi chipset that enable it to communicate its status to other devices in the smart-home environment 100, to user mobile devices 166, to the central server or cloud-computing system 164, as well as to external managed security services. It should be appreciated that smart hazard detector 104 is microprocessor driven and that the WiFi chip may contain extra processing capacity for controlling all or some operations of the smart hazard detector 104. In some embodiments, a separate processor is provided.
According to the illustrated embodiment, the smart hazard detector 104 includes a smoke detector 516, which comprises a smoke photodiode, a detector, and a smoke chamber. The smoke photodiode may be, for example, an IR LED. Alternatively, instead of IR, a visible light LED or a laser may be provided. In some embodiments, the detector may be a photon silicon photomultiplier chip. The smoke photodiode and the detector may be programmed to execute a duty cycle every ten seconds, or so. For example, every ten seconds the photodiode and the detector will do an X-axes microsecond smoke test. The photodiode and the detector also execute self-calibration tests at predetermined intervals.
Further, the smart hazard detector 104 includes a carbon monoxide sensor 520, which can be either an electrochemical sensor or a metal oxide semiconductor. Additionally, the smart hazard detector 104 may include a temperature sensor, a humidity sensor for reducing false alarms associated with showering and cooking, and an ambient light sensor, such as a single pixel that measures the brightness of the room.
The smart hazard detector 104 may be provided with occupancy detecting capabilities. According to an embodiment, one or more ultrasonic sensors 524 are provided for motion detecting. However, it should be appreciated that in addition to or instead of the ultrasonic sensors 524, one or more passive IR sensors 528 are provided for occupancy sensing. Having multiple ultrasonic sensor 524 and/or passive IR sensors 528 enhance the occupancy sensing capabilities of the detector. Because they are typically mounted in unobstructed locations, high on walls of often-occupied rooms, smart hazard detectors 104 are particularly well suited for occupancy detection, such as by the use of RFID, ultrasonic sensors, etc. The smart hazard detector 104 may also include a thermopile 534 for flame-heat detection. As it is well known in the art, the thermopile or thermo-camera 534 is a group of thermo couples that take infrared light and correlate that to flame heat. In some instances, this is advantageous because the thermo-camera looks into the room and gives advanced warning of heat. Thus, the thermo-camera 534 is able to “see” heat before the heat actually makes its way to the smart hazard detector 104.
In some embodiments, the smart hazard detector 104 is equipped with one or more air quality sensors 538. For example, the air quality sensors 538 may “sniff” for volatile organic compounds (VOCs) that may be present in the house. Thus, the smart hazard detector 104 can warn users when there are toxins in the user's home, such as when the user is burning a paraffin wax candle. Paraffin is a by-product of petroleum and has been shown to release an alarming range of (VOCs), such as toluene and benzene. Also, for example, the air quality sensors 538 can “sniff” for gas leaks in the house, such as by detecting methane, which is commonly added to natural gas so as to make natural gas detectable. This “sniffing” capability is not only good for houses, but also for schools and hospitals. Individuals will find peace of mind knowing such detection is in widespread use. Further, as houses get more and more sealed, air quality detection will grow in importance. Further, the air quality sensors 538 can measure levels of particulate, dust, pollen, mold, etc. for detection.
In addition to measuring air quality and detecting harmful VOCs, the smart hazard detector 104 is capable of transmitting this information to the other devices in the home as well as the central server or cloud-computing system 164. For example, in some embodiments, when there are elevated levels of patent harmful gases, particulate, dust, pollen, mold, etc. in the home, the smart hazard detector 104 can transmit this information to the central server or cloud-computing system 164, which communicates with other nodes in the home and just outside of the home, such as the smart doorbell 106, and assess whether the inside air or the outside air is purer. If the outside air is purer, then the central server or cloud-computing system 164 instructs the smart thermostat 102 to open a vent to permit fresh air into the home, otherwise it instructs the thermostat 102 to recirculate air in the home and to not draw in outside air. Furthermore, the central server or cloud-computing system 164, upon receiving the air quality information from the hazard device 104, can send detailed information about the air quality to the mobile device 166 of user. For example, the air quality information may identify the specific types of toxins, particulate, dust, pollen, mold, etc. in the air. This can help the user identify which pollen, etc. the user is allergic to. Further, the central server or cloud-computing system 164 can use the air quality information to provide the user with medication recommendations (e.g., be sure to take you allergy pills today). Furthermore, the central server or cloud-computing system 164 can aggregate data received from multiple home in various geographic locations and provide, for example, smog alerts, pollen warnings, etc.
According to some embodiments, the smart hazard detector 104 may include a carbon dioxide (CO2) sensor for fire detection, where the detector includes a passive IR detector from lead selenide. Fire produces CO, CO2, and infrared light. The intensity of the infrared light emitted by the flame is pretty constant, until it passes through the layer of CO2 produced by the fire. However, the frequency of light having a wavelength of 4.26μ excites CO2 molecules when the light contacts the CO2. In response, the CO2 absorbs the infrared light having a wavelength of 4.26μ, thereby decreasing the intensity of the light at this wavelength. Thus, to detect fire, a narrow optical bandpass filter is placed in front of the lead selenide IR detector to permit only light having a wavelength 4.26μ to pass through to the lead selenide IR detector. In the event of fire, the lead selenide detects the decrease in intensity of light at a wavelength of 4.26μ and triggers the fire alarm.
According to embodiments, technologies including the sensors of the smart hazard detector 104 in combination with rules-based inference engines or artificial intelligence provided at a central server such as 164 are used to warn occupants of dangerous conditions in the home. For example, an inference can be made that an occupant is burning a candle based of the qualities (e.g., intensity, wavelength, frequency, etc.) of the light and/or the toxins begin released into the air. Further, an inference can be made that the occupant in the room has fallen asleep when the occupant is in the room and has not moved for a predetermined period of time. In situations where a candle is burning and the occupant has fallen asleep, the smart hazard detector 104 in that room will sound an alarm to wake up the occupant. In other example, the smart hazard detector 104 can sound an alarm or send an alert text or email message when it detects dangerous conditions in unoccupied rooms, such as when the stove is left on in the kitchen.
In the event a fire does occur in the home, technologies including the sensors of the hazard detectors 104 in combination with rules-based inference engines or artificial intelligence provided at a central server such as 164 are used to determine the cause. For example, the smart hazard detector 104 can detect that the fire started in the kitchen, and the smart hazard detector 104 can detect an active stove, candle, etc. was left unattended in the kitchen just before the fire started. Additionally, a central server such as 164 can aggregate data from multiple homes that experienced a fire, analyze the data to find patterns and reconstruct what caused the fires, and share this information with fire departments.
In some embodiments, the smart hazard detector 104 is mounted in a location that is out-of-reach of the occupants, such as high on a wall or on a ceiling. Thus, in the event of a false alarm, the occupants cannot reach the smart hazard detector 104 to press a button that deactivates the alarm. Accordingly, embodiments of the smart hazard detector 104 allow for occupants to deactivate the alarm using “silence gestures”. For example, the smart hazard detector 104 detects a particular “silence gesture” from one of the occupants and, in response, deactivates the alarm.
According to embodiments, the one or more ultrasonic sensors 524 of the smart hazard detector 104 are used to detect the “silence gesture” of the occupant. In some embodiments, each of the ultrasonic sensors 524 may contain multiple piezos so as to make the sensor “omni-directional” and to make it easier to detect when an occupant is making a silence gesture. Using ultrasonic sensors 524 in battery-powered versions of the smart hazard detector 104 is particularly advantageous because ultrasonic sensors 524 consume very little power. The ultrasonic sensors 524 work by sending out pulses and then calculate the time interval between sending the pulse and receiving the echo to determine the distance to an object. In some embodiments, a single piezo of the ultrasonic sensor sends the pulse and receives the echo. In other embodiments, separate piezos send pulses and receive echoes.
During normal operation, the ultrasonic sensors 524 of the smart hazard detector 104 are merely performing occupancy sensing functions. For example, they are determining whether the room is occupied. When performing this function, the ultrasonic sensors 524 have a ping rate of about one hertz. This low ping rate is designed to preserve battery power, while still effectively perform occupancy detection. However, when one of the other sensors, such as the smoke, fire, or carbon monoxide sensors, activates the alarm, the smart hazard detector 104 increases the ping rate, such as up to twenty hertz. The increased ping rate better enables detection of “silence gestures”, which are only made when the alarm is activated. When detecting a “silence gesture”, the ultrasonic sensors 524 are “looking for” an object, such as a human hand, to remain within in a predefined distance from the smart hazard detector 104 for a specified period.
An example “silence gesture” will be described with references to
Referring now to block 630 of
Referring still to block 630, the light 610 is turned on when the occupant 608 successfully triggers the “silence gesture” period, thereby signaling to the occupant 608 to remain in the position for the requisite period, such as three seconds. Here, the hand of the occupant 608 triggered the “silence gesture” period. A tolerance is built in such that if the occupant 608 slightly moves and loses but quickly regains the signal, the “silence gesture” period will continue without having to start over. As shown in block 634, the occupant kept the hand in within the requisite distance of the sensor for the duration of the “silence gesture” period and, thus the alarm has been deactivated, the “BEEP” has stopped, and the light 610 has turned off. As shown at blocks 638 and 642, the occupant 608 can walk away from the smart hazard detector 104 and resume normal activity.
It should be appreciated that, in the event the smart hazard detector 104 is of a design that receives reliable power from the wiring of the home (rather than being battery powered), a CCD chip could be used to detect the “silence gesture”. However, such an arrangement is not suitable for battery-powered hazard detectors 104 because the CCD chips and associated processing consume a large amount of power and would quickly drain the battery. Other possible alternatives to ultrasonic sensors 524 include passive IR sensors, thermopile (e.g., thermo-cameras), laser-distance measuring, laser and a camera combination because a camera looks for dot instead of time of arrival (doppler shift), and a full on camera and image processing system.
According to some embodiments, to enhance the reliability and effectiveness of the silence gesture, the ultrasonic sensor 524 could work in concert with one or more optical sensors to make the sensing even better. For example, when an occupant attempts to silence by placing a hand in field, the optical sensor will sense the presence of the occupant's hand, and thereby trigger the “silence gesture” period. The ultrasonic sensor 524 could also work in concert with the optical sensor after the “silence gesture” period has been triggered, where the ultrasonic sensor detects the occupant's changing hand distance, and the optical sensor detects the occupant's changing hand distance using proximity and heat techniques.
According to some embodiments, the ultrasonic sensor 524 could work in concert with the passive IR sensor. For example, when an occupant attempts to silence by placing a hand in field, the passive IR will sense this, and thereby trigger the “silence gesture” period. The ultrasonic sensor 524 could also work in concert with the thermopile (e.g., thermo-camera), where both distance change and heat are used to detect the silence gesture. For example, the thermo-camera detects when a human hand is nearby and triggers the “silence gesture” period. Further, the ultrasonic sensor 524 could work in concert with the ambient light sensor. For example, when the occupant places a hand in the field and blocks light, then the ambient light sensor know the occupant is nearby and thus triggers the “silence gesture” period.
It should be appreciated that, according to embodiments, similar “gesture” controls can be applied to other smart devices in the home, such as to the smart thermostat, the smart wall switches, etc. For example, there can be gestures for increasing or decreasing temperature controls, for turning on and off lights, HVAC, etc.
Turning now to
In some embodiments, the smart doorbell 106 is connected to the wiring of the smart-home environment 100. For example, as is common in many homes, a 24V low voltage wire is provided at the outer entry points of the home, such as at the front, back, and side doors. The smart doorbell 106 can be connected to this 24V low voltage wire to obtain steady and reliable power. However, it should be appreciated that the smart doorbell could include a battery for the purpose of replacing or supplementing power obtained from the home wiring. In some embodiments, the battery could be a rechargeable battery, such as a rechargeable Lithium-Ion battery, for extracting power as needed from the house wiring (e.g., 24V low voltage wire). For example, the smart doorbell 106 could charge the battery during time intervals in which the doorbell's power usage is less than what the 24V low voltage wire can safely provide, and that will discharge to provide the needed extra electrical power during time intervals in which the hardware power usage is greater than what the 24V low voltage wire can safely provide. Thus, the rechargeable battery could be used as a conventional back-up source or as a reservoir to supply excess DC power if needed for short periods.
As illustrated in
Sensor devices such as temperature, humidity, occupancy, ambient light, fire, smoke, carbon monoxide, active proximity, passive infrared motion, ultrasound, CCD/video camera, bar code scanner, etc., as well as I/O devices such as speakers, user interfaces, 2D/3D projectors, etc., are provided in the head unit 804. The sensors and I/O devices are generally represented at 828.
According to embodiments, technologies including the sensors 828 in combination with rules-based inference engines or artificial intelligence provided at a central server such as 164 are used to detect when packages are delivered to the door of the smart-home environment 100, and to take a variety of automated actions in response. According to some embodiments, the sensors 828 can “see” the uniform of the delivery person approaching the door or the truck of the delivery person, or the sensors can “hear” the truck in combination with a person approaching the door within a period after hearing the truck. Once the person is with a predetermined distance from the door, the smart doorbell 106, using its speaker, asks the person if he or she is a delivery person, to which that person can reply with an audible response or by indicating as such on the user interface of the doorbell. If the person is making a delivery, the doorbell can instruct the person to place the package in a location proximate the doorbell 106 such that its scanner can scan the bar code or other type of identifying tag affixed to or associated with the package being delivered.
According to embodiments, a central server, such as server 164, can use the bar code to obtain information about the package, such as the sender, recipient, a description of the item therein, whether signature is required, etc. Based on this information the rules-based inferences engines or artificial intelligence can make inference regarding which action to take next. For example, if occupants or more particularly if the specified recipient or recipients are in the home and the package is from a sender or contains an item that is of particular interest to the one or more occupants, an announcement can be made in the home, indicating the package is currently being dropped off and providing details about the package. On the other hand, if the sender or item is not of particular interest to one of the occupants based on the occupants past responses to receiving such deliveries, then no announcement will be made and the occupants can discover the package in due course. Similarly, if no occupants are home but an inference is made that the package is of particular interest to one of the occupants, a text message, email, phone call, etc. can be made the one or more identified occupants, indicating that the package in being delivered.
According to embodiments, in the event signature is required for the package but none of the occupants are home an inference is made to not disturb the occupants, the smart doorbell can provide authorization to leave the package. For example, the doorbell 106 presents an authorization code (either in plain text, barcode, or encrypted forms) on its user interface and prompts the delivery person to use his or her handheld device to record, scan, photograph, or otherwise acquire the authorization code. Once the authorization code has been acquired by the delivery person, the doorbell 106 can then instruct the delivery person regarding where to leave the package, such as at the front door, around the back of the house in a discrete location, etc.
According to embodiments, technologies including the sensors 828, such as noise, motion, and/or facial recognition detection, in combination with rules-based inference engines or artificial intelligence provided at a central server, such as server 164, are used to detect when one or more unknown individuals are approaching the home. A number of learned inferences can be made in this situation. For example, during late evening hours, an alarm will be sounded in the house, giving notice of the approaching person and/or the doorbell 106 may audibly announce to the individual that he or she is being monitored by a home security system. Further, in the event the person attempts to enter a door, window, or other access point to the home, a message will be sent to local law enforcement. However, during day time hours when one or more occupants are at home, a learned inference can be made to take no action, such as when a meter reader, mail carrier, garbage collector, etc. is approaching the house as per a reasonably predictable and learned schedule.
According to embodiments, the smart doorbell 106 provides a context-based entry keypad. In some examples, the entry keypad can be projected, such as via a 2D/3D holographic projection. In other examples, the entry keypad can be rendered on a display such as a 2D LCD display. Persons standing proximate to the smart doorbell 106 can enter a code into the keypad to obtain access to the smart-home environment 100. According to embodiments, the occupants of the home get context-based keypads and/or access codes. For example, the parents get a more sophisticated keypad that provides a variety of controls, whereas children get a simple keypad into which they can enter their access code. Further, non-occupants get context-based keypads, too. For example, a delivery person gets one keypad, whereas uncategorized individuals get another keypad. According to some embodiments, the keypad can vary based on factors such as time of day, current news (e.g., any recent crime in the neighborhood?), proximity of security guards and other law enforcement personnel, and which, if any, occupants are currently at home. For example, if there is a nearby security guard, then the keypad requests a three-digit access code or no access code at all, rather than the usual ten-digit access code. In another example, if no one is home or if only children or elderly people are at home, then a ten-digit code is required. However, if the parents of the children or the adult children of the elderly are at home then no access code is required or only a three-digit code is required. If the approaching person is identified as a guest, then the keypad prompts the guest to enter the west access code assigned to him or her. It should also be appreciated that individuals are prompted to input their access code as they leave the home, too. This way the codes of the guests, the occupants, and recognized categories of strangers (e.g., a delivery person) can be used to track the goings and comings of those people. It should be appreciated that this keypad can be provided on any smart device in the home, such as the wall switch 108, the thermostat 102, hazard detector 104, and the wall plug 110.
According to embodiments, when the central server such as server 164, based on information received from the doorbell 106, such as noise and motion data, determines that the street adjacent to the home has a threshold level of traffic, the inferences are made regarding the safety of the children residing at the home. For example, an alarm can be triggered in the home in the event one or more of the children are detected by the occupancy sensing to be outside of the home. This alert enables the parents or other caretakers to quickly take actions to protect the child from the traffic. Further, for example, automatic adjustments are made to audio equipment in the home to account for the increased traffic noise, such as by increasing the volume a proportionate amount.
As discussed, the sensors 828 may include temperature and humidity sensors, the data from which may be used for a number of useful services. For example, the outside humidity and temperature data is considered by the thermostat 102 when controlling the HVAC to best accomplish the occupants' desired comfort preferences. Further, for example, this information may be presented to the occupants through a number of user interfaces, such as a user interface associated with another one of the devices located inside of the home, the television, mobile and other computing devices, or audibly. In some instances, a central server such as server 164 collects this information from a plurality of smart homes across a plurality of geographic locations. This aggregated data may be sold to weather services or may be used to provide weather data to smart home occupants.
According to embodiments, the smart doorbell 106 includes a button 812 that, upon being touched, depressed, or otherwise activated, causes as audible notification to be broadcasted within the home or a message to be sent to user interfaces of devices within the home or to a mobile device associated with occupants of the home. Learned inferences can be made regarding the appropriate response to activation of the button 812. For example, the audible notification is only broadcast in occupied rooms, or rooms occupied by one or more occupants who have a relationship with the person at the door, or no alarm is sounded in rooms where occupants, such as small children, are determined to be sleeping. Also, for example, the occupant-selected songs, such as uploaded MP3's, may be broadcast in the home, where different songs may be broadcast for different occupants at home at the time or based on the identity of the person at the door. Further, for example, technologies and sensors at the smart doorbell 106 may identify the person based on facial recognition or based on other characteristics such as the manner in which the person approached the door. For example over time, based on input received from the smart doorbell 106, a central server can build up an address book of profile data about people who approach the door, such as some identifying biometric data. For example, the address book can be built over time using low-resolution data such as ultrasonic, passive IR, etc. to create a unique signature for individuals. This combined data from different domains becomes almost like a fingerprint regarding how that person approaches the house. In some instances, when a “familiar” person approaches the door, the smart doorbell 106 “asks” the person if he is “John Doe”, to which the person can verbally or physically respond. Upon obtaining this information John Doe's name or image can be announced or projected on device in the home and/or John Doe will be given certain access rights to the home, such as for example the door will automatically unlock as he approaches. Further, in addition to or instead of identification based on these unique “signatures”, individuals may enable their mobile devices to communicate with the smart doorbell 106, such as via BLUETOOTH, NFC, or other wireless protocols. Also, for example, individuals may “swipe” their smart phones in front of the smart doorbell's RFID scanner. Upon identifying the individual, the smart doorbell may give the individual certain access right to the home, such as by automatically unlocking the door.
According to embodiments, technologies including the sensors 828 in combination with rules-based inference engines or artificial intelligence provided at a central server, such as server 164, also make learned decisions.
Turning now to
A rich variety of new interactions are made possible between the smart wall plugs 110 and other devices of the smart-home environment 100. Occupancy, motion, or presence sensing, for example, can be enhanced by virtue of the numerous installation locations of wall plugs inside and outside of the home, albeit some of these locations are hidden behind furniture or in locations where people are unlikely to go. According to embodiments, the smart wall plugs 110 can include all or some of the components that are included in the wall switch 108, as illustrated in
According to some embodiments, the head unit 908 includes a standard duplex receptacle 960 having upper and lower outlets, each having three slots. The head unit 908 further contains some or all of a main processor, storage, audio speaker, microphone, power converter, GPS receiver, RFID locater, etc. Additionally, the head unit 908 may include wireless and wired networking. In view of the ample power availability, a variety of communications capabilities can be provided, including Wi-Fi, ZigBee, 3G/4G wireless, CAT6 wired Ethernet, and even optical fiber from the curb. According to embodiments, the smart wall plugs 110 are spokesman nodes in the mesh network described above. For example, the smart wall plugs 110 regularly send out messages regarding what they are sensing and, in addition to sending out their own messages, the smart wall plugs 110 repeat messages from other smart devices in the mesh network, thereby causing the messages to travel from node to node (i.e., smart device to smart device) throughout the smart-home environment 100. As spokesman nodes in the smart-home environment 100, the smart wall plugs 110 are able to “drop down” to low-powered communication protocols to receive messages from low-power nodes, translate the messages to other communication protocols, and send the translated messages to other spokesman nodes and/or the central server or cloud-computing system 164. Thus, the smart-wall plugs 110 enable the low-powered nodes using low-power communication protocols to send messages across the entire smart-home environment 100 as well as over the Internet 162 to the central server or cloud-computing system 164. For example, battery operated smart hazard detectors 104 are able to preserve their limited power resource, yet also communicate with the enteral server or could-computing system 164 in real time or near real time by sending messages in low-power protocols to the wall plugs 110 which repeat the messages in high-power protocols, which are transmitted to the central server or cloud-computing system 164. According to embodiments, the mesh network enables the central server or cloud-computing system 164 to regularly receive data from all of the smart devices in the home, make inferences based on the data, and send commands back to individual one of the smart devices to accomplish some of the smart-home objectives descried herein.
Furthermore, because the smart wall plug 110 can be connected to the home 120V system, a HomePlug or other powerline-communications capability can be provided (See
In some examples, the wall plug 110 may include or be associated with a light source having variable intensity and color, and can therefore function in a manner similar to the smart nightlight 170 described above. In some embodiments, the light source of the wall plug 110 is configured to activate when the ambient light sensor detects that the room is dark and/or when the occupancy sensor detects a person's presence or movement. The color and intensity of the light source can be adjusted based on information received from sensor of the wall plug 110 or from other smart devices in the smart-home environment. For example, in the event the central server or cloud-computing system 164 triggers an alarm indicating unauthorized intrusion (e.g., based on motion detection data received from smart devices in the home), the light source associated with the smart wall plugs 110 can be activated. In this example, the light sources associated with the wall plugs 110 can emit a high-intensity red-colored light to indicate that an emergency is occurring and to cause any intruder to leave the home.
According to embodiments, the smart wall plugs 110 wirelessly communicate with a central server such as server 164. Rules-based inference engines or artificial intelligence provided at a central server such as 164 make security-related decisions based on data received from the smart wall plugs 110. For example, decisions are made regarding when to trigger an alarm, when to turn on lights, when to send a warning to the owner's mobile device or to the neighborhood network. Furthermore, the intelligence of the central process can be used for safety. For example, the central server can be programmed with safe operating parameters for each application in the smart home, and can shutoff power to the appropriate wall plug 110 when the corresponding application deviates from its safe operating parameters. Also for example, in the event data from an occupancy sensor on a particular wall plug 110 indicates that a small child is really close to the wall plug, the central server may shut off power to that plug. Further, users can remotely control, such as by use of their mobile device, the outlets in the home. For example, a parent may want to shutoff power to all wall plugs 110 in their child's room, or that are outside of the home and there is some risk that a child may be attracted to the plug.
Turning now to
The outer rotatable ring 1012 allows the user to make adjustments, such as selecting a new target temperature. For example, by rotating the outer ring 1012 clockwise, the target temperature can be increased, and by rotating the outer ring 1012 counter-clockwise, the target temperature can be decreased. The smart thermostat 102 may be configured to receive a plurality of types of inputs by virtue of the rotatable ring 1012, such as a scrolling input and a selection input. For example, a rotation of the ring may allow a user to scroll through an array of selection options, and inwards pressure exerted on the ring (inward click) may allow a user to select one of the options (e.g., corresponding to a particular scroll position).
The outer rotatable ring 1012 may include a component that may be physically rotated, or, in other embodiments, a static component that may sense a user's virtual rotation of the ring. For some embodiments, the outer rotatable ring 1012 may include a touch pad configured to track arcuate motion of a user's finger on the touch pad. The touch pad may comprise, e.g., a ring-shaped or circular area. In some instances, the touch pad includes multiple portions (e.g., to detect arcuate motion in a first ring-shaped area and to detect tapping in a second inner circular area). Boundaries of a touch pad area may be identified to a user using, e.g., visual or tactile cues. For example, a ring-shaped touchpad area may be indented compared to neighboring areas on the smart thermostat 102, or the area may be a different color than neighboring areas.
For preferred embodiments such as those of
The front face of the smart thermostat 102 comprises a clear cover 1014 that according to some embodiments is polycarbonate, and a metallic portion 1024 preferably having a number of slots formed therein as shown. According to some embodiments, the surface of cover 1014 and metallic portion 1024 form a common outward arc or spherical shape gently arcing outward, and this gentle arcing shape is continued by the outer ring 1012.
Although being formed from a single lens-like piece of material such as polycarbonate, the cover 1014 has two different regions or portions including an outer portion 1014o and a central portion 1014i. According to some embodiments, the cover 1014 is painted or smoked around the outer portion 1014o, but leaves the central portion 1014i visibly clear so as to facilitate viewing of an electronic display 1016 disposed thereunderneath. According to some embodiments, the curved cover 1014 acts as a lens that tends to magnify the information being displayed in electronic display 1016 to users. According to some embodiments the central electronic display 1016 is a dot-matrix layout (individually addressable) such that arbitrary shapes can be generated, rather than being a segmented layout. According to some embodiments, a combination of dot-matrix layout and segmented layout is employed. According to some embodiments, central display 1016 is a backlit color liquid crystal display (LCD). An example of information displayed on the electronic display 1016 is illustrated in
Particular presentations displayed on the electronic display 1016 may depend on detected user input. For example, one of a plurality of variables (e.g., current setpoint temperature versus learning status) or variable values (e.g., 65 degrees versus 75 degrees) may be displayed. The one being displayed may depend on a user's rotation of the outer rotatable ring 1012. Thus, for example, when the device is configured to display a current setpoint temperature, the value being displayed may gradually increase as the user rotates the ring in a clockwise direction. The sign of the change in the displayed temperature may depend on whether the user is rotating the ring in a clockwise or counterclockwise direction. The speed at which the displayed temperature is changing may depend (e.g., in a linear manner) on the speed at which the user is rotating the ring.
As described above, a displayed characteristic may vary depending on received user input. For example, a displayed temperature may increase as a user rotates the outer rotatable ring 1012 clockwise, or a highlighted indicator may progress across a list of displayed options as the user rotates the ring 1012. Further, or additionally, user inputs may cause the appearance of new types of information. For example, if a user is viewing setpoint-temperature options, a dramatic clockwise rotation may cause a flashing red symbol (to convey an anti-environmental message). Thus, a relationship may exist between a single type of user input (e.g., ring rotation) and a change in an active variable (e.g., setpoint temperature changes), and relationships may further exist between the single type of user input and an inactive variable (e.g., an environmental warning flag). The latter relationship may be indirect and depend on a value or change in values of the active variable.
The presentations on the electronic display 1016 may depend on one or more types of user input. For example, the display may change in a first manner (e.g., to show a varying selection option) as a user rotates the outer rotatable ring 1012 and may change in a second manner (e.g., to confirm a selection or default to a menu screen) as the user exerts inwards pressure on the outer rotatable ring 1012.
According to some embodiments, metallic portion 1024 has a number of slot-like openings so as to facilitate the use of a passive infrared motion sensor 1030 mounted therebeneath. The metallic portion 1024 can alternatively be termed a metallic front grille portion. Further description of the metallic portion/front grille portion is provided in the commonly assigned U.S. Ser. No. 13/199,108. The design of the metallic portion 1024 compliments the sleek, simple, uncluttered and elegant design of smart thermostat 102 while facilitating the integration and operation of sensors located within a housing of the thermostat. In the implementation as illustrated, smart thermostat 102 is enclosed by housing with a forward-facing surface including the cover 1014 and the metallic portion 1024. Some implementations of the housing include a back plate and a head unit. The housing provides an attractive and durable configuration for one or more integrated sensors used by smart thermostat 102 and contained therein. In some implementations, the metallic portion 1024 may be flush-mounted with the cover 1014 on the forward-facing surface of housing. Together the metallic portion 1024 as incorporated in housing does not detract from home or commercial decor, and indeed can serve as a visually pleasing centerpiece for the immediate location in which it is located.
The metallic portion 1024 is designed to conceal sensors from view promoting a visually pleasing quality of the thermostat yet permitting them to receive their respective signals. Openings in the metallic portion 1024 along the forward-facing surface of the housing allow signals to pass through that would otherwise not pass through the cover 1014. For example, glass, polycarbonate or other similar materials used for cover 1014 are capable of transmitting visible light but are highly attenuating to infrared energy having longer wavelengths in the range of 10 microns, which is the radiation band of operation for many passive infrared (PIR) occupancy sensors. Notably, included in the smart thermostat 102, according to some preferred implementations, is an ambient light sensor (not shown) and an active proximity sensor (not shown) positioned near the top of the thermostat just behind the cover 1014. Unlike PIR sensors, the ambient light sensor and active proximity sensor are configured to detect electromagnetic energy in the visible and shorter-infrared spectrum bands having wavelengths less than 1 micron, for which the glass or polycarbonate materials of the cover 1014 are not highly attenuating. In some implementations, the metallic portion 1024 includes openings in accordance with one or more implementations that allow the longer-wavelength infrared radiation to pass through the openings towards a passive infrared (PIR) motion sensor 1030 as illustrated. Because the metallic portion 1024 is mounted over the radiation receiving surface of PIR motion sensor 1030, PIR motion sensor 1030 continues to receive the longer wavelength infrared radiation through the openings and detect occupancy in an enclosure.
Additional implementations of the metallic portion 1024 also facilitate additional sensors to detect other environmental conditions. The metallic portion may at least partly conceal and/or protect one or more such sensors. In some implementations, the metallic portion 1024 helps a temperature sensor situated inside of the thermostat's housing measure the ambient temperature of air. Openings in the metallic portion 1024 promote air flow towards a temperature sensor located below the metallic portion 1024 thus conveying outside temperatures to the interior of the housing. In further implementations, the metallic portion 1024 may be thermally coupled to a temperature sensor promoting a transfer of heat from outside the housing.
The smart thermostat 102 is preferably constructed such that the electronic display 1016 is at a fixed orientation and does not rotate with the outer ring 1012, so that the electronic display 1016 remains easily read by the user. For some embodiments, the cover 1014 and metallic portion 1024 also remain at a fixed orientation and do not rotate with the outer ring 1012. According to one embodiment in which the diameter of the smart thermostat 102 is about 80 mm, the diameter of the electronic display 1016 is about 45 mm. According to some embodiments an LED indicator 1080 is positioned beneath portion 1024 to act as a low-power-consuming indicator of certain status conditions. For, example the LED indicator 1080 can be used to display blinking red when a rechargeable battery of the thermostat is very low and is being recharged. More generally, the LED indicator 1080 can be used for communicating one or more status codes or error codes by virtue of red color, green color, various combinations of red and green, various different blinking rates, and so forth, which can be useful for troubleshooting purposes.
Motion sensing as well as other techniques can be used in the detection and/or prediction of occupancy, as it is described further in the commonly assigned U.S. Ser. No. 12/881,430, supra (U.S. Pat. No. 8,510,255, issued Aug. 13, 2013). According to some embodiments, occupancy information is used in generating an effective and efficient scheduled program. Preferably, an active proximity sensor 1070A is provided to detect an approaching user by infrared light reflection, and an ambient light sensor 1070B is provided to sense visible light. The proximity sensor 1070A can be used to detect proximity in the range of about one meter so that the smart thermostat 102 can initiate “waking up” when the user is approaching the thermostat and prior to the user touching the thermostat. Such use of proximity sensing is useful for enhancing the user experience by being “ready” for interaction as soon as, or very soon after the user is ready to interact with the thermostat. Further, the wake-up-on-proximity functionality also allows for energy savings within the thermostat by “sleeping” when no user interaction is taking place or about to take place. The ambient light sensor 1070B can be used for a variety of intelligence-gathering purposes, such as for facilitating confirmation of occupancy when sharp rising or falling edges are detected (because it is likely that there are occupants who are turning the lights on and off), and such as for detecting long term (e.g., 24-hour) patterns of ambient light intensity for confirming and/or automatically establishing the time of day.
According to some embodiments, for the combined purposes of inspiring user confidence and further promoting visual and functional elegance, the smart thermostat 102 is controlled by only two types of user input, the first being a rotation of the outer ring 1012 as shown in
According to some embodiments, the smart thermostat 102 includes a processing system 1060, display driver 1064 and a wireless communications system 1066. The processing system 1060 may be disposed within a housing of smart thermostat 102, coupled to one or more temperature sensors of smart thermostat 102 and/or coupled to rotatable ring 1012. The processing system 1060 may be configured to dynamically identify user input via rotatable ring 1012, dynamically identifying a variable value (e.g., a setpoint temperature value), and/or dynamically identify an HVAC-control-related property. The processing system 1060 may be configured and programmed to provide an interactive thermostat menuing system on display area 1016 responsive to an inward pressing of rotatable ring 1012 (e.g., such as for asking questions or otherwise obtaining data from users during interactive information-exchange sessions, as described in commonly-assigned U.S. patent application Ser. No. 13/440,910 (now U.S. Patent Application Publication No. 2013/0268125), which is hereby incorporated by reference herein in its entirety) and/or to provide user navigation within the interactive thermostat menuing system based on rotation of rotatable ring 1012 and inward pressing of rotatable ring 1012 (e.g., such as is described in relation to
For example, an active variable (e.g., variable-value selection, setpoint selection, zip-code selection) may be determined based on a default state, smart logic or previously received user input. A relationship between the variable and user input may be identified. The relationship may be, e.g., linear or non-linear, continuous or discrete, and/or saturating or non-saturating. Such relationships may be pre-defined and stored within the thermostat. User input may be detected. Analysis of the user input may include, e.g., identifying: a type of user input (tapping versus rotation), a degree of input (e.g., a degree of rotation); a final input position (e.g., a final angular position of the rotatable ring); an input location (e.g., a position of a tapping); and/or a speed of input (e.g., a speed of rotation). Using the relationship, the processing system 1060 may then determine a display indicator, such as a digital numerical value representative of an identified value of a variable (e.g., a setpoint temperature). The display indicator may be displayed on display area 1016. For example, a digital numerical value representative of a setpoint temperature to be displayed may be determined based on a prior setpoint value and a saturating and continuous relationship between rotation input and the temperature. The displayed value may be, e.g., numeric, textual or graphical.
The processing system 1060 may further set a variable value in accordance with a user selection. For example, a particular type of user input (e.g., inwards pressure exertion) may be detected. A value of a selected variable may be determined based on, e.g., a prior ring rotation, displayed variable value, etc. The variable may then be set to this value.
The processing system 1060, according to some embodiments, is capable of carrying out the governance of the operation of smart thermostat 102 including the user interface features described herein. The processing system 1060 is further programmed and configured to carry out other operations as described further hereinbelow and/or in other ones of the commonly assigned incorporated applications. For example, processing system 1060 is further programmed and configured to maintain and update a thermodynamic model for the enclosure in which the HVAC system is installed, such as described in U.S. Ser. No. 12/881,463 (U.S. Pat. No. 8,606,374, issued Dec. 10, 2013). According to some embodiments, the wireless communications system 1066 is used to communicate with devices such as personal computers and/or other thermostats or HVAC system components, which can be peer-to-peer communications, communications through one or more servers located on a private network, and/or communications through a cloud-based service.
It should be appreciated that the smart thermostat 102 could be equipped with a tactile mechanical feedback feature for providing software-triggered mechanical feedback to encourage energy efficient user behavior. For example, in the event a user attempts to input an ill-advised temperature setting (e.g., a setting that consumes a large amount of energy), the tactile mechanical feedback features provide the user with negative mechanical feedback, such as by vibrating, making the ring hard or impossible to turn.
Further, it should be appreciated that any of the smart devices described herein, such as the smart hazard detector, the smart thermostat, the smart wall switch, the smart doorbell, etc., could have means for self-generating power and optionally storing the generated power in a local battery. For example, in some embodiments, the smart devices include a Peltier Junction for generating power. In these embodiments, for example, the Peltier Junction generates electricity from heat differentials created between the smart device and its mounting location, such as when the smart device gets hot from use. In other embodiments, the smart devices are equipped with generators, such as piezoelectric devices that generate electricity when the device is physically used, such as when a user turns the ring on the smart thermostat. While piezoelectric devices are used in this example, it should be appreciated that any generator devices known to those having skill in the art could be used.
Further included and illustrated in the exemplary smart-home environment 100 of
When serving as a localized thermostat for an occupant, a particular one of the service robots 168 can be considered to be facilitating what can be called a “personal comfort-area network” for the occupant, with the objective being to keep the occupant's immediate space at a comfortable temperature wherever that occupant may be located in the home. This can be contrasted with conventional wall-mounted room thermostats, which have the more attenuated objective of keeping a statically-defined structural space at a comfortable temperature. According to one embodiment, the localized-thermostat service robot 168 is configured to move itself into the immediate presence (e.g., within five feet) of a particular occupant who has settled into a particular location in the home (e.g., in the dining room to eat their breakfast and read the news). The localized-thermostat service robot 168 includes a temperature sensor, a processor, and wireless communication components configured such that control communications with the HVAC system, either directly or through a wall-mounted wirelessly communicating thermostat coupled to the HVAC system, are maintained and such that the temperature in the immediate vicinity of the occupant is maintained at their desired level. If the occupant then moves and settles into another location (e.g., to the living room couch to watch television), the localized-thermostat service robot 168 proceeds to move and park itself next to the couch and keep that particular immediate space at a comfortable temperature.
Technologies by which the localized-thermostat service robot 168 (and/or the larger smart-home system of
When serving as a localized air monitor/purifier for an occupant, a particular service robot 168 can be considered to be facilitating what can be called a “personal health-area network” for the occupant, with the objective being to keep the air quality in the occupant's immediate space at healthy levels. Alternatively or in conjunction therewith, other health-related functions can be provided, such as monitoring the temperature or heart rate of the occupant (e.g., using finely remote sensors, near-field communication with on-person monitors, etc.). When serving as a localized hazard detector for an occupant, a particular service robot 168 can be considered to be facilitating what can be called a “personal safety-area network” for the occupant, with the objective being to ensure there is no excessive carbon monoxide, smoke, fire, etc. in the immediate space of the occupant. Methods analogous to those described above for personal comfort-area networks in terms of occupant identifying and tracking are likewise applicable for personal health-area network and personal safety-area network embodiments.
According to some embodiments, the above-referenced facilitation of personal comfort-area networks, personal health-area networks, personal safety-area networks, and/or other such human-facing functionalities of the service robots 168, are further enhanced by logical integration with other smart sensors in the home according to rules-based inferencing techniques or artificial intelligence techniques for achieving better performance of those human-facing functionalities and/or for achieving those goals in energy-conserving or other resource-conserving ways. Thus, for one embodiment relating to personal health-area networks, the air monitor/purifier service robot 168 can be configured to detect whether a household pet is moving toward the currently settled location of the occupant (e.g., using on-board sensors and/or by data communications with other smart-home sensors along with rules-based inferencing/artificial intelligence techniques), and if so, the air purifying rate is immediately increased in preparation for the arrival of more airborne pet dander. For another embodiment relating to personal safety-area networks, the hazard detector service robot 168 can be advised by other smart-home sensors that the temperature and humidity levels are rising in the kitchen, which is nearby to the occupant's current dining room location, and responsive to this advisory the hazard detector service robot 168 will temporarily raise a hazard detection threshold, such as a smoke detection threshold, under an inference that any small increases in ambient smoke levels will most likely be due to cooking activity and not due to a genuinely hazardous condition.
The above-described “human-facing” and “away” functionalities can be provided, without limitation, by multiple distinct service robots 168 having respective dedicated ones of such functionalities, by a single service robot 168 having an integration of two or more different ones of such functionalities, and/or any combinations thereof (including the ability for a single service robot 168 to have both “away” and “human facing” functionalities) without departing from the scope of the present teachings. Electrical power can be provided by virtue of rechargeable batteries or other rechargeable methods, with
Provided according to some embodiments are systems and methods relating to the integration of the service robot(s) 168 with home security sensors and related functionalities of the smart home system. The embodiments are particularly applicable and advantageous when applied for those service robots 168 that perform “away” functionalities or that otherwise are desirable to be active when the home is unoccupied (hereinafter “away-service robots”). Included in the embodiments are methods and systems for ensuring that home security systems, intrusion detection systems, and/or occupancy-sensitive environmental control systems (for example, occupancy-sensitive automated setback thermostats that enter into a lower-energy-using condition when the home is unoccupied) are not erroneously triggered by the away-service robots.
Provided according to one embodiment is a home automation and security system (e.g., as shown in
According to another embodiment, functionality similar to that of the central server in the above example can be performed by an on-site computing device such as a dedicated server computer, a “master” home automation console or panel, or as an adjunct function of one or more of the smart-home devices of
According to other embodiments, there are provided methods and systems for implementing away-service robot functionality while avoiding false home security alarms and false occupancy-sensitive environmental controls without the requirement of a single overall event orchestrator. For purposes of the simplicity in the present disclosure, the home security systems and/or occupancy-sensitive environmental controls that would be triggered by the motion, noise, vibrations, or other disturbances of the away-service robot activity are referenced simply as “activity sensing systems,” and when so triggered will yield a “disturbance-detected” outcome representative of the false trigger (for example, an alarm message to a security service, or an “arrival” determination for an automated setback thermostat that causes the home to be heated or cooled to a more comfortable “occupied” setpoint temperature). According to one embodiment, the away-service robots are configured to emit a standard ultrasonic sound throughout the course of their away-service activity, the activity sensing systems are configured to detect that standard ultrasonic sound, and the activity sensing systems are further configured such that no disturbance-detected outcome will occur for as long as that standard ultrasonic sound is detected. For other embodiments, the away-service robots are configured to emit a standard notification signal throughout the course of their away-service activity, the activity sensing systems are configured to detect that standard notification signal, and the activity sensing systems are further configured such that no disturbance-detected outcome will occur for as long as that standard notification signal is detected, wherein the standard notification signal comprises one or more of: an optical notifying signal; an audible notifying signal; an infrared notifying signal; an infrasonic notifying signal; a wirelessly transmitted data notification signal (e.g., an IP broadcast, multicast, or unicast notification signal, or a notification message sent in a TCP/IP two-way communication session).
According to some embodiments, the notification signals sent by the away-service robots to the activity sensing systems are authenticated and encrypted such that the notifications cannot be learned and replicated by a potential burglar. Any of a variety of known encryption/authentication schemes can be used to ensure such data security including, but not limited to, methods involving third party data security services or certificate authorities. For some embodiments, a permission request-response model can be used, wherein any particular away-service robot requests permission from each activity sensing system in the home when it is ready to perform its away-service tasks, and does not initiate such activity until receiving a “yes” or “permission granted” message from each activity sensing system (or from a single activity sensing system serving as a “spokesman” for all of the activity sensing systems). One advantage of the described embodiments that do not require a central event orchestrator is that there can (optionally) be more of an arms-length relationship between the supplier(s) of the home security/environmental control equipment, on the one hand, and the supplier(s) of the away-service robot(s), on the other hand, as it is only required that there is the described standard one-way notification protocol or the described standard two-way request/permission protocol to be agreed upon by the respective suppliers.
According to still other embodiments, the activity sensing systems are configured to detect sounds, vibrations, RF emissions, or other detectable environmental signals or “signatures” that are intrinsically associated with the away-service activity of each away-service robot, and are further configured such that no disturbance-detected outcome will occur for as long as that particular detectable signal or environmental “signature” is detected. By way of example, a particular kind of vacuum-cleaning away-service robot may emit a specific sound or RF signature. For one embodiment, the away-service environmental signatures for each of a plurality of known away-service robots are stored in the memory of the activity sensing systems based on empirically collected data, the environmental signatures being supplied with the activity sensing systems and periodically updated by a remote update server. For another embodiment, the activity sensing systems can be placed into a “training mode” for the particular home in which they are installed, wherein they “listen” and “learn” the particular environmental signatures of the away-service robots for that home during that training session, and thereafter will suppress disturbance-detected outcomes for intervals in which those environmental signatures are heard.
Referring next to
A user 1504 can input commands into the computer 1502 using various input devices, such as a mouse, keyboard, track ball, touch screen, etc. If the computer system 1500 comprises a mainframe, a designer 1504 can access the computer 1502 using, for example, a terminal or terminal interface. Additionally, the computer system 1526 may be connected to a printer 1508 and a server 1510 using a network router 1512, which may connect to the Internet 1518 or a WAN.
The server 1510 may, for example, be used to store additional software programs and data. In one embodiment, software implementing the systems and methods described herein can be stored on a storage medium in the server 1510. Thus, the software can be run from the storage medium in the server 1510. In another embodiment, software implementing the systems and methods described herein can be stored on a storage medium in the computer 1502. Thus, the software can be run from the storage medium in the computer system 1526. Therefore, in this embodiment, the software can be used whether or not computer 1502 is connected to network router 1512. Printer 1508 may be connected directly to computer 1502, in which case, the computer system 1526 can print whether or not it is connected to network router 1512.
With reference to
Special-purpose computer system 1600 comprises a computer 1502, a monitor 1506 coupled to computer 1502, one or more additional user output devices 1630 (optional) coupled to computer 1502, one or more user input devices 1640 (e.g., keyboard, mouse, track ball, touch screen) coupled to computer 1502, an optional communications interface 1650 coupled to computer 1502 and/or a communication network 1695, a computer-program product 1605 stored in a tangible computer-readable memory in computer 1502. Computer-program product 1605 directs system 1600 to perform the above-described methods. Computer 1502 may include one or more processors 1660 that communicate with a number of peripheral devices via a bus subsystem 1690. These peripheral devices may include user output device(s) 1630, user input device(s) 1640, communications interface 1650, and a storage subsystem, such as random access memory (RAM) 1670 and non-volatile storage drive 1680 (e.g., disk drive, optical drive, solid state drive), which are forms of tangible computer-readable memory.
Computer-program product 1605 may be stored in non-volatile storage drive 1680 or another computer-readable medium accessible to computer 1502 and loaded into memory 1670. Each processor 1660 may comprise a microprocessor, such as a microprocessor from Intel® or Advanced Micro Devices, Inc.®, or the like. To support computer-program product 1605, the computer 1502 runs an operating system that handles the communications of product 1605 with the above-noted components, as well as the communications between the above-noted components in support of the computer-program product 1605. Exemplary operating systems include Windows® or the like from Microsoft Corporation, Solaris® from Sun Microsystems, LINUX, UNIX, and the like.
User input devices 1640 include all possible types of devices and mechanisms to input information to computer system 1502. These may include a keyboard, a keypad, a mouse, a scanner, a digital drawing pad, a touch screen incorporated into the display, audio input devices such as voice recognition systems, microphones, and other types of input devices. In various embodiments, user input devices 1640 are typically embodied as a computer mouse, a trackball, a track pad, a joystick, wireless remote, a drawing tablet, a voice command system. User input devices 1640 typically allow a user to select objects, icons, text and the like that appear on the monitor 1506 via a command such as a click of a button or the like. User output devices 1630 include all possible types of devices and mechanisms to output information from computer 1502. These may include a display (e.g., monitor 1506), printers, non-visual displays such as audio output devices, etc.
Communications interface 1650 provides an interface to other communication networks and devices and may serve as an interface to receive data from and transmit data to other systems, WANs and/or the Internet 1518. Embodiments of communications interface 1650 typically include an Ethernet card, a modem (telephone, satellite, cable, ISDN), a (asynchronous) digital subscriber line (DSL) unit, a FireWire® interface, a USB® interface, a wireless network adapter, and the like. For example, communications interface 1650 may be coupled to a computer network, to a FireWire® bus, or the like. In other embodiments, communications interface 1650 may be physically integrated on the motherboard of computer 1502, and/or may be a software program, or the like.
RAM 1670 and non-volatile storage drive 1680 are examples of tangible computer-readable media configured to store data such as computer-program product embodiments of the present disclosure, including executable computer code, human-readable code, or the like. Other types of tangible computer-readable media include floppy disks, removable hard disks, optical storage media such as CD-ROMs, DVDs, bar codes, semiconductor memories such as flash memories, read-only-memories (ROMs), battery-backed volatile memories, networked storage devices, and the like. RAM 1670 and non-volatile storage drive 1680 may be configured to store the basic programming and data constructs that provide the functionality of various embodiments of the present disclosure, as described above.
Software instruction sets that provide the functionality of the present disclosure may be stored in RAM 1670 and non-volatile storage drive 1680. These instruction sets or code may be executed by the processor(s) 1660. RAM 1670 and non-volatile storage drive 1680 may also provide a repository to store data and data structures used in accordance with the present disclosure. RAM 1670 and non-volatile storage drive 1680 may include a number of memories including a main random access memory (RAM) to store of instructions and data during program execution and a read-only memory (ROM) in which fixed instructions are stored. RAM 1670 and non-volatile storage drive 1680 may include a file storage subsystem providing persistent (non-volatile) storage of program and/or data files. RAM 1670 and non-volatile storage drive 1680 may also include removable storage systems, such as removable flash memory.
Bus subsystem 1690 provides a mechanism to allow the various components and subsystems of computer 1502 to communicate with each other as intended. Although bus subsystem 1690 is shown schematically as a single bus, alternative embodiments of the bus subsystem may utilize multiple busses or communication paths within the computer 1502.
For a firmware and/or software implementation, the methodologies may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. Any machine-readable medium tangibly embodying instructions may be used in implementing the methodologies described herein. For example, software codes may be stored in a memory. Memory may be implemented within the processor or external to the processor. As used herein the term “memory” refers to any type of long term, short term, volatile, nonvolatile, or other storage medium and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored.
Moreover, as disclosed herein, the term “storage medium” may represent one or more memories for storing data, including read only memory (ROM), random access memory (RAM), magnetic RAM, core memory, magnetic disk storage mediums, optical storage mediums, flash memory devices and/or other machine readable mediums for storing information. The term “machine-readable medium” includes, but is not limited to portable or fixed storage devices, optical storage devices, wireless channels, and/or various other storage mediums capable of storing that contain or carry instruction(s) and/or data. According to embodiments, storage media and computer readable media for containing code, or portions of code, may include any appropriate media known or used in the art, including storage media and communication media, such as but not limited to volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage and/or transmission of information such as computer readable instructions, data structures, program modules, or other data, including RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be utilized to store the desired information and which may be accessed by the a system device. Program modules, program components and/or programmatic objects may include computer-readable and/or computer-executable instructions of and/or corresponding to any suitable computer programming language. In at least one embodiment, each computer-readable medium may be tangible. In at least one embodiment, each computer-readable medium may be non-transitory in time. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will appreciate other ways and/or methods to implement the various embodiments.
As described above (e.g., with respect to process 1300 of
Capability data may include any suitable data that may be indicative of at least one capability of at least one network-connected smart device of the one or more network-connected smart devices of the smart-home environment for which a security score is being calculated or otherwise generated. Such capability data may be indicative of any suitable capability or capabilities of any suitable smart device or smart devices, where each capability may be independent of any or all potential external influences. For example, certain capability data may be “device capability data”, which may be any suitable data that may be indicative of at least one capability of a particular network-connected smart device of the smart-home environment, where each capability may be independent of any or all potential external influences on that smart device (e.g., as if the particular smart device were placed in a vacuum and not affected by any external influences, such as by an active user or by other characteristic(s) of the smart-home environment in which the smart device may currently exist). Such device capability data may include, but is not limited to, data that may be indicative of one or more of the following capabilities of a particular smart device: (i) current charge level of a battery of the device; (ii) maximum potential charge capacity of a battery of the device; (iii) any other current or potential capability of a battery or other power source of the device (e.g., estimated length of use possible if no external power source were to be provided for the device); (iv) currently enabled communication protocol(s) of the device; (v) all communication protocols available to the device; (vi) any other currently enabled or available communication capability of the device (e.g., bidirectional communication capability); (vii) currently enabled security features of the device; (viii) all security features available to the device; (ix) any other currently enabled or available security capability of the device (e.g., user authentication capabilities, data encryption capabilities, etc.); (x) currently enabled sensing features of the device; (xi) all sensing features available to the device; (xii) any other currently enabled or available sensing capabilities of the device (e.g., the number and types and quality of each sensor available to the device, the remaining lifespan/need to replace a worn down part of the device, etc.); (xiii) currently enabled processing features of the device; (xiv) all processing features available to the device; (xv) any other currently enabled or available processing capabilities of the device (e.g., the data processing speed and/or data processing power available to the device); (xvi) currently enabled output features of the device; (xvii) all output features available to the device; (xviii) any other currently enabled or available output capabilities of the device (e.g., the number and types and quality of each output component available to the device); (xix) any other suitable capabilities; and (xx) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the capabilities of a particular smart device of the smart-home environment are outdated/insufficient, sufficient, or top-notch (e.g., as compared to all available smart devices that may be readily available in the current market, which may be determined via extrinsic information 316 accessible to processing system 206), thereby enabling a security score and/or associated suggestions to reflect the ability of a user to upgrade one or more aspects of one or more smart devices of the smart-home environment (e.g., if an upgradeable head unit or software is available). Such device capability data may be processed by a computing system 164 using data from one or more particular smart devices of the environment (e.g., based on information available to/detectable by the device and communicated by the device to the computing system) and/or using information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the smart device(s) for enabling processed home data 208 of the device capability type.
As another example, certain capability data may be “network capability data”, which may be any suitable data that may be indicative of at least one capability of a network of two or more networked smart devices of the smart-home environment, where each capability may be independent of any or all potential external influences on that network of smart devices (e.g., as if the particular network of smart devices were placed in a vacuum and not affected by any external influences, such as an active user or characteristic(s) of the smart-home environment in which the network of smart devices may currently exist). Such network capability data may include, but is not limited to, data that may be indicative of one or more of the following capabilities of a particular network of two or more smart devices: (i) distance between any two smart devices of the network; (ii) shared communication protocol(s) between any two smart devices of the network; (iii) combined sensing capabilities of the network; (iv) mesh/spokesman/node relationship between any two or all smart devices of the network; (v) any other suitable capabilities; and (vi) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the capabilities of the network of the smart-home environment enable proper networked communication between devices of the network, whether each one of various desired sensing capabilities and/or output capabilities for the environment are provided by at least one of the devices of the network, and the like. Such network capability data may be processed by a computing system 164 using data from the various smart devices of the network itself (e.g., based on information available to/detectable by the network and communicated by the network to the computing system) and/or using information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the network for enabling processed home data 208 of the network capability type.
Opportunity data may include any suitable data that may be indicative of at least one opportunity afforded to at least one network-connected smart device by at least one influencer of the smart-home environment in which the at least one network-connected smart device is provided. Such opportunity data may be indicative of any suitable opportunity or opportunities afforded to any suitable smart device or smart devices, where each opportunity may be afforded by at least one influencer of the smart-home environment in which each of the at least one smart device is provided. That is, opportunity data may be indicative of the effectiveness or ineffectiveness of smart device(s) and/or the ability or inability of smart device(s) to succeed based on any or all potential external factors capable of influencing the smart device(s). For example, certain opportunity data may be “device opportunity data”, which may be any suitable data that may be indicative of at least one opportunity afforded to a particular network-connected smart device of the smart-home environment, where each opportunity may be based on any or all potential external factors capable of influencing that smart device (e.g., any external influences by an active user or characteristic(s) of the smart-home environment in which the smart device may currently exist). Such device opportunity data may include, but is not limited to, data that may be indicative of one or more of the following opportunities afforded to a particular smart device by the particular environment: (i) type and/or reliability of any environmental power source provided for the device (e.g., whether a fixed power source, such as a 120V line voltage wires of a structure 150 of environment 100, is powering the device); (ii) position and/or use of the device with respect to the environment (e.g., what type of room the device is provided in (e.g., kitchen or bedroom), what type of element the device is proximate/coupled to (e.g., HVAC 103, lamp 118, window 182, door 186, etc.), etc.); (iii) proximity of device to any environmental influencers that may have an undesired or desired effect on the performance of the device (e.g., a PIR sensor of a device being positioned in the direct path of an HVAC vent whereby the air flow from the vent may alter a characteristic of the sensor to increase the likelihood of triggering a false reading or preventing an accurate reading, a smoke detector being provided inside a fireplace thereby increasing the likelihood of triggering false alarms, a smoke detector being provided directly next to an open window thereby decreasing the likelihood of an accurate reading for the interior of the environment, a sensor of a smart device positioned next to a “dog bed” or other influencer of the environment where a considerable amount of dander or other uncommon particles may exist and undesirably influence the operation/effectiveness of that sensor, etc.); (iv) exposure to any environmental influencers that may have an undesired or desired effect on the security of the device (e.g., a large number of authentication codes being active for the device may indicate unnecessary exposure to a security breach, an authentication code for the device being too short/untrustworthy, how many occupants have had their contact information verified for use in response to an alarm condition of the device, responsiveness of a user/occupant to previous alarm conditions or other actions of the device (e.g., how quickly a user/occupant responded to an actual alarm or a “test alarm” that may be randomly generated by the device for testing the responsiveness of the user), etc.); (v) currently enabled/disabled communication protocol(s) of the device (e.g., as set by a user of the environment); (vi) currently enabled/disabled security feature(s) of the device (e.g., as set by a user of the environment); (vii) currently enabled/disabled sensing feature(s) of the device (e.g., thresholds or otherwise as set by a user of the environment); (viii) currently enabled/disabled processing feature(s) of the device (e.g., timers or otherwise as set by a user of the environment); (ix) currently enabled/disabled output features of the device (e.g., as set by a user of the environment); (x) any other suitable device opportunities; and (xi) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the capabilities of a particular smart device of the smart-home environment are promoted or inhibited or jeopardized by one or more external influencers (e.g., by a user or other characteristic(s)) of the smart-home environment in which the smart device may currently exist, thereby enabling a security score and/or associated suggestions to reflect the ability of a user to make adjustments with respect to such external influencers on the smart device (e.g., a suggestion to move the smart device away from the vent, to increase a sensing threshold of a sensor, to turn on a device option such that the device may mimic the user's patterns when the user is away, etc.). Such device opportunity data may be processed by a computing system 164 using data from one or more particular smart devices of the environment (e.g., based on any information available to/detectable by the device and communicated by the device to the computing system) and/or using information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the smart device(s) for enabling processed home data 208 of the device opportunity type. Following just one particular example, a smart device with a PIR sensor may also include a camera or thermometer to detect data indicative of the device being positioned too close to a vent. Following another example, a sensor may continuously detect a high level of a particular particle (e.g., pet dander) and determine that an influencer of the environment may be causing such detection.
As another example, certain opportunity data may be “network opportunity data”, which may be any suitable data that may be indicative of at least one opportunity afforded to a network of two or more networked smart devices of the smart-home environment, where each opportunity may be based on any or all potential external factors capable of influencing that network of smart devices (e.g., any external influences by an active user or characteristic(s) of the smart-home environment in which the network of smart devices may currently exist). Such network opportunity data may include, but is not limited to, data that may be indicative of one or more of the following opportunities afforded to a particular network of two or more smart devices: (i) environmental impediments to a communication channel/pathway between any two smart devices of the network (e.g., a concrete wall between two adjacent devices that may degrade/inhibit data communicated amongst the devices); (ii) environmental impediments to a communication channel/pathway between the network and communication system (e.g., reliability of the environment's wireless router 160 or connection to internet 162 for communicatively coupling the network of smart devices to computing system 164, availability of requisite/trusted SSL certificates for supporting secure video streaming with emergency personnel, etc.); (iii) type and/or reliability of any environmental power source provided for particular devices of the network (e.g., whether a fixed power source, such as a 120V line voltage wires of a structure 150 of environment 100, is powering at least one spokesman node of the network); (iv) availability/detectability of a “map” of the environment (e.g., quality of the map, positional information of the network with respect to the expanse or specific features of the environment); (v) network coverage of the environment (e.g., amount/locations of detected “black spots”, percentage of doors 186 of environment 100 associated with a particular smart device (e.g., smart entry detector 112 and/or smart doorknob 122 and/or smart doorbell 106), percentage of overall interior volume of structure 150 of environment 100 monitored/sensed by hazard detectors 104 or any other smart device sensor type, percentage of overall exterior area of environment 100 covered by outdoor lighting system 114 or any other smart device output type, etc.); (vi) exposure to any environmental influencers that may have an undesired or desired effect on the security of the network (e.g., a large number of authentication codes being active for the network may indicate exposure to a security breach, an authentication code for the network being too short/untrustworthy, current security measures of an occupant's web browser or mobile app (e.g., on a device 166), how many occupants have had their contact information verified for use in response to an alarm condition of the network, responsiveness of a user/occupant to previous alarm conditions or other actions of the network (e.g., how quickly a user/occupant responded to an actual alarm or a “test alarm” that may be randomly generated by the network for testing the responsiveness of the user), etc.); (vii) currently enabled/disabled communication protocol(s) of the network (e.g., as set by a user of the environment); (viii) currently enabled/disabled security feature(s) of the network (e.g., as set by a user of the environment); (ix) currently enabled/disabled sensing feature(s) of the network (e.g., thresholds or otherwise as set by a user of the environment); (x) currently enabled/disabled processing feature(s) of the network (e.g., timers or otherwise as set by a user of the environment); (xi) currently enabled/disabled output features of the network (e.g., as set by a user of the environment); (xii) any other suitable network opportunities; and (xiii) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the capabilities of a network of smart devices of the smart-home environment are promoted or inhibited or jeopardized by one or more external influencers (e.g., by a user or other characteristic(s)) of the smart-home environment in which the network may currently exist, thereby enabling a security score and/or associated suggestions to reflect the ability of a user to make adjustments with respect to external influencers on the network (e.g., a suggestion to move at least one of two adjacent smart devices such that a direct path between the two devices avoids a concrete wall, or to decrease the number of active authentication codes for the network, or to turn on a network option such that one or more devices of the network may work in tandem to mimic the user's patterns when the user is away, etc.). Such network opportunity data may be processed by a computing system 164 using data from the various smart devices of the network itself (e.g., based on information available to/detectable by the network and communicated by the network to the computing system) and/or information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the network for enabling processed home data 208 of the network opportunity type.
Environmental data may include any suitable data that may be indicative of at least one behavioral characteristic of the smart-home environment in which at least one network-connected smart device is provided. Such environmental data may be indicative of any suitable behavioral characteristic or characteristics of the smart-home environment in which any suitable smart device or smart devices is provided, where each behavioral characteristic may be indicative of at least one security influencer of the smart-home environment in which each of the at least one smart device is provided. For example, certain environmental data may be “micro-environmental data”, which may be any suitable data that may be indicative of at least one behavioral characteristic of the particular smart-home environment in which each of the at least one smart device is provided (e.g., on a micro-level independent of other smart-home environments or any other environments beyond the scope of the particular smart-home environment that may be in the same neighborhood or share similar traits with the particular smart-home environment). Such micro-environmental data may include, but is not limited to, data that may be indicative of one or more of the following behavioral characteristics of the particular smart-home environment in which each of the at least one smart device is provided: (i) exposure of environmental objects with respect to public view (e.g., an expensive item, such as a large television, being visible through a window 182 of a structure 150 of the environment may increase the target of that environment and the likelihood of an attempted robbery, while a crime-deterring item, such as a guard dog or a label identifying the security features of the environment being made apparent to a would be thief may decrease the target of that environment and the likelihood of an attempted robbery); (ii) a potentially dangerous object not being secured (e.g., a gun detected outside of a suitable receptacle, such as a home safe smart device as described above); (iii) features of an ingress or of any other vulnerability of a structure of the environment (e.g., the size of a window being too small to enable a criminal to enter therethrough and/or a window being protected by security bars for preventing a criminal to enter through the window, thereby reducing the security risk of such a window, or the distance of a window above the external ground/earth being less than a certain threshold for enabling a criminal on foot to access the window, thereby increasing the security risk of such a window); (iv) occupant/personal device recognition (e.g., the number of occupants/personal devices at the environment that are known/verified or unknown/unverified to the smart device(s)/computing system, thereby increasing or decreasing the security of the environment); (v) activities/habits of the environment, such as (v.a) tendencies for a user to remember to lock a door and/or turn off a light/appliance after use, as may be detected by any suitable smart device as described above, which may increase a security score due to ingresses being locked and/or potentially dangerous environment elements being shut down after use, (v.b) certain types of food preparation in the environment may tend to be considered dangerous (e.g., deep frying, as may be detected through examination of particle size sensed by a blue IR sensor or any other suitable sensor of a smart device, may be considered more dangerous than making a bowl of cereal and may decrease a security score), (v.c) recreational smoking in the environment may negatively affect a security score (e.g., tobacco smoking or even use of a fire place that emits certain smoke that may be detectable by any suitable sensor of any suitable smart device may be dangerous or increase risk of fire), (v.d) nocturnal behaviors may increase a security score by discouraging a would be night-thief (e.g., occupants that are detected to be awake and active and/or using lights at night may reduce the size of a target of the environment for theft, rather than occupants that are either asleep or away from the environment at night such that a thief under the cover of darkness may be tempted to burglarize an inactive environment), and/or (v.e) irrational/careless behavior may decrease a security score by increasing the likelihood of a dangerous situation (e.g., as may be detected through analysis of the age/mental state of an occupant, such as an occupant that is sleep deprived or otherwise compromised (e.g., intoxicated, forgetful, immature, etc.), as may be detected by any suitable sensor of any suitable smart device), etc.; (vi) user-provided answers to security questions (e.g., “Do you hide a key to the environment under a door mat?”, “When is the last time you practiced a fire drill?”, “Is your environment provided with a back-up power generator in case of a power grid power outage?”, etc.), as may be generated/proposed by one or more smart devices during interactive information-exchange sessions, as described in commonly-assigned U.S. patent application Ser. No. 13/440,910 (now U.S. Patent Application Publication No. 2013/0268125), which is hereby incorporated by reference herein in its entirety, where such answers may increase or decrease the security score; (vii) any other suitable micro-environmental data; and (viii) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the behaviors exhibited at the environment on a micro-level promote or inhibit or jeopardize the security of the environment, thereby enabling a security score and/or associated suggestions to reflect the ability of a user to make adjustments with respect to such behaviors (e.g., a suggestion to stop deep frying inside a structure 150 of the environment or to move the expensive television away from the see-through window 182, etc.). Such micro-environmental data may be processed by a computing system 164 using data from one or more particular smart devices of the environment (e.g., based on any information available to/detectable by the device(s) and communicated by the device(s) to the computing system) and/or information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the smart device(s) for enabling processed home data 208 of the micro-environmental type. Following just one particular example, a single smart device or a combination of adjacent smart devices may include one or more cameras or other suitable sensors for identifying an expensive object within the environment that may be within a threshold distance of an uncovered window, or for detecting the presence of a pet that barks whenever a sound over a certain threshold is made, and the like. Following another particular example, a smart device may include a camera for identifying a window as well as an altimeter for identifying the altitude or height of that window above the ground. As yet another example, a smart device may identify a window and a proximate user device 166 and then poll that device 166 for its altimeter data. As another example, a smart device may include a camera configured to detect a window as well as security bars that may be protecting that window. As yet another example, a smart device may identify a window and then propose questions to a user about that window, such as “What is the height of this window above the earth?”, or “What is the cross-sectional area of this window?”, or “Are there any security bars protecting this window?”, etc.
As another example, certain environmental data may be “macro-environmental data”, which may be any suitable data that may be indicative of at least one behavioral characteristic of the environment surrounding or otherwise associated with the particular smart-home environment in which each of the at least one smart device is provided (e.g., on a macro-level related to other environments beyond the scope of the particular smart-home environment that may be in the same neighborhood as or share similar traits with the particular smart-home environment). Such macro-environmental data may include, but is not limited to, data that may be indicative of one or more of the following behavioral characteristics of environment(s) related to the particular smart-home environment in which each of the at least one smart device is provided: (i) accessibility of the particular environment to security agencies (e.g., the distance or travel time between the particular smart-home environment and an emergency response entity, such as the police, fire department, etc., where increased distance/travel time may decrease the security score, and where such travel time may vary by taking into account current weather/travel conditions); (ii) ambient environmental conditions (e.g., weather, acts of nature, traffic, construction, service status, entities (e.g., nuclear power plants), etc. existing at/around the particular smart-home environment that may impact the security of the particular smart-home environment, such as where a current drought or nearby forest fires or a firefighter strike may negatively impact the security score); (iii) historical data regarding the macro-environment (e.g., crime rates for the neighborhood of the particular smart-home environment, frequency and average duration of power outages in the neighborhood, etc., which may negatively or positively impact a security score); (iv) accessible security networks (e.g., number and size of “neighborhood security networks” accessible to or otherwise in communication with the particular smart-home environment, as described above, whereby the greater the amount of other smart device equipped environments a particular smart-home environment may synergize with, the higher the security score for that particular smart-home environment may be); (v) any other suitable macro-environmental data (e.g., security data related to other floors or the entrance of an apartment building if the particular smart-home environment is a single apartment or floor in a larger apartment complex, where such data may include the secureness of the ingress to the entire apartment complex, the crime rate for that building, the security features of the building that are not directly associated with the particular smart-home environment (e.g., fire escape available on the roof of the complex and the distance to the roof from the particular smart-home environment, etc.); and (vi) any combinations thereof. For example, this may enable the security score to be based on a determination of whether or not the behaviors exhibited at the environment on a macro-level promote or inhibit or jeopardize the security of the environment, thereby enabling a security score and/or associated suggestions to reflect the ability of a user to make adjustments with respect to such behaviors (e.g., a suggestion to enable communication with more neighborhood security networks, or to buy a backup power generator, etc.). Such macro-environmental data may be processed by a computing system 164 using data from one or more particular smart devices of the environment (e.g., based on any information available to/detectable by the device(s) and communicated by the device(s) to the computing system) and/or information from other sources accessible to the computing system 164 (e.g., extrinsic information 316, paradigms 310, entities 222-230, etc.) that may be used to supplement the processing of any data received from the smart device(s) for enabling processed home data 208 of the macro-environmental type. Following just one particular example, a smart device may include a GPS device for identifying the current geographical location of the device and, thus, the particular smart-home environment, while extrinsic information 316 or law enforcement 222 may provide crime data for that geographical location. As another example, a smart device may include a weather sensor that may be configured to calculate total rainfall or snowfall at that device for any given historical time period.
As mentioned above, a security score for a particular smart-home environment may be calculated by comparing home data from one or more smart devices of the particular smart-home environment against a list of security criterions to determine how many of the security criterions are satisfied (e.g., through processed capability data, opportunity data, and/or environmental data). Higher scores may indicate that a particular smart-home environment satisfies a high number of security criterions and is therefore relatively secure, whereas lower scores indicate that the particular smart-home environment fails to satisfy many of the criterions. According to embodiments, security scores can be normalized and scaled so that occupants of a particular smart-home environment can compare the security of their particular smart-home environment to other particular smart-home environments. For example, a score of 0 to 100 can be used, where 0 is the lowest possible score and 100 is the highest possible score. Further, for example, the central server or cloud-computing system 164 may generate a report or log that may list the security criterions and/or provide an indication of whether the particular smart-home environment satisfies each of the criterions. Occupants can review this list to determine which criterions are not satisfied and then make the appropriate improvements to the particular smart-home environment so as to increase the security score of the particular smart-home environment. Additionally, the central server or cloud-computing system 164 can use this log to generate a list of suggestions for improving the particular smart-home environment. It may prioritize the list based on which criterions are associated with the most points, indicate which creation can be easily and cheaply satisfied with only minor improvement, and/or indicate which unsatisfied criterions are typically satisfied in other smart-home environments. For example, the central server or cloud-computing system 164 can send the following message to an occupant (e.g., to an occupant's personal electronic smart device 166: “We notice that you often leave the front door unlocked. Most homes in your neighborhood keep the front door locked at all times. Locking your front door at night is an easy and inexpensive way to improve your home's security and to improve your security score.” While certain security criterions for assessing the security of and/or calculating a security score have been discussed herein, it should be appreciated that any number and combination of security criterions can be used when assessing security and/or calculating a security score for a particular smart-home environment.
It is understood that the steps shown in process 1700 of
It is appreciated that the previous description of the disclosed examples is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these examples will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other examples without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the examples shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
This application a continuation-in-part and claims the benefit of prior filed U.S. Nonprovisional patent application Ser. No. 13/830,795, filed Mar. 14, 2013, which is hereby incorporated by reference herein in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| D660732 | Bould et al. | May 2012 | S |
| 8510255 | Fadell et al. | Aug 2013 | B2 |
| 8606374 | Fadell et al. | Dec 2013 | B2 |
| 8727611 | Huppi et al. | May 2014 | B2 |
| 8786425 | Hutz | Jul 2014 | B1 |
| 20040260407 | Wimsatt | Dec 2004 | A1 |
| 20050046571 | Stigall | Mar 2005 | A1 |
| 20060202822 | Finlayson | Sep 2006 | A1 |
| 20070182543 | Luo | Aug 2007 | A1 |
| 20090002189 | Liu | Jan 2009 | A1 |
| 20090303042 | Song | Dec 2009 | A1 |
| 20110046920 | Amis | Feb 2011 | A1 |
| 20110298623 | Lenkeit | Dec 2011 | A1 |
| 20120028589 | Fan | Feb 2012 | A1 |
| 20120130546 | Matas et al. | May 2012 | A1 |
| 20120286947 | Hsu | Nov 2012 | A1 |
| 20120314901 | Hanson | Dec 2012 | A1 |
| 20130008787 | Mammoto | Jan 2013 | A1 |
| 20130241727 | Coulombe | Sep 2013 | A1 |
| 20130268125 | Matsuoka | Oct 2013 | A1 |
| 20140084165 | Fadell et al. | Mar 2014 | A1 |
| 20140085092 | Fadell et al. | Mar 2014 | A1 |
| 20140085093 | Mittleman et al. | Mar 2014 | A1 |
| 20140201315 | Jacob | Jul 2014 | A1 |
| Entry |
|---|
| U.S. Appl. No. 61/704,437, filed Sep. 21, 2012. |
| Number | Date | Country | |
|---|---|---|---|
| 20150061859 A1 | Mar 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13830795 | Mar 2013 | US |
| Child | 14489162 | US |
