Baby cribs are routinely purchased on the basis of safety and aesthetic features. Typically a mattress for the crib is separately purchased for similar reasons. Many users separately select a baby monitor that includes a camera and/or microphone. More sophisticated monitors may have an infrared camera and/or a speaker. The monitor may include a camera that can be placed in a position that overlooks the baby crib. In some configurations, the camera and/or microphone may be affixed to the crib using child proof and safe mechanism. The baby monitor may contain a controller (e.g., head unit) to which the signal from the camera and/or speakers is transmitted. The head unit may contain indicators for the volume of sound detected by the microphone. The head unit may contain various buttons that activate or deactivate the display and/or speakers on the head unit. Thus, a baby monitor may be retrofitted to a baby crib.
According to an implementation of the disclosed subject matter, a baby crib is disclosed that includes a horizontal support platform and a base structure disposed below and physically supporting the horizontal support platform. The crib may include one or more vertical surfaces connected to the horizontal support platform and arranged to form a contained area at least 50 cm above the horizontal support platform. A first sensor may be physically integrated with the horizontal support platform and a second sensor may be physically integrated with the vertical surfaces.
In an implementation, a state of an environment in which a baby crib is located may be detected. The environment may include an environment within and surrounding the baby crib and a state of an occupant. The state of the environment may be determined to be unsatisfactory based on a preconfigured set of states. A notice may be generated in response to the determined unsatisfactory environment. The notice may be dispatched to a client device associated with the baby crib. A response from the client device may be received. The response may indicate an action to be taken by an entertainment device. The action may be determined to have resolved the unsatisfactory state.
A child crib is disclosed that includes a first sensor integral with a horizontal support platform of the crib and a second sensor integral with a portion of an enclosure of the crib. The child crib may include a wireless communication module and a processor. The processor may be configured to determine a condition of an occupant of the crib based upon data received from the first sensor, the second sensor, or both, and to provide an indication of the condition to a remote device.
Additional features, advantages, and implementations of the disclosed subject matter may be set forth or apparent from consideration of the following detailed description, drawings, and claims. Moreover, it is to be understood that both the foregoing summary and the following detailed description provide examples of implementations and are intended to provide further explanation without limiting the scope of the claims.
The accompanying drawings, which are included to provide a further understanding of the disclosed subject matter, are incorporated in and constitute a part of this specification. The drawings also illustrate implementations of the disclosed subject matter and together with the detailed description serve to explain the principles of implementations of the disclosed subject matter. No attempt is made to show structural details in more detail than may be necessary for a fundamental understanding of the disclosed subject matter and various ways in which it may be practiced.
As disclosed herein, one or more sensors may be integrated into a crib or toddler bed. The sensors, by virtue of being integrated into the crib, may be noninvasive and require no physical set-up by the user. Further, because the sensors are integrated into the crib, they mitigate the risks involved in placing foreign objects near and/or in a baby crib. The sensors may provide a desired monitoring of the baby crib without requiring separate wiring (e.g., power supply) and/or configuration. Each sensor may be modular. For example, each sensor may be a predetermined size and shape that matches a cavity or other attachment point in a portion of the crib, such as a horizontal support platform on which a mattress may be placed. Each sensor module may contain an identical connection system that provides it with power. The modular design of the sensors may permit a user to interchange one sensor with another sensor. The sensors may communicate with one another and/or with other devices, such as a smart home network or associated devices, to generate a notice based upon the combined data from the different sensors.
The horizontal support platform 105 may be constructed from a variety of materials such as a metal alloy, wood, plastic, a composite material, or any other suitable materials. The crib 101 materials and design may be configured to support between 10 kg to 35 kg. The dimensions of a rectangular horizontal support platform 105 may be between 60 cm and 150 cm for the short ends and 90 cm to 180 cm for the long ends. While these dimensions may accommodate most standard-sized crib mattresses, other sizes may be compatible with the implementations disclosed herein. In addition, the horizontal support platform 105 may be constructed in other shapes, such as circular, octagonal, or hexagonal, in accordance with any of the implementations disclosed herein. Description regarding the shape of the baby crib 101, materials to construct the crib 101, and/or the dimensions of the crib 101, are merely for reference and are non-limiting. Further, implementations are described in terms of a baby or toddler crib, however other furniture such as a full size bed may be used according to the implementations disclosed herein.
The horizontal support platform 105, as shown in
The first surface 105 may be supported by a base structure 115. The base structure 115 may be disposed below and physically supporting the horizontal support platform 105. The base structure 115 may refer to the portion of the crib frame 101 that contacts the floor 100 and the horizontal support platform 105. In some configurations, the base structure 115 may be composed of multiple components. The base structure 115 may be part of the vertical surfaces 110, 112 that surround and extend above the horizontal support platform 105. The base structure 115 may be posts located at each corner of the crib as shown in
The crib 101 may be assembled using a variety of methods known to those of ordinary skill in the art. A non-exhaustive list of assembly mechanisms for the various components of the crib 101 includes fasteners, clips, dowels, screws, bolts, Velcro, etc. For example, a vertical surface 110, 112 may be attached to another vertical surface 110, 112 and/or the horizontal support platform 105 using bolts secured with washers and a nut.
The crib 101 may contain one or more vertical surfaces 110, 112. The vertical surfaces 110, 112 may be substantially orthogonal to the horizontal support platform as shown in
In general, the crib 101 may contain four vertical surfaces 110, 112 as shown in
The crib 101 may be utilized for a toddler in some configurations. For example, the crib 101 may have an opening that would allow easy ingress and egress into the contained area 120 above the horizontal support platform 105 and bounded by the vertical surfaces 110, 112. The vertical surfaces 110, 112 other than the one with the opening may extend above the horizontal support platform by 50 cm or more.
In some configurations, one of the vertical surfaces may be configured to have an opening that can be latched/unlatched electronically in response to a signal received form a client device and/or a controller as described below with which the crib is in communication. For example, the crib may have physical integrated sensors that, in response to an environmental condition (e.g., high carbon monoxide concentration, fire, etc.) automatically open the crib. As another example, the crib sensors may indicate that the child is awake and send an indication thereof to a client device (e.g., smartphone or smart watch).
One or more of the vertical surfaces may include one or more second sensors.
In some configurations, the vertical surface 310 may not utilize a sensor bar as shown in
A first sensor and/or a second sensor may include one or more of: a camera, a pressure sensor, a microphone, a light sensor, an air sensor, a temperature sensor, an accelerometer, a humidity sensor, etc. Additional description regarding sensor systems is provided below in reference to
The client device 402 may include a processor 450, storage medium 460, and read only memory 470. The client device 402 processor 450 may receive the data provided by the crib 401 and/or send data/instructions to the crib 401 via the communication chipset 480. The communication between the crib 401 and the client device 402 may occur indirectly and/or directly. For example, a remote system such as a cloud service may relay communication between the crib 401 and the client device 402. In some instances, the remote service may perform processing of the data sent by the crib 401 and provide the processed data to the client device 402. For example, the crib 401 may analyze the sleeping pattern of the child based on a motion sensor 445. It may, based on the amount of motion detected within a time interval, send a notice to the client device 402.
The communication device 440 and/or power connection between the crib 401 and/or the sensors 445 may be shielded from the intrusion of electromagnetic radiation (e.g., radio frequency electromagnetic radiation) into the contained area occupied by an infant. The shielding may extend over a portion of the horizontal support platform and/or one or more of the vertical surfaces. Typically, the shielding may be applied to cables to isolate wires from the environment. The shielding may be applied to enclosures for any sensors integrated into the crib. For example, a copper and/or nickel spray may be applied to the interior of plastic enclosures for the sensors, processor, and/or communication device.
Processing of the data may be performed in at least three different ways. In an implementation, the crib contains a processor physically integrated in the horizontal support platform and/or one or more of the vertical surfaces. In some configurations, the data generated by the sensors may be sent to a cloud service that may store and/or perform the processing of the data. In some configurations, the data generated by the sensors may be sent to a client device for processing. Whether the processor is a component of the crib or is remote, it may be configured to respond to the data generated by the sensors in the horizontal support platform and/or vertical surfaces (See
As an example, one of the sensors in the horizontal support platform may be a pressure sensor. The pressure sensor may be, for example, a capacitive pressure sensor, an electromagnetic pressure sensor, and/or a piezoelectric pressure sensor. A top side of the horizontal support platform 105 may be used to detect pressure exerted on the horizontal support platform 105. The top side of the horizontal support platform 105 may refer to the side of the horizontal support platform 105 opposite the floor 100 (e.g., not facing the floor 100) as shown in
In some instances, the processor may utilize data generated by multiple sensors to detect a particular behavior by a child/occupant of the crib 101. For example, the pressure sensor data described above may be combined with a motion detecting camera (e.g., infrared camera). The combination of the data may indicate when the child is awake (e.g., where motion and two distinct pressure points are detected) versus sleeping poorly (e.g., motion detected and a relatively broad area of pressure detected). The motion sensor and pressure sensor may further be augmented by microphone data that indicates whether the child is speaking (e.g., crying) or not, the latter being associated with needing attention from an adult.
The processor may be configured to generate a notice based on the sensor data generated by one or more sensors in the crib. If the processor is physically integrated into the crib or is a part of a controller (e.g., for a smart home) and/or a cloud service, the processor may transmit the notice to the client device via the communication device (e.g., over wireless internet) as described above in reference to
The crib may contain an entertainment device. As with the sensors, an entertainment device may be modular and interchangeable with a sensor as far as position on the crib. In some configurations, the position of the entertainment device may be fixed with respect to the crib. A non-limiting list of an entertainment device may include a projector (e.g., a nano projector), a speaker, and a LED. An entertainment device may be an interactive device. For example, the crib may have a series of differently shaped pads that can illuminate in different colors. When the child touches a shape, it may flash and/or emit a sound through a speaker. More than one entertainment device may be present in the crib. For example, each corner of a baby crib may contain a speaker and/or microphone. Further, the entertainment device may be combined with a sensor. For example, a LED may be combined with a camera sensor in a single module or at the same location in the crib. The LED may be illuminated at a dim level to allow a parent, for example, to visualize a child through the camera.
As an example, a processor may be configured to detect an occupant condition based on data generated by the one or more sensors present in the crib. An occupant condition may refer to, for example, a child being awake (e.g., based on motion sensor and pressure sensor data), crying (e.g., based on a microphone), a noxious compound such as carbon monoxide (e.g., based on an air sensor), a dirty diaper (e.g., based on air sensor), an illness (e.g., vomit detected by air sensor), heart palpitations detected (e.g., by pressure sensor), unusual lack of movement (e.g., based on a motion sensor), an unusual by temperature (e.g., by a temperature sensor and/or a thermal imaging camera), coughing or sneezing (e.g., by motion capture camera and/or a microphone), etc. An air sensor, as used herein, may refer to a device capable of detecting a volatile organic compound or providing an air quality indication. For example, an air sensor may measure the amount or percentage of carbon monoxide or carbon dioxide in the air. An air sensor may detect the presence or percentage of methane gas present in the air. One or more air sensors may be utilized with the baby crib disclosed herein.
A response may be generated based on the condition detected by the sensors. The response may be emitted through an entertainment device. For example, if the child is crying, the projector may activate and display some cartoon animals on the ceiling. The projection may be accompanied by music played at a volume that is determined based on the ambient level of sound detected in the room by the microphone and/or the time of day. The response that is generated to the occupant condition may be configured by the end user. For example, the user may be presented with the option of having the crib not respond to a child's cry when the crying is detected for at least 30 seconds and, instead, notify the user's client device in those situations. The user may elect to have music played if the child is crying for at least a 20-second interval. By preconfiguring responses to be performed by the crib, the responses can occur without further user interaction. That is, the client device belonging to a parent of the child may not need to be disturbed with a notice.
In some instances, however, the crib may be configured to detect an occupant condition and communicate the condition detected to a client device, and/or other devices, such as other devices that are in a common smart home network with the crib. As described above, the detection of the condition may be performed by a processor that is physically integrated into the crib, a client device, a part of a controller and/or remote system such as a cloud service. A processor in the crib may transmit a notice regarding the determined occupant condition to the client device (e.g., child crying) using the communication device to send the notice regarding the occupant condition. In some configurations, the cloud service may send a notice regarding the occupant condition that has been determined by the cloud service determined based on the sensor data provided by the crib via the communication device. The client device may alert the user of the notice or as a component of the notice the user may be alerted of the occupant condition. For example, in the event the child is crying, an alarm may be emitted on the client device based on the notice received. The notice may indicate, for example, “Child crying for greater than 20 seconds.” A user may select from available options or capabilities of the crib regarding how to proceed. For example, the user may elect to have the crib play music, play a pre-recorded sound (e.g., the mother's voice), and/or project an image and/or video. The processor may be configured to receive the instruction sent by the client device and generate a response that is emitted through the entertainment device. For example, the instruction from the client device may be to play a video. The response generated may include the location of the video resource (e.g., on the Internet or locally) and the entertainment device that is to handle the instruction (a projector in this example).
The processor may determine whether the state of the occupant and/or environment is unsatisfactory at 540. An unsatisfactory state may refer to preconfigured states and/or user-configured states that are undesirable. For example, a temperature sensor and a thermal camera may indicate that there is an unusually strong heat source near the crib (e.g., a fire). Another example of an undesirable state may be crying by the occupant for more than 20 seconds at a volume in excess of 55 dB. As another example of an undesirable state, a volatile organic compound may be detected by an air sensor (e.g., methane percentage in excess of a threshold level). In some configurations, the undesirable state may be based upon a learned behavior of the environment and/or the occupant. For example, the occupant may have a sleeping behavior or pattern that is learned by the crib and/or an associated smart home network. If the processor determines, based on the motion sensor and pressure sensor, that the child is awake at a time when the learned behavior is for the child to be asleep, it may be an undesirable state. As another example, the lights in the room in which the crib is located may be part of a smart home system. A light sensor may indicate that the light level is at an undesirable level for the time of day based on the learned behavior for that particular room of the house.
If the state is determined to satisfactory at 540, then the system may continue to observe the environment and/or occupant as shown at 510. If the state is determined to be unsatisfactory at 540, then the processor may generate a notice at 550 that can be dispatched to a client device and/or a controller at 560. The processor may determine, at 570 that no response has been received after a threshold amount of time (e.g., 2 minutes). In that case, it may determine if the condition is still unsatisfactory at 590. If the condition is now satisfactory based on the new sensor data, then the system may return to 510. If the condition is still unsatisfactory, the system may again generate and dispatch a notice at 550, 560. If a response has been received, for example from a client device, then the system may perform the action instructed by the response at 580. It may then determine at 590 whether the response has had an effect on the state of the occupant and/or environment of the crib. One or more of the steps shown in
A few specific examples regarding the sensors, entertainment device(s), interaction between the sensors and/or entertainment device(s), detection of conditions around and in the crib (or frame), and notices constructed in response thereto will be described. These examples merely describe specific implementations and are not limiting. One of ordinary skill in the art will recognize that a variety of different sensor data may be obtained and processed. Further, the sensors may communicate (bidirectionally or unidirectionally) with other devices and/or sensors not associated with the crib. The device handling the processing of the sensor data may be programmed to generate notices based on the variety of conditions detected by the sensors.
In an implementation, a camera may detect motion at a particular time and that there is an occupant of the crib (e.g., by a pressure sensor). The time may be preprogrammed by an end user. For example, an end user may configure the system to recognize that a nap time or nighttime sleep time for a baby or toddler is from 7:30 PM to 7:30 AM. If motion is detected by the camera in the interior of the crib between those hours and it is detected for period exceeding one minute, the processor may generate a notice such as a beep to be emitted by the client device and/or sending through the audio feed detect by the microphone in the crib. The recipient of the notice may provide instructions for how the crib may respond. For example, the recipient may activate speakers on the crib and speak to the child directly. The recipient may elect to have a pre-recorded message played, a video played, and/or have music or white noise played for a predetermined amount of time. In some configurations, the processor may receive an instruction from the client device indicating that the child is sleeping. For example, the user may place the child in the crib for a nap period at 1:00 PM. A button on the crib, for example, or the client device may be utilized to indicate to the crib that the child is sleeping. This may activate specific sensors and/or indicate to the processor to detect specific types of occupant behavior (e.g., search for when the child is awake based on motion detected for greater than 2 minutes or warn client device if child has not fallen asleep within 5 minutes of the sleep mode being activated).
In an implementation, a pressure sensor located on the top of one or more of the vertical surfaces of the crib may indicate the presence of the child's hands thereon. It may be associated with localized contacts on the first surface and the localized contacts may be intermittent. This may be interpreted as a child jumping up and down in the crib and/or standing in the crib. This information may be followed by a detected loss of the pressure on the first surface and subsequently a loss of the pressure on the top of the second surface combined with a “thud” being detected by a microphone. This may be determined by the processor to indicate that the child has escaped from the interior of the crib. A notice may be sent to the client device to that effect.
In an implementation, the pressure sensor on the horizontal support platform may be configured to indicate a child's weight to the client device. The user or owner of the client device may plot the child's weight over a specified period of time based on the measurements of the pressure sensor. A camera may perform a motion capture and detect an estimated size of the child based on the captured images. For example, the camera may collect a series of still images and estimate distances between a child's hand and elbow and/or a knee and a foot. The determined distances may be combined to compute an overall length of the child. An overall length may be computed based on a measurement from the top of the head to the base of the foot in some instances. As with weight, the length of the child may be plotted or otherwise viewed as a function of time (e.g., days, months, years, etc.). Other metrics, such as a child's sleeping health may be computed as well. For example, the processor may compute the sleep activity of the child such as the number of times the child turns over during sleep periods based on camera data, the number times the child is awake during sleep periods, the number of times the child cries or coughs during sleep periods, etc. A sleep period may refer to a nighttime period preconfigured by a user (e.g., between 7:30 PM and 7:30 AM), a manually entered sleep time (e.g., child taking a nap), and/or an automatically-detected sleep period (e.g., it is dark in the child's room, it is nighttime, and the child has been relatively motionless or in a sleep pattern for 5 minutes).
In an implementation, an air sensor may detect a dirty diaper or that an “accident” has occurred in the crib. It may notify the client device that the child and/or crib requires attention to change a diaper and/or sheets in the crib.
In an implementation, the crib may receive communications from a device other than the client device that indicates, for example, a fire or carbon monoxide. The crib may have preprogrammed responses such as to alert the client device of the received indication (e.g., that a fire alarm has been alerted). In some configurations, the sensors may detect the condition and alert the client device. For example, an abnormal ambient temperature reading by a temperature sensor may trigger a notice to be sent to the client device. As another example, a fire alarm may be emitting a beep or flash pattern. The parents of the child may not be aware of the fire alarm's signal. The sensors on the crib, however, may be configured to detect a pattern that suggests a fire alarm is active and a notice may be dispatched to the client device. The client device may send an instruction to the crib to activate a camera that has a panning capability. Thus, the parents of the child, for example, may be able to quickly scan the child's room and crib area to ensure the child is safe. In some configurations, the fire alarm may cause LEDs on the crib to illuminate and/or a pre-recorded voice to be played.
In some configurations, the sensor data obtained from the crib's sensors may augment a smart home system. For example, a sensor detecting a high level of carbon monoxide may not only alert the client device, but also a controller of a smart home system. In response to the notice, the smart home system may dispatch a notice to a third party (e.g., fire department) and/or other client devices associated with the controller (e.g., other occupants of the home who are not receiving notices from the crib).
The processor may be configured to determine or detect a pattern of behavior based on signals received from the one or more sensors over a period of time and/or instructions received from a client device. As a specific example, a sleep pattern may be learned based on a child's sleeping behavior for a week. The processor may determine that a child awakes at approximately 11:00 PM most nights. Initially, the system may alert the client device that the child is awake. It may receive instruction from the client device to emit a particular color pattern using LEDs (e.g., a deep purple color) and to play a heartbeat sound. It may detect that the child typically falls asleep within 2 minutes of carrying out the instructions received. At a subsequent point in time, if the child awakes at 11:00 PM, rather than contact the client device, the deep purple color and the heartbeat sound may be played by an entertainment device. In the event the child does not fall asleep as predicted, a notice may be dispatched to the client device. The notice may indicate that the crib's entertainment devices have already performed the usual procedure requested by the user but have not been successful in calming or quieting the child.
As another example, in the morning, the child may wake up usually at 6:00 AM and the client device may provide instruction to the crib to emit an orange LED color with some music played at a low volume level. Upon learning the client device's routine instructions for the time of day and detected event, the crib may automatically perform the requested feature. That is, it may have learned a client device's desired response to various events detected by the sensors.
A machine learning algorithm may be applied to the data generated or obtained from the sensors of the crib. For example, audio data obtained by a microphone may be analyzed for a child's crying. Different cries may be associated with different needs of the child. For example, one type of cry may be associated with hunger while another type of cry may be associated with a desire for a diaper change. By analyzing the length, volume, pitch, and/or frequency of crying patterns in combination with the time of day, the processor may determine a likely reason for a child's crying and alert the client device accordingly. In some configurations, a notice may be sent to the client device to inquire as to the nature of the crying and/or confirm the predicted type of crying. For example, the notice may ask the user to indicate whether the crying was due to hunger, diaper change, attention or soothing, or other need. In some instances, the type of crying may be ascertained by comparing the audio data representing the crying to that of known crying types and matching the obtained audio data for the cry to a best or closest matching known cry.
Thus, various patterns of behavior both for that of the child occupying the crib and/or the response of the user thereto may be analyzed to generate improved notices and/or to lessen the instances for which the client device needs to be disturbed. A deviation from a pattern of behavior may likewise be learned or detected. For example, a child may routinely go to sleep between 7:40 PM and 7:48 PM. However, on a particular night, the child may be coughing at 7:55 PM and otherwise determined to be awake by the system. A processor may detect the deviation from the usual behavior of sleeping and alert the client device.
According to an implementation, a child crib is disclosed that includes a first sensor integral with a horizontal support platform of the crib as disclosed in
A sensor being integral or physical integrated with horizontal support platform and/or a vertical surface may refer to the sensor being embedded into the structure of the platform or surface as shown, for example, in
The child crib may include a wireless communication module that can communicate with a client device, a controller, and/or remote system as disclosed herein. The communication module may refer to a communication chipset that includes a radio antenna. The child crib may include a processor that can determine a condition of an occupant of the crib based upon data received from the first sensor, the second sensor, or both as described above. The processor may provide an indication of the condition to a remote device. For example, it may generate a notice that the child is awake.
Implementations disclosed herein may use one or more sensors. In general, a “sensor” may refer to any device that can obtain information about its environment. Sensors may be described by the type of information they collect. For example, sensor types as disclosed herein may include motion, smoke, carbon monoxide, proximity, temperature, time, physical orientation, acceleration, location, entry, presence, pressure, light, sound, and the like. A sensor also may be described in terms of the particular physical device that obtains the environmental information. For example, an accelerometer may obtain acceleration information, and thus may be used as a general motion sensor and/or an acceleration sensor. A sensor also may be described in terms of the specific hardware components used to implement the sensor. For example, a temperature sensor may include a thermistor, thermocouple, resistance temperature detector, integrated circuit temperature detector, or combinations thereof. A sensor also may be described in terms of a function or functions the sensor performs within an integrated sensor network, such as a smart home environment as disclosed herein. For example, a sensor may operate as a security sensor when it is used to determine security events such as unauthorized entry. A sensor may operate with different functions at different times, such as where a motion sensor is used to control lighting in a smart home environment when an authorized user is present, and is used to alert to unauthorized or unexpected movement when no authorized user is present, or when an alarm system is in an away (e.g., “armed”) state, or the like. In some cases, a sensor may operate as multiple sensor types sequentially or concurrently, such as where a temperature sensor is used to detect a change in temperature, as well as the presence of a person or animal. A sensor also may operate in different modes at the same or different times. For example, a sensor may be configured to operate in one mode during the day and another mode at night. As another example, a sensor may operate in different modes based upon a state of a home security system or a smart home environment, or as otherwise directed by such a system.
An “away” mode for the home security system may be utilized, for example, when the occupants are away. In the away mode, the entry points into a home may be monitored for intrusion by an unwanted party. A “home” mode may refer to the home security system's state when the occupants are home. The mode can affect the actions taken by the security system in response to sensed activities in the home. For example, in home mode, the sensed opening of an exterior door may result in no action being taken by the security system. In the away mode, the sensed opening of the same door may be construed as an intrusion detection and may trigger a call to the police. There can also be an intermediate mode between stay and away. For example, there can be a “night” mode for when occupants are sleeping in the home. This mode can, for example, refrain from triggering an alert to the police based on sensed movement in the bedroom and hallways, but send such an alert when an exterior door is opened. The system can transition between modes when a user enters a security code into an entryway security system. Such modes apply to the security system for the whole home.
In general, a “sensor” as disclosed herein may include multiple sensors or sub-sensors, such as where a position sensor includes both a global positioning sensor (GPS) as well as a wireless network sensor, which provides data that can be correlated with known wireless networks to obtain location information. Multiple sensors may be arranged in a single physical housing, such as where a single device includes movement, temperature, magnetic, and/or other sensors. Such a housing also may be referred to as a sensor, a sensor device, or a sensor package. For clarity, sensors are described with respect to the particular functions they perform and/or the particular physical hardware used, when such specification is necessary for understanding of the implementations disclosed herein.
A sensor may include hardware in addition to the specific physical sensor that obtains information about the environment.
In some configurations, two or more sensors may generate data that can be used by a processor of a system to generate a response and/or infer a state of the environment. For example, an ambient light sensor in a room may determine that the room is dark (e.g., less than 60 lux). A microphone in the room may detect a sound above a set threshold, such as 60 dB. The system processor may determine, based on the data generated by both sensors that it should activate one or more lights in the room. In the event the processor only received data from the ambient light sensor, the system may not have any basis to alter the state of the lighting in the room. Similarly, if the processor only received data from the microphone, the system may lack sufficient data to determine whether activating the lights in the room is necessary, for example, during the day the room may already be bright or during the night the lights may already be on. As another example, two or more sensors may communicate with one another. Thus, data generated by multiple sensors simultaneously or nearly simultaneously may be used to determine a state of an environment and, based on the determined state, generate a response.
As another example, a security system may employ a magnetometer affixed to a doorjamb and a magnet affixed to the door. When the door is closed, the magnetometer may detect the magnetic field emanating from the magnet. If the door is opened, the increased distance may cause the magnetic field near the magnetometer to be too weak to be detected by the magnetometer. If the security system is activated, it may interpret such non-detection as the door being ajar or open. In some configurations, a separate sensor or a sensor integrated into one or more of the magnetometer and/or magnet may be incorporated to provide data regarding the status of the door. For example, an accelerometer and/or a compass may be affixed to the door and indicate the status of the door and/or augment the data provided by the magnetometer.
In some configurations, an accelerometer may be employed to indicate how quickly the door is moving. For example, the door may be lightly moving due to a breeze. This may be contrasted with a rapid movement due to a person swinging the door open. The data generated by the compass, accelerometer, and/or magnetometer may be analyzed and/or provided to a central system such as a controller 73 and/or remote system 74 as previously described. The data may be analyzed to learn a user behavior, an environment state, and/or as a component of a home security or home automation system. While the above example is described in the context of a door, a person having ordinary skill in the art will appreciate the applicability of the disclosed subject matter to other implementations such as a window, garage door, fireplace doors, vehicle windows/doors, faucet positions (e.g., an outdoor spigot), a gate, seating position, etc.
Data generated by one or more sensors may indicate a behavior pattern of one or more users and/or an environment state over time, and thus may be used to “learn” such characteristics. For example, data generated by an ambient light sensor in a room of a house and the time of day may be stored in a local or remote storage medium with the permission of an end user. A processor in communication with the storage medium may compute a behavior based on the data generated by the light sensor. The light sensor data may indicate that the amount of light detected increases until an approximate time or time period, such as 3:30 PM, and then declines until another approximate time or time period, such as 5:30 PM, at which point there is an abrupt increase in the amount of light detected. In many cases, the amount of light detected after the second time period may be either below a dark level of light (e.g., under or equal to 60 lux) or bright (e.g., equal to or above 400 lux). In this example, the data may indicate that after 5:30 PM, an occupant is turning on/off a light as the occupant of the room in which the sensor is located enters/leaves the room. At other times, the light sensor data may indicate that no lights are turned on/off in the room. The system, therefore, may learn that occupants patterns of turning on and off lights, and may generate a response to the learned behavior. For example, at 5:30 PM, a smart home environment or other sensor network may automatically activate the lights in the room if it detects an occupant in proximity to the home. In some implementations, such behavior patterns may be verified using other sensors. Continuing the example, user behavior regarding specific lights may be verified and/or further refined based upon states of, or data gathered by, smart switches, outlets, lamps, and the like.
Sensors as disclosed herein may operate within a communication network, such as a conventional wireless network, and/or a sensor-specific network through which sensors may communicate with one another and/or with dedicated other devices. In some configurations, one or more sensors may provide information to one or more other sensors, to a central controller, or to any other device capable of communicating on a network with the one or more sensors. A central controller may be general- or special-purpose. For example, one type of central controller is a home automation network that collects and analyzes data from one or more sensors within the home. Another example of a central controller is a special-purpose controller that is dedicated to a subset of functions, such as a security controller that collects and analyzes sensor data primarily or exclusively as it relates to various security considerations for a location. A central controller may be located locally with respect to the sensors with which it communicates and from which it obtains sensor data, such as in the case where it is positioned within a home that includes a home automation and/or sensor network. Alternatively or in addition, a central controller as disclosed herein may be remote from the sensors, such as where the central controller is implemented as a cloud-based system that communicates with multiple sensors, which may be located at multiple locations and may be local or remote with respect to one another.
The devices of the security system and smart-home environment of the disclosed subject matter may be communicatively connected via the network 70, which may be a mesh-type network such as Thread, which provides network architecture and/or protocols for devices to communicate with one another. Typical home networks may have a single device point of communications. Such networks may be prone to failure, such that devices of the network cannot communicate with one another when the single device point does not operate normally. The mesh-type network of Thread, which may be used in the security system of the disclosed subject matter, may avoid communication using a single device. That is, in the mesh-type network, such as network 70, there is no single point of communication that may fail and prohibit devices coupled to the network from communicating with one another.
The communication and network protocols used by the devices communicatively coupled to the network 70 may provide secure communications, minimize the amount of power used (i.e., be power efficient), and support a wide variety of devices and/or products in a home, such as appliances, access control, climate control, energy management, lighting, safety, and security. For example, the protocols supported by the network and the devices connected thereto may have an open protocol which may carry IPv6 natively.
The Thread network, such as network 70, may be easy to set up and secure to use. The network 70 may use an authentication scheme, AES (Advanced Encryption Standard) encryption, or the like to reduce and/or minimize security holes that exist in other wireless protocols. The Thread network may be scalable to connect devices (e.g., 2, 5, 10, 20, 50, 100, 150, 200, or more devices) into a single network supporting multiple hops (e.g., to provide communications between devices when one or more nodes of the network is not operating normally). The network 70, which may be a Thread network, may provide security at the network and application layers. One or more devices communicatively coupled to the network 70 (e.g., controller 73, remote system 74, and the like) may store product install codes to ensure only authorized devices can join the network 70. One or more operations and communications of network 70 may use cryptography, such as public-key cryptography.
The devices communicatively coupled to the network 70 of the smart-home environment and/or security system disclosed herein may low power consumption and/or reduced power consumption. That is, devices efficiently communicate to with one another and operate to provide functionality to the user, where the devices may have reduced battery size and increased battery lifetimes over conventional devices. The devices may include sleep modes to increase battery life and reduce power requirements. For example, communications between devices coupled to the network 70 may use the power-efficient IEEE 802.15.4 MAC/PHY protocol. In embodiments of the disclosed subject matter, short messaging between devices on the network 70 may conserve bandwidth and power. The routing protocol of the network 70 may reduce network overhead and latency. The communication interfaces of the devices coupled to the smart-home environment may include wireless system-on-chips to support the low-power, secure, stable, and/or scalable communications network 70.
The sensor network shown in
The smart home environment can control and/or be coupled to devices outside of the structure. For example, one or more of the sensors 71, 72 may be located outside the structure, for example, at one or more distances from the structure (e.g., sensors 71, 72 may be disposed outside the structure, at points along a land perimeter on which the structure is located, and the like. One or more of the devices in the smart home environment need not physically be within the structure. For example, the controller 73 which may receive input from the sensors 71, 72 may be located outside of the structure.
The structure of the smart-home environment may include a plurality of rooms, separated at least partly from each other via walls. The walls can include interior walls or exterior walls. Each room can further include a floor and a ceiling. Devices of the smart-home environment, such as the sensors 71, 72, may be mounted on, integrated with and/or supported by a wall, floor, or ceiling of the structure.
The smart-home environment including the sensor network shown in
For example, a smart thermostat may detect ambient climate characteristics (e.g., temperature and/or humidity) and may control an HVAC (heating, ventilating, and air conditioning) system accordingly of the structure. For example, the ambient client characteristics may be detected by sensors 71, 72 shown in
As another example, a smart hazard detector may detect the presence of a hazardous substance or a substance indicative of a hazardous substance (e.g., smoke, fire, or carbon monoxide). For example, smoke, fire, and/or carbon monoxide may be detected by sensors 71, 72 shown in
As another example, a smart doorbell may control doorbell functionality, detect a person's approach to or departure from a location (e.g., an outer door to the structure), and announce a person's approach or departure from the structure via audible and/or visual message that is output by a speaker and/or a display coupled to, for example, the controller 73.
In some implementations, the smart-home environment of the sensor network shown in
In implementations of the disclosed subject matter, a smart-home environment may include one or more intelligent, multi-sensing, network-connected entry detectors (e.g., “smart entry detectors”). Such detectors may be or include one or more of the sensors 71, 72 shown in
The smart-home environment of the sensor network shown in
The smart thermostats, the smart hazard detectors, the smart doorbells, the smart wall switches, the smart wall plugs, the smart entry detectors, the smart doorknobs, the keypads, and other devices of a smart-home environment (e.g., as illustrated as sensors 71, 72 of
A user can interact with one or more of the network-connected smart devices (e.g., via the network 70). For example, a user can communicate with one or more of the network-connected smart devices using a computer (e.g., a desktop computer, laptop computer, tablet, or the like) or other portable electronic device (e.g., a smartphone, a tablet, a key FOB, or the like). A webpage or application can be configured to receive communications from the user and control the one or more of the network-connected smart devices based on the communications and/or to present information about the device's operation to the user. For example, the user can view or change the mode of the security system of the home.
One or more users can control one or more of the network-connected smart devices in the smart-home environment using a network-connected computer or portable electronic device. In some examples, some or all of the users (e.g., individuals who live in the home) can register their mobile device and/or key FOBs with the smart-home environment (e.g., with the controller 73). Such registration can be made at a central server (e.g., the controller 73 and/or the remote system 74) to authenticate the user and/or the electronic device as being associated with the smart-home environment, and to provide permission to the user to use the electronic device to control the network-connected smart devices and the security system of the smart-home environment. A user can use their registered electronic device to remotely control the network-connected smart devices and security system of the smart-home environment, such as when the occupant is at work or on vacation. The user may also use their registered electronic device to control the network-connected smart devices when the user is located inside the smart-home environment.
Alternatively, or in addition to registering electronic devices, the smart-home environment may make inferences about which individuals live in the home and are therefore users and which electronic devices are associated with those individuals. As such, the smart-home environment may “learn” who is a user (e.g., an authorized user) and permit the electronic devices associated with those individuals to control the network-connected smart devices of the smart-home environment (e.g., devices communicatively coupled to the network 70), in some implementations including sensors used by or within the smart-home environment. Various types of notices and other information may be provided to users via messages sent to one or more user electronic devices. For example, the messages can be sent via email, short message service (SMS), multimedia messaging service (MMS), unstructured supplementary service data (USSD), as well as any other type of messaging services and/or communication protocols.
A smart-home environment may include communication with devices outside of the smart-home environment but within a proximate geographical range of the home. For example, the smart-home environment may include an outdoor lighting system (not shown) that communicates information through the communication network 70 or directly to a central server or cloud-computing system (e.g., controller 73 and/or remote system 74) regarding detected movement and/or presence of people, animals, and any other objects and receives back commands for controlling the lighting accordingly.
The controller 73 and/or remote system 74 can control the outdoor lighting system based on information received from the other network-connected smart devices in the smart-home environment. For example, in the event that any of the network-connected smart devices, such as smart wall plugs located outdoors, detect movement at nighttime, the controller 73 and/or remote system 74 can activate the outdoor lighting system and/or other lights in the smart-home environment.
In some configurations, a remote system 74 may aggregate data from multiple locations, such as multiple buildings, multi-resident buildings, and individual residences within a neighborhood, multiple neighborhoods, and the like. In general, multiple sensor/controller systems 81, 82 as previously described with respect to
In situations in which the systems discussed here collect personal information about users, or may make use of personal information, the users may be provided with an opportunity to control whether programs or features collect user information (e.g., information about a user's social network, social actions or activities, profession, a user's preferences, or a user's current location), or to control whether and/or how to receive content from the content server that may be more relevant to the user. In addition, certain data may be treated in one or more ways before it is stored or used, so that personally identifiable information is removed. As another example, systems disclosed herein may allow a user to restrict the information collected by the systems disclosed herein to applications specific to the user, such as by disabling or limiting the extent to which such information is aggregated or used in analysis with other information from other users. Thus, the user may have control over how information is collected about the user and used by a system as disclosed herein.
Implementations of the presently disclosed subject matter may be implemented in and used with a variety of component and network architectures.
The bus 21 allows data communication between the central processor 24 and the memory 27, which may include read-only memory (ROM) or flash memory (neither shown), and random access memory (RAM) (not shown), as previously noted. The RAM is generally the main memory into which the operating system and application programs are loaded. The ROM or flash memory can contain, among other code, the Basic Input-Output system (BIOS) which controls basic hardware operation such as the interaction with peripheral components. Applications resident with the computer 20 are generally stored on and accessed via a computer readable medium, such as a hard disk drive (e.g., fixed storage 23), an optical drive, floppy disk, or other storage medium 25.
The fixed storage 23 may be integral with the computer 20 or may be separate and accessed through other interfaces. A network interface 29 may provide a direct connection to a remote server via a telephone link, to the Internet via an internet service provider (ISP), or a direct connection to a remote server via a direct network link to the Internet via a POP (point of presence) or other technique. The network interface 29 may provide such connection using wireless techniques, including digital cellular telephone connection, Cellular Digital Packet Data (CDPD) connection, digital satellite data connection, or the like. For example, the network interface 29 may allow the computer to communicate with other computers via one or more local, wide-area, or other networks, as shown in
Many other devices or components (not shown) may be connected in a similar manner (e.g., document scanners, digital cameras, and so on). Conversely, all of the components shown in
More generally, various implementations of the presently disclosed subject matter may include or be implemented in the form of computer-implemented processes and apparatuses for practicing those processes. The disclosed subject matter also may be implemented in the form of a computer program product having computer program code containing instructions implemented in non-transitory and/or tangible media, such as floppy diskettes, CD-ROMs, hard drives, USB (universal serial bus) drives, or any other machine readable storage medium, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing implementations of the disclosed subject matter. Implementations also may be implemented in the form of computer program code, for example, whether stored in a storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing implementations of the disclosed subject matter. When implemented on a general-purpose microprocessor, the computer program code segments configure the microprocessor to create specific logic circuits. In some configurations, a set of computer-readable instructions stored on a computer-readable storage medium may be implemented by a general-purpose processor, which may transform the general-purpose processor or a device containing the general-purpose processor into a special-purpose device configured to implement or carry out the instructions.
Implementations may use hardware that includes a processor, such as a general-purpose microprocessor and/or an Application Specific Integrated Circuit (ASIC) that includes all or part of the techniques according to implementations of the disclosed subject matter in hardware and/or firmware. The processor may be coupled to memory, such as RAM, ROM, flash memory, a hard disk or any other device capable of storing electronic information. The memory may store instructions adapted to be executed by the processor to perform the techniques according to implementations of the disclosed subject matter.
The foregoing description, for purpose of explanation, has been described with reference to specific implementations. However, the illustrative discussions above are not intended to be exhaustive or to limit implementations of the disclosed subject matter to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The implementations were chosen and described in order to explain the principles of implementations of the disclosed subject matter and their practical applications, to thereby enable others skilled in the art to utilize those implementations as well as various implementations with various modifications as may be suited to the particular use contemplated.
Number | Date | Country | |
---|---|---|---|
Parent | 14585220 | Dec 2014 | US |
Child | 15494937 | US |