Patent Grant
7486183
This application is related to commonly assigned:
U.S. patent application Ser. No. 10/686,187, filed Oct. 15, 2003, entitled “Home System Including A Portable Fob Having A Display”;
U.S. patent application Ser. No. 10/686,179, filed Oct. 15, 2003, entitled “Home System Including A Portable Fob Having A Rotary Menu And A Display”; and
U.S. patent application Ser. No. 10/686,016, filed Oct. 15, 2003, entitled “Home System Including A Portable Fob Mating With System Components”.
1. Field of the Invention
This invention relates generally to home systems and, more particularly, to home systems employing sensors and communications, such as, for example, a wireless local area network (WLAN) or a low rate—wireless personal area network (LR-WPAN). The invention also relates to methods for detecting and monitoring events in a home system.
2. Background Information
Home security or “wellness” monitoring systems provide remote status and/or alarm information through telephone voice or paging technology. Such status or information includes prerecorded voice or text messages.
Standalone digital cameras, cellular telephones with a camera, and cellular telephones with a display are known.
There is room for improvement in home systems, and in methods and apparatus for detecting and monitoring events in such systems.
It is believed that it is not known to send a digital image from a home monitoring system to a cellular data (display) telephone.
The present invention sends one or more digital images (e.g., a predetermined digital image; a digital image at the time of an event) to a remote device, such as a cellular telephone display, in order to provide improved remote indication of a status, a status change and/or a problem as identified by a home system.
As one aspect of the invention, a home system comprises: a server including a first communication port, a second communication port and a memory having at least one digital image; a plurality of first devices, at least one of the first devices comprising a sensor adapted to detect an event, and a first communication port adapted to send the detected event to the first communication port of the server; and a second device including a second communication port and a display, wherein the second communication port of the server is adapted to send one of the at least one digital image to the second communication port of the second device responsive to receipt of the detected event at the first communication port of the server, and wherein the second device is adapted to display the one of the at least one digital image on the display responsive to receipt thereof at the second communication port of the second device.
The one of the at least one digital image may be a predetermined digital image in the memory of the server. The server may be adapted to receive a message from the at least one of the first devices as the detected event and to associate the message with the predetermined digital image.
The server may be adapted to receive a message and a corresponding digital image from the at least one of the first devices at the first communication port of the server, and to store the corresponding digital image as the one of the at least one digital image in the memory of the server.
The second device may be adapted to send a request message from the second communication port thereof to the second communication port of the server. The server may be adapted to receive the request message from the second communication port thereof and to send another request message to the first communication port of the at least one of the first devices. The at least one of the first devices may be a digital camera device comprising the sensor, which is adapted to detect receipt of the another request message as the event, a digital camera adapted to create a corresponding digital image responsive to the event, and the first communication port of the at least one of the first devices being adapted to send the corresponding digital image as the detected event to the first communication port of the server. The server may be adapted to stored the corresponding digital image in the memory of the server and to send the corresponding digital image from the second communication port thereof to the second communication port of the second device. The second device may be adapted to display the corresponding digital image on the display responsive to receipt thereof at the second communication port of the second device.
The one of the at least one digital image may be a predetermined digital image in the memory of the server prior to receipt of the detected event at the first communication port of the server.
The one of the at least one digital image may be communicated to the first communication port of the server with the detected event.
The at least one of the first devices may further include a digital camera operatively associated with the sensor. The sensor may be adapted to detect the event and responsively trigger the digital camera. The digital camera, responsive to the trigger, may be adapted to create a digital image and communicate the created digital image to the first communication port of the server with the detected event.
Another one of the first devices may be a digital camera including a corresponding first communication port. The sensor may be adapted to detect the event and responsively send the detected event to the first communication port of the server. The server may be adapted to receive the detected event and send a snapshot request to the corresponding first communication port of the digital camera. The digital camera, responsive to receiving the snapshot request, may be adapted to create a digital image and communicate the created digital image to the first communication port of the server.
The sensor may be a first sensor, the event may be a first event, the digital image may be a first digital image, another one of the first devices may be a second sensor including a corresponding first communication port, and a further one of the first devices may be a digital camera including a corresponding first communication port. The second sensor may be adapted to detect a second event and responsively send the detected second event to the first communication port of the server. The server may be adapted to receive the detected second event and send a snapshot request to the corresponding first communication port of the digital camera. The digital camera, responsive to receiving the snapshot request, may be adapted to create a second digital image and communicate the created digital image to the first communication port of the server.
The at least one of the first devices may further include a plurality of digital cameras operatively associated with the sensor. The sensor may be adapted to detect the event and responsively trigger the digital cameras. Each of the digital cameras, responsive to the trigger, may be adapted to create a corresponding digital image and to communicate the corresponding digital image to the first communication port of the server. The server may be adapted to receive each of the corresponding digital images at the first communication port of the server, and to store the corresponding digital images in the memory of the server.
As another aspect of the invention, a method of displaying a digital image responsive to an event of a home system comprises: employing a home system server including a memory having at least one digital image; employing a plurality of first devices associated with the home system server; detecting an event at one of the first devices and sending the detected event to the home system server; responsively sending one of the at least one digital image to a second device; and responsively displaying the one of the at least one digital image on a display of the second device, in order to represent the detected event.
A full understanding of the invention can be gained from the following description of the preferred embodiments when read in conjunction with the accompanying drawings in which:
As employed herein, the term “wireless” shall expressly include, but not be limited by, radio frequency (RF), infrared, wireless area networks, IEEE 802.11 (e.g., 802.11a; 802.11b; 802.11g), IEEE 802.15 (e.g., 802.15.1; 802.15.3, 802.15.4), other wireless communication standards, DECT, PWT, pager, PCS, Wi-Fi, Bluetooth™, and cellular.
As employed herein, the term “communication network” shall expressly include, but not be limited by, any local area network (LAN), wide area network (WAN), intranet, extranet, global communication network, the Internet, and/or wireless communication network.
As employed herein, the term “portable wireless communicating device” shall expressly include, but not be limited by, any portable communicating device having a wireless communication port (e.g., a portable wireless device; a portable personal computer (PC); a Personal Digital Assistant (PDA)), data phone.
As employed herein, the term “fob” shall expressly include, but not be limited by, a portable wireless communicating device; a wireless network device; an object that is directly or indirectly carried by a person; an object that is worn by a person; an object that is placed on or coupled to a household object (e.g., a refrigerator; a table); an object that is coupled to or carried by a personal object (e.g., a purse; a wallet; a credit card case); a portable object; and/or a handheld object.
As employed herein, the term “user input device” shall expressly include, but not be limited by, any suitable input mechanism or transducer, which collects user input through direct physical manipulation, with or without employing any moving part(s), and which converts such input, either directly or indirectly through an associated processor and/or converter, into a corresponding digital form.
As employed herein, the term “network coordinator” (NC) shall expressly include, but not be limited by, any communicating device, which operates as the coordinator for devices wanting to join a communication network and/or as a central controller in a wireless communication network.
As employed herein, the term “network device” (ND) shall expressly include, but not be limited by, any communicating device (e.g., a portable wireless communicating device; a fob; a camera/sensor device; a wireless camera; and/or a fixed wireless communicating device, such as, for example, switch sensors, motion sensors or temperature sensors as employed in a wirelessly enabled sensor network), which participates in a wireless communication network, and which is not a network coordinator.
As employed herein, the term “node” includes NDs and NCs.
As employed herein, the term “headless” means without any user input device and without any display device.
As employed herein, the term “server” shall expressly include, but not be limited by, a “headless” base station; and/or a network coordinator.
As employed herein, the term “residence” shall expressly include, but not be limited by, a home, apartment, dwelling, office and/or place where a person or persons reside(s) and/or work(s).
As employed herein, the term “home system” shall expressly include, but not be limited by, a system for a home or other type of residence.
As employed herein, the term “digital image” shall expressly include, but not be limited by, a digital picture; a digital photograph; an image created by digital camera; and/or a digital representation of a picture, photograph, object, person or thing.
As employed herein, the term “cellular telephone” shall expressly include, but not be limited-by, wireless telephones; data phones with a digital display; and/or mobile telephones.
As employed herein, a home wellness system shall expressly include, but not be limited by, a home system for monitoring and/or configuring aspects of a home or other type of residence.
Referring to
The example cellular telephone 8 includes a communication port, such as an antenna 30, and the display 6. The server second communication port 14 is adapted to send a corresponding digital image 31 of the one or more digital images 18 to the cellular telephone communication port 30 responsive to receipt of the wireless message 29 at the server first communication port 12. In response, the cellular telephone 8 is adapted to display the corresponding digital image 31 on the display 6 responsive to receipt thereof at the cellular telephone communication port 30.
The base station 10 sends the digital image 31 from its second communication port 14 on telephone line 32 through cell tower 34 to the remote cellular telephone 8. The hardware and messaging for this communication that the base station 10 employs to send the digital image 31 may mimic, for example, a telephone text message employed by a cellular telephone (not shown) including a camera and a display.
For example, on such a cellular telephone (not shown), the user: (1) selects (e.g., from a menu (not shown)), “take picture,” which causes the digital image to be captured; (2) presses “send”; (3) selects e-mail (as the type of delivery mechanism); (4) enters the e-mail address of the intended recipient (and optionally adds any text to the message); and (5) presses “send”. This causes the cellular telephone to send the e-mail text message with, for example, a “.jpg” picture embedded in the body thereof.
In the present example, the base station 10 includes the digital image 31 (e.g., as obtained from an integral digital camera 218 (
Alternatively, any suitable delivery mechanism may be employed (e.g., text or picture messages may be sent directly between two cellular telephones and the base station 10 may mimic that delivery mechanism).
The one or more digital images 18 may be digital images captured during the setup of the sensors 20,22,24 of the home monitoring system 2, and/or may be digital images created at the time of corresponding detected events.
In this example, digital images are captured during setup of the sensors 20,22,24 of the home monitoring system 2. The user may create predetermined digital images (e.g., with digital camera 4) of where each of the sensors 20, 22 are mounted. Then, when the base station 10 sends an alert message 38 to the cellular telephone 8, the display 6 thereof shows a digital image (not shown) of the “activated” sensor in its location. Messages associated with this example are discussed below in connection with
During operation, whenever a sensor “trips,” which indicates that an event has occurred, the base station 10 detects this and responsively transmits the alert message 38 and the corresponding predetermined digital image 31A (e.g., a picture of an open garage door; a picture of a closed garage door) to the cellular telephone 8 for display thereon. Hence, at a glance, the user visually sees the event, instead of merely receiving a text message. In this example, the digital image 31A shows the location of the corresponding sensor and its representative state, rather than the exact image including the condition that caused the event. This allows for at-a-glance awareness with universal appeal and no words.
Here, the digital image 31A is predetermined in the memory 16 of the base station 10, which is adapted to receive a wireless message 29A from the sensors 20,22 as the detected event and to associate the subsequent alert message 38 with the predetermined digital image 31A.
A wireless digital camera, such as camera/sensor 24, sends a digital image 40 along with the detected event in the wireless message 29. In this example, if the sensor (S) 26 is a motion detector that detects movement in the area 23 (e.g., a “critter” in a garage), a corresponding camera (C) 42 creates the digital image 40 (e.g., a digital picture of a frog in the garage), which is sent to the base station 10 in the wireless message 29. In turn, the base station 10 forwards this digital image 31 to the remote user at the cellular telephone display 8, which shows the image 44 of the frog. For example, the digital image 40 would be sent to the user's cellular telephone 8, in order to provide a visual verification, as might be required by a police department, to respond to an “alarm” call or not to respond to a false alarm.
One or more wireless digital cameras 4, 42 of the home system 2 send digital images 31,31 A remotely to a user through the base station 10 and the user's cellular telephone 8. For example, a cellular carrier (not shown) promotes, sells, bills and collects revenue for this feature (e.g., a fixed or variable price per month added to the bill for the cellular telephone 8). Such digital images 31,31A are preferably sent only to the user's cellular telephone 8, which provides a visual verification as may be required by a police department to respond to an “alarm” call. Hence, the digital cameras 4,42 are not viewable by anyone else and are not viewable on the Internet (not shown).
It will be appreciated that the digital images 31, 31A provide, either, a predetermined visual confirmation of the area of the residence associated with the particular sensor 20,22, or a visual confirmation of the likely cause of the event in the residence. In the latter example, this visual confirmation advantageously communicates to the user the severity of the event (e.g., a garage motion detector has detected a wild animal, a small child, a burglar, or a known adult; a basement water sensor shows a small puddle or a substantial level of water).
The camera/sensor 24 further includes a physical discrete input 106 (e.g., an on/off detector; an open/closed detector; a water detector; a motion detector) with the μC 92 employing a corresponding discrete input 108. In this example, the discrete input 106 is a motion detector adapted to detect motion as the event. In the camera/sensor 24, the digital camera 110 is operatively associated with the motion detector input 106, which is adapted to detect the event (e.g., motion in this example) and responsively trigger 114 the digital camera 110 through the μC 92. The digital camera 110, responsive to the trigger 114, is adapted to create a digital image 116, which the μC 92 receives and communicates to the communication port 12 of the base station 10 of
The camera/sensor 24 also includes a suitable indicator, such as an LED 118, to output the status of the physical discrete input 106 (e.g., LED illuminated for on; LED non-illuminated for off). The camera 4 of
Although a motion detector input 106 is disclosed, a wide range of sensors (e.g., door open; window open; garage door open; closet door open; attic door open; unexpected motion; smoke alarm; water detected) may be employed by camera/sensors, such as the camera/sensor 24. Although a battery 90 is shown in
During operation, when a sensor, such as camera/sensor 24, detects that an event has occurred, it transmits the wireless message 29 (
For example, a front door motion detector (not shown) may detect that someone or something is at the front door (not shown) and may, thus, provide a digital image of that person or thing.
One advantage of physical pairing is that it requires no special user setup of the camera/sensor 24.
The base station 147 (e.g., a wireless server; a network coordinator) may collect data from the sensor 152 and cameras 148,150 and “page,” or otherwise send an RF alert message 163 to, the fob 154 in the event that a critical status changes at one or more of these network devices 148,150,152.
The fob 154 may be employed as both a portable in-home monitor for the various network devices 148,150,152 and, also, as a portable configuration tool for the base station 147 and such devices.
The example base station 147 is headless and includes no user interface. The network devices 148,150,152 preferably include no user interface, although some sensors may have a status indicator (e.g., LED 118 of
As was discussed above in connection with
As will be discussed below in connection with
Each one of the network devices 148,150,152, such as the sensor 152, senses information and includes a corresponding communication port, such as port 168, which sends the sensed information to the first communication port 164 of the base station 147. Another network device, the portable fob 154, includes a corresponding communication port 170 and a display 172 (
A remote user may employ a web site, such as a secure web site 176 at the web server 156, in order to remotely query the home monitoring system 146 from a client device 178 having a suitable global communication network (e.g., Internet) communication port 180. This may provide additional details to the user that the digital images 31,31A of
As shown in
The second processor 188, in turn, employs the communication port 170, such as an RF transceiver (RX/TX), having an external antenna 198. As shown with the processor 184, the various components of the fob 154 receive power from a battery 200. The first processor 184 receives inputs from the timer 185, a suitable proximity sensor, such as a sensor/base program switch 174 (e.g., which detects mating or engagement with one of the network devices 148,150,152 or with the base station 147 of
The program switch 174 may be, for example, an ESE-24MH1T Panasonic® two-pole detector switch or a Panasonic® EVQ-11U04M one-pole micro-switch. This program switch 174 includes an external pivotable or linear actuator (not shown), which may be toggled in one of two directions (e.g., pivoted clockwise and counter-clockwise; in and out), in order to close one of one or two normally open contacts (not shown). Such a two-pole detector is advantageous in applications in which the fob 154 is swiped to engage one of the network devices 148,150,152 or base station 147 of
Although a physical switch 174 is disclosed, an “optical” switch (not shown) may be employed, which is activated when the fob 154, or portion thereof, “breaks” an optical beam when mating with another system component. Alternatively, any suitable device or sensor may be employed to detect that the fob 154 has engaged or is suitably proximate to another system component, such as the base station 147 or network devices 148,150,152 of
The encoder 201 may be, for example, an AEC11BR series encoder marketed by CUI Inc. of Beaverton, Oreg. Although the encoder 201 is shown, any suitable user input device (e.g., a combined rotary switch and pushbutton; touch pad; joystick button) may be employed. Although the alert device 214 is shown, any suitable enunciator (e.g., an audible generator to generate one or more audible tones to alert the user of one or more corresponding status changes; a vibrational generator to alert the user by sense of feel; a visual indicator, such as, for example, an LED indicator to alert the user of a corresponding status change) may be employed. The display 172 preferably provides both streaming alerts to the user as well as optional information messages.
Referring to
After the user joins the sensors 20,22 (
Alternatively, it will be appreciated that a digital camera, such as 218 (
As shown in
As part of the sequence 260, the fob PIC processor 184 sends a PICDATA_request(rqst_updates) message 268 to the fob RF processor 188, which receives that message 268 and responsively sends a Data(reqst_updates) RF message 270 to the base RF processor 126. Upon receipt of the RF message 270, the base RF processor 126 sends an Acknowledgement(SUCCESS) RF message 272 back to the fob RF processor 188 and sends a PICDATA_indication(rqst_updates) message 274 to the base PIC processor 122. The data requested by this message 274 may include, for example, profile and state information from one or more components, such as the network devices 148,150,152. Here, the fob 154 is requesting an update from the base PIC processor 122 for data from all of the network devices 148,150,152, including any newly added sensor (not shown), in view of that state change (i.e., there is new data from the newly added sensor (not shown)). Responsive to receiving the Acknowledgement(SUCCESS) RF message 272, the fob RF processor 188 sends a PICDATA_confirm(SENT) message 276 to the fob PIC processor 184. Responsive to receiving the PICDATA_indication(rqst_updates) message 274, the base PIC processor 122 sends a PICDATA_request(updates) message 278 to the base RF processor 126, which receives that message 278 and responsively sends a Data(updates) RF message 280 to the fob RF processor 188.
After receiving the Data(updates) RF message 280, the fob RF processor 188 sends an Acknowledgement(SUCCESS) RF message 282 back to the base RF processor 126 and sends a PICDATA_indication(updates) message 286, including the requested sensor update data, to the fob PIC processor 184, which updates its local data table 266. Then, if there is no activity of the fob user input device (e.g., thumbwheel) 201, or if no alert is received from the base station 147, then the fob PIC processor 184 sends a SLEEP_request( ) message 262 to the fob RF processor 188 and both fob processors 184,188 enter a low_power_mode( ) 288,290, respectively (
After receiving the Acknowledgement(SUCCESS) RF message 282, the base RF processor 126 sends a PIC_DATA_confirm(SENT) message 284 back to the base PIC processor 122. Following the message sequence 260, the fob timer 185 (
In
In
The low_power_mode( ) 324 is maintained until one of two events occurs. As was previously discussed, after the expiration of the sensor_heartbeat_interval 314, the sensor 24 wakes up at 316. Alternatively, as shown in
As was discussed above in connection with
The advantage of logical pairing is that the wireless digital cameras 4,148,150 can be mounted in a location, possibly physically separate, but otherwise associated with one or more sensors, such as 20,22,152 (e.g., on a wall opposite, for example, one or more window, door and/or motion sensors).
It will be appreciated, however, that any suitable client, such as the cellular telephone 8 of
Provisions may be made to store and selectively forward the digital image from the base station 10,147 for possible future reference (e.g., insurance purposes; visual verification to police of burglary; reprimands to children or neighbors; status of a disabled or elderly person to a health care or elder care service provider). Here, the user determines the appropriate action based on the visual information being displayed.
Responsive to receiving the PICDATA_indication(state) message 334 by the base station PIC processor 122, it associates the sensor 152 with the predetermined digital image 348. In turn, the base station PIC processor 122 sends a Data(alert/picture) message 346 including the predetermined digital image 348 to the cellular telephone 8 of
While for clarity of disclosure reference has been made herein to the exemplary displays 6,172 for displaying digital images or home system information, it will be appreciated that such images or information may be stored, printed on hard copy, be computer modified, or be combined with other data. All such processing shall be deemed to fall within the terms “display” or “displaying” as employed herein.
While specific embodiments of the invention have been described in detail, it will be appreciated by those skilled in the art that various modifications and alternatives to those details could be developed in light of the overall teachings of the disclosure. Accordingly, the particular arrangements disclosed are meant to be illustrative only and not limiting as to the scope of the invention which is to be given the full breadth of the claims appended and any and all equivalents thereof.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5987011 | Toh | Nov 1999 | A |
| 6034961 | Masuo et al. | Mar 2000 | A |
| 6167025 | Hsing et al. | Dec 2000 | A |
| 6385772 | Courtney | May 2002 | B1 |
| 6542076 | Joao | Apr 2003 | B1 |
| 6583720 | Quigley | Jun 2003 | B1 |
| 20020057342 | Yoshiyama et al. | May 2002 | A1 |
| 20030038879 | Rye et al. | Feb 2003 | A1 |
| 20030065407 | Johnson et al. | Apr 2003 | A1 |
| 20030174210 | Vimpari et al. | Sep 2003 | A1 |
| 20040047471 | Sawano | Mar 2004 | A1 |
| Number | Date | Country |
|---|---|---|
| 10035812 | Jan 2002 | DE |
| 1316933 | Jun 2003 | EP |
| 2325548 | Nov 1998 | GB |
| WO 9707486 | Feb 1997 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20050262519 A1 | Nov 2005 | US |
