System and method of augmented reality alarm system installation

Information

  • Patent Grant
  • 10388068
  • Patent Number
    10,388,068
  • Date Filed
    Monday, July 14, 2014
    10 years ago
  • Date Issued
    Tuesday, August 20, 2019
    5 years ago
Abstract
Systems and methods of augmented reality alarm system installation are provided. Methods can include capturing an image of a first piece of information displayed on a first user interface, identifying and retrieving a second piece of information associated with the first piece of information, and displaying the second piece of information on a second user interface.
Description
FIELD

The present invention relates generally to installation of alarm systems. More particularly, the present invention relates to a system and method of augmented reality alarm system installation.


BACKGROUND

Installing a commercial alarm system is a complex process that is often undertaken via a simple user interface that consists of a keypad with sixteen keys and a 2×16 character alphanumeric LCD display. However, in some cases, such a display is insufficient to present and provide fully satisfactory feedback regarding the installation process. Furthermore, in all cases, it is impossible to display explanatory text on such a display.


In view of the above, there is a continuing, ongoing need for an improved system and method for alarm system installation.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a flow diagram of a method in accordance with disclosed embodiments; and



FIG. 2 is a block diagram of a system in accordance with disclosed embodiments.





DETAILED DESCRIPTION

While this invention is susceptible of an embodiment in many different forms, there are shown in the drawings and will be described herein in detail specific embodiments thereof with the understanding that the present disclosure is to be considered as an exemplification of the principles of the invention. It is not intended to limit the invention to the specific illustrated embodiments.


Embodiments disclosed herein include a system and method of augmented reality alarm system installation. Embodiments disclosed herein also include a system and method of assisting an end user to perform operations on the alarm system. However, it is to be understood that systems and methods disclosed herein do not limit the alarm system or the alarm system user interface. For example, the alarm system can be installed and configured independently of the systems and methods disclosed herein, and the alarm system user interface can function independently of the systems and methods disclosed herein.


Some embodiments disclosed herein can provide context specific installation help, on demand, by employing a smart phone, tablet device, or other personal digital assistant that includes a camera or other data capture device. A user, for example, an installation engineer, can direct the field of view of the camera at an alarm system's user interface, for example, a 2×16 alphanumeric LCD display, to read at least one aspect of the display and to capture the status of the display. Based on the captured status of the display, systems and methods disclosed herein can identify the status of the alarm system, including the installation thereof, and provide additional information related to that status, for example, installation instructions, hints, and/or user tips.


In some embodiments, systems and methods disclosed herein can capture the status of the alarm system display by instructing the camera to capture the entire display, for example, by capturing and reading all of the text on the display.


In some embodiments, the alarm system display can display short numeric, alphanumeric, or symbolic code on the display, for example, at the end of the display. In these embodiments, systems and methods disclosed herein can capture the status of the alarm system display by instructing the camera to capture and read the code.


In some embodiments, the alarm system display can display a user-defined graphic, for example, a two-dimensional bar code or QR code. In these embodiments, systems and methods disclosed herein can capture the status of the alarm system display by instructing the camera to capture and read the graphic.


In some embodiments, the alarm system can include a keypad with a light emitting diode (LED) or other visual indicator. In these embodiments, the keypad LED or other visual indicator can be modulated, and systems and methods disclosed herein can capture the status of the alarm system by instructing the camera to capture the modulation. Accordingly, in these embodiments, systems and methods disclosed herein can capture the status of the alarm system without capturing the status of the alarm system display itself.


Additionally or alternatively, the alarm system's keypad, display, or other user interface can include a sounder, speaker, or other audio indicator. In these embodiments, sound emitted from the sounder, speaker, or other audio indicator can be modulated, and systems and methods disclosed herein can capture the status of the alarm system by instructing a microphone of the user's smart phone, tablet device, or other personal digital assistant to capture the modulation. Accordingly, in these embodiments, systems and methods disclosed herein can capture the status of the alarm system without capturing any visual images.


In accordance with disclosed embodiments, a software application can run on a smart phone, tablet device, or other personal digital assistant that includes an onboard camera or other data capture device for capturing an image of an alarm system display and/or keypad. Furthermore, the software application can interpret the captured image and/or captured modulation to identify and display corresponding additional information.


In accordance with disclosed embodiments, a server can store the corresponding additional information, for example, in a database, and the corresponding additional information can be identified by cross-referencing the information in the captured image. In some embodiments, the server can run locally on the smart phone, tablet device, or other personal digital assistant. However, in some embodiments, the server can include a remote server that can be accessed in real time, via wireless communication, by the smart phone, tablet device, or other personal digital assistant.



FIG. 1 is a flow diagram of a method 100 in accordance with disclosed embodiments. As seen in FIG. 1, the method 100 can include directing the field of view of a data capture device of a smart device towards a user interface of an alarm system as in 110. Then, the method 100 can include the data capture device capturing an image of at least some information displayed on the user interface as in 120.


After the image of the information displayed on the user interface is captured as in 120, the method 100 can include locating the information in a database as in 130 and identifying additional information in the database that corresponds to and/or is associated with the captured information as in 140. Then, the method 100 can include displaying the additional information on a user interface of the smart device as in 150.


In some embodiments, the method 100 can also include updating the additional information in the database with the most current additional information available that corresponds to information that can be displayed on the user interface of the alarm system as in 160. Accordingly, the method 100 can continuously provide current additional information rather than outdated information that may no longer be useful or relevant to a user.



FIG. 2 is a block diagram of a system 200 in accordance with disclosed embodiments. In some embodiments, the system 200 can execute the method 100 of FIG. 1 and others in accordance with disclosed embodiments.


The system 200 can include a smart device 210, for example, a smart phone, a tablet device, or other personal digital assistant. The smart device can include a data capture device 212, a user interface 214, a memory device 215, control circuitry 216, one or more programmable processors 218, and an executable control software application 220 as would be understood by one of ordinary skill in the art. The executable control software application 220 can be stored on a transitory or non-transitory local computer readable medium, including, but not limited to, local computer memory, RAM, optical storage media, magnetic storage media, flash memory, and the like. In some embodiments, the control circuitry 216, the programmable processors 218, and/or the executable control software application 220 can execute and control the method 100 and others in accordance with disclosed embodiments.


As seen, the data capture device 212 can be positioned so that a user interface 230 of an alarm system is in its field of view 213 and so that the data capture device 212 can capture an image of information displayed on the user interface 230, for example, a keypad or other display. For example, in some embodiments, the user interface 230 can display a menu associated with the alarm system, and the data capture device 212 can capture an image of the menu and/or a portion thereof.


The control circuitry 216, the programmable processor 218, and/or the executable control software application 220 can decode the information in the image captured by the data capture device 212. For example, the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 can identify, determine, and/or locate an information file associated with the information in the image captured by the data capture device 212. In some embodiments, the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 can access a database, for example, a database stored in a memory device 215 to identify, determine, and/or locate the information file associated with the information in the image captured by the data capture device 212. Then, the control circuitry 216, the programmable processor 218, and/or the control software application 220 can request the information file from a server 240 or 250.


In some embodiments, a server 240 can be stored locally on the smart device 210, and the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 can communicate with the server 240 via an onboard and/or onsite communication means 245, for example, a communication bus or other communication means as would be known by one of ordinary skill in the art. However, in some embodiments, a server 250 can be located remotely from the smart device 210, and the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 can communicate with the server 250 via remote communication means 255, for example, wireless communication means such as radio, WiFi, cellular, and the like, or wired communication means such as Ethernet, fiber optics, and the like.


The server 240 or 250 can transmit the requested information file to the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 for displaying information in the requested information file on the user interface 214. Information files stored on the server 240 or 250 can be updated by a user periodically and/or as needed so that the information file transmitted to the control circuitry 216, the programmable processor 218, and/or the executable control software application 220 includes the most current information associated with the information in the image captured by the data capture device 212.


Although a few embodiments have been described in detail above, other modifications are possible. For example, the logic flows described above do not require the particular order described, or sequential order, to achieve desirable results. Other steps may be provided, or steps may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Other embodiments may be within the scope of the invention.


From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the spirit and scope of the invention. It is to be understood that no limitation with respect to the specific system or method described herein is intended or should be inferred. It is, of course, intended to cover all such modifications as fall within the sprit and scope of the invention.

Claims
  • 1. A system for an augmented reality alarm system installation comprising: a microphone;a user interface;a programmable processor; andexecutable control software stored on a non-transitory computer readable medium,wherein the programmable processor and the executable control software instruct the microphone to capture modulation of sound emitted from a sounder, a speaker, or another audio indicator of an alarm system,wherein the modulation represents a first piece of information,wherein the programmable processor and the executable control software identify and retrieve a second piece of information associated with the first piece of information by cross-referencing the first piece of information in a database that is stored on a server and by identifying and retrieving the second piece of information from the database,wherein the server is a remote device,wherein the programmable processor and the executable control software communicate with the server via remote communication, andwherein the programmable processor and the executable control software instruct the user interface to display the second piece of information.
  • 2. A method for an augmented reality alarm system installation, the method comprising: instructing a microphone of a smart device to capture modulation of sound emitted from a sounder, a speaker, or another audio indicator of an alarm system, wherein the modulation represents a first piece of information;identifying and retrieving a second piece of information associated with the first piece of information by cross-referencing the first piece of information in a database or on a server and by identifying and retrieving the second piece of information from the database or the server;displaying the second piece of information on a user interface of the smart device; andupdating the second piece of information stored in the database or on the server.
US Referenced Citations (29)
Number Name Date Kind
8646000 Kang Feb 2014 B2
9240058 Amacker Jan 2016 B1
20040161246 Matsushita Aug 2004 A1
20040172222 Simpson Sep 2004 A1
20040256465 Longacre, Jr. Dec 2004 A1
20050055244 Mullan Mar 2005 A1
20060232399 Martin Oct 2006 A1
20080303643 Ishida Dec 2008 A1
20100259549 Brown Oct 2010 A1
20110014975 Grabiec Jan 2011 A1
20110138416 Kang et al. Jun 2011 A1
20120023167 Hovdal Jan 2012 A1
20120169454 Petersen Jul 2012 A1
20120217292 Gratton Aug 2012 A1
20120223968 Kashimoto Sep 2012 A1
20120249588 Tison Oct 2012 A1
20130031202 Mick Jan 2013 A1
20130127980 Haddick May 2013 A1
20130326407 van Os Dec 2013 A1
20140159910 Lee Jun 2014 A1
20140299662 Harrison Oct 2014 A1
20150085128 Pineau Mar 2015 A1
20150188724 Kim Jul 2015 A1
20150224330 Kaib Aug 2015 A1
20150286857 Kim Oct 2015 A1
20150347740 O'Malley Dec 2015 A1
20160342839 Condel Nov 2016 A1
20170076504 Oar Mar 2017 A1
20170094042 Dagit, III Mar 2017 A1
Foreign Referenced Citations (9)
Number Date Country
1867142 Nov 2006 CN
102394926 Mar 2012 CN
102625219 Aug 2012 CN
103024063 Apr 2013 CN
103221963 Jul 2013 CN
103430565 Dec 2013 CN
2 575 291 Apr 2013 EP
WO 2014050147 Apr 2014 JP
WO 2013046231 Apr 2013 WO
Non-Patent Literature Citations (14)
Entry
Extended European search report for corresponding EP patent application 15173029.8, dated Nov. 10, 2015.
Jennifer Van Grove, City of New York Blankets Times Square with Giant QR Codes, Jun. 10, 2010, http://mashable.com/2010/06/10/internet-week-qr-codes/#Ifv7x2qsi8qT.
Roger, QR Code on the World's Largest HDTV, Sep. 7, 2009, http://2d-code.co.uk/hdtv-qr-code/.
Fare Compare, The QR Code for Airport Check-In: How Does It Work?, Aug. 29, 2012, http://www.farecompare.com/travel-advice/the-qr-code-for-airport-check-in-how-does-it-work/#/.
Gordon Povey, Augmented Reality using VLC, Visible Light Communication is an ideal technology to enable Augmented Reality applications for indoor environments, Jul. 12, 2012, http://visiblelightcomm.com/augmented-reality-using-vlc/.
European examination report for corresponding EP patent application 15173029.8, dated Oct. 26, 2016.
First Office Action from corresponding CN patent application 201510406906.8, dated May 5, 2019.
English-language translation of First Office Action from corresponding CN patent application 201510406906.8, dated May 5, 2019.
English-language translation of CN patent publication 1867142, dated Nov. 22, 2006.
English-language translation of CN patent publication 102394926, dated Mar. 28, 2012.
English-language translation of CN patent publication 1102625219, dated Aug. 1, 2012.
English-language translation of CN patent publication 103024063, dated Apr. 3, 2013.
English-language translation of CN patent publication 103221963, dated Jul. 24, 2013.
English-language translation of CN patent publication 103430565, dated Dec. 4, 2013.
Related Publications (1)
Number Date Country
20160012639 A1 Jan 2016 US