1. Field of the Invention
The invention is directed to an automation convergence system having scripted control of devices, and more particularly to a user control interface allowing generation of scripts for scripted control of devices in an automation convergence system.
2. Related Art
Household, academic facility and/or business spaces now more commonly have more than one audio or video device such as CD/DVD player, portable MP3 player, tuner, preamp, power amp, speakers, VCR, DVR, computers running media players or connected to some other source of audio or video (e.g., Internet radio, satellite radio and the like), etc. Typically, a CD/DVD player from one company comes with its own remote control and an amplifier by an entirely different company comes with its own remote control. The same space may have a PC with its keyboard and mouse, and yet another company's portable MP3 player with its own control switches. While each audio device is doing precisely what it was designed to do, each operates completely independent from the others with the possible exception of the portable MP3 player that may be connected to a PC for synchronization. As a result, a user ends up going from one keypad to another or juggling a series of remote controls in order to control the devices.
Since these audio/video and similar devices are not designed to communicate with each other or their communication is very limited, access to these audio/video devices is limited by their physical locations. For example, it is difficult to play an MP3 file saved in a PC hard disk drive in one room or area (a child's bedroom) on speakers located in another room or area (an entertainment room). Thus, in order for a user to enjoy music of his or her choice whenever and wherever he or she wants, each room needs to be equipped with all the necessary audio/video equipment and digital audio/video content.
Also, the audio/video devices are not designed to communicate with other home devices (e.g., TV, lighting, security system, etc.). Thus, it is difficult, if not impossible, to converge the devices for common control for certain occasions. For example, in order to watch a movie, the user must turn on a TV, a DVD player and an audio amplifier by using three different remote controls. Then the user must set the TV to receive a video signal from the DVD player, set the audio amplifier to receive an audio signal from the DVD player and use another control unit to adjust the lighting of the room. Even when a user utilizes universal remote, as is known in the art, the result is a plurality of devices that are separately operated and are operated separately from a single universal remote for each and every action that the device must execute. These devices do not converge as described above. Moreover, the devices lack any ability to operate in a controlled manner to execute multiple actions in response to a single user request.
Accordingly, there is a need for a solution for the aforementioned accessibility, connectability, controllability and convergence issues for controlled multiple action operation of devices.
In one aspect of the invention, a process of operating an automation system including an internet protocol based network includes receiving a user input to a client having a user interface implemented with Web Service for Devices (WSD) to initiate a series of scripted automation commands, executing the scripted automation commands by communicating the commands to at least one device implemented with WSD, and performing, with the at least one device, the scripted automation commands.
The at least one client may include at least one of a personal computer, a television, a personal digital assistant, and a controller. The at least one device may include at least one of an audio system, a video system, an intercom system, a lighting system, a security system, and a HVAC system.
According to another aspect of the invention, an automation system including an internet protocol based network includes a client having a user interface configured to receive a user input to initiate a series of scripted automation commands, at least one device to perform the scripted automation commands, and an internet protocol network to communicate the scripted automation commands to the at least one device.
The at least one client may include at least one of a personal computer, a television, a personal digital assistant, and a controller. The at least one device may include at least one of an audio system, a video system, an intercom system, a lighting system, a security system, and a HVAC system.
In yet another aspect of the invention, a machine-readable medium including instructions, which, when executed by a processor cause the processor to operate an automation system, includes instructions for receiving a user input to a client having a user interface implemented with WSD to initiate a series of scripted automation commands, instructions for executing the scripted automation commands by communicating the commands to at least one device implemented with WSD, and instructions for performing, with the at least one device, the scripted automation commands.
The at least one client may include at least one of a personal computer, a television, a personal digital assistant, and a controller. The at least one device may include at least one of an audio system, a video system, an intercom system, a lighting system, a security system, and a HVAC system.
Additional features, advantages, and embodiments of the invention may be set forth or apparent from consideration of the following detailed description, drawings, and claims. Moreover, it is to be understood that both the foregoing summary of the invention and the following detailed description are exemplary and intended to provide further explanation without limiting the scope of the invention as claimed.
The accompanying drawings, which are included to provide a further understanding of the invention, are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the detailed description serve to explain the principles of the invention. No attempt is made to show structural details of the invention in more detail than may be necessary for a fundamental understanding of the invention and the various ways in which it may be practiced. In the drawings:
The embodiments of the invention and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments and examples that are described and/or illustrated in the accompanying drawings and detailed in the following description. It should be noted that the features illustrated in the drawings are not necessarily drawn to scale, and features of one embodiment may be employed with other embodiments as the skilled artisan would recognize, even if not explicitly stated herein. Descriptions of well-known components and processing techniques may be omitted so as to not unnecessarily obscure the embodiments of the invention. The examples used herein are intended merely to facilitate an understanding of ways in which the invention may be practiced and to further enable those of skill in the art to practice the embodiments of the invention. Accordingly, the examples and embodiments herein should not be construed as limiting the scope of the invention, which is defined solely by the appended claims and applicable law. Moreover, it is noted that like reference numerals represent similar parts throughout the several views of the drawings.
The software (i.e. application) enables the hardware devices 120 and/or clients 110 to communicate with each other despite their different proprietary languages and communication protocols, and may provide the user with control over most or all the hardware from a single client. The application may utilize at least one portion of the hardware to send commands to the devices 120 and receive feedback from them. The application integrates centralized device control into a PC based media environment (e.g., Microsoft Windows XP Media Center™ or Microsoft Windows Vista™ environment or any equipment or future counterpart) that may store, organize and play digital media content. The user may use the remote control 115 or the portable device 106 to listen to music, watch and record television, enjoy family photographs and home movies, as well as adjust the lighting, secure the home, adjust the temperature, distribute music throughout the house, check surveillance cameras and the like. Moreover, the portable device 106 has further communication features as noted below.
The application maximizes flexibility and scalability with an elegant n-tiered, service oriented architecture that allows loosely coupled components to easily interact with each other across the network. In particular the application may be created using Microsoft™ .NET framework and coded primarily in C#. The application accordingly embraces the tremendous benefits of web services for the control of the devices. The Web Services use standard Internet protocol (IP) and are based on standard XML-related technologies such as SOAP (Simple Object Access Protocol) for communications and WSDL (Web Services Device Language) to describe interfaces. The devices implemented with Web Service for Device (WSD) become black boxes on the network, providing services to any application, on any platform, written in any language. Moreover, the use of WSD allows for the capabilities of Universal Plug and Play (UPnP) that seamlessly connects and simplifies implementation as is known in the art.
The invention may include a user interface for configuring CAS to maximize its convergence and automation capabilities to provide serial command to the various devices 120 shown in
The invention further allows for the generation of various scripts for command and control of devices 120 in response to a user operating or executing a script in one of the clients 110. The scripts may be generated a number of different ways, the invention as described in greater detail below shows a first way of generating scripts in conjunction with FIGS. 3 to 8 through various graphical user interfaces and a script engine. The invention also discloses a manner in which to generate script commands through the use of inputting various hand-coded script commands using known computer languages as shown in
In particular
In accordance with the invention, creating a script involves creating commands for the various devices to operate. These commands may be a combination of an action and any action properties that must be included with the action. Accordingly, the commands may be generated from the various clients 110 and/or the server 100 shown in
Once a user decides to add a script by selection of button 202 in the script setup graphical user interface 200, the script setup graphical user interface 200 may be replaced by a script command graphical user interface which is described in more detail below. Of course it should be noted that the various features shown in the script setup graphical user interface 200 may be arranged in a different manner and may include more or less features.
In response to the user selecting the add command button 304 shown in the script command graphical user interface 300, the display of client 110 may show the user a list of components for which the user may select in order to generate a command for (not shown). Thereafter the user may select one of the components from the listing of components and the client 110 may render an action setup graphical user interface 400 as described below.
For example as shown in the first row of Table 1, in order to turn on a dimmer light to a particular percentage, the action may be to set the load level of electricity going to the light and the action property may be a percentage from 0 to 100 percent. Further tasks, actions, and action properties are noted in Table 1. However, it should be noted that other types of tasks, actions, and action properties are within the scope of the invention and contemplated herewith.
Accordingly, as noted above a single command has been generated for a script to be operated in response to a script command. This process may be repeated a number of times in order to string a series of commands together. For example as shown in
The script engine 600 may be implemented such that a client or scheduler 602 may allow a user to enact the script as was noted above or in some other known manner. Thereafter, a script engine 604 may then look up various script templates (XML) and script configurations (text files) from a database 606 or the like. Thereafter the script engine 604 may send them to a compiler 608. The compiler 608 may then, on the fly, compile and create a script object 610 which may be a .NET object. This script object 610 may be created using C# or a VB.NET compilation. Once the script object 610 has been created, the script engine 604 may then execute the script object in order to create the script actions.
The menu bar 912 may provide menus for the control panel 910, such as “File” (i.e., save, save all, and/or exit functions and/or the like). “Edit” (i.e. new configuration, new component, new device, new schedule, new script and/or delete functions and/or the like), “View” (i.e., servers function and/or the like), “help” (i.e. about function and/or the like). The navigation pane 914 may contain configurations, devices, schedules and/or scripts and/or the like in a tree view. As well known, if a navigation item has a plus (+) sign next to it, the user may click the item to view additional sub items. If a navigation item has a minus (−) sign next to it, the user may click the item to hide the additional sub items.
The functional area pane 916 may contain several buttons for “Configuration,” “Devices,” “Scheduling,” “Scripting,” “Triggers,” “Templates,” and/or the like. The “Configuration” button allows the user to add and edit configurations on servers. The “Devices” button allows the user to view original manufacturer information, test devices, and control devices. The “Scheduling” button allows the user to set up schedules to run scripts. The “Scripting” button which allows the user to create and edit scripts for running components and devices. The “Triggers” button allows the user to identify a specific device status and condition as a trigger to automatically execute a script when it occurs. The “Templates” button allows the user to add control for certain non-certified devices (CD players, DVD players, audio receivers, displays, and so on).
The control panel 910 shown in
Accordingly the scripts generated with respect to the control panel in
Accordingly, the invention as described above includes the implantation of the strings of commands known as scripts to be used in an automation system as set forth in
The methodologies described herein may be implemented by various means depending upon the application. For example, these methodologies may be implemented in hardware, firmware, software, or a combination thereof. For a hardware implementation, the processing units may be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, or a combination thereof.
For a firmware and/or software implementation, the methodologies may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. Any machine readable medium tangibly embodying instuctions may be used in implementing the methodologies described herein. For example, software codes may be stored in a memory, for example the memory of client or device, and executed by a processor, for example a general-purpose processor. Memory may be implemented within the processor or external to the processor. As used herein the term “memory” refers to any type of long term, short term, volatile, nonvolatile, or other memory and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored.
While the invention has been described in terms of exemplary embodiments, those skilled in the art will recognize that the invention can be practiced with modifications in the spirit and scope of the appended claims. These examples given above are merely illustrative and are not meant to be an exhaustive list of possible designs, embodiments, applications or modifications of the invention.
This application claims priority to and the benefit of: Provisional Patent Application No. 60/782,734 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING A CONFIGURATION TOOL AND TWO-WAY ETHERNET COMMUNICATION FOR WEB SERVICE MESSAGING, DISCOVERY, DESCRIPTIONS, AND EVENTING THAT IS CONTROLLABLE WITH A TOUCH-SCREEN DISPLAY, to Seale MOORER et al; Provisional Patent Application No. 60/782,596 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING DIGITAL MEDIA STREAMING, to Seale MOORER et al.; Provisional Patent Application No. 60/782,598 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING DIGITAL LOGGING, to Seale MOORER et al.; Provisional Patent Application No. 60/782,635 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING A CONTROL PANEL, to Seale MOORER et al.; Provisional Patent Application No. 60/782,599 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING A CONFIGURATION TOOL, to Seale MOORER et al.; Provisional Patent Application No. 60/782,600 filed on Mar. 16, 2006, entitled AUTOMATION CONTROL SYSTEM HAVING DEVICE SCRIPTING, to Seale MOORER et al.; Provisional Patent Application No. 60/782,634 filed on Mar. 16, 2006, entitled DEVICE AUTOMATION USING NETWORKED DEVICE CONTROL HAVING A WEB SERVICES FOR DEVICE STACK, to Seale MOORER et al.; Provisional Patent Application No. 60/782,595 filed on Mar. 16, 2006, entitled WIRELESS DIGITAL AMPLIFIER CONFIGURED FOR WALL MOUNTING, SHELF MOUNTING, AND THE LIKE, to Seale MOORER et al.; Provisional Patent Application No. 60/785,275 filed on Mar. 24, 2006, entitled AUTOMATION SYSTEM, to Seale MOORER et al.; Provisional Patent Application No. 60/793,257 filed on Apr. 20, 2006, entitled TOUCH SCREEN FOR USE WITH AUTOMATION SYSTEMS, to Seale MOORER et al.; Provisional Patent application No. 60/747,726 filed on May 19, 2006, entitled COOLING DEVICE FOR A TOUCH SCREEN AND THE LIKE, to Seale MOORER et al.; Provisional Patent Application No. 60/746,287 filed on May 3, 2006, entitled HOME AUTOMATION SYSTEM AND THE LIKE, to Seale MOORER et al.; Provisional Patent Application No. 60/786,119 filed on Mar. 27, 2006, entitled HOME AUTOMATION PROGRAM CODE FOR SET TOP BOX OR SIMILAR CIRCUIT, to Steve CASHMAN; and Provisional Patent Application No. 60/857,774 filed Nov. 9, 2006, entitled PORTABLE MULTI-FUNCTIONAL MEDIA DEVICE, to Seale MOORER et al., all of which are hereby expressly incorporated by reference for all purposes as if fully set forth herein. Further, this application is related to the following U.S. Patent Applications: U.S. patent application No. ______ (to be assigned), entitled NETWORK BASED DIGITAL ACCESS POINT DEVICE, filed Mar. 14, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5013US; U.S. patent application No. ______ (to be assigned), entitled INTERNET PROTOCOL BASED MEDIA STREAMING SOLUTION, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5014US; U.S. patent application No. ______ (to be assigned), entitled AUTOMATION CONTROL SYSTEM HAVING A CONFIGURATION TOOL AND TWO-WAY ETHERNET COMMUNICATION FOR WEB SERVICE MESSAGING, DISCOVERY, DESCRIPTION, AND EVENTING THAT IS CONTROLLABLE WITH A TOUCH-SCREEN DISPLAY, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5017US; U.S. patent application No. ______ (to be assigned), entitled AUTOMATION CONTROL SYSTEM HAVING DIGITAL LOGGING, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5018US; U.S. patent application No. ______ (to be assigned), entitled USER CONTROL INTERFACE FOR CONVERGENCE AND AUTOMATION SYSTEM, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5019US; U.S. patent application No. ______ (to be assigned), entitled DEVICE AUTOMATION USING NETWORKED DEVICE CONTROL HAVING A WEB SERVICES FOR DEVICES STACK, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5020US; and U.S. patent application No. ______ (to be assigned), entitled AUTOMATION CONTROL SYSTEM HAVING A CONFIGURATION TOOL, filed Mar. 15, 2007, to Seale Moorer, et al., having Attorney Docket No.: 2047672-5022US; which are all hereby expressly incorporated by reference for all purposes as if fully set forth herein.
Number | Date | Country | |
---|---|---|---|
60782734 | Mar 2006 | US | |
60782598 | Mar 2006 | US | |
60782635 | Mar 2006 | US | |
60782596 | Mar 2006 | US | |
60782599 | Mar 2006 | US | |
60782600 | Mar 2006 | US | |
60782634 | Mar 2006 | US | |
60782595 | Mar 2006 | US | |
60785275 | Mar 2006 | US | |
60793257 | Apr 2006 | US | |
60747726 | May 2006 | US | |
60746287 | May 2006 | US | |
60786119 | Mar 2006 | US | |
60857774 | Nov 2006 | US |