1. Field of the Invention
The present invention relates generally to a touch-sensitive wireless device though which a user, in combination with an on screen display, may remotely control a programmable multimedia controller or other system.
2. Background Information
A now decades long expansion in the number and types of consumer electronic devices has generated pervasive use of radiofrequency (RF) and infrared (IR) remote controls. Originally developed for television, remote controls now accompany essentially every CD player, DVD player, audio receiver, TV, home theatre, camcorder and portable radio. To simply play a DVD and watch a movie on a TV, it may be necessary to operate three different remote controls in order to turn on and properly set the TV, DVD player and home theatre system for the performance.
One conventional approach to eliminating or reducing the number of physical remote controls is the so-called universal remote control. In general, a universal remote control works by “learning” the RF or IR signals to which various devices respond. Once the signals are learned and retained in memory, the universal remote control may control multiple devices.
Universal remote controls, however, present certain disadvantages beginning with a dizzying array of physical buttons, perhaps dozens, which are often marked with arcane, difficult to read labels. Due to the number of buttons, they are often so small they are difficult and annoying to use. Further, the physical layout of the buttons does not conform to any industry standard nor to an arrangement that most users find intuitive or even familiar. In addition, because of the small button size and counterintuitive layout, most users cannot operate a universal remote control by touch in a “heads up” manner but must instead frequently look down at the buttons to ensure the correct one is pressed. This represents a recurring, frustrating distraction for many users. Lastly, a conventional universal remote control has no capability to change its functionality based on different users' preferences, handicaps or other factors.
In brief summary, one aspect of the invention enables a touch-sensitive wireless device, such as a wireless telephone or wireless multimedia player, in conjunction with an interactive on screen display, to effectively remotely control a programmable multimedia controller or other system. User gestures, button presses or other touches to or movements of the touch-sensitive wireless device cause information to be wirelessly communicated to the programmable multimedia controller. Once received by the programmable multimedia controller, such information is effectively converted or translated into one or more commands or messages which are understandable by the controller's operating software.
Based upon programmable services supported by the programmable multimedia controller, a given command or message may cause changes to the interactive on screen display such as causing icons to rotate in one direction or another. Alternatively, a given command or message may cause changes in the operational state of the programmable multimedia controller such as powering the controller up or down. Similarly, a given command or message may cause changes with respect to a programmable services supported by the controller such as a DVD to begin playing.
Through a graphical programming environment, the function or functions associated with each icon or button in the interactive on screen display may be easily assigned or modified. An assigned function may be dynamically changed to provide appropriate functionality for the particular programmable service that a user has selected. Similarly, an assigned function may be dynamically changed in response to a menu level or state to which a user has navigated within a particular on screen display or programmable service.
The invention provides numerous advantages. First, a single wireless device, such as a touch-sensitive wireless telephone or touch-sensitive wireless multimedia player, may be used to remotely control a complex system which includes a large number of audio, video or other components.
Second, touch-sensitive wireless devices such as telephones or multimedia players are small and light and users are comfortable carrying them on an everyday basis. To the extent that the touch-sensitive wireless device is one that a user is inclined to carry anyway, the invention enables a user to leverage his or her investment and obtain significant additional functionality from that device.
Third, the user enjoys great convenience by avoiding the use of multiple remote control devices which are frequently lost or misplaced. A user need only keep track of a single wireless device. Further, through functionality provided by the programmable multimedia controller, the user's wireless device becomes aware of a plurality of on screen displays which may be present in different rooms of a house or zones of a system.
The invention may be better understood by referring to the following description in conjunction with the accompanying drawings in which like reference numerals indicate identical or functionally similar elements:
In the illustrative embodiment, the programmable multimedia controller 100 is connected to a wide range of audio/video components, for example, a compact disk (CD) player 105, a digital versatile disc (DVD) player 110, an audio/video receiver 115, a television 120, a personal media player 125, speakers 122, a microphone 123, and/or a video camera 124. The programmable multimedia controller may also be connected to telephony devices such as a telephone network 130 and telephone handsets 132. The telephone network 130 may be a publicly switched telephone network (PSTN), a private network or other network.
In addition, the programmable multimedia controller may intercommunicate with variety of light and/or home automation systems 135. These devices may operate via the X10 protocol developed by Pico Electronics, the INSTEON™ protocol developed by SmartHome, Inc, the CEBus standard managed by the CEBus Industry Council, or another well known home automation or control protocol. Similarly the controller may be connected to motor and/or relay operated devices 137 that may include, for example, a heating, ventilation and air conditioning system (HVAC) system, an irrigation system, an automatic shade or blind system, an electronic door lock, or other types of devices.
A computer network, such as the Internet 140, is connected to the multimedia controller. In addition, a personal computer (PC) 145, video game systems 150, home recording equipment 165 or other devices may also be connected.
In addition to providing interconnection to a wide variety of devices, the programmable multimedia controller is able to combine, synthesize, and otherwise processes various data types to implement an integrated multimedia solution for a user. In a preferred embodiment, the programmable multimedia controller 100 includes a general purpose computer such as a MacPro sold by Apple Inc. Further details regarding the internal architecture of programmable multimedia controller 100 are set forth in the co-pending application entitled SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER referenced above.
To facilitate the above described interconnections and processing, the programmable multimedia controller 100 may be arranged in a modular manner. For example, in one embodiment, the programmable multimedia controller 100 is arranged to have twelve separate input and output modules, each having a number of connection ports. The input and output modules are inserted into slots or module bays of the programmable multimedia controller 100. The modules interface with a mid-plane that provides connection to the rest of the system. By embracing a modular approach, a user is allowed to select the specific modules desired, and the system may be customized to fit a particular application. In addition, entry level pricing may be reduced by allowing a user to purchase a base configuration, with limited capabilities, and then add to the system by purchasing addition modules. It is expressly contemplated that a wide variety of additional modules may be provided, and, accordingly, this disclosure should be interpreted to embrace such other possible configurations. It is also contemplated that several programmable multimedia controllers may be interconnected to create a larger system, in effect implementing a modular-type solution at the controller level.
In order to establish wireless communications with programmable multimedia controller 100, touch-sensitive wireless devices 210 and 220 may utilize a service discovery protocol such as Bonjour by Apple Inc. Other wireless communication protocols may also be used. As shown in
Once wireless device 300 is registered, subsequently, a user may make a gesture, press a button, touch or simply move wireless device 300. As a result, a command indication 314 is issued to user interface server 330. User interface server 330 recognizes command indication 314 as a control command or request and responds by issuing a send command message 316 to service controller 332 which reacts according to the functionality previously programmed into programmable multimedia controller 100. Details regarding the services and functionality which may be programmed into controller 100 are set forth in the co-pending application entitled PROGRAMMABLE MULTIMEDIA CONTROLLER WITH PROGRAMMABLE SERVICES referenced above.
In the case of an interactive command 318 which requires data from user interface server 330, a command request 320 is issued by device 300 to user interface server 330. User interface server 330 replies with a command confirmation 322 which returns the requested data to wireless device 300.
In the case of an unsolicited interactive command 324 (e.g., a user loads a DVD into a DVD player or disconnects a component), user interface server 330 may issue a command indication 326 to inform wireless device 300 of the event.
A row of special graphical buttons is arranged along the bottom edge of screen-shot 400. An OSD button 402, when pressed by a user, causes an interactive on screen display to appear on television 120. Similarly, cable button 404, keypad button 406, DVD button 408 and favorites button 410 allow a user fast, direct access to several of the most frequently used functions (e.g., controlling a cable TV converter box).
At step 500, information is received, via WiFi router 200, from one of wireless devices 210 or 220. At step 502, a determination is made whether the received information signifies that a user pressed a button on wireless device 210 or 220. If so, the process advances to step 510, which is discussed below. If not, the process advances to step 504 where a determination is made whether the received information signifies that a user made a gesture (e.g., finger swipe) on wireless device 210 or 220. If so, the process advances to step 510 and, if not, the process advances to step 506.
At step 506, a determination is made whether the received information signifies that an accelerometer located within wireless device 210 or 220 has generated an output signifying movement of the wireless device. If so, the process advances to step 508 where the movement detected by the accelerometer is translated or mapped to a corresponding change or action with respect to an interactive on screen display. For example, a user holding wireless device 210 or 220 may press and hold center button 418 (
At step 510, information received from wireless devices 210 and 220, as well as translation or mapping information received from step 508, are processed by a virtual remote server. In general, the virtual remote server processes received information, corresponding to user action on wireless device 210 or 220, and determines what changes to the interactive on screen display (
In accordance with a typical programmable service that may be provided by the system of
Icon 606, which has the appearance of a thermostat, will when selected cause the multimedia controller 100 to initiate an “HVAC” service through which room temperature may be controlled.
Icon 602, which has the appearance of a video game controller, will when selected cause the programmable multimedia controller 100 to initiate a video game service.
In a preferred embodiment, icons 602-606, as well as others that may be present, may be rotated in either of two directions in response to a user action. When a user wishes to select one of the icons 602-606, he or she simply rotates the icons until the desired one appears in the front and center position (e.g., icon 604) in on screen display 600. At that point, the user may select the icon by pressing, for example, center button 418 (
The foregoing description has been directed to particular embodiments of this invention. It will be apparent, however, that other variations and modifications may be made to the described embodiments, with the attainment of some or all of their advantages. Additionally, the procedures or processes may be implemented in hardware, software, embodied as a computer-readable medium having program instructions, firmware, or a combination thereof. Therefore, it is the object of the appended claims to cover all such variations and modifications as come within the true spirit and scope of the invention.
This application is a U.S. National Phase application of international application PCT No. PCT/US2009/005001, of David McKinley, et al., filed on Sep. 4, 2009, entitled TOUCH SENSITIVE WIRELESS DEVICE AND ON SCREEN DISPLAY FOR REMOTELY CONTROLLING A SYSTEM, which claims priority from U.S. Provisional Patent Application No. 61/094,099, of David McKinley et al., filed on Sep. 4, 2008, entitled TOUCH-SENSITIVE WIRELESS DEVICE AND ON SCREEN DISPLAY FOR REMOTELY CONTROLLING A SYSTEM, both of which are incorporated herein by reference. This application is related to the following copending United States patent applications: SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER, filed Dec. 20, 2005 and assigned Ser. No. 11/314,664, PROGRAMMABLE MULTIMEDIA CONTROLLER WITH PROGRAMMABLE SERVICES, filed Dec. 20, 2005 and assigned Ser. No. 11/314,112, PROGRAMMING ENVIRONMENT AND METADATA MANAGEMENT FOR PROGRAMMABLE MULTIMEDIA CONTROLLER, filed Sep. 13, 2006 and assigned Ser. No. 11/520,215, and PROGRAMMABLE ON SCREEN DISPLAY AND REMOTE CONTROL, filed Mar. 16, 2007 and assigned Ser. No. 11/687,458, all of which are assigned to a common assignee and all of which are expressly incorporated herein by reference.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US09/05001 | 9/4/2009 | WO | 00 | 9/9/2010 |
Number | Date | Country | |
---|---|---|---|
61095099 | Sep 2008 | US |