Subscription television service providers, such as cable, satellite and fiber optic providers, use a network within a customer's premises (e.g., a home media network) to deliver content and services to a variety of customer equipment (e.g., multiple televisions, digital video recorders, computers, etc.) within the customer's premises. For example, a television service provider may provide television services to multiple televisions, and Internet services to multiple computers within the customer's premises.
The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. Also, the following detailed description does not limit the invention.
Implementations described herein may permit a subscription television service provider to offer intercom and/or chat functionality within a home media network. Intercom and/or chat features may be integrated within media clients (e.g., set-top boxes) in the home media network to facilitate intercom and/or chat features on display devices (e.g., televisions) associated with the media clients.
As used herein, the term “intercom message” may refer to a communication, from an originating media client to a recipient media client, that may include audio, video and/or text.
Display device 210 may include any digital or analog display that is capable of presenting audio and/or video content provided by a media client 220 connected to display device 210. Display device 210 may include technologies, such as cathode ray tube (CRT) displays, liquid crystal displays (LCDs), light-emitting diode (LED) displays, plasma displays, etc. In one implementation, display device 210 may be a television.
Media client 220 may include any device capable of receiving, transmitting and/or processing information to and/or from another media client 220 within customer premises network 280. Media client 220 may also receive, transmit and/or process information to and/or from provider network 270. Media client 220 may provide video and/or audio signals to display device 210, and may include decoding and/or decryption capabilities. Media client 220 may also include a digital video recorder (DVR) (e.g., a hard drive). In some implementations, media client 220 may include a set-top box, a computer device, or a portable device (e.g., a mobile telephone or a personal digital assistant (PDA)). Media client 220 may be capable of providing interactive content (e.g., interactive menus, etc.) to a user via display device 210 that may be activated, for example, via a remote control (e.g., remote control 240). In one implementation, media client 220 may include a USB port or another interface that allows for the connection of peripheral devices, such as HID 230. Media client 220 may be capable of receiving input from a user via peripheral devices and transmitting the input to another media client using, for example, Internet Protocol (IP) formats.
HID 230 may include a device for receiving auditory, visual or text information from a user. HID 230 may include, for example, a microphone to receive audio signals and output electrical signals, a video camera to capture images, and/or a keyboard to input text. In one implementation, HID 230 may be a portable device. For example, HID 230 may include a handheld microphone, a remote control device having a microphone, or a headset or a clip-on microphone. HID 230 may connect to media client 230 in a wired or wireless manner. In one implementation, HID 230 may connect using a Bluetooth adaptor that may be physically connected to media client 230 (e.g., via a USB port). In still another implementation, HID 230 may include an adaptor for a cordless telephone, such as a digital enhanced cordless telecommunications (DECT) adaptor.
Remote control 240 may include a device that allows a user to control programming, applications, and/or content displayed on one or more of display devices 210 via interaction with media client 220. Remote control 240 may transmit signals, such as, for example, infrared signals, to a signal receiver associated with media client 220. In one implementation, remote control 240 may include programmable keys that may be programmed to launch particular applications, such as a media client intercom application. Any function, described herein, as being performed by remote control 240, may be performed directly on media client 220 using, for example, one or more buttons on media client 220.
Backend server 250 may include one or more server devices, or other types of computation or communication devices, that gather, process, search, and/or provide information in a manner described herein. In one implementation, backend server 250 may provide applications (e.g., software) and/or data to media clients 220 to support a media client intercom. In another implementation, backend server 250 may provide data storage and/or processing to facilitate media client intercom features. For example, backend server 250 may receive intercom messages from an originating media client 220, provide additional processing (e.g., speech-to-text conversion, re-formatting, etc.) and/or temporary storage, and send the intercom message to a recipient media client 220. In another implementation, backend server 250 may provide conversion and forwarding functions to allow legacy systems (e.g., media clients that do not support IP communications and/or communications via a home media network) to receive intercom messages.
Gateway 260 may include a network device that provides an interface from provider network 270 to media client 220 and/or other network connectivity devices (not shown). Gateway 260 may include one of a number of possible gateway devices, including a satellite antenna and receiver, a coaxial cable connection, an optical network terminal (ONT), or a broadband access for Internet Protocol TV (IPTV). For example, when telecommunication services are provided to the customer's premises via an optical fiber, gateway 260 may include an ONT that connects to the optical fiber. The ONT may convert between signals appropriate for display devices 210 and signals appropriate for transmission over optical fiber. The ONT may include a coaxial cable connection that leads to media clients 220. The ONT may also include an Ethernet output port that connects to a personal computer or a VoIP telephone and/or a standard telephone port for connecting to a standard telephone.
Provider network 270 may include a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a telephone network, such as the Public Switched Telephone Network (PSTN), an intranet, the Internet, an optical fiber (or fiber optic)-based network, or a combination of networks. Although shown as a single element in
Customer premises network 280 may include display devices 210, media clients 220, HID 230, remote control 240, and local gateway 260. Customer premises network 280 may also include additional devices (not shown), such as local routers, personal computers, telephones, etc. Devices within customer premises network 280 may be connected via wired connections (e.g., coaxial cable or Ethernet connections) or wireless connections (e.g., using network devices such as those available under the IEEE 802.11 wireless LAN standards). In one implementation, customer premises network 280 may conform to guidelines from the Multimedia of Coax Alliance (MoCA). Customer premises network 280 may also be referred to herein as a home media network.
In an implementation described herein, a user may activate an intercom feature of media client 220 using, for example, remote control 240 and an interactive menu shown on display device 210-1. User input into HID 230 may be received by media client 220-1 and be directed as digital signals to media client 220-2 via customer premises network 280. Media client 220-2 may receive the digital signals and present the user input as an audio component via display device 210-2. Additionally, or alternatively, media client 220-2 may provide a visual component associated with the user input, such as an overlay to be displayed on display device 210-2. The visual component may include, for example, general information (e.g., “Intercom call from Basement TV,” “Intercom in use”, etc.) or a speech-to-text transcription.
In some implementations, additional features of the media client intercom within customer premises network 280 may be supported by backend server 250. As described further herein, backend server 250 may receive intercom messages, via provider network 270, from originating media client 220-1, provide additional processing, and send the processed intercom message to a recipient media client 220-2.
Processor 320 may include a processor, microprocessor, or a type of processing logic (e.g., an application-specific integrated circuit (ASIC) or field-programmable gate array (FPGA)) that may interpret and execute instructions. Main memory 330 may include a random access memory (RAM) or another type of dynamic storage device that may store information and instructions for execution by processor 320. ROM 340 may include a ROM device or another type of static storage device that may store static information and/or instructions for use by processor 320. Storage device 350 may include a magnetic and/or optical recording medium and its corresponding drive, or a type of flash memory. In one implementation (e.g., where device 300 corresponds to media client 220), storage device 350 may include a digital video recorder DVR.
Input device 360 may include a mechanism that permits an operator to input information to device 300, such as a keyboard, a mouse, a pen, a microphone, a button, voice recognition and/or biometric mechanisms, remote control 240, etc. Output device 370 may include a mechanism that outputs information to the operator, including a display, a speaker, a light-emitting diode (LED), etc. Communication interface 380 may include any transceiver-like mechanism that enables device 300 to communicate with other devices and/or systems. For example, communication interface 380 may include mechanisms for communicating with another device or system via a network, such as provider network 270 and/or customer premises network 280.
As described herein, device 300 may perform certain operations in response to processor 320 executing software instructions contained in a computer-readable medium, such as main memory 330. A computer-readable medium may be defined as a physical or logical memory device. A logical memory device may include memory space within a single physical memory device or spread across multiple physical memory devices. The software instructions may be read into main memory 330 from another computer-readable medium, such as storage device 350, or from another device via communication interface 380. The software instructions contained in main memory 330 may cause processor 320 to perform processes described herein. Alternatively, hardwired circuitry may be used in place of or in combination with software instructions to implement processes described herein. Thus, implementations described herein are not limited to any specific combination of hardware circuitry and software.
Although
User interface controller 400 may include hardware or a combination of hardware and software to generate and update a graphical user interface for a media client intercom. In one implementation, user interface controller 400 may assemble interface elements (e.g., interface elements 460) based on one or more templates. User interface controller 400 may detect user inputs and provide intercom functionality based on the user inputs. For example, user interface controller 400 may detect initiation of a media client intercom application (e.g., via selection of a dedicated key on remote control 240 or through a selection of menu items in a general media client user interface) and a subsequent selection (e.g., of menu items via remote control 240) to initiate an intercom message (e.g., a selection for voice, text, or video message). User interface controller 400 may also allow a user to store settings, delete settings, and/or modify settings from settings module 420.
Audio/video manager 410 may include hardware or a combination of hardware and software to convert physical events or phenomena to digital signals that pertain to media client 220, and vice versa. For example, audio/video manager 410 may receive speech or other audible input from a user via HID 230 (e.g., if HID 230 includes a microphone). The signals from the microphone may be digitized and packetized for transport over customer premises network 280. At other times, digitized/packetized signals may be received by audio/video manager 410 which may then be converted and/or inserted into a media stream for audible presentation by display device 210. Similarly, audio/video manager 410 may receive video input from the user via HID 230 (e.g., if HID 230 includes a video camera). The signals from the video camera may be digitized and packetized for transport over customer premises network 280. Video signals received by audio/video manager may be converted and/or inserted into a media stream for presentation by display device 210.
Settings module 420 may include hardware or a combination of hardware and software to solicit user input and/or store user preferences regarding media client intercom features. In one implementation, settings module 420 may include a database or another memory component to store user settings. Settings modules 420 may include, for example, settings for access controls (e.g., passwords, voice recognition, etc.), parental controls (e.g., to enable/disable one-way or two-way intercom), default volume, presentation types (e.g., audio only, audio with on-screen display, speech-to-text conversion), presentation formats (e.g., font sizes, automatic pause of other media, automatic mute of other media), and the like. In one implementation, settings module 420 may obtain setting from a single media client 220 and deliver settings to other media clients 220 within customer premises network 280. For example, in the configuration of
Speech/text convertor 430 may include hardware or a combination of hardware and software to convert audible speech input to text and/or text input to audible speech. For example, speech/text convertor 430 may transcribe speech-based audio received by HID 230 (e.g., a microphone or video camera) using automatic speech recognition technology. For example, speech from a user of media client 220 may be received by a microphone. Then, the data may be transferred, such as by way of bus 310, to speech/text convertor 430 (e.g., processor 320 of
Stored messaging manager 440 may include hardware or a combination of hardware and software to enable messages to be stored and presented at a selected time. For example, a user may select an option to record and store a message for presentation by the originating media client 220 and/or recipient media client(s) 220. Stored messaging manager 440 may store speech, video, or text from processed by audio/video manager 410 or converted speech/text from speech/text convertor 430. In one implementation, stored message manager 440 may temporarily store an intercom message at the originating media client 220 and transmit the stored message at a time set by the user. In another implementation, stored message manager 440 may attach presentation instructions to the intercom message (e.g., including a particular presentation time) and provide to a recipient media client 220 (e.g., stored messaging manager 440 on the recipient media client 220) for storage and eventual presentation. The stored message may be stored in a memory component (e.g., storage device 350). In another implementation, stored messaging manager 440 may store messages that are unable to be displayed (e.g., because display device 210 is powered off) until the message is able to be displayed (e.g., display device is powered up).
Device identifier 450 may include hardware or a combination of hardware and software to detect other media clients 220. For example, when a media client 220 is connected to customer premises network 280, the device identifier 450 may announce the capability to perform media client intercom functions. As another example, when an announcement is received from another media client 220, device identifier 450 may recognize that another media client 220 is functional on customer premises network 280. Device identifier 450 may then add the new media client to a list of available media clients on the intercom application interface. In one implementation, device identifier 450 may conform to the Digital Living Network Alliance (DLNA) guidelines. Device identifier may also enable media client 220 to support message delivery to a single recipient media client (e.g., unicast), selected multiple media clients (e.g., multicast), or all available media clients (e.g., broadcast).
Interface elements 460 may include templates, icons, menus and other graphical, audio, and/or text-based elements to facilitate user interaction with the media client intercom. In one implementation, interface elements 460 may include customizable features, such as pictures that may be associated with a particular user (e.g., based on an account log-in) or device (e.g., media client 220-1).
Power monitor 470 may include hardware or a combination of hardware and software to monitor availability of media clients 220 and/or display devices 210 used to support media client intercom features. For example, in one implementation power monitor 470 may activate media client 220 and/or display device 210 from a ‘standby’ mode upon receipt of an intercom message. In another implementation, power monitor 470 may cause media client 220 to present an indicator (e.g., a flashing light or a tone on media client 220) when an intercom message is available, but unable to be displayed.
Although
Application manager 500 may include hardware or a combination of hardware and software to provide intercom applications and upgrades to media clients 220. For example, application manager 500 may provide upgrades or additional components for intercom functionality to media clients 220. In one implementation, applications and/or upgrades may be provided to media client 220 in-band via provider network 270. In another implementation, applications and/or upgrades may be provided out-of-band.
Legacy convertor 510 may include hardware or a combination of hardware and software to reformat and distribute intercom messages for recipient legacy media clients. For example, legacy convertor 510 may receive an intercom message from an originating media client 220 that is intended for a media client that lacks IP capability. Legacy convertor 510 may reformat the intercom message (if necessary) and send the intercom message to the intended recipient legacy media client. In one implementation, intercom messages for recipient legacy media clients may be provided from backend server 250 in-band via provider network 270. In another implementation, intercom messages for recipient legacy media clients may be provided out-of-band.
Remote storage 520 may include hardware or a combination of hardware and software to supplement and/or substitute functions of stored messaging manager 440 described above. For example, when either an originating media client or a recipient media client lacks sufficient memory capacity, remote storage 520 may store intercom messages designated for presentation at a later time. In another implementation, remote storage 520 may also provide DVR-type storage for programming on a recipient media client that may be interrupted by an intercom message. For example, when a recipient media client 220 (e.g., without a local DVR capability) is configured to automatically pause current programming when an intercom message is received, remote storage 520 may automatically record subsequent program content (e.g., using DVR functionality) during the period of the intercom message and resume programming from that point when the intercom message is complete.
Although
Application stack 600 may include one or more applications that generates packets (or other data units) to be transmitted to customer premises network 280 and/or processes packets received from customer premises network 280. Application stack 600 may allow users to activate and provide user input for media client intercom functions. Middleware 610 may include software components to connect applications so that data can be exchanged.
DLNA stack 620 may include the component to support DNLA guidelines. For example, each of the devices in customer premises network 280 may provide a basic set of functionalities for controlling and/or interacting with one another, transporting multimedia content, and/or presenting the multimedia content. Current DNLA guidelines do not allow for media client intercom traffic as described herein, but may be modified to accommodate such traffic. DLNA stack 620 may be included in the platform code of media client 220 so that middleware 610 may be able to reference intercom communications (inbound or outbound) and pass appropriate trigger information to application stack 600.
IP stack 630 may include the Internet Protocol. When sending packets, IP stack 630 may determine how to get the packets to their destination. When receiving packets, IP stack 630 may determine where the packets belong. Firmware 640 may include hardware or a combination of hardware and software that includes general instructions regarding the processing of a display of multimedia content (including intercom communications).
Although
Process 700 may include receiving, at an originating media client, a signal from an originating user to initiate an intercom feature (block 710) and receiving a message input from the originating user via a human interface device (block 720). For example, an originating media client 220 may receive a user's signal (e.g., from remote control 240) to activate an intercom feature of media client 220.
Returning to
The converted message may be received at the one or more recipient media clients (block 750) and the converted message may be formatted for presentation on a display device (block 760). For example, a recipient media client 220 may receive the IP message from the originating media client 220. The signal may be converted (if necessary) into a format suitable for presentation on a display device 210 associated with the recipient media client 220. For example, recipient media client 220 may decompress a VoIP stream (e.g., an MPEG-4 stream) for presentation through speakers associated with display device 210. In one implementation, recipient media client 220 may also retrieve a display element (e.g., an overlay, banner, etc.) that may visually indicate information about the intercom message.
The formatted message may be sent to the display device for presentation to a recipient user (block 770). For example, recipient media client 220 may cause display device 210 to present audio and/or visual information to a user.
Still referring to
The illustrations of
Systems and/or methods described herein may present, on a display device associated with a media client, a menu interface for a media client intercom and may receive a signal from a user, via the menu interface, to initiate an intercom message. The media client may receive a message input from the user, where the message input is provided through a human interface device, and may convert the message input into a digital format to create a digitized message. The digitized message may be sent, exclusively via a home media network, to another media client within the home media network.
The foregoing description provides illustration and description, but is not intended to be exhaustive or to limit the implementations to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practice of systems and/or methods disclosed herein.
For example, while a series of blocks has been described with regard to
It will be apparent that aspects, as described herein, may be implemented in many different forms of software, firmware, and hardware in the implementations illustrated in the figures. The actual software code or specialized control hardware used to implement embodiments described herein is not limiting of the invention. Thus, the operation and behavior of the embodiments were described without reference to the specific software code—it being understood that software and control hardware may be designed to implement the embodiments based on the description herein.
Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of the invention. In fact, many of these features may be combined in ways not specifically recited in the claims and/or disclosed in the specification.
No element, act, or instruction used in the description of the present application should be construed as critical or essential to the invention unless explicitly described as such. Also, as used herein, the article “a” is intended to include one or more items. Where only one item is intended, the term “one” or similar language is used. Further, the phrase “based on,” as used herein is intended to mean “based, at least in part, on” unless explicitly stated otherwise.
Number | Name | Date | Kind |
---|---|---|---|
5818441 | Throckmorton et al. | Oct 1998 | A |
5990887 | Redpath et al. | Nov 1999 | A |
6434604 | Harada et al. | Aug 2002 | B1 |
6628302 | White et al. | Sep 2003 | B2 |
6754904 | Cooper et al. | Jun 2004 | B1 |
7036083 | Zenith | Apr 2006 | B1 |
7343561 | Stochosky et al. | Mar 2008 | B1 |
7761507 | Herf et al. | Jul 2010 | B2 |
7805487 | Isaacs et al. | Sep 2010 | B1 |
7873532 | Jones et al. | Jan 2011 | B2 |
8312500 | Emerson et al. | Nov 2012 | B2 |
20020174234 | Trovato et al. | Nov 2002 | A1 |
20030101450 | Davidsson et al. | May 2003 | A1 |
20040107439 | Hassell et al. | Jun 2004 | A1 |
20040117845 | Karaoguz et al. | Jun 2004 | A1 |
20050028208 | Ellis et al. | Feb 2005 | A1 |
20050262542 | DeWeese et al. | Nov 2005 | A1 |
20070162930 | Mickle et al. | Jul 2007 | A1 |
20080022322 | Grannan et al. | Jan 2008 | A1 |
20090113315 | Fisher et al. | Apr 2009 | A1 |
20090167839 | Ottmar | Jul 2009 | A1 |
20100146445 | Kraut | Jun 2010 | A1 |
20110107364 | Lajoie et al. | May 2011 | A1 |
Number | Date | Country |
---|---|---|
WO2004056119 | Jul 2004 | WO |
Number | Date | Country | |
---|---|---|---|
20110161839 A1 | Jun 2011 | US |