The present invention relates generally to home networks having multiple digital content storage, access and/or display elements, and in particular, relates to a centralized resource manager that utilizes a passive sensing mechanism to control, allocate and otherwise manage distributed network resources in such home networks.
The concept of linking multiple digital entertainment devices in a home network infrastructure has become widely accepted. It is now possible to interconnect a plurality of these devices—including televisions and video recording devices, audio recording and playback devices, personal computers, and telephony devices—in a network having sufficient bandwidth to distribute media content (e.g., movies, audio/stereo) and data throughout a home, as desired by the individual users, so that the resources of the devices may be shared. However, the sharing of these multiple devices in a home-based network presents new problems in allocating and managing the resources of the various devices in an efficient manner.
Members of the Home Audio Video Interactive (HAVi) alliance have developed a protocol for dealing with distributed devices across a bus architecture (typically IEEE 1394 or FireWire), using concepts of resource management and reservation. Under the HAVi protocol, certain devices will allow partial or total reservation of their resources. These devices include their own local resource manager component. A device wishing to reserve resources will communicate with the local resource manager associated with that device. If another device has reserved these resources, the device requesting these resources may negotiate with the resource holder by communicating messages through the local resource manager of the device in question.
However, the HAVi methodology is limited in several ways. First, the device wishing to establish a complete media pipeline/session is responsible for establishing the reservations with each of the components. This is inefficient, and can possibly result in deadlock timing situations from competing reservation requests. Second, only devices on the network providing local resource managers may be reserved. There is no proxy device for reserving the resources of “dumb” devices (i.e., devices having no local resource manager associated therewith) on the network. Third, the distributed nature results in added complexity for each device that must support a local resource manager.
UPnP and Jini are similar resource discovery and control tools. Both of these lack any robust resource management tools. They are also implemented in a manner similar to HAVi, in that all devices are responsible for supporting the protocol, and support distributed, not centralized, interaction.
In addition, Tivo, ReplayTV, and others have developed personal video recording (PVR) products, which allow a user to digitally store television programs and other media content for later viewing. Each of these products supports the reservation of a tuner to support a scheduled recording of television shows. However, neither supports distributed networks or distributed resource management.
Accordingly, there exists a need for devices and systems that support distributed networks and centralized management of distributed network resources
The present invention overcomes the disadvantages of prior art systems, by providing a centralized resource manager, rather than relying on a plurality of local resource managers. The invention requires only one device to act as a centralized resource manager, enables the centralized resource manager to assign network resources in the most efficient manner, and provides proxy reservations where necessary for devices on the distributed network that do not include a local resource manager.
The centralized resource manager of the invention can be linked with a media server and each client device in the distributed network. The centralized resource manager identifies, assigns, and reserves available network resources in response to user requests for processing media content so that the functionality of the distributed network is centralized, in a manner which most efficiently uses the resources of the distributed network. Managed resources can include, among others, network bandwidth, CPU allocation, TV tuners, MPEG encoders and decoders, disk bandwidth, applications, and input/output devices.
In a home-networking environment, a centralized resource manager allocates network resources in the following manner. In one embodiment, requests are made to the centralized resource manager by agent processes in response to requests received from a user for viewing or recording television programming material, or from agent processes acting on behalf of the user, such as an agent process using user profile or history information to predict that a user that has watched, for example, several James Bond titles in the past would likely wish to record “Thunderball” and automatically schedule that recording on the user's behalf When a request is received from a user or agent process for viewing or recording television programming material, which may include viewing or recording television programming material available at a scheduled future time and channel, the centralized resource manager implements a reservation protocol (e.g., least-cost algorithm) to define a pipeline or session, using the available network resources embodied in the media server and client devices, to fulfill the user's request. The centralized resource manager identifies available network resources that match the requirements imposed by the user request using a scheduling algorithm to determine the availability of such network resources when the program will be viewed or recorded.
Once an audio-video pipeline has been defined from the available network resources, these network resources are assigned and reserved for the appropriate time, and a reservation identifier is returned to the scheduling application. The reservation is stored in a reservation table for use by the centralized resource manager in connection with any future user requests. The reservation identifier may include identification of the specific resources assigned, which would allow the requesting application to communicate with, configure, and control the assigned resources.
In another aspect of the invention, the audio-video pipeline can be constructed using a least cost algorithm to minimize the use of network bandwidth. In a further aspect of the present invention, in response to the user scheduling an event, the centralized resource manager checks to see if a disk storage device in the network has sufficient disk space to record the media program. If the disk space is insufficient, the centralized resource manager searches for any files that may be deleted. The user may be alerted by displaying a message on the television screen or alerted when there are insufficient network resources to process the user's current request.
In another aspect of the invention, the centralized resource manager can include an interface to a service provider that allows the service provider to reserve resources in response to the service provider scheduling an event. In a further aspect of the invention, the centralized resource manager communicates with a service provider Network Operation Center over a WAN interface when the service provider wishes to reserve resources for events such as pushing of special content or software upgrades.
The centralized resource manager can also include sensing systems that are operable to determine when devices are added or removed from the network. These means may include a current, infrared (IR), or electromagnetic field (EMF) sensing systems for detecting when video devices are turned off so that the network resources associated with that video device may be reallocated. The IR sensing system is operative to detect and process signals from a typical IR remote control device, and thereby determine the on/off state of the corresponding video device, so that resources associated with that device can be automatically reallocated.
The centralized resource manager can also include a power switching system that is operable to control the on/off state of devices attached to the network. This system may include the ability to plug devices into a switched power supply allowing the centralized resource manager to determine the powering on and off of the devices such that network resources associated with these devices may be automatically reallocated when the devices are determined to be in an OFF state. A typical IR or radio-frequency (RF) remote control device can be used to allow the user to command turning on and off of any device equipped with a power switching system.
In an embodiment of the present invention, a centralized resource manager receives a user request for streaming of media data to a destination resource. The centralized resource manager identifies a source resource for fulfilling the user request responsive to an amount of bandwidth that would be consumed by a media pipeline that includes a representation of the source and destination resources. The centralized resource manager may then initiate the streaming of data from the source resource to the destination resource.
In another embodiment, the centralized resource manager receives a user request for a scheduled rendering event. The centralized resource manager then identifies a source resource and a destination resource for fulfilling the user request based on an amount of bandwidth that would be consumed at a time interval associated with the scheduled rendering event by a media pipeline containing both the source and the destination resources. The centralized resource manager then initiates rendering of media data from the source resource to the destination resource at the beginning of the time interval.
In another embodiment, a centralized resource manager detects the removal from the home area network of a first resource from a plurality of resources. The centralized resource manager then determines whether there is a media pipeline that contains a representation of the first resource. If there is such a pipeline, the centralized resource manager identifies a second resource that is of the same type as the first resource. The centralized resource manager then amends the media pipeline by removing a representation of the first resource and adding a representation of the second resource.
In another embodiment, the centralized resource manager detects an addition to a home area network of a new resource. The centralized resource manager determines whether there is a media pipeline containing a representation of a pre-existing resource that is of the same type as the new resource. If there is such a media pipeline, the centralized resource manager determines whether replacement of the representation of the pre-existing resource by the new resource in the media pipeline is desirable in accordance with a predetermined criteria. If the centralized resource manager determines that replacement is desirable according to the predetermined criteria, the centralized resource manager amends the media pipeline by removing the representation of the pre-existing resource and adding a representation of the new resource.
In another embodiment, the centralized resource manager receives a user request and a time-usage indication associated with the user request. The centralized resource manager identifies, responsive to the user request, the time-usage indication and pre-existing entries in a reservations database, a subset of a plurality of resources for fulfilling the user request. The centralized resource manager stores in a reservations database representations of the identified subset of the plurality of resources and the time-usage indication associated with the user request. In this embodiment, the centralized resource manager is further capable of detecting the presence in the home area network of another centralized resource manager, and negotiating with the other centralized resource manager to determine which centralized resource manager will provide centralized control over the plurality of resources.
The present invention may be implemented in a single network that uses video clients, audio clients, PC, and other devices. Various networking protocols and architectures can be used, including wireless LANs.
Other embodiments of the invention are discussed in or made apparent by the following disclosure.
These and other features and advantages of the present invention will become apparent to those skilled in the art from the description below, with reference to the following drawing figures, in which:
Overview of the Centralized Resource Manager: Embodiments of the present invention involve a centralized resource manager (CRM) that can be linked to a plurality of networked devices in a distributed network. One such network could be a home network having digital entertainment, computing, and communication devices. Examples of network services include audio and video processing (e.g., recording audio and/or video content for storage or real-time use), distributing audio and/or video content for real-time presentation to a user (e.g., listening to a stereo system or viewing and listening via a television set), and data and graphics processing (e.g., creation, modification, display, storage, or rendering of data or graphics by using a PC or other devices or applications). Illustrative descriptions of distributed home networks are set forth below.
In accordance with known network practice, each of the devices or functional systems in the network can have resources that can be used by the functional system in conjunction with the services it provides. In the following discussion, network devices or functional systems are divided into two broad categories: client devices and atomic devices. A client device is any functional system that includes a local resource manager that provides a mechanism for control of resources useable by that client device. Such resources can be local resources, i.e., integral to the client device, and/or remote resources, e.g., resources non-integral to the client device but available thereto via a server. An atomic device is any functional system that does not include a local resource manager.
In accordance with embodiments of the invention, while local resource managers exercise control over the set of resources useable by their respective client devices, the centralized resource manager controls not only these resources, but also the resources of atomic devices (i.e., proxy control) and the resources of the distributed network as a whole. Any conflict in the exercise of control over resources between the centralized resource manager and the respective local resource manager can be resolved in favor of the centralized resource manager.
In response to a user or agent process request to provide a service, e.g., a media processing service such as recording a movie distributed by an external provider, the centralized resource manager exercises master control over the network resources by identifying network resources that are available to fulfill the user (or agent process) request, assigning specific network resources from the available network resources to define a media pipeline or session that fulfills the user request, and reserving the network resources defining the media pipeline to fulfill the user (or agent process) request. The reserved network resources can be used immediately or scheduled for use at a future date. Once the reserved network resources have been used to fulfill the user or agent process request, the centralized resource manager frees these network resources, changing their status from “reserved” to “available”.
Exemplary Architectures of a CRM-Enabled Network: Referring to
The centralized resource manager 12 of
Typically, the centralized resource manager 12 is located in a gateway device that manages the LAN and WAN links of the distributed home network 10, although one skilled in the art will understand that the foregoing description does not limit the present invention. In the embodiment shown in
Another example of a distributed home network utilizing the centralized resource manager 12 is illustrated in
The distributed network 116 comprises a typical 75-ohm coaxial cable used to deliver analog and digital cable channels through splitters to televisions, VCRs, etc. A LAN functionality is superimposed over the coax using frequency division multiplexing (e.g., using frequencies above or below the CATV channels for a general purpose data link). In this example, this network is Ethernet-over-coax, but other solutions exist, such as IEEE 1394 over coax, or HPNA over coax. In some topologies, a filter 118 may be required to prevent the data network frequencies from reaching outside the home.
Examples of Operation of a CRM-Enabled Network: A method of controlling audio-video network resources of a distributed network by means of a centralized resource manager will now be described. Consider an evening of family television viewing. Earlier in the day, Dad programmed a client device to record the hockey game (media content) at 8:00 PM on channel 150 (the user request). Dad used a graphical user interface (GUI) to navigate to the Electronic Program Guide (EPG) application of the client device and selected the game to record. The centralized resource manager includes a scheduling application that requests a reservation of an audio-video pipeline or session with the resource requirements shown in
Referring now to
The centralized resource manager 12 will search the resource database to identify available network resources that match the resource requirements imposed by the user request. In the system described, there is one disk 110 (and more specifically one partition for video reported to the centralized resource manager 12) and three tuners. In this example, all three tuners have the same capabilities, and are distinguished only by their location in the distributed network. The centralized resource manager 12 implements a resource protocol, e.g., a least-cost algorithm, for constructing the media session or pipeline, i.e., identifying available network resources, assigning available network resources to fulfill the request, and reserving the assigned network resources. Using one of the two tuners associated with the media server 108, the media pipeline can be constructed without using network bandwidth. By using the tuner in one of the client devices 112, 114, in contrast, the centralized resource manager 12 would need to reserve network bandwidth. There is no cost difference between the two local tuners associated with the media server 108, so the lower number one is chosen.
The centralized resource manager 12 checks the disk storage device 110 for disk space both when the user schedules the recording and shortly before the recording event. If insufficient disk space is available when the user schedules the event, the centralized resource manager 12 checks to see if the disk storage device 110 includes any “delete-able” files. If all the files on the disk storage device 110 are marked as “do not delete”, the user will be alerted that the user request cannot be fulfilled (scheduled) due to insufficient recording space on the disk storage device 110. If sufficient disk space is available (or there are deleteable files), disk space will be reserved at the time of the request by the centralized resource manager 12. However, disk space will not be created (by deleting files) until the time the recording is scheduled to begin.
The centralized resource manager 12 also reserves disk bandwidth for the recording at the time the recording is scheduled. Upon successful reservation of the required network resources, the reservation is stored in a network resource reservation table for use in comparison against future user (or agent process) requests. Reservation of network resources to fulfill any request, i.e., the media pipeline or session, is communicated back to the scheduling application with a reservation id for the specific event.
At 7:30, the children want to watch a show in the family room. This television 106 is associated with the client device 114 with the MPEG2 encoder 206. The show they want to watch is on analog channel. They select this program from the EPG and the scheduling application contacts the centralized resource manager 12 to request network resources.
As shown in
Note that with the exception of the video output display provided by the television set 106, the requested pipeline is not limited by the location in the distributed network where the network resources are located. The centralized resource manager will use resource protocols, e.g., least cost-of-bandwidth algorithms, to determine which network resources are assigned to fulfill the user request.
Bandwidth requirements for un-encoded video are high, so the MPEG2 decoder 208 chosen is the decoder in the client device 114 (see
Once the centralized resource manager 12 has successfully mapped the requested media pipeline to available network resources, an instantiated graph is returned to the scheduling application, and the assigned resources are marked as reserved (indefinitely). The centralized resource manager 12 has assigned one other resource to the graph, as shown in
At 7:45, Mom wants to watch a program in the kitchen. The television 104 in the kitchen is connected to the decode-only video client device 112 (see
At 7:50, the distributed network prepares to record the hockey game. Most of the network resources have been reserved, but the centralized resource manager 12 needs to verify that disk space is available on the disk storage device 110. If there is not sufficient disk space to record the program, existing files will need to be deleted. If disk space cannot be made available (user has marked all existing files as “do not erase”), an exception will be generated and the recording will not take place. Typically, an alert is displayed on the television screens allowing the user to make room on the disk storage device 110.
At 8:00 the recording of the hockey game takes place.
At 8:05, Dad sits down in the living room to watch a program on television 102. If a program is selected by the EPG, a request for network resources similar to that shown in
There is an MPEG2 decoder 212 available in the network resources, and provided disk bandwidth is available, the centralized resource manager 12 would assign and reserve these network resources as a media pipeline that would allow Dad to view the James Bond movie on television 102.
There is one more option that Dad could have chosen. He could have requested to “steal” a tuner from one of the other media pipelines, i.e., utilizing a network resource (tuner) that had previously been reserved by the centralized resource manager 12. While this approach probably would not endear Dad to others in this scenario, there are cases where such behavior may occur. For example, in the typical home-based distributed network, a centralized resource manager has no way of knowing when any particular TV is on or off. If Mom turns off the TV in the kitchen, without indicating this action to the centralized resource manager, the tuner associated with the kitchen TV is still allocated to the media pipeline she requested. Rather than force someone to go to the kitchen and free up the tuner, the GUI is configured to allow another user to appropriate network resources from another media pipeline. The scheduling application communicates with the centralized resource manager 12 to tear down the previously instantiated graph (media pipeline) and re-allocate the network resources to the current media request. One method of alleviating this is to allow the client device to be turned off or put in a standby mode. Other methods, including ways of indicating, to the centralized resource manager 12, which network resources can be freed up, are discussed below.
Each of the media pipelines described above can be torn down when they are no longer needed, e.g., when particular requests have been fulfilled. For example, the network resources for fulfilling a recording request, such as the tuner 200, can be freed up when the scheduled recording of the hockey game is completed.
Note that this example specifically illustrates the negotiation of network resources to build a media pipeline or session. Similarly, the centralized resource manager 12 allows reservation of network resources for audio (music) and graphics pipelines. Typically, a graphics pipeline is established at boot time or when a new client/atomic device is added to the distributed network. The graphics network resources are reserved and the graphics pipelines instantiated to allow applications running on the media server 108 and rendered on the client devices, or applications running on the client devices accessing data on the WAN or LAN 116 to reserve necessary network resources to provide the GUI and application services necessary to fulfill a particular user request.
Also note that this example specifically illustrates negotiation of a partial set of network resources to build a complete pipeline. The centralized resource manager 12 may not explicitly manage all segments of a pipeline. For example, a PCI bus connecting only an IDE hard-drive interface to an Ethernet network interface may provide far greater bandwidth than the network or hard-drive interfaces can support. In this case, reservation support of the PCI bus bandwidth may not be necessary in order to construct a resource pipeline. It should be apparent to those skilled in the art that the centralized resource manager described herein may be used to allow reservation of one or more of the resources necessary to build a network pipeline.
Media Server:
Analog CATV also enters the distributed network through the same interface, or through a secondary interface. In a cable system interface to the distributed network, both DCATV and ACATV typically share the same coax network using frequency division multiplexing. In satellite systems, all content provided to the distributed network is in digital format, but local terrestrial broadcast may enter the distributed network through a separate analog feed.
Analog content needs to be encoded 308 prior to being stored or transmitted. Typically this is done with MPEG2 encoders, although various other encoders are known in the art (MPEG4, wavelet, etc.). In some applications, this content will also be encrypted prior to persistent storage on the disk storage device 110.
The media server 108 described here also contains a broadband interface for receiving digital content such as TCP/IP or UDP/IP packets. This is typically through a cable modem 300 or xDSL link, but many other technologies are known in the art. This link provides data for applications running on the media server 108 or elsewhere on the distributed network. It also provides shared internet connectivity for PCs linked to the network. Digital video may also be received in the distributed network encoded in MPEG2 or some other format. Digital telephony may also be received in the distributed network as in Voice over IP or packet cable.
In an embodiment of a CRM-enabled network, the media server 108 is capable of running representative applications 310, 312. These applications 310, 312 can render graphics either locally on a connected television or remotely on client devices attached to a television. The applications 310, 312 can also render graphics suitable for other client devices such as PCs, PDAs and webpads. In one embodiment of a CRM-enabled network, these graphics are rendered using X-windows calls across the distributed network. In another embodiment, a remote frame buffer protocol such as VNC is used. In another embodiment, HTML is used for rendering. Other methods are known in the art. In yet another configuration of the distributed network, the client devices are capable of running their own applications 328.
As noted above, the centralized resource manager 12 provides centralized control over user requests for media, computing and communication services. In the embodiments described above, the centralized resource manager 12 is depicted as part of the media server. In other configurations, the resource manager 12 can exist on any client device of the distributed network. It is only necessary that client and/or atomic devices wishing to use network resources be able to communicate with the centralized resource manager 12 via the distributed network. This can be done using sockets or other methods known in the art.
Client Devices: Video client devices 112, 114 typically provide a video decoder 320, a frame buffer 322, alpha blending 324 and encoding 326 for analog output as exemplarily illustrated in
In an embodiment, the media server 108 provides the services of a single video client device. This allows a television to be directly connected to the media server. In another configuration, the media server 018 is placed in a closet or basement, and only client devices embodying a video-display capability can display video.
In another configuration, video client devices capable of encoding video as well as decoding video are part of the distributed network. These devices are capable of tuning into digital and/or analog content and encoding the video and directing this video either back to the media server, or directly to the local decoder. This configuration allows the number of tuners to be incremented as video client devices are added to the distributed network.
NAS and Other Storage: In some distributed networks, network attached storage will also be used. In this configuration, one or more disk storage devices may reside on the distributed network. These disk storage devices are capable of receiving content from any source or streaming content to any sink. This content includes audio, video, still images and other data.
Wireless and Other Variations: In some homes there may be more than one type of distributed network. For example, there may be both wired and wireless aspects to the distributed network. There may also be a LAN and local buses such as IEEE 1394. The centralized resource manager 12 is capable of communicating to any client and/or atomic devices on the various wired and wireless aspects comprising the distributed network.
The centralized resource manager 12 is capable of reserving network resources, e.g., disk space, memory, and network bandwidth, on multiple parts of the distributed network using various methods such as TDMA networks, which are known in the art.
Dedicated applications 310, 312 capable of interacting with the centralized resource manager 12 may be used to control the allocation of some network resources, such as network bandwidth. In other cases, 3rd party applications may be running on client devices such as PCs. These client devices may be forced to route their traffic through bandwidth shaping components, such as those described in the patent applications listed above and herein incorporated by reference.
The centralized resource manager 12 is also responsible for detecting what network resources are available on the distributed network, and discovering when new client and/or atomic devices are added to the distributed network. Many protocols supporting this function are known in the art, such as Simple Service Discovery Protocol (SSDP), which is a component of UPnP. If client and/or atomic devices are removed from the distributed network without notifying the centralized resource manager, the scheduling application or the OS can be adapted to indicate an exception when the media pipeline is broken. The centralized resource manager 12 will then be contacted and the local resources of the removed client and/or atomic devices can also be removed from the network resource pool.
Individual hardware components typically have associated software management components that provide both control and data interfaces. For example, the client video decode resource 326 (see
External Control for Reservation of Network Resources: As noted previously, resources of the distributed network may be requested as the result of either a user action or an agent request. In some systems, the media server or other components may be providing a service through an agreement with a broadband service provider. In some cases, it may be advantageous for the service provider to use the centralized resource manager to reserve or request resources independently of the user. For example, a service provider may wish to reserve a tuner and/or disk space at a certain time to push special media content, advertisement, or software upgrade data. In this case, an agent process residing on an Operations Support System at the service provider Network Operations Center (NOC) will generate reservation requests and communicate such requests to the centralized resource manager using a protocol such as the Simple Network Management Protocol (SMNP) over a WAN interface. Other means of configuring the home equipment and resources are known in the art.
Current Sensing system for Automatically Reallocating Network Resources: As noted previously, one constraint of the distributed network described above is that the centralized resource manager does not know when a particular TV is turned off or on. If this information is not known, the centralized resource manager may assign resources such as television tuners used in a media pipeline or session to deliver video to a television that has been shut off. One solution proposed above is to allow the user to turn the client device (and/or media server) into a standby mode. The resources associated with the client device (or media server) would still function if useable by the rest of the distributed network, but specific resources dedicated to that TV would be powered down. One problem with this approach is that many users do not turn off entertainment components, as they do with television sets.
By adding a current sensing system to any client device (and/or media server) having a television set associated therewith, and configuring the client device such that the television is operatively integrated with the current sensing system, which in turn was plugged into a wall outlet, the current sensing system provides indications as to when the TV is in an ON state and when it is in an OFF state. This current sensing system could be contained in the client device (or media server), or it could be contained in an external transformer power supply, or it could be a sensor that wraps around the television cord.
Referring now to
A resistance R1 is the load resistor for the secondary of the transformer T1. Operational amplifier A1 amplifies the voltage across T1 by a ratio of R5/R4. This ratio is chosen to exceed the turn-on voltage of diode D1, allowing the peak detection circuit formed by capacitor C2 and resistor R6 to charge. Operational amplifier A2 serves as a comparator driving current through the voltage divider formed by resistors R7 and R8, which are chosen to set a voltage at the anode of diode D2 to turn on transistor Q1. Transistor Q1 drives the opto-isolator circuit U1 producing a digital output logic low signal. An additional inverter U2 is provided to create a digital signal at V_out which is logically high when current is sensed on 310 (television in the ON state) and logically low when no current is sensed (television in the OFF state).
Referring to
IR Sensing system for Prioritizing Resource Reallocation
Turning now to
In a system that lacks a current sensing system of the type described above, a need exists to make an educated guess as to whether a particular television or other resource is in use. One means for making this guess is based on examining the signal (IR typically) detector/receiver in the room where the particular television or other resource resides.
For example, if a viewer of one television is requesting a tuner, and if all tuners are in use, and if more than one tuner is in use in a media pipeline to a television set, the ideal solution is to reallocate a tuner 404 that is used by a television 104 that is actually turned off. The centralized resource manager 12 will guess which television is most likely turned off and issue an alert to that screen.
One possible alert is a graphical pop-up window 406 (see
The drawback to this scheme is that many users would prefer not to see alerts 406 popping up on their screens. By making a considered determination as to which televisions are not in use, the centralized resource manager 12 can first start by alerting a screen that has a high probability of being turned off. If that screen is in use, the central resource manager 12 will then try to reallocate the resources associated with the next-most likely powered down screen.
The centralized resource manager 12 can make a considered determination as to the likelihood a screen of television 104 is being watched by monitoring the IR channel 402 (detector/receiver) of the associated client device 112 (or media server 108), one method for reaching such a considered determination being shown in
More advanced techniques can be employed, as shown in
For example, the IR monitoring channel 402 could detect the IR “On” signal at the same time the TV 104 does. But the IR signal to the IR monitoring channel 402 could be blocked when the TV 104 is turned off. The IR detection circuit within the channel 402 would then be out of sync. This is why other key presses in combination with the On/Off signal are useful. This method is shown in
In one embodiment of this aspect of a CRM-enabled network, the sensor of the IR monitoring channel 402 is the same one used to receive signals targeted at the client device 112 (or media server 108). In an alternative embodiment, a physically separate, tethered receiver 408 can be employed as the IR signal sensor.
In another embodiment of this aspect of a CRM-enabled netowork, there is included a means for learning the On and Off codes (or common On/Off code) of the remote control unit (secondary) used for the television. It may be preferable that such a means be operative to learn the complete code set for the television. One method is to allow the user to enter the model number or an ID cross-referencing the model number of the TV into such means. Another method is to put the means in learn mode and to press the key to be learned. In the method depicted in
Note that this method would also be applicable to systems such as HAVi. For example, if a service were negotiating whether or not to steal resources, one method for determining which resource to target would be based on usage of this information.
Electro-Magnetic Field (EMF) Sensing for Prioritizing Resource Reallocation
Turning now to
In a system that lacks the current sensing or IR sensing systems described above, a need exists to determine when resources associated with a particular television may be reallocated. Another system for making this determination is based on detecting EMF in the proximity of the particular television 104. This EMF sensing system 469 may be either tethered, as shown in
Referring now to
Referring now to
Power Switching for Automatic Resource Reallocation
Another method of determining when resources assigned to a particular TV session may be automatically reassigned is to provide a means for the user to control the power of the TV through interaction with the STB. In this embodiment the user will use a standard IR (or RF) remote control unit to signal to the STB to turn the TV on or off. By adding a power switch mechanism to the client device (or media server) the STB will then be able to add or remove power to the TV and control when it is in the ON or OFF state. With this added mechanism of control, the centralized resource manager can then determine the ON or OFF state of the television by an internal query to determine the position or state of the power switch 307. The power switch according to the present invention could be contained in the client device (or media server), or it could be contained in an external transformer power supply.
Referring now to
Referring to
Description of Exemplary Embodiments of CRM Functionality
The functionality of the CRM as a manager exercising central control over resources in a HAN can be illustrated through a discussion of example embodiments. Other embodiments within the scope of the present invention will be apparent to those skilled in the art in light of the present disclosure.
In step 1910 of the embodiment depicted in
Generally, the destination resource associated with a user request may not be limited to a display device. For example, the user may request that a program being broadcast by a service provider be recorded to memory resource 2210. Additionally, a user request may not directly specify the recording or playback of a specific program at a specific time. For example, the user may request that all James Bond movie-content be recorded. Media server 2270 may determine based on information from a newly updated electronic program guide that “Thunderball” will be played on a specific cable channel at 9 pm. Based on this, media server 2270 may request that CRM 2280 construct and implement a media pipeline resulting in the recording of “Thunderball” from that cable channel at that time.
The term “user request” as used herein may also include generalized system requests that are not directly related to a request from a particular user. In an embodiment, media server 2270 may implement logic that results in a request to the CRM to record all advertisements on a specific channel during a non-peak period. Such advertisements may be stored in memory, e.g., memory 2210, for playback or storage in connection with programs of interest to members of the household of the HAN. Such requests are also “user requests” as used in the present disclosure.
In step 1920 of the embodiment depicted in
An example of the embodiment described directly above is illustrative. In this example, the user request may involve the streaming of a 4 Mbps program from one of two HAN tuners to a particular display device. Moreover, the user request may include the ability to use live-pause DVR functionality in viewing the program. Thus, a HAN resource with buffering functionality—e.g., a drive—may be required to fulfill the user request. Assuming that the display device and the sole drive in the HAN are located in differing rooms, and that one tuner is local to the display device while the other tuner is local to the drive, the CRM in the present embodiment may use the tuner that is local to the drive, because data flowing from the tuner would then travel a shorter distance than would be the case if the other tuner were used. In other words, network bandwidth consumption would be reduced, because media data from the tune local to the display would need to traverse the network twice (once from the display to the disk, and once from the disk to the display, while a media data stream from a tuner local to the drive would only traverse the network once (from the drive to the display). In this manner, network bandwidth consumption would be reduced.
More generally, if there are two types of resources that could be used in a media pipeline to fulfill the user's request, and there is more that one resource available for each type, then an available resource of the first type and an available resource of the second type can be selected so that the resulting media pipeline consumes the least amount of HAN bandwidth (e.g., by considering the media pipelines and corresponding HAN bandwidth consumption resulting from each combination of the available resources of the first and second types). It is convenient to label a resource that is upstream in terms of the data flow direction in a media pipeline as a “source resource” and to label a resource that is downstream of the source resource as a “destination resource.”
In embodiments where the user's request involves an event (such as playback of a program or recording of a program) at a future time or time interval, the set of available resources for fulfilling the user's request may be determined from the resources available at that time or time interval, as indicated by pre-existing entries in a reservations database that can be accessed by the CRM. Further, once a media pipeline to fulfill the user's request is constructed, the CRM may store a representation of that time or time interval (i.e., a time-usage indication) in association with a representation of the media pipeline in the reservations database. In embodiments where the user's request involves a real-time event (such as immediate playback of a program), then the available resources for fulfilling the user's request are determined at that time based on pre-existing entries in the reservations database. Because the length of time of use of the resources in the corresponding media pipeline may be uncertain for a real-time event, the time-usage indication stored in association with the representation of the media pipeline in this case may indicate, instead of a particular time or time interval, a flag representing indefinite usage of the resources used for the media pipeline. The CRM may then consider these resources to be unavailable for other uses until it detects or otherwise decides that such real-time us of the resources has terminated. However, regardless of whether the user request involves a future event or a real-time current event, the CRM may construct the media pipeline for fulfilling the user request as discussed above (e.g., based on bandwidth considerations as discussed earlier).
In the embodiment depicted in
In embodiments, a user request for a live session (i.e., real-time playback) may be treated by the CRM as having a lower priority compared to pre-scheduled media pipelines. For example, if a user requests a live session, and the CRM determines that fulfilling the user request will conflict with a media pipeline represented in the reservations database, the CRM may direct the display device to display a message warning the user about the conflict and asking the user to confirm that the conflicting media pipeline will overridden. If the user provides such confirmation by user input through, e.g., the display device and the user's remote control, then in these embodiments the CRM will delete the representation of the conflicting media pipeline from the reservations database, freeing the HAN resources represented in the conflicting media pipeline.
In embodiments, a user request for a live session may result in the CRM implementing a live session media pipeline that utilizes one or more HAN resources that are also represented in media pipelines of the reservations database that are scheduled for implementation in the future. At the time of or shortly before these resources are scheduled to be used in an implementation of such a pre-existing media pipeline, the CRM may provide the user with a warning and the option of terminating the pre-existing media pipeline. In these embodiments, if no response is obtained from the user within a predetermined time, the CRM may assume that the user is no longer watching the live session and may terminate it, freeing up the resources for implementation of the conflicting pre-existing media pipeline. Thus, in these embodiments, the CRM treats live sessions as having lower priority compared to pre-existing media pipelines represented in the reservations database.
The embodiment depicted in
In step 2010 of the embodiment depicted in
In step 2020, the CRM identifies a second resource in the HAN that may be used instead of the removed resource in media pipelines represented in the reservations database. For example, the CRM may check the reservations database to determine whether any resources of the same type as the removed resource are available at the time(s) indicated by the time-usage indication stored in the reservations database in association with a media pipeline containing a representation of the removed resource. Such a resource found by the CRM may be used to replace the resource removed from the HAN. If more than one such resource is identified, then the CRM may determine the replacement resource that is to be actually used by an algorithm as discussed earlier. In one embodiment, if no replacement resource is identified, then a message may be displayed to the user indicating the occurrence of an error, and the relevant media pipeline may be abandoned and deleted from the reservations database.
In step 2030 of the embodiment depicted in
In embodiments, the CRM may not perform at least one of steps 2010, 2020 and 2030 until after some time elapses following step 2000. This may be done in these embodiments to avoid the needless reallocation of resources where the first resource is only temporarily removed from the HAN—e.g., where the first resource needs to be shut down and rebooted. In one aspect of these embodiments, the CRM may not carry out steps 2010, 2020 and/or 2030 until after a pre-determined amount of time elapses after the CRM detects the removal of the first resource. In another aspect of these embodiments, the CRM may not carry out steps 2020 and/or 2030 until a time shortly before a pre-existing media pipeline containing a representation of the removed first resource is scheduled to be implemented. In yet another aspect of these embodiments, the CRM may not carry out steps 2010, 2020 and/or 2030 until after an explicit message is received from the first resource that it is leaving the HAN.
In step 2100 of the embodiment depicted in
In step 2110, the CRM determines whether the reservations database includes a representation of a media pipeline that includes a representation of a pre-existing resource of the same type as the new resource. For example, if the new resource is a tuner, the CRM may determine whether any pre-existing media pipelines represented in the reservations database contain representations of pre-existing tuners in the HAN.
In step 2120, the CRM determines whether it would be desirable to amend or reconfigure any media pipeline identified in step 2110 so that the pre-existing resource is replaced with the new resource for that media pipeline. The CRM may determine whether such amendment or reconfiguration is desirable by, for example, using an algorithm as described earlier to compare a media pipeline that includes a representation of a pre-existing resource with one including a representation of the new resource. Such an algorithm may be based on one or more pre-determined selection criteria that are programmed into the hardware and/or software logic implementing the CRM.
If the CRM determines in step 2130 that replacement would be desirable, then the CRM in step 2130 of the embodiment depicted in
It is illustrative to consider another example of the embodiment discussed in connection with
Interactions of a CRM with Other CRMs in a HAN
In some embodiments of the present invention, a CRM may have the capability to detect the addition to the HAN of another resource that is also capable of CRM functionality. Either or both CRMs may also have the ability to negotiate and agree with one another regarding which CRM is to provide centralized control over HAN resources, and which CRM is to operate in a manner that does not conflict with the other CRM's centralized control. In embodiments, such detection and/or negotiation may take place in accordance with a pre-defined protocol implementing logic programmed into the software unit and/or the hardware device implementing CRM functionality. Each CRM may be capable of implementing any or any combination of the CRM features discussed above. Thus, embodiments of the present invention include a CRM that has the capability to implement any or any combination of the CRM features discussed above, and that is further capable of detecting and negotiating with, when present, another CRM in the HAN that also has the capability to implement any or any combination of the discussed CRM features.
Variations to the embodiments discussed above will be apparent to those skilled in the art based on the present disclosure. Such variations are within the scope of embodiments of the invention.
In a variation of embodiments discussed above, actions discussed above as being taken by a resource of the HAN may be taken by a local resource manager of the relevant resource. Such variations of the embodiments discussed above are within the scope of the present invention.
In embodiments, display devices in a HAN may each have a local decoder resource that is utilized, for example, for decoding MPEG2 (or other MPEG) encoded data. Such a decoder may be a part of a display device, or in an alternative embodiment, may be implemented in a set-top box local to a display device. Moreover, media server 2270 may have a local memory or other storage resource. Additionally, tuners that are utilized in embodiments of the invention include analog tuners as well as digital tuners. An analog tuner in embodiments of the invention may additionally include an MPEG2 (or other MPEG) encoder. A tuner in embodiments of the invention may be used to tune to a carrier in the relevant medium in which the media data propagates to the tuner. The tuner may then demodulate media data modulated onto the carrier to extract useful data. Demodulation functionality may be implemented in the tuner resource itself, or an additional demodulator resource may be used in conjunction with the tuner for such functionality. All such embodiments will be apparent to one skilled in the art based on the present disclosure.
Additionally, the structures shown and discussed in apparatus embodiments of the invention are exemplary only and the functions performed by these structures may be performed by any number of structures, as is known to those of skill in the art in view of this specification. All of such possible variations are within the scope and spirit of embodiments of the invention and the appended claims.
Propagating signals embodied in a medium, such as a carrier wave or other carrier medium, that are products of embodiments of methods of the invention, or products of the use of embodiments of systems or devices of the present invention, are within the scope and spirit of the present invention and the appended claims. Similarly, any medium containing instructions that are readable by a processor and that, when executed by the processor, perform the steps of method embodiments of the present invention, are also within the scope and spirit of the present invention and the appended claims.
Other variations and modifications of the present invention are possible, given the above written description and the appended drawings. Persons skilled in the art will recognize from these that the invention is not limited to the embodiments described, and may be practiced with modifications and alterations limited only by the spirit and scope of the appended claims which are intended to cover such modifications and alterations, so as to afford broad protection to the invention and its equivalents.
The present patent application is a continuation-in-part of and claims the benefit under 35 U.S.C. § 120 of U.S. patent applications Ser. No. 10/490,225 filed Mar. 19, 2004, entitled “Centralized Resource Manager” (Atty. Dkt. UCN-027); Ser. No. 10/490,224 filed Mar. 19, 2004, entitled “Centralized Resource Manager With Passive Sensing System For Automatic Reallocation Of Resources” (Atty. Dkt. UCN-028); Ser. No. 10/490,325 filed Mar. 19, 2004, entitled “Centralized Resource Manager With Power Switching System For Automatic Reallocation Of Resources” (Atty. Dkt. UCN-029). The entirety of each of these patent applications is herein incorporated by reference. The present application for United States Patent incorporates herein by reference the contents of the following U.S. Patent Applications: Ser. No. 09/365,726 filed Aug. 3, 1999, entitled “Multi-Service In-Home Network With an Open Interface”; Ser. No. 09/809,770 (Atty. Dkt. UCN-006) filed Mar. 16, 2001, entitled “Home Area Network Including Arrangement for Distributing Television Programming Over Local Cable”; 60/193,813, filed Mar. 31, 2000, entitled “Home Area Network”; 60/313,209 (Atty. Dkt. UCN-011), filed Aug. 17, 2001, entitled “Delivering Multimedia Over Home Area Networks”; 60/313,228, filed Aug. 17, 2001, entitled “Web Services Provisioning Architecture”; 60/327,627 (Atty. Dkt. UCN-012), filed Oct. 5, 2001, entitled “Home Area Network Centralized Video Recorder”; 60/345,966 (Atty. Dkt. UCN-017), filed Nov. 7, 2001, entitled “Digital Video Recording System Supporting Concurrent Playback Using Advanced Program Information”; Ser. No. 10/017,675 (Atty. Dkt. UCN-018) filed Dec. 15, 2001, entitled “Centralized Digital Video Recording and Playback System Accessible To Multiple Reproduction And Control Units Via A Home Area Network”; Ser. No. 10/032,218 (Atty. Dkt. UCN-015) filed Dec. 21, 2001, entitled “Digital Video Recording and Reproduction System And Method Suitable For Live-Pause Playback Utilizing Intelligent Buffer Memory Allocation”; 60/323,618 (Atty. Dkt. UCN-016) filed Sep. 20, 2001, entitled “Home Network Platform, Architecture and System”; 60/350,431 (Atty. Dkt. UCN-019) filed Jan. 18, 2002, entitled “Home Area Network Traffic Management with a Networked Personal Video Recorder”; 60/350,431 (Atty. Dkt. UCN-032) filed Apr. 11, 2002, entitled “Centralized Resource Manager.”
Number | Date | Country | |
---|---|---|---|
Parent | 10490225 | Aug 2004 | US |
Child | 10835551 | Apr 2004 | US |
Parent | 10490224 | Aug 2004 | US |
Child | 10835551 | Apr 2004 | US |
Parent | 10490325 | Jul 2004 | US |
Child | 10835551 | Apr 2004 | US |