Patent Application
20060041924
The present invention relates generally to data broadcasting and home networking. More particularly, the invention relates to a middleware technology applicable with digital television (DTV) systems that provides a bridge between DTV carousel mechanisms and home networking devices and protocols, such as, but not limited to UPnP-based networking.
Digital television (DTV) is implemented upon a set of standards that provide for the distribution of audio, video and data. As of this writing the MPEG standard is currently employed. Currently, broadcasters utilize the MPEG-2 standard to deliver motion pictures, audio and digital data, including executable application data, to subscribers and/or members of the public. In this regard, although the MPEG-2 standard is in current use, the inventions discussed herein are not intended to be limited to such standard. Indeed, the inventions are adapted to evolve with evolving standards, allowing the inventions to be exploited both today and in the future.
Television viewers are, of course, aware that digital television will allow audio and video content to be delivered for enjoyment in the home. What many may not realize, however, is that the DTV standards also define data storage, retrieval and broadcasting services whereby digital information other than the audio and video content may be delivered to the home. By way of example, when it is necessary to upgrade the software in the home user's DTV receiver or set-top box, one or more files containing the digital information needed to perform the upgrade may be transmitted as part of the MPEG transport stream (according to the DTV standards) to the receiver or set-top box. In some instances, this digital data may represent an executable program that is then launched and run on the local receiver or set-top box to effect the software upgrade.
The MPEG-2 standard, for example, provides a full set of protocols known as the digital storage medium command and control (DSM-CC) protocols that may be used to control the flow of this digital information between the video source and the receiving equipment. According to the roadmap outlined by the DSM-CC standards, after an initial link has been set up between two entities in a video delivery network (such as between the broadcast source and the user's receiver or set-top box) DSM-CC provides the functionality to continue the setup of an application session. Because this session setup happens at the interface between the network and the user equipment, DSM-CC defines a user-to-network protocol. Once the application session has been set up, further logical links are established between the video server and the receiver or set-top box. One logical link might be used for user data (like MPEG-2 coded video) and another logical link might be used to control what is happening on the user data link. This latter link is sometimes called the control link.
The actual protocol to be used on this control link is not specified by DSM-CC. However, DSM-CC defines a set of services (such as services to manipulate a video stream) in the server. These services can be used by the client on the receiver or set-top box. Because these services are primarily relevant between two user entities (such as the server and the client), the DSM-CC standard refers to them as the DSM-CC user-to-user interface (U-U interface). Thus the DSM-CC standards envision two fundamentally different interfaces, a user-network interface and a user-user interface. The user-network interface is used primarily for session setup and teardown and for managing the resources needed for the session. The user-user interface provides more application layer-oriented functions. For example, the user-user interface is used for application download communications and client-server communications.
Application Download Communication
Under the DSM-CC protocol, the user-user interface enables application download operations, which are primarily used for loading executable code from the server to a client. In a service on demand scenario, for example, a navigator application software program might be downloaded immediately after the session between the server and the client is set up. For such relatively straightforward download communication, the DSM-CC defines a simple message-based protocol, which implements a basic data flow-control mechanism.
There are, however, some applications where the simple data flow-control mechanism may not be sufficient. The DSM-CC thus provides for the use of a broadcasting approach to downloading digital data such as executable code from the server to a plurality of end users. To support broadcast download, the DSM-CC employs a data carousel which mediates the downloading of data. The data carousel supplies data continuously on a well defined download channel. Clients can tune to this channel, identify the data that is provided for download by analyzing periodically transmitted download control messages, and finally capturing the data the clients are interested in.
Client-Server Communication
After a session has been set up between the client and the server, the actual software application used to implement the service can then be started. Typically the service will employ one software component executed on the client and another software component on the server. Frequently the client software provides a user interface that will allow the user to navigate and use the actual service.
The client-server communication needed to support the software application during use is typically quite application-specific. For example, to implement VCR functionality in an interactive video on demand application, commands like fast forward, rewind or pause will typically be transmitted from the client to the server. These commands would be implemented using the user-user portion of the DSM-CC protocols.
User-User Object Carousel
The data carousel protocol makes use of non-flow-controlled download messages to provide periodic broadcast of data to a set of clients. While simple images may be distributed using the generic data carousel services, a more ambitious use of data carousel services is to provide an environment where the actual user-user objects behind a user service are physically delivered to clients. To support this type of functionality, DSM-CC specifies a user-user (U-U) object carousel and a broadcast interoperability protocol (BIOP). BIOP provides a standard way of embedding in broadcast carousels object references that describe actual locations of object representations within the same broadcast channel. U-U objects may include such objects such as directories, files, streams and service gateways.
Universal Plug-And-Play (UPnP) Standards
The plug-and-play concept has enjoyed widespread popularity in the personal computer and computer peripherals market. In that market, consumers have begun to increasingly demand products that “just work” without requiring complex installation and configuration tasks. Recently, the universal serial bus (USB) and plug-and-play technologies have been improved so that devices can now be automatically detected and the device drivers automatically installed when computer peripherals are first plugged in. While tremendous strides have been made in this regard, there still remain numerous instances where true plug-and-play (“it just works”) has not been realized.
In an effort to bring plug-and-play benefits to the networked device arena, a protocol known as the universal plug-and-play (UPnP) protocol has been proposed and is currently being explored by the industry. The UPnP standard is intended to bring the PC peripheral plug-and-play concept to the home network with the same ease of use and automatic configuration that users have come to expect with plug-and-play devices. Many believe that the home networking arena is an ideal one for implementing plug-and-play concepts, as that will allow the home network to begin to approach the ease of use that other consumer home appliances enjoy.
UPnP provides a framework of network layer protocols and application layer XML-based constructs:
While the DTV standards, such as the DSM-CC standards provide for basic object carousel access functionality, there are no self-describing discoverable home networking frameworks exposing object carousel data, and utilizing it for application launching. The present invention provides such functionality.
According to one aspect, the invention provides a middleware service that interconnects or interoperates between a data carousel broadcast transport stream configured according to a predefined object data carousel application program interface and a control point configured according to a predefined plug-and-play protocol. A first communication mechanism operates to communicate with the broadcast transport stream using said predefined application program interface to obtain information about objects available on said data carousel. A second communication mechanism operates to communicate with said control point using said predefined plug-and-play protocol and to thereby expose said control point to said objects available on said data carousel. Using the middleware service it is now possible to expose object carousel data to a wide variety of devices that support plug-and-play functionality
Further areas of applicability of the present invention will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
The present invention will become more fully understood from the detailed description and the accompanying drawings, wherein:
The following description of the preferred embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
Referring first to
The DTV server 12 preferably adheres to a digital storage media command and control protocol, such as the DSM-CC protocol 20. This protocol defines mechanism for periodically delivering digital data to clients. These mechanisms are configured as carousels. Thus in
The middleware service 10 interacts with the DTV server 12 to communicate the objects served by object carousel 22 to subscribed control points and services that are implemented in accordance with a plug-and-play protocol such as UPnP protocol 16 or another protocol 18, such as APIs supported by the Open Services Gateway Initiative (OSGi) framework, for example. The middleware service 10 has extended support for application objects, permitting execution control on broadcast enabled and broadcast disconnected devices. Middleware service 10 exposes carousel events to home networking devices that are implemented according to a plug-and-play protocol, making these carousel events (of the DSM-CC protocol) appear to the networked device as an event or action (as defined by the plug-and-play standard).
In order to better appreciate how the middleware service 10 provides a bridge between the DTV DSM-CC protocol and a plug-and-play protocol, such as the UPnP protocol, a basic understanding of plug-and-play protocols will be helpful. While the UPnP protocol has currently gained industry-wide favor, it is envisioned that other protocols may be developed to either expand upon or replace the UPnP protocol in the future. Thus the middleware service 10 of
The UPnP protocol defines three basic abstractions: devices, services, and control points. A UPnP device can be any entity on a network that implements the protocols required by the UPnP architecture. The UPnP standardizes the protocols through which a device communicates, rather than the application programming interfaces that are used to connect to the device. Thus a device that speaks the required protocols is a UPnP device.
A UPnP service is a unit of functionality implemented by a device. A device can implement zero or more services. Each service is typically defined as a set of methods or actions, each with a set of optional input and output parameters and an optional return value. In general, a given device type will have a set of required services that the device must implement. For example, a CD player would have a service that provides the ability to play, stop and pause the audio content.
A UPnP control point is an entity on the network that invokes the functionality provided by a device. One can think of the control point as a client and the device as the server.
In
A UPnP device can provide many different types of services, depending on the functionality desired. Often these services will have an associated state table comprising a grouping of the services state variables. Each state variable would have a name, a type and a value, and would be used to keep track of what particular mode of operation or function is being provided. For example, a service that renders or plays audio tracks might keep a state variable that contains the URL of the current track being played. When the track changes, the service would send a state change notification with the new URL to all control points that have registered to receive events from the service.
The UPnP protocol provides a framework whereby control points can discover devices, invoke actions on a device's services and subscribe to events. Devices, on the other hand, respond to control point messages by invoking actions and sending events when state variables change. To support this basic interaction between control point and device, all UPnP devices adhere to the following phases of operation:
The middleware service may be implemented using one or more servers having suitable connectivity to the DTV server 12 and to the end user systems which implement a plug-and-play protocol. An example of such a server implementation has been illustrated in
The middleware service 10 encapsulates service objects 40, which may implemented as classes. The middleware service further includes a data store of service state variables, properties and attributes, shown diagrammatically at 42. The middleware service includes a set of functional programs for performing service actions, shown diagrammatically at 44.
The middleware service 10 is configured to initiate a message exchange with the object carousel 24, in order to determine what services are available. Examples of such services include providing directories, files, streams and service gateways. Information obtained from the object carousel 24 about its capabilities are then stored as service state variables at 42.
The middleware service is further adapted to communicate with the control point 30, adhering to the protocols utilized by the control point 30. For purposes of illustration, the UPnP protocol has been illustrated. Of course, other protocols are also possible within the scope of the invention. Communication can be effected by any suitable means, such as by XML document.
The control point 30 establishes communication with communication module 46 and initially interacts with the middleware service 10 to register a subscription to one or more services being made available through the middleware service 10. The control point subscribes to services that the user is interested in. Knowledge of which services are available is obtained by consulting the object carousel data store 44. As will be more fully explained below, the middleware service then includes the subscribed control point 30 in disseminating any pertinent information about the services being subscribed to. For example, if a particular service subscribed to becomes available or unavailable, this change of state information would be sent to control point 30.
The middleware service operates to encapsulate data objects from the object carousel 24 and to expose them through a well established protocol, such as a UPnP protocol. Thus, if the end user has requested delivery of a particular file or stream, this information is obtained from the object carousel (by utilizing the middleware service) and then delivered or routed to the end user device. The middleware service 10 performs the necessary protocol conversion, making the object carousel information appear to the end user device as if it had been provided to that device in its native plug-and-play form.
The middleware service thus effectively extends the reach of the broadcaster and data service provider, by allowing a wide range of plug-and-play devices to utilize the information and services provided by the broadcaster or data service provider. For example, a properly configured UPnP device, such as a personal computer, cellular telephone, or home network appliance, could be made to receive a media stream originally designed to be delivered to broadcast receiving devices like television sets. The middleware service thus has the potential to greatly enhance the value of broadcast services.
In some instances there may be a service offered by the broadcaster, such as an executable application, that cannot be directly supported by the end user device. The device may not be broadcast enabled, for example, or the device may be disconnected from the broadcast communication channel. The middleware service of the invention has the ability to host applications in this instance. Specifically, the middleware service 10 includes a host application execution environment 50, that may be used to allow a device to give the appearance of running the application, even though the application is actually being run elsewhere (on the middleware service, for example). Thus the middleware service provides companion service functionality. As will be seen, the ability to offer companion service functionality has wide-reaching implications for the providing of DTV services to plug-and-play devices of all descriptions, ranging from a low-featured set-top box to a full-featured with broadband connection.
Before presenting a more detailed description of the middleware service, a few examples of the service will be presented. Referring to
In some instances, the control point (or a logical device that is controlled by the control point) will have sufficient capability to execute the application object directly. In other instances, the control point or associated device may not have the necessary environment for computing capabilities. In such case, the middleware service 10 provides the needed execution platform, thereby associating with the control point 30 a companion service 74 that has the capability to execute and control the launched application 76. Thus, although some, or all, of the execution platform may be provided by the middleware service. From the viewpoint of the control point and its associated devices, the companion service appears the same as if it had been hosted on the control point or device directly. The service and/or control point may then interrogate the requesting entity's companion service about its execution environment available at that entity, to determine the suitability of the application being deployed there.
In operation, the middleware service 10 executes a sequence of steps, illustrated in
Having thus described the middleware service in some of its presently preferred forms,
The DTV middleware service 10 is programmed to provide a plurality of basic methods or actions. These have been listed at 96. As previously discussed, in connection with
In one presently preferred embodiment, the middleware service is configured to support the following actions:
In addition to the aforementioned actions, the DTV middleware service 10 is also programmed to provide message notifications to its subscribers. The notifications include, for example, listing object changes, providing object metadata change information and providing life cycle change event information. This set of notification functions has been illustrated at 98. In one presently preferred embodiment, the middleware service 10 provides the following service notifications:
In addition to the above notifications, the middleware service may also provide further state variable information, action information and notifications. This would include, for example, exposing timing information for event synchronization, such as whatever events are coming from the real-time transports streams as UPnP events, actions and state variables. These would include, for example, Normal Play Time (NPT) information. The middleware service would implement an action to get the NPT and would provide event notification when the NPT changes.
The net effect of the actions and notifications provided by middleware service 10 is summarized in block 100. Thus the middleware service operates to deliver objects, control execution environment, launch applications and control life cycle of application objects. The middleware service 10 may also be configured to supply pointers to applications (which may include protocol information on how and where to get the applications—which can be the URL where the application can be obtained). Through these functions, the middleware service is able to seamlessly integrate with the protocol of the control point 30, and with any associated devices and services operating under that protocol. Thus the middleware service 10 is able to effect changes in actions, events, descriptions and state variables associated with the control point and its associated devices and services.
In one presently preferred embodiment, the middleware service 10 provides a rich set of metadata pertaining to application objects. This metadata includes:
In addition to the above, the middleware service may also provide further metadata associated with DTV events (synchronization with stream events), application resource requirements, default user preferences and profiles, and “playlists” of application objects.
The middleware service can provide a handle for internet protocol (IP) channel “interconnection” point for other applications. This can be included in the metadata. Additional metadata describing the IP communication parameters may include:
If desired, the middleware service may be configured to provide other, extended functionality. For example, to run mulitimedia home platform (MHP) applications (e.g., Java applications), the MHP stack needs to be present at the box, but the box might lack broadcast or broadband connection. However, the device might be home network connected (i.e., a full-fledged UPnP device).
Applications coming in over object carousel can be sent to other boxes for execution (e.g., a new UPnP service can be delivered to another box). In this case, the control point discovers new applications as they are made available. The control point would instruct some other device to download a new application object from the primary source service. The middleware service delivers applications, their components and methods to obtain those necessary execution environment components.
The description of the invention is merely exemplary in nature and, thus, variations that do not depart from the gist of the invention are intended to be within the scope of the invention. Such variations are not to be regarded as a departure from the spirit and scope of the invention.
