The present invention generally relates to content display, and more particularly, to methods and systems for providing display device specific content over a network architecture.
With the advent of new content distribution technologies such as, for example, Very high rate Digital Subscriber Line (VDSL), or technologies that offer point to point connections with respect to a home and a content server, new application opportunities arise.
In consumer viewing, one of the issues that have been identified is that today's consumer displays and viewing situations cause alterations in picture representations so that the original color composition, the creator's intent, is not properly represented as the creator intended. It is to be noted that in cases of point to multipoint communication scenarios, as well as in cases of packaged media, it is a current practice to presume a standardized viewing device and a standardized viewing environment. In fact, this is the only feasible possibility with today's technology. However, it has therefore been found that one master picture cannot serve the variety of display configurations and viewing conditions currently encountered at the consumer side.
For example, currently imagery for home video viewing is color corrected mainly on studio monitors which are known to be highly accurate cathode ray tube
(CRT) monitors. However, although those are typically high quality display devices, in reality, cathode ray tube displays have less and less in common with the display devices that are actually and currently used in homes. The newer display devices used in homes differ in at least display brightness, color gamut, contrast ratio, spatial, and temporal behavior. The situation is further complicated given the fact that individual display technologies are diverging among themselves by new advances in backlight technology, power management, and so forth.
In addition, there is a completely new type of home viewing environment emerging with screens of one hundred inches or more in size. These new displays have completely new requirements with respect to the color grading process in a home video framework. In fact, the requirements of these particular viewing environments may be closer to digital cinema requirements than they are to home video requirements.
Embodiments of the present principles provide methods and systems for providing display device specific content over a network architecture.
In one embodiment of the present invention, a method for providing display device specific video content over a network includes determining a plurality of virtual model versions of the video content generated in accordance with a plurality of respective virtual device models, each of the plurality of virtual device models having a virtual model specification which represents at least one display feature of a particular reference display, and selecting a particular one of the plurality of virtual model versions for display based on a comparison of at least one of the display features of the virtual model specification and a display feature of an intended display for display. The method of the present invention can further include engaging in negotiations to permit a remote selection of a particular one of the plurality of virtual model versions based on a comparison of at least one of the at least one display feature of the virtual model specification of at least one of the plurality of virtual device models against an actual display feature included in a display specification of the intended display.
In an alternate embodiment of the present invention, a system for providing display device specific video content over a network includes at least one content server for storing a plurality of virtual model versions of the video content generated in accordance with a plurality of respective virtual device models, each of the plurality of virtual device models having a virtual model specification which represents at least one display feature of a particular reference display and at least one network attached unit for enabling a selection of a particular one of the plurality of virtual model versions for display based on a comparison of at least one of the display features of the virtual model specification and a display feature of an intended display.
In one embodiment of a system of the present invention, the at least one content server is configured to engage in negotiations to permit a remote selection of a particular one of the plurality of virtual device versions based on a comparison of at least one of the at least one display feature of the virtual model specification of at least one of the plurality of virtual device models against an actual display feature included in a display specification of the intended display. In the above described embodiment, an intended network attached unit can be configured to engage in negotiations with the at least one content server to perform a selection of a particular one of a plurality of virtual model versions of the content.
In an alternate embodiment of the present invention, an apparatus for providing display device specific video content over a network includes a decision matrix for selecting a particular one of a plurality of stored virtual model versions of the video content and communicating a request for the selected virtual model version, and a signal transformer for applying a transform to received video content for transforming received video content to the selected virtual model version for display. In various embodiments of the present invention, the apparatus can further include a database for storing at least one of virtual model versions, virtual device models and display features.
These and other aspects, features and advantages of the embodiments of the present invention will become apparent from the following detailed description of exemplary embodiments, which is to be read in connection with the accompanying drawings.
The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which:
It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention. To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures.
Embodiments of the present invention advantageously provide methods and systems for providing display device specific content over a network architecture. Although the present embodiments will be illustratively described primarily within the context of providing picture content using the International Organization for Standardization/ International Electrotechnical Commission (ISO/IEC) Moving Picture Experts Group-4 (MPEG-4) Part 10 Advanced Video Coding (AVC) standard/International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 recommendation (hereinafter the “MPEG-4 AVC standard”), the specific embodiments of the present invention should not be treated as limiting the scope of the invention. It will be appreciated by those skilled in the art and informed by the teachings of the present invention that the concepts of the present invention can be advantageously utilized with other video coding standards, recommendations, and extensions thereof, including extensions of the MPEG-4 AVC standard.
The functions of the various elements shown in the figures can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage. Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure).
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
As used herein, the acronym “VC denotes video content. In one embodiment of the present invention, there is one VC per movie feature or other picture product, which can include several virtual device model versions.
The acronym “VM” denotes virtual device model. The virtual device model represents the specification of a display or a group of displays. Regarding the phrase “VM Version”, there is one version of the content for each VM.
The acronym “VMS” denotes virtual device model specification. This is the specification of one particular VM, and includes specification details including, but not limited to, contrast ratio, signal accuracy, and other display parameters.
The acronym “ADS” denotes an actual device model specification. The ADS is the specification of one particular display. This ADS is used for choosing the VM version by matching the ADS and the VMS.
In the example of
In the embodiment of the system 100 of
Each user 141, 142, and 143, via the NAUs 131, 132, and 133, respectively, is capable of making a stream selection, respectively denoted as stream selection 1, stream selection 2, and stream selection 3, which is provided to the network database 110 via the network 120. The network database 110 then provides the selected stream(s) to the appropriate user via the network 120. The selected streams are ultimately provided as selected video to the appropriate display device.
Additionally, display and video content (VC) information is provided from the displays 151, 152, and 153 to the respective NAUs 131, 132, and 133 for use during negotiations between the displays 151, 152, and 153 and the respective NAUs 131, 132, and 133. The user associated equipment, namely the NAU 131 and display 151 for user 141, the NAU 132 and display 152 for user 142, and the NAU 133 and display 153 for user 143 correspond to a user side 199. The network database 110 corresponds to a server side 188. As such, in the exemplary system 100 of
As further described below, the respective display of a user transfers its ADS to a corresponding NAU. Thus, for example, with respect to user 141, display 151 transfers its ADS to NAU 131 which then compares this data with the reference data for the available content (ADS-VMS matching as further described below), and so on with respect to each of the users. An embodiment showing the ADS-VMS matching of an embodiment of the present invention is illustrated with respect to
Referring to
The second input of the decision matrix 263 may, for example signal a request 5013 to the content server 111, which can be located at a remote location, to download or stream one particular feature film that exists in several VM versions. The content server 111 provides a response 5014 to the request. The response 5014 signals what VM versions of that feature film are available for streaming/downloading.
Subsequently, the decision matrix 263 of the NAU 131 receives an ADS 5016 from the ADS unit 173 of the display 151. The Decision Matrix 263, on the other hand, accesses a VMS database that could be stored either locally or remotely picks the VMS according to the available VM versions. The Decision Matrix 263 then selects the VM that is the best fit for the particular display 151 by comparing, in one embodiment, a best match of the ADS with the VMS of the available VM versions. This decision 5013 is communicated to the content server 111 which then provides the VM version 5015 for streaming to the NAU 131. The NAU 131 then communicates the video signal to the display 151, in particular, the display portion 171. It is to be appreciated that in one or more embodiments, the content may have to be reformatted or decompressed prior to display on the display portion 171.
Advantageously, the above described embodiment of the present invention overcomes the typically encountered prior art deficiency of presuming a standardized viewing device and a standardized viewing environment by providing display device specific content for each group of displays and viewing environments or for each individual display and viewing environment. The different types of display content are made available for delivery to respective consumers for their respective display technology and viewing situation. Such individual displays and/or groups of displays can include, but are not limited to, for example, the following types of displays and display technologies: liquid crystal display (LCD); Plasma, cathode ray tube (CRT); digital light processing (DLP); and silicon crystal reflective display (SXRD).
In one embodiment, the system of the present invention use a point to point connection to provide consumers with a version of the picture material adapted to their display and viewing conditions. Of course, the present principles are not limited solely to the use of point to point connections and, thus, other types of connections and communication technologies can also be employed in accordance with the concepts of the present invention.
When delivering content, a decision is made which essentially selects only one version of the content. When broadcasting, only one version can be broadcasted per channel at one particular time. Using packaged media like digital video disks (DVDs), high-definition digital video disks (HD-DVDs), and Blue ray disks (BDs), in order to avoid confusion with multiple inventories, again only one version can be chosen for delivery. However, in accordance with alternate embodiments of the present invention, exceptions are made with respect to the preceding conventional approach.
Embodiments of the present invention are directed at least in part to addressing the storage of media content on a network server side, the selection of content according to negotiations with a network attached unit (NAU) side, the delivery of the media content to the NAU side (e.g., the retrieval of the content on the NAU side), and the negotiation process between the NAU and the attached display and/or the user. In one or more embodiments of the present invention, different VM versions based on the actual display and viewing environment are generated in addition to the “standard version(s)”. For example, in one embodiment of the present invention (hereinafter referred to as “content scenario 1”), each VM version is stored at a different location. In an alternate embodiment of the present invention (hereinafter referred to as “content scenario 2”), the different VM versions are encoded in a hierarchical manner. In yet an alternate embodiment of the present invention (hereinafter referred to as “content scenario 3”), the different VM versions have one “mother” content and metadata describing the transform for each VM.
In accordance with various embodiments of the present invention, on the content server side, the following exemplary implementation approaches can be used for the above described scenarios. For example, in the case of content scenario 1, the content server negotiates with the NAU about the selection of the VM version. There are several exemplary negotiation terms that can be used. One exemplary negotiation term is the ADS of the user display. In a selection process involving the ADS, content is selected for use by matching the ADS with all available VMSs, in order to find the best match. Another exemplary negotiation term is the eligibility of the NAU to receive a version of the content that is superior to the “standard version”. In one embodiment, this decision can be related to product pricing. The server then selects the corresponding version of the content for delivery to the NAU.
In the case of content scenario 2, the same general concept as applied for the above described content scenario 1 is used, but with the difference of having one database per VC. This is based on the concept of having one base video content, (the “standard version”) and one or several “enhancement layers”, each describing the difference between different VM Versions. In one embodiment of the present invention, these “enhancement layers” can be implemented in the uncompressed domain, where a simple difference picture between the standard version and the enhanced version is stored. However, it is advantageous to use more advanced possibilities such as a scalable encoding. In such an embodiment, a base layer compliant with the MPEG-4 AVC standard, in combination with one or several MPEG-4 AVC standard (scalable video encoders and/or decoders) compressed enhancement layers, are stored. One VM version can then be derived from the base layer plus at least one enhancement layer.
The following examples include embodiments of possible server implementation scenarios in the case of content scenario 2. One exemplary server implementation scenario (hereinafter referred to as “scenario 2, application 1”) involves delivering the whole database to the customer and letting the respective NAU extract the data that is relevant, determined by the ADS of the user display (see
For example,
In the case of content scenario 3, the same general concept of content scenario 1 is used, but with the difference of having one database per VC. This one database can be described as having a high quality “mother content” from which all VM versions could be derived. The derivation of a VM version is described by metadata that is stored along with the picture content. In various embodiments of the present invention, there is one set of metadata per VM. This metadata describes the signal transform from the “mother version” to the VM version according to the VMS.
The following are the possible server implementation scenarios in the case of content scenario 3 described above. In one embodiment of the present invention, one exemplary server implementation scenario (hereinafter referred to as “scenario 3, application 1”) involves delivering the “mother content” to the NAU, along with all metadata for all VM to the NAU. Then, the NAU extracts the metadata according to the ADS of the user display. The NAU or the display attached to the NAU then performs the signal transformation of the “mother content” to the VM version according to the metadata that accompanies the content (see
Content scenario 2, application 3 has a similar implementation on the user side that is described above with respect to
Content scenario 2, application 2 has a similar implementation on the user side as that described above with respect to
Content scenario 2, application 1 differs from the implementation on the user side as that described above with respect to
Referring to
The VMS database 261 has an output connected to a first input of a decision matrix 263. The decision matrix 263 further includes a second input and an output, both respectively available as an input and an output of the NAU 131, for respectively receiving and transmitting data to the server side 188. An output of the ADS unit 173, which is available as an output of the display 151, is connected to a third input of the decision matrix 263.
The signal transformer 865 includes a first input and a second input, both available as inputs to the NAU 131. The signal transformer 865 includes an output (available as an input of the NAU 131) connected to an input of the display portion 171 (available as an input of the display 151).
The process of selecting the VM version is similar to that described above with respect to the system 100 of
In an embodiment of the present invention, ADS data can be provided by the display manufacturer. The ADS data can be stored, for example in one embodiment, in a Read Only Memory (ROM) inside the display and read out for the purpose of content negotiation. This readout can occur once during a setup procedure or once per content selection. Of course, the storage of the ADS data is not limited solely to ROMs and any suitable storage or memory device can be utilized in accordance with the present invention. Such storage or memory device can be implemented and/or used in conjunction with the ADS unit 173 depicted in
Moreover, in an embodiment of the present invention, ADS data can also be provided by an external hardware device (s) or external software that analyzes the display properties and stores them in a Read Only Memory or other memory device. Even further, in an alternate embodiment of the present invention, ADS data can be provided by an external local or network based resource. For example, there may be a database that includes ADS data for several models of displays. This database would allow the uploading of ADS data to the NAU 131, depending on the product reference, in order to store them in a storage device.
Having described preferred embodiments for a method and system for providing display device specific content over a network architecture (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims. While the forgoing is directed to various embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2007/015245 | 6/28/2007 | WO | 00 | 12/16/2009 |