Patent Grant
8395993
The present invention relates to data communications in general and, in particular, to adaptive coding and modulation.
Service providers may desire to use communication systems to provide high availability to high-quality services for their subscribers. Where the network desires to communicate the same or similar information to multiple terminals, however, communications with each terminal may have different characteristics. In certain cases, each terminal may have different and/or changing link conditions (e.g., due to geographic differences in weather, proximity to sources of interference, etc.) In other cases, each terminal may have different capabilities for handling (e.g., receiving, processing, displaying, etc.) information from the network.
These different terminal characteristics may result in differences in apparent availability or quality of services to subscribers. Techniques like adaptive coding and modulation (ACM) may dynamically adjust coding and modulation schemes to adapt to these changing link conditions. For example, as link conditions change, the availability of services may be increased or maintained by using more reliable (lower order) coding and modulation schemes. However, the network may typically send the information at the most reliable modcode to ensure that the terminal with the worst link conditions may still receive the information.
Lower order modulation and coding schemes may use more bandwidth to send error correction data, making them less bandwidth efficient. Because communication systems have limited bandwidth, decreasing bandwidth efficiency may decrease the amount of service-related information that may be transmitted per unit time. This trade-off may mean that service providers will have to choose between providing services with high availability or with high quality.
Thus, there may be a need in the art for new ways to dynamically adjust transmission parameters with an awareness of terminal capabilities to improve both the availability and the quality of network services in differing link conditions.
An example of a network access unit of a load balancing communications network configured to communicate with multiple data terminals adapted to receive transmissions over a satellite link according to the disclosure includes: a source data receiver module adapted to receive multiple first source data, each first source data representing respective video content, and second source data representing broadband data content; a network control module adapted to receive link condition data about data terminals in the multiple data terminals and configuration data about the multiple first source data and the second source data, calculate priority data for the multiple first source data and the second source data based on the link condition data and the configuration data, use the priority data to generate a master schedule including program data indicating, for each of the multiple first source data, whether the respective first source data is to be transmitted with one or two layers, and transmit the master schedule to other components of the network access unit to configure parameters for a next sequence; a pre-coder module adapted to pre-code, for each first source data of the multiple first source data, the respective first source data using a respective first pre-coding scheme to generate a respective first set of representation data decodable independently to provide a set of first-level playback data representing the respective first source data, to determine if the program data of the master schedule indicates that the respective first source data is to be transmitted with two layers, and if the program data is determined to indicate that the respective first source data is to be transmitted with two layers, to pre-code the respective first source data using a respective second pre-coding scheme to generate a respective second set of representation data decodable in combination with the respective first set of representation data to provide a set of second-level playback data representing the respective first source data; and an ACM module adapted to associate, for each first source data of the multiple first source data, the respective first set of representation data with a respective first coding and modulation scheme, and associate, for each first source data indicated for transmission with two layers, the respective second set of representation data with a respective second coding and modulation scheme, wherein the respective second coding and modulation scheme is of a higher order than the respective first coding and modulation scheme.
Embodiments of such a network access unit may include one or more of the following features. Each of the first pre-coding schemes and the second pre-coding schemes includes a data partitioning scheme using scalable video coding. The network access unit further includes a transceiver module adapted to generate, for each first source data of the multiple first source data, a respective first transmission by applying the respective first coding and modulation scheme to the respective first set of representation data and applying, for each first source data indicated for transmission with two layers, the respective second coding and modulation scheme to the respective second set of representation data, to generate a second transmission from the second source data, and to communicate each of the first transmissions and the second transmission to respective data terminals of the multiple data terminals over the satellite link. The satellite link has a given bandwidth; and the network control module is adapted to generate the master schedule to indicate that available bandwidth is allocated to one or more of the first transmissions and the second transmission communicated to the respective data terminals, wherein the available bandwidth is made available by not transmitting a second layer for one or more of the multiple first source data.
The network control module is further adapted to generate the master schedule to include bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, wherein a sum of the first bit rate and the second bit rate equals a given bit rate of the respective first source data; and for each first source data indicated for transmission with one layer, the bit rate data for the respective first source data indicates that the first bit rate is lower than the first bit rates of other first source data indicated for transmission with two layers. For each first source data indicated for transmission with one layer, the respective set of first-level playback data representing the respective first source data provides, on playback, a single frame, a title screen, a lower frame rate version, a lower resolution version, or a lower bit rate version of the respective video content represented by the respective first source data. The network control module is adapted to use the priority data to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the link condition data indicates that an audience metric of the respective video content represented by the particular first source data is less than a threshold amount. The threshold amount for the audience metric is one of the following: a determined number of one or more viewers, a determined number of program requests from one or more viewers, or a program request from a network operator. When the network control module receives updated link condition data indicating that the audience metric of the respective video content represented by the particular first source data is equal to or greater than the threshold amount, the network control module is further adapted to generate an updated master schedule including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence. The updated master schedule also includes bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, wherein a sum of the first bit rate and the second bit rate equals a given bit rate of the respective first source data; and for the particular first source data indicated for transmission with two layers during the following sequence, the bit rate data of the updated master schedule indicates that the first bit rate for the particular first source data is to be higher during the following sequence.
The network control module is further adapted to receive network congestion data, to calculate the priority data based in part on the network congestion data, and to use the priority data to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the network congestion data received indicates a network congestion level that is equal to or greater than a threshold amount and the configuration data received indicates that a priority level of the particular first source data is lower than priority levels of other first source data and a priority level of the second source data. When the network control module receives updated network congestion data indicating that the network congestion level is less than the threshold amount or receives updated configuration data indicating that the priority level of the particular first source data has increased relative to the priority levels of the other first source data and the priority level of the second source data, the network control module is further adapted to generate an updated master schedule including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence.
An example of a load balancing communications network configured to communicate with data terminals in a satellite environment includes: multiple data terminals, each adapted to receive a transmission over a satellite link; and a gateway, in communication with the multiple data terminals and including: a source data receiver module adapted to receive multiple first source data, each first source data representing respective video content, and second source data representing broadband data content; a network control module adapted to receive link condition data about data terminals in the multiple data terminals and configuration data about the multiple first source data and the second source data, calculate priority data for the multiple first source data and the second source data based on the link condition data and the configuration data, use the priority data to generate a master schedule including program data indicating, for each of the multiple first source data, whether the respective first source data is to be transmitted with one or two layers, and transmit the master schedule to other components of the gateway to configure parameters for a next sequence; a pre-coder module adapted to pre-code, for each first source data of the multiple first source data, the respective first source data using a respective first pre-coding scheme to generate a respective first set of representation data decodable independently to provide a set of first-level playback data representing the respective first source data, to determine if the program data of the master schedule indicates that the respective first source data is to be transmitted with two layers, and if the program data is determined to indicate that the respective first source data is to be transmitted with two layers, to pre-code the respective first source data using a respective second pre-coding scheme to generate a respective second set of representation data decodable in combination with the respective first set of representation data to provide a set of second-level playback data representing the respective first source data; and an ACM module adapted to associate, for each first source data of the multiple first source data, the respective first set of representation data with a respective first coding and modulation scheme, and associate, for each first source data indicated for transmission with two layers, the respective second set of representation data with a respective second coding and modulation scheme, wherein the respective second coding and modulation scheme is of a higher order than the respective first coding and modulation scheme.
An example of a method for hierarchical communication of a set of source data in a load balancing communications network configured to communicate with multiple data terminals in a satellite environment, each of the data terminals adapted to receive a transmission over a satellite link, includes: receiving multiple first source data, each first source data representing respective video content; receiving second source data representing broadband data content; receiving link condition data about data terminals in the multiple data terminals and configuration data about the multiple first source data and the second source data; calculating priority data for the multiple first source data and the second source data based on the link condition data and the configuration data; using the priority data to generate a master schedule including program data indicating, for each of the multiple first source data, whether the respective first source data is to be transmitted with one or two layers; transmitting the master schedule to configure parameters for a next sequence; for each first source data of the multiple first source data, pre-coding the respective first source data using a respective first pre-coding scheme to generate a respective first set of representation data decodable independently to provide a set of first-level playback data representing the respective first source data; determining if the program data of the master schedule indicates that the respective first source data is to be transmitted with two layers; and if the program data is determined to indicate that the respective first source data is to be transmitted with two layers, pre-coding the respective first source data using a respective second pre-coding scheme to generate a respective second set of representation data decodable in combination with the respective first set of representation data to provide a set of second-level playback data representing the respective first source data; and for each first source data of the multiple first source data, associating the respective first set of representation data with a respective first coding and modulation scheme; and for each first source data indicated for transmission with two layers, associating the respective second set of representation data with a respective second coding and modulation scheme, wherein the respective second coding and modulation scheme is of a higher order than the respective first coding and modulation scheme.
Embodiments of such a method may include one or more of the following features. Each of the first pre-coding schemes and the second pre-coding schemes includes a data partitioning scheme using scalable video coding. The method further includes: generating, for each first source data of the multiple first source data, a respective first transmission by applying the respective first coding and modulation scheme to the respective first set of representation data and applying, for each first source data indicated for transmission with two layers, the respective second coding and modulation scheme to the respective second set of representation data; generating a second transmission from the second source data; and communicating each of the first transmissions and the second transmission to respective data terminals of the multiple data terminals over the satellite link. The satellite link has a given bandwidth; and using the priority data to generate the master schedule further includes generating the master schedule to indicate that available bandwidth is allocated to one or more of the first transmissions and the second transmission communicated to the respective data terminals, wherein the available bandwidth is made available by not transmitting a second layer for one or more of the multiple first source data.
Using the priority data to generate the master schedule further includes generating the master schedule to include bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, wherein a sum of the first bit rate and the second bit rate equals a given bit rate of the respective first source data; and for each first source data indicated for transmission with one layer, the bit rate data for the respective first source data indicates that the first bit rate is lower than the first bit rates of other first source data indicated for transmission with two layers. For each first source data indicated for transmission with one layer, the respective set of first-level playback data representing the respective first source data provides, on playback, a single frame, a title screen, a lower frame rate version, a lower resolution version, or a lower bit rate version of the respective video content represented by the respective first source data. Using the priority data to generate the master schedule further includes using the priority data to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the link condition data indicates that an audience metric of the respective video content represented by the particular first source data is less than a threshold amount. The threshold amount for the audience metric is one of the following: a determined number of one or more viewers, a determined number of program requests from one or more viewers, or a program request from a network operator. Receiving link condition data about data terminals further includes receiving updated link condition data indicating that the audience metric of the respective video content represented by the particular first source data is equal to or greater than the threshold amount; and using the priority data to generate the master schedule further includes generating an updated master schedule including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence. Generating the updated master schedule further includes generating the updated master schedule to include bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, wherein a sum of the first bit rate and the second bit rate equals a given bit rate of the respective first source data; and for the particular first source data indicated for transmission with two layers during the following sequence, the bit rate data of the updated master schedule indicates that the first bit rate for the particular first source data is to be higher during the following sequence.
The method further includes: receiving network congestion data, wherein calculating priority data for the multiple first source data and the second source data further includes calculating the priority data based in part on the network congestion data, and using the priority data to generate the master schedule further includes using the priority data to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the network congestion data received indicates a network congestion level that is equal to or greater than a threshold amount and the configuration data received indicates that a priority level of the particular first source data is lower than priority levels of other first source data and a priority level of the second source data. Receiving network congestion data and receiving configuration data further includes receiving updated network congestion data indicating that the network congestion level is less than the threshold amount or receiving updated configuration data indicating that the priority level of the particular first source data has increased relative to the priority levels of the other first source data and the priority level of the second source data; and using the priority data to generate the master schedule further includes generating an updated master schedule including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence.
Items and/or techniques described herein may provide one or more of the following capabilities. In a communications system where video programs and broadband data are transmitted to data terminals on a satellite link, the video and broadband data can be prioritized, and the priorities can be combined with network congestion data and terminal link condition data to load balance the traffic in the network. The priorities can be assigned in any number of ways, and the load balancing techniques allow the system to be dynamically optimized to balance availability with efficient transmission of video and data. The system can determine that a video program should be transmitted with one or two layers or not transmitted at all, depending on priorities, network congestion, and/or link conditions. Bandwidth made available by transmitting the video program with fewer layers or with lower bit rates can be utilized to increase reliability in transmission of higher priority video programs and broadband data. While item/technique-effect pairs have been described, it may be possible for a noted effect to be achieved by means other than those noted, and a noted item/technique may not necessarily yield the noted effect.
A further understanding of the nature and advantages of the present invention may be realized by reference to the following drawings. In the appended figures, similar components or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label by a lower-case character or a dash and a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
This description provides exemplary embodiments only, and is not intended to limit the scope, applicability, or configuration of the invention. Rather, the ensuing description of the embodiments will provide those skilled in the art with an enabling description for implementing embodiments of the invention. Various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the invention.
Among other things, the description provides methods, systems, and devices for dynamically adjusting transmission parameters with an awareness of terminal capabilities to improve both the availability and the quality of network services in differing link conditions.
Turning first to
In some embodiments, the communication network 100 includes a satellite communication network in which the network access unit 110 is a gateway, adapted to transmit information to network data terminals 120. The network data terminals 120 may include subscriber terminals, including devices having satellite receivers. For example, the network data terminals 120 may include satellite telephones, global positioning satellite (“GPS”) units, satellite radios, etc.
In other embodiments, the communication network 100 includes a cellular communication network in which the network access unit 110 is a cell (or multiple cells), adapted to transmit information to network data terminals 120, including devices having cellular receivers (e.g., cell phones). In yet other embodiments, the communication network 100 includes other types of networks, including local area networks, wide area networks, secure networks, the Internet, etc. The communication network 100 uses one or more other types of communication links 130, including short-range wireless links, long-range wireless links, cellular links, optical links, wired links, parallel links, etc.
In these and other communication networks 100, service providers may desire to provide high availability to high-quality services for their subscribers. Where the communication network 100 desires to communicate the same or similar information to multiple data terminals 120, however, communications with each data terminal 120 may have different characteristics. These different data terminal 120 characteristics may result in differences in apparent availability or quality of services to subscribers.
In one embodiment, various data terminals 120 in a network have different and/or changing link conditions for their respective communication links 130. For example, in a satellite network, one data terminal 120 may be a satellite receiver mounted on a house located in an adverse weather area, another data terminal 120 may be a global positioning satellite (“GPS”) receiver located in a car in an underground parking garage, and a third data terminal 120 may be a satellite radio receiver located in a vehicle moving through a city. Each of these data terminals 120 may see different link conditions with the network access unit 110, and some of these data terminals 120 may see dynamically changing link conditions.
In another embodiment, various data terminals 120 in a network have different capabilities for handling information from the communication network 100. For example, a network subscriber may be able to access video on both a cellular telephone and a home high-definition television (“HDTV”). The cellular telephone may have lower resolution, a smaller screen, a less reliable communication link, etc. Still, the subscriber may wish to experience the media on both devices (e.g., by previewing the video on the cellular phone during a commute and watching the full, HDTV version after arriving at home).
It will be appreciated that different data terminal 120 characteristics may result in differences in apparent availability or quality of services to subscribers. Various techniques may dynamically adjust coding and modulation schemes to adapt to these changing link conditions. For example, techniques like adaptive coding and modulation (“ACM”) may increase or maintain the integrity of services as link conditions change by using more reliable (e.g., lower order) coding and modulation schemes.
Lower order modulation and coding schemes may use more bandwidth to send error correction data, making them less bandwidth efficient. Because the communication network 100 may have limited bandwidth, decreasing bandwidth efficiency may decrease the amount of service-related information that may be transmitted per unit time over each communication link 130. This trade-off may mean that service providers will have to choose between providing services with high availability or with high quality. Further, because the communication network 100 may determine how to send information according to the data terminal 120 with the worst link conditions (i.e., so that terminal may still receive the information), local changes in link condition may adversely impact the performance (e.g., integrity, throughput, etc.) of the entire communication network 100.
For these and other reasons, it may be desirable for the communication network to adapt its transmissions based on characteristics of individual data terminals 120, rather than based on the network as a whole. For example, transmissions may be dynamically optimized to provide higher quality services and/or higher service availability to individual data terminals 120, regions, etc. that are able to support it. As such, regional changes in link conditions may only affect services to those regions, without affecting the network as a whole.
It will be further appreciated that, in some embodiments, multiple data terminals 120 may be associated with each other in one or more ways. In some embodiments, multiple data terminals 120 are associated, so that content received by one data terminal 120 is also received by others. Making the communication network 100 aware of this association may allow the communication network 100 to provide additional adaptive functionality. For example, the communication network 100 may be able to adapt to the combined capabilities of the data terminals 120 or in some other way.
In one embodiment, a first data terminal 120-1 is a cellular telephone with low-definition video display capability, and a second data terminal 120-2 is a networked high-definition television, located at a subscriber's premises and associated with the first data terminal 120-1. While commuting, the subscriber uses the first data terminal 120-1 to request download of a favorite television show available online. Low definition content is distributed to the subscriber's cellular telephone (e.g., because that may be all the cellular telephone can display) at a relatively low order modcode (e.g., to provide a more reliable transmission while the subscriber commutes through various regions of the network). At the same time, a high definition version of the same content may begin to download to the subscriber's high definition television (the second data terminal 120-2) at a higher order modcode (e.g., the higher definition data may be able to be transmitted with less overhead because of the relatively stable link condition of the television).
In another embodiment, a first data terminal 120-1 is a cellular telephone with low-definition video display capability, and a second data terminal 120-2 is a networked high-definition television, located at a subscriber's premises and associated with the first data terminal 120-1. Again, while commuting, the subscriber uses the first data terminal 120-1 to request download of a favorite television show available online. Low definition content is distributed to the subscriber's cellular telephone (e.g., because that may be all the cellular telephone can display) at a relatively low order modcode (e.g., to provide a more reliable transmission while the subscriber commutes through various regions of the network). At the same time, content optimized for use by the second data terminal 120-2 may begin to download to cache memory in the first data terminal 120-1 (e.g., higher definition data may be transmitted at the same or a different modcode as the lower definition data). When the subscriber reaches the subscriber's premises, the first data terminal 120-1 and the second data terminal 120-2 may be communicatively coupled (e.g., synched through a wired or wireless connection), by which the higher definition data (or at least the portion of data that has been cached) may be directly transferred to the second data terminal 120-2.
In still another embodiment, a first data terminal 120-1 and a second data terminal 120-2 both subscribe to the same massively multiplayer online game. It may be desirable to adapt transmission of game content as a function of the capabilities of both data terminals (i.e., 120-1 and 120-2). For example, this may help ensure that no one player has an advantage due to a better communication link, or that certain important game data is lost or out of synchronization due to differences in capabilities.
Of course, there are many ways of implementing and exploiting terminal aware adaptive communications.
The method 200 begins at block 204 by determining a capability metric of a designated data terminal. The capability metric may define any useful capability of the terminal that may affect the terminal's ability to handle (e.g., receive, use, etc.) content over the network. In one embodiment, the capability metric relates to a capability of the communication link between the network access unit and the designated data terminal. For example, the capability metric may relate to communication link characteristics, including bandwidth, throughput, bit error rates, etc. In another embodiment, the capability metric relates to a receiving capability of the designated data terminal. For example, the capability metric may relate to the designated data terminal's antenna, protocol compatibility, buffering capability, etc. In still another embodiment, the capability metric relates to a playback capability of the designated data terminal. For example, the capability metric may relate to the designated data terminal's screen resolution or fidelity, audio playback fidelity, etc.
Further, the capability metric may be determined at block 204 in many different ways. In some embodiments, the network access unit or other network element is adapted to test certain capability metrics either directly or indirectly. For example, a network tester module in the network access unit may be adapted to send test data through the network and track the communication to approximate bandwidth measurements. In other embodiments, the data terminals may be adapted to communicate certain capability metrics (e.g., or information useful in generating the capability metrics) to the network access unit. It will be appreciated that many other ways of generating capability metrics are possible, according to embodiments of the invention.
In some embodiments, the same or other techniques may be used to generate the same or other capability metrics from other data terminals in block 208. In some embodiments, all or a portion of the data terminals in the network are evaluated to generate macro-metrics of the capabilities of all or part of the network. For example, capability metrics may be generated for multiple data terminals to generate a minimum, maximum, average, median, or other statistically useful result. In one embodiment, the network access unit keeps track of a minimum capability metric, for example, to be able to transmit at least for a worst-case capability.
It will be appreciated that the capability metrics generated in blocks 204 and 208 may be used in a number of ways. In some embodiments, a capability map may be generated. In one embodiment, the map is used to understand capabilities of the network by either data terminal, geographic region, data terminal type, account holder, etc. In another embodiment, content may be offered at least partially as a function of the capability map.
At block 212, content is received as source data. For example, the source data may include an audiovisual data file. Embodiments of the method 200 generate communication data for communicating the source data to one or more data terminals in the network, at least including the designated terminal. Some of these embodiments use ACM aware encoding schemes, as described more fully below.
In some embodiments, a first pre-coding scheme is determined at block 216 and a second pre-coding scheme is determined at block 224. In certain embodiments, the first and/or second pre-coding schemes are determined at least partially as a function of the capability metrics generated in blocks 204 and/or 208. The pre-coding schemes may further be determined as a function of characteristics of the source data (e.g., the type, priority, file size, etc.).
The pre-coding schemes determined in blocks 216 and 224 may then be applied to the source data to generate first and second sets of representation data in blocks 220 and 228, respectively. As discussed more fully below, embodiments of the invention use hierarchical pre-coding schemes, resulting in hierarchical representation sets of the source data. For example, the first pre-coding scheme may generate a base layer of the source data (e.g., the most basic information needed to be able to recreate the source data at some resolution or fidelity), and the second pre-coding scheme may generate an enhancement layer of the source data (e.g., additional information useful for enhancing the recreation of the source data, like data for increasing resolution or color depth). It will be appreciated that any number of pre-coding schemes may be used, according to embodiments of the invention. For example, additional enhancement layers may be generated for additional hierarchical representations of the source data.
In some embodiments, a first coding and modulation scheme is determined at block 232 and a second coding and modulation scheme is determined at block 240. In certain embodiments, the first and/or second coding and modulation schemes are determined at least partially as a function of the capability metrics generated in blocks 204 and/or 208. The coding and modulation schemes may further be determined as a function of characteristics of the source data (e.g., the type, priority, file size, etc.).
At blocks 236 and 244, the coding and modulation schemes determined in blocks 232 and 240 may be associated with the representation data sets generated in blocks 220 and 228. In some embodiments, the first coding and modulation scheme is applied to the first representation data set in block 236 and the second coding and modulation scheme is applied to the second representation data set in block 244. In other embodiments, a signal coding and modulation is applied to multiple representation data sets. In still other embodiments, multiple coding and modulation schemes are applied to single representation data sets.
It will be appreciated that these and other techniques may be used to generate a hierarchical encoding of the source data. At block 248, the method 200 generates a transmission for the designated data terminal. It is worth noting that, because the source data was encoded at least partially as a function of the capabilities of the designated data terminal, the transmission may be optimized for communication with the designated data terminal. The transmission may be communicated to the designated data terminal at block 252.
In some embodiments, at block 256, the method 200 generates a transmission for other data terminals, including or in addition to the designated data terminal. It is worth noting that, because the source data was encoded at least partially as a function of the capabilities of other data terminals in certain embodiments, the transmission may be optimized for communication with a portion of the network (or the entire network). The transmission may be communicated to the other data terminals at block 260.
In one embodiment, the communication is generated in block 256 by applying the first, high-reliability, coding and modulation scheme to the first representation data set, to generate a high-reliability transmission of a base layer of the source data. This high-reliability base layer representation may then be broadcast to the entire network at block 260. A second communication is generated in block 248 by applying the second, lower-reliability, coding and modulation scheme to the second representation data set, to generate a lower-reliability transmission of an enhancement layer of the source data. The lower-reliability enhancement layer data may then be unicast to the designated data terminal at block 252. Alternately, the lower-reliability enhancement layer data may be combined (e.g., multiplexed) with the first communication (e.g., high-reliability base layer) data to generate the second communication. The multiplexed data may then be unicast to the designated data terminal at block 252.
It will be appreciated that many types of communication network 100 are possible for providing terminal aware communications. Systems and methods for providing terminal aware communications, including providing ACM-aware hierarchical encoding for handling different terminal conditions, are shown in
The network 320 may be any type of network and can include, for example, the Internet, an IP network, an intranet, a local- or wide-area network, a virtual private network, the Public Switched Telephone Network (“PSTN”), or any other type of network supporting data communication between devices described herein, in different embodiments. A network 320 may include both wired and wireless connections, including optical links. The network 320 may also transmit information about link conditions for one or more data terminals 330 to the gateway 315. The network 320 may connect the terminal aware network access unit 315 with other gateways (not pictured), which are also in communication with the satellite 305, and which may share information on link conditions and other network metrics.
The terminal aware network access unit 315 provides an interface between the network 320 and the data terminal 330. The terminal aware network access unit 315 may be configured to receive data and information directed to one or more data terminals 330, and can format the data and information for delivery to the respective destination data terminal 330 via the satellite 305. Similarly, the terminal aware network access unit 315 may be configured to receive upstream signals from the satellite 305 (e.g., from one or more data terminals 330) directed to a destination in the network 320, and can format the received signals for transmission along the network 320.
For example, the terminal aware network access unit 315 may use ACM to generate a layered transmission of the information. ACM may allow the satellite communication system 300 to dynamically adjust the coding and modulation schemes applied to transmissions to adapt to changing link conditions. Lower order coding and modulation schemes may use lower order modulation and lower information densities to provide more reliable transmission of information over the communication link. Thus, while lower order coding and modulation schemes may be more reliable, they may also be less bandwidth efficient (e.g., less information may be transmitted per unit bandwidth per unit time). This may mean that, in order to maintain the availability of communications over the satellite communication network 300 in changing link conditions, service providers may have to change the amount of information transmitted to their subscribers per unit time.
Table 1 (below) provides a purely exemplary set of data to further clarify the trade-off between availability and bandwidth efficiency. As such, the data in Table 1 should not be construed as limiting the scope of the invention. Referring to Table 1, the leftmost column shows the availability of an exemplary communication system ranging from 99% to 99.99%. The remaining columns, from left to right, show metrics relating to the link margin, signal-to-noise ratio, coding and modulation scheme, and bandwidth efficiency of the exemplary communication system, respectively. As illustrated by Table 1, lower order coding and modulation schemes are used to increase availability of the network (i.e., the coding and modulation scheme is changed from 16APSK 3/4 to QPSK 3/4 to increase availability from 99% to 99.99%). The illustrative result shows a decrease in bandwidth efficiency from 2.97 to 1.32, almost a 60% decrease in bandwidth efficiency.
In some embodiments, the terminal aware network access unit 315 may further use hierarchical pre-coding schemes at least in part to mitigate the trade-off between availability and bandwidth efficiency. In certain embodiments, hierarchical pre-coding schemes may include simulcasting (simultaneously broadcasting) multiple versions of a set of source data (e.g., standard- and high-definition versions of a video stream). In other embodiments, hierarchical pre-coding schemes may include scalable pre-coding schemes, data partitioning schemes, and other pre-coding schemes, as described below. In certain embodiments, the hierarchically pre-coded data may be adaptively coded and/or modulated for transmission over the communication link in a layered fashion. In this way, it may be possible to affect either or both of availability and bandwidth efficiency per each hierarchical data layer, adding flexibility to the satellite communication system 300.
In certain embodiments, the terminal aware network access unit 315 may use either or both of ACM and hierarchical pre-coding schemes. In one example, multiple hierarchical layers are created, but a single coding and modulation scheme is used for all the layers. In another example, a single layer may be sent using multiple coding and modulation schemes. In other embodiments, the terminal aware network access unit 315 may pre-code, code, and/or modulate only a portion of the data. For example, the terminal aware network access unit 315 may detect that only enough bandwidth is available to transmit a single layer over the communication link. In this case, it may be efficient for the terminal aware network access unit 315 to generate only a single layer for some or all of the incoming source data.
A device connected to the network 320 may communicate with one or more data terminals 330 through the gateway 315. Data and information, for example IP datagrams, may be sent from a device in the network 320 to the gateway 315. A variety of physical layer transmission modulation and coding techniques may be used with certain embodiments of the invention, including those defined with the DVB-S2 and WiMAX standards. In a number of embodiments, the terminal aware network access unit 315 utilizes ACM in conjunction with one or more hierarchical data pre-coding schemes described herein to direct traffic to the individual terminals. The terminal aware network access unit 315 may use a broadcast signal, with a modulation and coding format adapted for each packet to the link conditions of the data terminal 330 or set of data terminals 330 to which the packet is directed (e.g., to account for the variable service link 350 conditions from the satellite 305 to each respective data terminal 330).
The terminal aware network access unit 315 may use an antenna 310 to transmit the signal or signals to the satellite 305. In one embodiment, the antenna 310 comprises a parabolic reflector with high directivity in the direction of the satellite and low directivity in other directions. The antenna 310 may be implemented in a variety of alternative configurations. The downstream signals may include, for example, a number of single carrier signals. Each signal carrier signal may be divided (e.g., using Time Division Multiple Access, or “TDMA”) into a number of virtual channels. The virtual channels may be the same size, or different sizes. In other embodiments, other channelization schemes may be used, such as Frequency Division Multiple Access (“FDMA”), Orthogonal Frequency Division Multiple Access (“OFDMA”), Code Division Multiple Access (“CDMA”), or any number of hybrid or other schemes known in the art.
In one embodiment, a geostationary satellite 305 is configured to receive the signals from the location of antenna 310 and within the frequency band and specific polarization transmitted. The satellite 305 may process the signals received from the terminal aware network access unit 315 and forward the signal from the terminal aware network access unit 315 to one or more data terminals 330. In some embodiments, only a portion of the data terminals 330 may be able to receive some or all of the signals due to certain link conditions.
In another embodiment, the satellite 305 operates in a multi-beam mode, transmitting a number of narrow beams each directed at a different region of the earth, allowing for frequency re-use. This satellite 305 may be configured as a “bent pipe” satellite, wherein the satellite may frequency convert the received carrier signals before retransmitting these signals to their destination, but otherwise perform little or no other processing on the contents of the signals. A variety of physical layer transmission modulation and coding techniques may be used by the satellite 305 in accordance with certain embodiments of the invention, including those defined with the DVB-S2 and WiMAX standards. For other embodiments, a number of configurations are possible (e.g., using LEO satellites, or using mesh networks instead of star networks), as known in the art.
The service signals 350 transmitted from the satellite 305 may be received by one or more data terminals 330, via the respective subscriber antenna 325. The data terminals 330 may receive the signals from the satellite 305 under very diverse link conditions. In certain embodiments, the data terminals 330 may decode the received signals differently based on how they are received in different link conditions.
In one embodiment, the antenna 325 and terminal 330 together comprise a very small aperture terminal (“VSAT”). In other embodiments, a variety of other types of antennas 325 may be used at the data terminal 330 to receive a signal. Each of the data terminals 330 may comprise a single user terminal or, alternatively, a hub or router (not pictured) that is coupled to multiple user terminals. In some embodiments, each data terminal is connected to additional systems, devices, components, etc. (e.g., consumer premises equipment (“CPE”), computers, local area networks, Internet appliances, wireless networks, etc.).
In one embodiment, a Multi-Frequency Time-Division Multiple Access (“MF-TDMA”) scheme is used for upstream links 340, 345, allowing efficient streaming of traffic while maintaining flexibility in allocating capacity among each of the data terminals 330. In this embodiment, a number of frequency channels are allocated which may be fixed, or which may be allocated in a more dynamic fashion. A TDMA scheme is also employed in each frequency channel. In this scheme, each frequency channel may be divided into several timeslots that can be assigned to a connection (i.e., a data terminal 330). In other embodiments, one or more of the upstream links 340, 345 may be configured with other schemes, such as FDMA, OFDMA, CDMA, or any number of hybrid or other schemes known in the art.
A data terminal 330 may transmit information related to signal quality to the terminal aware network access unit 315 via the satellite 305. The signal quality may be a measured signal to noise ratio, an estimated signal to noise ratio, a bit error rate, a received power level, or any other communication link quality indicator. The data terminal 330 itself may measure or estimate the signal quality, or it may pass information measured or estimated by other devices. This signal quality information may be used by the terminal aware network access unit 315 in some embodiments to adapt pre-coding schemes or coding and modulation schemes to match link conditions.
A data terminal 330 may also transmit data and information to a network 320 destination via the satellite 305 and terminal aware network access unit 315. The data terminal 330 transmits the signals via the upstream uplink 345 to the satellite 305 using the antenna 325. A data terminal 330 may transmit the signals according to a variety of physical layer transmission modulation and coding techniques, including those defined with the DVB-S2 and WiMAX standards. In various embodiments, the physical layer techniques may be the same for each of the links 335, 340, 345, 350, or may be different.
The functions of the components of the satellite communication system 300 may be implemented in a number of different ways. For example, some or all of the functionality of the terminal aware network access unit 315 or the data terminals 330 may be implemented in other components of the system, for example in the satellite 305. Further, many embodiments of terminal aware network access units 315 and data terminals 330 are possible according to the invention.
In some embodiments, the terminal aware network access unit 400 includes a receiver unit 420, a pre-coder unit 430, a controller unit 440, and a transceiver unit 450. The terminal aware network access unit 400 may receive a set of source data 410, process the data using various components, and transmit the data over a communication link 460.
In some embodiments, the terminal aware network access unit 400 includes the receiver unit 420, which receives the set of source data 410. The set of source data 410 may include, for example, audio data, video data, voice data, or any other type of data. The receiver unit 420 may include any hardware, software, or other components necessary to receive the set of source data 410. For example, the receiver unit 420 may include amplifiers, buffers, ports, codecs, etc. In one embodiment, the set of source data 410 includes an audio-visual data stream, which is received by the receiver unit 420 from a data network through a data port.
The receiver unit 420 may pass all or a portion of the set of source data 410 to the pre-coder unit 430. The pre-coder unit 430 may pre-code the portion of the set of source data 410 to generate sets of representation data. The sets of representation data may contain any type of information, including information extracted or adapted from the set of source data 410, which is useful for generating a representation of the set of source data 410. For example, a set of representation data may contain enough information extracted from a source video stream to allow the generation of a lower-resolution version of the video stream. In another example, the set of representation data may include color or texture information, which may be added to other sets of representation data to generate an enhanced version of the source video stream.
In certain embodiments, the pre-coder unit 430 applies certain pre-coding schemes, including scalable pre-coding schemes, data partitioning schemes, etc. In one embodiment, where the set of source data 410 includes an audio-visual data stream, the pre-coder unit 430 may pre-code the audio-visual data stream into various hierarchical sets of representation data by using the scalable capabilities of the Moving Picture Experts Group-4 (MPEG-4) standard. In another embodiment, where the set of source data 410 includes an audio-visual data stream, the pre-coder unit 430 may pre-code the audio-visual data stream into various hierarchical sets of representation data by using the data partitioning capabilities of the H.264 adaptive video coding (H.264/AVC) standard. Embodiments of pre-coding schemes are described more fully below.
In some embodiments, multiple pre-coding schemes may, in reality, be implemented as multiple functions of a single pre-coding scheme. In one embodiment, multiple scalable pre-coding schemes are implemented by using a single MPEG-4 pre-coding algorithm to generate multiple layers of output (i.e., the generation of a base layer and enhancement layers using MPEG-4 may be inextricably linked). In another embodiment, multiple data partitioning pre-coding schemes are implemented by using one data partitioning algorithm to slice the set of source data 410 into multiple data partitions. As such, it will be appreciated that phrases like “multiple pre-coding schemes” and “a first pre-coding scheme” should be broadly construed to encompass at least single pre-coding schemes capable of producing multiple different outputs.
The sets of representation data may be passed from the pre-coder unit 430 to the controller unit 440, which may associate each set of representation data with a coding and modulation scheme. For example, a first set of representation data may correspond to first-level (e.g., low resolution) playback of the set of source data 410, and a second set of representation data may correspond to second-level (e.g., higher resolution, enhanced) playback of the same set of source data 410. The controller unit 440 may associate the first set of representation data with a lower order coding and modulation scheme (e.g., quadrature phase-shift keying with 1-to-4 forward error correction (QPSK 1/4)) to better ensure the transmission of data for at least first-level playback. The controller unit 440 may associate the second set of representation data with a higher order coding and modulation scheme (e.g., 8PSK 7/8), reducing the transmission reliability of less critical enhancements for savings in power and bandwidth. Embodiments of coding and modulation schemes are described more fully below.
In some embodiments, the controller unit 440 may be configured to control all or some of the operations of the pre-coder unit 430. For example, the controller unit 440 may determine certain parameters, which the pre-coder unit 430 may use to pre-code the set of source data 410. In one embodiment, the controller unit 440 determines a set of scaling parameters for the pre-coder unit 430 to use with a scalable pre-coding scheme to generate sets of representation data. It will be appreciated that the controller unit 440 may determine how to control the pre-coder unit 430 based on different types of information. For example, the controller unit 440 may receive information relating to link conditions, as described more fully below.
In certain embodiments, the controller unit 440 may receive terminal-related capability metrics, as described above, from a terminal awareness unit 435. The capability metrics may then be used to determine one or more pre-coding schemes, coding and modulation schemes, etc. The terminal awareness unit 435 may receive and/or generate capability metrics in any effective way, for example as described with reference to the method 200 of
The controller unit 440 may pass the coded and/or modulated data to a transceiver unit 450. The transceiver unit 450 may process the data into one or more signals for transmission (e.g., by buffering or amplifying the data), and may pass the signal to a communication link 460. The transceiver unit 450 may include any hardware, software, or other components necessary to transmit the signals or to interface with the communication link 460.
In some embodiments, signals are transmitted by the terminal aware network access unit 400 over the communication link 460 to one or more data terminals.
In some embodiments, signals are received by the data terminal 500 at a receiver unit 510. The receiver unit 510 may include any hardware, software, or other components necessary to receive the signals. The received signals may include the sets of representation data generated by a terminal aware network access unit (e.g., terminal aware network access unit 110 of
In poor link conditions (e.g., heavy rain), higher order coding and modulation schemes may fail to provide reliable signal transmission over the communication link 460. For example, signals may be corrupted in transmission, arriving at the data terminal 500 with low power, high bit error rates, low signal-to-noise ratios, etc. As such, in certain link conditions, sets of representation data transmitted using lower order coding and modulation schemes may be reliably transmitted to the data terminal 500, while other sets of representation data may fail to be reliably transmitted.
Received signals may be passed to a decoder unit 520 for decoding. It will be appreciated that certain amounts and types of data may need to be extracted from the signals to permit decoding. Thus, signals, which fail to be reliably received by the receiver unit 510, may also fail to be decoded reliably by the decoder unit 520. Of course, the decoder unit 520 may include any hardware, software, or other components helpful for decoding data in various conditions. For example, the decoder unit 520 may have access to various error correction, de-multiplexing, formatting, and other routines.
In some embodiments, the data terminal 500 may be capable of decoding received signals in multiple modes 524. The modes 524 may relate, for example, to decoding for different levels of playback. In certain embodiments, modes 524 may be determined based in part on which sets of representation data are received, and whether enough data from those sets is reliably received, so the data may be decoded by the decoder unit 520. When sufficient data is received from a particular set of representation data, the mode 524 may switch to utilize that data. The data terminal 500 may use one or more of the modes 524 as a default, and be able to switch to other modes 524 either manually or automatically.
In some embodiments, the decoder unit 520 includes a threshold detector 522, which detects whether enough data is being reliably received to allow the decoder unit 520 to provide higher level playback. Because different sets of representation data may be transmitted using different coding and modulation schemes, some sets of representation data (e.g., those transmitted with higher order coding and modulation schemes) may fail to be reliably received by the data terminal 500 under certain link conditions. Depending on whether the threshold is being met, the decoder unit 520 may be configured to provide different levels of playback by decoding signals in different modes 524.
In one embodiment, a first set of representation data (representing low level playback of a set of source data) is transmitted with a very low order coding and modulation scheme. In this way, the first set of representation data may almost always be reliably received by the data terminal 500. The reliable receipt of the first set of representation data also means that the decoder unit 520 may almost always be able to decode sufficient information to generate a set of low level playback data. As such, the decoder unit 520 may be configured to operate by default in a first mode 524-1. In this first mode 524-1, the decoder unit 520 may decode only those signals which provide the first set of representation data, providing a subscriber with the ability for low level playback 526-1 at almost all times.
In this embodiment, at times, signals are received by the data terminal 500 which contain a second set of representation data. This second set of representation data (representing high level playback of a set of source data) may be transmitted with a higher order coding and modulation scheme, making its receipt less reliable in some link conditions. The threshold detector 522 may monitor the received signals to determine whether some threshold amount of the second set of representation data is being reliably received. When the threshold amount of the second set of representation data is not being reliably received, the data terminal 500 may remain in mode 1524-1. When the threshold detector 522 detects that the threshold amount of the second set of representation data is being reliably received, the data terminal 500 may enter mode 2524-2. In mode 2524-2, the decoder unit 520 may generate a set of second-level playback data 526-2.
It will be appreciated that other numbers and types of modes 524 are possible, and the modes 524 may be implemented in different ways. In some embodiments, different levels of playback data include base and enhancement layers of a single data type (e.g., layers of an image). In other embodiments, different levels of playback data include different types of data to be combined for playback (e.g., text versus images versus videos on a webpage). It will be further appreciated that modes 524 may be selected manually, or as a result of other conditions, and may be implemented in hardware or software.
The decoder unit 520 may generate a set of playback data 526 to allow different levels of playback of the source data. The generated set of playback data 526 may be output to playback or other equipment or components (e.g., a display, sound card, etc.), for example, through a port 550. It will be appreciated that the set of playback data 526 may be further processed or other hardware, software, etc. may be provided to interface with different types of ports 550, devices, systems, and/or components.
In other embodiments, the data terminal 500 may include a data store 530, which may be communicatively coupled with the decoder unit 520. The data terminal 500 may be configured to save data decoded by the decoder unit 520 in the data store 530 either all the time or on certain conditions. In one embodiment, a subscriber manually selects times when data should be stored in the data store 530 for later playback.
In certain embodiments, data is automatically stored in the data store 530 based on the signal quality of the received signals. At certain times (e.g., in certain weather, because of bandwidth constraints, or due to other link conditions), only a portion of the sets of representation data relating to a particular set of source data may be reliably received by the data terminal 500. At these times, it may be desirable to accumulate related data in the data store 530 as it is received. It will be appreciated that many ways to accumulate related data in the data store 530 are known in the art. For example, a relational database may be used, which stores each decoded dataset in relation to the set of source data to which it relates. In these embodiments, it may be possible to store the first set of representation data while link conditions are poor, and wait to receive additional sets of representation data when link conditions improve.
In some embodiments, the data terminal 500 may generate notifications relating to which sets of representation have been received, decoded, and/or stored. In one embodiment, a subscriber may set the data terminal 500 to automatically generate a notification when at least two sets of representation data have been stored in the data store 530 relating to a particular set of source data. In another embodiment, the data terminal 500 may periodically send notifications to a service provider requesting transmission (or re-transmission) of certain sets of representation data. For example, if a set of representation data fails to be reliably received, the data terminal 500 may notify the sender to retransmit the set of representation data, possibly using a lower order coding and modulation scheme.
It will now be appreciated that many embodiments and configurations of the terminal aware network access unit 315 and the data terminals 500 are possible according to the invention. These various embodiments may be further understood with regard to various block diagrams, like those shown in
Turning to
Preferably, each pre-coding scheme 624 is different from each other pre-coding scheme 624 in some way, generating hierarchal (or layered or partitioned) output. Purely by way of example, some or all of the different pre-coding schemes 624 may use different codecs, parameters, transformations, transcoding, algorithms, and other techniques to affect resolution, quantization, bit rate, temporality, quality, spatiality, complexity, or any other useful characteristic of the data.
In some embodiments, the pre-coder unit 430 is communicatively coupled with a processor unit 610. In some embodiments, the processor unit 610 may be part of the controller unit 440 of
In one embodiment, three pre-coding schemes (624-1, 624-2, and 624-3) are used to generate three sets of representation data (622-1, 622-2, and 622-3), respectively. The three sets of representation data (622-1, 622-2, and 622-3) may correspond to three hierarchical layers of representation of the set of source data 410. Each of these sets of representation data 622 may be stored in a representation data store 620.
Further embodiments of the functionality in
In this set of embodiments, a set of source data 410 passes to the pre-coder unit 430. The pre-coder unit 430 pre-codes the set of source data 410 using a scalable pre-coding scheme 624. Scalable pre-coding schemes 624 may divide the set of source data 410 into different hierarchical layers. In some embodiments, a first (lowest-level) layer is called the base layer and higher layers are called enhancement layers. A scalable pre-coding scheme 624 may intend to achieve graceful degradation of the picture quality. For example, by providing the capability to playback data at a number of different levels, the pre-coding scheme 624 may avoid suffering from the “all or nothing” effect observed in some non-scalable coding systems.
In some embodiments, the scalable pre-coding scheme 624 may exploit different compression techniques to produce bit streams that are decodable at different bit rates. In one embodiment, a base layer contains the most critical information for playback that is determined to be “good enough” for a consumer. In this embodiment, enhancement layers may contain less critical information, like higher color depths, texturing, or resolution. Using this pre-coding scheme 624, it may be possible to provide a consumer with more reliable access to the base layer, such that a “good enough” level of playback is almost always available.
It will be appreciated that various types of scalability may be used. Purely by way of example, scalabilities may include quality, temporal, spatial and complexity scalability, in order to accommodate heterogeneous networks, different devices, various link conditions, or other communication environments. Among these scalabilities, various spatial and temporal scalable pre-coding schemes 624 may be known in the art, such as MPEG-2, MPEG-4, and H.263++. In addition, certain fine-granularity scalable (“FGS”) pre-coding schemes 624 may be known in the art. For example, MPEG-4 standard (Part-2) may incorporate a FGS technique with the pre-coder unit 430 using the motion-compensated discrete cosine transform (“DCT”) to generate a base layer as the lowest-level layer. Residual information between the original image and the reconstructed base layer image may be used to form one or more enhancement layers. An enhancement layer may be generated with a bit plane coding technique, which may provide fine granularity quality and temporal scalabilities.
Further, in certain embodiments, scalable pre-coding schemes 624 may provide error correction capabilities. For example, the MPEG-4 standard (Part-2) may be used to predict base layers and enhancement layers of future frames by using data from present frames. Using predicted data in the context of received data may allow correction of any bit stream truncation or lost packets, and may allow future frames to be more reliably recreated.
Regardless of the type or types of scalable pre-coding schemes 624 used, it may be preferable for each pre-coding scheme 624 to provide different scaling results for generating hierarchal output. Further, in some embodiments, the pre-coder unit 430 may be communicatively coupled with a processor unit 610, such that the processor unit 610 may control all or part of the functionality of the pre-coder unit 430. For example, the processor unit 610 may be configured to generate or select scaling parameters.
In one embodiment, one pre-coding scheme 624 is used with three scaling parameters (626-1, 626-2, and 626-3) to generate three sets of representation data (622-1, 622-2, and 622-3), respectively. The three sets of representation data (622-1, 622-2, and 622-3) may correspond to three hierarchical layers of representation of the set of source data 410. For example, the first set of representation data 622-1 may include base layer information, while the other two sets of representation data (622-2 and 622-3) may include enhancement layer information. Each of these sets of representation data 622 may be stored in a representation data store 620.
Various data partitioning pre-coding schemes 624 may be known in the art. For example, data partitioning capabilities may be included in the H.264/AVC standard. According to this standard, the pre-coder unit 430 may divide the set of source data 410 into three separate data partitions 628.
In one embodiment, three data partitions 628 may be defined to provide different levels of information representing the set of source data 410. A first partition 628-1 may contain syntax elements from header information within the set of source data 410, including macroblock types, quantization parameters, and motion vectors. A second partition 628-2 may contain intra-coded block patterns and transform coefficients. The second partition 628-2 may, for example, use various spatial prediction modes to exploit spatial statistical dependencies in the set of source data 410 for a single video frame. A third partition 628-3 may contain inter-coded block patterns and transform coefficients. The third partition 628-3 may, for example, use motion vectors for block based inter prediction to exploit block-shaped regions of each video frame in the set of source data 410.
The information contained in the first partition 628-1 (e.g., the header information of the set of source data 410) may represent a small portion of the set of source data 410, but it may be very critical to the recreation of the set of source data 410. For example, a “good enough” (or even a relatively high-quality) representation of the set of source data 410 may be recreated from only the information contained in the first partition 628-1, like macroblock types and motion vectors. On the contrary, information contained in the second partition 628-2 and the third partition 628-3 may be less critical while representing larger portions of the set of source data 410. Further information contained in the second partition 628-2 and the third partition 628-3 may be useful only in conjunction with information from the first partition 628-1.
It will be appreciated that other numbers and types of partitions are possible. Further, other steps may be required or desired as part of data partitioning pre-coding schemes 624. Regardless of the type or types of data partitions 628 used, it may be preferable for each pre-coding scheme 624 to use those data partitions 628 to provide hierarchal output. Further, in some embodiments, the pre-coder unit 430 may be communicatively coupled with a processor unit 610, such that the processor unit 610 may control all or part of the functionality of the pre-coder unit 430. For example, the processor unit 610 may be configured to generate or select data partitions 628.
In one embodiment, one data partitioning pre-coding schemes 624 is used with three data partitions 628 (628-1, 628-2, and 628-3) to generate three sets of representation data (622-1, 622-2, and 622-3), respectively. The three sets of representation data (622-1, 622-2, and 622-3) may correspond to three hierarchical partitions of the set of source data 410. For example, the first set of representation data 622-1 may include critical header information, while the other two sets of representation data (622-2 and 622-3) may include less critical intra- and inter-coded block patterns and transform coefficients. For example, using the H.264/AVC standard, the data partitions 628 may be encapsulated into separate network abstraction layer (NAL) packets, which may be collated into the sets of representation data 622. Each of these sets of representation data 622 may be stored in a representation data store 620.
In various embodiments, the scalable pre-coding schemes 624-2 and the data partitioning pre-coding schemes 624-1 may be used in different orders to provide the same or different results. In one embodiment, the scalable pre-coding schemes 624-2 may create base and enhancement layers of the set of source data 410, and the data partitioning pre-coding schemes 624-1 may divide some or all of those layers into different partitions. In another embodiment, the data partitioning pre-coding schemes 624-1 may divide the set of source data 410 into a number of partitions, which may then be layered using the scalable pre-coding schemes 624-2.
It will be appreciated that various scalable and data partitioning pre-coding schemes 624 may be known in the art. Further, it will be appreciated that different types of pre-coding schemes 624 may manifest various drawbacks. For example, many data partitioning pre-coding schemes 624-1 (e.g., H.264/AVC) may lack flexibility in the creation of data partitions 628. Additionally, many scalable pre-coding schemes 624-2 (e.g., FGS) may degrade compression efficiencies. Some combinations of pre-coding schemes 624 may be able to minimize some of these drawbacks.
In the embodiment shown in
In one embodiment, H.264/AVC data partitioning pre-coding schemes 624-1 are used to generate the three data partitions (628-1, 628-2, and 628-3). For example, as described above with respect to
In this embodiment, the first partition 628-1 may be further pre-coded, using the first scaling parameter 626-1, thereby generating a first set of representation data 622-1. The second partition 628-2 may be further pre-coded into two layers, using both scaling parameters (626-1 and 626-2), thereby generating second and third sets of representation data (622-2 and 622-3). The third partition 628-3 may also be further pre-coded into two layers, using both scaling parameters (626-1 and 626-2), thereby generating fourth and fifth sets of representation data (622-4 and 622-5). It will be appreciated that further pre-coding the second and third data partitions (628-2 and 628-3) may create layers based on any useful characteristic of the partitioned data. For example, the base layers of the data partitions (e.g., what generated the second and fourth sets of representation data (622-2 and 622-4)), may contain coarsely quantized DCT coefficients, while the enhancement layers of the data partitions (e.g., what generated the third and fifth sets of representation data (622-3 and 622-5)), may contain refinement information from which a finer quantization can be obtained.
In some embodiments, the pre-coder unit 430 may be communicatively coupled with a processor unit 610, such that the processor unit 610 may control all or part of the functionality of the pre-coder unit 430. In certain embodiments, the processor unit 610 may be configured to generate or select data partitions 628. In other embodiments, the processor unit 610 may be configured to generate or select scaling parameters 626. In still other embodiments, the processor unit 610 may be configured to generate or select both data partitions 628 and scaling parameters 626. It will be appreciated that the processor unit 610 may be utilized in many ways to add capabilities and flexibility to the functionality of the pre-coder unit 430. For example, the data partitioning and layering may be adjusted flexibly according to system throughput requirements and link conditions. To achieve greater flexibility, the pre-coding schemes 624 may be configured to dynamically change numbers and types of data partitions 628, numbers and types of scaling parameters 626, etc.
In addition to the many functions and capabilities of the pre-coder unit 430, various embodiments may provide many different coding and modulation capabilities.
Each identifier 710 is associated with a coding and modulation scheme 705. For example, identifier “1” 710-1 is associated with a first coding and modulation scheme 705-1, representing quadrature phase shift keying with a one-to-four forward error correction (“FEC”) rate (QPSK 1/4). In some embodiments, each identifier 710 may be a pointer to a set of information (e.g., an algorithm or a set of parameters) needed to implement its associated coding and modulation scheme 705.
According to the table of identifier data 722, a shift from identifier “1” 710-1 to identifier “4” 710-2 maintains the same modulation order (QPSK) while increasing the information density of the FEC (from 1/4 to 1/2). The coding and modulation scheme 705-2 associated with identifier “4” 710-2 generates half as many error correction bits for each information bit as does the coding and modulation scheme 705-1 associated with identifier “1” 710-1.
It will be appreciated that different implementations may use different types of coding and modulation schemes 705. It will further be appreciated that different tables of identifier data 722 may be configured to have different margins between the coding and modulation schemes 705 or to associate the identifiers 710 differently. For example, a table of identifier data 722 may include only every third entry shown on the table of identifier data 722 in
When link conditions are poor (e.g., low signal-to-noise ratio), lower order modulation schemes and low information densities may be required for reliable delivery of data. This may result in fewer data bits being sent per unit time as well as inefficient uses of power and bandwidth. When link conditions are good, higher order modulation schemes may be used with higher information density. This may allow more data bits to be sent per unit time with more efficient usage of power and bandwidth.
In many communication systems, the situation may be complicated by the fact that data is being sent to multiple subscribers with different characteristics (e.g., in different geographic locations, having different receiving capabilities, having different entitlement levels, etc.). When data packets are addressed to a single terminal (unicast), the packets may be sent using the most efficient coding and modulation scheme 705 that the communication link will support. However, when data packets are addressed to many receivers (multicast or broadcast), the packets may have to be sent using the coding and modulation scheme 705 that the receiver with the worst link in the group can support. When link conditions affect only a portion of the subscribers (e.g., a localized rain fade), this may result in inefficient network usage. Thus, link conditions may change dynamically per unit time, per subscriber, or based on other parameters.
By using certain ACM techniques, coding and modulation schemes 705 may be dynamically selected to match changing link conditions. In one embodiment, coding and modulation schemes 705 are selected by using the identifiers 710 and the table of identifier data 722. The coding and modulation schemes 705 are then encapsulated, coded, mapped, and transmitted in any of a variety of ways, as known in the art. ACM is then implemented using the DVB-S2 standard, which specifically provides for its use. It will be appreciated that other implementations are possible, for example, including systems using DOCSIS or WiMAX.
In some embodiments, the table of identifier data 722 and any other related information may be stored in an identifier store 720. The identifier store 720 may store the table of identifier data 722 in any useful way. For example, the table of identifier data 722 may be hard-wired into a microchip or stored as a flat file or a relational database.
In some embodiments, the processor unit 810 is communicatively coupled with the representation data store 620 and the identifier data store 720. The representation data store 620 may be configured to store sets of representation data 622 and the identifier data store 720 may be configured to store a table of identifier data 722. In certain embodiments, the processor unit 810 may be configured to process data from both the representation data store 620 and the identifier data store 720 to generate a set of output data 820. In other embodiments, the processor unit 810 may be configured to control at least a portion of the generation or processing of the data stored in either or both of the representation data store 620 and the identifier data store 720.
The capabilities and functionality of the processor unit 810 are discussed further in
In some embodiments, the processor unit 810 may receive sets of representation data 622 from the pre-coder unit 430. The sets of representation data 622 may pass through a multiplexer unit 910. The multiplexer unit 910 may multiplex the data in any useful way, for example, by time division multiplexing (“TDM”), frequency division multiplexing (“FDM”), wavelength division multiplexing (“WDM”), code division multiplexing (“CDM”), polarization, or any other effective technique.
The multiplexer unit 910 may be communicatively coupled with an ACM unit 920. The ACM unit 920 may be further communicatively coupled with an identifier data store 720 and configured to receive identifier data stored at the identifier data store 720. Using the identifier data, the ACM unit 920 may implement ACM on the multiplexed data coming from the multiplexer unit 910 to generate a set of output data 820.
In one embodiment, the ACM unit 920 is implemented as a single module, which is configured to accept only a single stream of data. In this embodiment, the purpose of the multiplexer unit 910 may be to produce serial data for use by the single-stream ACM unit 920. Packets of information belonging to sets of representation data 622 coming from the pre-coder unit 430 may be tagged with information that represents to which of the sets of representation data 622 each packet belongs. For example, packets of data may be appended with header information that includes a designator number representing a particular set of representation data 622. Using the tags, the multiplexer unit 910 may multiplex the data from the multiple sets of representation data 622 to produce a single stream of data for the ACM unit 920.
In another embodiment, the set of source data (not shown) received by the pre-coder unit 430 includes data for multiple source programs (e.g., multiple video streams). At times (e.g., when link conditions are substantially static), the pre-coder unit 430 may be configured to pre-code each of the multiple source programs into the same sets of representation data 622, using the same pre-coding schemes. For example, a set of source data for a first program and a set of source data for a second program may each be pre-coded into a base layer and an enhancement layer. The multiplexer unit 910 may multiplex the two base layers (i.e., one from each program) into one data stream and multiplex the two enhancement layers into a second data stream. The two data streams each may then pass to the ACM unit 920.
In some embodiments, the ACM unit 920 generates a set of output data 820. The set of output data 820 may include one or more signals configured to be transmitted over a communication link 460. The signal or signals may be coded and/or modulated as dictated by the ACM unit 920. Further, the signal or signals may be coded and/or modulated in any additional way or combination of ways for transmission over the communication link 460. It will be appreciated that one or more signals may not be included in the set of output data. For example, at times when insufficient bandwidth is available for sending multiple signals, the output data may include only one signal or only one set of representation data 622.
It will be appreciated that the processor unit 810 may be configured in different ways according to the invention. For example, turning to
Other configurations may also be possible according to the invention. In some embodiments, the ACM unit 920 may include a channel coding unit and a modulation unit. In one embodiment, each of the channel coding unit and the modulation unit may be independently controllable or may be configured to work in conjunction with one another. In another embodiment, the multiplexer unit 910 may multiplex multiple streams of data coming from the channel coding unit with different coding schemes and pass them as a single stream of data to the modulation unit.
Returning to
In some embodiments, the ACM unit 920 is further communicatively coupled to a profiler unit 930. The profiler unit 930 may be communicatively coupled with the communication link 460 and the pre-coder unit 430. The profiler unit 930 may also be configured to determine certain communication link profiles relating to the communication link 460. It will be appreciated that the profiler unit 930 may generate communication link profiles by detecting or receiving data intrinsic to and/or extrinsic to the communication link 460, by receiving information from other systems or components, or in any other useful way.
In one embodiment, the profiler unit 930 periodically or continuously determines signal-to-noise ratios (“SNRs”) relating to the communication link 460 for use as communication link profiles. For example, the profiler unit 930 may sample signals received at one end of the communication link 460 to determine the SNRs of the signals. Further, the SNRs may be recorded for statistical processing (e.g., to determine average SNRs or to determine SNR by signal type), for logging (e.g., to keep a record of SNRs at different times of day or in different link conditions), or for other reasons. It will be appreciated that the SNRs may be detected at either end of the communication link 460 (e.g., at either the network access unit end or the data terminal end) and by any effective method.
In another embodiment, the profiler unit 930 determines the bandwidth of the communication link 460 to generate a communication link profile. Similarly, the bandwidth of the communication link 460 may be provided to the profiler unit 930 manually or by another component, either before or when the communication link profile is generated. It will be appreciated that many other useful characteristics may be detected from the communication link 460 to generate communication link profiles, including, for example, throughput, hop count, path length, physical latency, bit error rate, power consumption, power availability, excess bandwidth, traffic congestion, etc.
In yet another embodiment, the profiler unit 930 determines an audience metric, which may be used as a communication link profile. There may be many ways to determine an audience metric. For example, the audience metric may be determined by detecting the number of subscribers receiving a signal, the number of subscribers playing back the signal (e.g., watching the video data), polling subscribers to determine the number of subscribers planning to playback the signal. In some embodiments, the signal may include multicast information (information transmitted to subscribers who have joined the multicast stream). In those embodiments, the audience metric may relate to the number or type of subscribers who have joined the multicast stream.
In still another embodiment, the profiler unit 930 may determine or receive a receiver capability, which may be used as a communication link profile. In some embodiments, a data terminal may include a receiver for receiving signals from the communication link 460. The receiver may have limited capabilities, due to limitations, for example, in a port or antenna, in a playback mechanism, in a decoding mechanism, etc. For example, a subscriber may be receiving video signals on a mobile phone. The phone may have a small screen with limited resolution, a small antenna with limited range, a small battery with limited power, etc.
In even another embodiment, the profiler unit 930 may determine or receive authorization to transmit signals over the communication link 460 in certain ways, which may be used as a communication link profile. In some embodiments, subscribers may have accounts with a service provider, which are associated with certain entitlement information. For example, a subscriber may be able to purchase a base package, which entitles the subscriber to receive and/or playback only base layer information generated by a scalable pre-coding scheme (e.g., a low-resolution video). Other subscribers may be able to purchase the additional entitlement to receive and/or playback enhanced layers (e.g., a high-definition video). In other embodiments, other parties may be at least partially responsible for the generation of the communication link profiles. For example, a backbone provider may allocate certain bandwidths to certain applications at certain times of the day.
It will be appreciated that the profiler unit 930 may provide and/or include some or all of the functionality of the terminal awareness unit 435 of
In some embodiments, the profiler unit 930 is communicatively coupled with either or both of the ACM unit 920 and the pre-coder unit 430. Thus, in certain embodiments, the profiler unit 930 may use communication link profiles to determine certain parameters of pre-coding schemes used by the pre-coder unit 430 (e.g., scaling parameters, data partitions, etc.), or to assign identifiers to appropriate coding and modulation schemes. In other embodiments, the profiler unit 930 may generate, modify, or otherwise influence the functionality of both the ACM unit 920 and the pre-coder unit 430 in other ways to best suit data to various communication link profiles.
In an embodiment where the profiler unit 930 generates communication link profiles using an audience metric, different audience metrics may be used in different ways. For example, the bandwidth required for a popular program may be permitted to increase at the expense of less popular programs. To this effect, the popular program may be encoded at a high bit rate, and sent using a very low order (reliable) modulation and coding scheme. Alternately, the least popular programs may be encoded at a low bit rate, and sent using a high order modulation and coding scheme. In a satellite communication system according to this embodiment, one result may include an improved balance between the overall fixed bandwidth of the satellite transponder and service quality and availability.
In another embodiment, the profiler unit 930 generates communication link profiles at least in part based on weather patterns. As the weather worsens, link conditions may also worsen, decreasing the reliability of data transfers over the communication link 460. To compensate for worsening conditions, the profiler unit 930 may direct the ACM unit 920 to increase transmission reliability by using lower order coding and modulation schemes (e.g., lower order modulation schemes, lower information density, etc.). The change in coding and modulation schemes may be implemented, for example, by assigning identifiers to lower order coding and modulation schemes in a table like the identifier data table 722 of
In yet another embodiment, the profiler unit 930 generates communication link profiles at least in part based on notifications generated by a data terminal 330. As discussed above with reference to
In still another embodiment, the profiler unit 930 may generate communication link profiles based on a variety of different types of data. For example, the profiler unit 930 may receive a notification from a data terminal requesting retransmission of a set of representation data 622. The profiler unit 930 may poll the communication link 460 to determine its bandwidth, waiting to detect that excess bandwidth is available. When excess bandwidth is available on the communication link 460, the profiler unit 930 may direct the ACM unit 920 to retransmit the requested set of representation data 622 using a very reliable (but bandwidth inefficient) coding and modulation scheme.
As illustrated, the first set of representation data 622-1 is associated with identifier “1” 710-1, which is further identified with a QPSK 1/4 coding and modulation scheme 705-1. The second set of representation data 622-2 is associated with identifier “2” 710-2, which is further identified with a second coding and modulation scheme 705-2. The second coding and modulation scheme 705-2 represents the same order modulation scheme (i.e., QPSK) as the first coding and modulation scheme 705-1, but with higher information density (i.e., 3/5 provides fewer error correction bits per information bit than 1/4). The third set of representation data 622-3 is associated with identifier “3” 710-3, which is further identified with a third coding and modulation scheme 705-3. The third coding and modulation scheme 705-3 represents a higher order modulation scheme than the second coding and modulation scheme 705-2 (i.e., 8PSK instead of QPSK), but with the same information density (i.e., 3/5). Thus, the first set of representation data 622-1 may be transmitted with the highest reliability, relative to the other sets of representation data (622-2 and 622-3).
As illustrated, the first set of representation data 622-1 is still associated with identifier “1” 710-1, which is still further identified with a QPSK 1/4 coding and modulation scheme 705-1. No change is made to these assignments, as the QPSK 1/4 coding and modulation scheme is the most reliable option provided in the identifier data store 720. However, the second set of representation data 622-2 associated with identifier “2” 710-2 is now further associated with a new coding and modulation scheme 705-4 (QPSK 1/2). The new coding and modulation scheme 705-4 represents the same order modulation scheme (i.e., QPSK) as the second coding and modulation scheme 705-2 used in
The features of the various embodiments of
The method 1100 may begin by receiving a set of source data at block 1110. The set of source data may be any type of data, for example audio-visual data. The set of source data may be pre-coded at block 1120, using various pre-coding schemes. The pre-coding at block 1120 may generate sets of representation data at block 1130.
At block 1140, the sets of representation data generated at block 1130 may be associated with identifiers. In some embodiments, each identifier is associated with a coding and modulation scheme at block 1150. As such, each set of representation data may be associated to a coding and modulation scheme.
In some embodiments, a communication link profile is determined at block 1160. The communication link profile may relate to link conditions, receiver capabilities, subscriber entitlement, audience metrics, or any other useful characteristic of the communication environment in which the method 1100 is being implemented. In certain embodiments, assignments in either or both of blocks 1140 and 1150 may be dynamically adjusted to adapt to information from the communication link profile determined at block 1160.
At block 1170, ACM is performed on the sets of representation data using their associated coding and modulation schemes to generate one or more signals. In some embodiments, the signals may be multiplexed at block 1180 to generate a single signal for transmission. The signal or signals may then be transmitted over a communication link at block 1190.
In some embodiments, multiple modes may be available for decoding the signals. At block 1230, a mode determination may be made. This mode determination may be based on any useful parameter, like signal quality of the received signals. In a first embodiment, a default mode is used at block 1240-1, resulting in a selection of “Mode 1” at block 1250-1. In a second embodiment, at block 1240-2, the received signal contains only a first set of representation data, or other sets of representation data cannot be reliably decoded (e.g., they are received with high bit error rates). In this second embodiment, “Mode 1” is also selected at block 1250-1. In a third embodiment, multiple sets of representation data are received at block 1240-3, allowing decoding for a high level playback of the set of source data. In this third embodiment, a second mode, “Mode 2,” is selected at block 1250-2. At block 1260, the data decoded in the various modes at blocks 1240 may be output for playback.
In some embodiments, the network access unit 1305 includes one or more transcoders 1310 (i.e., transcoders for channel 0, 1, . . . , N), a network interface unit 1330 (e.g., a satellite network interface unit for communication in the satellite communication system of
Generally, a channel does not correspond to a specific frequency. A channel is a resource that can be allocated to a broadcaster. A channel can be subdivided in time into multiple programs. For example, multiple video program input sources can be spliced together in time into a single output channel.
The network control unit 1320 can integrate configuration commands from network operators and status information from various sources to control the transcoders 1310, the network interface unit 1330, and the modulator 1340, e.g., in real time. The transcoders 1310 can receive a number of video feeds and encode them as data streams (e.g., data streams in the format of the Scalable Video Coding (SVC) extension to the H.264/AVC standard) using parameters that are configured through the network control unit 1320. Possible parameters include parameters that control the bit rate of each program, the proportion of the bit rate allocated to each layer of each program, the satellite bandwidth (e.g., as a function of the modcode(s)) the program will utilize, and the availability of the base and enhancement layers of the program. The network interface unit 1330 can multiplex multiple programs as channel streams and format the streams for transmission (e.g., broadcast) via the modulator 1340.
The transcoders 1310 can accept video feeds on various interfaces (e.g., an Actuator Sensor Interface and/or Ethernet) encoded in various formats (e.g., MPEG-2, MPEG-4, H.264, etc.). The transcoders 1310 decode the video and then encode it as H.264/SVC programs, e.g., in real time. In some embodiments, the transcoders 1310 encode the data using a different data partitioning scheme or a scalable pre-coding scheme. In some embodiments, after the transcoders 1310 encode the data, the encoded data is stored for later transmission.
The SVC encoder portion of a transcoder 1310 can be configured per channel. A channel can be subdivided in time into multiple programs, which are further divided into sequences. A sequence is a period of time in which the configuration of the SVC encoder for the channel (i.e., the program during that sequence) is constant. The encoder configuration can change without disrupting the channel and can change, for example, by operator intervention, according to a schedule based on service level agreements, and/or according to an automatic scheme, e.g., a scheme that optimizes the channel based on some network status criteria. In some embodiments, the encoder configuration is implemented according to a master schedule, which is broadcast periodically by the network control unit 1320 to the transcoders 1310 and the network interface unit 1330.
In some embodiments, the encoder configuration parameters determine the bit rate of the program, and thus the quality of the base and enhancement layers of the program. In some embodiments, the encoder configuration parameters indicate that a program will not be transmitted or, if the program will be transmitted, whether one layer (i.e., the base layer) or multiple layers (i.e., a base layer and an enhancement layer) of the program will be transmitted. The network control unit 1320 can associate the encoder configuration parameters with the modcode(s) used to broadcast the program to optimize the program for increased availability or increased broadcast efficiency. For example, an operator could increase the availability of the more popular programs and increase efficiency (e.g., sending only a base layer) for the programs with the smallest audience. In some embodiments, programs without an audience can be dropped (i.e., not transmitted).
The transcoders 1310 can be implemented as a combination of high-speed central processing units (CPUs) and field-programmable gate arrays (FPGAs). In some embodiments, a single transcoder hardware node can handle one or more channels.
The transcoders 1310 send encoded data to the network interface unit 1330, e.g., via Ethernet. The network control unit 1320 creates a logical association between the network interface unit 1330 and a transponder 1310 or a contiguous portion of a transponder 1310. The network control unit 1320 configures the network interface unit 1330 to associate a program with modcode(s) used to broadcast the program.
The network interface unit 1330 multiplexes multiple channels from one or more transcoders 1310 and formats the channels into packets for broadcast via the modulator 1340 and/or for routing over the network (e.g., the Internet). The network interface unit 1330 also multiplexes broadband data destined for the data terminals. The broadband data, received as broadband data feeds, are routed through the network control unit 1320 to the network interface unit 1330, and further routed to the data terminals via the modulator 1340. A modcode is determined for the broadband data based on the link condition of the data terminal that will receive the broadband data. The network interface unit 1330 can use the master schedule to generate a set of modcode configurations. Modulator control messages are generated from the modcode configurations, inserted into the output data packet stream of the network interface unit 1330, and sent (e.g., via Ethernet) to the modulator 1340, so that the channels (i.e., the programs associated with the channels during that sequence) are sent using the appropriate modcode(s).
In some embodiments, multiple instances of a network interface unit 1330 can run on a single piece of hardware. In some embodiments, the network interface unit 1330 can be implemented as a commercial, off-the-shelf server.
The network control unit 1320 can implement a broadcast network by combining multiple transcoder banks and network interface units with configuration data (e.g., configuration instructions) from operator(s) and status information collected by a variety of sources. The status information can be real time and can include, for example, network congestion data, weather radar (e.g., Next-Generation Radar) data, and/or link condition data from a variety of sources, which the network control unit 1320 can use to generate link condition models for one or more data terminals. The configuration data, the status information, and the link condition models can be used to adapt the broadcast to optimize the system for increased capacity or reliability.
The network control unit 1320 can create the association between a satellite transponder and a set of network interface units, transcoders, and channels by configuring the bandwidth and output frequency of the modulator and by configuring the routing of packets from the transcoders and network interface units. The network control unit 1320 also controls the flow of video data and broadband data traffic through the transcoders and network interface units by periodically broadcasting a master schedule (e.g., via the Ethernet) and by buffering broadband data packets and forwarding them to the appropriate network interface unit. For broadband data, the network control unit 1320 controls how much bandwidth is available for each broadband data stream. In some embodiments, the network control unit 1320 can be implemented as a commercial, off-the-shelf server with substantial processing and storage capabilities.
The system 1300 (e.g., a broadcast system) transmits the video data and/or the broadband data to one or more data terminals (e.g., like data terminals 330 of
The base layer 1420 has half the dimensions of the source video 1410, i.e., a frame resolution of 960×540 pixels. The base layer 1420 is transmitted (e.g., broadcast) with a robust modcode (i.e., a low order modcode) to ensure availability of the base layer 1420.
The combination 1430 of the enhancement layer and the base layer 1420 brings the received video to the full resolution of the source video 1410, i.e., a frame resolution of 1920×1080 pixels. The enhancement layer is transmitted (e.g., broadcast) with a more efficient modcode, i.e., a higher order modcode than the robust modcode used for the base layer 1420. Depending on the system configuration, the division of the source data into hierarchical layers transmitted with different modcodes can result in bandwidth saving on the channel of, for example, 30-50%.
During a rain fade, one or more data terminals may lose reception of the enhancement layer, which is transmitted with the more efficient, less robust modcode. As a result, the quality of the image of the program will be temporarily reduced in these affected data terminals. However, in some cases, the users of these affected data terminals may not realize that the image of the program is temporarily impaired. Thus, there is a trade-off between bandwidth savings and loss in program image quality and availability.
The base layer can be transmitted with a robust modcode (i.e., a low order modcode) that provides high availability. The enhancement layer can be transmitted with a less robust modcode (i.e., a higher order modcode) that provides slightly lower availability of the enhancement layer. This configuration can reduce the bandwidth used to transmit the program (e.g., by 30-50%) relative to sending both layers with a robust modcode or sending a single layer version of the program with a robust modcode.
A less aggressive configuration might allocate 50% of the bit rate to the base layer and 50% of the bit rate to the enhancement layer. Using this configuration, the bandwidth used to transmit the program might be reduced by only 15%, for example. However, it is less likely that viewers of the program would perceive the loss of image fidelity during a rain fade. Thus, the ability to vary the bit rate allocation between the base layer and the enhancement layer allows efficient utilization of bandwidth and tailoring of video program delivery over a wide range of fade conditions.
In a communications system like system 1300 of
Prioritization of video and broadband data can be assigned in any number of ways. For example, priority can be assigned to classes of data, such as broadband Internet data or video data, or to individual streams of data that are transmitted over a satellite, such as a single Hypertext Transfer Protocol (HTTP) connection.
For broadband data, a network operator can use several different criteria to assign priority. For example, priority can be determined by a data terminal or a group of data terminals to which a packet is destined. Headers in an IP packet, such as a source or a destination IP address, the protocol, or a destination or a source port of a packet can be used to establish priority. Alternatively, an operator can assign priority according to the broadband data application.
Video streams can also be prioritized using a variety of criteria, such as an audience metric (e.g. the number of viewers who are watching a program) or as a service level agreement between a content provider and the broadcaster.
The priority assignment can be a simple ranking (e.g., highest to lowest), a bit rate assignment (e.g., 5 megabits), or a bandwidth assignment (e.g., 1 MHz). When the network has more data to transmit than capacity, the priority can determine how much bandwidth is actually available to transmit a given video program or a data stream. For example, for a video program, the priority can be used to determine, at least in part, the number of layers of the program to be transmitted, the proportion of bits of the program to be allocated to each layer, the modcode to be used per layer, and even, that the program should be dropped altogether. For broadband data, the priority can be used to determine how much bandwidth is available for each data stream.
The priority assignments can be indicated by configuration data, e.g., from a network operator. As shown in
In some embodiments, a master schedule can include program data, e.g., program data indicating that some but not all video programs are to be transmitted or program data indicating, for each video program, whether the program is to be transmitted with one or two layers. The program data can be included in the encoder configurations and/or the modcode configurations. Alternatively, the program data can be indicated separately from the encoder configurations and the modcode configurations.
Updates to one or more of the configuration data, the network congestion data, and the link condition data can lead to broadcast of an updated master schedule that modifies the encoder configurations, the modcode configurations, and/or program data for a next sequence, as described above in reference to
Generally, in a conventional video broadcast system, programs are broadcast using a single modcode that is selected using a statistical analysis of fade conditions for the beam. In an example system, video programs are satellite transmitted using a Ku band transponder that is 36 MHz wide and broadcasting at 11 GHz. The operating Es/N0 for clear skies of the Ku band beam is 13 dB. For an availability of 99.9% and 99%, link margins of 2.0 dB and 0.5 dB, respectively, are needed for a full program broadcast on the Ku band. To achieve the 99.9% availability for the Ku band, a DVB-S2 modcode of 8-PSK 5/6 (i.e., 8-PSK modulation and 5/6 rate coding), which needs an Es/N0 of 9.9 dB, can be used. When high-definition programs are encoded at 10,000 kbps using H.264 format and broadcast using a single layer, the example Ku band transponder can broadcast eight programs. In the following examples, “kilo” or “k” equals 1000 units, and the overhead imposed by encapsulation is ignored.
The availability of a program, or a layer of a program, can be determined statistically and used by a broadcaster when real-time link conditions are not provided by return links from data terminals. Availability statistics can be compiled, for example, by monitoring satellite signals at specific frequencies at specific locations for long durations. For optimizing system configurations, it is preferable to use real-time link conditions rather than availability statistics. Radar data (e.g., Next-Generation Radar) provide a system with an intermediate level of knowledge about link conditions.
In a load balancing communications network, as described below, a broadcaster can configure a set of programs to occupy less than 100% of the capacity of a satellite transponder, where the remainder of the capacity can be allocated to other applications, such as two-way Internet traffic to data terminals. In the example of the conventional video broadcast system described above, the broadcaster has the capacity to transmit eight high-definition programs using 99.9% availability modcodes on the Ku band transponder system. For the following load balancing examples, the broadcaster only broadcasts five programs, leaving the remaining capacity available to broadband data applications.
The broadband data and video data traffic of a network can be load balanced by adjusting the modcodes that are used to deliver video program layers for dynamic allocation of video bandwidth. In rain fade conditions, a modcode might be assigned to the enhancement layer and/or the base layer that is not robust enough for some rain fade data terminals to receive, where the modcode is determined by the priority of the video program or program layers relative to the priorities of other video programs and the broadband data traffic. When network congestion is high and some data terminals are experiencing rain fade, the modcode used to broadcast an enhancement layer can be adjusted to reduce the number of data terminals that will lose reception of the enhancement layer or the overall program when the program is prioritized over other programs and broadband data. When there is spare capacity in the network, the video programs can be transmitted with more robust modcodes to improve reliability.
During clear sky conditions, the 36 MHz Ku band transponder described above has an operating Es/N0 of 13 dB. A DVB-S2 modcode of 8-PSK 9/10 (i.e., 8-PSK modulation and 9/10 rate coding), which needs an Es/N0 of 11.5 dB, could be used to broadcast the five high-definition video programs. The five programs total 50,000 kbps of data and occupy 18.7 MHz of the Ku band transponder. The remaining 17.3 MHz capacity of the Ku band transponder is available for broadband data applications.
When a hypothetical rain cell moves into the beam area of the Ku band transponder, a number of data terminals may be affected. Table 2 provides example numbers of data terminals in the beam area and their attenuation due to the hypothetical rain cell.
Data terminals experiencing 20 dB or higher attenuation will lose service of the programs. However, for the data terminals experiencing 10 dB of attenuation, a more robust modcode (i.e., a modcode with lower order than 8-PSK 9/10) can be used so that these data terminals can receive the programs and data streams. One modcode to support 3 dB Es/N0 (i.e., 13 dB Es/N0, for clear skies, with 10 dB attenuation from the rain cell) is QPSK 3/5, which needs an Es/N0 of 2.8 dB. For the data terminals experiencing 3 dB attenuation, a modcode of 8PSK 5/6, which needs an Es/N0 of 9.9 dB, can be used. This example uses a simplifying assumption that all data terminals in each attenuation group are experiencing the same attenuation, although in reality, the data terminals would experience a range of fade conditions.
Because the system only includes five programs, it is quite likely that all programs are being watched by at least some of the 1000 data terminals in the 10 dB attenuation group. However, the system cannot use the QPSK 3/5 modcode to broadcast the programs and the broadband data, because there would be insufficient bandwidth available on the transponder.
For this rain fade scenario, the network load balancing might include determining the bit percentage allocation of a program to the base layer and the enhancement layer and determining the modcodes for those layers. The base layer of a program can be broadcast using a robust modcode, while the enhancement layer of the program can be broadcast using a higher modcode. A network operator can also allocate a proportion of the bandwidth to the video programs and the remaining proportion to the broadband data applications, e.g., allocating 25 MHz of the 36 MHz capacity to video when the network is congested.
In one load balancing example, when all the video programs have the same priority, 15% of the bit rate of a program is allocated to the base layer, and the remaining 85% of the bit rate is allocated to the enhancement layer. The five programs can be broadcast by using a base modcode of QPSK 3/5, which needs an Es/N0 of 2.8 dB, and an enhancement layer modcode of 8PSK 9/10, which needs an Es/N0 of 11.5 dB. With this configuration, the video programs will utilize 22.23 MHz of bandwidth, leaving 13.37 MHz available for broadband data applications. Based on the example numbers of Table 2, the 100 data terminals experiencing ≧20 dB attenuation will be unable to receive the programs and the broadband data with these modcodes. The 1000 data terminals experiencing 10 dB attenuation and the 1500 data terminals experiencing 3 dB attenuation will be able to receive the base layers of the programs but not the enhancement layers of the programs. The 10000 data terminals experiencing clear sky conditions will be able to receive the full programs. Thus, this configuration provides capacity to the broadband data applications, using efficient broadcast of the programs in exchange for some reduced program availability for rain faded data terminals.
In another load balancing example, the system is configured to assign different priorities to the different video programs, while the bandwidth allocation is again limited to 25 MHz for the video programs. For this scenario, the higher priority programs will have more bits allocated to the base layer and a more robust modcode for transmitting the enhancement layer. The lower priority programs will have fewer bits allocated to the base layer and a higher order modcode (i.e., a less robust modcode) for transmitting the enhancement layer.
Table 3 shows some example numbers for the five programs, where sample bit rate percentage allocations, modcodes, and bandwidth utilization are given for the base and enhancement layers of each program. The total bandwidth utilized by the five programs is also provided, where the bandwidth utilization for each layer is calculated based on a number of bits per symbol for the respective modcode.
In Table 3, Program 1 has the highest priority, and Programs 2-5 have decreasing priorities. For Program 1, 40% of the program bits are allocated to the base layer, which will be available to data terminals experiencing 10 dB attenuation when a modcode of QPSK 3/5 is used. The enhancement layer of Program 1 has the remaining 60% of the program bits allocated and will be available to channels experiencing up to 5.8 dB of attenuation when a modcode of 8-PSK 2/3 is used. For Program 5, the lowest priority program in this example, 15% of the program bits are allocated to the base layer, which will be available to data terminals experiencing up to 7.8 dB of attenuation, when a modcode of QPSK 4/5 is used, while the enhancement layer of Program 5 will be available to data terminals experiencing up to 1.5 dB of attenuation (e.g., data terminals with clear sky conditions).
In yet another load balancing example, instead of allocating 25 MHz of the 36 MHz capacity of the Ku band transponder, a network operator can configure the system to allow the bandwidth utilized by the video programs to expand to occupy the entire bandwidth of the Ku band transponder, even when there is congestion. In this scenario, transmission of the broadband data traffic will be delayed or dropped altogether.
In still another load balancing example, the system is configured to assign higher priority to certain broadband traffic (e.g., broadband data traffic from credit card authorizations) than the priority assigned to video traffic. Further, in cases of extreme congestion, an enhancement layer of a program or an entire video program can be dropped in favor of reliable transmission of the higher priority broadband data streams and/or other higher priority video programs. That is, the bandwidth that would otherwise be allocated to transmission of the enhancement layer or both layers of the lower priority program can instead be used to transmit broadband data and/or other higher priority video programs.
The techniques provided above for load balancing video programs and broadband data have been described with respect to example systems with fairly small numbers of video programs (i.e., under ten programs) and fairly small audiences. In reality, some satellite broadcast systems have millions of subscribers and offer hundreds of video programs. The previously described load balancing techniques also apply to these larger systems. However, the above examples do not address the scenario where there are so many available channels that some of them may not always have an audience.
An audience metric can be measured for each program (e.g. the number of viewers who are watching a program), for example, when there is a return link from each data terminal. For example, a data terminal can have a return link through one or more satellites, via an Ethernet connection to a broadband network, and/or through a cellular network interface. When there is two-way communication between the data terminals and a hub of the satellite broadcaster, the system can broadcast a very low bit rate base layer for programs that are not presently being watched or watched by a small audience relative to the audience of other programs. The very low bit rate base layer can serve as a placeholder for users who are navigating program guides or browsing from program to program. In some embodiments, the placeholder is displayed to the user as a single frame, a title screen, a lower frame rate version, or a lower resolution version of the full program. The bandwidth that would otherwise be allocated to full or higher bit rate transmission of the program with the placeholder can instead be used to transmit broadband data or other higher priority video programs.
When a user navigates to a program presently transmitted with a placeholder, the system can continue to display the placeholder while activating transmission of the enhancement layer. In some embodiments, the system displays a higher bit rate base layer (i.e., higher than the low bit rate placeholder) prior to or at the same time as activating transmission of the enhancement layer.
Alternatively, in some scenarios, transmission of a particular video program can be dropped altogether instead of continued transmission of a placeholder. One scenario could be when a particular video program has an audience metric that is less than a defined threshold amount (e.g., indicating that the program is not being watched or that the program is being watched by a very small audience relative to the audience of other programs). Another scenario could be when the network congestion level is above a determined threshold amount, and the priority of a particular video program is less than priority levels of other programs and broadband data. The dropping of a program can be indicated, for example, by program data included in a master schedule.
The features of the various embodiments of
The method 1600 may begin by receiving first source data representing video content to be communicated to a first data terminal at block 1610. A load balancing communications network is configured to communicate with multiple data terminals, including the first data terminal and a second data terminal, in a satellite environment. Each of the first data terminal and the second data terminal are adapted to receive a transmission over the satellite link. In some embodiments, the satellite link has bandwidth that is used for communicating transmissions through one or more of broadcasting, multicasting, and unicasting.
At block 1620, second source data representing broadband data content to be communicated to the second data terminal is received. The first source data may be pre-coded at block 1630, using various pre-coding schemes. The pre-coding at block 1630 may generate sets of representation data at block 1640. In particular, the first source data is pre-coded using a first pre-coding scheme to generate a first set of representation data. The first set of representation data is decodable independently to provide a set of first-level playback data representing the first source data. The first source data is also pre-coded using a second pre-coding scheme to generate a second set of representation data. The second set of representation data is decodable in combination with the first set of representation data to provide a set of second-level playback data representing the first source data.
In some embodiments, the pre-coding of block 1630 includes pre-coding the first source data using at least one of a scalable pre-coding scheme or a data partitioning scheme. If a data partitioning scheme is used, each of the first pre-coding scheme and the second pre-coding scheme can include a data partitioning scheme using SVC.
At block 1650, the sets of representation data generated at block 1640 are associated with modulation schemes. The first set of representation data is associated with a first coding and modulation scheme. The second set of representation data is associated with a second coding and modulation scheme, which is of a higher order than the order of the first coding and modulation scheme. In some embodiments, each set of representation data is associated with an identifier that is further associated with a particular coding and modulation scheme.
At block 1660, ACM is performed on the sets of representation data using their associated coding and modulation schemes to generate a first transmission. In particular, a first transmission is generated by applying the first coding and modulation scheme to the first set of representation data and by applying the second coding and modulation scheme to the second set of representation data.
At block 1670, a second transmission is generated from the second source data. For example, ACM can be performed on the second source data using an associated coding and modulation scheme to generate the second transmission. The associated coding and modulation scheme can be determined using, for example, the real-time link condition of the second data terminal provided by a return link of the second data terminal. At block 1680, the first transmission is communicated to the first data terminal, and the second transmission is communicated to the second data terminal over the satellite link.
In some embodiments, priority data is calculated for the first source data and the second source data, where the priority data is used to generate a master schedule including one or more of bit rate data and modcode data. The master schedule can be transmitted, for example, to a pre-coder module (e.g., transcoders 1310 of
In some embodiments, link condition data about data terminals of the multiple data terminals is received, and the priority data is calculated based, at least in part, on the link condition data. When updated link condition data is received and indicates that a link condition of the first data terminal is deteriorating, an updated master schedule can be generated, including updated modcode data indicating that the first coding and modulation scheme is to be updated to a different coding and modulation scheme of a lower order for a following sequence.
In some embodiments, configuration data about the first source data and the second source data is received from a network operator, and the priority data is calculated based, at least in part, on the configuration data. In other embodiments, the priority data is calculated based, at least in part, on one or more of the following for the video content or the broadband data content: an audience metric, minimizing transmission cost, or maximizing availability.
In some embodiments, bit rate data included in the master schedule indicates a first bit rate and a second bit rate, where a sum of the first bit rate and the second bit rate equals a given bit rate of the first source data. The first set of representation data can be generated, in part, based on the first bit rate, and the second set of representation data can be generated, in part, based on the second bit rate.
The method 1700 may begin by receiving multiple first source data, where each first source data represents video content at block 1710. At block 1715, second source data representing broadband data content is received.
At block 1720, link condition data about data terminals in the multiple data terminals and configuration data about the multiple first source data and the second source data are received. At block 1725, priority data for the multiple first source data and the second source data are calculated based on the link condition data and the configuration data. At block 1730, the priority data is used to generate a master schedule including program data indicating that some but not all of the multiple first source data are to be transmitted. At block 1735, the master schedule is transmitted, for example, to components of a network access unit (e.g., the network access unit 1305 of
At block 1740, first source data of the multiple first source data is selected. At decision 1745, for the selected first source data, it is determined if the program data of the master schedule indicates that the selected first source data is to be transmitted. If it is determined that the program data indicates that the selected first source data is not to be transmitted (i.e., ‘No’ branch of decision 1745), the method 1700 returns to block 1740 to select a different first source data.
If it is determined that the program data indicates that the respective first source data is to be transmitted (i.e., ‘Yes’ branch of decision 1745), the selected first source data is pre-coded at block 1750, using various pre-coding schemes. The pre-coding at block 1750 may generate sets of representation data at block 1755. In particular, the selected first source data is pre-coded using a respective first pre-coding scheme to generate a respective first set of representation data. The respective first set of representation data is decodable independently to provide a set of first-level playback data representing the selected first source data. The selected first source data is also pre-coded using a respective second pre-coding scheme to generate a respective second set of representation data. The respective second set of representation data is decodable in combination with the respective first set of representation data to provide a set of second-level playback data representing the selected first source data.
In some embodiments, the pre-coding of block 1750 includes pre-coding the selected first source data using at least one of a scalable pre-coding scheme or a data partitioning scheme. If a data partitioning scheme is used, each of the first pre-coding scheme and the second pre-coding scheme can include a data partitioning scheme using SVC.
At block 1760, for the selected first source data indicated for transmission, the respective sets of representation data generated at block 1755 are associated with respective modulation schemes. The respective first set of representation data is associated with a respective first coding and modulation scheme. The respective second set of representation data is associated with a respective second coding and modulation scheme, which is of a higher order than the order of the respective first coding and modulation scheme. In some embodiments, each set of representation data is associated with an identifier that is further associated with a particular coding and modulation scheme. The method 1700 returns to block 1740 to select a different first source data.
In some embodiments, ACM is performed on the sets of representation data using their associated coding and modulation schemes to generate a first transmission. In particular, for each selected first source data indicated for transmission, a respective first transmission is generated by applying the respective first coding and modulation scheme to the respective first set of representation data and by applying the respective second coding and modulation scheme to the respective second set of representation data. A second transmission from the second source data can also be generated. Each of the first transmissions and the second transmission can be communicated to respective data terminals of the multiple data terminals over the satellite link.
In some embodiments, the satellite link has a given bandwidth. The master schedule can be generated to indicate that available bandwidth is allocated to one or more of the first transmissions and the second transmission communicated to the respective data terminals, where the available bandwidth is made available by not transmitting one or more of the multiple first source data.
In some embodiments, the priority data can be used to generate the master schedule including program data indicating that a particular first source data is not to be transmitted if the link condition data indicates that an audience metric of the respective video content represented by the particular first source data is less than a threshold amount.
In some embodiments, network congestion data can be received, and the priority data can be calculated based, in part, on the network congestion data. Network congestion data can indicate the demand for video programs and broadband data relative to the network resources allocated or available to transmit them. The priority data can be used to generate the master schedule including program data indicating that a particular first source data is not to be transmitted if the network congestion data received indicates a network congestion level above a threshold amount and the configuration data received indicates that a priority level of the particular first source data is lower than priority levels of the other first source data and the priority level of the second source data.
The method 1800 may begin by receiving multiple first source data, where each first source data represents video content at block 1810. At block 1815, second source data representing broadband data content is received.
At block 1820, link condition data about data terminals in the multiple data terminals and configuration data about the multiple first source data and the second source data are received. At block 1825, priority data for the multiple first source data and the second source data are calculated based on the link condition data and the configuration data. At block 1830, the priority data is used to generate a master schedule including program data indicating, for each of the multiple first source data, whether the respective first source data is to be transmitted with one or two layers. At block 1835, the master schedule is transmitted, for example, to components of a network access unit (e.g., the network access unit 1305 of
At block 1840, first source data of the multiple first source data is selected. At block 1850, the selected first source data is pre-coded using a respective first pre-coding scheme. The pre-coding at block 1850 may generate a respective first set of representation data decodable independently to provide a set of first-level playback data representing the respective first source data at block 1860.
At decision 1870, for the selected first source data, it is determined if the program data of the master schedule indicates that the selected first source data is to be transmitted with two layers. If it is determined that the program data indicates that the respective first source data is to be transmitted with two layers (i.e., ‘Yes’ branch of decision 1870), the method 1800 continues to block 1855. At block 1855, the selected first source data is pre-coded using a respective second pre-coding scheme. The pre-coding at block 1855 may generate a respective second set of representation data decodable in combination with the respective first set of representation data to provide a set of second-level playback data representing the selected first source data at block 1865. At block 1885, for the selected first source data indicated for transmission with two layers, the respective second set of representation data generated at block 1865 is associated with a respective second coding and modulation scheme.
After block 1885 or if it is determined that the program data indicates that the respective first source data is not to be transmitted with two layers (i.e., ‘No’ branch of decision 1870), the method 1800 continues to block 1880. At block 1880, the respective first set of representation data is associated with a respective first coding and modulation scheme, which is of a lower order than the order of the respective second coding and modulation scheme. The method 1800 continues to block 1840 to select a different first source data. In some embodiments, each set of representation data is associated with an identifier that is further associated with a particular coding and modulation scheme.
In some embodiments, the pre-coding of block 1850 and 1855 includes pre-coding the selected first source data using at least one of a scalable pre-coding scheme or a data partitioning scheme. If a data partitioning scheme is used, each of the first pre-coding scheme and the second pre-coding scheme can include a data partitioning scheme using SVC.
In some embodiments, for each first source data of the multiple first source data, a respective first transmission is generated by applying the respective first coding and modulation scheme to the respective first set of representation data and applying, for each first source data indicated for transmission with two layers, the respective second coding and modulation scheme to the respective second set of representation data. A second transmission can also be generated from the second source data. Each of the first transmissions and the second transmission can be communicated to respective data terminals of the plurality of data terminals over the satellite link. In some embodiments, the satellite link has a given bandwidth, and the master schedule can be generated to indicate that available bandwidth is allocated to one or more of the first transmissions and the second transmission communicated to the respective data terminals. The available bandwidth is made available by not transmitting a second layer for one or more of the multiple first source data.
In some embodiments, the master schedule is generated to include bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, where a sum of the first bit rate and the second bit rate equals a given bit rate of the respective first source data. For each first source data indicated for transmission with one layer, the bit rate data for the respective first source data can indicate that the first bit rate is lower than the first bit rates of other first source data indicated for transmission with two layers.
In some embodiments, for each first source data indicated for transmission with one layer, the respective set of first-level playback data representing the respective first source data provides, on playback, a single frame, a title screen, a lower frame rate version, a lower resolution version, or a lower bit rate version of the respective video content represented by the respective first source data.
In some embodiments, the priority data is used to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the link condition data indicates that an audience metric of the respective video content represented by the particular first source data is less than a threshold amount. The threshold amount for the audience metric can be one of the following: a determined number of one or more viewers, a determined number of program requests from one or more viewers, or a program request from a network operator.
When updated link condition data is received and indicates that the audience metric of the respective video content represented by the particular first source data is equal to or greater than the threshold amount, an updated master schedule can be generated including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence. In some embodiments, the updated master schedule also includes bit rate data indicating, for each first source data of the multiple first source data, a first bit rate for a first layer and a second bit rate for a second layer, where the sum of the bit rates equals a given bit rate of the respective first source data. For the particular first source data indicated for transmission with two layers during the following sequence, the bit rate data of the updated master schedule can indicate that the first bit rate for the particular first source data is to be higher during the following sequence.
In some embodiments, network congestion data is received, and the priority data is calculated based, in part, on the network congestion data. The priority data can be used to generate the master schedule including program data indicating that a particular first source data is to be transmitted with one layer if the network congestion data received indicates a network congestion level that is equal to or greater than a threshold amount and the configuration data received indicates that a priority level of the particular first source data is lower than priority levels of other first source data and the priority level of the second source data. When updated network congestion data is received and indicates that the network congestion level is less than the threshold amount, or updated configuration data is received and indicates that the priority level of the particular first source data has increased relative to the priority levels of the other first source data and the priority level of the second source data, an updated master schedule can be generated including updated program data indicating that the particular first source data is to be transmitted with two layers during a following sequence.
It should be noted that the methods, systems, and devices discussed above are intended merely to be examples. It must be stressed that various embodiments may omit, substitute, or add various procedures or components as appropriate. For instance, it should be appreciated that, in alternative embodiments, the methods may be performed in an order different from that described, and that various steps may be added, omitted, or combined. Also, features described with respect to certain embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. Also, it should be emphasized that technology evolves and, thus, many of the elements are exemplary in nature and should not be interpreted to limit the scope of the invention.
Specific details are given in the description to provide a thorough understanding of the embodiments. However, it will be understood by one of ordinary skill in the art that the embodiments may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary detail in order to avoid obscuring the embodiments.
Also, it is noted that the embodiments may be described as a process which is depicted as a flow diagram or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure.
Moreover, as disclosed herein, the term “memory” or “memory unit” may represent one or more devices for storing data, including read-only memory (ROM), random access memory (RAM), magnetic RAM, core memory, magnetic disk storage mediums, optical storage mediums, flash memory devices, or other computer-readable mediums for storing information. The term “computer-readable medium” includes, but is not limited to, portable or fixed storage devices, optical storage devices, wireless channels, a sim card, other smart cards, and various other mediums capable of storing, containing, or carrying instructions or data.
Furthermore, embodiments may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments to perform the necessary tasks may be stored in a computer-readable medium such as a storage medium. Processors may perform the necessary tasks.
Having described several embodiments, it will be recognized by those of skill in the art that various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the invention. For example, the above elements may merely be a component of a larger system, wherein other rules may take precedence over or otherwise modify the application of the invention. In addition, a number of steps may be undertaken before, during, or after the above elements are considered. Accordingly, the above description should not be taken as limiting the scope of the invention.
The present application is a continuation-in-part of co-pending, commonly assigned U.S. patent application Ser. No. 12/250,394, filed on Oct. 13, 2008, and entitled “TERMINAL AWARE MULTICASTING,” which is a continuation-in-part of co-pending, commonly assigned U.S. patent application Ser. No. 11/956,200, filed on Dec. 13, 2007, and entitled “ACM AWARE ENCODING SYSTEMS AND METHODS,” which claims the benefit of U.S. Provisional Application No. 60/869,809, filed on Dec. 13, 2006, entitled “ADAPTIVE CODING & MODULATION (ACM) AWARE ENCODER SYSTEM,” the entirety of each of which is herein incorporated by reference for all purposes. The present application is also related to U.S. patent application Ser. No. 12/762,277, filed on Apr. 16, 2010, and entitled “MULTIPLE TRANSMISSION PATHS FOR HIERARCHICAL LAYERS”; U.S. patent application Ser. No. 12/762,280, filed on Apr. 16, 2010, and entitled “VIDEO AND DATA NETWORK LOAD BALANCING”; U.S. patent application Ser. No. 12/762,283, filed on Apr. 16, 2010, and entitled “VIDEO AND DATA NETWORK LOAD BALANCING WITH VIDEO DROP”; and U.S. patent application Ser. No. 12/762,293, filed on Apr. 16, 2010, and entitled “ACM AND FIXED CODING AND MODULATION OF HIERARCHICAL LAYERS,” the entirety of each of which is herein incorporated by reference for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6215776 | Chao | Apr 2001 | B1 |
| 6292512 | Radha et al. | Sep 2001 | B1 |
| 6339450 | Chang et al. | Jan 2002 | B1 |
| 6374112 | Widegren et al. | Apr 2002 | B1 |
| 6381242 | Maher et al. | Apr 2002 | B1 |
| 6392705 | Chaddha | May 2002 | B1 |
| 6404755 | Schafer | Jun 2002 | B1 |
| 6556546 | Maeda et al. | Apr 2003 | B1 |
| 6574794 | Sarraf | Jun 2003 | B1 |
| 6700882 | Lindoff et al. | Mar 2004 | B1 |
| 6798838 | Ngo | Sep 2004 | B1 |
| 6829221 | Winckles et al. | Dec 2004 | B1 |
| 6845246 | Steer | Jan 2005 | B1 |
| 6925120 | Zhang et al. | Aug 2005 | B2 |
| 6934679 | Zhou et al. | Aug 2005 | B2 |
| 6943702 | Kato | Sep 2005 | B2 |
| 6961388 | Ling et al. | Nov 2005 | B2 |
| 6973128 | Zhou et al. | Dec 2005 | B2 |
| 6993689 | Nagai et al. | Jan 2006 | B2 |
| 6999432 | Zhang et al. | Feb 2006 | B2 |
| 7093028 | Shao et al. | Aug 2006 | B1 |
| 7136066 | Li et al. | Nov 2006 | B2 |
| 7146185 | Lane | Dec 2006 | B2 |
| 7349906 | Cherkasova | Mar 2008 | B2 |
| 7376418 | Wells | May 2008 | B2 |
| 7382729 | Honda et al. | Jun 2008 | B2 |
| 7406176 | Zhu et al. | Jul 2008 | B2 |
| 7450901 | Parkman | Nov 2008 | B2 |
| 7477597 | Segel | Jan 2009 | B2 |
| 7477688 | Zhang et al. | Jan 2009 | B1 |
| 7483487 | Liu et al. | Jan 2009 | B2 |
| 7505480 | Zhang et al. | Mar 2009 | B1 |
| 7515566 | Dale et al. | Apr 2009 | B2 |
| 7535863 | Gin et al. | May 2009 | B2 |
| 7593697 | Zhu et al. | Sep 2009 | B2 |
| 7603075 | Barda | Oct 2009 | B2 |
| 7643441 | De La Chappelle et al. | Jan 2010 | B2 |
| 7667707 | Margulis | Feb 2010 | B1 |
| 7690021 | Ng | Mar 2010 | B2 |
| 7720136 | Friedman et al. | May 2010 | B2 |
| 7860161 | Xu et al. | Dec 2010 | B2 |
| 20010052130 | Yap et al. | Dec 2001 | A1 |
| 20020058478 | de La Chappelle et al. | May 2002 | A1 |
| 20030112878 | Kloper | Jun 2003 | A1 |
| 20030204630 | Ng | Oct 2003 | A1 |
| 20030204850 | Ng | Oct 2003 | A1 |
| 20030217362 | Summers et al. | Nov 2003 | A1 |
| 20040071216 | Richardson et al. | Apr 2004 | A1 |
| 20040093396 | Akune | May 2004 | A1 |
| 20040208121 | Gin et al. | Oct 2004 | A1 |
| 20040252725 | Sun et al. | Dec 2004 | A1 |
| 20040253980 | Lane | Dec 2004 | A1 |
| 20050152372 | Kim et al. | Jul 2005 | A1 |
| 20050251838 | Chandhok et al. | Nov 2005 | A1 |
| 20060050660 | Wells | Mar 2006 | A1 |
| 20060126576 | Dale et al. | Jun 2006 | A1 |
| 20060182026 | Zhu et al. | Aug 2006 | A1 |
| 20070091881 | Kallio et al. | Apr 2007 | A1 |
| 20070159521 | Lane | Jul 2007 | A1 |
| 20080049597 | Walker et al. | Feb 2008 | A1 |
| 20080049659 | Ram et al. | Feb 2008 | A1 |
| 20080056145 | Woodworth | Mar 2008 | A1 |
| 20080064323 | Barda | Mar 2008 | A1 |
| 20080101466 | Swenson et al. | May 2008 | A1 |
| 20080144713 | Kimmich et al. | Jun 2008 | A1 |
| 20080144723 | Chen et al. | Jun 2008 | A1 |
| 20080155373 | Friedman et al. | Jun 2008 | A1 |
| 20080219266 | Agarwal et al. | Sep 2008 | A1 |
| 20080225964 | Han et al. | Sep 2008 | A1 |
| 20080259901 | Friedman et al. | Oct 2008 | A1 |
| 20080268838 | Zufall et al. | Oct 2008 | A1 |
| 20090003452 | Au et al. | Jan 2009 | A1 |
| 20090028182 | Brooks et al. | Jan 2009 | A1 |
| 20090034609 | Peng et al. | Feb 2009 | A1 |
| 20090041100 | Kimmich et al. | Feb 2009 | A1 |
| 20090060033 | Kimmich et al. | Mar 2009 | A1 |
| 20090060086 | Kimmich et al. | Mar 2009 | A1 |
| 20090073876 | Kimmich et al. | Mar 2009 | A1 |
| 20090080510 | Wiegand et al. | Mar 2009 | A1 |
| 20090135789 | Snapir et al. | May 2009 | A1 |
| 20090219990 | Han et al. | Sep 2009 | A1 |
| 20090252134 | Schlicht et al. | Oct 2009 | A1 |
| 20100008416 | Ben-Zedeff et al. | Jan 2010 | A1 |
| 20100260043 | Kimmich et al. | Oct 2010 | A1 |
| 20100260050 | Kimmich et al. | Oct 2010 | A1 |
| 20100260254 | Kimmich et al. | Oct 2010 | A1 |
| 20100260259 | Kimmich et al. | Oct 2010 | A1 |
| 20120076201 | Kimmich et al. | Mar 2012 | A1 |
| Number | Date | Country |
|---|---|---|
| WO 2008064270 | May 2008 | WO |
| WO 2008074020 | Jun 2008 | WO |
| WO 2009058118 | May 2009 | WO |
| WO 2009154704 | Dec 2009 | WO |
| 2010019157 | Feb 2010 | WO |
| 2011130685 | Oct 2011 | WO |
| Entry |
|---|
| European Broadcasting Union: “Digital Video Broadcasting (DVB) User guidelines for the second generation system for Broadcasting, Interactive Services, News Gathering and other broadband satellite applications (DVB-S2)”, Feb. 2005; ETSI TR 102 376, V1.1.1, pp. 1-104. |
| International Search Report and Written Opinion mailed on Aug. 1, 2008 for Patent Application No. PCT/US2007/087483, 16 pages. |
| International Search Report and Written Opinion mailed Feb. 20, 2009 for Patent Application No. PCT/US2008/076038, 13 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,394 mailed Mar. 5, 2010, 9 pages. |
| Han, L. et al., “Cross Layer Optimization for Scalable Video Multicast over 802.11 WLANs”, IEEE 2006 Proceedings Consumer Communications and Networking Conference (ICCNC), Las Vegas, NV, USA, Jan. 8, 2006, pp. 838-843. |
| Horn, Uwe, et. al., “Scalable Video Coding for Multimedia Application and Robust Transmission over Wireless Channels”, 7th International Workshop on Packet Video, 1996, 6 pages. |
| McCanne, S., et al., “Receiver-driven Layered Multicast”, SIGCOMM '96, Conference Proceedings on Applications, Technologies, Architectures, and Protocols for Computer Applications, Aug. 1996, Stanford, CA, pp. 1-14. |
| Radha, H., et. al., “The MPEG-4—Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP”, IEEE Transactions on Multimedia, vol. 3, No. 1, Mar. 2001, pp. 53-68. |
| Schierl, T. et al., “Using H.264/AVC-Based Scalable Video Coding (SVC) for Real Time Streaming in Wireless IP Networks”, IEEE International Symposium on Circuits and Systems, 2007, 4 pages. |
| Schierl, T., et al., “Mobile Video Transmission Using Scalable Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, Sep. 2007, vol. 17, Issue 9, pp. 1204-1217. |
| Van Der Schaar, M. et al. “Robust Transmission of MPEG-4 Scalable Video over 4G Wireless Networks”, Proceedings of IEEE / ICIP International Conference on Image Processing, 2002, Rochester, NY, USA, Sep. 22-25, 2002, pp. III-757-III-760. |
| Final Office Action for U.S. Appl. No. 11/956,200 mailed on Jan. 25, 2012; 31 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,384 mailed on Feb. 6, 2012; 8 pages. |
| International Search Report and Written Opinion mailed on Feb. 2, 2012 for Patent Application No. PCT/US2011/032758, 16 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/250,384 mailed on May 11, 2011, 10 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/192,544 mailed on May 25, 2011; 23 pages. |
| Restriction Requirement for U.S. Appl. No. 11/956,200 mailed on Jun. 3, 2011; 7 pages. |
| Non-Final Office Action for U.S. Appl. No. 11/956,200 mailed on Aug. 3, 2011;22 pages. |
| Final Office Action for U.S. Appl. No. 12/192,544 mailed on Sep. 13, 2011; 11 pages. |
| Final Office Action for U.S. Appl. No. 12/250,384 mailed on Sep. 28, 2011; 7 pages. |
| Horn, Uwe, et. al., “Scalable Video Coding for Multimedia Applications and Robust Transmission over Wireless Channels”, 7th International Workshop on Packet Video, Mar. 1996, pp. 43-48. |
| Schierl, T. et al., “Using H.264/AVC-Based Scalable Video Coding (SVC) for Real Time Streaming in Wireless IP Networks”, IEEE International Symposium on Circuits and Systems (ISCAS), May 27-30, 2007, pp. 3455-3458. |
| Restriction Requirement for U.S. Appl. No. 12/192,544 mailed on Mar. 31, 2011; 6 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,392 mailed on Mar. 18, 2011; 9 pages. |
| Decision on Petition to Make Special 37 CFR 1.102 for U.S. Appl. No. 12/250,384 mailed on Feb. 14, 2011; 2 pages. |
| Decision on Petition to Make Special 37 CFR 1.102 for U.S. Appl. No. 12/192,544 mailed on Feb. 14, 2011; 2 pages. |
| Decision on Petition to Make Special 37 CFR 1.102 for U.S. Appl. No. 11/956,200 mailed on Feb. 9, 2011; 2 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,394 mailed on Feb. 8, 2011; 9 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,392 mailed on Dec. 8, 2010; 9 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/250,394 mailed on Sep. 14, 2010; 12 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,394 mailed on Aug. 4, 2010; 9 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/250,392 mailed on May 27, 2010; 17 pages. |
| First Examination Report for Australian Patent Application No. 2007333037 of Jun. 18, 2010; 2 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/762,293, mailed on Aug. 29, 2012, 13 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/762,283, mailed on Aug. 29, 2012, 13 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/762,277, mailed on Sep. 14, 2012, 33 pages. |
| Notice of Allowance for U.S. Appl. No. 12/250,384, mailed on Jul. 30, 2012; 9 pages. |
| Non-Final Office Action for U.S. Appl. No. 12/762,280, mailed on Sep. 20, 2012, 39 pages. |
| Notice of Allowance for U.S. Appl. No. 12/762,283, mailed on Dec. 3, 2012, 10 pages. |
| Notice of Allowance for U.S. Appl. No. 12/762,293, mailed on Dec. 21, 2012, 15 pages. |
| Notice of Allowability for U.S. Appl. No. 12/762,293, mailed on Jan. 3, 2013, 12 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20100260045 A1 | Oct 2010 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60869809 | Dec 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12250394 | Oct 2008 | US |
| Child | 12762285 | US | |
| Parent | 11956200 | Dec 2007 | US |
| Child | 12250394 | US |
