Patent Application
20150029842
This application claims priority under 35 U.S.C. §119 to French patent application Number FR1357281, filed Jul. 24, 2013, the disclosure of which is incorporated herein by reference.
The subject of the invention relates to a method and a system for transmitting data in a transmission channel with given bitrate simultaneously with a set of streams containing video data Dvideo and using statistical multiplexing. The invention applies in the case of video streams.
The field of digital multimedia calls upon data compression schemes to enable the transmission of more services in one and the same bandwidth. It is thus possible to achieve a better compromise between on the one hand the quality of rendition and on the other hand the bitrate necessary to disseminate these data over a network.
It is thus known to use constant bitrate encoding techniques of CBR (Constant Bit Rate) type for data coding. The CBR mode generates a constant bitrate predefined by the user. The drawback of this mode is that the chosen target bitrate corresponds to the maximum bitrate necessary for the transmission of the most complex images. This results in poor use of the bandwidth for images of low complexities.
It is also known to use the variable bitrate or VBR (standing for Video Bit Rate) mode of coding, which makes it possible to preserve a predefined level of image quality whatever the complexity of a scene. The occupancy of the bandwidth of a transmission channel is thus better optimized.
Another way of proceeding is to apply statistical multiplexing in respect of a set of coders. This makes it possible to allot each coder a variable bitrate depending on the complexity of the image to be coded. Each coder sends a bitrate demand to a bitrate allocator which returns an instantaneous bitrate to the coders which depends on the set of demands of all the coders. The statistical multiplexing can be of the CBR type if the sum of the allocated bitrates is equal to the channel bitrate, or else be of the VBR type if the total bitrate is less than or equal to this channel.
The company Harmonic markets a device for multiplexing data with video streams.
The following letters will be used in the description:
The word “data” designates the data to be multiplexed with the video streams. The expression “video stream” designates a stream which comprises data included in a video service, video data, audio data, teletex, data for sub-titles or DVB-Subtitle, etc. The word coder designates the video coder.
The method according to the invention relies notably on the inserting of a data stream into a transmission channel with fixed bitrate intended mainly for the transport of signals arising from coders controlled by a statistical multiplexer.
The invention relates to a system for multiplexing data Di and one or more streams containing video data Dvideo in a transmission channel with fixed bitrate comprising at least one configuration interface for the system, a multiplexer and its controller, the multiplexer comprising one to n inputs receiving the stream or streams containing video data Dvideo, a bitrate allocator, the system is characterized in that the multiplexer comprises an input for the data Di to be multiplexed, the said system comprises at least the following elements: a memory receiving the data to be multiplexed with the stream or streams containing video data Dvideo, a bitrate estimator which transmits a bitrate request Rd to the bitrate allocator, the bitrate request Rd is transmitted to the controller of the multiplexer and delayed, for example by a value ΔT, the controller is suitable for reading from the memory the data Di to be multiplexed, up to compliance with the bitrate request Rd.
The system can comprise one or more of the following modules
The system can comprise an element for instantaneous measurement of total bitrate Rt of the streams containing video data Dvideo at the level of the controller of the multiplexer, a module of the controller receiving the measured total bitrate Rt of the streams containing video data Dvideo, the data Di bitrate request Rd, the channel bitrate Rc, the said module being suitable for calculating an opportunistic data bitrate Rdop equal to the channel bitrate minus the deterministic data bitrate minus the total bitrate of the video streams, Rdop=Rc−Rd−Rt.
The invention also relates to a method for simultaneously multiplexing data Di and one or more streams containing video data Dvideo in a transmission channel with fixed bitrate Rc by using a system exhibiting one of the above characteristics, the method is characterized in that it comprises at least the following steps:
The method can comprise a step of measuring at least one of the following parameters:
According to a variant embodiment, the total bitrate Rt of the streams containing video data Dvideo is measured and a value of opportunistic data bitrate Rdop is calculated by taking account of the measured bitrate of the video stream and of the bitrate Rd of the deterministic data.
According to another variant embodiment a bitrate for the data to be multiplexed is reserved equal to the bitrate at input with a determined fixed delay.
According to another variant, a bitrate for the data to be multiplexed is reserved equal to the bitrate at input smoothed over a given constant duration.
It is also possible to determine the bitrate reserved for the data to be multiplexed as a function of the degree of filling of the memory.
According to another variant the bitrate reserved for the data to be multiplexed is chosen as a function of the measured delay of the data to be multiplexed in the memory. It is also possible to take account of the degree of fill of the memory and of the delay of the data.
The stream containing video data is a video stream.
Other characteristics and advantages of the device according to the invention will be more apparent on reading the description which follows of an exemplary embodiment given by way of wholly nonlimiting illustration, together with the figures which represent:
The system comprises a Man Machine Interface (MMI) which will make it possible to configure the system.
The system comprises a set of video coders 101, 102, . . . 10n in conjunction with a multiplexer 11 and its controller 112, and a bitrate allocator 12 whose function is notably to calculate the bitrate which will be allocated to each stream. The multiplexer 11 comprises n inputs 11v for the video streams Dvideo and an additional input 11d of the data to be multiplexed Di.
The set of video coders 101, 102, 10n provides the compressed video streams and the associated components. Each video coder 101, 102, . . . 10n makes a request Qj for bitrate to the bitrate allocator 12. In return the bitrate allocator 12 transmits the bitrate value Rvj which is allocated to a video coder to transmit the video data. The various video streams arising from the coders are transmitted, by an appropriate means, to the multiplexer 11 in charge of multiplexing them in the transmission channel 14. There exists a time or delay, noted ΔT, between the instant at which a video coder receives a bitrate order and the instant at which the bitrate is actually equal to this command.
The multiplexer 11 is adapted for multiplexing the data Di and the video data Dvideo. The function of its controller 112 is notably to control the transfer of the data Di between a memory 20 in which the data Di are stored and the input 11d of the multiplexer. The controller 112 will receive the bitrate requested Rd for the data Di, and it will carry out a transfer of data Di between the memory 20 and the input 11d of the multiplexer with a delay equal to ΔT so as to compensate for the delay of the video coders.
The memory 20 makes it possible to temporarily store the data Di to be multiplexed with the video streams in the transmission channel. The data will be inserted best into the transmission channel as a function of criteria related on the one hand to the configuration given by a user and, on the other hand, to the characteristics of the incoming video streams. The memory 20 is in conjunction with a bitrate estimator 21 which makes a bitrate request Rd to the allocator 12 of the multiplexer 11 in a manner similar to a video coder. The bitrate estimator 21 receives, for example, information from a module 22 for estimating bitrate of the data at input, and/or an item of information from a module 23 for calculating degree of occupancy of the memory by the data to be multiplexed. The bitrate estimator 21 is also in conjunction with a module 24 suitable for calculating the memory delay between the input data De and the output data Ds, i.e, the time taken by the data to travel across the memory.
The bitrate request Rd is dependent on the one hand on the system optimization desired by the user and, optionally, dependent on the other hand on several criteria which may be the input bitrate Re of the data, the degree of filling X of the memory 20 and/or the time Td resulting from the time taken by the data to cross the memory 20.
The bitrate request Rd is allotted by priority by the allocator 12 (the bitrate is imposed on the allocator). The allocator 12 will distribute between the video coders a bitrate Rv equal to the bitrate Rc of the transmission channel minus the bitrate allotted Rd to the data. There are therefore no losses in the data transmission.
The bitrate demand Rd is transmitted to the controller 112 of the multiplexer which will thus read from the memory 20, data Di up to compliance with the deterministic bitrate request in this example. The bitrate request Rd is delayed by ΔT in a delay module 15 so as to compensate for the delay taken by a video coder between the bitrate allocation and the actual presence of this bitrate at the output of the coder in such a way that all the bitrates (data bitrate, video streams bitrate) are in phase at the input of the multiplexer and avoid any under or over-bitrate at the output of the multiplexer.
The operation of the system in deterministic mode is explained hereinafter.
The user configures the mode of operation of the system as a function of the type of data that he wishes to multiplex with the video streams. Configuration is carried out through the man machine interface or MMI and software which configure the various blocks and modules described in the invention.
The reservation of bitrate in the output channel in the deterministic mode can be done, for example, according to five modes chosen by the user:
Moreover, if the statistical multiplexing is of the VBR type, there exist instants at which the total bitrate Rt, that is to say the bitrate of the coders Rv plus the deterministic bitrate Rd, is less than the bitrate of the channel Rc, for example if several coders transmit a fixed image at the same instant. There is therefore an opportunity to add further data that will therefore be called opportunistic.
Depending on the type of data to be transmitted, the appropriate mode will be selected:
Without departing from the scope of the invention, the method can be applied for real-time data streams which are not video streams, but which contain video data.
In the case of a system operating with all the outputs of the coders at zero bitrate, so as to fill the entire channel, the method will multiplex several additional data pathways. A constraint in respect of the implementation of the method is that the sum of the instantaneous bitrates of all these pathways be less than the channel bitrate.
The method and the system according to the invention exhibit notably the advantage of giving back bitrate to the video streams, according to a mode chosen as a function of the priority or non-priority character of the data on the video. They make it possible notably to insert these data according to several modes configurable by the user as a function of the priority or non-priority character of the data on the video. The modes of configuration explained above cover the entire range from the maximum priority to video (respectively data) to the minimum priority to video (respectively data) while guaranteeing lossless data transmission.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1357281 | Jul 2013 | FR | national |
