The present invention relates to a packet relay method and device, which are preferably applied to a relay method and device of a real-time type packet in a wireless (radio) network.
As a typical wireless network system, a wireless LAN (IEEE 802.11) system depicted in
In a multi-media service, especially a video service, by taking account of a load to a network for the distribution thereof over the Internet or the like and enormous amounts of video data pressing a storage area, a video file is compression encoded as needed in order to avoid them. This is represented by e.g. MPEG1 and 2.
Also, H.263 for 3G mobile phone encoding and H.264 for changing a compression rate in a wideband from QCIF level to HD level have been proposed as a new encoding method, unified with AVC that is MPEG-4 part 10 and standardized as H.264/AVC.
As streaming data, there exist the ones allowing temporary buffering like on-demand video program distribution besides the ones requiring a real-time reproduction like a live telecast or a video teleconference. Namely, there exist streaming data reproduced after having been buffered to some extent with respect to a reproduction timing on a timeline and streaming data not necessarily forced to carry all data transmitted from a media server to a receiving device upon the reproduction like a TV program.
It is to be noted that, as a reference, there is a simultaneous report communication system and method performing feedback of the statistical information, in which each relay node is provided with an information input means obtaining information reception status data delivered from receiving terminals connected or a subsidiary relay node to an up line, a statistical processing means generating statistical information of the receiving status of the receiving terminals connected by counting receiving status data according to the predetermined rules and a statistical information output means periodically delivering statistical information generated to an upper relay node or a transmitting device (see e.g. Japanese Laid-open Patent Publication No. 2001-345807).
Also, as another reference, there is a streaming communication system and a stream transfer control method adjusting transfer data amount to reach a specified transmission rate, in which a QoS control portion in a reception node calculates QoS parameters respectively representing transmission rates allowing a real-time transfer in a transmission node and a relay node based on a data receiving performance and a data processing performance notified by the relay node and the reception node itself as well as the current transmission rate to require a setting change to the corresponding parameters; the transmission node and the relay node, after having sent a message temporarily aborting a QoS control to the transmission node, reduce stepwise a transmission allowable priority while increasing stepwise a transmission allowable block number of data block of the same priority as the priority in the same cycle to transmit or discard each data block (see e.g. Japanese Laid-open Patent Publication No. 11-341063).
The above system is designed supposing high quality media as transmission media but not designed supposing media in an environment with severe condition for ensuring a transmission quality for a wireless system. Therefore, an influence to services due to a wireless quality becomes a problem.
Generally, a wireless environment varies momentarily and so is not fixed due to fadings, multipaths, interferences between channels, interferences between systems and movements of terminals or the like. In order to avoid such a problem, there exist technologies for error concealment and error recovery processing for encoding errors caused due to a wireless transmission quality deterioration with technologies such as a power control, Rake reception, channel orthogonalization, transmission diversity and soft hand-over and with technologies such as interleave or FEC (Forward Error Collection) between a wireless base station and terminals.
However, even if those technologies are used, all of the errors can not be removed, where for example burst errors disabling effects of interleave etc. occur due to a link disconnection between the base station and the terminals based on a hard hand-over and a severe fading.
It arises from temporal environment changes of a wireless transmission path and contiguous environment changes of a wireless transmission path, i.e. state changes of a terminal, in which it arises from a change of a positional relationship between a terminal and a service offering area (called a cell in case of a cellular system especially depicted in
A media reproduction side (receiving device) has generally a means for sending feedback information having stored therein packet discard rate and discarded packet number etc. to a transmitting device with an RTCP reception report packet (see
However, the above feedback information includes as an object a transmission quality obtained as a result of error correction in a wireless section, so that an error state ERR as depicted by diagonal lines in
Namely, although the transmitting device can acquire error rate information of the packet discard rate etc. in the receiving device from feedback information, the transmitting device can not know how much degree of contribution (a change to an intensive error correcting method or a plural number of retransmission processes etc.) the relay device makes for maintaining the packet discard rate or the like.
Accordingly, despite that the transmission ability of the relay device is going to reach its limit, the transmitting device determines that the transmission quality of the receiving device is still good, failing to control downward the transmission speed, so that the transmitting device is to reduce the transmission speed only after the transmission ability of the relay device is exceeded (error state ERR).
Such a change of situation is serious for video transmission, so that when referencing pictures of video streamed especially with a compression technology, the picture images can not be reproduced because of lack of the referenced frame, thereby appearing as a visually-unbearable quality.
Namely, in excess of the control limit by transmission quality maintenance of the wireless network, upper application such as multimedia streaming data will be affected with errors. Recently, the above problem is becoming remarkable since the use of the video distribution service in the wireless environment is increasing.
In order to achieve the above-mentioned object, a packet relay method and device in one aspect of the present invention receives feedback information, from a receiving device, including a transmission quality of a packet transmitted from a transmitting device to the receiving device and revises down the above transmission quality included in the feedback information, to be transferred to the transmitting device, based on information of resource consumed for maintaining a wireless link included in a transmission path to the receiving device.
One embodiment of a network arrangement is depicted in
In such a network environment, upon handling a real-time type transmission, particularly a video stream transmission with feedback information, when an error correction processing in the transmission path such as a retransmission processing is performed more than a fixed number of times as the transmission environment varies, the transmission quality reported in the feedback information (packet discard rate or discarded packet number etc.) is reported as a transmission quality lower (worse) than a transmission quality maintained to a transmission source of the video stream. Namely, it is transmitted after revising down (modifying the effect component) the feedback information transmitted to the transmitting device 3 from the receiving device 2, based on the information of resource (resource information) consumed for maintaining the transmission quality of the section A between the relay device 1 and the receiving device 2.
As a result, as depicted by heavy lines C in
This will be described with reference to a sequence in
In the relay device 1, the feedback information is modified or corrected (step T4) based on information of resource consumed for maintaining the wireless link included in the transmission path to the receiving device 2. For example, if it is determined that an ability more than a fixed threshold (a limit value or less than the limit value) is exercised, a parameter is generated for modifying the feedback information based on the information of resource consumed for maintaining the wireless link such as the number of retransmission times for a predetermined time interval, a transmission power level and a code length of an error correcting code, thereby modifying the feedback information with the parameter.
While the receiving device 2 thus reports the feedback information based on the transmission quality maintained by an error protective control in the relay device 1, the relay device 1 rewrites the feedback information to a value discounted by an error protection amount performed by the relay device 1, i.e. revises down the transmission quality included in the feedback information. By reporting this to the transmitting device 3, the transmitting device 3 determines that some of the packet data transmitted do not have reached the receiving device 2, reducing the transmission speed (step T5), for example by reducing the encoding rate.
When the above transmission quality maintaining ability is the number of retransmission times of a packet for a predetermined time interval and the above feedback information is modified, a value given by subtracting a threshold from a discarded packet number corresponding to the number of retransmission times of the packet to the receiving device for the predetermined time interval or from a packet discard rate indicating a value given by dividing the discarded packet number by the number of transmission times of the packet may be added respectively to the discarded packet number or the packet discard rate indicating the transmission quality stored in the feedback information.
Also, when the above transmission quality maintaining ability is the transmission power level for a predetermined time interval, a value given by subtracting a threshold from the packet discard rate determined based on a ratio of a period during which the transmission power level exceeds a predetermined power level over the predetermined time interval or from the discarded packet number based on the packet discard rate may be added respectively to the packet discard rate or the discarded packet number as the transmission quality included in the feedback information.
Furthermore, when the above transmission quality maintaining ability is a code length of the error correcting code for the predetermined time interval, a value given by subtracting a threshold from the packet discard rate determined based on the code length of the error correcting code or from the discarded packet number may be added respectively to the packet discard rate or the discarded packet number as the transmission quality included in the feedback information.
The controller SW has mounted therein “MANE: Media Aware Network Element” described in e.g. RFC3984. MANE is a network element such as a middle box or an application layer gateway (see
A packet to the terminals UE is transmitted from the controller SW to the access points AP subjecting the terminals UE. When the controller SW receives the packet to the terminal e.g. UE#0 from the transmitting device 3 (not depicted.), the controller SW transmits it to the terminal UE#0 through the access point AP#0.
Here, the information of resource consumed for maintaining the wireless link between the access point AP#0—the terminal UE#0 (maintaining the wireless link not to be disconnected, maintaining the error rate in the wireless link below a predetermined value and the like) is reported to the controller SW. For example, the information of resource consumed for maintaining the wireless link is power control information, retransmission information in such a case where a retransmission control is performed between the access points AP—the terminals UE or code length information of an error correcting code when using an error correcting code process such as turbo coding. These information are information relating to a resource that the access points are consuming for maintaining the wireless link in the wireless link between the access point AP#0—the terminal UE#0, in which a power value increased as the receiving level is decreased at the terminal, the number of retransmission (e.g. retransmission control by HARQ) times due to reception failures at the terminals and information regarding how long the code length is elongated when encoding with turbo codes are cited as an examples. In this embodiment, the controller SW is composed, as depicted in
An operation of the embodiment depicted in
Normally in the wireless network, retransmission control, power control or redundant encoding is performed for maintaining a predetermined transmission quality when a wireless quality deterioration etc. occurs, where this sequence illustrates a quality maintenance by retransmission. In End-to-End, the feedback information is transmitted thereby to distribute data matching the current quality, where the controller SW edits the feedback information to be transferred.
At first, it is assumed that streaming data at a transmission speed TR1 [Mbps] are flowing (step T1). The terminals UE returns periodical feedback information to the media server MS (step T2), where the controller SW takes in the feedback information upon relaying.
Generally, accesses in the wireless section A are worse in transmission quality than the wire section B, so that the transmission quality maintenance, such as retransmitting packet data with errors having occurred, increasing the transmission power level or providing redundancy (enhancing) of the error correcting code, is performed by an error correction at the controller SW (step T3). The predetermined transmission quality is maintained by these operations.
The terminals UE returns the feedback information based on the transmission quality maintained to the media server MS, where the controller SW relaying this determines whether or not the feedback information should be modified depending on a degree of the transmission quality maintaining ability (error correcting ability), which will now be described in connection with
Namely, the information is not modified when the resource consumed for maintaining the transmission quality is low or has a margin with respect to the transmission quality maintaining ability (limit of a consumable resource; transmission quality maintaining ability known as stored in a storing portion or notified from the access points AP). On the other hand, when the resource is high or has no margin with respect to the quality maintenance ability, by predicting that the transmission quality maintaining ability will be exceeded so that an error more than the predetermined value will occur, the feedback information is modified and a value lower than a value which the terminals UE report to the media server MS is notified to the media server MS (step T4). Without comparison with the transmission quality maintaining ability, the feedback information may be simply revised down if the resource consumed for maintaining the wireless link increases more than the predetermined value.
The media server MS in response thereto determines that a service can not be maintained with the current traffic amount (data amount), so that the information amount is converted into available traffic amount from information (packet discard rate or discarded packet number) described in the feedback information thereby to transmit the streaming data at e.g. transmission speed TR2 (TR2<TR1>)[Mbps] (step T5).
Information Generation at Quality Manager
In the controller SW depicted in
For example, a number (β) having succeeded in the retransmission of the packet can be regarded as a transmission quality maintenance effect or a resource consumed. Therefore, it is also possible to report β and β/α respectively as the discarded number and the discard rate (γ) to the feedback information modifier 1_2.
Alternatively, when the transmission power level is applied as the transmission quality maintaining ability, for example a rate of a period, for which the power level exceeds a defined value, over a predetermined time interval multiplied by a specific coefficient is supposed to be the packet discard rate (γ), thereby enabling the discarded packet number (β) to be obtained. For example, if the defined transmission power level is exceeded for 10% of the predetermined time interval, the packet discard rate assumes 1% if the specific coefficient is supposed to be 0.1 with respect to the value of 10%, so that if the transmitted packet number for the predetermined time interval is 10,000, 100 is the discarded packet number to be allocated.
In the feedback information modifier 1_2, for subtracting a value generated by the quality manager 1_3 from a value stored in the feedback information, a fixed valid time of the value is defined. For example, as depicted in
In any case, in this embodiment, with the reception of the feedback information at the relay device 1 being triggered, it is determined whether or not a wireless quality status for the information valid duration, e.g. a parameter such as the error correcting ability, the number of retransmission times, the power level or the like exceeds the predetermined threshold, where the feedback information is modified to a value less than a value reported from the terminals UE in excess of the predetermined threshold (step 3).
More specific example is depicted in
Step S3_1:
It is determined whether or not the transmission quality is maintained, i.e. whether or not the predetermined transmission quality (e.g. error rate such as the packet discard rate or the discarded packet number) is maintained by the packet retransmission, the power control or the error correcting code level enhancement.
Step S3_2:
It is determined whether or not the information of resource exceeds the threshold (e.g. limit value), i.e. whether or not the number of packet retransmission times or the power level assumes the upper limit or whether or not the code length of the error correcting coding uses the maximum one. A value less than the limit value may be made the threshold. For example, N−1 smaller by a predetermined offset amount may be made the threshold with respect to the number of the maximum retransmission times N.
Step S3_3:
When it is determined that the transmission quality is not maintained, the feedback information is to be necessarily modified.
On the other hand, the feedback information is not modified when there is a margin for further enhancing the transmission quality maintaining ability while the transmission quality is maintained, i.e. when a power enhancement, an increase of the number of retransmission times of the packet or an intensive error correction encoding (redundancy of code) can be performed. Otherwise (step S3_3), the feedback information is to be modified.
It is also to be noted that the present invention is not limited by the above-mentioned embodiments, and it is obvious that various modifications may be made by one skilled in the art based on the recitation of the claims.
According to the embodiments, it is possible to promote the multimedia transmitting device, capable of encoding in real time and modifying the encoding rate with the feedback information from the receiving device so as to slow down the transmission speed by decreasing the encoding rate before the transmission quality maintaining ability in the wireless link reaches the limit value enabling a desired transmission quality to be maintained. As a result, upon the reproduction of the media, it is possible to avoid a rapid deterioration of picture quality or sound quality at the reproduction, caused by exceeding the limit of the transmission quality maintaining ability in the wireless link.
Furthermore, it is possible to constantly provide a remaining power enabling the transmission quality to be improved to the wireless link. Heretofore, a quality deterioration level grows in excess of a certain level of the transmission quality improvement ability in the wireless network, whereas in this embodiment a degree of variation in the transmission quality deterioration becomes moderate. This is also important for lightening the network process, whereby the remaining power saved can be used for the other processes, contributing to improve the network performance.
This application is a continuation of International Application PCT/JP2007/63165 filed on Jun. 29, 2007, the contents of which are herein wholly incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5710981 | Kim et al. | Jan 1998 | A |
6445679 | Taniguchi et al. | Sep 2002 | B1 |
20020015528 | Kondo et al. | Feb 2002 | A1 |
20030018794 | Zhang et al. | Jan 2003 | A1 |
20040156315 | Walls et al. | Aug 2004 | A1 |
20040229570 | Matsumura | Nov 2004 | A1 |
20050143115 | Hiddink et al. | Jun 2005 | A1 |
20060240826 | Shinozaki | Oct 2006 | A1 |
20060246938 | Hulkkonen et al. | Nov 2006 | A1 |
20070064604 | Chen et al. | Mar 2007 | A1 |
20080025269 | Gupta et al. | Jan 2008 | A1 |
Number | Date | Country |
---|---|---|
2161888 | Mar 2010 | EP |
11341063 | Dec 1999 | JP |
2001345807 | Dec 2001 | JP |
2002325095 | Nov 2002 | JP |
2004140674 | May 2004 | JP |
Entry |
---|
International Search Report dated Jul. 24, 2007, from the corresponding International Application. |
Extended European Search Report dated Jun. 28, 2013 received in Application No. 07767949.6. |
Number | Date | Country | |
---|---|---|---|
20100097979 A1 | Apr 2010 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2007/063165 | Jun 2007 | US |
Child | 12645698 | US |