The present invention relates to a transmission controlling apparatus, a transmission controlling method, a recording medium, and a program. More particularly, the invention relates to a transmission controlling apparatus, a transmission controlling method, a recording medium, and a program for instantaneously transmitting data over a network while averting a so-called slow start.
Audio and video data (called multimedia data hereunder where appropriate) is transmitted from sender terminals to receiver terminals over networks such as the Internet. In such cases, the sender terminal is generally required to adjust the rate at which to transmit multimedia data to the receiver terminal in accordance with network traffic status. Otherwise, the receiver terminal would incur packet losses or propagation delays, triggering deterioration in the quality of the transmitted data.
To deal with that problem, the sender terminal controls the rate at which to transmit outgoing data. Generally, protocols such as TCP (Transmission Control Protocol) or UDP (User Datagram Protocol) are applied to the transmission of data over networks. TCP is a transport protocol that guarantees delivery of data and is highly reliable in data transmission. In addition, TCP offers arrangements for autonomously adjusting transmission rates in keeping with network status. In TCP-based communication, the sender terminal typically begins its data transmission by sending a single packet to the receiver terminal and waits for an acknowledgement (ACK) from the latter. Upon receipt of the acknowledgement, the sender terminal sends two packets to the receiver terminal and awaits another acknowledgement. In like manner, the sender terminal increments the number of transmitted packets by one in response to each acknowledgement received from the receiver terminal.
By the above method, however, the rate at which one terminal sends data to another terminal rises only gradually up to a rate at which the transmission stabilizes (the rate is called the stable transmission rate hereunder). This phenomenon is what is known as the slow-start problem.
As opposed to TCP, UDP is a protocol which, although often utilized in transmitting audio and video data, has no arrangements for autonomously adjusting the rate of data transmission in accordance with network status. To make up for the lacuna, a number of methods have been proposed by which to adjust the transmission rate under UDP.
A method called TFRC (TCP-Friendly Rate Control) is proposed by R. Rejaje, M. Handley and D. Estrin in “RAP: An end-to-end rate-based congestion control mechanism for real-time streams in the Internet,” in Proc. of IEEE/INFOCOM '99, March 1999. This method, as with TCP, involves getting the sender side to estimate the state of network loads (traffic status) based on the information returned from the receiver side (called feedback information), whereby the amount of outgoing data (transmission rate) is adjusted autonomously. Because it uses the same scheme as TCP, the TFRC method is also subject to the slow-start problem.
Another method is proposed by J. Widmer in “Equation-based congestion control,” Diploma Thesis, University of Mannheim, February 2000, <URL: http://www.icir.org/tfrc>. This method, too, involves gradually raising the rate of data transmission in response to acknowledgements from the receiver side. Thus the method also shares the slow-start problem with TCP.
Where multimedia data is transmitted on a streaming basis, the slow-start problem has two ramifications: it takes time to reach the stable transmission rate, and the data transmitted at a low rate can be meaningless on the receiver side. Illustratively, when streaming video data is transmitted at a low rate, picture quality can be so poor at the receiver side that pictures are not acceptable to the user in terms of quality. In such a case, the user may need to wait for pictures to become good enough to watch in quality, i.e., the user may need to wait for the transmission rate to become sufficiently high so that the quality of the transmitted pictures is acceptable to the user. With broadband connections coming into general use today, the content transmitted over the network is getting larger in quality so that the user's expectations for picture quality are higher than ever. The higher the quality of pictures desired by the user, the longer the user may be required to wait for satisfactory pictures to arrive because of the slow-start problem.
A technique has been proposed to solve the slow-start problem outlined above. The proposed technique involves estimating the bandwidths (transmission rates) of the sender and the receiver sides by use of a probe packet called a packet pair upon start of a data transmission (e.g., as disclosed in Japanese Patent Laid-open No. 2002-94567, page 14, FIGS. 5 and 8).
While it bypasses the slow-start problem, the proposed technique above incurs a new problem. That is, from the time the probe packet is sent to the receiver side until an acknowledgement (ACK) is received for the transmitted packet (i.e., during the so-called round trip time), the sender side is incapable of starting to send target data such as video data.
Furthermore, the probe packet has nothing to do with the data desired by the receiver side. Transmitting such extra data can narrow the bandwidth over the network.
The present invention has been made in view of the above circumstances and provides arrangements for instantaneously transmitting data over the network while averting the so-called slow start.
According to one embodiment of the present invention, there is provided a transmission controlling apparatus for controlling transmission of data. The apparatus includes: quality determining means for determining quality of the data in keeping with a property of the data; transmission rate determining means for determining a transmission rate in accordance with the quality determined by the quality determining means; and transmission rate controlling means for controlling the transmission rate of the data so that the data will start to be transmitted at the transmission rate determined by the transmission rate determining means.
Preferably, the data may constitute pictures, and the property of the data may be a picture property.
The picture property may preferably be at least one of an application property, a content property, and an imaging device property.
Preferably, the inventive transmission controlling apparatus may further include storing means for storing the data of which the quality is associated with the picture property. The quality determining means may determine the quality based on the data stored in the storing means.
Preferably, the data may constitute pictures encoded by a predetermined encoding method, and the transmission rate determining means may determine the transmission rate based on a picture size of the pictures and on a relationship between the quality associated with the encoding method on the one hand and the transmission rate on the other hand.
Preferably, the inventive transmission controlling apparatus may further include information inputting means for inputting information about the property of the data from outside the transmission controlling apparatus. The quality determining means may determine the quality in accordance with the information input by the information inputting means.
The transmission rate controlling means may preferably control the transmission rate of the data so that after the transmission of the data has started, the rate of the transmission will not be lowered below the transmission rate supplied from the transmission rate determining means.
The transmission rate controlling means may preferably control the transmission rate of the data so that in case of a communication time-out of the data, the transmission of the data will be resumed at the transmission rate determined by the transmission rate determining means.
According to another embodiment of the present invention, there is provided a transmission controlling method for controlling transmission of data. The method includes the steps of: determining quality of the data in keeping with a property of the data; determining a transmission rate in accordance with the quality determined in the quality determining step; and controlling the transmission rate of the data so that the data will start to be transmitted at the transmission rate determined in the transmission rate determining step.
According to a further embodiment of the present invention, there is provided a recording medium which stores in computer-readable fashion a program for controlling transmission of data. The program includes the steps of: determining quality of the data in keeping with a property of the data; determining a transmission rate in accordance with the quality determined in the quality determining step; and controlling the transmission rate of the data so that the data will start to be transmitted at the transmission rate determined in the transmission rate determining step.
According to an even further embodiment of the present invention, there is provided a program for controlling transmission of data and for causing a computer to execute a procedure including the steps of: determining quality of the data in keeping with a property of the data; determining a transmission rate in accordance with the quality determined in the quality determining step; and controlling the transmission rate of the data so that the data will start to be transmitted at the transmission rate determined in the transmission rate determining step.
Where the transmission controlling apparatus, transmission controlling method, recording medium, and program according to this invention are in use, the quality of data to be transmitted is determined in keeping with the property of the data in question. The rate at which to transmit the data is established in accordance with the data quality thus determined. Data transmission is controlled in such a manner that the data starts getting transmitted at the established transmission rate.
The transmission controlling apparatus may be either an independent apparatus or a block for handling transmission control processing in an apparatus.
The receiving apparatus 13 receives the packets from the transmitting apparatus 11, acquires video data from the received packets, and has the data displayed on a display unit (not shown) such as a CRT (Cathode Ray Tube) unit or an LCD (Liquid Crystal Display). In response to the packets received from the transmitting apparatus 11, the receiving apparatus 13 generates feedback information such as acknowledgements (ACK) and returns the feedback information to the transmitting apparatus 11.
For purpose of simplification and illustration, the transmitting apparatus 11 is shown independent of the receiving apparatus 13 in this description. In practice, however, the transmitting apparatus 11 may be designed also to function as the receiving apparatus 13 and the receiving apparatus 13 may also be given the capabilities of the transmitting apparatus 11.
The picture acquisition unit 21 is formed illustratively by a camcorder or a digital video camera. The picture acquisition unit 21 takes pictures of a subject and supplies the picture encoding unit 22 and initial rate determination unit 24 of the video data constituting the imaged object. The video data is typically composed of a brightness signal (Y), of the difference between the brightness signal and a red component (U), and of the difference between the brightness signal and a blue component (V) in the YUV format.
As described, when the user designates the encoding method by manipulating the operation unit 27, the information denoting the designated encoding method is supplied from the operation unit 27 to the picture encoding unit 22. The picture encoding unit 22 encodes the video data coming from the picture acquisition unit 21 through the use of the encoding method such as MPEG-4 or JPEG 2000 designated and supplied from the operation unit 27. The video data thus encoded (called the encoded data hereunder) is forwarded from the picture encoding unit 22 to a transmission unit 23.
Given the encoded data from the picture encoding unit 22, the transmission unit 23 splits the received data to packetize into a plurality of packets called data packets. The transmission unit 23 prefixes each of the generated data packets with a packet head of TCP/IP (Transmission Control Protocol/Internet Protocol) or UDP/IP (User Datagram Protocol/Internet Protocol). In keeping with a timing command coming from a rate control unit 25, to be described later, the transmission unit 23 transmits the data packets each furnished with the packet header. (the packet header-prefixed packets will simply called the packets hereunder) to the receiving apparatus 13 through a network interface unit 26.
The initial rate determination unit 24 is supplied with picture-related properties both from the picture acquisition unit 21 and from outside the transmitting apparatus 11. The initial rate determination unit 24 is also fed by the operation unit 27 with the information denoting the encoding method selected by the user manipulating the operation unit 27. Based on the property of the pictures in question and on the designated encoding method, the initial rate determination unit 24 determines a minimum picture quality acceptable to the user who views the pictures received by the receiving apparatus 13. Furthermore, the initial rate determination unit 24 determines a transmission rate that satisfies the minimum picture quality and supplies the determined transmission rate to the rate control unit 25 as an initial transmission rate. Structural details of the initial rate determination unit 24 and specific picture properties will be discussed later in reference to
The rate control unit 25 controls the transmission rate at which the transmission unit 23 transmits packets. More specifically, when the transmission unit 23 transmits a first packet, the rate control unit 25 supplies the transmission unit 23 with a timing command for causing the first packet to be transmitted at the initial transmission rate fed from the initial rate determination unit 24. For transmission of the second and subsequent packets, the rate control unit 25 determines a transmission rate based on the feedback information coming from the receiving apparatus 13 through the network interface unit 26. The rate control unit 25 then supplies the transmission unit 23 with a timing command such that the packets will be transmitted at the determined transmission rate.
When the display unit displays the video data transmitted from the transmitting apparatus 11 to the receiving apparatus 13 at the initial transmission rate, the quality of the displayed pictures (i.e., picture quality) is the lowest quality appropriated for streaming data. That is because the initial transmission rate is determined as representative of the lowest picture quality acceptable to the user viewing the received pictures. If the pictures were transmitted at a rate lower than the initial transmission rate, the quality of the pictures would be less than that is acceptable to the user. That means the rate control unit 25 cannot let the transmission rate at which the transmission unit 23 sends packets become lower than the initial transmission rate. In other words, the initial transmission rate is both the rate at which the transmission unit 23 starts data transmission and the lowest limit of transmission rates for communication. The rate control unit 25 thus determines adaptively the transmission rate in keeping with the feedback information coming from the receiving apparatus 13 through the network interface unit 26, making sure that the determined rate does not become lower than the initial transmission rate supplied from the initial rate determination unit 24.
It might happen that the feedback information corresponding to the packets sent by the transmission unit 23 is not received by the network interface unit 26, i.e., that a communication time-out is detected between the transmitting apparatus 11 and the receiving apparatus 13, so that the rate control unit 25 cannot determine the rate at which to transmit the next packet based on the feedback information. In such a case, the rate control unit 25 resets the transmission rate at which the transmission unit 23 sends the next packet, to the initial transmission rate supplied from the initial rate determination unit 24. The transmission unit 23 is then controlled to transmit the next packet at the initial transmission rate thus supplied.
The network interface unit 26 outputs the packets coming from the transmission unit 23 to the receiving apparatus 13 over the network 12. The network interface unit 26 also gives the rate control unit 25 the feedback information sent from the receiving apparatus 13 over the network 12.
Based on the property of the pictures being acquired by the picture acquisition unit 21 (
The picture property may be any one of an application property, a content property, and an imaging device property.
The application property is one of, say, four categories of content represented by teleconference, news program, baseball telecast, and soccer telecast. Typically, the news program is a program that shows a person or persons in the middle of the screen against a background that moves sporadically. The teleconference is a program that shows a person or persons in the middle of the screen against a background that remains mostly static. Because of a high demand for depicting the facial expressions of the people being imaged, the picture quality required of the teleconference is higher than that of the news program. Compared with the baseball telecast, the soccer telecast is required to emphasize two teams being constantly in motion on a single playing field. That means the picture quality required of the soccer telecast emphasizing movements is lower than that of the baseball telecast. The user designates the application property (e.g., teleconference, news program, baseball telecast, or soccer telecast) by manipulating the operation unit 27. The information thus designated is supplied from the operation unit 27 to an acceptable picture quality determination unit 42.
The property of content represents a degree of the visual noise in content as perceived by the humans. Illustratively, pictures of rapid movements or pictures full of small details are not perceived by the humans to be as much degraded in quality as the high compression rate in use would suggest. Defining the property of content thus involves taking into consideration the characteristics of the humans' sense of sight. The property of a given content may be represented illustratively by the degree of rapidity of motions in the pictures of that content. The rapidity of motions in pictures is typically obtained by first extracting frame-by-frame pictures at predetermined intervals from the video data fed from the picture acquisition unit 21 to the initial rate determination unit 24, and by acquiring chronologically the differences between the frame pictures in terms of correspondingly moving pixels found therebetween.
The property of an imaging device signifies how much the device affects the perceived noise in content. Illustratively, pictures taken by a rapidly moving digital video camera are not perceived by the humans to be as corrupted in quality as the elevated compression rate in use would imply. If the picture acquisition unit 21 is a digital video camera, information indicating whether the camera was moving or fixed while taking pictures may be adopted as the imaging device property. That information may illustratively be represented by the traveling speed of the digital video camera. When acquired outside the transmitting apparatus 11, the value of the camera speed may be supplied to an external interface unit 41. If the digital video camera was fixed and stationary, information indicating that the traveling speed of the camera is zero is sent to the external interface unit 41. Whereas the property of the imaging device is similar to the property of content, it is easier to obtain the traveling speed of the device as an objectively measured value than a value representative of the content property.
The external interface unit 41 receives the above-described imaging device property (i.e., traveling speed) from outside the transmitting apparatus 11, and forwards the received property to the acceptable picture quality determination unit 42.
Based on the video data fed from the picture acquisition unit 21, the acceptable picture quality determination unit 42 calculates the above-mentioned picture motions (i.e., content property). In reference to a database 43, the acceptable picture quality determination unit 42 determines a minimum acceptable picture quality based on the application property sent from the operation unit 27, on the picture motions (i.e., content property) calculated from the video data coming from the picture acquisition unit 21, and on the traveling speed (i.e., imaging device property) supplied from the external interface unit 41. The minimum acceptable picture quality thus determined is forwarded from the acceptable picture quality determination unit 42 to a transmission rate determination unit 44. For this embodiment of the invention, it is assumed that the application property is selected from four options, i.e., teleconference, news program, baseball telecast, and soccer telecast; that the content property is furnished by the picture motions; and that the imaging device property is provided by the traveling speed of the picture acquisition unit 21.
The database 43 is arranged to retain in advance a table associating application properties with minimum allowable picture qualities, as well as data denoting relations between picture motions and the minimum allowable picture qualities, as shown in
Although the figures above show no example of data associating traveling speeds as the property of the imaging device with minimum acceptable picture qualities, such relations can also be expressed in a manner similar to what is shown in
Alternatively, the relationship between picture motions and minimum acceptable picture qualities may be defined not by the function fx( ) (i.e., D=fx(m) in
As described, in reference to the database 43, the acceptable picture quality determination unit 42 determines a minimum acceptable picture quality Di (i=one of 1 through 4) based on the application property and another minimum acceptable picture quality Dm1 based on the content property. With the minimum acceptable picture qualities Di and Dm1 thus determined, the acceptable picture quality determination unit 42 decides on a definitive minimum acceptable picture quality D and supplies it to the transmission rate determination unit 44. Illustratively, the definitive minimum acceptable picture quality D may be determined by selecting whichever is the higher of the minimum acceptable picture quality Di (i=one of 1 through 4) derived from the application property and the minimum acceptable picture quality Dm1 derived from the picture motion (traveling speed) based on the content property (picture quality).
The database 43 should preferably be updated periodically. That is because subsequent experiments and experiences are expected to prompt changes in the table that associates application properties with minimum acceptable picture qualities, as well as in the relations between content properties and the minimum acceptable picture qualities. Illustratively, the database 43 may be stored on a removable storage medium. This allows the storage medium, along with the database 43 held thereon, to be replaced when any of the data in the database 43 has been updated. As another alternative, the database 43 may be connected to the network 12 and updated by acquiring updated data from servers or like sources on the network 12.
Returning to
What follows is a discussion of relations between the picture size and picture compression rate on the one hand, and bandwidths (i.e., transmission rates) on the other hand. With all other conditions made equal, the SD size picture obviously requires a greater bandwidth (i.e., higher transmission rate) than the SIF size picture when they are transmitted. When video data is sent from the transmitting apparatus 11 to the receiving apparatus 13, the data is compressed by the picture encoding unit 22 as mentioned above before being output onto the network 12. It follows that raising the compression rate at which the picture encoding unit 22 compresses (i.e., encodes) the video data reduces the bandwidth (transmission rate) necessary for transmitting the data over the network 12. However, higher compression rates used by the picture encoding unit 22 for its compressing (encoding) process translate into poorer picture qualities. In other words, the relations between picture qualities and transmission rates are specific to each picture size and encoding method (compression rate), as depicted in
In
In
The data representative of the relations between picture qualities and transmission rates as indicated in
For this embodiment of the invention, two picture sizes are assumed, i.e., SD size and SIF size, with respect to the pictures taken by the picture acquisition unit 21. However, this is not limitative of the invention. Alternatively, other sizes may be adopted, such as the HD (High Definition) size (denoting 1920 by 1080 pixels).
The video data encoding method (compression method) designated by the user manipulating the operation unit 27 is not limited to MPEG-4 or JPEG 2000. Other encoding methods may also be adopted, such as MPEG-2.
If any of these alternative picture sizes and encoding methods is to be adopted, the relations between picture qualities and transmission rates regarding the new picture size and/or encoding method will be set anew in the transmission rate determination unit 44 as plotted in
Although the relations between the minimum acceptable picture quality and the transmission rate with respect to the picture size and encoding method of interest as depicted in
Referring to the flowchart of
In step S1, the initial rate determination unit 24 sets the initial transmission rate to zero and supplies it to the rate control unit 25 as the initial value. Control is passed from step S1 to step S2.
In step S2, the acceptable picture quality determination unit 42 in the initial rate determination unit 24 carries out an acceptable picture quality determining process. Step S2 is followed by step S3. The acceptable picture quality determining process, to be discussed later in detail with reference to
In step S3, the transmission rate determination unit 44 carries out an initial transmission rate determining process based on the minimum acceptable picture quality supplied from the acceptable picture quality determination unit 42 in step S2. Control is passed from step S3 to step S4. It is assumed that the initial transmission rate determined in the initial transmission rate determining process is represented by reference character B. The initial transmission rate determining process will be discussed later in detail with reference to
In step S4, the transmission rate determination unit 44 supplies the rate control unit 25 with the initial transmission rate B determined by the unit 44 in step S3. Step S4 is followed by step S5.
In step S5, the rate control unit 25 carries out rate control by resorting to the TFRC method. More specifically, the rate control unit 25 gives the transmission unit 23 a timing command causing the unit 23 to establish the initial transmission rate B that was sent from the transmission rate determination unit 44 in step S4. Control is passed from step S5 to step S6.
In step S6, the rate control unit 25 checks to determine whether transmission of the video data acquired by the picture acquisition unit 21 has ended, i.e., whether the packets sent from the transmission unit 23 to the receiving apparatus 13 through the network interface unit 26 have been exhausted. If the transmission of the video data is not found to have ended in step S6, step S7 is reached. In step S7, the rate control unit 25 checks to determine whether a time-out has occurred, i.e., whether feedback information is supplied from the network interface unit 26 in response to the packets sent by the transmission unit 23.
If no time-out is detected in step S7, the rate control unit 25 returns to step S5 and repeats steps S5 through S7. During the process, the rate control unit 25 determines adaptively the transmission rate based on the feedback information coming from the network interface unit 26. For transmission rate control, the rate control unit 25 gives the transmission unit 23 a timing command causing the unit 23 to established the transmission rate thus determined.
If a time-out is detected in step S7, i.e., if the rate control unit 25 is not supplied with feedback information from the network interface unit 26 in response to the packets sent by the transmission unit 23, then the rate control unit 25 returns to step S4 and repeats the subsequent steps. That is, the rate control unit 25 resets the transmission rate to the initial transmission rate B for transmission rate control.
When the transmission of the video data is found to have ended in step S6, the transmission rate determining process is terminated.
The acceptable picture quality determining process performed by the acceptable picture quality determination unit 42 in step S2 of
In step S21, the acceptable picture quality determination unit 42 acquires the application property supplied from the operation unit 27. Control is passed from step S21 to step S22.
In step S22, the acceptable picture quality determination unit 42 checks to determine whether the application property acquired in step S21 is representative of the teleconference. If in step S22 the application property is found to represent the teleconference, the acceptable picture quality determination unit 42 goes to step S23. In step S23, the acceptable picture quality determination unit 42 adopts (i.e., determines) D1 as the minimum acceptable picture quality by referencing the table which resides in the database 43 and is shown in
If in step S22 the application property is not found to be representative of the teleconference, step S24 is reached. In step S24, the acceptable picture quality determination unit 42 checks to determine whether the application property acquired in step S21 is representative of the news program. If in step S24 the application property is found to represent the news program, the acceptable picture quality determination unit 42 goes to step S25. In step S25, the acceptable picture quality determination unit 42 adopts D2 as the minimum acceptable picture quality by referencing the table which resides in the database 43 and is shown in
If in step S24 the application property is not found to be representative of the news program, step S26 is reached. In step S26, the acceptable picture quality determination unit 42 checks to determine whether the application property acquired in step S21 is representative of the baseball telecast. If in step S26 the application property is found to represent the baseball telecast, the acceptable picture quality determination unit 42 goes to step S27. In step S27, the acceptable picture quality determination unit 42 adopts D3 as the minimum acceptable picture quality by referencing the table which resides in the database 43 and is shown in
If in step S26 the application property is not found to be representative of the baseball telecast, step S28 is reached. In step S28, the acceptable picture quality determination unit 42 checks to determine whether the application property acquired in step S21 is representative of the soccer telecast. If in step S28 the application property is found to represent the soccer telecast, the acceptable picture quality determination unit 42 goes to step S29. In step S29, the acceptable picture quality determination unit 42 adopts D4 as the minimum acceptable picture quality by referencing the table which resides in the database 43 and is shown in
If in step S28 the application property is not found to be representative of the soccer telecast, step S30 is also reached. In step S30, the acceptable picture quality determination unit 42 calculates the picture motion ml from the video data supplied by the picture acquisition unit 21. By referencing the relations between the picture motion m and the minimum acceptable picture quality D held in the database 43 and shown in
In step S31, the acceptable picture quality determination unit 42 determines a definitive minimum acceptable picture quality D based on both the minimum acceptable picture quality Di (i=one of 1 through 4) calculated from the application property and on the minimum acceptable picture quality Dm1 derived from the picture motion m1. The minimum acceptable picture quality D thus determined is supplied to the transmission rate determination unit 44, and control is returned to the process of
Referring to the flowchart of
In step S51, the transmission rate determination unit 44 acquires the user-designated video data encoding method supplied from the operation unit 27. From step S51, control is passed on to step S52.
In step S52, the transmission rate determination unit 44 checks to determine whether the encoding method acquired in step S51 is MPEG-4, i.e., whether the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are encoded using the MPEG-4 standard. If in step S52 the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are not found to be encoded using the MPEG-4 standard, step S53 is reached. In step S53, the transmission rate determination unit 44 checks to determine whether the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are encoded using the JPEG 2000 standard.
If in step S53 the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are not found to be encoded using the JPEG 2000 standard, then the transmission rate determination unit 44 determines an initial transmission rate BD as the default, supplies it to the rate control unit 25, and terminates the process. The situation in which neither MPEG-4 nor JPEG 2000 applies occurs illustratively when the user fails to designate any encoding method. In such a case, the transmission rate determination unit 44 may select as the initial transmission rate BD the lowest transmission rate relative to the minimum acceptable picture quality D supplied from the acceptable picture quality determination unit 42. The selection is made with respect to the relational expressions (in
If in step S53 the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are found to be encoded using the JPEG 2000 standard, step S55 is reached. In step S55, the transmission rate determination unit 44 checks to determine whether the pictures acquired by the picture acquisition unit 21 have the SD size.
If in step S55 the pictures acquired by the picture acquisition unit 21 are found to have the SD size, step S56 is reached. In step S56, the transmission rate determination unit 44 selects the function B=fc(D) shown in
If in step S55 the pictures acquired by the picture acquisition unit 21 are not found to have the SD size, i.e., if the pictures are found to have the SIF size, then step S57 is reached. In step S57, the transmission rate determination unit 44 selects the function B=fd(D) shown in
If in step S52 the pictures sent by the transmitting apparatus 11 to the receiving apparatus 13 are found to be encoded using the MPEG-4 standard, step S58 is reached. In step S58, the transmission rate determination unit 44 checks to determine whether the pictures acquired by the picture acquisition unit 21 have the SD size.
If in step S58 the pictures acquired by the picture acquisition unit 21 are found to have the SD size, step S59 is reached. In step S59, the transmission rate determination unit 44 selects the function B=fa(D) shown in
If in step S58 the pictures acquired by the picture acquisition unit 21 are not found to have the SD size, i.e., if the pictures are found to have the SIF size, then step S60 is reached. In step S60, the transmission rate determination unit 44 selects the function B=fb(D) shown in
In step S61, using the function selected in step S56, S57, S59, or S60, the transmission rate determination unit 44 calculates the transmission rate B corresponding to the minimum acceptable picture quality D supplied from the acceptable picture quality determination unit 42. Thereafter, control is returned to the process of
A line L1 represents the relations between the elapsed time since the start of data transmission by the transmitting apparatus 11 of
Another line L0 denotes the relations between the elapsed time since the start of data transmission by the conventional setup on the one hand and transmission rates on the other hand. The transmission rate at the start of transmission is zero. When an acknowledgement is received upon elapse of the time period RTT, the transmission rate is raised by a predetermined level for the next transmission. This transmission rate control is repeated in response to the feedback information corresponding to the transmitted packets in a manner similar to how the inventive transmitting apparatus 11 carries out its communication. As a result, the stable transmission rate Bstable is reached a time period T0 after the start of data transmission, which is later than the time T1.
As described above, the transmitting apparatus 11 reduces the time required to reach the stable transmission rate Bstable by a time period (T0-T1) compared with the conventional setup. In the example of
Also with regard to the example of
Obviously, the higher the initial transmission rate B1 (
According to this invention, as described above, the transmission rate that satisfies the minimum acceptable picture quality is determined as the initial transmission rate. When the transmission of data is started at the initial transmission rate thus determined, it is possible to bypass the slow-start problem that has plagued data transmissions.
According to the invention, there is no need for the sender side to send to the receiver side a packet for measuring the bandwidth on the network and to wait for an outcome of the transmission (i.e., feedback information) from the receiver side. That means data can be transmitted without delay.
As in the case of the initial rate determination unit 24 in
What makes the initial rate determination unit 61 in
That is, the external interface unit 71 is supplied, from outside the transmitting apparatus 11, with the same table associating application properties with minimum acceptable picture qualities and the same data representing relations between picture motions and the minimum acceptable picture qualities as those retrieved from the database 43 shown in
Illustratively, the external interface unit 41 may be a network interface similar to the network interface unit 26 of
In the same manner as with the first embodiment of
In the same manner as with the first embodiment in
With the above-described second embodiment of this invention, the table associating application properties with minimum acceptable picture qualities and the data denoting relations between picture motions and the minimum acceptable picture qualities were shown supplied from outside the transmitting apparatus 11 through the external interface unit 71 as the basis on which the acceptable picture quality determination unit 42 determines the minimum acceptable picture quality. Alternatively, the user (i.e., the person who has video data transmitted or received) may explicitly set the minimum acceptable picture quality that may be sent to the acceptable picture quality determination unit 42 via the external interface unit 71. As another alternative, the user may explicitly establish the minimum acceptable picture quality by manipulating the operation unit 27. In turn, the operation unit 27 supplies the established quality to the acceptable picture quality determination unit 42. If the user explicitly sets the minimum acceptable picture quality, the acceptable picture quality determination unit 42 forwards the supplied picture quality unchanged to the transmission rate determination unit 44.
Where the second embodiment is in use, any updates made from numerous experiments and experience to the table associating application properties with minimum allowable picture qualities and to the data denoting relations between picture motions and the minimum allowable picture qualities may be supplied without delay to the acceptable picture quality determination unit 42 via the external interface unit 71. In terms of up-to-dateness, the second embodiment is thus preferred to the first embodiment in which the database 43 is set up inside the transmitting apparatus 11.
The second embodiment of the above-described structure provides the same effects (shown in
In the above-described embodiments of the invention, the transmitting apparatus 11 was shown transmitting video data. However, this is not limitative of the invention. Alternatively, this invention applies to setups whereby diverse kinds of streaming data including moving pictures, still pictures, sounds, presentation data, and video games are transmitted. It is also possible for the transmitting apparatus 11 to send data other than streaming data.
In the embodiments described above, the application property and the imaging device property were shown supplied by the user manipulating the operation unit 27 or sent from outside the transmitting apparatus 11 through the external interface unit 41. Alternatively, the transmitting apparatus. 11 may be arranged to determine by itself these properties based on the pictures acquired by the picture acquisition unit 21.
In the above embodiments, the picture size was shown determined by the transmission rate determination unit 44 based on the video data supplied from the picture acquisition unit 21. Alternatively, the picture size may be designated by the user manipulating the operation unit 27. In turn, the operation unit 27 feeds the designated picture size to the initial rate determination unit 61.
In the embodiments above, the picture encoding method was shown designated by the user manipulating the operation unit 27. Alternatively, an appropriate encoding method may be established beforehand as the default. Only when the user designates a different encoding method, the designated method may be replaced therewith.
The series of steps and processes described above may be executed either by hardware or by software. In any case, the transmitting apparatus 11 may be constituted illustratively by a personal computer such as one shown in
In
The CPU 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input/output interface 305 is also connected to the bus 304.
The input/output interface 305 is connected with diverse components. They include an input unit 306 formed illustratively by a keyboard and mouse, an output unit 307 constituted by a display device such as a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display) as well as by speakers, the storage unit 308 composed of a hard disk drive or the like, a communication unit 309 having a modem and a terminal adapter, and an imaging unit 331 made up of image devices such as CCD (Charge Coupled Devices) or CMOS (Complementary Metal Oxide Semiconductors). The communication unit 309 performs communications over the network such as the Internet. The imaging unit 311 takes pictures of an object and supplies the CPU 301 and related components with video data representative of the imaged object by way of the input/output interface 305. The CPU 301 controls illustratively the processes performed by the acceptable picture quality determination unit 42 and transmission rate determination unit 44 in the initial rate determination unit 24 as well as by the picture encoding unit 22, transmission unit 23, and rate control unit 25. The communication unit 309 controls the processes carried out by the network interface unit 26 and by the external interface unit 41 in the initial rate determination unit 24, among others.
The input/output interface 305 is further connected with a drive 310 as needed. A recording medium such as a magnetic disk 321, an optical disk 322, a magneto-optical disk 323, or a semiconductor memory 324 is loaded into the drive 310. Computer programs may be retrieved from the loaded recording medium and installed as needed into the storage unit 308.
In this description, the steps which are stored on the recording medium and which describe the programs to be executed represent not only the processes that are to be carried out in the depicted sequence (i.e., on a time series basis) but also processes that may be performed parallelly or individually.
According to the above-described transmission controlling apparatus, transmission controlling method, recording medium, and program of this invention, it is possible to start transmitting data over the network instantaneously while circumventing the slow-start problem using the inventive arrangements.
Number | Date | Country | Kind |
---|---|---|---|
2003-057428 | Mar 2003 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP04/02651 | 3/3/2004 | WO | 8/5/2005 |