This application is based upon and claims the benefit of priority of prior Japanese Patent Application No. 2009-155503, filed on Jun. 30, 2009, the entire contents of which are hereby incorporated by reference.
The embodiments discussed herein are related to a transmission technology in the case where real-time transmission and non-real-time transmission are mixed in the transmission of media information on a packet network.
When a transmitting device and a receiving device communicate media information such as images, voices and the like with each other on a packet network such as an IP (Internet protocol) network or the like, sometimes real-time transmission and non-real-time transmission are mixed.
In real-time transmission, for example, as illustrated in
However, in non-real-time transmission, as illustrated in
In this case, although the real-time image receiving device 1301 illustrated in
In order to realize such mixed reception, it is necessary for the real-time image receiving device 1301 to have a flow control function for non-real-time transmission.
However, when the real-time image receiving device 1301 attempts to receive an image signal file transmitted from the real-time image distribution device 1303 not in real time, there is no prior art capable of discriminating real-time transmission from non-real-time transmission. Therefore, conventionally a flow control function cannot be mounted on the real-time image receiving device 1301.
Therefore, when the real-time image receiving device 1301 receives an image signal file transmitted from the real-time image distribution device 1303 not in real time without flow control, as illustrated in
One aspect can be realized as a media distribution switching method for switching media distributed from a transmitting device to a receiving device on a packet network and has the following configuration.
Firstly, a request packet for requesting the distribution of media information from a receiving device to a transmitting device is transmitted.
Then, a request response packet to which is attached device type information indicating whether the transmitting device is for real-time or non-real-time transmission is returned from the transmitting device to the receiving device in response to the request packet.
Then, in the receiving device, an operation mode for real-time transmission and that for non-real-time transmission are switched on the basis of the device type information attached to the request response packet received from the transmitting device, and a receiving operation is performed.
The object and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the claims.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention as claimed.
Preferred embodiments of the present invention will be explained in detail with reference to accompanying drawings.
In the receiving device 100 illustrated in
A request response packet receiving unit 103 receives a request response packet in response to the request packet transmitted by its own device from the network. A request response analysis unit 104 analyzes the contents of a request response, which are given in the request response packet received by the request response packet receiving unit 103. A mode determination unit 105 determines which is specified as a device type in the request response, a real-time encoder or a distribution server. If a real-time encoder is specified in the request response, the mode determination unit 105 notifies a flow control unit 106 and a switching unit 115 of a real-time mode. If a distribution server is specified in the request response, the mode determination unit 105 notifies a flow control unit 106 and a switching unit 115 of a server mode.
A data packet receiving unit 109 receives a data packet transmitted from the transmitting device 200 via the network.
A packet determination unit 110 determines whether the data packet stores PCR or image information other than PCR. When operating in a real-time mode, the packet determination unit 110 detects a data packet storing PCR or a data packet storing image signals transmitted from the transmitting device 200, which is the real-time image distribution device. The packet determination unit 110 writes the data packet storing image signals in a packet receiving buffer 111 and transfers the data packet storing PCR data to a PCR control unit 112.
The PCR control unit 112 extracts PCR data from the packet transferred from the packet determination unit 110 and calculates a differential value between each piece of PCR data and a system time clock (STC) in its own device. Then, the PCR control unit 112 generates a voltage control signal corresponding to the differential value and supplies it to a VCXO (voltage control Xtal oscillator).
In the real-time mode, the mode determination unit 105 enables the switching unit 115 to select the output of the VCXO 113. Thus, in the real-time mode, a clock voltage-controlled on the basis of the PCR oscillated from the VCXO 113 is supplied to a motion image decoding unit 116.
Thus, in the real-time mode, the motion image decoding unit 116 can decode/reproduce the image signal packet received by the packet receiving buffer 111 by a clock synchronized with the clock at the time of encoding. In other words, in the real-time mode, the data packet receiving unit 109, the packet determination unit 110, the packet receiving buffer 111, the motion image decoding unit 116, a PCR generation unit 206, the VCXO 113, and the switching unit 115 constitute a first receiving unit for receiving media information in an operation mode for making a real-time transmission.
In the real-time mode, since synchronous reproduction is possible as described above, it is not necessary to exercise flow control according to the state of the packet receiving buffer 111. Therefore, in the real-time mode, the flow control unit 106 is prevented from operating by the mode determination unit 105 notifying the flow control unit 106 of a real-time mode.
However, when operating in a sever mode, since a packet storing PCR data is neglected and discarded, only a data packet is written in the packet receiving buffer 111. This data packet stores the image file transmitted from the transmitting device 200, which is a file distribution server.
In a sever mode, the mode determination unit 105 enables the switching unit 115 to select the output of a self-running OSC 114. The self-running OSC (oscillator) 114 oscillates a system time clock regardless of timing on the transmitting side. Thus, in a sever mode, the system time clock oscillated from the self-OSC 114 is supplied to the motion image decoding unit 116.
As a result, in a sever mode, the motion image decoding unit 116 decodes/reproduces the image file received by the packet receiving buffer 111 on the basis of the system time clock oscillated by the self-running OSC 114 at a timing independent of the transmitting device 200.
In this case, in a sever mode, the mode determination unit 105 notifies the flow control unit 106 of a server mode. As a result, since the flow control unit 106 absorbs the difference between reproduction timing and transmission timing, it exercises flow control.
Specifically, when packets remaining in the packet receiving buffer 111 seem to exceed the buffer size in a sever mode, the flow control unit 106 issues a first instruction to a transmit stop/start request packet transmitting unit 107. As a result, the transmit stop/start request packet transmitting unit 107 generates a transmit stop request packet for the transmitting device 200 in communication and transmits this packet to the network via a request packet transmitting unit 108. As a result, the transmitting device 200 starts (re-starts) the transmission of the data packet storing the image file and the amount of packets received by the receiving device 100 is adjusted.
In this case, in a server mode, since the difference between reproduction timing and transmission timing tends to increase, it can also be controlled in such a way that the capacity of the packet receiving buffer 111 may be increased.
Thus, in a server mode, the data packet receiving unit 109, the packet determination unit 110, the packet receiving buffer 111, the motion image decoding unit 116, the PCR generation unit 206, the self-running OSC 114, the switching unit 115, the flow control unit 106, the transmit stop/start request packet transmitting unit 107, and the request packet transmitting unit 108 forma second receiving unit for receiving media information in an operation mode for a non-real-time transmission.
Then, in the transmitting device 200 illustrated in
A request packet analysis unit 202 analyzes the received request packet.
When the request packet requests the start or stoppage of the distribution of an image signal or an image file as an analysis result, the request packet analysis unit 202 instructs a request response packet transmitting unit 203 to transmit a request response packet. The request response packet transmitting unit 203 transmits a request response packet to the receiving device 100 (
When the request packet requests the start or stoppage of the distribution of an image signal or an image file as an analysis result, the request packet analysis unit 202 also instructs the motion image transmitting unit 204 to start or stop the distribution of an image signal or an image file.
A self-running OSC 205 oscillates a system time clock.
If the motion image transmitting unit's 204 own device is a real-time image distribution device, it encodes image signals in real time and generates image signal packets, on the basis of a clock generated by the self-running OSC 205, and sequentially writes them in a packet transmitting buffer 207 until the distribution stops after it starts. If the motion image transmitting unit's 204 own device is a file distribution server, it reads image files from a storage device, which is not illustrated, generates image file packets, and sequentially writes them in the packet transmitting buffer 207 until the distribution stops after it starts.
Furthermore, if the PCR generation unit's 206 own device is a real-time image distribution device, it performs the following operations until the distribution stops after it starts. Specifically, the PCR generation unit 206 generates a packet storing PCR data corresponding to the clock of an image signal distributed in real time by the motion image transmitting unit 204, on the basis of a clock generated by the self-running OSC 205. Then, the PCR generation unit 206 writes the packet in the packet transmitting buffer 207.
If the PCR generation unit's 206 own device is a file distribution server, the PCR generation unit 206 is not installed.
The packet transmitting buffer 207 sequentially transfers the written data packets to a data packet transmitting unit 208. The data packet transmitting unit 208 transmits the data packets to the network toward the receiving device 100 (
In this case, if the request packet is a transmit stop request packet resulting from the analysis when the request packet analysis unit's 202 own device is a file distribution server, the request packet analysis unit 202 instructs the packet transmitting buffer 207 to start (re-start) the transmission of data packets. Thus, flow control is exercised.
The operation of the first preferred embodiment, having the above configuration of the receiving and transmitting devices, will be explained in detail below.
Firstly, a request packet for requesting the start of distribution is transmitted to an IP (Internet protocol) address specified by a user. As described earlier, this operation is executed by the request packet generation unit 101 and the request packet transmitting unit 102 illustrated in
Then, when a request response packet is received after waiting for the request response packet from the transmitting device 200 whose IP address is specified for 30 seconds (repetition of steps S301→S302→S301), it is determined which is specified in the request response packet as device type information, a real-time encoder or a distribution server (step S303). Real-time and server modes are switched between on the basis of this determination result (step S304). The above operations are performed by the request response packet receiving unit 103, the request response analysis unit 104, and the mode determination unit 105 illustrated in
Then, when a real-time mode is set, data is received on the basis of PCR control (step S305→S301). In this operation, as described earlier, the motion image decoding unit 116 receives an image signal received in real time via the data packet receiving unit 109, the packet determination unit 110, and the packet receiving buffer 111. In this case, the motion image decoding unit 116 performs decoding/reproduction operations according to a synchronous clock generated via the PCR generation unit 206 and the VCXO 113.
However, when a server mode is set, data is received on the basis of flow control (step S305→S307). In this operation, as described earlier, the motion image decoding unit 116 receives an image signal received in real time via the data packet receiving unit 109, the packet determination unit 110, and the packet receiving buffer 111. In this case, the motion image decoding unit 116 performs decoding/reproduction operations according to a system time clock generated by the self-running OSC 114.
In this case, the flow control unit 106 illustrated in
However, as described earlier, when packets remaining in the packet receiving buffer 111 seem to exceed its buffer size (buffer over), the flow control unit 106 issues a first instruction to the transmit stop/start request packet transmitting unit 107. Upon receipt of this, the transmit stop/start request packet transmitting unit 107 generates a transmit stop request packet for the transmitting device 200 (
Conversely, as described earlier, when no packets seem to remain in the packet receiving buffer 111 (buffer empty), the flow control unit 106 issues a second instruction to the transmit stop/start request packet transmitting unit 107. Upon receipt of this, the transmit stop/start request packet transmitting unit 107 generates a transmit start request packet for the transmitting device 200 whose IP address is specified and transmits this packet to the network via the request packet transmitting unit 108 (step S308→S310). As a result, in the transmitting device 200, the transmission of data packets storing an image file is started (re-started) and the amount of packets received by the receiving device 100 is adjusted.
Firstly, the transmitting device 200 is in a state of waiting for a request packet (repetition of the determination in step S401).
When the request packet is received, the contents of the request packet are analyzed (step S402). As described earlier, this operation is performed by the request packet receiving unit 202 and the request packet analysis unit 202 illustrated in
When the request packet requests the start of the distribution of an image signal or file as a result of the above analysis, a request response packet is transmitted toward the receiving device 100 (
Then, the transmission start of data packets is instructed from the request packet analysis unit 202 to the motion image transmitting unit 204 (step S404). After this step, the transmission of data packets is continued while it is determined whether a request packet is received (repetition of determination in step S405). As described earlier, the transmitting operation of data packets is performed by the motion image transmitting unit 204, the packet transmitting buffer 207, and the data packet transmitting unit 208 illustrated in
When a request packet is received in the above-described transmitting operation, the contents of the request packet are analyzed and determined (steps S405→S406→S407). This operation is performed by the request packet receiving unit 201 and the request packet analysis unit 202 illustrated in
If it is determined that the request packet is a distribute stop request packet, the stoppage of a distribution operation is instructed from the request packet analysis unit 202 to the motion image transmitting unit 204 illustrated in
If it is determined that the request packet is not a distribute stop request packet, and also that the request packet's own device is a real-time image distribution device, step S407 is not performed and the process returns to the determination process in step S405.
If it is determined that the request packet is not a distribute stop request packet, and also that the request packet's own device is a file distribution server, the flow control process in step S407 is performed. Specifically, firstly it is determined whether the request packet is a transmit stop request packet or a transmit start request packet (step S407-1). If a transmit stop request packet is received, the stoppage of the transmission of data packets is instructed from the request packet analysis unit 202 to the packet transmitting buffer 207, both of which are illustrated in FIG. (steps S407-1→S407-2). Then, the process returns to the determination process in step S405.
If a transmit start request packet is received, the start (re-start) of transmission of data packets is instructed from the request packet analysis unit 202 to the packet transmitting buffer 207 (steps S407-1→S407-3). Then, the process returns to the determination process in step S405. Thus, flow control is exercised.
The above operations of the first preferred embodiment of receiving and transmitting devices are summarized in the operational sequence charts illustrated in
If the transmitting device's 200 own device is a real-time image distribution device, as illustrated in
If the transmitting device's 200 own device is a file distribution server, as illustrated in
Thus, according to the first preferred embodiment of receiving and transmitting devices, the transmitting device 200 can report the device type of its own device by “EQPTYPE” information in response to a distribute start request packet from the receiving device 100, and the receiving device can switch the operation of its own device between real-time and server modes, according to this piece of information.
Next, the second preferred embodiment of receiving and transmitting devices will be explained.
Firstly, the configuration of the second preferred embodiment of a receiving device is the same as that of the receiving device 100 in the first preferred embodiment, illustrated in
However, in the receiving device 100, firstly the request packet generation unit 101 transmits a request packet in which the distribute request mode information of a real-time mode is set toward the transmitting device. When a request response packet in which the mode of a real-time encoder is set to indicate normality is returned from the transmitting device in response to this request packet, the receiving device operates in a real-time mode. When the request response packet in which the mode of a distribution server is set to indicate abnormality is sent from the transmitting device, the request packet generation unit 101 re-transmits a request packet in which the distribute request mode information of a server mode is set, toward the transmitting device. When a request response packet in which the mode of a distribution server is set to indicate normality is returned from the transmitting device in response to this request packet, the receiving device 100 operates in a server mode.
In
The configuration illustrated in
If a real-time mode is set in the distribute start request packet when its own device is a real-time image distribution device, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet indicating normality. Conversely, if a server mode is set in the distribute start request packet, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet indicating abnormality. Simultaneously, device type information indicating a real-time encoder is also attached to the request response packet.
If a real-time mode is set in the distribute start request packet when its own device is a file distribution server, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet indicating abnormality. Conversely, if a server mode is set in the distribute start request packet, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet indicating normality. Simultaneously, device type information indicating a distribution server is also attached to the request response packet.
Firstly, a request packet for requesting the start of distribution is transmitted to an IP (Internet protocol) address specified by a user (step S901). In this case, distribute request mode information indicating a real-time mode is attached to the request packet.
“0×0001” indicating a distribute request is specified as “TYPE” information and a value “0” indicating a real-time mode is specified as “RECEIVETYPE” information. This operation is performed by the request packet generation unit 101 and the request packet transmitting unit 102 illustrated in
Then, when a request response packet is received from the transmitting device 200 whose IP address is specified after waiting for it for 30 seconds (repetition of steps S901→S902→S901), it is determined on the basis of the received request response packet whether the device type information of a real-time encoder is specified as a request response specified in the request response packet (step S903).
If this determination is YES, the mode determination unit 105 illustrated in
If the determination in step S903 is NO, the mode determination unit 105 notifies the request packet generation unit 101 of this fact. In response to this notice, the request packet generation unit 101 transmits a request packet requesting re-starting of the distribution to the specified IP address (step S905). In this case, a value “1” indicating a server mode is specified in the request packet as distribute request mode information, that is, “RECEIVETYPE” information.
Then, when a request response packet is received from the transmitting device 200 whose IP address is specified after waiting for it for 30 seconds (repetition of steps S905 →S906→S905), the mode determination unit 105 illustrated in
Firstly, the processes in steps S401 and S402 are the same as those in steps S401 and S402 in the first preferred embodiment, illustrated in
Specifically, firstly, the transmitting device 800 is in a request packet waiting state (repetition of the determination in step S401).
When a request packet is received, the contents of the request packet are analyzed (step S4029). This operation is performed by the request packet receiving unit 201 and the request packet analysis unit 202 illustrated in
When the request packet requests the start of the distribution of image signals or files as a result of the above analysis, it is determined whether distribute request mode information set in the request packet coincides with the mode of its own device (step S1001). This operation is performed by the request mode determination unit 801 illustrated in
When a distribute start request packet is received the first time, a value “0” indicating a real time mode is specified in the request packet as “RECEIVETYPE” information in step S901 illustrated in
If its own device is a file distribution server, after the determination of non-coincidence in step S1001, the second distribute start request packet is received in step S905 illustrated in
If its own device is a file distribution server and it is determined in step S1001 that they are matched when the first distribute start request packet is received, the following operation is performed. Specifically, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet to which the device type information indicating abnormality and a distribution server (step S1002) is attached. The data structure of the request response packet is the same as the data structure in the first preferred embodiment, illustrated in
If its own device is a file distribution server and the second distribute start request packet is received or if its own device is a real-time image distribution device 1403 and the first distribute start request packet is received, it is determined in step S1001 that they are matched. In this case, the request mode determination unit 801 instructs the request response packet transmitting unit 203 to return a request response packet to which device type information indicating normality and its own mode is attached (a distribution server or real-time encoder) (step S1003). Specifically, in the data structure example illustrated in
Then, the start of transmission of data packets is instructed from the request packet analysis unit 202 to the motion image transmitting unit 204, both of which are illustrated in
The above operations of the receiving and transmitting devices in the second preferred embodiment are summarized in the operational sequence charts illustrated in
If its own deice is a real-time image distribution device, as illustrated in
Thus, according to the second preferred embodiment of transmitting and receiving devices, a distribute request mode expected by the receiving device 100 can be explicitly reported from the receiving device 100 to the transmitting device 800 by “RECEIVETYPE” information.
Thus, according to the first or second preferred embodiment of receiving and transmitting devices, there is no need to prepare receiving devices dedicated for respective devices in an environment where a real-time image distribution device for monitoring and a file distribution server are mixed, thereby reducing costs.
Using a receiving device according to the above preferred embodiments, images can be received seamlessly without being aware of a distribution source.
Although in the respective preferred embodiments, explanations are given targeting image signals as an example, the disclosed technology is also applicable to various media signals other than image signals, such as voice signals and the like.
All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the invention and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions, nor does the organization of such examples in the specification relate to a demonstration of superior and inferior aspects of the invention. Although the embodiments of the present invention have been described in detail, it should be understood that various changes, substitutions and alterations could be made hereto without departing from the spirit and scope of the invention.
Number | Date | Country | Kind |
---|---|---|---|
2009-155503 | Jun 2009 | JP | national |