Apparatus, Network Device And Method For Video/Audio Data Transmission

Abstract

Embodiments of the present invention disclose an apparatus for transmitting video/audio data, including a receiving decoding module, configured to receive remote video/audio data and a stream media transmitted from an IP network, respectively decode the received remote video/audio data and the stream media, input the decoded video data to the video synchronization module, and input the decoded audio data to the mixer; a video synchronization module, configured to combine and a synchronize the received video data; a mixer, configured to mix the received audio data. Embodiments of the present invention also disclose a network device and a method for transmitting video/audio data. Through the technical scheme disclosed in the embodiments of the invention, a user terminal may make an audio/video call while watching a stream media program via the same display screen and speaker.

Description

DRAWINGS

The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.

FIG. 1 is a schematic diagram illustrating an IP multimedia communication networking according to the related art.

FIG. 2 is a schematic diagram of establishing an IP multimedia communication according to the related art.

FIG. 3 is a block diagram illustrating a multimedia video/audio receiving module in a videophone according to the related art.

FIG. 4 is a schematic diagram of playing a stream media program via a videophone by a user according to the related art.

FIG. 5 is a block diagram illustrating a multimedia video/audio receiving module in the videophone according to a first embodiment of the present invention.

FIG. 6 is a schematic diagram illustrating a video synchronization module according to the first embodiment of the present invention.

FIG. 7 is a schematic diagram of initiating a call while playing a stream media according to the first embodiment of the present invention.

FIG. 8 is a schematic diagram illustrating a networking of a data composing server scheme according to a second embodiment of the present invention.

FIG. 9 is a schematic diagram illustrating a structure of the data composing server according to the second embodiment of the present invention.

FIG. 10 is a schematic diagram illustrating a structure of a video/audio processing module according to the second embodiment of the present invention.

FIG. 11 is a flowchart diagram of initiating a call while playing a stream media by a user terminal according to the second embodiment of the present invention.

Claims

1. An apparatus for video/audio data transmission, comprising: a receiving decoding module, a video synchronization module and a mixer; whereinthe receiving decoding module is configured to receive remote video/audio data and a stream media transmitted from an IP network, respectively decode the received remote video/audio data and the stream media, input decoded video data to the video synchronization module, and input decoded audio data to the mixer;the video synchronization module is configured to combine and synchronize the received video data;the mixer is configured to mix the received audio data.

2. The apparatus of claim 1, wherein the receiving decoding module comprises an interface module, a first video decoding module, a second video decoding module, a first audio decoding module and a second audio decoding module; wherein the interface module is configured to transmit the remote video/audio data and the stream media from the IP network to corresponding decoding modules;the first video decoding module is configured to decode the remote video data received from the interface module, and send the decoded video data to the video synchronization module;the second video decoding module is configured to decode the video data of the stream media received from the interface module, and send the decoded video data to the video synchronization module;the first audio decoding module is configured to decode the remote audio data received from the interface module, and send the decoded audio data to the mixer;the second audio decoding module is configured to decode the audio data of the stream media received from the interface module, and send the decoded audio data to the mixer.

3. The apparatus of claim 1, wherein the video synchronization module comprises two video frame registers respectively configured to store the video data of the stream media and the remote video data; if any one of the frame registers is refreshed, a combination and an output are made; and if no new data is inputted into the video frame registers, the video frame registers keep the previous video data.

4. The apparatus of claim 2, wherein the video synchronization module comprises two video frame registers respectively configured to store the video data of the stream media and the remote video data; if any one of the frame registers is refreshed, a combination and an output are made; and if no new data is inputted into the video frame registers, the video frame registers keep the previous video data.

5. The apparatus of claim 1, wherein the apparatus is a video terminal, further comprising: a display screen and an audio playing device; whereinthe display screen of the video terminal receives the combined and synchronized video data from the video synchronization module;the audio playing device of the video terminal receives the mixed audio data from the mixer.

6. The apparatus of claim 5, wherein the video synchronization module selects a synchronization and combination mode according to an instruction inputted by a user; and the mixer selects a mixing mode according to an instruction inputted by the user.

7. A network device for video/audio data transmission, comprising: a receiving decoding module, a video synchronization module, a mixer, a video encoding module, an audio encoding module and an interface module; whereinthe receiving decoding module is configured to receive remote video/audio data and a stream media transmitted from an IP network, respectively decode the received remote video/audio data and the stream media, input decoded video data to the video synchronization module, and input decoded audio data to the mixer;the video synchronization module is configured to combine and synchronize the received video data;the mixer is configured to mix the received audio data;the video encoding module is configured to receive the video data outputted from the video synchronization module and send the outputted video data to a video terminal via the interface module;the audio encoding module is configured to receive the audio data outputted from the mixer and send the outputted video data to the video terminal via the interface module;

8. The network device of claim 7, wherein the receiving decoding module comprises: an interface module, a first video decoding module, a second video decoding module, a first audio decoding module, a second audio decoding module;the interface module is configured to transmit remote video/audio data and a stream media from an IP network to corresponding decoding modules;the first video decoding module is configured to decode remote video data received from the interface module, and send the decoded video data to the video synchronization module;the second video decoding module is configured to decode video data of a stream media received from the interface module, and send decoded the video data to the video synchronization module;the first audio decoding module is configured to decode the remote audio data received from the interface module, and send the decoded audio data to the mixer;the second audio decoding module is configured to decode audio data of a stream media received from the interface module, and send the decoded audio data to the mixer.

9. The network device of claim 7, wherein the video synchronization module comprises two video frame registers respectively configured to store the video data of the stream media and remote the video data; if any one of the frame registers is refreshed, a combination and an output are made; and if no new data is inputted into the video frame registers, the video frame registers keep the previous video data.

10. A method for video/audio data transmission, comprising combining and synchronizing remote video data and video data sent to the video terminal from a streaming server;mixing remote audio data and audio data sent to the video terminal from a streaming server;playing the resultant video/audio data to a user via the video terminal.

11. The method of claim 10, wherein the steps of combing and synchronizing remote video data and video data sent to the video terminal from a streaming server and mixing remote audio data and audio data sent to the video terminal from a streaming server comprise: receiving, by the video terminal, the remote video/audio data and the video/audio data from the streaming server;combining and a synchronizing the received two channels of video data; andmixing the received two channels of audio data.

12. The method of claim 10, further comprising: sending, by a user, an operation mode instruction to the video terminal;determining, by the video terminal, an operation mode according to the received operation mode instruction.

13. The method of claim 10, wherein the steps of combining and synchronizing remote video data and video data sent to the video terminal from a streaming server and mixing remote audio data and audio data sent to the video terminal from a streaming server comprise: informing, by the video terminal in a call, the remote side of the call to send the remote video/audio data to a data composing server configured at a network side;informing, by the video terminal in the call, the streaming server to send the video/audio data sent to the video terminal to the data composing server;receiving, by the data composing server, the remote video/audio data and the video/audio data from the streaming server;combining and a synchronizing, by the data composing server, the received two channels of video data and mixing the received two channels of audio data;the step of playing the resultant video/audio data to a user via the video terminal comprising:encoding, by the data composing server, the combined and synchronized video data and the mixed audio data respectively;sending the resultant video/audio data to the video terminal;playing, by the video terminal, the received video data and the audio data to the user.

14. The method of claim 10, further comprising: sending, by the user, an operation mode instruction to the data composing server through the video terminal;determining, by the data composing server, an operation mode according to the received operation mode instruction.