Patent Application
20240430311
This application claims the priority from Chinese Patent Application No. 202111401823.1, filed on Nov. 19, 2021, the entire contents of which are incorporated herein by reference.
The present disclosure relates to, but is not limited to, the technical field of communications.
Due to instability, interference, position shielding and the like of a wireless network, a user sometimes encounters the problems of low voice, discontinuity, no sound, noisy noise and the like during a call, making it hard for the user to acquire clear information from the call peer (i.e., the other party of the call).
An embodiment of the present disclosure provides a call method applied to a first terminal, the call method including: establishing, when conducting an IP multimedia subsystem (IMS) call with a second terminal, a data channel with a data server; collecting in real time audio/video data; and transmitting the collected audio/video data to the data server through the data channel, so that the data server generates first multimedia data according to the audio/video data and transmits the first multimedia data to the second terminal.
An embodiment of the present disclosure further provides a call method applied to a data server, the call method including: establishing a data channel with a first terminal, wherein the first terminal is in an IMS call with a second terminal; receiving audio/video data sent from the first terminal through the data channel; and generating, according to the audio/video data, first multimedia data and transmitting the first multimedia data to the second terminal.
An embodiment of the present disclosure further provides a call system, including: a first terminal, a second terminal and a data server; wherein the first terminal is communicatively connected with the data server, and the data server is communicatively connected with the second terminal; the first terminal is configured to establish, when conducting an IMS call with the second terminal, a data channel with the data server, and collect in real time audio/video data, and transmit the collected audio/video data to the data server through the data channel; the data server is configured to generate, according to the audio/video data, first multimedia data, and transmit the first multimedia data to the second terminal; and the second terminal is configured to receive the first multimedia data.
An embodiment of the present disclosure further provides an electronic device, including: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions, when executed by the at least one processor, cause the at least one processor to implement the call method as described above.
An embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon which, when executed by a processor, causes the call method as described above to be implemented.
During the IMS call with the second terminal in the embodiments of the present disclosure, the first terminal will establish a data channel with the data server, and transmit audio/video data interacted with the second terminal to the server through the data channel, and the data server obtains multimedia data to be transmitted to the second terminal according to the audio/video data. Since the data server is usually a data server connected to a proximal end of the first terminal, the first terminal can also transmit multimedia data to the second terminal through the data server in the case of poor call quality, which ensures the transmission quality of call data between the two parties, and thus enables normal interaction of the terminals even if the wireless network is poor.
To make the objects, technical solutions and advantages of the embodiments of the present disclosure clearer, embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in various embodiments of the present disclosure to provide a better understanding of the present disclosure. However, the technical solutions claimed in the present disclosure can be implemented even without these technical details or based on various changes and modifications based on the following embodiments. The following embodiments are divided for convenience of description, and should not constitute any limitation to the specific implementation of the present disclosure, and the embodiments may be mutually incorporated and referred to without contradiction.
An embodiment of the present disclosure relates to a call method applied to a first terminal such as a mobile phone, a tablet, or any other electronic device. The call method of this embodiment includes: the first terminal establishes a data channel with a data server when conducting an IMS call with a second terminal; collects in real time audio/video data; and transmits the collected audio/video data to the data server through the data channel, so that the data server obtains, according to the audio/video data, first multimedia data to be transmitted to the second terminal, and transmits the first multimedia data.
During the IMS call with the second terminal, the first terminal of the embodiment of the present disclosure establishes a data channel with the data server, and transmits audio/video data interacted with the second terminal to the server through the data channel; and the data server obtains multimedia data to be transmitted to the second terminal according to the audio/video data. Since the data server is usually a data server connected to a proximal end of the first terminal, the first terminal can also transmit multimedia data to the second terminal through the data server in the case of poor call quality, which ensures the transmission quality of call data between the two parties, and thus enables normal interaction of the terminals even if the wireless network is poor and ensures the call quality.
The implementation details of the call method according to this embodiment will be described in detail below, and the following description is provided merely for facilitating understanding of the implementation details, and is not necessary to implement the solution.
A specific flow of the call method of this embodiment applied to the first terminal may be as shown in
At operation 101, establishing, when conducting an IMS call with a second terminal, a data channel with a data server.
The IMS call in this embodiment includes, but is not limited to: voice over new radio (VoNR), voice over long-term evolution (VoLTE), voice over WiFi (VoWiFi), or the like. In this embodiment, when conducting the IMS call with the second terminal, the first terminal also establishes a data channel with the data server to perform data transmission, thereby ensuring the call quality between the first terminal and the second terminal.
In some implementations, before the first terminal establishes the data channel with the data server, the first terminal further monitors an instruction sent from the second terminal; detects, according to the instruction, whether to establish the data channel; and proceeds to the operation of establishing the data channel with the data server under the condition that the instruction indicates to establish the data channel. In this embodiment, the first terminal may upload audio information of the first terminal to the data server in response to the instruction of the second terminal. Therefore, on the basis of ensuring that the second terminal can accurately receive call information from the first terminal, the first terminal can also respond to the call peer (i.e., the second terminal) in time to meet the call requirement of the call peer.
In some implementations, monitoring the instruction sent from the second terminal includes: monitoring session initiation protocol (SIP) signaling sent from the second terminal; and detecting, according to the instruction, whether to establish the data channel includes: determining whether to establish the data channel according to a dcmap field carried in the SIP signaling.
Illustratively, the second terminal may be understood as a call peer. The first terminal monitors SIP signaling sent from the call peer, parses a dcmap field in a session description protocol (SDP) offer (SDP offer) message therein, to determine whether to establish the data channel.
According to the 3GPP TS 26.114 specification, the dcmap field characterizes the need to establish a data channel. The 3GPP TS 26.114 specification specifies: multiple data channels may be mapped to a single data channel SDP media description, each with a corresponding “a=dcmap” SDP attribute and stream IDs that are unique within that media description.
Table 1 below shows an example SDP offer with data channel capability signaling in the specification.
The specification specifies that the established data channel may be a Boottrap data channel, which may be understood as a data channel established between a terminal and a network side data server.
Table 2 below shows relevant provisions about bootstrap data channel content sources in the specification.
The specification specifies that the established data channel may be a non-boottrap data channel, which is a data channel directly established between terminals. Table 3 below shows an example SDP offer with data channel application streams in the specification.
According to the 3GPP TS 26.114 specification, the terminal may establish a data channel with the network side data server. As shown by arrows 4 and 5 in
It should be noted that the first terminal is connected to a first data server proximal thereto, the second terminal may be also connected to a second data server proximal thereto, and the first data server may be connected to the second data server through a physical link, such as an optical fiber, instead of using air interface, so that the call quality of the first terminal and the second terminal can be ensured.
At operation 102, collecting in real time audio/video data.
Illustratively, the collected audio/video data includes, but is not limited to: audio data of a microphone, video data of a camera, text data of audio, and the like. The first terminal may provide a human-machine interaction interface (or UI). The collected content may be designated by a user through the human-machine interaction interface.
At operation 103, transmitting the collected audio/video data to the data server through the data channel. The data server generates, according to the audio/video data, first multimedia data to be transmitted to the second terminal. If the data server receives a data request from the second terminal, the data server may transmit the first multimedia data to the second terminal.
In some embodiments, the first multimedia data may be generated from the collected audio/video data. The first multimedia data includes, but is not limited to: a call recording, a call text, simultaneous interpretation data, a play of call video, a meme image, and the like.
In some implementations, in the call process, the first terminal may also receive, through the data server, second multimedia execution data generated from audio/video data of the second terminal. The first terminal may provide a user interface which, as shown in
At operation 104, receiving second multimedia data from the data server through the data channel. The operation 104 may be executed concurrently with the operations 102 to 103, or may be executed before the operations 102 and 103, which is not limited in this embodiment.
In some implementations, the first terminal may acquire a multimedia data type through the first human-machine interaction interface; and before receiving the second multimedia data from the data server, the first terminal may request second multimedia data satisfying the multimedia data type from the data server.
In some implementations, the types of the second multimedia data include, but are not limited to: original audio data collected by the call peer (i.e., the second terminal), a call text uploaded by the call peer, a text converted by a server from the original audio data of the call peer, a text translated from simultaneous interpretation, original audio and video data collected by the call peer, and the like.
The first terminal may display data pushed by a network side data server on a call interface. Taking the “enhance call” service as an example, when a user clicks the “enhance call” button on a call interface, a call recording playing interface, a call text popup message or the like may be displayed on the call interface.
Illustratively, the first terminal collects audio data of a microphone in real time, and uploads the collected audio data to the network side data server through the data channel in real time. The network side data server may push the original audio data collected by the first terminal or multimedia data after enhancement process (or called expansion process), such as text or sign language video converted from the original audio data, or text or audio data of a foreign language translated from the original audio data, to the second terminal in real time. If the enhanced multimedia volume data is text, video or the like, the text, video or the like may be displayed on the call interface.
In this embodiment, the first terminal may push the audio/video data to the data server in response to the second terminal, so that the second terminal can acquire the original audio/video data or the enhanced audio/video data through the data server, and in the case of poor call quality, multimedia data may be transmitted through the data server, thereby ensuring the quality of the call audio/video data. In the call process, the second terminal may also acquire second multimedia data from the data server, so that the data call quality is improved when a voice call between two parties has poor quality. In addition, the user may select a multimedia data type, such as multimedia data of simultaneous interpretation, meme image, sign language video, text and the like, to improve the call experience of the two parties.
Another embodiment of the present disclosure relates to a call method which is applied to a terminal. The terminal of this embodiment can acquire historical multimedia data from a data server even after a call is hung up.
The implementation details of the call method according to this embodiment will be described in detail below, and the following description is provided merely for facilitating understanding of the implementation details, and is not necessary to implement the solution.
At operation 401, establishing, when conducting an IMS call with a second terminal, a data channel with a data server.
At operation 402, collecting in real time audio/video data.
At operation 403, transmitting the collected audio/video data to the data server through the data channel. The data server obtains first multimedia data to be transmitted to the second terminal according to the audio/video data. After receiving a first multimedia data request from the second terminal, the data server may transmit the first multimedia data to the second terminal.
The operations 401 to 403 are substantially the same as the operations 101 to 103 described above, and thus are not repeated here.
At operation 404, releasing, in response to the IMS call being hung up, the data channel established with the data server.
In some implementations, the first terminal stops audio collection when the IMS call is hung up.
At operation 405, re-establishing, in response to receiving a second call enhancement instruction through a second human-machine interaction interface, the data channel with the data server.
In some implementations, the user selects a control (widget) indicating a call enhancement instruction through the second human-machine interaction interface (provided by the first terminal), and optionally a desired multimedia data type, for example, multimedia data of a call text type.
At operation 406, receiving third multimedia data from the data server through the re-established data channel. The third multimedia data is generated according to the audio/video data in the process of the IMS call (i.e., IMS call process).
In some implementations, the first terminal may send a third multimedia data request to the data server, and then receive third multimedia data pushed by the network side data server. The third multimedia data is generated according to the audio/video data in the IMS call process.
Types of the pushed third multimedia data may include call recordings of the second terminal, complete call recordings, call text, translated voice, call videos, or multimedia data obtained from voice at a caller side, such as the first multimedia data or the second multimedia data.
Compared with conventional solutions, this embodiment has the following beneficial effects: first, in this embodiment, the terminal uploads the collected audio data to the data server, and since the operator (telecom carrier) generally designates a data server closest to the terminal for use, the quality of the call audio data, such as low loss and low distortion, is guaranteed; and second, in this embodiment, the QoS of low loss, low latency, and the like is designated when the terminal establishes the data channel, thereby ensuring the transmission quality of the data channel; and further, the terminal in this embodiment can show in real time talk text of call peers and the like during the call, play in real time or playback call recording of the call peers after the call is ended, or show or browse in real time call text of the call peers, or perform simultaneous interpretation. In other words, this embodiment can solve the problems of low voice, discontinuity, no sound, noisy noise and the like in a call, thereby improving the call experience of the user.
Another embodiment of the present disclosure relates to a call method applied to a data server. The implementation details of the call method according to this embodiment will be described in detail below, and the following description is provided merely for facilitating understanding of the implementation details, and is not necessary to implement the solution.
At operation 501, establishing a data channel with a first terminal, wherein the first terminal is in an IMS call with a second terminal.
At operation 502, receiving audio/video data sent from the first terminal through the data channel.
In some implementations, after receiving the audio/video data from the first terminal, the server may store the audio/video data.
At operation 503, obtaining, according to the audio/video data, first multimedia data to be transmitted to the second terminal.
In some implementations, the first multimedia data to be transmitted to the second terminal may be original audio data, or enhanced audio data. Upon receiving a data request from the second terminal, the server may transmit the first multimedia data to the second terminal.
In some implementations, the type of the first multimedia data may be determined according to a selection by a user. For example, the terminal provides the user with a human-machine interaction interface, based on which the user selects a multimedia data type.
In some implementations, the established data channel may be released when the IMS call is hung up, and after receiving a second call enhancement instruction, the first terminal may re-establish a data channel with the first terminal, through which third multimedia data is transmitted to the first terminal. The third multimedia data is generated according to the audio/video data in the IMS call process.
Alternatively, the type of the third multimedia data may be acquired from a request from the first terminal.
In the case of poor call quality, the server of this embodiment can transmit the audio/video data or the enhanced audio/video data between the first terminal and the second terminal to improve the call quality, and can further transmit data during historical calls after the call is completed, thereby further improving the user experience.
Another embodiment of the present disclosure relates to a call device which is applicable to (or included in) a terminal. The details of the call device according to this embodiment will be described in detail below. The following description is provided merely for facilitating understanding of the implementation details and is not necessary for implementing the present embodiment.
In some implementations, the call device further includes a receiving module configured to provide a human-machine interaction interface; and receive, in response to receiving a first call enhancement instruction through a first human-machine interaction interface, second multimedia data from the data server through the data channel. The second multimedia data is generated according to the audio/video data from the second terminal.
In some implementations, the data channel management module 601 in the call device is further configured to release, in response to the IMS call being hung up, the data channel established with the data server, and provide a human-machine interaction interface; and re-establish, in response to receiving a second call enhancement instruction through a second human-machine interaction interface, the data channel with the data server; and the receiving module is further configured to receive third multimedia data from the data server through the re-established data channel. The third multimedia data is generated according to the audio/video data in the IMS call process.
In some implementations, the transmission module 603 is further configured to acquire a multimedia data type through the human-machine interaction interface; and request second multimedia data satisfying the multimedia data type from the data server.
In some implementations, the data channel management module 601 is further configured to monitor an instruction sent from the second terminal; detect, according to the instruction, whether to establish the data channel; and proceed, under the condition that the instruction indicates to establish the data channel, to the operation of establishing the data channel with the data server.
In some implementations, the data channel management module 601 is further configured to monitor session initiation protocol (SIP) signaling sent from the second terminal; and determine whether to establish the data channel according to a dcmap field carried in the SIP signaling.
Another embodiment of the present disclosure relates to a call device which is applicable to (or included in) a server. The details of the call device according to this embodiment will be described in detail below. The following description is provided merely for facilitating understanding of the implementation details and is not necessary for implementing the present embodiment.
In some implementations, the transmission module 703 is further configured to send, upon receiving a second multimedia data request from the first terminal, the second multimedia data to the first terminal through the data channel, where the second multimedia data is generated according to the audio/video data from the second terminal.
In some implementations, the data channel management module 701 is further configured to release, in response to the IMS call being hung up, the data channel established with the first terminal; and re-establish a data channel with the first terminal in response to a data request from the first terminal, and send third multimedia data to the first terminal through the re-established data channel. The third multimedia data is generated according to the audio/video data in the IMS call process.
In some implementations, the receiving module 702 is further configured to send, in response to a request from the first terminal, second multimedia data satisfying a second multimedia data type to the first terminal.
It is obvious that this embodiment is a system embodiment corresponding to the above method embodiment, and this embodiment may be implemented in cooperation with the above method embodiment. The related technical details and technical effects mentioned in the above embodiment are still valid in this embodiment, and thus are not repeated here to avoid redundancy. Accordingly, the related technical details mentioned in this embodiment are also applicable to the foregoing embodiment.
It should be noted that all modules referred to in this embodiment are logic modules, and in practical applications, one logic unit may be one physical unit, or a part of one physical unit, or may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present disclosure, units which are not so closely related to solving the technical problem proposed by the present disclosure are not introduced in the embodiment, but this does not indicate that no other unit is present in the embodiment.
Another embodiment of the present disclosure relates to a call system. As shown in
Another embodiment of the present disclosure relates to an electronic device which, as shown in
The memory and the processor are connected via a bus. The bus may include any number of interconnected buses and bridges, and the bus connects various circuits of the one or more processors and the memory together. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art and, therefore, will not be described in further details herein. A bus interface provides an interface between the bus and a transceiver. The transceiver may include one or more elements, such as a plurality of receivers and transmitters, to provide a unit for communicating with various other apparatuses over a transmission medium. Data processed by the processor is transmitted over a wireless medium through an antenna which further receives data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing, and may further provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory may be configured to store data used by the processor during operation.
Another embodiment of the present disclosure relates to a computer-readable storage medium with a computer program stored thereon. The computer program is executed by a processor to implement any of the above method embodiments.
That is, as can be understood by those skilled in the art, all or part of the operations in any of the method embodiments described above may be implemented by a program instructing related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a micro controller unit, a chip, or the like) or a processor to perform all or part of the operations in the method described in any of the above embodiments of the present application. The storage medium mentioned before includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic or optical disk, or any other medium that can store program codes.
It will be understood by those of ordinary skill in the art that the foregoing implementations are specific embodiments of the present disclosure, and that, in practical applications, various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202111401823.1 | Nov 2021 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2022/132581 | 11/17/2022 | WO |
