Communications arrangement and method for communications systems having an interactive voice function

Abstract

The invention relates to the processing of combined display screen-oriented and voice-oriented web page information (i(html,xml)). To this end, display screen-oriented web page information (i(html)) is processed in an internet terminal (PC) and voice-oriented web page information (i(xml)) is processed in a multimedia platform (VOX). In order to synchronize the processing of web page information that is distributed among the internet terminal and the multimedia platform, voice information (ivox) is exchanged by using voice agents (Avox) and control information (isig) and data (idat) are exchanged by using a communications agent (Asig). This results in dynamically reducing the load placed upon the multimedia platform.

Description

[0001] Efforts have increasingly been made for some time now to allow voice-oriented access as well as screen-oriented access to information on data media. A typical scenario for such access is for example the visual display of web content, which can be navigated with voice commands.

[0002] The linking of voice-oriented and screen-oriented input and output requires suitable processing and conversion of the transported information in addition to the corresponding input and output devices, e.g. keyboard, screen, microphone and speakers. Processing voice information above all requires significant expenditure. Functions such as conversion from text to voice and voice recognition take up a large proportion of the resources required in respect of memory capacity and computing power. This is why resource-intensive functions are usually only implemented on terminals in a limited form.

[0003] The object of the invention is to allow voice-oriented access to information on data media, which is not subject to the usual resource limitations.

[0004] The problem is resolved by a communication arrangement according to Claim 1 with an internet terminal according to Claim 5 and a multimedia platform according to Claim 7 and a method according to Claim 9.

[0005] With the communication arrangement according to the invention or the method according to the invention a voice agent is provided in the multimedia platform and in the internet terminal for the direct communication exchange of voice information. A communication agent is also provided in the internet terminal for reciprocally influencing processing functions of the voice-oriented web page information and for synchronizing voice-oriented and screen-oriented web page information by transmitting control and data information—Claims 1 and 9. The communication arrangement and the method have the advantage that resource-intensive voice processing functions are provided by the multimedia platform and therefore voice processing and voice-oriented access to web page information can be executed regardless of the performance of the internet terminal.

[0006] With the assistance of the communication arrangement according to the invention or the method according to the invention the processing of voice information in the media platform, the outputting of processed voice information in the internet terminal PC and the transmission and launching of new web page information can be influenced by the exchange of control information. Converted voice information can be exchanged directly between the internet terminal and the multimedia platform—Claims 2 and 10. The direct exchange of control information and converted voice information ensures efficient information processing; an important aspect for voice-oriented interaction and navigation for access to web page information.

[0007] In order to take into account the different requirements relating to the transfer of voice information and data, separate transfer channels can be provided between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)) for the transmission of voice information and the data and control information provided for the purposes of reciprocal synchronization—Claims 3 and 11. The transfer channels here can be set up by means of a connection for example based on the TCP/IP protocol, operating according to Asynchronous Transfer Mode or based on the Bluetooth standard—Claims 4 and 12. Separate transfer channels or different systems may have advantages in respect of optimizing transfer quality and allocating resources.

[0008] A further important aspect of the invention is the internet terminal, which is equipped with a browser for processing and interpreting web page information which is transmitted from a web server via the internet, with a voice agent for the direct communication exchange of voice information with a multimedia platform and with at least one communication agent to influence the processing functions of the voice-oriented web page information in the multimedia platform and to synchronize the processing of voice-oriented and screen-oriented web page information by transmitting control and data information—Claim 5. Equipping the internet terminal according to the invention has the advantage of ensuring the processing of voice-oriented web page information and communication with the multimedia platform, without having to implement resource-intensive program structures or functions on the internet terminal.

[0009] A further important aspect is the multimedia platform according to the invention, which is equipped with a voice browser for processing and interpreting voice-oriented web page information which is transmitted from a web server via the internet, with a voice agent for the direct communication exchange of voice information with an internet terminal PC and with means for synchronizing the voice information exchanged with the internet terminal with the voice-oriented web page information transmitted from the web server—Claim 7. Also a program for voice recognition and/or a program for converting text to voice can be provided—Claims 8 and 13. The multimedia platform according to the invention can therefore manage resource-intensive processing stages, such as voice recognition and the conversion of text to voice. It can for example be advantageous with these processing functions for databases located either in the multimedia platform or in WWW servers accessible via the internet to be accessed for processing the combined screen-oriented and voice-oriented web page information—Claim 14. Voice recognition for a number of different languages for example requires considerable memory resources. The use of external resources on WWW servers or databases can be advantageous for reducing the load on the communication arrangement.

[0010] The communication arrangement according to the invention and the method according to the invention are described in more detail below using an example. This shows:

[0011] FIG. 1: a configuration of the arrangement according to the invention and

[0012] FIG. 2: a possible set-up for access to web page information using a voice command.

[0013] Identical references here refer to identical elements.

[0014] FIG. 1 shows a multimedia platform VOX(TTS,ASR) set up for example using a computer, said platform being connected to an internet terminal PC via a transfer channel for voice information ivox and a transfer channel for data and control information idat and isig. For this purpose the multimedia platform VOX(TTS,ASR) is equipped in each instance with corresponding connection units—not shown—for connection to the internet (INT). The transfer channels are for example set up according to the TCP/IP (protocol combining the Transmission Control Protocol (TCP) and the Internet Protocol (IP)) or the H.323 protocol (standard for internet voice transfers). In a preferred embodiment the multimedia platform is positioned in spatial proximity to the access server of the internet service provider—not shown—via which the internet terminal PC is connected to the internet INT. With such a position the transfer distance is relatively short, with the result that the voice quality of the voice information ivox exchanged between the internet terminal PC and the multimedia platform VOX(TTS,ASR) can be verified and controlled. The voice information ivox here is not routed via extensively branched connections, such as for example longer paths on the internet INT, the quality of which is outside the control of the internet service provider. The multimedia platform VOX(TTS,ASR) and the internet terminal PC are each provided with a voice agent Avox to control the exchange of voice information ivox. The internet terminal PC is also equipped with a communication agent Asig, which allows the transmission of control information isig or data to be processed idat. The internet terminal is provided with a browser BRhtml for processing and interpreting web page information. The multimedia platform VOX(TTS,ASR) is equipped with programs for voice recognition ASR for processing voice information ivox and for converting text to voice TTS and with a voice browser BRxlm for processing and interpreting voice-oriented web page information i(xml).

[0015] The internet terminal PC and the multimedia platform VOX(TTS,ASR) can be connected by a connection set-up initialized by the internet terminal PC via the internet (INT) to a web server SER(HTML,XML). Combined screen-oriented and voice-oriented web page information i(html,xml) is transmitted from the web server SER(HTML,XML). At present such combined screen-oriented and voice-oriented web page information i(html,xml) comprises separate screen-oriented i(html) and voice-oriented i(xml) components or source codes, which can be called up separately and transmitted separately. The voice-oriented components of the web page information i(xml) are predominantly programmed in an XML (extensible markup language) language, which supports voice applications, e.g. VoxML™, VoiceXML™ or DialogML™.

[0016] The screen-oriented component i(html) can for example be created using the html (hypertext markup language) programming method and generally contains references to the voice-oriented component i(xml), which allow switching from processing the screen-oriented component i(html) to processing the voice-oriented component i(xml). The browser BRhtml installed on the internet terminal PC is used not only to process and interpret the screen-oriented component i(html) but also to interpret the references to the voice-oriented component i(xml) and where necessary to initialize the transmission of control information isig and/or data idat for the transition to processing or the outputting of voice information ivox. This is why the term parser is also used in English language literature instead of browser. Efforts are being made to combine both components in one source code. In this case the arrangement according to the invention is adapted so that either the internet terminal PC and the multimedia platform VOX(html,xml) are provided with browsers, which can process and interpret the same source code combining screen-oriented and voice-oriented web page information or only one browser is provided in the internet terminal PC, which is supplemented where necessary by an additional communication agent Asig in the multimedia platform VOX(HTML,XML).

[0017] At the start of the method according to the invention the screen-oriented component i(html) of screen-oriented and voice-oriented web page information i(html,xml) supplied on a World Wide Web server SER(HTML,XML) is transmitted to an internet terminal PC. A message is sent from the internet terminal PC via a transmission channel for control information isig and data idat, signaling the start of the internet session and transmitting the address of the voice-oriented component i(xml) of the screen-oriented and voice-oriented web page information i(html,xml). The voice-oriented component is then transferred from the WWW sever SER(HTML,XML) to a multimedia platform VOX(TTS,ASR). The processing and interpreting of the screen-oriented component i(html)and the voice-oriented component i(xml) by a browser BRhtml of the internet terminal PC or a voice browser BRxml of the multimedia platform VOX(TTS,ASR) are synchronized by the exchange of control information isig. Voice information ivox is exchanged directly via a transfer channel provided for this purpose by means of voice agents Avox, e.g. in order to be processed with a program for voice recognition ASR or to be output with devices provided for this purpose with the internet terminal PC, e.g. speakers. For example in FIG. 2 a possible set-up for the launch of new combined screen-oriented and voice-oriented web page information i(html,xml) is shown during an internet session by means of a voice command ivox (nr(url)). It is assumed here that a list l(url) of such web page information is displayed via the screen-oriented output medium, from which a selection can be made.

[0018] The individual stages of the set-up are shown below. The processing stages in which a computer program processes data, are shown by solid arrows and the transmission of data or information by line arrows.

[0019] a. During an internet session the internet terminal PC displays a list l(url) of combined screen-oriented and voice-oriented web page information i(html,xml) e.g. on a screen using the browser BRhtml.

[0020] b. An entry in the list l(url) is selected by means of a voice command ivox(nr(url)). The selected entry is identified for example by its number nr. The voice command ivox(nr(url)) is transmitted using the voice agent Avox to the multimedia platform VOX(TTS, ASR).

[0021] c. The program for voice recognition ASR converts the voice command ivox(nr(url)) to text information nr(url) on the multimedia platform VOX(TTS, ASR).

[0022] d. The text information nr(url) is transmitted via the channel for the transfer of data and control information to the internet terminal PC.

[0023] e. The browser BRhtml of the internet terminal PC uses the text information nr(url) to identify the address url of the required web page information and accesses it via the internet (INT). Web page information i(html) is then transmitted to the internet terminal PC.

[0024] The method according to the invention or the arrangement according to the invention are not restricted to the example but can be used for the further processing and conversion of voice-oriented information to screen-oriented information and vice versa, e.g. for voice conversions, voice recognition, navigation through web page information using voice commands, voice input and output, etc., with the multimedia platform VOX(TTS,ASR) being equipped or supplemented with the corresponding data processing programs or functions and conversion programs or functions.

Claims

1. Communication arrangement with a web server (SER(HTML,XML)), which can be connected to a multimedia platform (VOX(TTS,ASR) and an internet terminal (PC), with at least partially voice-oriented web page information (i(xml)) being transmitted to the multimedia platform (VOX(TTS, ASR)) and screen-oriented web page information (i(html)) being transmitted to the internet terminal (PC) within the scope of an internet connection, with at least one voice agent (Avox) in the multimedia platform (VOX(TTS,ASR)) and in the internet terminal (PC) for the direct communication exchange of voice information (ivox), with at least one communication agent (Asig) in the internet terminal (PC) for the reciprocal influencing of processing functions of the voice-oriented web page information (i(xml)) and for synchronizing the voice-oriented and screen-oriented web page information (i(xlm,i(html)) by the transmission of control and data information (isig, idat).

2. Communication arrangement according to claim 1, characterized in that the processing of voice information (ivox) in the multimedia platform (VOX(TTS,ASR)), the outputting of the processed voice information (ivox) in the internet terminal PC and the transmission and launch of new web page information can be influenced by the exchange of control information (isig) and converted voice information (idat) can be exchanged directly between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)).

3. Communication arrangement according to one of claims 1 or 2, characterized in that separate transfer channels are provided between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR))for the transmission of voice information (ivox) and the data and control information (idat, isig) provided for reciprocal synchronization.

4. Communication arrangement according to one of claims 1 or 3, characterized in that one of the transfer channels is set up by means of a connection based on the TCP/IP protocol, operating according to Asynchronous Transfer Mode or based on the Bluetooth standard.

5. Internet terminal with a browser (BRhtml) for processing and interpreting web page information, which is transmitted from a web server (SER(HTML,XML)) via the internet (INT), with a voice agent (Avox) for the direct communication exchange of voice information (ivox) with a multimedia platform (VOX(TTS,ASR)) and with at least one communication agent (Asig) for influencing processing functions of the voice-oriented web page information (i(xlm)) in the multimedia platform (VOX(TTS,ASR)) and for synchronizing the processing of the voice-oriented and screen-oriented web page information (i(xlm), i(html)) by the transmission of control and data information (isig, idat).

6. Internet terminal according to claim 5, characterized in that the outputting of the processed voice information (ivox) and the transmission and launch of new web page information can be influenced by the exchange of control information (isig) and the converted voice information (idat) can be exchanged directly between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)).

7. Multimedia platform with a voice browser (BRxml) for processing and interpreting voice-oriented web page information (i(xml)), which is transmitted from a web server (SER(HTML,XML)) via the internet (INT), with a voice agent (Avox) for the direct communication exchange of voice information (ivox) with an internet terminal (PC), with means for synchronizing the voice information (ivox) exchanged with the internet terminal (PC) with the voice-oriented web page information (i(xml)) transmitted from the web server (SER(HTML,XML)).

8. Multimedia platform according to claim 7, characterized in that a program for voice recognition (ASR) and/or a program for converting text to voice (TTS) is provided.

9. Method for processing combined screen-oriented and voice-oriented web page information (i(html,xml)), of which at least the screen-oriented component (i(html)) is transmitted to an internet terminal and at least the voice-oriented component (i(xml)) is transmitted to a multimedia platform (VOX(TTS,ASR)) from a web server (SER(HTML,XML)) within the scope of an internet connection, in which the transmitted voice information (ivox) to be processed or already processed is exchanged directly between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)) in each instance using a voice agent (Avox), in which control and data information (isig, idat) is transmitted between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)) to influence processing functions of the voice-oriented web page information (i(xml)) in the multimedia platform (VOX(TTS,ASR)) and to synchronize the processing of the voice-oriented and the screen-oriented web page information (i(xlm), i(html)).

10. Method according to claim 9, characterized in that the processing of the voice information (ivox) in the multimedia platform (VOX(TTS,ASR)), the outputting of the processed voice information (ivox) in the internet terminal PC and the transmission and launch of new web page information are influenced by the exchange of control information (isig) and converted voice information (idat) is exchanged directly between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)).

11. Method according to one of claims 9 or 10, characterized in that the voice information (ivox) and the data and control information (idat, isig) provided for reciprocal synchronization are transmitted via separate transfer channels between the internet terminal (PC) and the multimedia platform (VOX(TTS,ASR)).

12. Method according to one of claims 9 to 11, characterized in that the voice information (ivox) and/or the data and control information (idat, isig) provided for reciprocal synchronization are transmitted via a transfer channel based on the TCP/IP protocol, operating according to the Asynchronous Transfer Mode or based on the Bluetooth standard.

13. Method according to one of claims 9 to 12, characterized in that components of the processing of the combined screen-oriented and voice-oriented web page information (i(html,xml)) are executed in the multimedia platform (VOX(TTS,ASR)) by voice recognition (ASR) and/or conversion from text to voice (TTS).

14. Method according to one of claims 9 to 13, characterized in that during the processing of the combined screen-oriented and voice-oriented web page information (i(html,xml)) databases located either in the multimedia platform (VOX(TTS,ASR)) or in WWW servers accessible via the internet (INT) are accessed.