Patent Application
20090024389
The present disclosure relates generally to the field of electronic messaging, including voice messaging, over telephony networks.
Voice messaging systems that enable users to send and retrieve voice mail messages are known in the communication arts. In a typical prior art voice messaging system a telephone is attached to a private branch exchange (PBX) that utilizes a notification mechanism to notify a message recipient that a new message is waiting for them. Today, many modern communication systems provide messaging services via packet-based networks, i.e., those that operate in accordance with the Internet Protocol (IP). A Unified Messaging/Voicemail System (UMS) handles voice, facsimile, regular text messages, and computer-readable documents as objects in a single mailbox that a user can access either with a regular email client, or by telephone. A UM system usually connects to a PBX to provide automated attendant, audiotext, and voicemail services to subscribers or users. For instance, a personal computer (PC) user with multimedia capabilities typically can open and playback voice messages, either as speech or text.
In a modern UMS, when a user who is recording a voice message makes a mistake he is usually forced to delete the message and re-record the entire voice message using a standard Telephony User Interface (TUI), e.g., to record, delete, re-record, send, etc. This is particularly time consuming and irritating when the voicemail message is lengthy, which also increases the likelihood of making another error during re-recording of the voice message.
The present disclosure will be understood more fully from the detailed description that follows and from the accompanying drawings, which however, should not be taken to limit the invention to the specific embodiments shown, but are for explanation and understanding only.
In the following description specific details are set forth, such as device types, system configurations, protocols, methods, etc., in order to provide a thorough understanding of the disclosure herein. However, persons having ordinary skill in the relevant arts will appreciate that these specific details may not be needed to practice the embodiments described.
In the context of the present application, a communications network is a geographically distributed collection of interconnected subnetworks for transporting data between nodes, such as intermediate nodes and end nodes (also referred to as endpoints). A local area network (LAN) is an example of such a subnetwork; a plurality of LANs may be further interconnected by an intermediate network node, such as a router, bridge, or switch, to extend the effective “size” of the computer network and increase the number of communicating nodes. Examples of the devices or nodes include servers, mixers, control units, and personal computers. The nodes typically communicate by exchanging discrete frames or packets of data according to predefined protocols.
A “voicemail system”, as that term is used in the present disclosure, refers to a computer system (e.g., a UMS) or network, or more expansive systems that include gateway devices attached to other computer systems, thus enabling users to send/retrieve recorded multimedia messages anywhere in the world. A “voicemail” or multimedia message which comprises voice, video, text, etc., is a recorded (e.g., audio) message stored in such a computerized system. An endpoint is any device, component, element, or object capable of recording, editing, sending or receiving a voicemail message over a network. An endpoint may comprise a personal computer (PCs), workstation, personal digital assistant (PDA), laptop or notebook computer, VoIP phone, or other communications equipment. A Unified Messaging (or UM) system is a computerized system that integrates different streams of messages (e-mail, fax, voice, video, etc.) into a single “in-box”, accessible from a variety of different endpoint devices.
Speech-to-text (STT) technology is a known method of transforming speech into a text file. Similarly, a text-to-speech (TTS) system converts normal language text into speech. Direct editing of audio files, e.g., a .WAV file, is also a known technology. (WAV or WAVE is short for Waveform audio format, which is a Microsoft and IBM audio file format standard for storing audio on PCs.) Examples these latter types of voice editors can be found at http://www.catauto.com/ed1000w.html; http://www.catauto.com/ed300dxl.html; http://www.goldwave.com; http://www.snapfiles.com/get/soliton.html; and http://www.voicemailspecial.com/. The difficulty with these voice editors is that the user only sees the audio “wavefront” and must move the cursor in a “hit or miss” trial fashion trying to locate the exact place of the error.
According to one embodiment of the present invention, a UMS provides a user with a textual view for editing a voicemail message that has been recorded, but not yet sent. The user may edit the voicemail message by highlighting a word or portion of the displayed text and then either typing new text or recording new speech that replaces the audio data corresponding to the highlighted text. That is, the user may edit his voicemail message without having to listen to any portion of the recording. Once editing of the voicemail message has been completed, the user may send the edited voicemail message as one or more audio data files to the intended recipient's mailbox.
The UMS handles the edited voicemail message just like any other rich-media UMS message. That is, the UMS handles the edited voicemail message as one or more objects in a single mailbox that the receiver can access either with a regular endpoint device, such as a personal computer, (PC), a telephone, or other suitable communications device. The edited audio file(s) may also be filtered or processed to eliminate or minimize any differences in volume, tone, noise levels, etc., between the original recording and the edited portions. This post-recording processing of the message smoothes out the speech, thereby making the edited portions undetectable to the recipient.
Referring to
In the embodiment shown, MLVM-Server 12 comprises an add-on hardware (firmware) and/or software module to UMS 14 and utilizes standard speech-to-text (STT) capabilities in real-time to create a Multi-Layered VoiceMail Message (MLVM-Message). That is, MLVM-Server 14 may incorporate or be associated with a STT converter for converting a voice message to text for editing by a user, as well as a text-to-speech (TTS) converter for converting a text message to audible speech.
The MLVM-Message has a data structure which comprises an Audio Layer, which is the actual audio data consisting of the user's speech recorded in any one of a number of different data formats (e.g., .wav, G711, etc.), a Text Layer, which is the text data generated as a result of the translation of audio data using an STT converter, and a Text-to-Audio Mapping Layer, which is a layer that maps each unit within the Text Layer (e.g. text word) to its corresponding segment or unit (chunk of audio data) in the Audio Layer, and vice versa. By way of example, when user 11 calls into UMS 14 and starts recording a voicemail message, MLVM-Server 12 creates, in real-time, the translated Text Layer and the Mapping Layer that links the generated text to the corresponding audio data in the Audio Layer of the MLVM-Message.
In the embodiment of
In the event that user 11 makes a mistake while recording his message, he may finish recording the remainder of his voice message and then use MLVM-Editor 16 to easily scroll through the text to locate the portion of the message that needs to be edited. Once that portion of the text has been located, user 11 may perform normal text editing, such as deleting or moving text from one portion of the message to another. MLVM-Editor 16, by utilizing the Text-to-Audio Mapping Layer of the corresponding MLVM-Message, automatically “mirrors” the exact editing to the corresponding audio data in the Audio Layer of the MLVM-Message. In another example embodiment, rather than using TTS the system identifies and utilizes recorded words with the voice of user 11.
Note that clicking on Send button 24 causes the modified audio data file(s) comprising the edited voicemail message to be placed or stored in the intended recipient's mailbox of UMS 14.
In another embodiment, a user of MLVM-Editor 16 may display the Text Layer data (i.e., a text view of the voice message) to find a place in the message where he forgot to say something. For example, if he forgot to leave his administrative assistant's name and phone number he could scroll through or search the text view/message and, using his cursor, highlight the space or word(s) where the new speech is to be inserted. In an alternative implementation, the user may simply position his cursor and hit a “Record” button or icon appearing in GUI window 20 or otherwise invoke recording by another command input (e.g., keypad sequence or combination). The user may then record (by speaking) the missing information (e.g., “Please call my assistant Mary at 408-902-1234 and let her know if you are available”). In this case, MLVM-Editor 16 inserts the newly recorded audio data in the corresponding location of the MLVM-Message Audio Layer, as well as inserting the corresponding text (audio-to-text translated) into the MLVM-Message Text Layer at the appropriate position in text field 21.
Practitioners in the art will understand that MLVM-Editor 16 may run on the user's PC, or, alternative, the GUI shown in
In accordance with another embodiment, a user may use the MLVM-Editor to delete/change portions of the recorded message, or insert additional or missing information, by typing new text at appropriate position in the displayed text field. In other words, instead of recording new speech as described above, the system allows the user to simply update the Text layer by typing new text. The system then updates the corresponding audio data using a standard TTS converter. In a specific implementation, the TTS engine may use voice characteristics of the user extracted from the recorded speech (or from stored data files of the user's speech) for converting the text to speech, thereby matching the text-to-speech portion with the rest of recorded message.
In still another embodiment, the user can mark a text segment from the Text Layer of a MLVM-Message (i.e., the textual view of the voicemail message) using the MLVM-Editor and cut/paste that segment to another place in the MLVM-Message, or even into another MLVM-Message. This cut/paste operation has the effect of moving a copy of the audio data corresponding to the cut text data, as well as moving the corresponding and Text-to-Audio Mapping Layer segments.
Additionally, rather than using a TTS module to generate speech that attempts to emulate the voice of user 11, the system searches within existing voice messages for words, sound patterns, or utterances that are similar to those needed for the editing task. The system may utilize the words, sound patterns, or utterances rather than the TTS generated speech.
Note that according to the method shown, the edited voice message (using textual view) is recorded in user's own voice. In other embodiments, a computer-generated voice, or a computer-synthesized version of the user's voice (based on the user's detected or stored voice characteristics) may be utilized for edits to the audio data.
It is appreciated that the MLVM-Editor may also provides a user-friendly way to locate a voice segment (through the textual view), which segment can be copy/cut and pasted into another place in that same multi-layer message or into another multi-layer voicemail message.
Once the user has finished inserting newly recorded speech into the MLVM-Message, or deleting/replacing portions of the message, he is given the option of making another edit (block 35). If the user elects to make further edits to his message, the process returns to block 33. On the other hand, once editing has been completed the user may then send the voice portion (i.e., audio data) of the message to the intended recipient (block 36). This latter step may be initiated simply by closing the GUI window provided by the MLVM-Editor on the user's PC display screen. The recipient may retrieve the voicemail message by accessing her mailbox within the UMS any time thereafter.
It is appreciated that any unified messaging/voicemail system utilized by or in conjunction with node 50 may comprise separate hardware devices coupled to the system bus 56, or, alternatively, implemented as software programs or modules 54 that run on one or more processors of subsystem 51. In other words, the composing, sending, storing, and receiving of electronic messages, as well as other associated functions may be implemented as separate hardware devices, memory locations (storing executable code), firmware devices, software modules, or other machine-readable devices. (In the context of the present application, therefore, the term “module” is to be understood as being synonymous with both hardware devices and computer-executable software code, programs or routines.) Additionally, although voice messaging has been specifically described in the above examples, it should be understood that the concepts presented are equally applicable to all types of multimedia messaging.
It should be further understood that elements of the present invention may also be provided as a computer program product which may include a machine-readable medium having stored thereon instructions which may be used to program a computer (e.g., a processor or other electronic device) to perform a sequence of operations. Alternatively, the operations may be performed by a combination of hardware and software. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnet or optical cards, propagation media or other type of media/machine-readable medium suitable for storing electronic instructions. For example, elements of the present invention may be downloaded as a computer program product, wherein the program may be transferred from a remote computer or telephonic device to a requesting process by way of data signals embodied in a carrier wave or other propagation medium via a communication link (e.g., a modem or network connection).
Additionally, although the present invention has been described in conjunction with specific embodiments, numerous modifications and alterations are well within the scope of the present invention. For instance, although functions and methods of various embodiments have been described as being embodied on a UMS coupled to a server via an IP network, it is appreciated that these same methods and functions may be embodied on an endpoint device of a user, another server or client, a messaging application, or a third party service application program accessible via a web-based browser. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
