Patent Application
20230116268
The embodiments herein, in general, relate to transliteration. More particularly, the embodiments herein relate to a system and a method for transliteration based on phonetic mapping. Further, the embodiments herein provide systems and methods for inputting language into a computing device based on a phonetic-based scheme.
In a general sense, transliteration is defined as a process of translation of text of one literature to other based on pronunciation. Transliteration is an important process in many multilingual natural language tasks. An essential component of transliteration approaches is a verification mechanism that evaluates if the two words of different languages are phonetically accurate translations of each other. Although many systems have transliteration generation (recognition) as a component, stand-alone verification is relatively new. Most of the existing transliteration methods follow word to word mapping, for example, Latin words were directly mapped to words in a native language. Transliteration using word to word mapping does not provide accurate results and also deceit the users of a good typing experience. Further, verification has been used as an essential step for transliteration and the existing prior-art fail to provide an effective validation process which are time efficient and accurate. Also, in many cases, there is no agreed upon standard romanization system, leading to an increase in ambiguity and noise when decoding to the target words in the native script.
Hence, there is a need for a system and a method that yields substantial accuracy improvements and latency reductions over the existing transliteration methods.
A primary object of the embodiments herein is to develop a system and a method for transliteration based on grapheme to phoneme mapping and cross-lingual pronunciation mapping models.
Another object of the embodiments herein is to utilize a single, pre-trained transliteration model for all different languages for reducing time required for training multiple different artificial intelligence (AI) models.
Yet another object of the embodiments herein is to transliterate text in any input language (or first language) to text comprising characters of a base language (or a second language) based on pronunciation.
Yet another object of the embodiments herein is to utilize a conventional word mapping algorithm along with the pretrained transliteration model.
Yet another object of the invention is to utilize a character mapping algorithm along with the pretrained transliteration model
The objects disclosed above will be realized and achieved at least by the elements, features, and combinations particularly pointed out in the detailed description of the embodiments herein. The objects disclosed above have outlined, rather broadly, the features of the embodiments herein in order that the detailed description that follows may be better understood. The objects disclosed above are not intended to determine the scope of the claimed subject matter and are not to be construed as limiting the embodiments herein. Additional objects, features, and advantages of the embodiments herein are disclosed below. The objects disclosed above, which are believed to be characteristic of the embodiments herein, both as to its organization and method of operation, together with further objects, features, and advantages, will be better understood and illustrated by the technical features broadly embodied and described in the following description when considered in connection with the accompanying drawings.
The following details present a simplified summary of the embodiments herein to provide a basic understanding of the several aspects of the embodiments herein. This summary is not an extensive overview of the embodiments herein. It is not intended to identify key/critical elements of the embodiments herein or to delineate the scope of the embodiments herein. Its sole purpose is to present the concepts of the embodiments herein in a simplified form as a prelude to the more detailed description that is presented later.
The other objects and advantages of the embodiments herein will become readily apparent from the following description taken in conjunction with the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
According to an embodiment herein, a method for converting text in one of a plurality of input languages into a text in a second language using phonetic based transliteration is provided. The method includes receiving an input text in a first script from a user. Each character of the input text is phonetically mapped with a second script corresponding to the second language. The permutations of mapping of each, input character with, each character of the second script is validated and the input text in the first script is transliterated into an output text in the second script.
According to an embodiment herein, the step of transliterating includes performing a machine transliteration using an artificial intelligence (AI)-based transliteration engine executable by at least one processor for converting text in any input language into output text.
According to an embodiment herein, the step of transliterating includes transliterating text in an input language to a text including one or more characters of a base language.
According to an embodiment herein, the step of transliterating includes transliterating text using a speech transliteration engine, and wherein a text includes Latin or English characters to a text including characters of Devanagari or Hindi characters, based on mapping of the phonetics instead of word mapping using a pre-trained artificial intelligence (AI) model.
According to an embodiment herein, the AI based transliteration engine is integrated into an input interface of a user device.
According to an embodiment herein, the AI based transliteration engine utilizes a Unicode symbol sequence.
According to an embodiment herein, the AI based transliteration engine is configured to utilize expectation maximization (EM) algorithm as an approach for performing maximum likelihood estimation in the presence of latent variables. The latent variables are the variables not directly observed and are actually inferred from the values of the other observed variables.
According to an embodiment herein, the expectation maximization (EM) algorithm is used for the latent variables to predict, the values with the condition that a general form of probability distribution governing the latent variables is known.
According to an embodiment herein, the method further includes performing a grapheme to phoneme (G2P) conversation using a per-symbol alignment of an input string and an output string. Grapheme-to-Phoneme (G2P) conversion is a technique related to Natural Language Processing, Speech Recognition and Spoken Dialog Systems development.
According to an embodiment herein, a primary goal of G2P conversion is to accurately predict the pronunciation or transliteration of a novel input word given the spelling. The G2P conversion process is typically broken down into several sub-processes. The subprocesses includes (1) Sequence alignment, (2) Model training and, (3) Decoding processes. The goal of Sequence alignment process is to align the grapheme and phoneme sequence pairs in a training dictionary. The goal of Model training process is to produce a model to generate new transliteration for novel words. The goal of Decoding process is to find the most likely pronunciation given the model.
According to an embodiment herein, a method for converting input text into output text is provided. The method comprises the step of checking if the user device is downloaded with the weighted finite-state transducer (WFST) algorithm. The input text is provided to the WFST model. The input text is converted to a first output text, when the WFST algorithm is downloaded. The method still further includes proceeding with the word mapping algorithm as the fallback when the WFST model is not downloaded in the user device. The method further includes checking when the input text matches with a prestored native words through direct mapping process. The method further includes forwarding the input text through the word mapping algorithm and generating a second output text if input matches with the prestored native words and forwarding the input text through the character mapping algorithm and generating a third output text if the input does not match with the prestored native words.
According to an embodiment herein, the WFST is a finite-state machine includes two memory tapes, including an input tape and an output tape for tuning machines.
According to an embodiment herein, the word mapping algorithm is based on direct mappings of the words.
According to an embodiment herein, the character mapping algorithm implies mapping of characters of the input text to phonetically similar sounding characters of the output text.
According to an embodiment herein, a system for phonetic-based transliteration is provided. The system includes a memory for storing one or more executable modules and a processor for executing the one or more executable modules for phonetic-based transliteration. The one or more executable modules includes a transliteration engine configured to transliterate input text of first language into the output text of second language. The transliteration engine includes a data reception module for receiving an input text in an input language, a data transformation module is used for transforming the input text into a transliterated text including one or more characters in a second language, a training module for training a pre-trained model and decoding an output text of the trained model to generate text including characters of the second language, an inference module for executing the inference stage by receiving a text file as input, processing the input text data through the pre-trained language model and generating output text data in a second language; and a database is used for storing text files received as input text for transliteration and a corpus containing large datasets of curated and augmented texts.
According to an embodiment herein, the encoder is configured to train a pre-trained model with the data files and corresponding transliterated text using transfer learning.
According to an embodiment herein, the decoder is configured to perform decoding and the decoder improves the accuracy of the generated text including characters of the second language.
According to an embodiment herein, the data transformation module transliterates the generated text to output text including characters in the second language.
According to an embodiment herein, the transliteration engine is executed by the processor and causes the processor to transliterate input text of first language into the output text of second language.
The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments.
It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the spirit and scope of the appended claims.
The foregoing summary, as well as the following detailed description, is better understood when read in conjunction with the appended drawings. For illustrating the embodiments herein exemplary constructions of the embodiments herein are shown in the drawings. However, the embodiments herein are not limited to the specific methods and components disclosed herein. The description of a method step or a component referenced by a numeral in a drawing is applicable to the description of that method step or component shown by that same numeral in any subsequent drawing herein.
The other objects, features, and advantages will occur to those skilled in the art from the following description of the preferred embodiment and the accompanying drawings in which:
Although the specific features of the embodiments herein are shown in some drawings and not in others. This is done for convenience only as each feature may be combined with any or all of the other features in accordance with the embodiments herein.
The detailed description of various exemplary embodiments of the disclosure is described herein with reference to the accompanying drawings. It should be noted that the embodiments herein are described herein in such details as to clearly communicate the disclosure. However, the amount of details provided herein is not intended to limit the anticipated variations of embodiments; on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present disclosure as defined by the appended claims.
It is also to be understood that various arrangements may be devised that, although not explicitly described or shown herein, embody the principles of the present disclosure. Moreover, all statements herein reciting principles, aspects, and embodiments of the present disclosure, as well as specific examples, are intended to encompass equivalents thereof.
While the disclosure is susceptible to various modifications and alternative forms, specific embodiment thereof has been shown by way of example in the drawings and will be described in detail below. It should be understood, however that it is not intended to limit the disclosure to the forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.
The embodiments herein provide a system and method for transliteration based on graphene to phoneme mapping and cross-lingual pronunciation mapping models. The embodiments herein transliterate text in any input language (or first language) to text comprising characters of a base language (or a second language) based on pronunciation. The system and method utilize a conventional word mapping algorithm along with the pretrained transliteration model. The embodiments herein use a character mapping algorithm along with the pretrained transliteration model for transliterating.
According to an embodiment herein, a method for converting text in one of a plurality of input languages into a text in a second language using phonetic based transliteration is provided. The method comprising the steps of receiving (802) an input text in a first script from a user; phonetically mapping (804) each character of the input text with a second script corresponding to the second language: validating (806) permutations of mapping of each input character with each character of the second script: and transliterating (808) the input text in the first script into an output text in the second script.
According to an embodiment herein, the step of transliterating comprises performing a machine transliteration using an artificial intelligence (AI)-based transliteration engine (106) executable by at least one processor for converting text in any input, language into output text.
According to an embodiment herein, the step of transliterating comprises transliterating text in an input language to a text comprising one or more characters of a base language.
According to an embodiment herein, the step of transliterating comprises using a speech transliteration engine to transliterate a text comprising Latin or English characters to a text comprising characters of Devanagari or Hindi characters, based on mapping of the phonetics instead of word mapping using a pre-trained artificial intelligence (AI) model.
According to an embodiment herein, the AI based transliteration engine is integrated into an input interface (401) of a user device.
According to an embodiment herein, the AI based transliteration engine utilizes a Unicode symbol sequence.
According to an embodiment herein, the AI based transliteration engine is configured to utilize Expectation Maximization (EM) algorithm as an approach for performing maximum likelihood estimation in the presence of latent variables.
According to an embodiment herein the latent variables are the variables not directly observed and are actually inferred from the values of the other observed variables.
According to an embodiment herein, an expectation maximization (EM) algorithm is used for latent variables to predict the values with the condition comprising a general form of probability distribution governing the latent variables is known.
According to an embodiment herein, the method further comprises performing a grapheme to phoneme (G2P) conversation using a per-symbol alignment of an input string and an output string.
According to an embodiment herein, a primary goal of G2P conversion is to accurately predict the pronunciation or transliteration of a novel input word given the spelling.
According to an embodiment herein, a method for converting input text into output text is provided. The method comprising the steps of checking (301)/(902) if the user device is downloaded with a weighted finite state transducer (WFST) algorithm; providing (302)/(904) the input text to the WFST model and converting the input text to the output text-1 if the WFST algorithm is downloaded proceeding (906) with the word mapping algorithm as the fallback if the WFST model is not downloaded in the user device; checking (303)/(908) if the input text matches with a prestored native words through direct mapping process; forwarding (304)/(910) the input text through the word mapping algorithm and generating output text-2, if input matches with the prestored native words; and forwarding (305)/(912) the input text through the character mapping algorithm and generating output text-3, if the input does not match with the prestored native words.
According to an embodiment herein, the weighted finite-state transducer (WFST) is a finite-state machine comprising two memory tapes, following the terminology for tuning machines comprising an input tape and an output tape.
According to an embodiment herein, the word mapping algorithm is implemented for direct mappings of the words.
According to an embodiment herein, the character mapping algorithm is executed for mapping of characters of the input text to phonetically similar sounding characters of the output text.
According to an embodiment herein, a system for phonetic-based transliteration is provided. The system comprises a memory (102) for storing one or more executable modules; and a hardware processor (104) for executing the one or more executable modules for phonetic-based transliteration, The one or more executable modules comprises a transliteration engine (106) configured to transliterate input text of first language into the output text of second language, the transliteration engine comprising: a data reception module (108) for receiving an input text in an input language; a data transformation module (110) for transforming the input text into a transliterated text comprising one or more characters in a second language; a training module (112) comprising an encoder (112a) and a decoder (112b) for training a pre-trained model and decoding an output text of the trained model to generate text comprising characters of the second language; and an inference module (114) for executing the inference stage by receiving a text file as input, processing the input text data through the pre-trained language model, and generating output text data in a second language.
According to an embodiment herein, the encoder (112a) is configured to train a pre-trained model with the data files and corresponding transliterated text using transfer learning.
According to an embodiment herein, the decoder (112b) is configured to perform decoding and decoder improves the accuracy of the generated text comprising characters of the second language.
According to an embodiment herein, the data transformation module (110) transliterates the generated text to output text comprising characters in the second language.
According to an embodiment herein, the transliteration engine (106) is executed by the processor and causes the processor to transliterate input text of first language into the output text of second language.
According to an embodiment herein, the modules of the transliteration engine 106 are stored in the memory unit 102, The processor 104 is operably and communicatively coupled to the memory unit 102 for executing the computer program instructions defined by the modules of the transliteration engine 106. The transliteration engine 106 is not limited to employing the processor 104. According to an embodiment herein, the transliteration engine 106 employs one or more controllers or microcontrollers. The transliteration engine 106 comprises modules defining computer program instructions, which when executed by the processor 104, cause the processor 104 to transliterate input text of first language into the output text of second language. The database 116 stores, for example, text files received as input text for transliteration and a corpus containing large datasets of curated and augmented texts. The data reception module 108 receives an input text in any input language, for example, Latin characters of English language. The data transformation module 110 transforms the input text into transliterated text comprising characters of a second, language. According to an embodiment herein, the training module 112 comprises an encoder 112a and a decoder 112b. The encoder 112a trains a pre-trained model with the data files and corresponding transliterated text using transfer learning. The acoustic model is pre-trained on multiple datasets of the base language. The decoder 112b performs decoding, for example, an output text of the trained model to generate text comprising characters of the second language. According to an embodiment herein, decoder 112b improves the accuracy of the generated, text comprising characters of the second language, for example, Hindi, by using a pre-trained customized language model. The data transformation module 110 then transliterates the generated text to output text comprising characters in the second language. The inference module 114 executes the inference stage, where the inference module 114 receives a text file as input, processes the input text data through the pre-trained language model, and through the pretrained customized language model, and generates output text data in a second language, according to an embodiment herein.
According to one embodiment herein, the character mapping algorithm implies mapping of characters of the input text to phonetically similar sounding characters of the output text, in one example, the characters of the Latin alphabet are mapped to Devanagari language characters. The process of mapping incudes a set of Latin (English) mapped words are taken for any particular language, such as Devanagari, proceeding further, word-by-word, the phonetics of the word are mapped to the Latin characters' phonemes. A list of words, corresponding native word mapping is given to a native language expert who breaks the word phonetics mapping after which the below file is made which is called phonetics character mapping file. For an example of the Devanagari word, consider below mapping table,
”
”
”
The above part is creation of phonetics mapping which is known as encoding. After this the decoding is carried out by the transliteration engine which mainly contributes to the conversion of input txt to corresponding transliterated output text. In one example, for decoding, the Latin input is taken from the user, and the word is broken down into the characters with all the possible permutations available in the Latin character mapping set. For example, if input is received as ‘kuch’ then the possible permutations would be “k u c h”, “k u ch”. Then all the permutations for the possible phonemes will be calculated by replacing the Devanagari phoneme mapping for each Latin sound available. For the input text “kuch” below available mappings are the possible permutations,
”, “
”
”, “
”
”
”
”
As per Table. 2, possible permutations for “k u c h=>“”, “
”
”, “
”, “
” and possible permutations for “k u ch”=>“
”, “
”
”, “
”, “
. Out of given permutations, the only output which is relevant here is “
, which is validated from a given dictionary of the respective language. After validation, all the other outputs will be discarded, and the final output will be “
” for input Latin word “kuch.”
According to one embodiment herein, the transliteration engine 106 checks if the keyboard of the user device is a QWERTY keyboard. If not, the transliteration engine 106 is configured to proceed with the word mapping algorithm as the fallback. The word mapping algorithm is based on direct mappings of the words. The transliteration engine 106 checks if the input text matches with a prestored native words through direct mapping process. If yes, the transliteration engine 106 forwards the input text through the word mapping algorithm and generates output text 2. If no, the transliteration engine 106 forwards the input text through the character mapping algorithm and generates output text 3.
According to an embodiment herein, the transliteration engine 106 is accessible to users, for example, through a broad spectrum of technologies and user devices such as smart phones, tablet computing devices, endpoint devices, and the like, with access to a network, for example, a short-range network or a long-range network. The network is, for example, one of the internets, an intranet, a wired network, a wireless network, a network that implements Wi-Fi® of Wi-Fi Alliance Corporation, a mobile telecommunication network, etc., or a network formed from any combination of these networks.
As illustrated in
As illustrated in
The network interface 504 enables connection of the transliteration engine 106 to the network. The network interface 504 is, for example, one or more of infrared interfaces, interfaces implementing Wi-Fi® of Wi-Fi Alliance Corporation, universal serial bus interfaces, FireWire® interfaces of Apple Inc., interfaces based on transmission control protocol/internet protocol, interfaces based on wireless communications invention such as satellite invention, radio frequency invention, near field communication, etc. The common modules 505 of the computing device 501 comprise, for example, input/output (I/O) controllers, input devices, output devices, fixed media drives such as hard drives, removable media drives for receiving removable media, etc. Computer applications and programs are used for operating the transliteration engine 106. The programs are loaded onto fixed media drives and into the memory unit 102 via the removable media drives. According to an embodiment herein, the computer applications and programs are loaded into the memory unit 102 directly via the network.
According to an embodiment herein, the transliteration engine 106 comprises modules defining computer program instructions, which when executed by the hardware processor 104, cause the processor 104 to transliterate input text of first language into the output text of second language. According to an embodiment herein, the modules of the transliteration engine 106 comprise a data reception module 108, a data transformation module 110, a training module 112, an inference module 114, and a database 116. The database 116 stores, for example, text files received as input text for transliteration and a corpus containing large datasets of curated and augmented texts. The data reception module 108 receives an input text in any input language, for example, Latin characters of English language. The data transformation module 110 transforms the input text into transliterated text comprising characters of a second language, for example, Hindi language with Devanagari characters, using transliteration, for example, WFST model, along with word mapping model, and character mapping, as disclosed in the detailed description of
According to an embodiment herein, the training module 112 comprises an encoder 112a and a decoder 112b. The encoder 112a trains a pre-trained model with the data files and corresponding transliterated text using transfer learning. The acoustic model is pretrained on multiple datasets of the base language. The decoder 112b performs decoding, for example, an output text of the trained model to generate text comprising characters of the second language, for example, Hindi, as disclosed in the detailed description of
The data reception module 108, the data transformation module 110, the training module 112, and the inference module 114 are disclosed above as software executed by the processor 104. According to an embodiment herein, the modules, for example, 508, 509, 510, and 511 of the transliteration engines 106 are implemented completely in hardware. In another embodiment, the modules of the transliteration engine 106 are implemented by logic circuits to perform their respective functions disclosed above. In another embodiment, the transliteration engine 106 is also implemented as a combination of hardware and software including one or more processors, for example, 502, that are used to implement the modules, for example, 108, 110, 112 and 114 of the transliteration engine 106. The processor 104 retrieves instructions defined by the data reception module 108, the data transformation module 110, the training module 112, and the inference module 114 from the memory unit 102 for performing respective functions disclosed above. The non-transitory, computer-readable storage medium disclosed herein stores computer program instructions executable by the processor 104 for converting text using machine transliteration.
A Weighted Finite State Transducer (WFST) over a set K of weights can be defined as an 8-tuple T=(Q, Σ, Γ, I, F, E, λ, ρ), where:
A WFST, T=(A, B, Q, I, F, E, λ, ρ) over a semiring K is specified by a finite input alphabet A, a finite output alphabet B, a finite set of states Q, a set of initial states I⊆Q, a set of final states F⊆Q, a finite set of transitions E⊆Q×(A∪{ε})×(B∪{ε})×K×Q, an initial state weight assignment λ: I→K, and a final state weight assignment ρ: F→K. E[q] denotes the set of transitions leaving state q∈Q.
Given a transition e∈E, p[e] denotes its origin or previous state, n[e] its destination or next state, i[e] its input label, o[e] its output label, and w[e] its weight. A path π=e1 ek is a sequence of consecutive transitions: n[ei−1]=p[ei], i=2, . . . , k. The functions n, p, and w on transitions can be extended to paths by setting: n[π]=n[ek] and p[π]=p[e1] and by defining the weight of a path as the ⊗-product of the weights of its constituent transitions: w[π]=w[e1]⊗⊗[ek]. More generally, w is extended to any finite set of paths. R by setting w[R]=⊕π∈R w[π]; if the semiring is closed, this is defined even for infinite R. We denote by P (q, q′) the set of paths from q to q′ and by P (q, x, y, q′) the set of paths from q to q′ with input label x∈A* and output label y∈B*. These definitions can be extended to subsets R, R′⊆Q by P (R, R′)=∪q∈R, q′∈R′P (q, q′), P (R, x, y, R′)=∪q∈R, q′∈R′P (q, x, y, q′).
A transducer T is regulated if the weight associated by T to any pair of inputoutput string (x, y) given by:
[[T]](x,y)=⊕λ[p[π]]⊗w[π]⊗ρ[n[π]]π∈P(I,x,y,F)
The transliteration engine is integrated into an input interface of a user device. As used herein, “input interface” refers to an interface rendered on the user device, for example, a smartphone, for receiving one or more inputs from a user. For example, the input interface is a keyboard or a virtual keyboard that is invoked on the user device when a user clicks on an input field such as a text field provided by a user application such as a messaging application or a chat application. In the method disclosed herein, the transliteration engine is integrated within the input interface invoked on the user device, independent of a user application, for example, a messaging or messenger application, a chat application, etc. As the input interface such as a virtual keyboard is opened and closed only during an input action into an input field of the user application, the operations and functions the engine is configured to be independent of the user application or any application that is present in the foreground.
In the method disclosed herein, the transliteration engine, at step 802, receives an input text in a first script from the user, for example, Latin or English characters. As used herein, the term “first script” refers to words or characters of a first language. For example, if the first language is English then the corresponding first script refers to Latin characters. The transliteration engine which is integrated with the input interface is configured to receive the input text in the first script which is further configured to be phonetically transliterated into a “second script.” For example, consider the input text contains the word ‘SANSKRIT’ which is inputted into the input interface by the user. The input text is further configured to be converted into output text of the second script. For example, consider the output text contains the word ‘’ transliterated from the ‘SANSKRIT.’
At 804, the transliteration engine is configured to phonetically map each grapheme (or character) of the input text with a second script. According to an embodiment herein, for mapping each character of the input text with the phonemes based matching characters of the second script. For example, the transliteration engine is configured to align a Devanagari script of word ‘’ with its romanization version ‘Sanskrit.’ in one embodiment, the transliteration engine utilizes the Unicode symbol sequence, for example, the Unicode symbol sequence for the input text ‘Sanskrit,’
‘’: s:
, a: ϵ, n:
, s:
, ϵ:
, k:
, r:
, i: ϵ, t:
The Unicode symbols sequence on either the input or the output may not directly correspond to a symbol on the other side, that is, in the present example, ‘a,’ ‘i’ and , which is represented with an ϵ on the other side of the transduction. We make use of the Unicode symbol sequence (
) with its Romanised word Sanskrit.
s: a: ε n:
s:
ε:
k:
r:
i: ε t:
Note that symbols on either the input or the output may not directly correspond to a symbol on the other side (such as ‘a,’ ‘i’ and in the above example), which we represent with an c on the other side of the transduction. This explains the method of creating a training set for models based on define vocab. Expectation maximization (EM) is used to learn effective alignments of this sort. We built an n-gram model to produce joint probabilities over sequences of such pairs.
According to an embodiment herein, the transliteration engine is configured to utilize Expectation Maximization (EM) algorithm as an approach for performing maximum likelihood estimation in the presence of latent variables. It can be used for the latent variables (variables that are not directly observable and are actually inferred from the values of the other observed variables) too in order to predict their values with the condition that the general form of probability distribution governing those latent variables is already known. This algorithm is actually at the base of many unsupervised clustering algorithms in the field of machine learning.
The algorithm comprises following steps:
The lexicon of input words and their pronunciations or transliterations, for example, ‘Sanskrit’ is a romanization of , are straightforwardly used to learn effective alignments of input words with that of output words. In one embodiment, for grapheme to phoneme conversion, wherein the grapheme to phoneme conversation is a method of per-symbol alignment of both the input string and the output string. For example, the word “phlegm” is pronounced F L EH M and one natural alignment between the grapheme and phoneme sequences is: p: ϵ h: F l: L e:EH g: ϵ m: M. Grapheme-to-Phoneme (G2P) conversion is an important problem related to Natural Language Processing, Speech Recognition and Spoken Dialog Systems development. The primary goal of G2P conversion is to accurately predict the pronunciation or transliteration of a novel input word given only the spelling. The G2P conversion problem is typically broken down into several sub-problems: (1) Sequence alignment, (2) Model training and, (3) Decoding. The goal of (1) is to align the grapheme and phoneme sequence pairs in a training dictionary. The goal of (2) is to produce a model able to generate new transliteration for novel words. The goal of (3) is to find the most likely pronunciation given the model. The alignment comprises the proposed toolkit that implements a modified WFST-based version of the EM-driven multiple-to-multiple alignment algorithm. This algorithm is capable of learning natural G-P relationships like Sanskrit->
which were not possible with previous 1-to-1 algorithms. The Joint Sequence N-gram model is the transliteration model implemented by the toolkit is a straightforward joint N-gram model. The training corpus is constructed by extracting the best alignment for each entry. The training procedure is then,
The decoding comprises the proposed toolkit that provides varying support for three different decoding schemes. The default decoder provided by the distribution simply extracts the shortest path through the phoneme lattice created via composition with the input word. The recurrent Neural Network (RNN) Language Models have recently enjoyed a resurgence in popularity in the context of ASR applications. N-best reranking is then accomplished with the toolkit by configuring the decoder to output the N-best joint G-P sequences and employing RNNLM to rerank the N-best joint sequences.
The aligned letter to phoneme sequence of input:output pairs (or alternatively referred as ‘permutations’), for example, symbols such as e:EH, are used to build an n-gram model to produce joint probabilities over sequences of the pairs, wherein the n-gram models are referred as pair language models (alternatively called as ‘joint multi-gram models’). By conditioning the probability of the input:output mappings on the prior context, the transliteration engine appropriately conditions the probability of h: F on whether the previous mapping was p: E. As stated above, results of these models yield remarkably similar performance to more complex and compute-intensive modelling methods, and they can be directly encoded as Weighted Finite state Transducers (WFSTs), making them excellent candidates for low resource, low-latency models for mapping graphemes of the input words with the phonemes of the output words.
At 806, the transliteration engine validates the permutations of mapping of each input character with phoneme of every character of the second script. The transliteration engine is further configured to build n-gram model to produce joint probabilities over sequences of the pairs. In one embodiment, the transliteration engine is configured to score each permutation probability of input:output pair. For example, consider below scenarios where the score is calculated using joint probability of input:output pairs (s: a: ε n:
s:
ε:
k:
r:
i: ε t:
)
Input Word: Score: Output Transliteration sequence
Sanskrit: 11.56:
Sanskrit: 13.78:
Sanskrit: 19.34:
According to an embodiment herein, for any weighted finite-state transducer, WFST is represented by ‘T’, wherein T=(Σ,Δ,Q,I,F,E,K) that is the ‘T’ includes input (Σ) and output (Δ) vocabularies, a finite set of states (Q), of one is the initial state (I), and a subset of states (F⊆Q) are final states; a weight semiring K; and a set of transitions(q,σ,δ,w,q′)∈E, where q,q′∈Q are, respectively, the source and destination states of the transition, are at σ∈Σ,δ∈Δ and w∈K. Further, a weighted finite-state automaton is a special case where Σ=Δ and, for every transition, the condition is (q, σ, δ, w, q′)∈E, σ=δ. In an exemplary embodiment, the Open FST library is used to encode and manipulate WFSTs, and, unless otherwise stated, use the tropical semiring for weights. As per
According to an embodiment herein, the transliteration engine is further configured to personalize the input text transliteration. As established, the Indian languages transliteration is very fuzzy. For example, “bahar” can be transliterated as “” or “
.” The transliteration engine, by default, transliterate “Bahar” as “
” but the engine suggests the user with “
” as well. If the user picks the suggested word, then the engine stores the user choice of word and next time whenever user types “bahar” the default transliteration is “
.” In one embodiment, the transliteration engine is configured with a character level filtration process to detect invalid words detection. For example, input text is “ok,” the first generated output for the word “ok” is
, which is an Invalid word and after filtration, the suggested output is
.
The embodiments herein disclose an AI-based transliteration engine for conversion of text in first language into text in second language based on combination of algorithms. The embodiments herein disclose multiple applications involving text-to-text conversations from Latin to Hindi, other Indic languages such as Tamil, Telugu, Kannada, Malayalam, or any other language spoken in the world. The embodiments herein can be used by third parties, research industries, firms or academic institutions working on transliteration, businesses requiring data-driven strategies, research-based industries, software sectors, cloud-based companies. AI-based conversation media entities, etc. The embodiments herein preclude the need for investing substantial amounts of money, time, and human resources on building AI models for speech recognition for multiple languages.
The foregoing examples and illustrative implementations of the various embodiments have been provided merely for explanation and are in no way to be construed as limiting the embodiments herein. While the embodiments herein have been described with reference to various embodiments, illustrative implementations, drawings, and techniques, it is understood that the words, which have been used herein, are words of description and illustration, rather than words of limitation. Although the embodiments herein have been described herein with reference to means, materials, embodiments, techniques, and implementations, the embodiments herein are not intended to be limited to the particulars disclosed herein; rather, the embodiments herein extend to all functionally equivalent structures, methods and uses, such as are within the scope of the appended claims. It will be understood by those skilled in the art, having the benefit of the teachings of this specification, that the embodiments herein are capable of modifications and other embodiments may be effected and changes may be made thereto, without departing from the scope and spirit of the embodiments herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202111046729 | Oct 2021 | IN | national |
