Patent Grant
8265922
The present invention claims priority of Korean Patent Applications No. 10-2008-0121023, filed on Dec. 2, 2008, and No. 10-2009-0026452, filed on Mar. 27, 2009, which are incorporated herein by reference.
The present invention relates to a method and apparatus for applying translation memory in an automatic translation system, and, in particular, to a method and apparatus that, in a Korean-English or Korean-Chinese translation, store in an expanded translation memory database source sentences expanded by analyzing its morphemes and applying the translation memory expansion and translated sentences that correspond to the expanded source sentences and then carry out an automatic translation by matching with the expanded source sentences an input sentence expanded by analyzing its morphemes and applying the translation memory expansion.
There have been a great deal of efforts to translate a document automatically on a machine since 1940s with the advent of the computer. Machine-translation systems of early days such as Georgetown Automatic Translation (also known as GAT) and Traduction Automatique à l'Université de Montréal (also known as TAUM) are regarded as pioneers in this field but their translation quality fell badly short of the industry's expectations.
With the recent rapid development of computer capabilities and the increasing need to resolve the information blockage due to language barriers, however, research works in artificial intelligence and computational linguistics have made significant progresses, giving rise to the modern development of machine translation. In a machine-translation system, the method applying translation memory plays the central role.
There are two types of applying translation memory in a machine-translation system: exact match and approximate match. If the first type is employed, a translated sentence may be produced only when there is an exact match between the input sentence and the translation memory. In this case, the quality of translated sentence is expected to be high. If the second type is employed, a translated sentence may be produced in spite of an inexact match with the translation memory, if it is regarded as being sufficiently close to the translation memory based on the degree of approximation.
If a machine translation system of the first type is employed, i.e., a translated sentence is produced only when there is a perfect match between the input sentence that needs translation and the translation memory, the success of translation depends largely on how many sentences used in the corresponding domain are contained in the translation memory. In case of an agglutinative language such as Korean, the domain coverage of the translation memory gets significantly diminished due to factors like elision, word order, variety of particles, endings and expressions.
If a machine translation system of the second type is employed, i.e., a translated sentence may be produced in spite of an approximate match with the translation memory, additional works are called for in order to produce the final output. That is, the approximately matched parts of the sentence need additional human intervention and the mismatched parts are subject to an additional automatic translation. While the requirement of additional human intervention reduces a great deal of merits in automatic translation, the additional automatic translation of the mismatched parts leads to deterioration in the translation quality.
In view of the above, the present invention provides a method and an apparatus for applying translation memory (hereinafter, referred to as TM) in an automatic translation system that stores in an expanded TM database a source sentence expanded by analyzing its morphemes and applying the TM expansion and a translated sentence that corresponds to the expanded source sentence and then carries out an automatic translation by matching with the expanded source sentence an input sentence expanded by analyzing its morphemes and applying the TM expansion.
In accordance with a first aspect of the present invention, there is provided a method for applying TM in an automatic translation system, including:
generating TM-expanded forms by applying TM expansion rules respectively to source sentences whose morphemes have been analyzed;
storing in an expanded TM database translated sentences corresponding to the generated TM-expanded source sentences;
analyzing morphemes if an input sentence does not match any of the source sentences stored in basic TM database;
generating a TM-expanded form by applying pertinent ones among the TM expansion rules to the input sentence whose morphemes have been analyzed; and
producing, if the TM-expanded input sentence matches one of the TM-expanded source sentences stored in the expanded TM database, a translated output corresponding to the matched TM-expanded source sentence.
In accordance with a second aspect of the present invention, there is provided an apparatus for applying TM in an automatic translation system, including:
a basic TM match unit that matches an input sentence with source sentences stored in a basic TM database;
a morphemic analyzer that analyzes morphemes of the input sentence if the basic match yields a mismatch;
an expansion unit that generates a TM-expanded form by applying pertinent ones among TM expansion rules to the input sentence whose morphemes have been analyzed; and
an expanded TM match unit that produces a translated output corresponding to the matched expanded source sentence if the generated TM-expanded input sentence matches one of expanded source sentences stored in an expanded TM database.
The present invention provides a method and an apparatus for applying TM in an automatic translation system that stores in an expanded TM database a source sentence expanded by analyzing its morphemes and applying the TM expansion and a translated sentence that corresponds to the expanded source sentence and then carries out an automatic translation by matching with the expanded source sentence an input sentence expanded by analyzing its morphemes and applying the TM expansion so that the TM coverage can be extended by using the TM sentence of the same size without having to construct additional TM.
Besides, by the method and apparatus for applying TM in an automatic translation system of the present invention, the single most important requirement of an automatic translation system that the translation quality be enhanced can be fulfilled.
The above features of the present invention will become apparent from the following description of embodiments given in conjunction with the accompanying drawings, in which:
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that they can be readily implemented by those skilled in the art. Furthermore, if, in the following description of the present invention, detailed descriptions of well-known functions or constructions may unnecessarily make the gist of the present invention obscure, such detailed descriptions will be omitted.
The basic TM match unit 10 identifies spaces and symbols in an input sentence S1 and compares the input sentence with respective source sentences stored in the basic TM database 20. If the comparison yields an exact match as the same sentence, the translated result corresponding to a source sentence that matches the input sentence is read in to produce the output and the translation is finished. If the comparison does not give an exact match, however, the input sentence is passed to the morphemic analyzer 30.
The basic TM database 20 keeps a number of source sentences and an equal number of translated sentences corresponding to them.
The morphemic analyzer 30 analyzes morphemes of the input sentence passed from the basic TM match unit 10 and sends the result to the expansion unit 40. Besides, the morphemic analyzer 30 reads in a source sentence held in the basic TM database 20 as well as its translated sentence and then analyzes morphemes of the source sentence to send the result to the expansion unit 40.
The expansion unit 40 includes an expansion module 41, a paraphrase database 43 and a TM expansion-rule holder 45 as illustrated in the detailed block diagram of
The expansion module 41 generates a TM-expanded form of the input sentence by applying pertinent ones among the five expansion rules held in the TM expansion-rule holder 45 to the input sentence sent by the morphemic analyzer 30 and then passes the generated TM-expanded form to the expanded TM match unit 50. Here, the five TM expansion rules includes those rules reflecting an ellipsis, inflection, free word order, paraphrase with various expressions and characteristics of a sentence-initial word.
Furthermore, the expansion module 41 generates a TM-expanded form of the source sentences by applying pertinent ones among the five expansion rules held in the TM expansion-rule holder 45 to the source sentences sent by the morphemic analyzer 30 and then passes the TM-expanded source sentences as well as their corresponding translations to the expanded TM database 60.
The paraphrase database 43 keeps paraphrase data for them to be available for the expansion module 41 to apply the TM expansion rule that reflects paraphrase with various expressions.
The TM expansion-rule holder 45 holds the five TM expansion rules, i.e. the rules that reflect an ellipsis, inflection, free word order, paraphrase with various expressions and characteristics of a sentence-initial word.
The expanded TM match unit 50 compares the TM-expanded input sentence passed from the expansion module 41 in the expansion unit 40 with the expanded source sentences stored in the expanded TM database 60, respectively. If the comparison yields an exact match as the same sentence, the translated result corresponding to an expanded source sentence that matches the input sentence is read in to produce the output and the translation is finished. If the comparison does not give an exact match, however, the input sentence is passed to the translation engine 70.
The expanded TM database 60 keeps the TM-expanded source sentences that have been obtained by expanding the source sentence input from the expansion unit 40 as well as their corresponding translations.
The translation engine 70 is a conventional automatic translator. It produces an automatically translated output for the input sentence passed from the expanded TM match unit 50.
Therefore, the present invention stores in the expanded TM database a source sentence expanded by analyzing its morphemes and applying the TM expansion and a translated sentence that corresponds to the expanded source sentence and then carries out an automatic translation by matching with the expanded source sentence an input sentence expanded by analyzing its morphemes and applying the TM expansion so that the translation memory coverage can be extended by using the translation memory sentence of the same size without having to construct additional translation memory.
In what follows, an explanation is given to show how translation memory is applied in an automatic translation system in accordance with an embodiment of the present invention.
The morphemic analyzer 30 reads in a source sentence held in the basic TM database 20 as well as its translated sentence and then analyzes morphemes of the source sentence, at step S301, to send the result to the expansion unit 40.
At step S303, the expansion module 41 in the expansion unit 40 applies the five TM expansion rules held in the TM expansion-rule holder 45 to the source sentence whose morphemes have been analyzed by the morphemic analyzer 30 in order to expand the source sentence and generate its TM-expanded form. A detailed account of the five expansion rules and the respective expansion procedure is given below with select examples.
(1) The TM expansion reflecting ellipsis is to generate a form in which particles are omitted. For example,
Note that the result of a morphemic analysis indicates that in the clause
is an auxiliary particle. In an expanded form that reflects ellipsis of particles, this auxiliary particle is omitted and, hence, the TM-expanded form of a TM,
is generated.
(2) The TM expansion reflecting inflection is to register an interrogative form in lieu of individual endings to treat them as an identical TM. For example,
Note that the result of a morphemic analysis indicates that the three endings, and
are of interrogative form. Hence, by registering only their common information, the interrogative form in the present example, in lieu of three individual endings, the individual sentences that would be recognized otherwise as three different sentences are treated as an identical TM, yielding the TM-expanded form of a TM,
interrogative form.
(3) The TM expansion reflecting free word order is to generate an expanded TM by recomposing a sentence in clauses by a criterion independent of word order. For example,
In order to resolve the problem of diminution of coverage due to word order, clauses in the sentences are arranged and the expanded TM is generated as one entry from the arranged clauses. In the present example, is an entry to be input for the expanded TM.
(4) The TM expansion reflecting paraphrase with various expressions is to generate an expanded TM by using paraphrase data stored in the paraphrase database shown in
Paraphrase data can be any of a word, a clause or a sentence. In the present example, can be paraphrased to
so that
is generated for the TM-expanded form.
(5) The TM expansion reflecting characteristics of a sentence-initial word is to generate an expanded TM based on the type of a sentence-initial word and morphemic analysis of the sentence. For example,
When a sentence-initial word is an adverb, interjection or vocative, it is eliminated in the expanded TM. In this case, unlike in the four preceding expansions, a translator is used to translate the sentence-initial word and then the translated result is combined with the translation of the expanded TM to yield a TM-expanded form.
A number of source sentences stored in the basic TM 20 are all expanded by the five rules at step S303. At step S305, TM-expanded forms of a source sentence and the translations of these expanded source sentences are stored in the expanded TM database 60.
At step S307, the basic TM match unit 10 identifies spaces and symbols in an input sentence S1 and compares the input sentence with respective source sentences stored in the basic TM database 20 to see if they match as the same sentence.
At step S309, if the comparison at step S307 yields an exact match as the same sentence, the translated result corresponding to a source sentence that matches the input sentence is read in to produce the output and the translation is finished.
At step S311, if the comparison does not give an exact match, however, the input sentence is passed to the morphemic analyzer 30.
At step S313, the morphemic analyzer 30 analyzes morphemes of the input sentence passed from the basic TM match unit 10 and sends the result to the expansion unit 40.
At step S315, the expansion module 41 generates a TM-expanded form of the input sentence by applying pertinent ones among the five expansion rules held in the TM expansion-rule holder 45 to the input sentence sent by the morphemic analyzer 30. At step S317, the generated TM-expanded form is passed to the expanded TM match unit 50.
At step S319, the expanded TM match unit 50 compares the TM-expanded input sentence passed from the expansion module 41 in the expansion unit 40 with the expanded source sentences stored in the expanded TM database 60, respectively.
If the comparison at step S319 does not give an exact match, the input sentence is passed to the translation engine 70, step S323. The translation engine 70 produces an automatically translated output for the input sentence passed from the expanded TM match unit 50, at step S325.
If the comparison at step S319 yields an exact match as the same sentence, however, the translated result corresponding to an expanded source sentence that matches the input sentence is read in to produce the output and the translation is finished at step S327.
It has been shown in embodiments of the present invention that, by the method and apparatus for applying translation memory in an automatic translation system of the present invention, the single most important requirement of an automatic translation system that the translation quality be enhanced can be fulfilled.
While the invention has been shown and described with respect to the embodiments, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2008-0121023 | Dec 2008 | KR | national |
| 10-2009-0026452 | Mar 2009 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20020138250 | Okura et al. | Sep 2002 | A1 |
| 20030125928 | Lee et al. | Jul 2003 | A1 |
| 20080162115 | Fuji et al. | Jul 2008 | A1 |
| 20080249760 | Marcu et al. | Oct 2008 | A1 |
| 20100070261 | Jin et al. | Mar 2010 | A1 |
| Number | Date | Country |
|---|---|---|
| 10-2001-0081770 | Aug 2001 | KR |
| 10-2003-0068502 | Aug 2003 | KR |
| 10-2004-0050394 | Jun 2004 | KR |
| 10-2006-0067116 | Jun 2006 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20100138214 A1 | Jun 2010 | US |
