Patent Application
20170220559
1. Technical Field
The present disclosure relates to a paraphrase generation method, a paraphrase generator, and a non-transitory recording medium having a computer program stored thereon that are used to create one or more paraphrases from a single original text, and a machine translation system that includes or implements the same.
2. Description of the Related Art
Machine translation, which involves translating a text in a first language into a text in a second language different from the first language, has been studied and developed in recent years. Various techniques have been proposed, such as those disclosed in Japanese Patent No. 3919720 and Japanese Unexamined Patent Application Publications Nos. 2002-278963, 2006-190072, and 2015-118498, as well as documents titled Generating Targeted Paraphrases for Improved Translation, NITIN MADNANI, Educational Testing Service, ACM2013, and Distributional Phrasal Paraphrase Generation for Statistical Machine Translation, YUVAL MARTON, University of Marryland, Columbia University, ACM2013.
From the viewpoint of improving the performance of machine translation, it is desirable to have as many example texts available for translation as possible. Currently, there is room for improvement in collection of such example texts.
One non-limiting and exemplary embodiment provides a paraphrase generation method, a paraphrase generator, and a non-transitory recording medium having a computer program stored thereon that allow one or more paraphrases to be created from a single original text, and a machine translation system that includes or implements the same.
In one general aspect, the techniques disclosed here feature a paraphrase generation method. The paraphrase generation method includes generating one or more paraphrases of an original text by paraphrasing, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in the original text into another expression in the language of the original text, the plurality of fragments being obtained by dividing the original text in accordance with a predetermined rule.
It should be noted that general or specific embodiments may be implemented as a system, an apparatus, an integrated circuit, a computer program, a storage medium, or any selective combination thereof.
The paraphrase generation method, the paraphrase generator, and the non-transitory recording medium having a computer program stored thereon according to the present disclosure, and the machine translation system that implements or includes the same allow one or more paraphrases to be created from a single source text.
Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Parts or components designated by like reference numerals in the drawings represent like parts or components, and description of such parts or components will not be provided as appropriate. In this specification, reference numerals without subscripts are used for generic reference, whereas reference numerals with subscripts are used to refer to a particular individual part or component.
A paraphrase generator M according to the first embodiment generates one or more texts (paraphrases) from a single text (original text) by paraphrasing a part or all of the original text in accordance with a predetermined rule. As illustrated in
The paraphrase generator M including the units 1 to 3 is implemented by, for example, an information processor. The information processor includes, for example, a computer including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and an auxiliary memory, a display that outputs data by displaying the data, and an input device used to input data. Examples of such an information processor that may be used include desktop information processors such as desktop computers, and portable information processors such as notebook computers and tablet computers.
The blocks illustrated in
The input unit (first input unit) 1 is connected to the paraphrase generation unit 2. The input unit 1 is, for example, a circuit used to receive a predetermined operation, and input data into the paraphrase generator M. The input unit 1 is, for example, an input device including a plurality of input switches that are each assigned a predetermined function, such as a keyboard or a mouse. Alternatively, the input unit 1 may be, for example, an interface unit that communicates data with an external apparatus. The interface unit is, for example, an interface circuit that is compliant with the USB standard, or a communication interface circuit that is compliant with the IEEE802.11 standard. Examples of the predetermined operation include various operations necessary for the paraphrase generator M to create paraphrases from an original text, such as inputting of an original text from which to generate a paraphrase into the paraphrase generator M, and inputting of a start command that instructs the paraphrase generator M to create a paraphrase.
The output unit (first output unit) 3 is a device that is connected to the paraphrase generation unit 2, and outputs information such as a command or data input from the input unit 1, and a paraphrase generated by the paraphrase generation unit 2 in a manner described later. The output unit 3 is, for example, a display, such as a CRT display, a liquid crystal display (LCD), or an organic EL display, or a printing device such as a printer.
The input unit 1 and the output unit 3 may form a touch panel. If the input unit 1 and the output unit 3 form a touch panel as described above, the input unit 1 is, for example, a locator of a resistive membrane type, a capacitive type, or other types used to detect and input the position being operated on. The output unit 3 is a display device. With the touch panel, the locator is provided on the display surface of the display device, and one or more candidate information items that can be input are displayed on the display device. When the user touches the position where an item of information that the user desires to input is displayed, the position is detected by the locator, and the item of information being displayed at the detected position is input into the paraphrase generator M as a user's operational input. Such a touch panel allows for intuitive user input, making the resulting paraphrase generator M easy to handle for the user.
The paraphrase generation unit 2 paraphrases (substitutes) one or more of a plurality of fragments, which are obtained by dividing a text in accordance with a predetermined rule and included in an original text received by the input unit 1, with another expression in the language of the original text within an acceptable limit for accepting paraphrasing. The paraphrase generation unit 2 thus generates one or more paraphrases of the original text.
The predetermined rule may be any rule. For example, the predetermined rule may specify that a text be segmented every n letters (for example, two or three letters), in which case each of the fragments is made up of the n letters. Further, for example, the predetermined rule may specify that a text be segmented into phrases, in which case each of the fragments is made up of such a phrase. Further, for example, the predetermined rule may specify that a text be segmented into semantic classes, in which case each of the fragments is made up of a word in the semantic class. Further, for example, the predetermined rule may specify that a text be segmented into morphemes used in morphological analysis, in which case each of the fragments is made up of such a morpheme. Paraphrasing may be either applied only once to the same fragment in the original text, or applied a plurality of times to the same fragment in the original text.
The acceptable limit is set in advance as appropriate through attempts using a plurality of samples. Alternatively, the acceptable limit may be set randomly. Setting the acceptable limit to larger values allow relatively larger numbers of fragments to be paraphrased, thus allowing for generation of relatively larger numbers of paraphrases. Setting the acceptable limit to smaller values causes only relatively smaller numbers of fragments to be paraphrased, thus allowing for generation of paraphrases with relatively less semantic divergence from the original text.
More specifically, as illustrated in
The paraphrase information storage unit 21 is connected to each of the paraphrasing unit 22 and the paraphrase acceptability score processing unit 23. Paraphrase information is stored in the paraphrase information storage unit 21 in advance. Paraphrase information refers to information necessary for paraphrasing a fragment into a fragment expressed in another way. In the first embodiment, paraphrase information includes, for example, a first fragment as a paraphrase source, and a second fragment as a paraphrase target, which is associated with the first fragment and represents another way of expressing the first fragment, and a paraphrase acceptability score assigned to the paraphrase pair of the first fragment and the second fragment. The first fragment and the second fragment are in the same language, and in the same language as the language of the original text. The paraphrase acceptability score is a measure of the degree to which paraphrasing from the first fragment into the second fragment is accepted. For example, the paraphrase acceptability score is set as appropriate in advance through attempts using a plurality of samples, such that smaller values indicate that a paraphrase is more acceptable. Alternatively, for example, the paraphrase acceptability score may be set randomly. Preferably, for example, relatively small values are assigned in advance for the paraphrase acceptability scores of certain types of paraphrase pairs, such as paraphrase pairs that are paraphrased with relatively high frequencies and paraphrase pairs of synonyms. Although the paraphrase acceptability score may be a fixed value, the paraphrase acceptability score may be varied through a feedback process as will be described later.
In the first embodiment, such paraphrase information is stored in the paraphrase information storage unit 21 in table format. As illustrated in
The paraphrasing unit 22 is connected to the input unit 1. The paraphrasing unit 22 receives an input of an original text received by the input unit 1. The paraphrasing unit 22 is connected to the paraphrase acceptability score processing unit 23. The paraphrasing unit 22 paraphrases one predetermined fragment included in the original text received by the input unit 1 into another expression in the language of the original text to thereby generate one paraphrase candidate for the original text. Each one fragment to be paraphrased is determined in accordance with a predetermined rule. The predetermined selection rule is, for example, a rule such that the paraphrase acceptability scores of individual fragments included in an original text are determined from the paraphrase table, and the fragments are selected in order of decreasing paraphrase acceptability score. Employing this selection rule results in the acceptable limit being exceeded with a relatively small number of paraphrasing iterations, leading to less divergence between the original text and each resulting paraphrase. Alternatively, for example, the predetermined selection rule is a rule such that the paraphrase acceptability scores of individual fragments included in an original text are determined from the paraphrase table, and the fragments are selected in order of increasing paraphrase acceptability score. Employing this selection rule causes paraphrasing to be executed a relatively large number of times, thus allowing for generation of a relatively large number of paraphrases. Alternatively, for example, the predetermined selection rule is a rule such that individual fragments included in an original text are selected randomly. With this selection rule, the fragment to be paraphrased is selected randomly, thus allowing for generation of a wide variety of paraphrases.
More specifically, in the first embodiment, the paraphrasing unit 22 searches the first fragment field 211 of the paraphrase table CT, which is stored in the paraphrase information storage unit 21, for one fragment selected from the original text in accordance with the predetermined selection rule. As a result of this search, the paraphrasing unit 22 extracts the corresponding second fragment from the second fragment field of a record having the above-mentioned one fragment registered in the first fragment field 211, and paraphrases the fragment with the extracted second fragment to generate one paraphrase candidate for the original text. The paraphrasing unit 22 outputs the generated paraphrase candidate to the determination unit 24 via the paraphrase acceptability score processing unit 23. The paraphrasing unit 22 is connected to the determination unit 24. The paraphrasing unit 22 continues to execute the second and subsequent rounds of paraphrasing under control of the determination unit 24, until the determination unit 24 determines that the acceptable limit is exceeded as will be described later.
The paraphrase acceptability score processing unit 23 is connected to the determination unit 24. The paraphrase acceptability score processing unit 23 acquires, from the paraphrase information storage unit 21, a paraphrase acceptability score assigned to the paraphrase pair corresponding to a second fragment that is included in the paraphrase candidate input from the paraphrasing unit 22 as a result of paraphrasing. The paraphrase acceptability score processing unit 23 then calculates the cumulative total of paraphrase acceptability scores acquired for individual rounds of paraphrasing applied to a single original text to thereby determine a cumulative paraphrase acceptability score (the sum total of paraphrase acceptability scores acquired for individual rounds of paraphrasing applied to a single original text). More specifically, in the first embodiment, the paraphrase acceptability score processing unit 23 either receives, from the paraphrasing unit 22, a notification of the record from which the corresponding second fragment has been extracted, or retrieves, from the paraphrase table CT, a record having the source-side first fragment and the target-side second fragment respectively registered in the first and second fragment fields 211 and 212. The paraphrase acceptability score processing unit 23 then extracts and acquires a paraphrase acceptability score from the paraphrase acceptability score field 213 of this record. Then, the paraphrase acceptability score processing unit 23 adds the acquired paraphrase acceptability score to the cumulative paraphrase acceptability score (zero being the initial value for each single original text) calculated in the previous round of paraphrasing to calculate the cumulative paraphrase acceptability score resulting from the current round of paraphrasing (cumulative paraphrase acceptability score←cumulative paraphrase acceptability score+paraphrase acceptability score). The paraphrase acceptability score processing unit 23 outputs, to the determination unit 24, the paraphrase candidate input from the paraphrasing unit 22 and the calculated cumulative paraphrase acceptability score.
The determination unit 24 is connected to the output unit 3. The determination unit 24 determines whether paraphrasing executed in the paraphrasing unit 22 is within the acceptable limit for accepting paraphrasing. If, as a result of this determination, the determination unit 24 determines that paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit, the determination unit 24 determines to retain, as a paraphrase of the original text, the paraphrase candidate generated as a result of the current round of paraphrasing executed by the paraphrasing unit 22. Then, the determination unit 24 instructs the paraphrasing unit 22 to execute the next round of paraphrasing. If, as a result of the above determination, the determination unit 24 determines that paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit, the determination unit 24 determines not to retain, as a paraphrase of the original text, the paraphrase candidate generated as a result of the current round of paraphrasing executed by the paraphrasing unit 22. Then, the determination unit 24 instructs the paraphrasing unit 22 to stop execution of the subsequent rounds of paraphrasing. Then, the determination unit 24 outputs the currently retained paraphrase to the output unit 3.
More specifically, in the above-mentioned determination process according to the first embodiment, the determination unit 24 determines whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit, based on the paraphrase acceptability score assigned to the paraphrase pair corresponding to the second fragment used in the current round of paraphrasing. More specifically, the determination unit 24 determines whether the cumulative paraphrase acceptability score input from the paraphrase acceptability score processing unit 23 is equal to or less than a predetermined threshold (first threshold). The predetermined threshold (first threshold) corresponds to the acceptable limit. In the first embodiment, for example, the paraphrase acceptability score is set to be in the range of 0 to 1. Accordingly, the predetermined threshold (first threshold) is set to a suitable value such as 0.5, 0.7, 1, 1.2, 1.5, or 2, for example, 1. If, as a result of this determination, the determination unit 24 determines that the cumulative paraphrase acceptability score is equal to or less than 1, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit. If, as a result of the above determination, the determination unit 24 determines that the cumulative paraphrase acceptability score exceeds 1, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit.
Next, operation of the paraphrase generator according to the first embodiment will be described.
The paraphrase generator M according to the first embodiment generates paraphrases roughly through the following procedure. First, the input unit 1 receives an original text (receiving step). Next, the paraphrase generation unit 2 generates one or more paraphrases of the original text received by the input unit 1 by paraphrasing, within an acceptable limit, one or more of a plurality of fragments included in the original text into another expression in the language of the original text (paraphrase generating step). Then, the output unit 3 outputs the one or more paraphrases received from the paraphrase generation unit 2. A more detailed description of this operation is provided below with reference to the drawings.
The paraphrase generator M according to the first embodiment first executes an operation of receiving an original text, and paraphrasing a fragment. Referring to
Next, in the paraphrase generator M, the paraphrasing unit 22 of the paraphrase generation unit 2 paraphrases one predetermined fragment included in the original text received via the input unit 1 into another expression in the language of the original text to generate a paraphrase candidate for the original text. The paraphrase generator M then outputs the generated paraphrase candidate to the determination unit 24 via the paraphrase acceptability score processing unit 23 (S12), and ends the original-text receiving and paraphrasing operation. More specifically, the paraphrasing unit 22 first selects one fragment from the original text in accordance with the predetermined selection rule. Next, the paraphrasing unit 22 searches the first fragment field 211 of the paraphrase table CT, which is stored in the paraphrase information storage unit 21, for the one selected fragment. Then, as a result of this search, the paraphrasing unit 22 extracts the corresponding second fragment from the second fragment field of a record having the above-mentioned one fragment registered in the first fragment field 211. Then, the paraphrasing unit 22 paraphrases (substitutes) the one fragment in the original text with the extracted second fragment to generate one paraphrase candidate for the original text.
Through the above operation, the paraphrase generator M receives an original text via the input unit 1, and generates one paraphrase candidate corresponding to the original text received via the input unit 1.
Next, the paraphrase generator M according to the first embodiment executes processing of paraphrase acceptability score to evaluate paraphrasing executed by the paraphrasing unit 22. Referring to
Next, in the paraphrase generator M, the paraphrase acceptability score processing unit 23 adds the acquired paraphrase acceptability score to the cumulative paraphrase acceptability score (zero being the initial value for each single original text) calculated in the previous round of paraphrasing to thereby calculate the cumulative paraphrase acceptability score resulting from the current round of paraphrasing (cumulative paraphrase acceptability score←cumulative paraphrase acceptability score+paraphrase acceptability score). Then, the paraphrase generator M outputs the paraphrase candidate input from the paraphrasing unit 22 and the calculated cumulative paraphrase acceptability score to the determination unit 24 (S22), and ends the processing of paraphrase acceptability score.
Through the above operation, in order to evaluate paraphrasing executed by the paraphrasing unit 22, the paraphrase generator M acquires the paraphrase acceptability score for the executed paraphrasing to calculate a cumulative paraphrase acceptability score. Determination of whether Paraphrasing is within Acceptable Limit
Next, the paraphrase generator M according to the first embodiment executes a determination of whether paraphrasing executed by the paraphrasing unit 22 is within an acceptable limit. Referring to
Next, in the paraphrase generator M, the determination unit 24 of the paraphrase generation unit 2 determines whether paraphrasing executed by the paraphrasing unit 22 is within an acceptable limit (S32). More specifically, the determination unit 24 determines whether the cumulative paraphrase acceptability score acquired from the paraphrase acceptability score processing unit 23 is equal to or less than the predetermined threshold (first threshold). If it is determined as a result of this determination that the cumulative paraphrase acceptability score is equal to or less than the predetermined threshold, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit (Yes). Thus, the paraphrase candidate generated by the current round of paraphrasing executed by the paraphrasing unit 22 is stored into the RAM or other memories (not illustrated) as a paraphrase, and the paraphrasing unit 22 is instructed to execute the next round of paraphrasing for a single original text (S33). This ends the determination of whether paraphrasing is within an acceptable limit. If it is determined as a result of the above determination that the cumulative paraphrase acceptability score exceeds the predetermined threshold, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit (No). Thus, the paraphrase candidate generated by the current round of paraphrasing executed by the paraphrasing unit 22 is not retained as a paraphrase, and the paraphrasing unit 22 is instructed to stop the subsequent executions of paraphrasing for a single original text. This ends the determination of whether paraphrasing is within an acceptable limit.
Through the above operation, the paraphrasing unit 22 executes a determination of whether paraphrasing is within an acceptable limit in order to evaluate paraphrasing executed by the paraphrasing unit 22.
When execution of paraphrasing by the paraphrasing unit 22 is stopped, the paraphrase generator M outputs the retained paraphrase from the output unit 3.
One specific example of the above operation will be described with reference to
First, at step S11, the original text OS1 illustrated in
Then, at step S21, a paraphrase acceptability score “0.1” is acquired from the paraphrase acceptability score field 213 of the retrieved record. At step S22, the cumulative paraphrase acceptability score resulting from the current round of paraphrasing is calculated from the acquired paraphrase acceptability score “0.1”. In the initial (first) round of paraphrasing, the cumulative paraphrase acceptability score is initialized to 0. Thus, the cumulative paraphrase acceptability score obtained at step S22 as a result of the first round of paraphrasing is equal to the paraphrase acceptability score “0.1” acquired at step S22 (cumulative paraphrase acceptability score←0+paraphrase acceptability score). The value “0.1” is illustrated in
Next, at step S31, the cumulative paraphrase acceptability score “0.1” calculated at step S22 is acquired. At step S32, it is determined whether the acquired cumulative paraphrase acceptability score “0.1” is equal to or less than the predetermined threshold of 1. In the initial round of paraphrasing, the cumulative paraphrase acceptability score “0.1” is equal to or less than the predetermined threshold of 1 as illustrated in
Thus, the second round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD6 in the original text OS1 is paraphrased with a second fragment SD22, a paraphrase candidate CS2 is generated, and a paraphrase acceptability score “0.1” and a cumulative paraphrase acceptability score “0.2” (=0.1+0.1) are obtained. The results are illustrated in
Thus, the third round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD2 in the original text OS1 is paraphrased with a second fragment SD23, a paraphrase candidate CS3 is generated, and a paraphrase acceptability score “0.3” and a cumulative paraphrase acceptability score “0.5” (=0.2+0.3) are obtained. The results are illustrated in
Thus, the fourth round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD4 in the original text OS1 is paraphrased with a second fragment SD24, a paraphrase candidate CS4 is generated, and a paraphrase acceptability score “0.4” and a cumulative paraphrase acceptability score “0.9” (=0.5+0.4) are calculated. The results are illustrated in
Thus, the fifth round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD3 in the original text OS1 (the second fragment SD21 in the paraphrase candidate CS4 that corresponds to the fragment SD3) is paraphrased with a second fragment SD25, a paraphrase candidate CS5 is generated, and a paraphrase acceptability score “0.2” and a cumulative paraphrase acceptability score “1.1” (=0.9+0.2) are obtained. The results are illustrated in
The differences in expression among the original text OS1, the paraphrase candidate CS1, and the paraphrase candidate CS2 in Japanese are similar to the differences in expression among the following corresponding texts in English.
Through the above operation, four paraphrase candidates CS1 to CS4 are generated as paraphrases of a single original text OS1, and output from the output unit 3.
As described above, the paraphrase generator M according to the first embodiment, the paraphrase generation method and the non-transitory recording medium having a computer program stored thereon that are respectively implemented and included in the paraphrase generator M allow one or more paraphrases of an original text to be generated by paraphrasing, within an acceptable limit, one or more of a plurality of fragments included in the original text into another expression in the language of the original text. Therefore, the paraphrase generator M, the paraphrase generation method, and the non-transitory recording medium having a computer program stored thereon allow one or more paraphrases to be created as example texts from a single original text. In particular, as will be described later, when used for creating a translation corpus with a collection of a plurality of text pairs each including a first text in a first language paired with a second text in a second language different from the first language, the paraphrase generator M, the paraphrase generation method, and the non-transitory recording medium having a computer program stored thereon allow the number of example texts (text pairs) in the translation corpus to be increased automatically.
Japanese Unexamined Patent Application Publication No. 2006-190072 mentioned above proposes an automatic paraphrasing apparatus, an automatic paraphrasing method, and a paraphrase processing program that are used to, for example, perform pre-processing in a machine translator to transform (paraphrase) an input original expression into another semantically equivalent expression suitable for subsequent processing. More specifically, the automatic paraphrasing apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2006-190072 includes the following components: an expression fragment memory that stores expression fragments that appear in a first set of example texts in a predetermined language, together with the frequency of each individual expression fragment in the first set of example texts; a paraphrase memory that stores one or more paraphrases for each of example texts contained in a second set of example texts in the predetermined language, together with paraphrase information indicative of the manner in which paraphrasing is applied to obtain the paraphrases; a paraphrase information memory that stores a plurality of pieces of paraphrase information indicative of the manner in which individual example texts in the second set of example texts are paraphrased into paraphrases, together with the frequency with which each individual piece of paraphrase information is applied; a retrieval unit that receives an original text to be paraphrased, and retrieves, from among paraphrases stored in the paraphrase memory, paraphrases that share, with the original text, at least one of the expression fragments stored in the expression fragment memory; an evaluation unit that evaluates a validity score of each individual paraphrase retrieved by the retrieval unit, with regard to paraphrasing between the retrieved paraphrase and the corresponding source example text and paraphrasing between the retrieved paraphrase and the original text, the validity score being calculated by a calculation method determined in advance based on the frequency of application of paraphrase information stored in the paraphrase information memory; and an original text paraphrasing unit that generates a paraphrase of the original text by back-applying, to the original text, paraphrasing information associated with a paraphrase whose validity score as evaluated by the evaluating unit satisfies a predetermined condition.
As described above, the automatic paraphrasing apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2006-190072 generates a paraphrase by paraphrasing an original expression input into a machine translator into an expression that is easy for the machine translator to translate. As such, the automatic paraphrasing apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2006-190072 generates only a single paraphrase for a single input text, and does not generate a plurality of paraphrases for a single input text. Further, the automatic paraphrasing apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2006-190072 does not add a generated paraphrase to a translation corpus, nor does the automatic paraphrasing apparatus generate a translation corpus. Therefore, Japanese Unexamined Patent Application Publication No. 2006-190072 neither discloses nor suggests the first embodiment mentioned above.
Further, Japanese Unexamined Patent Application Publication No. 2015-118498 mentioned above proposes a technique for creating similar texts for voice interactive systems. More specifically, the technique disclosed in Japanese Unexamined Patent Application Publication No. 2015-118498, which creates similar texts with the same intent, causes a computer to function as the following units: a seed text analysis unit that detects seed words related to each other in seed texts, the seed texts representing given texts with the same intent; a synonym search unit that searches a synonym database for one or more synonyms similar to each seed word; a seed word co-occurrence vector calculating unit that refers to a set of texts with the same intent to calculate a seed word co-occurrence vector with individual context words as vector elements, the seed word co-occurrence vector representing the frequency of each individual context word relevant to each seed word; a synonym co-occurrence vector calculating unit that refers to a large set of general texts to calculate a synonym co-occurrence vector with individual context words as vector elements, the synonym co-occurrence vector representing the frequency of each individual context word relevant to each synonym; a synonym selecting unit that selects a synonym with a synonym co-occurrence vector having a similarity equal to or greater than a predetermined threshold relative to the seed word co-occurrence vector for each seed word; and a similar text creating unit that creates similar texts in which each seed word and the synonyms co-occur.
As described above, Japanese Unexamined Patent Application Publication No. 2015-118498 relates to voice interactive systems, and is not intended for application to machine translation. Thus, the technique disclosed in Japanese Unexamined Patent Application Publication No. 2015-118498 does not create a translation corpus. Japanese Unexamined Patent Application Publication No. 2015-118498 is directed to creation of similar texts with the same intent, and thus a similar text created in this way is not necessarily the same in meaning as the corresponding source text. Further, in Japanese Unexamined Patent Application Publication No. 2015-118498 mentioned above, a synonym co-occurrence vector with a similarity equal to or greater than a predetermined threshold relative to the seed word co-occurrence vector for each seed word is used to select a synonym. In this regard, the similarity mentioned above is a measure of similarity between the seed word co-occurrence vector and the synonym co-occurrence vector. As such, this similarity measure is not equivalent to the acceptable limit for accepting paraphrasing, the paraphrase acceptability score, the cumulative paraphrase acceptability score, or other such measures according to the first embodiment mentioned above. Therefore, Japanese Unexamined Patent Application Publication No. 2015-118498 neither discloses nor suggests the first embodiment mentioned above.
In the first embodiment, a paraphrase acceptability score is assigned to each paraphrase pair of first and second fragments. Therefore, the paraphrase generator M, the paraphrase generation method, and the non-transitory recording medium having a computer program stored thereon described above enable quantitative comparison and assessment of paraphrase acceptability score and acceptable limit. Further, suppose that the paraphrase acceptability score is set to smaller values for more acceptable paraphrases. In this case, for example, when relatively small values are assigned in advance for the acceptability scores of certain types of paraphrase pairs, such as paraphrase pairs generally paraphrased with relatively high frequencies and paraphrase pairs of synonyms, this allows the paraphrase generator M, the paraphrase generation method, and the non-transitory recording medium having a computer program stored thereon to generate paraphrases that are substantially identical in meaning to the original text through quantitative comparison and assessment of paraphrase acceptability score and acceptable limit.
In the first embodiment, the paraphrase generation unit 2 determines whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit based on paraphrase acceptability score. Alternatively, the paraphrase generation unit 2 may further determine whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit based on linguistic acceptability score. That is, the determination of whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit may be made based on paraphrase acceptability score and linguistic acceptability score.
The paraphrase generation unit 2 according to this modification further includes a linguistic information storage unit 25 and a linguistic acceptability score processing unit 26 as indicated by broken lines in
The linguistic information storage unit 25 is connected to the linguistic acceptability score processing unit 26, and stores linguistic information. Linguistic information refers to information necessary for calculating a linguistic acceptability score. Linguistic information represents, for example, a language model, a semantic vector, or other such information built from a relatively large-scale data set. The first embodiment uses the language model as linguistic information. The linguistic acceptability score is a measure of the degree to which a paraphrase candidate generated by the paraphrasing unit 22 is accepted as having a linguistically correct meaning.
The linguistic acceptability score processing unit 26 is provided between the paraphrase acceptability score processing unit 23 and the determination unit 24, and connected to each of the paraphrase acceptability score processing unit 23 and the determination unit 24. The linguistic acceptability score processing unit 26 calculates, based on linguistic information stored in the linguistic information storage unit 25, the linguistic acceptability score of a paraphrase candidate generated by the paraphrasing unit 22 that is obtained via the paraphrase acceptability score processing unit 23. In the first embodiment, the linguistic acceptability score processing unit 26 determines, as the linguistic acceptability score of the paraphrase candidate, a language model, for example, an N-gram language model of the paraphrase candidate based on a language model stored in the linguistic information storage unit 25. The N-gram language model of a paraphrase candidate, which is a model of N-gram of N words including a fragment paraphrased by the paraphrasing unit 22, is determined by, for example, the (N-1) words preceding the fragment paraphrased by the paraphrasing unit 22 (N is an integer equal to or greater than 2). The linguistic acceptability score processing unit 26 may calculate, as the linguistic acceptability score of the paraphrase candidate, the semantic vector of the paraphrase candidate based on a semantic vector stored in the linguistic information storage unit 25. The linguistic acceptability score processing unit 26 outputs the calculated linguistic acceptability score to the determination unit 24.
As described above, the determination unit 24 is connected to the output unit 3, and determines whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit for accepting paraphrasing. According to this modification, in the determination process executed by the determination unit 24, the determination of whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit is made by using, in addition to a paraphrase acceptability score, a linguistic acceptability score indicating the degree to which a paraphrase candidate generated by the paraphrasing unit 22 is accepted as having a linguistically correct meaning. More specifically, in addition to a determination based on paraphrase acceptability score, the determination unit 24 further makes a determination of whether a linguistic acceptability score input from the linguistic acceptability score processing unit 26 is equal to or less than a predetermined threshold (second threshold). The predetermined threshold (second threshold) corresponds to the acceptable limit. For example, in the first embodiment, the predetermined threshold equates to the probability of a language model, and is thus set to suitable values such as 0.4, 0.5, and 0.6, for example, 0.5. If, as a result of this determination, the determination unit 24 determines that the linguistic acceptability score is equal to or less than 0.5, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit. If, as a result of this determination, the determination unit 24 determines that the linguistic acceptability score exceeds 0.5, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit.
The paraphrase generation unit 2 according to the modification executes the receiving and paraphrasing of an original text described above with reference to
The linguistic acceptability score processing illustrated in
Through the above operation, the paraphrase generation unit 2 according to the modification determines a linguistic acceptability score in order to linguistically evaluate a paraphrase candidate.
Determination of whether Paraphrasing is within Acceptable Limit
The determination of whether paraphrasing is within an acceptable limit illustrated in
Next, the determination unit 24 of the paraphrase generation unit 2 according to the modification determines whether paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit (S52 and S53).
More specifically, the determination unit 24 first determines whether the cumulative paraphrase acceptability score acquired from the paraphrase acceptability score processing unit 23 is equal to or less than the first threshold (S52). If it is determined as a result of this determination that the cumulative paraphrase acceptability score is equal to or less than the first threshold, the determination unit 24 determines that paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit (Yes), and executes the next step S53. If it is determined as a result of the above determination that the cumulative paraphrase acceptability score exceeds the first predetermined threshold, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit (No). Thus, the paraphrase candidate generated by the current round of paraphrasing executed by the paraphrasing unit 22 is not retained as a paraphrase, and the paraphrasing unit 22 is instructed to stop the subsequent executions of paraphrasing for a single original text. This ends the determination of whether paraphrasing is within an acceptable limit.
At step S53, the determination unit 24 determines whether the linguistic acceptability score acquired from the linguistic acceptability score processing unit 26 is equal to or greater than the second threshold. If it is determined as a result of this determination that the linguistic acceptability score is equal to or greater than the second threshold, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is within the acceptable limit (Yes). Thus, the paraphrase candidate generated by the current round of paraphrasing executed by the paraphrasing unit 22 is stored into the RAM or other memories (not illustrated) as a paraphrase, and the paraphrasing unit 22 is instructed to execute the next round of paraphrasing for a single original text (S54). This ends the determination of whether paraphrasing is within an acceptable limit. If it is determined as a result of the above determination that the linguistic acceptability score is below the second threshold, the determination unit 24 determines that the paraphrasing executed by the paraphrasing unit 22 is not within the acceptable limit (No). Thus, the paraphrase candidate generated by the current round of paraphrasing executed by the paraphrasing unit 22 is not retained as as a paraphrase, and the paraphrasing unit 22 is instructed to stop the subsequent executions of paraphrasing for a single original text. This ends the determination of whether paraphrasing is within an acceptable limit.
Through the above operation, the paraphrase generation unit 2 according to the modification executes a determination of whether paraphrasing is within an acceptable limit in order to evaluate paraphrasing executed by the paraphrasing unit 22.
When execution of paraphrasing by the paraphrasing unit 22 is stopped, the paraphrase generator M outputs the retained paraphrase from the output unit 3.
One specific example of the above operation will be described with reference to
First, the original text OS1 illustrated in
Next, at step S51, the cumulative paraphrase acceptability score “0.1” determined at step S22 and the linguistic acceptability score “0.8” calculated at step S42 are acquired. Then, at step S52, it is first determined whether the acquired cumulative paraphrase acceptability score “0.1” is equal to or less than the first threshold of 1. In the initial round of paraphrasing, the cumulative paraphrase acceptability score “0.1” is equal to or less than the first threshold of 1 as illustrated in
Thus, the second round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD6 in the original text OS1 is paraphrased into the second fragment SD22, the paraphrase candidate CS2 is generated, and a paraphrase acceptability score “0.1”, a cumulative paraphrase acceptability score “0.2”, and a linguistic acceptability score “0.9” are obtained. The results are illustrated in
Thus, the third round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD2 in the original text OS1 is paraphrased into the second fragment SD23, the paraphrase candidate CS3 is generated, and a paraphrase acceptability score “0.3”, a cumulative paraphrase acceptability score “0.5”, and a linguistic acceptability score “0.7” are obtained. As illustrated in
Thus, the fourth round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD4 in the original text OS1 is paraphrased into the second fragment SD24, the paraphrase candidate CS4 is generated, and a paraphrase acceptability score “0.4”, a cumulative paraphrase acceptability score “0.9”, and a linguistic acceptability score “0.8” are obtained. The results are illustrated in
Thus, the fifth round of paraphrasing is executed in the same manner as described above. As a result, the fragment SD1 in the original text OS1 is paraphrased with a second fragment SD26, a paraphrase candidate CS6 is generated, and a paraphrase acceptability score “0.1”, a cumulative paraphrase acceptability score “1.0”, and a linguistic acceptability score “0.01” are obtained. As illustrated in
Through the above operation, four paraphrase candidates CS1 to CS4 are generated as paraphrases of a single original text OS1, and output from the output unit 3.
Now, suppose that, in the example illustrated in
The paraphrase generator M including the paraphrase generation unit 2 according to the modification, and the paraphrase generation method and the non-transitory recording medium having a computer program stored thereon that are respectively implemented and included in the paraphrase generator M make it possible to reduce the possibility that a paraphrase candidate that no longer has a linguistically correct meaning as a result of paraphrasing is retained as a paraphrase, thus allowing more linguistically appropriate paraphrases to be obtained.
In the first embodiment, the paraphrase generator M may be further configured to create a translation corpus. As indicated by dashed lines in
The translation corpus storage unit 5 stores a translation corpus. The translation corpus is a collection of a plurality of text pairs each having a first text in a first language paired with a second text in a second language different from the first language.
The translation corpus creation unit 4 is connected to each of the input unit 1, the paraphrase generation unit 2, and the translation corpus storage unit 5. The translation corpus creation unit 4 creates a translation corpus, and stores the created translation corpus into the translation corpus storage unit 5.
In the paraphrase generator M according to this modification, the input unit 1 receives an original text and a second text, with the original text serving as a first text in the translation corpus. The input unit 1 outputs the received original text to the paraphrase generation unit 2, and outputs the received second text to the translation corpus creation unit 4.
The paraphrase generation unit 2 generates, through the above-mentioned processes, one or more paraphrases of the original text received by the input unit 1, and outputs the generated one or more paraphrases to each of the output unit 3 and the translation corpus creation unit 4.
Then, the translation corpus creation unit 4 creates a translation corpus based on the one or more paraphrases generated by the paraphrase generation unit 2, and the second text received by the input unit 1, and stores the generated translation corpus into the translation corpus storage unit 5. More specifically, the translation corpus creation unit 4 creates one or more new text pairs by pairing the one or more paraphrases of the original text generated by the paraphrase generation unit 2 with the second text received by the input unit 1. The created one or more new text pairs form a new part of the translation corpus stored in the translation corpus storage unit 5. For example, an original text OS11 as a first text, and a second text OS12 are input as a text pair. Alternatively, a translation corpus including the original text OS11 as a first text, and a text OS21 as a second text is input. When two paraphrases CS21 and CS22 are generated from the single original text OS11, a new text pair of the paraphrase CS21 and the second text OS12, and a new text pair including the paraphrase CS22 and the second text OS12 are created. The two new text pairs form a new part of the translation corpus stored in the translation corpus storage unit 5.
A text pair including an original text, which serves as a first text, and a second text, which is received by the input unit 1, may be either a text pair included in the translation corpus stored in the translation corpus storage unit 5, or a text pair not included in the translation corpus stored in the translation corpus storage unit 5. If an original text serving as a first text and a second text that are received as a text pair by the input unit 1 are paired texts not included in the translation corpus stored in the translation corpus storage unit 5, the input unit 1 outputs the received text pair including the original text serving as a first text and a second text to the translation corpus creation unit 4. The translation corpus creation unit 4 may retain this text pair including the original text as a first text and a second text as a new text pair forming a new part of the translation corpus stored in the translation corpus storage unit 5.
The paraphrase generator M according to this modification, and the paraphrase generation method and the non-transitory recording medium having a computer program stored thereon that are respectively implemented and included in the paraphrase generator M allow the number of example texts (text pairs) in a translation corpus to be increased automatically, thus allowing for creation of a translation corpus with a greater number of example texts (text pairs).
In the first embodiment, the paraphrasing unit 22 executes paraphrasing of a first fragment into a second fragment at all times. Alternatively, the paraphrasing unit 22 may not execute paraphrasing of a first fragment into a second fragment depending on a predetermined condition. Such a condition for not executing paraphrasing (Exclude condition) is, for example, registered in a paraphrase table CTa as illustrated in
As opposed to the paraphrase table CT illustrated in
Next, another embodiment will be described.
As illustrated in
The translator T translates a source text, which is a text to be translated, between a first language and a second language based on a translation corpus created by the paraphrase generator M according to the modification that includes the translation corpus creator C. The translator T includes, for example, a learning unit 6, a translation unit 7, a second input unit 8, and a second output unit 9.
The second input unit 8 is connected to the translation unit 7. For example, the second input unit 8 is a device used to input, into the translator T, information including various commands, such as a command that instructs translation to be started, and various data necessary for translating, for example, a source text in a first language. For example, the second input unit 8 is an input device such as a keyboard or a mouse. Alternatively, the second input unit 8 may be, for example, an interface unit. The second output unit 9 is connected to the translation unit 7. The second output unit 9 is a device that outputs information, such as commands or data input from the second input unit 8, and a translated text in a second language translated by the translation unit 7. For example, the second input unit 8 is a display device such as a CRT display, a liquid crystal display (LCD), or an organic EL display, or a printing device such as a printer. The second input unit 8 and the second output unit 9 may form a touch panel. The second input unit 8 may double as the input unit (first input unit) 1, and the second output unit 9 may double as the output unit (first output unit) 3.
The learning unit 6 is connected to the translation unit 7. The learning unit 6 generates or learns a translation model for the translation unit 7 by use of a translation corpus created by the paraphrase generator M according to the modification including the translation corpus creator C.
The translation unit 7 translates a source text in a first language received by the second input unit 8 into a text in a second language to generate a translated text in the second language, and outputs the generated translated text to the second output unit 9.
The translator T including the units 6 to 9 mentioned above is implemented by, for example, an information processor such as a desktop, notebook, or tablet computer.
In the machine translation system S configured as mentioned above, the paraphrase generator M according to the modification including the translation corpus creator C creates a translation corpus (new translation corpus) including new text pairs generated through the operations described above with reference to the first embodiment. Then, the learning unit 6 acquires the created new translation corpus, and uses the acquired new translation corpus to create or learn a translation model for the translation unit 7. As described above with reference to the first embodiment, the new translation corpus contains more example texts, thus allowing a translation model for the translation unit 7 to be generated and learned with improved accuracy. When a source text is received from the second input unit 8, and the translation unit 7 is instructed to perform translation, the translation unit 7 translates the source text, and outputs the translated text to the second output unit 9. Since the translation model for the translation unit 7 is generated or learned with improved accuracy as described above, the translation unit 7 is able to translate the learning unit 6 with improved accuracy.
The machine translation system S configured as described above includes the paraphrase generator M that implements the paraphrase generation method and includes the non-transitory recording medium having a computer program stored thereon. This allows the machine translation system S to create one or more paraphrases from a single original text. Further, the machine translation system S includes the translation corpus creator C. Thus, with the original text as a first text, the machine translation system S is able to create one or more new text pairs by pairing one or more paraphrases of the original text with a second text, and create a new translation corpus with the new text pairs contained as a new part of the translation corpus. Therefore, the machine translation system S allows the number of example texts (text pairs) in the translation corpus to be increased automatically. This enables creation of a translation corpus with more example texts (text pairs), thus allowing for more accurate translation.
In the second embodiment, the paraphrase acceptability score may be varied by a feedback process that takes the translated text output to the second output unit 9 into consideration.
For example, as illustrated in
As a result, the paraphrase acceptability score for the paraphrasing that has led to a correct translation (first fragment→second fragment) is lowered so that this paraphrasing is accepted to a greater degree, whereas the paraphrase acceptability score for the paraphrasing that has not led to a correct translation (second fragment→first fragment) (that is, the paraphrase acceptability score for the paraphrasing applied in a direction opposite (second fragment→first fragment) to the paraphrasing that has led to a correct translation (first fragment→second fragment)) is increased so that this paraphrasing is accepted to a lesser degree. This enables the paraphrase generator M to create example texts (paraphrases) for a translation corpus that allow for more accurate translation.
Among the various aspects of the techniques disclosed herein, major aspects are summarized as follows.
In one aspect, the techniques feature a paraphrase generation method including receiving, with a processor, an original text, generating, with the processor, one or more paraphrases of the original text by paraphrasing, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in the original text into another expression in the language of the original text, the plurality of fragments being obtained by dividing the original text in accordance with a predetermined rule. In another preferred aspect, in the paraphrase generation method mentioned above, the generating of the one or more paraphrases includes paraphrasing one of the one or more fragments included in the original text into another expression in the language of the original text to generate a paraphrase candidate for the original text, and determining whether the paraphrasing is within the acceptable limit, the paraphrasing is executed until the determining determines that the paraphrasing is not within the acceptable limit, and the determining includes determining, as the one or more paraphrases, the paraphrase candidate generated by the paraphrasing that is determined to be within the acceptable limit.
The paraphrase generation method mentioned above paraphrases, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in an original text into another expression in the language of the original text to thereby generate one or more paraphrases of the original text. Therefore, the paraphrase generation method allows one or more paraphrases to be created as example texts from a single original text.
In another aspect, in the paraphrase generation method mentioned above, the determining includes determining whether the paraphrasing is within the acceptable limit based on a paraphrase acceptability score, the paraphrase acceptability score being assigned to a paraphrase pair including a first fragment and a second fragment that represents another expression of the first fragment, the paraphrase acceptability score indicating a degree to which paraphrasing from the first fragment into the second fragment is accepted.
With the paraphrase generation method mentioned above, a paraphrase acceptability score, which indicates the degree to which paraphrasing from the first fragment to the second fragment is accepted, is assigned in advance to each paraphrase pair including the first and second fragments. Therefore, the paraphrase generation method mentioned above allows for a quantitative comparison and assessment of paraphrase acceptability score and acceptable limit. Further, suppose that the paraphrase acceptability score is set to smaller values for more acceptable paraphrases. In this case, for example, the paraphrase generation method assigns relatively small values in advance for the acceptability scores of certain types of paraphrase pairs, such as paraphrase pairs generally paraphrased with relatively high frequencies and paraphrase pairs of synonyms, thus allowing for generation of paraphrases that are substantially identical in meaning to the original text through quantitative comparison and assessment of paraphrase acceptability score and acceptable limit.
In another aspect, in the paraphrase generation method mentioned above, the determining includes determining whether the paraphrasing is within the acceptable limit further based on a linguistic acceptability score, the linguistic acceptability score indicating a degree to which the paraphrase candidate generated by the paraphrasing is accepted as having a linguistically correct meaning. In a preferred implementation, in the paraphrase generation method mentioned above, the linguistic acceptability score represents a language model of the paraphrase candidate. In another preferred implementation, in the paraphrase generation method mentioned above, the linguistic acceptability score represents a semantic vector of the paraphrase candidate.
The paraphrase generation method mentioned above includes determining whether paraphrasing is within the acceptable limit further based on a linguistic acceptability score, which is a measure of the degree to which a paraphrase candidate is accepted as having a linguistically correct meaning. Therefore, the paraphrase generation method makes it possible to reduce the possibility that a paraphrase candidate that no longer has a linguistically correct meaning as a result of paraphrasing is retained as a paraphrase, thus allowing more linguistically appropriate paraphrases to be obtained.
In another aspect, the paraphrase generation method mentioned above further includes creating a translation corpus that includes a collection of a plurality of text pairs, the plurality of text pairs each including a first text in a first language paired with a second text in a second language. The receiving includes further receiving the second text, with the original text being the first text. The creating of the translation corpus includes creating one or more new text pairs, the one or more new text pairs each including the received second text and the one or more paraphrases of the original text that are generated by the generating of the one or more paraphrases. The one or more new text pairs thus created form a new part of the translation corpus.
The paraphrase generation method mentioned above further includes creating a translation corpus. The creating of a translation corpus includes creating one or more new text pairs that each include, with the original text being the first text, the one or more paraphrases of the original text and the second text. The created one or more new text pairs thus created form a new part of the translation corpus. Thus, the paraphrase generation method mentioned above allows the number of example texts (text pairs) in the translation corpus to be increased automatically. This enables creation of a translation corpus with more example texts (text pairs).
In another aspect, the techniques feature an apparatus including a processor, and a medium having a computer program stored thereon. The computer program causes the processor to execute operations including receiving an original text, and generating one or more paraphrases of the original text by paraphrasing, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in the original text into another expression in the language of the original text, the plurality of fragments being obtained by dividing the original text in accordance with a predetermined rule.
In another aspect, the techniques feature a non-transitory recording medium having a computer program stored thereon, the computer program causing a processor to execute operations including receiving an original text, and generating one or more paraphrases of the original text by paraphrasing, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in the original text into another expression in the language of the original text, the plurality of fragments being obtained by dividing the original text in accordance with a predetermined rule.
The paraphrase generation method and the non-transitory recording medium having a computer program stored thereon mentioned above paraphrases, within an acceptable limit for accepting paraphrasing, one or more of a plurality of fragments included in an original text into another expression in the language of the original text to thereby generate one or more paraphrases of the original text. Therefore, the paraphrase generator and the non-transitory recording medium having a computer program stored thereon allow one or more paraphrases to be created as example texts from a single original text.
In another aspect, the techniques feature a machine translation system including a paraphrase generator that receives an original text, and generates one or more paraphrases of the original text, a translation corpus creator that creates a translation corpus including a collection of a plurality of text pairs, the plurality of text pairs each including a first text in a first language paired with a second text in a second language different from the first language, and a translator that translates a source text between the first language and the second language based on the translation corpus created by the translation corpus creator, the source text representing a text to be translated. The translation corpus creator creates one or more new text pairs, the one or more new text pairs each including the second text and the one or more paraphrases of the original text that are generated by the paraphrases generator with the original text being the first text. The one or more new text pairs thus created form a new part of the translation corpus. The paraphrase generator implements any one of the paraphrase generation methods mentioned above.
The machine translation system configured as described above includes the paraphrase generator that implements any one of the paraphrase generation methods mentioned above. This allows the machine translation system to create one or more paraphrases from a single original text. Further, the machine translation system includes the translation corpus creator. Thus, with the original text being the first text, the machine translation system is able to create one or more new text pairs by pairing one or more paraphrases of the original text with the second text. The one or more new text pairs thus created form a new part of the translation corpus. Therefore, the machine translation system mentioned above allows the number of example texts (text pairs) in the translation corpus to be increased automatically. This enables creation of a translation corpus with more example texts (text pairs), thus allowing for more accurate translation.
Although the present disclosure has been described above in appropriate and sufficient detail by way of its embodiments with reference to the drawings in order to aid in understanding the present disclosure, it is to be noted that those skilled in the art will readily make adaptations and/or improvements to the above embodiments. Therefore, any adaptations or modifications made by those skilled in the art are to be construed to fall within the scope of the claims as set forth herein, unless such adaptations or modifications depart from the scope of the claims.
The present disclosure makes it possible to provide a paraphrase generation method, a paraphrase generator, and a non-transitory recording medium having a computer program stored thereon that allow one or more paraphrases to be created from a single original text, and a machine translation system that includes or implements the same.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2016-017110 | Feb 2016 | JP | national |
