1. Field
Implementations of the present invention relate to natural language processing. In particular, implementations relate to classifying, and also to clustering and filtering of text-centric documents written in one or more languages.
2. Description of the Related Art
The modern man has to deal every day with huge volume of new information. Also, corporations, agencies and libraries must receive and process a lot of text and text resources. Information is presented in many forms including texts, resources and references, print (e.g., newspapers and magazines), Internet sources (e.g., videos, audio programs), etc. Selection, cataloguing and filtering of information is an important task in managing information overload. Sometimes texts must be selected based on some feature or a plurality of a tightly defined set of features. Other times there is a need to find texts that are similar to a given text. Yet other times, there is a need to form groups or classes of texts according to a set of criteria. Text-based information which a person or organization must use may originate from many countries and may be written in different languages. Known mathematical methods of classifying and clustering objects that have been adopted for solving these tasks are insufficient to adequately cope with information overload.
Many natural language processing systems involve classifying texts into predefined categories. For example, in order to sort the huge amount of news available online into some meaningful categories, e.g., politics, cultural events, sporting events, etc., a text classification method may be applied. Other tasks related to text processing include clustering and filtering.
Nowadays, there is a great desire to be able to analyze multi-language data. However, existing text processing systems are usually language-dependent, i.e., they are able to analyze text written only in one particular language and cannot readily be ported to address another language.
The very few existing cross-language systems are based on machine translation techniques. These systems generally choose a so called target language, translate all documents to that language with machine translation techniques, and then construct document representations and apply classification. Such machine translation creates additional errors not found in the source material and, moreover, the analysis is usually based on low-level properties of documents, and the meanings of documents are not reflected in the utilized representation or translation.
Thus, it is possible to create systems that can improve cross-language document processing, including classification, clustering and filtering, systems that can take into account not only the symbolic information found in sources, but systems that address semantics, i.e., meaning, of documents.
Methods are described for performing clustering or classification of texts of different languages. Language-independent semantic structures (LISS) are constructed before clustering is performed. These structures reflect lexical, morphological, syntactic, and semantic properties of texts. The methods suggested are able to perform cross-language text clustering which is based on the meaning derived from texts. The methods are applicable to genre classification, topic detection, news analysis, authorship analysis, internet searches, and creating corpora for other tasks, etc.
While the appended claims set forth the features of the present invention with particularity, the invention, together with its objects and advantages, will be more readily appreciated from the following detailed description, taken in conjunction with the accompanying drawings, wherein:
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the invention. It will be apparent, however, to one skilled in the art that the invention can be practiced without these specific details.
Reference in this specification to “one embodiment” or “an implementation” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase “in one embodiment” or “in one implementation” in various places in the specification are not necessarily all referring to the same embodiment or implementation, nor are separate or alternative embodiments mutually exclusive of other embodiments. Moreover, various features are described which may be exhibited by some embodiments and not by others. Similarly, various requirements are described which may be requirements for some embodiments but not other embodiments.
Implementations of the present invention disclose techniques for cross-language natural language text processing such as text classification, clustering and filtering based on exhaustive syntactic and semantic analyses of texts and language-independent semantic structures. A lot of lexical, grammatical, syntactical, pragmatic, semantic and other features of the texts may be identified, extracted and effectively used to solve said tasks.
A classifier is an instrument to perform classification. One implementation of document classification may be formulated as follows: given a finite set of categories {C1, C2, . . . , Cn} and an input document D, a classifier has to assign the document D to one (or more) of the categories {C1, C2, . . . , Cn} or produce an output representing a set of pairs (a so called classification spectrum) {(C1, w1), (C2, w2), . . . , (Cn, wn)}, where for each integer i from 1 to n, Ci is the category and wi is a weight (e.g., a real number in the interval [0,1]) defining to which extend the document D belongs to the category Ci. A threshold value may be defined in order to omit the categories with low weights below the threshold. For example, given the following categories {Sport, TV, Business, Art} and a document to be classified describing a TV show about football, an adequate classifier could produce the following classification spectrum for the document {(Sport, 0.7), (TV,0.8), (Business,0.2), (Art,0.05)}. If the threshold is 0.3, only sport and TV categories will be considered.
Classification is a task of supervised learning, i.e., supervised (training) data is required. Training data is a set of labeled documents, i.e., each document is labeled with its category or classification spectrum. By analyzing this labeled data, a so called classification function or classification model is defined. This function or model should predict an output (category or a classification spectrum) for an input document.
Many natural language processing (NLP) problems may be formulated as a task of classification. For example, authorship attribution is a problem of assigning authors to anonymous texts, the authors are to be chosen out of a predefined list of possible authors. For each possible author, one or more documents written by the author are available. Thus, these documents are the training data and a classifier may be trained in order to assign an author to the anonymous texts. Another problem formulated as a task of classification is determining a document's genre or topic(s) out of lists of possible genres and topics when training data are available for each genre or topic.
Classification is usually performed on documents represented as vectors of so called features. Features represent characteristics of the documents to be classified and should reflect essential characteristics for the particular task. The naïve approach is to create features out of words: each word in a document may be a feature, thus vectors containing frequencies of each word may be utilized in classification. Another common way to create this vector space model is term frequency—inverted document frequency (TF-IDF) document representation (such as described by Salton, 1988), in this approach a value in a document vector is not only proportional to the corresponding word frequency in the document but is also inversely proportional to its frequency in the entire document corpus. Thus, those words that are frequently found in documents (e.g., and, but, the, a, etc.) do not get high values.
Another task of processing huge collections of texts is clustering. Clustering is the task of attributing or sorting objects into groups (clusters) so that objects in the same cluster are more similar to each other than to those in other clusters. The clusters may be presented as conglomerations of points in n-dimensional space, where n is the number of features which are used for attributing.
As distinct from classifying, clustering may executed without training, without samples, representing groups. Clustering is one of the tasks traditionally associated with data mining, and common techniques for statistical data analysis may be used to indicate similar objects.
The task of clustering can be solved by various algorithms that differ significantly in their notion of what constitutes a cluster and how to efficiently find them. The most general way of searching clusters is to find groups with low “distances” among or between the cluster members, dense areas of the data space, intervals or particular statistical distributions. The proper algorithm of clustering and selection of parameters (including distance function, a density threshold or the number of expected clusters) depend on the individual data set and the goal or goals of clustering. In case of texts, there is a wide diapason of features which can be used for this purpose.
In practice, the task of clustering across languages usually is an iterative process of knowledge discovery and interactive multi-objective optimization. It will often be necessary to modify preprocessing and parameters, and modify the selection of features until the results exhibit the desired properties.
Still another task of cross-language processing huge collections of texts is filtering. It consists of selecting texts by one or more criteria. The simple examples of such task may be filtering by author, by title, by topic, by word or group of words, by date of issue or source, by geographical source, etc. A more complex tasks of filtering may be formulated on the basis of using deeper properties of texts, the properties related to their lexical, syntactic and semantic features of the texts. For example, tasks related to sentiment analysis may consist in a selection of documents that reflect a specific attitude of an author to a subject. It can be expressed in different ways, for example, by lexical means, but it is difficult to say a priori which words might be used by authors. On the other hand, filtering allows one to avoid results where documents exhibit some chosen criteria.
Some widely used features that can be used are primarily lexical and character features, those that consider a text as a sequence of words and characters respectively. Namely, word frequencies, n-grams, letter frequencies, character n-grams, etc. A big advantage of these features is that they are easy to be extracted automatically. But they are language dependent and do not capture a document's semantics. Therefore, these lexical-based features do not allow performing cross-language, semantically rich, document analysis.
Language independent features of a text capture not only the symbolic information but semantics of a text often appear to be more promising for solving various tasks. For example, certain tasks associated within authorship analysis systems are promising since many authors write in different languages or their texts are translated. A language independent system could fairly compare authors across different languages. Features of the original author can be lost in translation. Language independent systems should capture an author's writing style when an author's work is translated. Language independent systems would also be highly useful to group online news by topic across languages, since there is a big amount of news written in different languages, and increasingly news can be accessed easily in text and other formats through the Internet.
Previous cross-language systems do not provide accurate extraction of language independent semantically rich features of text. Therefore these systems were not exploited or adopted. Existing systems for text document processing are limited to analyzing documents written in a single language, and systems that attempt to process across languages fail to address or analyze semantically rich features of text. However, for some tasks such as topic detection in online news or authorship attribution of translated texts, cross-language analysis techniques are required. The existing systems dealing with documents written in different languages usually translate them to one particular language (e.g., English, Russian, Mandarin) with machine translating systems and then apply classification. Therefore syntactic and semantic properties of the source sentences are not taken into account.
Advantageously, the problems associated with existing text processing systems are overcome—or at least reduced—by the techniques and systems disclosed herein.
Implementations of the invention allow a user to perform classification, clustering and filtering of natural language texts written in one or many natural languages. The techniques are particularly effective for searching across many natural languages. The disclosed methods take into account lexical, grammatical, syntactical, pragmatic, semantic and other features of texts.
The features are extracted during an exhaustive analysis of each sentence and constructing language-independent semantic structures. Such exhaustive analysis precedes classification, clustering and/or filtering texts. The system employs automatic syntactic and semantic analyses to determine and to extract lexical, grammatical, syntactical, pragmatic, semantic and other features for their further using in processing texts. Then, the system indexes based on the extracted information, and stores syntactic and semantic information about each sentence, as well as parses results and lexical choices including results obtained when resolving ambiguities. The system analyzes sentences using linguistic descriptions of a given natural language to reflect the real complexities of the natural language, rather than simplified or artificial descriptions. The system functions based on the principle of integral and purpose-driven recognition, where hypotheses about the syntactic structure of a part of a sentence are verified within the hypotheses about the syntactic structure of the whole sentence. It avoids analyzing numerous parsing of anomalous variants.
An index usually comprises and may be represented as a table where each value of a feature (for example, a word, expression, or phrase) in a document is accompanied by a list of numbers or addresses of its occurrence in that document. According to embodiments of the present invention, morphological, syntactic, lexical, and semantic features can be indexed in the same fashion as each word in a document is indexed. In one embodiment of the present invention, indexes may be produced to index all or at least one value of morphological, syntactic, lexical, and semantic features (parameters). These parameters or values are generated during a two-stage semantic analysis described in more detail below. The index may be used to facilitate such operations of natural language processing such as semantic searching, classifying, clustering and filtering of cross-language documents. As used herein, cross-language documents include those documents that address a common topic and that are in different languages.
In one implementation, said linguistic descriptions include a plurality of linguistic models and knowledge about natural languages. These may be arranged in a database and applied for analyzing each text or source sentence such as at step 106. Such a plurality of linguistic models may include, but are not limited to, morphology models, syntax models, grammar models and lexical-semantic models. In a particular implementation, integral models for describing the syntax and semantics of a language are used in order to recognize the meanings of the source sentence, analyze complex language structures, and correctly convey information encoded in the source sentence.
Accordingly, a rough syntactic analysis is performed on the source sentence to generate a graph of generalized constituents 232 for further syntactic analysis. All reasonably possible surface syntactic models for each element of lexical-morphological structure are applied, and all the possible constituents are built and generalized to represent all the possible variants of parsing the sentence syntactically.
Following the rough syntactic analysis, a precise syntactic analysis is performed on the graph of generalized constituents to generate one or more syntactic trees 242 to represent the source sentence. In one implementation, generating the syntactic tree 242 comprises choosing between lexical options and choosing between relations from the graphs. Many prior and statistical ratings may be used during the process of choosing between lexical options, and in choosing between relations from the graph. The prior and statistical ratings may also be used for assessment of parts of the generated tree and for the whole tree. In one implementation, the one or more syntactic trees may be generated or arranged in order of decreasing assessment. Thus, the best syntactic tree may be generated first. Non-tree links are also checked and generated for each syntactic tree at this time. If the first generated syntactic tree fails, for example, because of an impossibility to establish non-tree links, the second syntactic tree is taken as the best, etc.
Many lexical, grammatical, syntactical, pragmatic, semantic features are extracted during the steps of these steps of analysis. For example, the system can extract and store lexical information and information about belonging lexical items to semantic classes, information about grammatical forms and linear order, about syntactic relations and surface slots, using predefined forms, aspects, sentiment features such as positive-negative relations, deep slots, non-tree links, semantemes, etc.
With reference to
With reference to
The analysis methods ensure that the maximum accuracy in conveying or understanding the meaning of the sentence is achieved.
With reference to
Referring to
The language-independent semantic structure (LISS) of a sentence is represented as acyclic graph (a tree supplemented with non-tree links) where each word of specific language is substituted with its universal (language-independent) semantic notions or semantic entities referred to herein as “semantic classes”. Semantic class is one of the most important semantic features that can be extracted and used for tasks of classifying, clustering and filtering text documents written in one or many languages. The other features usable for such task may be semantemes, because they may reflect not only semantic, but also syntactical, grammatical, etc. language-specific features in language-independent structures.
The semantic classes, as part of linguistic descriptions, are arranged into a semantic hierarchy comprising hierarchical parent-child relationships. In general, a child semantic class inherits many or most properties of its direct parent and all ancestral semantic classes. For example, semantic class SUBSTANCE is a child of semantic class ENTITY and at the same time it is a parent of semantic classes GAS, LIQUID, METAL, WOOD_MATERIAL, etc.
Each semantic class in the semantic hierarchy is supplied with a deep model. The deep model of the semantic class is a set of deep slots. Deep slots reflect the semantic roles of child constituents in various sentences with objects of the semantic class as the core of a parent constituent and the possible semantic classes as fillers of deep slots. The deep slots express semantic relationships between constituents, including, for example, “agent”, “addressee”, “instrument”, “quantity”, etc. A child semantic class inherits and adjusts the deep model of its direct parent semantic class.
With reference to
Semantic descriptions 104 are language-independent. Semantic descriptions 104 may provide descriptions of deep constituents, and may comprise a semantic hierarchy, deep slots descriptions, a system of semantemes, and pragmatic descriptions.
With reference to
With reference to
Also, any element of language description 610 may be extracted during an exhaustive analysis of texts, and any element may be indexed (the index for the feature are created). The indexes or indices may be stored and used for the task of classifying, clustering and filtering text documents written in one or more languages. Indexing of semantic classes is important and helpful for solving these tasks. Syntactic structures and semantic structures also may be indexed and stored for using in semantic searching, classifying, clustering and filtering.
For the task of clustering a set of features and at least one criterion should be selected, the criterion may define a similarity of documents. The set of the features should include at least one feature.
One classification and/or clustering problem is based on the concept of similarity. There are many ways to calculate similarity between two texts. One naïve way to find out if two texts are similar is to count how many words they have in common. There are also more advanced versions of this approach such as techniques involving lemmatization, stemming, weighting, etc. For example, a vector space model (G. Salton, 1975) may be built, and vector similarity measures, such as e.g. cosine similarity, may be utilized. During the text processing described here, documents may be represented with language independent semantic classes that in their turn may be considered as lexical features. Therefore, the similarity measures as were mentioned above may be used.
Such similarity measures have a drawback in that they do not actually capture the semantics. For example, the two sentences, “Bob has a spaniel” and “Richard owns a dog” are semantically similar but they do not share any words but an article. Therefore, a mere lexical text similarity measure will fail to find that these sentences are similar. To capture this type of similarity, knowledge-based semantic similarity measures may be used. They require a semantic hierarchy to be calculated. Similarity between two words usually depends on a shortest path between corresponding concepts in a corresponding semantic hierarchy. For example, “spaniel” in the semantic hierarchy corresponding to the first sentence above appears as a child node (hyponym) of “dog”, therefore semantic similarity between the concepts will be high. Word-to-word similarity measures may be generalized to text-to-text similarities by combining values for similarities of each word pair. Semantic classes described here represent nodes of semantic hierarchy. Therefore, knowledge-based semantic similarity measures described above and their generalizations to text-to-text similarity measures may be utilized within document processing.
Creating clusters of texts may be known, but usual or known systems of clustering use language-dependent parameters (for example, a set of key words), which are most representative for the texts. The present invention allows one to use for this purpose semantic classes and other semantic attributes. For example, referring to the present invention, a list of semantic classes {C1, C2, . . . Cm} may be considered as a document representation 1104. Since lexical meanings may be expressed in different words, a semantic class may unite several close lexical meanings; a semantic class embodies the idea of generalization. Synonyms and derivates are generalized. If we deal with texts in different languages, a semantic class generalizes lexical meanings of texts in different languages. In one embodiment, the frequency of the same semantic classes may be used as the criterion for clustering. In another embodiment, the frequency of “near located” semantic classes may be also used as a criterion.
The notion of “near located” semantic classes as a similarity measure may be interpreted in different ways. In the present invention, semantic classes are organized into a semantic hierarchy. So, there are several types of relationships which may link two semantic classes, for example, “parent—child”, “grandparent—grandchild”, “brothers”, “nephew”, “cousin”, etc. Figuratively speaking, “degree of kinship” or a distance in the semantic hierarchy may define the similarity measure between two semantic classes. More exactly, the distance and inheritance (generally speaking) are taken into account in one embodiment of invention to measure the similarity of two semantic classes, and it may be used to get a similarity measure for the task of clustering text documents. In another embodiment, the similarity measure for the task of clustering text documents may be defined on the basis of frequency of the same (or “near located”) semantic classes.
In one embodiment, the similarity measure for two or more documents may be defined heuristically or on the basis of experience. For example, if there are 2 documents—D1 and D2. After semantic analysis, there may be two sets of semantic classes {C11, C12, . . . C1n}{C21, C22, . . . C2m}, which are selected as most representative for these 2 texts. The principle of the choice may be different, for example most frequent classes may be selected. Each class may be supplied by or with a coefficient of the frequency Fij in the document. Most frequent semantic classes in a language may be excluded. These classes include such words (in English) as “the” and other articles that frequently appear in text. Most common semantic classes (like ENTITY, ABSRACT_SCIENTIFIC_OBJECT, etc.) also may be discarded. Then, a similarity measure depends on:
a) a number of cases when C1i=C2j, maybe, with taking into account the frequency of objects (words) of C1i and C2j in the language, e.g., a number objects of the same class are found in the both documents; and
b) a number of cases when C1i and C2j are “near relations”. For each pair (C1i, C2j) the common ancestor C0 is found. Let's p(C0) is a probability to find objects of C0 and all his descendants in the corpora. This value may be found statistically. Then a similarity measure of C1i and C2j is a function such as a function represented by F(p(C0)). The nearer the common ancestor is located to the root of a semantic hierarchy (it means, something that is the most general, abstract) the less is the value of the similarity measure.
The said similarity measure of two documents, or distance between them, may be expressed, for example, as
Σi=1,nΣj=1,mF(p(ancestor(C1i,C2j)))/(n*m).
Another problem is anaphoric construction in a text. An object in a text is often substituted by a pronoun. For example, “The algorithm is very fast, but it lacks a memory.” In this case, as a result of a usual statistical analysis, the frequency of the word “algorithm” is really below the true frequency of the lexical meaning. The exhaustive syntactic and semantic analysis can correct such misrepresentation.
In still another embodiment, for more exact results (such as those generated by the methods described herein), additional methods of comparing semantic structures may be applied. It allows one to find not only similar documents in different languages, but also to identify sentences which have the same semantic structures and different syntactic structures (for example, Active and Passive).
In still other embodiments, known methods of cluster analysis may be applied. For example, hierarchical clustering based on distance connectivity may be applied. Among other methods, the following methods may be used—k-means algorithm representing each cluster by a single mean vector; methods of statistic distributions, such as multivariate normal distributions used by the Expectation-maximization algorithm; methods of density models defining clusters as connected dense regions in the data space; two-mode-clustering, where clusters are modeled with both cluster members and relevant attributes, etc.
The task of filtering is more simple when the methods described herein are used. Filtering allows one to locate documents selected by one or more criteria. The task is close to or analogous to the task of searching. But, a user can just indicate themes, topics, objects or other matters of his or her interest, and the system will adapt to select and deliver news, press and other information related to a particular indicated matter.
The present invention differs from other approaches in that it can evolve into formulating criteria that include a wide spectrum of features (parameters). The deeper properties of texts may be found and used, these deeper properties relate to semantic features, and also to lexical, syntactic and morphological features of the texts. Since semantic features, like semantic classes and semantemes, are language independent, the system can filter documents written in different languages.
For example, the system can filter documents not only related to some objects, types or classes, but can select them on the basis of sentiment analysis, which consists in a selecting documents that reflect a specific attitude of an author to a subject. A specific attitude can be expressed in different ways, for example, by lexical means, but it is not known a priori which words might be used by authors. Using objects of specific semantic classes in text, or indicating during an analysis some semantemes, for example, Polarity Minus, helps to interpret the attitude of a speaker or a writer with respect to some topic or the overall contextual polarity of the document. The attitude may be, for example, blaming, estimation, admiration, an emotional state (when writing), etc.
On the other hand, filtering allows one to not include documents into search results based on some chosen criteria. A good example in practice is the filtering or elimination of spam—undesired or unsolicited email messages. A user can adopt his filter using common notions, which may be expressed in terms of semantic classes, for example ADVERTISEMENT_PAPERS, PURCHASE_AND_SALE, etc.
In regard to classifying, one implementation of classification is a method related to supervised learning. In this case, a training set with data for which the classes are already known is required. In one embodiment, clustering is executed to get or acquire training sets. Supervised learning may be done as follows and as illustrated in
First, with reference to
The hardware 1400 also typically receives a number of inputs and outputs for communicating information externally. For interface with a user or operator, the hardware 1400 may include one or more user input devices 1406 (e.g., a keyboard, a mouse, imaging device, scanner, microphone) and a one or more output devices 1408 (e.g., a Liquid Crystal Display (LCD) panel, a sound playback device (speaker)). To embody the present invention, the hardware 1400 typically includes at least one screen device.
For additional storage, the hardware 1400 may also include one or more mass storage devices 1410, e.g., a floppy or other removable disk drive, a hard disk drive, a Direct Access Storage Device (DASD), an optical drive (e.g. a Compact Disk (CD) drive, a Digital Versatile Disk (DVD) drive) and/or a tape drive, among others. Furthermore, the hardware 1400 may include an interface with one or more networks 1412 (e.g., a local area network (LAN), a wide area network (WAN), a wireless network, and/or the Internet among others) to permit the communication of information with other computers coupled to the networks. It should be appreciated that the hardware 1400 typically includes suitable analog and/or digital interfaces between the processor 1402 and each of the components 1404, 1406, 1408, and 1412 as is well known in the art.
The hardware 1400 operates under the control of an operating system 1414, and executes various computer software applications, components, programs, objects, modules, etc. to implement the techniques described above. Moreover, various applications, components, programs, objects, etc., collectively indicated by application software 1416 in
In general, the routines executed to implement the embodiments of the invention may be implemented as part of an operating system or a specific application, component, program, object, module or sequence of instructions referred to as a “computer program.” A computer program typically comprises one or more instruction sets at various times in various memory and storage devices in a computer, and that, when read and executed by one or more processors in a computer, cause the computer to perform operations necessary to execute elements involving the various aspects of the invention. Moreover, while the invention has been described in the context of fully functioning computers and computer systems, those skilled in the art will appreciate that the various embodiments of the invention are capable of being distributed as a program product in a variety of forms, and that the invention applies equally to actually effect the distribution regardless of the particular type of computer-readable media used. Examples of computer-readable media include but are not limited to recordable type media such as volatile and non-volatile memory devices, floppy and other removable disks, hard disk drives, optical disks (e.g., Compact Disk Read-Only Memory (CD-ROMs), Digital Versatile Disks (DVDs), flash memory, etc.), among others. Another type of distribution may be implemented as Internet downloads.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative and not restrictive of the broad invention and that this invention is not limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art upon studying this disclosure. In an area of technology such as this, where growth is fast and further advancements are not easily foreseen, the disclosed embodiments may be readily modified or re-arranged in one or more of its details as facilitated by enabling technological advancements without departing from the principals of the present disclosure.
For purposes of the USPTO extra-statutory requirements, the present application constitutes a continuation-in-part of U.S. patent application Ser. No. 12/983,220, filed on 31 Dec. 2010, which is a continuation-in-part of U.S. Ser. No. 11/548,214, filed on 10 Oct. 2006, which is currently co-pending, or is an application of which a currently co-pending application is entitled to the benefit of the filing date. This application is also a continuation-in-part of U.S. patent application Ser. No. 13/535,638, filed 28 Jun. 2012. The United States Patent Office (USPTO) has published a notice effectively stating that the USPTO's computer programs require that patent applicants reference both a serial number and indicate whether an application is a continuation or continuation-in-part. See Stephen G. Kunin, Benefit of Prior-Filed Application, USPTO Official Gazette 18 Mar. 2003. The Applicant has provided above a specific reference to the application(s) from which priority is being claimed as recited by statute. Applicant understands that the statute is unambiguous in its specific reference language and does not require either a serial number or any characterization, such as “continuation” or “continuation-in-part,” for claiming priority to U.S. patent applications. Notwithstanding the foregoing, Applicant understands that the USPTO's computer programs have certain data entry requirements, and hence Applicant is designating the present application as a continuation-in-part of its parent applications as set forth above, but points out that the designations are not to be construed as commentary or admission as to whether or not the present application contains any new matter in addition to the matter of its parent application(s). All subject matter of the Related Applications and of any and all parent, grandparent, great-grandparent, etc. applications of the Related Applications is incorporated herein by reference to the extent such subject matter is not inconsistent herewith. All subject matter of the Related Application(s) and of any and all parent, grandparent, great-grandparent, etc. applications of the Related Applications is incorporated herein by reference to the extent such subject matter is not inconsistent herewith.
Number | Name | Date | Kind |
---|---|---|---|
4914590 | Loatman et al. | Apr 1990 | A |
5268839 | Kaji | Dec 1993 | A |
5301109 | Landauer et al. | Apr 1994 | A |
5386556 | Hedin et al. | Jan 1995 | A |
5418717 | Su et al. | May 1995 | A |
5426583 | Uribe-Echebarria Diaz De Mendibil | Jun 1995 | A |
5497319 | Chong et al. | Mar 1996 | A |
5669007 | Tateishi | Sep 1997 | A |
5677835 | Carbonell et al. | Oct 1997 | A |
5678051 | Aoyama | Oct 1997 | A |
5687383 | Nakayama et al. | Nov 1997 | A |
5715468 | Budzinski | Feb 1998 | A |
5729741 | Liaguno et al. | Mar 1998 | A |
5752051 | Cohen | May 1998 | A |
5768603 | Brown et al. | Jun 1998 | A |
5787410 | McMahon | Jul 1998 | A |
5794050 | Dahlgren et al. | Aug 1998 | A |
5826219 | Kutsumi | Oct 1998 | A |
5867811 | O'Donoghue | Feb 1999 | A |
5884247 | Christy | Mar 1999 | A |
5930746 | Ting | Jul 1999 | A |
5995920 | Carbonell et al. | Nov 1999 | A |
6006221 | Liddy et al. | Dec 1999 | A |
6055528 | Evans | Apr 2000 | A |
6076051 | Messerly et al. | Jun 2000 | A |
6081774 | de Hita et al. | Jun 2000 | A |
6161083 | Franz et al. | Dec 2000 | A |
6182028 | Karaali et al. | Jan 2001 | B1 |
6233544 | Alshawi | May 2001 | B1 |
6233546 | Datig | May 2001 | B1 |
6243670 | Bessho et al. | Jun 2001 | B1 |
6243723 | Ikeda et al. | Jun 2001 | B1 |
6246977 | Messerly et al. | Jun 2001 | B1 |
6275789 | Moser et al. | Aug 2001 | B1 |
6295543 | Block et al. | Sep 2001 | B1 |
6345245 | Sugiyama et al. | Feb 2002 | B1 |
6349276 | McCarley et al. | Feb 2002 | B1 |
6356864 | Foltz et al. | Mar 2002 | B1 |
6381598 | Williamowski et al. | Apr 2002 | B1 |
6442524 | Ecker et al. | Aug 2002 | B1 |
6463404 | Appleby | Oct 2002 | B1 |
6523026 | Gillis et al. | Feb 2003 | B1 |
6529865 | Duan et al. | Mar 2003 | B1 |
6601026 | Appelt et al. | Jul 2003 | B2 |
6604101 | Chan et al. | Aug 2003 | B1 |
6622123 | Chanod et al. | Sep 2003 | B1 |
6631346 | Karaorman et al. | Oct 2003 | B1 |
6658627 | Gallup et al. | Dec 2003 | B1 |
6751606 | Fries et al. | Jun 2004 | B1 |
6778949 | Duan et al. | Aug 2004 | B2 |
6871199 | Binnig et al. | Mar 2005 | B1 |
6901402 | Corston-Oliver et al. | May 2005 | B1 |
6928407 | Ponceleon et al. | Aug 2005 | B2 |
6928448 | Franz et al. | Aug 2005 | B1 |
6937974 | d'Agostini | Aug 2005 | B1 |
6947923 | Cha et al. | Sep 2005 | B2 |
6965857 | Decary | Nov 2005 | B1 |
6983240 | Ait-Mokhtar et al. | Jan 2006 | B2 |
7027974 | Busch et al. | Apr 2006 | B1 |
7132445 | Taveras et al. | Nov 2006 | B2 |
7146358 | Gravano et al. | Dec 2006 | B1 |
7184948 | Chalabi et al. | Feb 2007 | B2 |
7200550 | Menezes et al. | Apr 2007 | B2 |
7231393 | Harik et al. | Jun 2007 | B1 |
7249121 | Bharat et al. | Jul 2007 | B1 |
7263488 | Chu et al. | Aug 2007 | B2 |
7272595 | Tsuchitani et al. | Sep 2007 | B2 |
7283951 | Marchisio et al. | Oct 2007 | B2 |
7383258 | Harik et al. | Jun 2008 | B2 |
7398201 | Marchisio et al. | Jul 2008 | B2 |
7403938 | Harrison et al. | Jul 2008 | B2 |
7406542 | Erlingsson | Jul 2008 | B2 |
7409404 | Gates | Aug 2008 | B2 |
7426507 | Patterson | Sep 2008 | B1 |
7444348 | Fries et al. | Oct 2008 | B2 |
7461056 | Cao et al. | Dec 2008 | B2 |
7466334 | Baba et al. | Dec 2008 | B1 |
7475015 | Epstein et al. | Jan 2009 | B2 |
7490099 | Myers et al. | Feb 2009 | B2 |
7536408 | Patterson | May 2009 | B2 |
7555428 | Franz et al. | Jun 2009 | B1 |
7577683 | Cho et al. | Aug 2009 | B2 |
7580827 | Brants et al. | Aug 2009 | B1 |
7580921 | Patterson | Aug 2009 | B2 |
7580929 | Patterson | Aug 2009 | B2 |
7584175 | Patterson | Sep 2009 | B2 |
7599914 | Patterson | Oct 2009 | B2 |
7619656 | Ben-Ezra et al. | Nov 2009 | B2 |
7668791 | Azzam et al. | Feb 2010 | B2 |
7672830 | Goutte et al. | Mar 2010 | B2 |
7672831 | Todhunter et al. | Mar 2010 | B2 |
7689536 | Weissman et al. | Mar 2010 | B1 |
7693813 | Cao et al. | Apr 2010 | B1 |
7698259 | Xue | Apr 2010 | B2 |
7698266 | Weissman et al. | Apr 2010 | B1 |
7711679 | Patterson | May 2010 | B2 |
7716216 | Harik et al. | May 2010 | B1 |
7739102 | Bender | Jun 2010 | B2 |
7769579 | Zhao et al. | Aug 2010 | B2 |
7792783 | Friedlander et al. | Sep 2010 | B2 |
7792836 | Taswell | Sep 2010 | B2 |
7831531 | Baluja et al. | Nov 2010 | B1 |
7840589 | Holt et al. | Nov 2010 | B1 |
7877371 | Lerner et al. | Jan 2011 | B1 |
7895221 | Colledge et al. | Feb 2011 | B2 |
7912705 | Wasson et al. | Mar 2011 | B2 |
7913163 | Zunger | Mar 2011 | B1 |
7917497 | Harrison et al. | Mar 2011 | B2 |
7925610 | Elbaz et al. | Apr 2011 | B2 |
7925655 | Power et al. | Apr 2011 | B1 |
7937265 | Pasca et al. | May 2011 | B1 |
7937396 | Pasca et al. | May 2011 | B1 |
7987176 | Latzina et al. | Jul 2011 | B2 |
8010539 | Blair-Goldensohn et al. | Aug 2011 | B2 |
8019748 | Wu et al. | Sep 2011 | B1 |
8024372 | Harik et al. | Sep 2011 | B2 |
8051104 | Weissman et al. | Nov 2011 | B2 |
8055669 | Singhal et al. | Nov 2011 | B1 |
8065248 | Baluja et al. | Nov 2011 | B1 |
8065290 | Hogue et al. | Nov 2011 | B2 |
8065316 | Baker et al. | Nov 2011 | B1 |
8073865 | Davis et al. | Dec 2011 | B2 |
8078450 | Anisimovich et al. | Dec 2011 | B2 |
8086594 | Cao et al. | Dec 2011 | B1 |
8086619 | Haahr et al. | Dec 2011 | B2 |
8086624 | Hubinette | Dec 2011 | B1 |
8090723 | Cao et al. | Jan 2012 | B2 |
8108412 | Patterson | Jan 2012 | B2 |
8112437 | Katragadda et al. | Feb 2012 | B1 |
8117223 | Patterson | Feb 2012 | B2 |
8122026 | Laroco, Jr. et al. | Feb 2012 | B1 |
8145473 | Anisimovich et al. | Mar 2012 | B2 |
8166021 | Cao et al. | Apr 2012 | B1 |
8176048 | Morgan et al. | May 2012 | B2 |
8214199 | Anismovich et al. | Jul 2012 | B2 |
8229730 | Van Den Berg et al. | Jul 2012 | B2 |
8229944 | Latzina et al. | Jul 2012 | B2 |
8260049 | Deryagin et al. | Sep 2012 | B2 |
8266077 | Handley | Sep 2012 | B2 |
8271453 | Pasca et al. | Sep 2012 | B1 |
8285728 | Rubin | Oct 2012 | B1 |
8300949 | Xu | Oct 2012 | B2 |
8301633 | Cheslow | Oct 2012 | B2 |
8370128 | Brun et al. | Feb 2013 | B2 |
8402036 | Blair-Goldensohn et al. | Mar 2013 | B2 |
8423495 | Komissarchik et al. | Apr 2013 | B1 |
8468153 | Ahlberg et al. | Jun 2013 | B2 |
8495042 | Symington et al. | Jul 2013 | B2 |
8533188 | Yan et al. | Sep 2013 | B2 |
8548951 | Solmer et al. | Oct 2013 | B2 |
8554558 | McCarley et al. | Oct 2013 | B2 |
8577907 | Singhal et al. | Nov 2013 | B1 |
8856096 | Marchisio et al. | Oct 2014 | B2 |
8856163 | Tong et al. | Oct 2014 | B2 |
20010029442 | Shiotsu et al. | Oct 2001 | A1 |
20010056352 | Xun | Dec 2001 | A1 |
20020022956 | Ukrainczyk et al. | Feb 2002 | A1 |
20020078091 | Vu et al. | Jun 2002 | A1 |
20030040901 | Wang | Feb 2003 | A1 |
20030101182 | Govrin et al. | May 2003 | A1 |
20030145285 | Miyahira et al. | Jul 2003 | A1 |
20030176999 | Calcagno et al. | Sep 2003 | A1 |
20040034520 | Langkilde-Geary et al. | Feb 2004 | A1 |
20040064438 | Kostoff | Apr 2004 | A1 |
20040098250 | Kimchi et al. | May 2004 | A1 |
20040261016 | Glass et al. | Dec 2004 | A1 |
20050065916 | Ge et al. | Mar 2005 | A1 |
20050108630 | Wasson et al. | May 2005 | A1 |
20050155017 | Berstis et al. | Jul 2005 | A1 |
20050171757 | Appleby | Aug 2005 | A1 |
20050209844 | Wu et al. | Sep 2005 | A1 |
20050240392 | Munro, Jr. et al. | Oct 2005 | A1 |
20050267871 | Marchisio et al. | Dec 2005 | A1 |
20060004563 | Campbell et al. | Jan 2006 | A1 |
20060106767 | Adcock et al. | May 2006 | A1 |
20060106793 | Liang | May 2006 | A1 |
20060149739 | Myers | Jul 2006 | A1 |
20060184516 | Ellis | Aug 2006 | A1 |
20070083505 | Ferrari et al. | Apr 2007 | A1 |
20070094006 | Todhunter et al. | Apr 2007 | A1 |
20070130112 | Lin | Jun 2007 | A1 |
20070143322 | Kothari et al. | Jun 2007 | A1 |
20070150800 | Betz et al. | Jun 2007 | A1 |
20070156669 | Marchisio et al. | Jul 2007 | A1 |
20070185860 | Lissack | Aug 2007 | A1 |
20070203688 | Fuji et al. | Aug 2007 | A1 |
20070244690 | Peters | Oct 2007 | A1 |
20070250305 | Maxwell | Oct 2007 | A1 |
20070294200 | Au | Dec 2007 | A1 |
20080091405 | Anisimovich et al. | Apr 2008 | A1 |
20080133218 | Zhou et al. | Jun 2008 | A1 |
20080133483 | Bayley et al. | Jun 2008 | A1 |
20080133505 | Bayley et al. | Jun 2008 | A1 |
20080228464 | Al-Onaizan et al. | Sep 2008 | A1 |
20080243777 | Stewart et al. | Oct 2008 | A1 |
20080294622 | Kanigsberg et al. | Nov 2008 | A1 |
20080319947 | Latzina et al. | Dec 2008 | A1 |
20090049040 | Fay et al. | Feb 2009 | A1 |
20090063472 | Pell et al. | Mar 2009 | A1 |
20090070094 | Best et al. | Mar 2009 | A1 |
20090076839 | Abraham-Fuchs et al. | Mar 2009 | A1 |
20090089047 | Pell et al. | Apr 2009 | A1 |
20090089277 | Cheslow | Apr 2009 | A1 |
20090112841 | Devarakonda et al. | Apr 2009 | A1 |
20090182738 | Marchisio et al. | Jul 2009 | A1 |
20090222441 | Broder et al. | Sep 2009 | A1 |
20090271179 | Marchisio et al. | Oct 2009 | A1 |
20100082324 | Itagaki et al. | Apr 2010 | A1 |
20100095196 | Grabarnik et al. | Apr 2010 | A1 |
20100169314 | Green et al. | Jul 2010 | A1 |
20100169337 | Green et al. | Jul 2010 | A1 |
20100318423 | Kanigsberg et al. | Dec 2010 | A1 |
20100332493 | Haas et al. | Dec 2010 | A1 |
20110040772 | Sheu | Feb 2011 | A1 |
20110055188 | Gras | Mar 2011 | A1 |
20110072021 | Lu et al. | Mar 2011 | A1 |
20110119254 | Brown et al. | May 2011 | A1 |
20110153539 | Rojahn | Jun 2011 | A1 |
20110191286 | Cho et al. | Aug 2011 | A1 |
20110202526 | Lee et al. | Aug 2011 | A1 |
20110202563 | Colledge et al. | Aug 2011 | A1 |
20110258181 | Brdiczka et al. | Oct 2011 | A1 |
20110295864 | Betz et al. | Dec 2011 | A1 |
20110301941 | De Vocht | Dec 2011 | A1 |
20110307435 | Overell et al. | Dec 2011 | A1 |
20110314032 | Bennett et al. | Dec 2011 | A1 |
20120023104 | Johnson et al. | Jan 2012 | A1 |
20120030226 | Holt et al. | Feb 2012 | A1 |
20120047145 | Heidasch | Feb 2012 | A1 |
20120131060 | Heidasch et al. | May 2012 | A1 |
20120197628 | Best et al. | Aug 2012 | A1 |
20120197885 | Patterson | Aug 2012 | A1 |
20120203777 | Laroco, Jr. et al. | Aug 2012 | A1 |
20120221553 | Wittmer et al. | Aug 2012 | A1 |
20120246153 | Pehle | Sep 2012 | A1 |
20120271627 | Danielyan et al. | Oct 2012 | A1 |
20120296897 | Xin-Jing et al. | Nov 2012 | A1 |
20120310627 | Qi et al. | Dec 2012 | A1 |
20130013291 | Bullock et al. | Jan 2013 | A1 |
20130041652 | Zuev et al. | Feb 2013 | A1 |
20130054589 | Cheslow | Feb 2013 | A1 |
20130091113 | Gras | Apr 2013 | A1 |
20130132383 | Ahlberg et al. | May 2013 | A1 |
20130138696 | Turdakov et al. | May 2013 | A1 |
20130144592 | Och et al. | Jun 2013 | A1 |
20130144594 | Bangalore et al. | Jun 2013 | A1 |
20130185307 | El-Yaniv et al. | Jul 2013 | A1 |
20130254209 | Kang et al. | Sep 2013 | A1 |
20130282703 | Puterman-Sobe et al. | Oct 2013 | A1 |
20130311487 | MOORE et al. | Nov 2013 | A1 |
20130318095 | Harold | Nov 2013 | A1 |
20140012842 | Yan et al. | Jan 2014 | A1 |
Number | Date | Country |
---|---|---|
2400400 | Dec 2001 | EP |
1365329 | Oct 2009 | EP |
2011160204 | Dec 2011 | WO |
Entry |
---|
Bolshakov, I.A. “Co-Ordinative Ellipsis in Russian Texts: Problems of Description and Restoration” Proceedings of the 12th conference on Computational linguistics, Volue 1, pp. 65-67. Association for Computational Linguistics 1988. |
Hutchins, Machine Translation: Past, Present, Future, Ellis Horwood, Ltd., Chichester, UK, 1986. |
Mitamura, T. et al. “An Efficient Interlingua Translation System for Multi-lingual Document Production,” Proceedings of Machine Translation Summit III, Washington DC, Jul. 2-4, 1991. |
Number | Date | Country | |
---|---|---|---|
20130041652 A1 | Feb 2013 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13535638 | Jun 2012 | US |
Child | 13648527 | US | |
Parent | 12983220 | Dec 2010 | US |
Child | 13535638 | US | |
Parent | 11548214 | Oct 2006 | US |
Child | 12983220 | US |