1. Field
Implementations of the present invention relate to natural language processing. In particular, implementations relate to classifying, and also to clustering and filtering of text-centric documents written in one or more languages.
2. Description of the Related Art
The modern man has to deal every day with huge volume of new information. Also, corporations, agencies and libraries must receive and process a lot of text and text resources. Information is presented in many forms including texts, resources and references, print (e.g., newspapers and magazines), Internet sources (e.g., videos, audio programs), etc. Selection, cataloguing and filtering of information is an important task in managing information overload. Sometimes texts must be selected based on some feature or a plurality of a tightly defined set of features. Other times there is a need to find texts that are similar to a given text. Yet other times, there is a need to form groups or classes of texts according to a set of criteria. Text-based information which a person or organization must use may originate from many countries and may be written in different languages. Known mathematical methods of classifying and clustering objects that have been adopted for solving these tasks are insufficient to adequately cope with information overload.
Many natural language processing systems involve classifying texts into predefined categories. For example, in order to sort the huge amount of news available online into some meaningful categories, e.g., politics, cultural events, sporting events, etc., a text classification method may be applied. Other tasks related to text processing include clustering and filtering.
Nowadays, there is a great desire to be able to analyze multi-language data. However, existing text processing systems are usually language-dependent, i.e., they are able to analyze text written only in one particular language and cannot readily be ported to address another language.
The very few existing cross-language systems are based on machine translation techniques. These systems generally choose a so called target language, translate all documents to that language with machine translation techniques, and then construct document representations and apply classification. Such machine translation creates additional errors not found in the source material and, moreover, the analysis is usually based on low-level properties of documents, and the meanings of documents are not reflected in the utilized representation or translation.
Thus, it is possible to create systems that can improve cross-language document processing, including classification, clustering and filtering, systems that can take into account not only the symbolic information found in sources, but systems that address semantics, i.e., meaning, of documents.
Methods are described for performing clustering or classification of texts of different languages. Language-independent semantic structures (LISS) are constructed before clustering is performed. These structures reflect lexical, morphological, syntactic, and semantic properties of texts. The methods suggested are able to perform cross-language text clustering which is based on the meaning derived from texts. The methods are applicable to genre classification, topic detection, news analysis, authorship analysis, internet searches, and creating corpora for other tasks, etc.
While the appended claims set forth the features of the present invention with particularity, the invention, together with its objects and advantages, will be more readily appreciated from the following detailed description, taken in conjunction with the accompanying drawings, wherein:
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the invention. It will be apparent, however, to one skilled in the art that the invention can be practiced without these specific details.
Reference in this specification to “one embodiment” or “an implementation” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase “in one embodiment” or “in one implementation” in various places in the specification are not necessarily all referring to the same embodiment or implementation, nor are separate or alternative embodiments mutually exclusive of other embodiments. Moreover, various features are described which may be exhibited by some embodiments and not by others. Similarly, various requirements are described which may be requirements for some embodiments but not other embodiments.
Implementations of the present invention disclose techniques for cross-language natural language text processing such as text classification, clustering and filtering based on exhaustive syntactic and semantic analyses of texts and language-independent semantic structures. A lot of lexical, grammatical, syntactical, pragmatic, semantic and other features of the texts may be identified, extracted and effectively used to solve said tasks.
A classifier is an instrument to perform classification. One implementation of document classification may be formulated as follows: given a finite set of categories {C1, C2, . . . , Cn} and an input document D, a classifier has to assign the document D to one (or more) of the categories {C1, C2, . . . , Cn} or produce an output representing a set of pairs (a so called classification spectrum) {(C1, w1), (C2, w2), . . . , (Cn, wn)}, where for each integer i from 1 to n, Ci is the category and wi is a weight (e.g., a real number in the interval [0,1]) defining to which extend the document D belongs to the category Ci. A threshold value may be defined in order to omit the categories with low weights below the threshold. For example, given the following categories {Sport, TV, Business, Art} and a document to be classified describing a TV show about football, an adequate classifier could produce the following classification spectrum for the document {(Sport, 0.7), (TV,0.8), (Business,0.2), (Art,0.05)}. If the threshold is 0.3, only sport and TV categories will be considered.
Classification is a task of supervised learning, i.e., supervised (training) data is required. Training data is a set of labeled documents, i.e., each document is labeled with its category or classification spectrum. By analyzing this labeled data, a so called classification function or classification model is defined. This function or model should predict an output (category or a classification spectrum) for an input document.
Many natural language processing (NLP) problems may be formulated as a task of classification. For example, authorship attribution is a problem of assigning authors to anonymous texts, the authors are to be chosen out of a predefined list of possible authors. For each possible author, one or more documents written by the author are available. Thus, these documents are the training data and a classifier may be trained in order to assign an author to the anonymous texts. Another problem formulated as a task of classification is determining a document's genre or topic(s) out of lists of possible genres and topics when training data are available for each genre or topic.
Classification is usually performed on documents represented as vectors of so called features. Features represent characteristics of the documents to be classified and should reflect essential characteristics for the particular task. The naïve approach is to create features out of words: each word in a document may be a feature, thus vectors containing frequencies of each word may be utilized in classification. Another common way to create this vector space model is term frequency—inverted document frequency (TF-IDF) document representation (such as described by Salton, 1988), in this approach a value in a document vector is not only proportional to the corresponding word frequency in the document but is also inversely proportional to its frequency in the entire document corpus. Thus, those words that are frequently found in documents (e.g., and, but, the, a, etc.) do not get high values.
Another task of processing huge collections of texts is clustering. Clustering is the task of attributing or sorting objects into groups (clusters) so that objects in the same cluster are more similar to each other than to those in other clusters. The clusters may be presented as conglomerations of points in n-dimensional space, where n is the number of features which are used for attributing.
As distinct from classifying, clustering may executed without training, without samples, representing groups. Clustering is one of the tasks traditionally associated with data mining, and common techniques for statistical data analysis may be used to indicate similar objects.
The task of clustering can be solved by various algorithms that differ significantly in their notion of what constitutes a cluster and how to efficiently find them. The most general way of searching clusters is to find groups with low “distances” among or between the cluster members, dense areas of the data space, intervals or particular statistical distributions. The proper algorithm of clustering and selection of parameters (including distance function, a density threshold or the number of expected clusters) depend on the individual data set and the goal or goals of clustering. In case of texts, there is a wide diapason of features which can be used for this purpose.
In practice, the task of clustering across languages usually is an iterative process of knowledge discovery and interactive multi-objective optimization. It will often be necessary to modify preprocessing and parameters, and modify the selection of features until the results exhibit the desired properties.
Still another task of cross-language processing huge collections of texts is filtering. It consists of selecting texts by one or more criteria. The simple examples of such task may be filtering by author, by title, by topic, by word or group of words, by date of issue or source, by geographical source, etc. A more complex tasks of filtering may be formulated on the basis of using deeper properties of texts, the properties related to their lexical, syntactic and semantic features of the texts. For example, tasks related to sentiment analysis may consist in a selection of documents that reflect a specific attitude of an author to a subject. It can be expressed in different ways, for example, by lexical means, but it is difficult to say a priori which words might be used by authors. On the other hand, filtering allows one to avoid results where documents exhibit some chosen criteria.
Some widely used features that can be used are primarily lexical and character features, those that consider a text as a sequence of words and characters respectively. Namely, word frequencies, n-grams, letter frequencies, character n-grams, etc. A big advantage of these features is that they are easy to be extracted automatically. But they are language dependent and do not capture a document's semantics. Therefore, these lexical-based features do not allow performing cross-language, semantically rich, document analysis.
Language independent features of a text capture not only the symbolic information but semantics of a text often appear to be more promising for solving various tasks. For example, certain tasks associated within authorship analysis systems are promising since many authors write in different languages or their texts are translated. A language independent system could fairly compare authors across different languages. Features of the original author can be lost in translation. Language independent systems should capture an author's writing style when an author's work is translated. Language independent systems would also be highly useful to group online news by topic across languages, since there is a big amount of news written in different languages, and increasingly news can be accessed easily in text and other formats through the Internet.
Previous cross-language systems do not provide accurate extraction of language independent semantically rich features of text. Therefore these systems were not exploited or adopted. Existing systems for text document processing are limited to analyzing documents written in a single language, and systems that attempt to process across languages fail to address or analyze semantically rich features of text. However, for some tasks such as topic detection in online news or authorship attribution of translated texts, cross-language analysis techniques are required. The existing systems dealing with documents written in different languages usually translate them to one particular language (e.g., English, Russian, Mandarin) with machine translating systems and then apply classification. Therefore syntactic and semantic properties of the source sentences are not taken into account.
Advantageously, the problems associated with existing text processing systems are overcome—or at least reduced—by the techniques and systems disclosed herein.
Implementations of the invention allow a user to perform classification, clustering and filtering of natural language texts written in one or many natural languages. The techniques are particularly effective for searching across many natural languages. The disclosed methods take into account lexical, grammatical, syntactical, pragmatic, semantic and other features of texts.
The features are extracted during an exhaustive analysis of each sentence and constructing language-independent semantic structures. Such exhaustive analysis precedes classification, clustering and/or filtering texts. The system employs automatic syntactic and semantic analyses to determine and to extract lexical, grammatical, syntactical, pragmatic, semantic and other features for their further using in processing texts. Then, the system indexes based on the extracted information, and stores syntactic and semantic information about each sentence, as well as parses results and lexical choices including results obtained when resolving ambiguities. The system analyzes sentences using linguistic descriptions of a given natural language to reflect the real complexities of the natural language, rather than simplified or artificial descriptions. The system functions based on the principle of integral and purpose-driven recognition, where hypotheses about the syntactic structure of a part of a sentence are verified within the hypotheses about the syntactic structure of the whole sentence. It avoids analyzing numerous parsing of anomalous variants.
An index usually comprises and may be represented as a table where each value of a feature (for example, a word, expression, or phrase) in a document is accompanied by a list of numbers or addresses of its occurrence in that document. According to embodiments of the present invention, morphological, syntactic, lexical, and semantic features can be indexed in the same fashion as each word in a document is indexed. In one embodiment of the present invention, indexes may be produced to index all or at least one value of morphological, syntactic, lexical, and semantic features (parameters). These parameters or values are generated during a two-stage semantic analysis described in more detail below. The index may be used to facilitate such operations of natural language processing such as semantic searching, classifying, clustering and filtering of cross-language documents. As used herein, cross-language documents include those documents that address a common topic and that are in different languages.
In one implementation, said linguistic descriptions include a plurality of linguistic models and knowledge about natural languages. These may be arranged in a database and applied for analyzing each text or source sentence such as at step 106. Such a plurality of linguistic models may include, but are not limited to, morphology models, syntax models, grammar models and lexical-semantic models. In a particular implementation, integral models for describing the syntax and semantics of a language are used in order to recognize the meanings of the source sentence, analyze complex language structures, and correctly convey information encoded in the source sentence.
Accordingly, a rough syntactic analysis is performed on the source sentence to generate a graph of generalized constituents 232 for further syntactic analysis. All reasonably possible surface syntactic models for each element of lexical-morphological structure are applied, and all the possible constituents are built and generalized to represent all the possible variants of parsing the sentence syntactically.
Following the rough syntactic analysis, a precise syntactic analysis is performed on the graph of generalized constituents to generate one or more syntactic trees 242 to represent the source sentence. In one implementation, generating the syntactic tree 242 comprises choosing between lexical options and choosing between relations from the graphs. Many prior and statistical ratings may be used during the process of choosing between lexical options, and in choosing between relations from the graph. The prior and statistical ratings may also be used for assessment of parts of the generated tree and for the whole tree. In one implementation, the one or more syntactic trees may be generated or arranged in order of decreasing assessment. Thus, the best syntactic tree may be generated first. Non-tree links are also checked and generated for each syntactic tree at this time. If the first generated syntactic tree fails, for example, because of an impossibility to establish non-tree links, the second syntactic tree is taken as the best, etc.
Many lexical, grammatical, syntactical, pragmatic, semantic features are extracted during the steps of these steps of analysis. For example, the system can extract and store lexical information and information about belonging lexical items to semantic classes, information about grammatical forms and linear order, about syntactic relations and surface slots, using predefined forms, aspects, sentiment features such as positive-negative relations, deep slots, non-tree links, semantemes, etc.
With reference to
With reference to
The analysis methods ensure that the maximum accuracy in conveying or understanding the meaning of the sentence is achieved.
With reference to
Referring to
The language-independent semantic structure (LISS) of a sentence is represented as acyclic graph (a tree supplemented with non-tree links) where each word of specific language is substituted with its universal (language-independent) semantic notions or semantic entities referred to herein as “semantic classes”. Semantic class is one of the most important semantic features that can be extracted and used for tasks of classifying, clustering and filtering text documents written in one or many languages. The other features usable for such task may be semantemes, because they may reflect not only semantic, but also syntactical, grammatical, etc. language-specific features in language-independent structures.
The semantic classes, as part of linguistic descriptions, are arranged into a semantic hierarchy comprising hierarchical parent-child relationships. In general, a child semantic class inherits many or most properties of its direct parent and all ancestral semantic classes. For example, semantic class SUBSTANCE is a child of semantic class ENTITY and at the same time it is a parent of semantic classes GAS, LIQUID, METAL, WOOD_MATERIAL, etc.
Each semantic class in the semantic hierarchy is supplied with a deep model. The deep model of the semantic class is a set of deep slots. Deep slots reflect the semantic roles of child constituents in various sentences with objects of the semantic class as the core of a parent constituent and the possible semantic classes as fillers of deep slots. The deep slots express semantic relationships between constituents, including, for example, “agent”, “addressee”, “instrument”, “quantity”, etc. A child semantic class inherits and adjusts the deep model of its direct parent semantic class.
With reference to
Semantic descriptions 104 are language-independent. Semantic descriptions 104 may provide descriptions of deep constituents, and may comprise a semantic hierarchy, deep slots descriptions, a system of semantemes, and pragmatic descriptions.
With reference to
With reference to
Also, any element of language description 610 may be extracted during an exhaustive analysis of texts, and any element may be indexed (the index for the feature are created). The indexes or indices may be stored and used for the task of classifying, clustering and filtering text documents written in one or more languages. Indexing of semantic classes is important and helpful for solving these tasks. Syntactic structures and semantic structures also may be indexed and stored for using in semantic searching, classifying, clustering and filtering.
For the task of clustering a set of features and at least one criterion should be selected, the criterion may define a similarity of documents. The set of the features should include at least one feature.
One classification and/or clustering problem is based on the concept of similarity. There are many ways to calculate similarity between two texts. One naïve way to find out if two texts are similar is to count how many words they have in common. There are also more advanced versions of this approach such as techniques involving lemmatization, stemming, weighting, etc. For example, a vector space model (G. Salton, 1975) may be built, and vector similarity measures, such as e.g. cosine similarity, may be utilized. During the text processing described here, documents may be represented with language independent semantic classes that in their turn may be considered as lexical features. Therefore, the similarity measures as were mentioned above may be used.
Such similarity measures have a drawback in that they do not actually capture the semantics. For example, the two sentences, “Bob has a spaniel” and “Richard owns a dog” are semantically similar but they do not share any words but an article. Therefore, a mere lexical text similarity measure will fail to find that these sentences are similar. To capture this type of similarity, knowledge-based semantic similarity measures may be used. They require a semantic hierarchy to be calculated. Similarity between two words usually depends on a shortest path between corresponding concepts in a corresponding semantic hierarchy. For example, “spaniel” in the semantic hierarchy corresponding to the first sentence above appears as a child node (hyponym) of “dog”, therefore semantic similarity between the concepts will be high. Word-to-word similarity measures may be generalized to text-to-text similarities by combining values for similarities of each word pair. Semantic classes described here represent nodes of semantic hierarchy. Therefore, knowledge-based semantic similarity measures described above and their generalizations to text-to-text similarity measures may be utilized within document processing.
Creating clusters of texts may be known, but usual or known systems of clustering use language-dependent parameters (for example, a set of key words), which are most representative for the texts. The present invention allows one to use for this purpose semantic classes and other semantic attributes. For example, referring to the present invention, a list of semantic classes {C1, C2, . . . Cm} may be considered as a document representation 1104. Since lexical meanings may be expressed in different words, a semantic class may unite several close lexical meanings; a semantic class embodies the idea of generalization. Synonyms and derivates are generalized. If we deal with texts in different languages, a semantic class generalizes lexical meanings of texts in different languages. In one embodiment, the frequency of the same semantic classes may be used as the criterion for clustering. In another embodiment, the frequency of “near located” semantic classes may be also used as a criterion.
The notion of “near located” semantic classes as a similarity measure may be interpreted in different ways. In the present invention, semantic classes are organized into a semantic hierarchy. So, there are several types of relationships which may link two semantic classes, for example, “parent—child”, “grandparent—grandchild”, “brothers”, “nephew”, “cousin”, etc. Figuratively speaking, “degree of kinship” or a distance in the semantic hierarchy may define the similarity measure between two semantic classes. More exactly, the distance and inheritance (generally speaking) are taken into account in one embodiment of invention to measure the similarity of two semantic classes, and it may be used to get a similarity measure for the task of clustering text documents. In another embodiment, the similarity measure for the task of clustering text documents may be defined on the basis of frequency of the same (or “near located”) semantic classes.
In one embodiment, the similarity measure for two or more documents may be defined heuristically or on the basis of experience. For example, if there are 2 documents—D1 and D2. After semantic analysis, there may be two sets of semantic classes {C11, C12, . . . C1n}{C21, C22, . . . C2m}, which are selected as most representative for these 2 texts. The principle of the choice may be different, for example most frequent classes may be selected. Each class may be supplied by or with a coefficient of the frequency Fij in the document. Most frequent semantic classes in a language may be excluded. These classes include such words (in English) as “the” and other articles that frequently appear in text. Most common semantic classes (like ENTITY, ABSRACT_SCIENTIFIC_OBJECT, etc.) also may be discarded. Then, a similarity measure depends on:
a) a number of cases when C1i=C2j, maybe, with taking into account the frequency of objects (words) of C1i and C2j in the language, e.g., a number objects of the same class are found in the both documents; and
b) a number of cases when C1i and C2j are “near relations”. For each pair (C1i, C2j) the common ancestor C0 is found. Let's p(C0) is a probability to find objects of C0 and all his descendants in the corpora. This value may be found statistically. Then a similarity measure of C1i and C2j is a function such as a function represented by F(p(C0)). The nearer the common ancestor is located to the root of a semantic hierarchy (it means, something that is the most general, abstract) the less is the value of the similarity measure.
The said similarity measure of two documents, or distance between them, may be expressed, for example, as
Σi=1,nΣj=1,mF(p(ancestor(C1i,C2j)))/(n*m).
Another problem is anaphoric construction in a text. An object in a text is often substituted by a pronoun. For example, “The algorithm is very fast, but it lacks a memory.” In this case, as a result of a usual statistical analysis, the frequency of the word “algorithm” is really below the true frequency of the lexical meaning. The exhaustive syntactic and semantic analysis can correct such misrepresentation.
In still another embodiment, for more exact results (such as those generated by the methods described herein), additional methods of comparing semantic structures may be applied. It allows one to find not only similar documents in different languages, but also to identify sentences which have the same semantic structures and different syntactic structures (for example, Active and Passive).
In still other embodiments, known methods of cluster analysis may be applied. For example, hierarchical clustering based on distance connectivity may be applied. Among other methods, the following methods may be used—k-means algorithm representing each cluster by a single mean vector; methods of statistic distributions, such as multivariate normal distributions used by the Expectation-maximization algorithm; methods of density models defining clusters as connected dense regions in the data space; two-mode-clustering, where clusters are modeled with both cluster members and relevant attributes, etc.
The task of filtering is more simple when the methods described herein are used. Filtering allows one to locate documents selected by one or more criteria. The task is close to or analogous to the task of searching. But, a user can just indicate themes, topics, objects or other matters of his or her interest, and the system will adapt to select and deliver news, press and other information related to a particular indicated matter.
The present invention differs from other approaches in that it can evolve into formulating criteria that include a wide spectrum of features (parameters). The deeper properties of texts may be found and used, these deeper properties relate to semantic features, and also to lexical, syntactic and morphological features of the texts. Since semantic features, like semantic classes and semantemes, are language independent, the system can filter documents written in different languages.
For example, the system can filter documents not only related to some objects, types or classes, but can select them on the basis of sentiment analysis, which consists in a selecting documents that reflect a specific attitude of an author to a subject. A specific attitude can be expressed in different ways, for example, by lexical means, but it is not known a priori which words might be used by authors. Using objects of specific semantic classes in text, or indicating during an analysis some semantemes, for example, Polarity Minus, helps to interpret the attitude of a speaker or a writer with respect to some topic or the overall contextual polarity of the document. The attitude may be, for example, blaming, estimation, admiration, an emotional state (when writing), etc.
On the other hand, filtering allows one to not include documents into search results based on some chosen criteria. A good example in practice is the filtering or elimination of spam—undesired or unsolicited email messages. A user can adopt his filter using common notions, which may be expressed in terms of semantic classes, for example ADVERTISEMENT_PAPERS, PURCHASE_AND_SALE, etc.
In regard to classifying, one implementation of classification is a method related to supervised learning. In this case, a training set with data for which the classes are already known is required. In one embodiment, clustering is executed to get or acquire training sets. Supervised learning may be done as follows and as illustrated in
First, with reference to
The hardware 1400 also typically receives a number of inputs and outputs for communicating information externally. For interface with a user or operator, the hardware 1400 may include one or more user input devices 1406 (e.g., a keyboard, a mouse, imaging device, scanner, microphone) and a one or more output devices 1408 (e.g., a Liquid Crystal Display (LCD) panel, a sound playback device (speaker)). To embody the present invention, the hardware 1400 typically includes at least one screen device.
For additional storage, the hardware 1400 may also include one or more mass storage devices 1410, e.g., a floppy or other removable disk drive, a hard disk drive, a Direct Access Storage Device (DASD), an optical drive (e.g. a Compact Disk (CD) drive, a Digital Versatile Disk (DVD) drive) and/or a tape drive, among others. Furthermore, the hardware 1400 may include an interface with one or more networks 1412 (e.g., a local area network (LAN), a wide area network (WAN), a wireless network, and/or the Internet among others) to permit the communication of information with other computers coupled to the networks. It should be appreciated that the hardware 1400 typically includes suitable analog and/or digital interfaces between the processor 1402 and each of the components 1404, 1406, 1408, and 1412 as is well known in the art.
The hardware 1400 operates under the control of an operating system 1414, and executes various computer software applications, components, programs, objects, modules, etc. to implement the techniques described above. Moreover, various applications, components, programs, objects, etc., collectively indicated by application software 1416 in
In general, the routines executed to implement the embodiments of the invention may be implemented as part of an operating system or a specific application, component, program, object, module or sequence of instructions referred to as a “computer program.” A computer program typically comprises one or more instruction sets at various times in various memory and storage devices in a computer, and that, when read and executed by one or more processors in a computer, cause the computer to perform operations necessary to execute elements involving the various aspects of the invention. Moreover, while the invention has been described in the context of fully functioning computers and computer systems, those skilled in the art will appreciate that the various embodiments of the invention are capable of being distributed as a program product in a variety of forms, and that the invention applies equally to actually effect the distribution regardless of the particular type of computer-readable media used. Examples of computer-readable media include but are not limited to recordable type media such as volatile and non-volatile memory devices, floppy and other removable disks, hard disk drives, optical disks (e.g., Compact Disk Read-Only Memory (CD-ROMs), Digital Versatile Disks (DVDs), flash memory, etc.), among others. Another type of distribution may be implemented as Internet downloads.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative and not restrictive of the broad invention and that this invention is not limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art upon studying this disclosure. In an area of technology such as this, where growth is fast and further advancements are not easily foreseen, the disclosed embodiments may be readily modified or re-arranged in one or more of its details as facilitated by enabling technological advancements without departing from the principals of the present disclosure.
For purposes of the USPTO extra-statutory requirements, the present application constitutes a continuation-in-part of U.S. patent application Ser. No. 12/983,220, filed on 31 Dec. 2010, which is a continuation-in-part of U.S. Ser. No. 11/548,214, filed on 10 Oct. 2006, which is currently co-pending, or is an application of which a currently co-pending application is entitled to the benefit of the filing date. This application is also a continuation-in-part of U.S. patent application Ser. No. 13/535,638, filed 28 Jun. 2012. The United States Patent Office (USPTO) has published a notice effectively stating that the USPTO's computer programs require that patent applicants reference both a serial number and indicate whether an application is a continuation or continuation-in-part. See Stephen G. Kunin, Benefit of Prior-Filed Application, USPTO Official Gazette 18 Mar. 2003. The Applicant has provided above a specific reference to the application(s) from which priority is being claimed as recited by statute. Applicant understands that the statute is unambiguous in its specific reference language and does not require either a serial number or any characterization, such as “continuation” or “continuation-in-part,” for claiming priority to U.S. patent applications. Notwithstanding the foregoing, Applicant understands that the USPTO's computer programs have certain data entry requirements, and hence Applicant is designating the present application as a continuation-in-part of its parent applications as set forth above, but points out that the designations are not to be construed as commentary or admission as to whether or not the present application contains any new matter in addition to the matter of its parent application(s). All subject matter of the Related Applications and of any and all parent, grandparent, great-grandparent, etc. applications of the Related Applications is incorporated herein by reference to the extent such subject matter is not inconsistent herewith. All subject matter of the Related Application(s) and of any and all parent, grandparent, great-grandparent, etc. applications of the Related Applications is incorporated herein by reference to the extent such subject matter is not inconsistent herewith.
Number | Date | Country | |
---|---|---|---|
Parent | 13535638 | Jun 2012 | US |
Child | 13648527 | US | |
Parent | 12983220 | Dec 2010 | US |
Child | 13535638 | US | |
Parent | 11548214 | Oct 2006 | US |
Child | 12983220 | US |