Natural language question answering method and apparatus

Information

  • Patent Grant
  • 10210245
  • Patent Number
    10,210,245
  • Date Filed
    Monday, March 9, 2015
    9 years ago
  • Date Issued
    Tuesday, February 19, 2019
    5 years ago
Abstract
A natural language question answering method and apparatus belong to the field of information retrieval and processing. The method includes: acquiring a natural language question N; converting the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N; searching an RDF graph G for a subgraph matching the query semantic graph Qs; and obtaining an answer to the natural language question N according to the subgraph.
Description
CROSS-REFERENCE TO RELATED APPLICATION

This application is a national stage of PCT Application No. PCT/CN2015/073884, filed on Mar. 9, 2015, which claims priority to a Chinese patent application No. 201410085902.X, filed on Mar. 10, 2014, the content of all of which is incorporated herein by reference in their entirety.


FIELD OF THE TECHNOLOGY

Embodiments of the present invention relate to the field of information retrieval and processing, and in particular, to a natural language question answering method and apparatus.


BACKGROUND OF THE DISCLOSURE

A question answering system is an advanced form of an information retrieval system. It can answer, by using a natural language accurately and briefly, questions that users ask in the natural language.


A Resource Description Framework (RDF) repository is a basis for implementing the question answering system. The RDF repository, also referred to as a knowledge base, generally includes a large quantity of triplets that assist a computer in recognition and understanding. Each triplet is expressed in the form of a subject, a predicate, and an object, for example, a subject “An Actor Prepares”, a predicate “category”, and an object “book”. A current question answering system mainly includes two phases: a question understanding phase and a query executing phase. In the question understanding phase, the question answering system first translates a natural language question N into an SPARQLs query sentence, where the SPARQLs is a language for executing query in the RDF repository; and then, in the query executing phase, the question answering system inputs the SPARQLs query sentence to an SPARQLs search engine to find an answer to the natural language question N in the RDF repository.


SUMMARY

Accordingly, embodiments of the present invention provide a natural language question answering method and apparatus.


A natural language question answering method, including:


acquiring a natural language question N;


converting the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N;


searching an RDF graph G for a subgraph matching the query semantic graph Qs; and


obtaining an answer to the natural language question N according to the subgraph.


The converting the natural language question N into a query semantic graph Qs includes:


discovering a relation phrase in the natural language question N;


discovering correlative parameters of each relation phrase; and


constructing the query semantic graph Qs, each edge in the query semantic graph Qs corresponding to one relation phrase, and each vertex in the query semantic graph Qs corresponding to one correlative parameter.


The discovering a relation phrase in the natural language question N includes:


analyzing the natural language question to obtain a syntax dependence tree Y;


looking up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y, where, when a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:


condition 1: each node in the connected subtree y includes one word of the relation phrase, and the connected subtree y includes all words of the relation phrase; and


condition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.


The discovering correlative parameters of each relation phrase includes:


discovering, in the connected subtree y that is corresponding to each relation phrase and is in the syntax dependence tree Y, correlative parameters of the relation phrase according to a subject-class semantic relation and an object-class semantic relation;


the subject-class semantic relation including: subject, nominal subject, passive nominal subject, clause subject, passive clause subject, control subject, and possessive modifier; and


the object-class semantic relation including: object, prepositional object, direct object, and indirect object.


The searching an RDF graph G for a subgraph matching the query semantic graph Qs includes:


acquiring a candidate list Cvi corresponding to each correlative parameter on the assumption that the query semantic graph Qs includes n vertices {v1, . . . , vn}, and each vertex vi in the query semantic graph Qs corresponds to one correlative parameter, where i=1, . . . , n;


acquiring a candidate list Cvivj corresponding to each relation phrase relvivj, each edge vivj in the query semantic graph Qs corresponding to one relation phrase relvivj, where 1≤i≠j≤n; and


searching the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj.


The acquiring a candidate list Cvj corresponding to each correlative parameter includes:


acquiring the candidate list Cvi corresponding to each correlative parameter argi by using an entity linking technology, the candidate list Cvi corresponding to each correlative parameter argi including a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvi being sorted according to a descending order of degrees of confidence.


The acquiring a candidate list Cvivj corresponding to each relation phrase relvivj includes:


acquiring the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, the candidate list Cvivj of each relation phrase relvivj including a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvivj being sorted according to a descending order of degrees of confidence.


The searching the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvj and the candidate list Cvivj includes:


searching the RDF graph G for a subgraph that includes vertices {u1, . . . , un} and satisfies a preset condition, the preset condition including the following three conditions:


condition 1: if v1 is mapped to an entity ui in the RDF graph G, where i=1, . . . , n, ui should belong to the candidate list Cvi;


condition 2: if v1 is mapped to a class ci in the RDF graph G, where i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; and


condition 3: for each edge vivj ∈Qs, uiuj ∈G or ujui ∈G, and a predicate or predicate path Pij corresponding to the edge vivj is mapped to uiuj or ujui in the candidate list Cvivj.


Before the acquiring a candidate list Cvivj of each relation phrase relvivj by using a preset paraphrasing dictionary, the method further includes:


setting a dictionary T={rel1, . . . , reln}, where i=1, . . . , n, and each reli is one relation phrase, and mapping the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli;


computing a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;


searching, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli; and


constructing the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.


The computing a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L includes:


setting, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli):

Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)},


finding, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P (vij, v′ij), and

making PS(reli)=∪j=1, . . . ,mPath(vij,v′ij);


computing, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows:

tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;


computing an idf value of L in the dictionary T={rel1, . . . , reln} as follows:








idf


(

L
,
T

)


=

log




T






{



rel
i


T



L


PS


(

rel
i

)




}



+
1




;




computing a tf−idf value of L as follows:

tf−idf(L,PS(reli),T)=tf(L,PS(reli))×idf(L,T); and


using the tf−idf value as the degree of confidence of the mapping from the relation phrase reli to the predicate or predicate path L.


A natural language question answering apparatus, including:


a question acquiring module, configured to acquire a natural language question N;


a question converting module, configured to convert the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N;


a subgraph matching module, configured to search an RDF graph G for a subgraph matching the query semantic graph Qs; and


an answer generating module, configured to obtain an answer to the natural language question N according to the subgraph.


The question converting module includes:


a phrase discovering unit, a parameter discovering unit, and a semantic graph constructing unit,


the phrase discovering unit being configured to discover a relation phrase in the natural language question N;


the parameter discovering unit being configured to discover correlative parameters of each relation phrase; and


the semantic graph constructing unit being configured to construct the query semantic graph Qs, each edge in the query semantic graph Qs corresponding to one relation phrase, and each vertex in the query semantic graph Qs corresponding to one correlative parameter.


The phrase discovering unit includes:


a syntax analyzing sub-unit, configured to analyze the natural language question to obtain a syntax dependence tree Y; and


a phrase query sub-unit, configured to look up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y, where, when a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:


condition 1: each node in the connected subtree y includes one word of the relation phrase, and the connected subtree y includes all words of the relation phrase; and


condition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.


The parameter discovering unit is configured to discover, in the connected subtree y that is corresponding to each relation phrase and is in the syntax dependence tree Y, correlative parameters of the relation phrase according to a subject-class semantic relation and an object-class semantic relation;


the subject-class semantic relation including: subject, nominal subject, passive nominal subject, clause subject, passive clause subject, control subject, and possessive modifier; and


the object-class semantic relation including: object, prepositional object, direct object, and indirect object.


The subgraph matching module includes:


a first list acquiring unit, configured acquire a candidate list Cvi corresponding to each correlative parameter on the assumption that the query semantic graph Qs includes n vertices {v1, . . . , vn}, and each vertex v1 in the query semantic graph Qs corresponds to one correlative parameter, where i=1, . . . , n;


a second list acquiring unit, configured to acquire a candidate list Cvivj corresponding to each relation phrase relvivj each edge vivj in the query semantic graph Qs corresponding to one relation phrase relvivj, where 1≤i≠j≤n; and


a subgraph matching unit, configured to search the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj.


The first list acquiring unit is configured to acquire the candidate list Cvi corresponding to each correlative parameter argi by using an entity linking technology, the candidate list Cvi corresponding to each correlative parameter argi including a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvi being sorted according to a descending order of degrees of confidence.


The second list acquiring unit is configured to acquire the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, the candidate list Cvivj of each relation phrase relvivj including a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvivj being sorted according to a descending order of degrees of confidence.


The subgraph matching unit is configured to search the RDF graph G for a subgraph that includes vertices {u1, . . . , un} and satisfies a preset condition, the preset condition including the following three conditions:


condition 1: if v1 is mapped to an entity ui in the RDF graph G, where i=1, . . . , n, ui should belong to the candidate list Cvi;


condition 2: if vi is mapped to a class ci in the RDF graph G, where i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; and


condition 3: for each edge vivj∈Qs, uiuj ∈G or ujui ∈G, and a predicate or predicate path Pij corresponding to the edge vivj is mapped to uiuj or ujui in the candidate list Cvivj.


The apparatus further includes:


a path mapping module, configured to set a dictionary T={rel1, . . . , reln}, where i=1, . . . , n, and each reli is one relation phrase, and map the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli;


a degree of confidence computing module, configured to compute a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;


a path searching module, configured to search, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli; and


a dictionary constructing module, configured to construct the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.


The degree of confidence computing module includes:


a path searching unit, configured to set, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli):

Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)}


find, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P (vij, v′ij), and

make PS(reli)=∪j=1, . . . ,mPath(vij,v′ij);


a tf value computing unit, configured to compute, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows:

tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;


an idf value computing unit, configured to compute an idf value of L in the dictionary T={rel1, . . . , reln} as follows:








idf


(

L
,
T

)


=

log




T






{



rel
i


T



L


PS


(

rel
i

)




}



+
1




;




a Tf−idf value computing unit, configured to compute a tf−idf value of L as follows:

tf−idf(L,PS(reli),T)=tf(L,PS(relj))×idf(L,T); and


use the tf−idf value as the degree of confidence of the mapping from the relation phrase reli to the predicate or predicate path L.


By converting a natural language question N into a query semantic graph Qs, searching an RDF graph G for a subgraph matching the query semantic graph Qs, and obtaining an answer to the natural language question N according to the subgraph, the present disclosure solves a problem of consumption of a large computation amount for disambiguation in an understanding stage, and achieves an effect of providing a brand new natural language question answering mechanism in which disambiguation is not needed when the natural language question N is converted into the query semantic graph Qs, and a disambiguation process is completed naturally in a process of searching for the subgraph matching the query semantic graph Qs.





BRIEF DESCRIPTION OF THE DRAWINGS

To illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings required for describing the embodiments of the present invention. Apparently, the accompanying drawings in the following description show merely some embodiments of the present invention, and a person of ordinary skill in the art may still derive other drawings from these accompanying drawings without creative efforts.



FIG. 1 is a method flowchart of a natural language question answering method provided in the existing technology;



FIG. 2A is a method flowchart of a natural language question answering method according to an embodiment of the present invention;



FIG. 2B is a schematic diagram of implementation of the embodiment shown in FIG. 2A in an actual application;



FIG. 3A is a method flowchart of a natural language question answering method according to another embodiment of the present invention;



FIG. 3B to FIG. 3E are schematic diagrams of implementation of the embodiment shown in FIG. 3A in an actual application;



FIG. 4 is a schematic structural diagram of a natural language question answering apparatus according to an embodiment of the present invention;



FIG. 5 is a schematic structural diagram of a natural language question answering apparatus according to another embodiment of the present invention; and



FIG. 6 is a schematic structural diagram of a server according to an embodiment of the present invention.





DESCRIPTION OF EMBODIMENTS

To make the objectives, the technical solutions, and advantages of the present disclosure clearer, the implementation manners of the present disclosure will be described in more detail below with reference to the accompanying drawings.


As shown in FIG. 1, after a natural language question “who was married to an actor that played in Philadelphia?” is input to a question answering system, the question answering system first translates the natural language question into an SPARQLs query sentence 12:


“?x starred in Philadelphia (movie);


?x type actor;


?x is the spouse of ?y”,


Then, an SPARQLs search engine 14 outputs a query result 16: “?y=Melanie⋅Griffith”.


In the process of implementing natural language question answering, at least the following problems are found: due to the ambiguity of the natural language, for example, “Philadelphia” may refer to Philadelphia (city), Philadelphia (movie), and Philadelphia 76ers, in the process of translating the natural language question N into the SPARQLs query sentence 12, the foregoing technology needs to eliminate ambiguity according to the meaning of the natural language question N. However, to eliminate ambiguity is not a simple task; it not only needs to consume a large computation amount, but also interferes with the accuracy of the result if disambiguation fails.


Embodiments of the present invention provide a brand new natural language question answering mechanism. Different from the existing technology that uses an SPARQLs query sentence and an SPARQLs search engine to acquire an answer to a natural language question N, the embodiments of the present invention use a query semantic graph Q and an RDF graph G to acquire an answer to a natural language question N, which is specifically described as follows:


Referring to FIG. 2A, FIG. 2A shows a method flowchart of a natural language question answering method according to an embodiment of the present invention. The natural language question answering method is applied to a server, and the method includes:


Step 202: Acquire a natural language question N.


The natural language question N is a question that a user asks a question answering system by using a natural language.


For example, the natural language question N is “who was married to an actor that played in Philadelphia?”.


Step 204: Convert the natural language question N into a query semantic graph Qs, where each edge in the query semantic graph Qs represents one semantic relation in the natural language question N.


The natural language question N includes at least one semantic relation, and the query semantic graph Qs is used for equivalently representing the semantic relation in the natural language question N. One semantic relation is one triplet <reli, arg1, arg2>, where reli is a relation phrase, and arg1 and arg2 are two correlative parameters of the relation phrase. One semantic relation represents a relation between two entities, or an attribute value of one entity.


Each edge in the query semantic graph Qs represents one semantic relation in the natural language question N. Each edge in the query semantic graph Qs corresponds to the relation phrase in one semantic relation, and two vertices on each edge each correspond to one correlative parameter.


With reference to FIG. 2B, a query semantic graph Qs obtained by converting the natural language question N “who was married to an actor that played in Philadelphia?” includes two edges: a semantic relation represented by a first edge v1v2 is <was married to, who, actor>, where “was married to” is a relation phrase, and “who” and “actor” are two correlative parameters of the relation phrase “was married to”; a semantic relation represented by a second edge v2v3 is <played in, that, Philadelphia>, where “played in” is a relation phrase, and “that” and “Philadelphia” are two correlative parameters of the relation phrase “played in”. Because “actor” and “that” refer to the same entity, they share a vertex. This is the “anaphora resolution” that has been intensively studied so far, and is no longer described in detail.


Step 206: Search an RDF graph G for a subgraph matching the query semantic graph Qs.


The RDF graph G is an RDF repository expressed in the form of a graph.


For example, in FIG. 2B, it is assumed that the given RDF graph G includes triplets related to “Philadelphia”, “Philadelphia (movie)”, “Philadelphia 76ers”, “actor”, and the like, as shown in block 22. Then, by using a subgraph matching technology, the server searches the RDF graph G for a subgraph matching the query semantic graph Qs, as shown in block 24.


Step 208: Obtain an answer to the natural language question N according to the subgraph.


Because the subgraph matches the query semantic graph Qs, the subgraph includes the answer to the natural language question N.


For example, according to a node u1 “Melanie-Griffith” which is in the subgraph 24 and corresponds to an interrogative “who” in the query semantic graph Qs, an answer 26 to the natural language question N is obtained


In conclusion, by converting a natural language question N into a query semantic graph Qs, searching an RDF graph G for a subgraph matching the query semantic graph Qs, and obtaining an answer to the natural language question N according to the subgraph, the natural language question answering method provided by this embodiment solves a problem of consumption of a large computation amount for disambiguation in an understanding stage, and achieves an effect of providing a brand new natural language question answering mechanism in which disambiguation is not needed when the natural language question N is converted into the query semantic graph Qs, and a disambiguation process is completed naturally in a process of searching for the subgraph matching the query semantic graph Qs.


Referring to FIG. 3A, FIG. 3A shows a method flowchart of a natural language question answering method according to another embodiment of the present invention. The natural language question answering method is applied to a server, and the method includes:


Step 301: Acquire a natural language question N.


The server may directly acquire the natural language question N asked by a user. Alternatively, the server acquires the natural language question that a user asks by using a terminal.


For example: the user inputs an audio-form natural language question N by using a microphone on a mobile phone, and then the mobile phone transmits the audio-form natural language question N to the server through a wired network or a wireless network. The server converts the audio-form natural language question N into a text-form natural language question N by using an audio recognition technology, and finally acquires the natural language question N.


To simplify description, that the natural language question N is “who was married to an actor that played in Philadelphia?” is constantly used as an example for illustration herein. (Note: The English question “who was married to an actor that played in Philadelphia” is used in actual experiments, and limited by the sentence pattern, some examples herein still use the original English question for discussion.)


Step 302: Convert the natural language question N into a query semantic graph Q.


The server converts the acquired natural language question N into the query semantic graph Qs having equivalent semantics. Each edge in the query semantic graph Qs represents one semantic relation in the natural language question N. Each edge in the query semantic graph Qs corresponds to the relation phrase in one semantic relation, and two vertices on each edge separately correspond to one correlative parameter of the relation phrase on the edge.


This step may include the following sub-steps, as shown in FIG. 3B:



302
a: Discover a relation phrase in the natural language question N.



302
b: Discover correlative parameters of each relation phrase.



302
c: Construct the query semantic graph Qs, where each edge in the query semantic graph Qs corresponds to one relation phrase, and each vertex in the query semantic graph Qs corresponds to one correlative parameter.


In sub-step 302a, the server first analyzes the natural language question N to obtain a syntax dependence tree Y, and then the server looks up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y. The server may obtain the syntax dependence tree Y of the natural language question N by using a syntax parser provided by Stanford University.


When a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:


condition 1: each node in the connected subtree y includes one word of the relation phrase, and the connected subtree y includes all words of the relation phrase; and


condition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.


In other words, the task of sub-step 302a is to give a syntax dependence tree Y of the natural language question N and a relation phrase dictionary T={rel1, . . . , reln}, and the objective of the server is to look up the relation phrase dictionary T to find a relation phrase that exists in the syntax dependence tree Y.


The basic idea of an algorithm for implementing the task of sub-step 302a is as follows:


For each node wi in Y, find a candidate mode list PLi, and then detect, in the PLi, whether there is a subtree rooted at wi and including words the same as all those in the relation phrase. Specifically speaking, a depth-first search strategy is used to probe each path rooted at wi, and if there is no relation phrase that includes a word w′ and all words on the path from the node w′ to the node wi (where w′ is a sub-node of wi), stop searching branches at the node w′. Herein, rel[w] is used to represent that a word w′ on a subtree rooted at wi exists in the relation phrase rel.


The specific algorithm is as follows:


Input: a syntax dependence tree Y and an inverted index based on a relation phrase dictionary T;


Output: all occurrence positions of relation phrases (which belong to the relation phrase dictionary T) that exist in the syntax dependence tree Y.


1: for each node wi in Y do


2: Find a list of relation phrases PLi occurring in T by the inverted list.


3: for each node wi in Y do


4: Set PL=PLi


5: for each relation phrase rel∈PL do


6: Set rel[wi]=1//indicating the appearance of word wi in rel.


7: Call Probe(wi, PL)


8: for each relation phrase rel in PLi do


9: if all words w of rel have rel[wi]=1 then


10: rel is an occurring relation phrase in Y


11: Return rel and a subtree rooted at wi includes (and only includes) all words in rel.


Probe(wi, PL′)


1: for each child w′ of wi do


2: PL″=PL′∩PLi;


3: if PL″=Ø, then:


4: return


5: else


6: for each relation phrase rel∈PL″ do


7: Set rel[w′]=1


8: Call Prode (w′, PL″)


Referring to FIG. 3C, by using the natural language question N “who was married to an actor that played in Philadelphia” as an example, the server may find occurrence positions of the relation phrase “was married to” and the relation phrase “played in” in the syntax dependence tree Y by using the foregoing algorithm. The relation phrase “was married to” corresponds to a connected subtree that is in the syntax dependence tree Y and includes a total of three nodes, namely, the node “was”, the node “married”, and the node “to”; and the relation phrase “played in” corresponds to a connected subtree that is in the syntax dependence tree Y and includes a total of two nodes, namely, the node “played” and the node “in”.


In sub-step 302b, for the connected subtree y that is in the syntax dependence tree Y and corresponding to each relation phrase, correlative parameters of the relation phrase are found in the connected subtree y according to a subject-class semantic relation and an object-class semantic relation.


The subject-class semantic relation includes: subject subj, nominal subject nsubj, passive nominal subject nsubjpass, clause subject csubj, passive clause subject csubjpass, control subject xsubj, and possessive modifier poss.


The object-class semantic relation includes: object obj, prepositional object pobj, direct object dobj, and indirect object iobj.


In other words, after finding a connected subtree y of one relation phrase rel, the server checks whether there is a subject-class relation between each node w in the connected subtree y and sub-nodes of each node w, to identify the correlative parameter arg1. Similarly, the correlative parameter arg2 may be identified by using an object-class relation. If one correlative parameter has more than one candidate, the server selects a candidate which is closest to the relation phrase rel as the correlative parameter.


For example, in FIG. 3C, for the relation phrase “was married to”, the correlative parameter “who” is identified among the sub-nodes of the node “married” according to the subject-class semantic relation, and the correlative parameter “actor” is identified among the sub-nodes of the node “to” according to the object-class semantic relation. In the same manner, for the relation phrase “played in”, the correlative parameter “that” is identified among the sub-nodes of the node “played” according to the subject-class semantic relation, and the correlative parameter “Philadelphia” is identified among the sub-nodes of the node “in” according to the object-class semantic relation.


In addition, if the server does not identify the correlative parameters arg1 and arg2 of a relation phrase according to the subject-class relation and object-class relation, the server further identifies the correlative parameters by using the following heuristic rules:


Rule 1: Extend an occurrence position t of the relation phrase by using some frequently used words such prepositions and auxiliary words, and identify a subject-class relation or an object-class relation by using newly added tree nodes.


Rule 2: If a parent node, which is in Y, of a root node oft has a subject-class relation or an object-class relation, add the root node as arg1.


Rule 3: If a parent node of a root node oft has a subject-class relation with a child node oft, add the child node as arg1.


Rule 4: If one of arg1 and arg2 is empty, add the closest interrogative or the first nominal phrase in t as arg1 or arg2.


If correlative parameters arg1 and arg2 still cannot be found, the server further discards the relation phrase.


In sub-step 302c, the server constructs a query semantic graph Qs according to the relation phrases identified from the natural language question N and the correlative parameters corresponding to each relation phrase, where each edge in the query semantic graph Qs corresponds to one relation phrase, and each vertex in the query semantic graph Qs corresponds to one correlative parameter.


If two correlative parameters refer to a same entity, the two correlative parameters share a vertex in the query semantic graph Qs.


So far, the server completes the conversion of the natural language question N into the query semantic graph Qs. Then, the server needs to find out, in the RDF graph G, candidates of each vertex and each edge in the query semantic graph Qs, which is as follows:


Step 303: Acquire a candidate list Cvi corresponding to each correlative parameter.


Assuming that the query semantic graph Qs includes n vertices {v1, . . . , vn}, and each vertex vi in the query semantic graph Qs corresponds to one correlative parameter, where i=1, . . . , n, the server acquires the candidate list Cvi corresponding to each correlative parameter.


Specifically, the server acquires the candidate list Cvi corresponding to each correlative parameter argi by using an entity linking technology, where the candidate list Cvi of each correlative parameter argi includes a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponds to a degree of confidence, and mappings in each candidate list Cvi are sorted according to a descending order of degrees of confidence.


For example, with reference to FIG. 3D, the query semantic graph Qs corresponding to the natural language question N “who was married to an actor that played in Philadelphia?” includes three vertices: a vertex v1, a vertex v2, and a vertex v3.


The correlative parameter corresponding to the vertex v1 is the interrogative “who”, and the server uses all entities in the RDF graph as a candidate list of the vertex v1.


The correlative parameter corresponding to the vertex v2 is “actor”, and the server uses an entity “actor”, an entity “An Actor Prepares”, and an entity “Antonio Banderas” in the RDF graph as a candidate list of the vertex v2, and sorts the entities according to degrees of confidence. “Antonio Banderas” is classified as “actor”.


The correlative parameter corresponding to the vertex v3 is “Philadelphia”, and the server uses an entity “Philadelphia”, an entity “Philadelphia (movie)”, and an entity “Philadelphia 76ers” in the RDF graph as a candidate list of the vertex v3, and sorts the entities according to degrees of confidence. The entity “Philadelphia 76ers” is a name of a basketball team.


Step 304: Acquire a candidate list Cvivj corresponding to each relation phrase relvivj.


Each edge vivj in the query semantic graph Qs corresponds to one relation phrase relvivj, where 1≤i≠j≤n, and the server acquires a candidate list Cvivj corresponding to each relation phrase relvivj.


Specifically, the server may first construct a paraphrasing dictionary, where the paraphrasing dictionary includes a mapping from the relation phrase to at least one candidate predicate or candidate predicate path in the RDF graph G, and each mapping has a degree of confidence.


Then, the server acquires the candidate list Cvivj of each relation phrase relvivj in the query semantic graph Qs by using the paraphrasing dictionary, where the candidate list Cvivj of each relation phrase relvivj includes a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponds to a degree of confidence, and mappings in the candidate list Cvivj are sorted according to a descending order of degrees of confidence.


For example, with reference to FIG. 3D, the query semantic graph Qs corresponding to the natural language question N “who was married to an actor that played in Philadelphia?” includes two edges: an edge v1v2 and an edge v2v3.


The relation phrase corresponding to the edge v1v2 is “was married to”, and the server uses a predicate “is the spouse of” in the RDF graph as a candidate list of the edge v1v2.


The relation phrase corresponding to the edge v2v3 is “played in”, and the server uses a predicate “played for” (note: the word play in English means both being a part of a team and representing a character in a movie), a predicate “starred in” and a predicate “directs” in the RDF graph as a candidate list of the edge v2v3.


It should be noted that, in step 303 and step 304, the server does not perform disambiguation, which is different from the existing technology. For example, although the entity “Philadelphia 76ers” is apparently irrelevant to the natural language question N, the server currently does not process this ambiguity.


Step 305: Search an RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj.


The server searches the RDF graph G for a subgraph that includes vertices {u1, . . . , un} and satisfies a preset condition, where the preset condition includes the following three conditions:


Condition 1: if v1 is mapped to an entity ui in the RDF graph G, where i=1, . . . , n, ui should belong to the candidate list Cvi.


Condition 2: if v1 is mapped to a class ci in the RDF graph G, where i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; and


Condition 3: for each edge vivj∈Qs, uiuj ∈G or uiuj∈G, and a predicate or predicate path Pij corresponding to the edge vivj is mapped to uiuj or ujui in the candidate list Cvivj.


The server may search the RDF graph G for the subgraph matching the query semantic graph Qs by using a top-k algorithm. The top-k algorithm can be used to find top K most possible matching subgraphs; each matching subgraph has a score, where the score comes from a confidence probability on each edge and each vertex in the matching subgraph. The score is defined as follows:


Assuming that one query semantic graph Qs has n vertices {v1, . . . , vn}, and a subgraph which is in the RDF graph G and includes n vertices {u1, . . . , un} is a subgraph matching Qs, the score is as follows:










Score


(
M
)


=



log
(





v
i



V


(

Q
s

)











δ


(


arg
i

,

u
i


)


×







v
i



v
j


_



E


(

Q
s

)










δ


(


rel



v
i



v
j


_


,

P
ij


)





)







=








v
i



V


(

Q
s

)






log


(

δ


(


arg
i

,

u
i


)


)



+







v
i



v
j


_



E


(

Q
s

)






log


(

δ


(


rel



v
i



v
j


_


,

P
ij


)


)











where argi is a correlative parameter of the vertex vi, ui is an entity or a class in the RDF graph G, custom character is a relation phrase of the edge vivj, and Pij is a predicate on the edge uiuj or ujui.


The server may also optimize a search space of the foregoing top-k algorithm according to the following heuristic method:


The first pruning method is to reduce the number of candidates in each candidate list Cvi/Cvivj as far as possible, and if a vertex ui that belongs to Cvi cannot belong to any subgraph matching the query semantic graph Qs, the server directly filters out the vertex.


The second method is to end the search process as early as possible by using a score threshold of top k matches.


The basic idea is as follows: Set a buoy for each candidate list Cvi/Cvivj. For each vertex vi in the query semantic graph Qs, set pi pointing to the candidate list Cvi; for each edge vivj in the query semantic graph Qs, set pij pointing to the candidate list Cvivj.


For ease of description, we use pi to represent a node in the RDF graph G that the cursor pi points to. At the beginning, all cursors point to the head of the candidate list. For each node pi, any isomorphism algorithm, such as VF2 algorithm, is invoked, to find a subgraph that includes the node pi and matches the query semantic graph. In this process, nodes that the cursor pi points to are considered in turn, where i=1, . . . , |V(Qs)|. We update a current threshold θ according to a newly found subgraph match. In addition, for subgraph matches not discovered, we may compute an upper bound Upperbound for matching scores of the subgraph matches not discovered.






Upbound
=





p
i




log


(

δ


(


arg
i

,

p
i


)


)



+




p
ij




log


(

δ


(


rel



v
i



v
j


_


,

P
ij


)


)








If θ>upperbound, it means that scores of all subgraph matches found will not exceed matching scores of subgraphs that have been discovered so far. In other words, the server already knows the top-k matches. Therefore, the server may terminate the running of the algorithm. Otherwise, the server moves all cursors one step forward in corresponding queues, and repeats the foregoing operation.


The top-k algorithm used by the server may be as follows:


Input: one query semantic graph Qs and one RDF graph G.


Output: Top-k query results, that is, top k most possible matching subgraphs of Qs over G.


1: for each candidate list Lri, i=1, . . . , |E(Qs)| do


2: Sorting all candidate relations in Lri in a non-ascending order


3: for each candidate list Largj, j=1, . . . , |V(Qs)| do


4: Sorting all candidate entities/classes (i.e., vertices in G′) in Largj in a non-ascending order.


5: Set cursor ci to the head of Lri and cursor cj to the head of Largj, respectively.


6: Set the upper bound Upbound(Q) according to Equation 3 and the threshold θ=−∞


7: while true do


8: for each cursor cj in list Largj, j=1, . . . , |V(Qs)| do


9: Perform an exploration based subgraph isomorphism algorithm from cursor cj, such as VF2, to find subgraph matches (of Qs over G), which contains cj.


10: Update the threshold θ to be the top-k match score so far.


11: Move all cursors ci and cj by one step forward in each list.


12: Update the upper bound Upbound(Q) according to Equation 3.


13: if θ≥Upbound(Q) then


14: Break//TA-style stopping strategy


For example, in FIG. 3E, the server may discover, in the RDF graph G, that a subgraph including vertices U1, U2, U3, and C1 is a matching result of the query semantic graph Qs. The vertex v3 “Philadelphia” in the Qs is mapped to an entity U3<Philadelphia>; the vertex V2“actor” is mapped to an entity U2<Antonio Banderas>, where the class of the entity U2<Antonio Banderas> is <actor>; the vertex V1 “who” is mapped to an entity U1<Melanie⋅Griffith>; in addition, edges in Qs where the two relation phrases: “was married to” and “played in” are located are mapped to edges where the predicates <is the spouse of> and <starred in> are located, respectively.


Step 306: Obtain an answer to the natural language question N according to the subgraph.


Because the subgraph matches the query semantic graph Qs, the subgraph includes the answer to the natural language question N.


Generally, the server obtains the answer to the natural language question N according to a node that is in the subgraph and corresponding to the interrogative in the query semantic graph Qs.


Apparently, the entity U1<Melanie⋅Griffith> is an answer to the natural language question N. It should be noted that, the server does not perform disambiguation in step 303 or step 304; however, if mapping from a vertex in the query semantic graph Qs to an entity is ambiguous, a matching subgraph that includes the ambiguous entity will not be discovered in the subgraph matching process. In other words, the discovered subgraph matching the query semantic graph Qs will not include the ambiguous entity. Therefore, a disambiguation process is naturally completed in the subgraph matching process, and the server does not need to perform disambiguation additionally.


In conclusion, by converting a natural language question N into a query semantic graph Qs, searching an RDF graph G for a subgraph matching the query semantic graph Qs, and obtaining an answer to the natural language question N according to the subgraph, the natural language question answering method provided by this embodiment solves a problem of consumption of a large computation amount for disambiguation in an understanding stage, and achieves an effect of providing a brand new natural language question answering mechanism in which disambiguation is not needed when the natural language question N is converted into the query semantic graph Qs, and a disambiguation process is completed naturally in a process of searching for the subgraph matching the query semantic graph Qs.


In the natural language question answering method provided by this embodiment, correlative parameters are further searched for by providing four heuristic rules, which improves the success rate of the correlative parameters, and improves the accuracy of understanding the natural language question N.


The natural language question answering method provided by this embodiment further provides two optimization methods to optimize a search space when the server performs subgraph matching, which improves the search efficiency of subgraph matching.


It should further be noted that, in the foregoing embodiment, the server further needs to construct a paraphrasing dictionary in advance.


In other words, before the server acquires the candidate list Cvivj of each relation phrase relvivj by using the preset paraphrasing dictionary, the method further includes:


1. Set a dictionary T={rel1, . . . , reln}, where i=1, . . . , n, and each reli is one relation phrase, and map the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli.


The supported entity set of the relation phrase may be provided by existing Patty and ReVerb systems. These supported entity sets are existing research results extracted from many Neuro-Linguistic Programming (NLP) semantic relations.


The predicate path refers to a predicate edge consisting of at least two continuous simple paths. For example, if a predicate from A to B is “is the father of”, and a predicate from B to C is “is the father of”, a predicate edge consisting of two simple paths from A to C represents a predicate “is the grandfather of”. In the existing technology, during mining of mappings from relation phrases to predicates, only simple paths are considered, however, because many relation phrases cannot be explained as single predicates, this embodiment innovatively proposes explaining complex predicates such as “is the grandfather of” and “is the uncle of” by using continuous predicate edges.


However, the inventor finds that a lot of noises are brought in during analysis of continuous predicates. In other words, for a complex predicate, many continuous predicate edges that are obtained through analysis and satisfy characteristics are different from the actual meaning of the complex predicate. Therefore, the inventor further proposes a method of mining mappings from relation phrases to predicates by using tf−idf. The method is specifically as follows:


2. Compute a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;


set, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli):

Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)}},


find, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P (vij, v′ij), and

make PS(reli)=∪j=1, . . . mPath(vij,v′ij);


compute, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows:

tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;


compute an idf value of L in the dictionary T={rel1, . . . , reln)} as follows:








idf


(

L
,
T

)


=

log




T






{



rel
i


T



L


PS


(

rel
i

)




}



+
1




;




compute a tf−idf value of L as follows:

tf−idf(L,PS(reli),T)=tf(L,PS(reli))×idf(L,T); and


use the tf−idf value as the degree of confidence of the mapping from the relation phrase reli to the predicate or predicate path L.


3. Search, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli.


4. Construct the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.


An algorithm corresponding to this part is as follows:


Input: a relation phrase dictionary T={rel1, . . . , reln} and each text-form reli, where i=1, . . . , n, a supported entity set Sup(reli)={{(vi1, v′i1), . . . , (vim, v′im)}, and an RDF graph G.


Output: top k most possible predicate/predicate paths {Li1, . . . , Lik} having same semantics as each relation phrase reli (i=1, . . . , n).


1: for each relation phrase reli, i=1, . . . , n in T do


2: for each entity pair (vij, v′ij) in Sup(reli) do


3: Find all simple predicate path patterns (with length less than a predefined parameter θ) between vij and v′ij, denoted as


P(vij, v′ij).


4: PS(ti)=∪j=1, . . . mPath(vij, v′ij)


5: for each relation phrase reli do


6: for each predicate path pattern L in PS(ti) do


7: Compute tf−idf value of L


8: for relation phrase reli, record the k predicate path patterns with the top-k highest tf−idf values.


In conclusion, the natural language question answering method provided by this embodiment not only describes complex relation phrases by using continuous predicate edges, but also proposes a method of constructing a paraphrasing dictionary by using tf−idf which effectively improves the efficiency and accuracy for acquiring a candidate list of a relation phrase.


QALD is the only test reference for an RDF-based question answering system. The inventor uses a QLAD-3 test set to test the foregoing natural language question answering method, and finds that the foregoing natural language question answering method can correctly answer 32 questions among a total of 99 questions in the test set, while the most advanced non-natural language question answering system, squa1|2sparq1, can answer 77 questions; however, the squa1|2sparq1 system is a non-natural language question answering system, and the user needs to specify the entity and predicate in the question; therefore, squa1|2sparq1 is incomparable to the natural language question answering system herein. The second most advanced system, casia, is a natural language question answering system, and can answer 30 questions among a total of 99 questions in the test set. Apparently, the natural language question answering system proposed herein is advanced universally in terms of accuracy. Meanwhile, in terms of running time, the natural language question answering system also has an advantage which crosses the order of magnitudes compared with casia. For example, for the 81st question in the QLAD-3 test set, it takes 418 seconds for casia to convert the natural language question into an SPARQLs query sentence, while it takes less than 1 second for the natural language question answering system herein to find out the answer to the 81st question.


Referring to FIG. 4, FIG. 4 shows a structural block diagram of a natural language question answering apparatus according to an embodiment of the present invention. The natural language question answering apparatus may be implemented as all or a part of a server by using software, hardware, or a combination thereof. The apparatus may include: a question acquiring module 420, a question converting module 440, a subgraph matching module 460, and an answer generating module 480.


The question acquiring module 420 is configured to acquire a natural language question N.


The question converting module 440 is configured to convert the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N.


The subgraph matching module 460 is configured to search an RDF graph G for a subgraph matching the query semantic graph Qs.


The answer generating module 480 is configured to obtain an answer to the natural language question N according to the subgraph.


In conclusion, by converting a natural language question N into a query semantic graph Qs, searching an RDF graph G for a subgraph matching the query semantic graph Qs, and obtaining an answer to the natural language question N according to the subgraph, the natural language question answering apparatus provided by this embodiment solves a problem of consumption of a large computation amount for disambiguation in an understanding stage, and achieves an effect of providing a brand new natural language question answering mechanism in which disambiguation is not needed when the natural language question N is converted into the query semantic graph Qs, and a disambiguation process is completed naturally in a process of searching for the subgraph matching the query semantic graph Qs.


Referring to FIG. 5, FIG. 5 shows a schematic structural diagram of a natural language question answering apparatus according to another embodiment of the present invention. The natural language question answering apparatus may be implemented as all or a part of a server by using software, hardware, or a combination thereof. The apparatus may include: a question acquiring module 420, a question converting module 440, a subgraph matching module 460, and an answer generating module 480. The modules 420, 440, 460, and 480 exist in a memory (a memory 602 as shown in FIG. 7) of the server, and are executed by one or more built-in processors (a central processing unit 601 as shown in FIG. 7) of the server, so as to implement the natural language question answering method.


The question acquiring module 420 is configured to acquire a natural language question N.


The question converting module 440 is configured to convert the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N.


The subgraph matching module 460 is configured to search an RDF graph G for a subgraph matching the query semantic graph Qs.


The answer generating module 480 is configured to obtain an answer to the natural language question N according to the subgraph.


The question converting module 440 includes a phrase discovering unit 442, a parameter discovering unit 444, and a semantic graph constructing unit 446.


The phrase discovering unit 442 is configured to discover a relation phrase in the natural language question N.


The parameter discovering unit 444 is configured to discover correlative parameters of each relation phrase.


The semantic graph constructing unit 446 is configured to construct the query semantic graph Qs, each edge in the query semantic graph Qs corresponding to one relation phrase, and each vertex in the query semantic graph Qs corresponding to one correlative parameter.


The phrase discovering unit 442 includes:


a syntax analyzing sub-unit, configured to analyze the natural language question to obtain a syntax dependence tree Y; and


a phrase query sub-unit, configured to look up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y, where, when a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:


condition 1: each node in the connected subtree y comprises one word of the relation phrase, and the connected subtree y includes all words of the relation phrase; and


condition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.


The parameter discovering unit 444 is configured to discover, in the connected subtree y that is corresponding to each relation phrase and is in the syntax dependence tree Y, correlative parameters of the relation phrase according to a subject-class semantic relation and an object-class semantic relation.


The subject-class semantic relation includes: subject, nominal subject, passive nominal subject, clause subject, passive clause subject, control subject, and possessive modifier.


The object-class semantic relation includes: object, prepositional object, direct object, and indirect object.


The subgraph matching module 460 includes:


a first list acquiring unit 462, configured acquire a candidate list Cvi corresponding to each correlative parameter on the assumption that the query semantic graph Qs includes n vertices {v1, . . . , vn}, and each vertex vi in the query semantic graph Qs corresponds to one correlative parameter, wherein i=1, . . . , n;


a second list acquiring unit 464, configured to acquire a candidate list Cvivj corresponding to each relation phrase relvivj, each edge vivj in the query semantic graph Qs corresponding to one relation phrase relvivj, wherein 1≤i≠j≤n; and


a subgraph matching unit 466, configured to search the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj.


The first list acquiring unit 462 is configured to acquire the candidate list Cvi corresponding to each correlative parameter arg; by using an entity linking technology, the candidate list Cvi corresponding to each correlative parameter argi including a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvi being sorted according to a descending order of degrees of confidence.


The second list acquiring unit 464 is configured to acquire the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, the candidate list Cvivj of each relation phrase relvivj including a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvivj being sorted according to a descending order of degrees of confidence.


The subgraph matching unit 466 is configured to search the RDF graph G for a subgraph that includes vertices (u1, . . . , un) and satisfies a preset condition, the preset condition including the following three conditions:


condition 1: if vi is mapped to an entity ui in the RDF graph G, where i=1, . . . , n, ui should belong to the candidate list Cvi;


condition 2: if vi is mapped to a class ci in the RDF graph G, where i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; and


condition 3: for each edge vivj ∈Qs, uiuj ∈G or ujui ∈G, and a predicate or predicate path Pij corresponding to the edge vjvi is mapped to uiuj or ujui in the candidate list Cvivj.


The apparatus further includes:


a path mapping module 492, configured to set a dictionary T={rel1, . . . , reln}, where i=1, . . . , n, and each reli is one relation phrase, and map the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli;


a degree of confidence computing module 494, configured to compute a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;


a path searching module 496, configured to search, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli; and


a dictionary constructing module 498, configured to construct the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.


The degree of confidence computing module 494 includes:


a path searching unit, configured to set, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli):

Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)},


find, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P (vij, v′ij), and

make PS(reli)=∪j=1, . . . mPath(vij,v′ij);


a tf value computing unit, configured to compute, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows:

tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;


an idf value computing unit, configured to compute an idf value of L in the dictionary T={rel1, . . . , reln} as follows:








idf


(

L
,
T

)


=

log




T






{



rel
i


T



L


PS


(

rel
i

)




}



+
1




;




a Tf−idf value computing unit, configured to compute a tf−idf value of L as follows:

tf−idf(L,PS(reli),T)=tf(L,PS(reli))×idf(L,T); and


use the tf−idf value as the degree of confidence of the mapping from the relation phrase reli to the predicate or predicate path L.


It should be noted that: when the server provided by the foregoing embodiment performs natural language question answering, the foregoing division of functional modules is merely used as an example for description; in an actual application, the foregoing functions may be completed by different functional modules, so as to complete all or some functions described above. In addition, the natural language question answering apparatus provided by the foregoing embodiment belongs to a same conception as the embodiment of the natural language question answering method; for the specific implementation process, refer to the method embodiment, and details are not described herein again.


Referring to FIG. 6, FIG. 19 shows a structural block diagram of a server provided by an embodiment of the present invention. The server 600 includes a central processing unit (CPU) 601, a system memory 604 that includes a random access memory (RAM) 602 and read-only memory (ROM) 603, and a system bus 605 connecting the system memory 604 and the CPU 605. The server 600 further includes a basic input/output (I/O) system 606 that facilitates information transmission between components in the computer, and a mass storage device 607 configured to store an operating system 613, an application program 614, and another program module 615.


The basic I/O system 606 includes a display 608 configured to display information, and an input device 609, such as a mouse and a keyboard, used by a user to input information. The display 608 and the input device 609 are both connected to the CPU 601 through an I/O controller 610 that is connected to the system bus 605. The basic I/O system 606 may further include the I/O controller 610 to receive and process input from multiple other devices such as a keyboard, a mouse, and an electronic stylus. Similarly, the I/O controller 610 further provides output to a display, a printer, or other types of output devices.


The mass storage device 607 is connected to the CPU 601 through a mass storage controller (not shown) that is connected to the system bus 605. The mass storage device 607 and a related computer readable medium thereof provide non-volatile storage for a function server or a verification server 600. In other words, the mass storage device 607 may include a computer readable medium (not shown) such as a hard disk or a CD-ROM drive.


Generally, the computer-readable medium may include a computer storage medium and a communication medium. The computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. The computer storage medium includes a RAM, a ROM, an electrically erasable programmable read-only memory (EEPROM), a flash memory or other solid-state storage technologies, a CD-ROM, a digital versatile disk (DVD) or other optical storage, a magnetic cassette, a magnetic tape, magnetic disk storage or other magnetic storage devices. Certainly, a person skilled in the art may know that the computer storage medium is not limited to those described above. The foregoing system memory 604 and the mass storage device 607 may be generally referred to as a memory.


According to the embodiments of the present invention, the server 600 may further be connected to a remote computer through a network such as the Internet and run on the remote computer. In other words, the server 600 may be connected to a network 612 through a network interface unit 611 on the system bus 605, or, may be connected to other types of network or remote computer systems (not shown) by using the network interface unit 611.


The memory further includes one or more programs, where the one or more programs are stored in the memory, and the one or more programs include instructions for performing the natural language question answering method provided by the embodiment of the present invention.


The sequence numbers of the foregoing embodiments of the present invention are merely for the convenience of description, and do not imply the preference among the embodiments.


A person of ordinary skill in the art may understand that all or some of the steps of the foregoing embodiments may be implemented by using hardware, or may be implemented by a program instructing relevant hardware. The program may be stored in a computer readable storage medium. The storage medium may be a read-only memory, a magnetic disk, an optical disc, or the like.


The foregoing descriptions are merely preferred embodiments of the present invention, but are not intended to limit the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims
  • 1. A natural language question answering method, applied to a server, the server comprising one or more processors, a memory, and program instructions stored in the memory, and the program instructions being executed by the one or more processors; the method comprising: acquiring a natural language question N;converting the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N;searching a Resource Description Frame (RDF) graph G for a subgraph matching the query semantic graph Qs, comprising: acquiring a candidate list Cvi corresponding to each correlative parameter on the assumption that the query semantic graph Qs comprises n vertices {v1, . . . , vn}, and each vertex vi in the query semantic graph Qs corresponds to one correlative parameter, wherein i=1, . . . , n;acquiring a candidate list Cvivj corresponding to each relation phrase relvivj, each edge vivj in the query semantic graph Qs corresponding to one relation phrase relvivj, wherein 1≤i≠j≤n; andsearching the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj; andobtaining an answer to the natural language question N according to the subgraph;wherein the acquiring a candidate list Cvi corresponding to each correlative parameter comprises: acquiring the candidate list Cvi corresponding to each correlative parameter arch by using an entity linking technology, the candidate list Cvi corresponding to each correlative parameter argi comprising a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvi being sorted according to a descending order of degrees of confidence.
  • 2. The method according to claim 1, wherein the converting the natural language question N into a query semantic graph Qs comprises: determining a relation phrase in the natural language question N;determining correlative parameters of each relation phrase; andconstructing the query semantic graph Qs, each edge in the query semantic graph Qs corresponding to one relation phrase, and each vertex in the query semantic graph Qs corresponding to one correlative parameter.
  • 3. The method according to claim 2, wherein the determining a relation phrase in the natural language question N comprises: analyzing the natural language question to obtain a syntax dependence tree Y;looking up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y, wherein, when a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:condition 1: each node in the connected subtree y comprises one word of the relation phrase, and the connected subtree y comprises all words of the relation phrase; andcondition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.
  • 4. The method according to claim 3, wherein the determining correlative parameters of each relation phrase comprises: discovering, in the connected subtree y that is corresponding to each relation phrase and is in the syntax dependence tree Y, correlative parameters of the relation phrase according to a subject-class semantic relation and an object-class semantic relation;the subject-class semantic relation comprising: subject, nominal subject, passive nominal subject, clause subject, passive clause subject, control subject, and possessive modifier; andthe object-class semantic relation comprising: object, prepositional object, direct object, and indirect object.
  • 5. The method according to claim 1, wherein the acquiring a candidate list Cvivj corresponding to each relation phrase relvivj comprises: acquiring the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, the candidate list Cvivj of each relation phrase relvivj comprising a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvivj being sorted according to a descending order of degrees of confidence.
  • 6. The method according to claim 5, before the acquiring the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, further comprising: setting a dictionary T={rel1, . . . , reln}, wherein i=1, n, and each reli is one relation phrase, and mapping the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli;computing a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;searching, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli; andconstructing the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.
  • 7. The method according to claim 6, wherein the computing a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L comprises: setting, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli): Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)},finding, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P(vij, v′ij) and making PS(reli)=∪j=1, . . . ,mPath(vij,v′ij);computing, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows: tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;computing an idf value of L in the dictionary T={rel1, . . . , reln} as follows:
  • 8. The method according to claim 1, wherein the searching the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj comprises: searching the RDF graph G for a subgraph that comprises vertices {u1, . . . , un} and satisfies a preset condition, the preset condition comprising the following three conditions:condition 1: if vi is mapped to an entity ui in the RDF graph G, wherein i=1, . . . , n, ui should belong to the candidate list Cvi;condition 2: if vi is mapped to a class ci in the RDF graph G, wherein i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; andcondition 3: for each edge vivj∈Qs, uiuj∈G or ujui∈G, and a predicate or predicate path Pij corresponding to the edge vivj is mapped to uiuj or ujui in the candidate list Cvivj.
  • 9. A server, comprising: one or more processors; anda memory coupled to the one or more processors, wherein the one or more processors are configured to:acquire a natural language question N;convert the natural language question N into a query semantic graph Qs, each edge in the query semantic graph Qs representing one semantic relation in the natural language question N;search a resource description frame (RDF) map G for a subgraph matching the query semantic graph Qs, comprising: acquiring a candidate list Cvi corresponding to each correlative parameter on the assumption that the query semantic graph Qs comprises n vertices {v1, . . . , vn}, and each vertex vi in the query semantic graph Qs corresponds to one correlative parameter, wherein i=1, . . . , n;acquiring a candidate list Cvivj corresponding to each relation phrase relvivj, each edge vivj in the query semantic graph Qs corresponding to one relation phrase relvivj, wherein 1≤i≠j≤n; andsearching the RDF graph G for a subgraph matching the query semantic graph Qs according to the candidate list Cvi and the candidate list Cvivj; andobtain an answer to the natural language question N according to the subgraph;wherein the acquiring a candidate list Cvi corresponding to each correlative parameter comprises: acquiring the candidate list Cvi corresponding to each correlative parameter argi by using an entity linking technology, the candidate list Cvi corresponding to each correlative parameter argi comprising a mapping from the correlative parameter argi to at least one candidate entity or candidate class in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvi being sorted according to a descending order of degrees of confidence.
  • 10. The server according to claim 9, wherein the one or more processors are further configured to: discover a relation phrase in the natural language question N;discover correlative parameters of each relation phrase; andto construct the query semantic graph Qs, each edge in the query semantic graph Qs corresponding to one relation phrase, and each vertex in the query semantic graph Qs corresponding to one correlative parameter.
  • 11. The server according to claim 10, wherein the one or more processors are further configured to: analyze the natural language question to obtain a syntax dependence tree Y; andlook up, according to a preset relation phrase dictionary, the relation phrase dictionary for a relation phrase that exists in the syntax dependence tree Y, wherein, when a relation phrase in the relation phrase dictionary exists in the syntax dependence tree Y, one and only one connected subtree y in the syntax dependence tree Y satisfies the following conditions:condition 1: each node in the connected subtree y comprises one word of the relation phrase, and the connected subtree y comprises all words of the relation phrase; andcondition 2: it is impossible to find a subtree y′ in the syntax dependence tree Y, the subtree y′ also satisfying the condition 1 and the connected subtree y being a subtree of the subtree y′.
  • 12. The server according to claim 11, wherein, the one or more processors are further configured to discover, in the connected subtree y that is corresponding to each relation phrase and is in the syntax dependence tree Y, correlative parameters of the relation phrase according to a subject-class semantic relation and an object-class semantic relation;the subject-class semantic relation comprising: subject, nominal subject, passive nominal subject, clause subject, passive clause subject, control subject, and possessive modifier; andthe object-class semantic relation comprising: object, prepositional object, direct object, and indirect object.
  • 13. The server according to claim 9, wherein the one or more processors are further configured to acquire the candidate list Cvivj corresponding to each relation phrase relvivj by using a preset paraphrasing dictionary, the candidate list Cvivj of each relation phrase relvivj comprising a mapping from the relation phrase relvivj to at least one candidate predicate or candidate predicate path in the RDF graph G, each mapping corresponding to a degree of confidence, and mappings in each candidate list Cvivj being sorted according to a descending order of degrees of confidence.
  • 14. The server according to claim 13, wherein the one or more processors are further configured to: set a dictionary T={rel1, . . . , reln}, wherein i=1, n, and each reli is one relation phrase, and map the relation phrase reli to a predicate or predicate path L in the RDF graph G according to a supported entity set Sup(reli) corresponding to each relation phrase reli;compute a degree of confidence of the mapping from the relation phrase reli to each predicate or predicate path L;search, according to the degrees of confidence, continuous predicate edges formed in the RDF graph G by top k most possible predicate/predicate paths, the continuous predicate edges having same semantics as the relation phrase reli; andconstruct the paraphrasing dictionary according to the relation phrase reli and the continuous predicate edges.
  • 15. The server according to claim 14, wherein the one or more processors are further configured to: set, for each relation phrase reli, that the supported entity set corresponding to the relation phrase reli is Sup(reli): Sup(reli)={{(vi1,v′i1), . . . ,(vim,v′im)},find, in the RDF graph G for each entity pair vij, v′ij in the Sup(reli), all simple paths between the entity pair vij, v′ij, the simple paths being expressed as P(vij, v′ij), and making PS(reli)=∪j=1, . . . ,mPath(vij,v′ij);a tf value computing unit, configured to compute, for the predicate or predicate path L, a tf value of L in the PS(reli) as follows: tf(L,PS(reli))=|{(Path(vij,v′ij)|L∈Path(vij,v′ij))}|;an idf value computing unit, configured to compute an idf value of L in the dictionary T={rel1, . . . , reln} as follows:
  • 16. The server according to claim 9, wherein the one or more processors are further configured to search the RDF graph G for a subgraph that comprises vertices {u1, . . . , un} and satisfies a preset condition, the preset condition comprising the following three conditions:condition 1: if vi is mapped to an entity ui in the RDF graph G, where i=1, . . . , n, ui should belong to the candidate list Cvi;condition 2: if vi is mapped to a class ci in the RDF graph G, where i=1, . . . , n, ui is an entity whose class is ci, and ci should belong to the candidate list Cvi; andcondition 3: for each edge vivj∈Qs, uiuj∈G or ujui∈G, and a predicate or predicate path Pij corresponding to the edge vivj is mapped to uiuj or ujui in the candidate list Cvivj.
Priority Claims (1)
Number Date Country Kind
2014 1 0085902 Mar 2014 CN national
PCT Information
Filing Document Filing Date Country Kind
PCT/CN2015/073884 3/9/2015 WO 00
Publishing Document Publishing Date Country Kind
WO2015/135455 9/17/2015 WO A
US Referenced Citations (11)
Number Name Date Kind
8429179 Mirhaji Apr 2013 B1
9342556 Bhatia May 2016 B2
20090012778 Feng et al. Jan 2009 A1
20110078166 Oliver Mar 2011 A1
20110235799 Sovio Sep 2011 A1
20110238985 Sovio Sep 2011 A1
20110289520 Grigoriev Nov 2011 A1
20130332490 Hu Dec 2013 A1
20150237021 Sovio Aug 2015 A1
20170124158 Mirhaji May 2017 A1
20170300469 Mirhaji Oct 2017 A1
Foreign Referenced Citations (4)
Number Date Country
102262634 Nov 2011 CN
102722542 Oct 2012 CN
101339551 Jan 2013 CN
102262634 May 2013 CN
Non-Patent Literature Citations (11)
Entry
André Freitas et al., Querying linked data graphs using semantic relatedness: A vocabulary independent approach, Aug. 14, 2013, Data & Knowledge Engineering (journal homepage www.elsevier.com/locate/datak), pp. 126-141 (Year: 2013).
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2015/073884 dated Apr. 28, 2015.
Xu, Kun et al.: “Automatic Understanding of Natural Language Questions for Querying Chinese Knowledge Bases”, ACTA Scientiarum Naturalium Universitatis Pekinensis, vol. 50, No. 1, Jan. 31, 2014 (Jan. 31, 2014), pp. 85-92.
European Patent Office (EPO) European search report for 15761024.7 dated Mar. 17, 2017.
European Patent Office (EPO) European Office Action for 15761024.7 dated Feb. 7, 2018 8 pages.
Freitas Andre et al, “Querying Linked Data Using Semantic Relatedness: A Vocabulary Independent Approach”, Data & Knowledge Engineering, vol. 88, Aug. 14, 2013, pp. 126-141.
Bettina Fallinga et al, “Semantic Web search based on ontological conjunctive queries”, Web Semantics: Science, Services and Agents on the World Wide Web, vol. 9, No. 4, Sep. 14, 2011, pp. 453-473.
Schoefegger Karin et al, “A survey socio-semantic information retrieval”, Computer Science Review, Elsevier, Amsterdam, NL, vol. 8, Apr. 30, 2013, pp. 25-46.
Marie-Catherine De Marneffe et al, “Generating Typed Dependency Parses from Phrase Structure Parses”, Proceedings of LREC 2006, Jun. 1, 2006 3 pages.
Zou Lei. “Natural language question answering over RDF—a graph data driven approach”, Proceedings of the 2014 ACM SIGMOD international conference on management of data, Jun. 27, 2014. p. 313-324 12 Pages.
The State Intellectual Property Office of the People's Republic of China (SIPO) Office Action 1 for 201410085902.X dated Oct. 9, 2018 7 Pages (including translation).
Related Publications (1)
Number Date Country
20160328467 A1 Nov 2016 US