Patent Application
20130282633
For a more complete understanding, reference is now made to the following description taken in conjunction with the accompanying Drawings in which:
a illustrates a diagram of the system linkage to clumps;
Referring now to the drawings, wherein like reference numbers are used herein to designate like elements throughout, the various views and embodiments of a method and apparatus for defining an artificial brain via a plurality of concept nodes connected together through predetermined relationships are illustrated and described, and other possible embodiments are described. The figures are not necessarily drawn to scale, and in some instances the drawings have been exaggerated and/or simplified in places for illustrative purposes only. One of ordinary skill in the art will appreciate the many possible applications and variations based on the following examples of possible embodiments.
Referring now to
The brain processing system 102 interfaces with a nodal array 104 comprised of a plurality of individual neuron nodes, hereinafter referred to as “neurons. The nodal array 104 is operable to store in each of the plurality of neurons a unique concept. This concept can relate to a hard object or an abstract idea. For example, the concept could be the concept of a tree in a plant based context. It could also be the concept of a “truck.” Further, it could be related to the concept of a “fire truck.” Any complex number of words could define a particular concept and this particular concept does not necessarily require that it be a single word but, rather, it can be a combination of words and could even include the concept embodied in a phrase.
As will be described herein below, each concept has some type of relationship with other concepts, when taken in the context of a sentence. In order to have any type of discourse or to relay a particular overall concept in a discourse, a plurality of individual concepts are organized in a particular sequence and organization. Therefore, it is the structure and sequence of an individual concept in a particular manner which defines an idea or a “conceptual flow.” The details of this conceptual flow will be described in more detail herein below.
Referring now to
When defining a particular grouping, i.e., a sentence, all that is necessary is to define the concepts that are defined in this grouping, a sentence making a logical grouping in natural language, and then define the relationships between the various concepts. Once the concepts in a grouping, i.e., a sentence, and the relationships between those concepts, is defined, the overall idea or concept of the sentence or logical grouping is defined. This can be further extended to a paragraph, a chapter in an overall book, etc. Again, this will all be described in much more detail herein below. Referring back to
Referring now to
The sequence flow would then go between various neurons. In this example, there is the “dog” neuron, the “domestic animal” neuron, the “companions” neuron, the “Fido” neuron, the “canine” neuron and the “hairy” neuron. The flow of a sentence would be the first relationship between “dog” and “domestic animal” along a first path represented by {circle around (1)}. There would be a second flow from “domestic animal” back to “dog”, as there is a relationship from “dog” to “domestic animal” which is one of parentage, i.e., “dog” is a member of the “domestic animal” category. The relationship between “domestic animal” and “dog” is one where “dog” is a child of the “domestic animal” category (a back_reln). There will then be the next relationship defined which is between “dog” and “companions.” There will be a relationship at the “dog” neuron indicating that the “companions” neuron is an associative relationship, which will have a back relationship with the {circle around (4)} relationship. Thus, dog will have a stored relationship to “companions” and companions will have a stored relationship back to “dog.” It is understood that stored in the “dog” neuron is the relationship to other neurons and not the relationship “from” other neurons, i.e., all that is important for the dog neuron is to know that it has an associative relationship to the companion neuron and not to know that the companionship neuron has a back relationship to the dog neuron. In a similar manner, the next relationship in the flow will be the relationship of the “dog” neuron to the “canine” neuron, which is one of parent/child. The “dog” neuron indicates that there is a parent relationship to the “canine” neuron and the “canine” neuron will indicate a child relationship back to the “dog” relationship. Thus, the “child” relationship is not stored in the “dog” relationship. There will then be a relationship defined between “canine” and “hairy,” this being an associative relationship. The last relationship will be the instance_of relationship to the “Fido” neuron. There will be a relationship in one direction to “Fido” that is an instance relationship and the back relationship from “Fido” to “dog” will be a “instance_of” relationship. These relationships will be described in more detail herein below.
As noted herein above, the nodal array and the overall information stored for the artificial brain is comprised of a plurality of concept neurons that are interconnected together with various relationships. That is to say, one particular neuron may have thousands of potential relationships to other neurons. For example, the “dog” neuron may be related to the “canine” neuron, the “dog body” neuron, the “fur” neuron, etc. However, until some conceptual flow occurs such as that associated with a particular sentence, these relationships mean nothing. It is when the concept flow is disposed in some organized and structural conceptual manner that these concepts give meaning to a particular overall idea that is conveyed by the sequence, structure and organization of the particular grouping and flow of concepts.
Referring now to
Referring back to
Thus, referring back to
From the standpoint of how a neuron is defined, a word can be parsed from a particular sentence that exists within a particular paragraph or discourse and “conceptualized” into the particular neuron, wherein the properties of that neuron may be defined and the relationships between that particular concept and other concept neurons defined. There in the conceptualization process, the relationships are defined between various other neurons that exist within the particular discourse. It may be that the discourse results in a new relationship that will be presented. For example, if the discourse indicated that “the dog has a red collar.” The indication would be that there is a POSSN (possession) reln between the “dog” neuron and a “red collar” neuron, which may have previously existed. These relationships would result in the “dog” neuron, which already exists, possibly having a POSSN reln pointing to the “red collar” neuron and a POSSN_OF reln stored at the “red collar” neuron pointing back to the “dog” neuron. This is how a relationship would be defined as a result of a particular input discourse, this being described herein below in more detail. In general, as noted herein above multiple times, every unique concept to be known is embodied as a single neuron. While all neurons are essential identical, the truly important information is not what is stored within them (or their specific characteristic) but how they are interconnected with other neurons. It is these connections that define a concept for what it is, i.e., its unique relationships with other concepts within the system. These relationships can be fixed or they can change. Some can be temporal, i.e., they disappear, or not. As will be described herein below, most of these relns, i.e., the relational connections, are non-weighted, but there are some that are weighted. There are some that are bi-directional connections between two neurons such as the ASOC reln and other concepts required to separate relns, such as the PARENT and CHILD relns. In general, when discussing the general context or flow of concepts, one has to view communications of a concept or a thought. In general, words are used to communicate a concept or a thought. The predominant memory mechanism of human beings is a storage of the concept or thought, not the words by which it was conveyed. There are memory mechanisms that do store exact text, such as memorizing the Declaration of Independence, but this is not addressed herein. The matter of conceptual memory exists across all cultures, because all languages intend to convey something through the use of words. The use of the concept nodes and the relational interconnections is provided to represent overall concepts, ranging from the simplest to the more complex concepts. A listener, in general is like a parser—a translator of text—trying to arrive at the greater meaning that words in and of themselves attempt to convey. Text comes in through various channels and it is broken down and processed.
Concepts are remembered in one of four basic types of neurons. The first is a simple neuron. This is one wherein a single concept is stored in a single neuron or node, where the neuron is simply a place-holder for that concept. As described herein above, relational connections, “relns,” are provided to other concepts (or words) that give the neuron meaning within the overall context of the brain to provide a knowledge set. These simple neurons store relationships between concepts in a factual manner. For example, the word “dog” forms a “dog” neuron, and that neuron is linked through a reln to other neurons that help to establish the concept of the dog in the system. This may be simply a single neuron or multiple neurons requiring multiple relns. Neuron IDs (NID) for both simple and complex neurons share the same number space.
Complex neurons are another type of neuron, which are required in that there are occasionally repeated references to nouns that have a qualifying adjective, such as “black dog.” A complex neuron is created to handle such cases. The complex neuron and its associated concept carries all the implications of “dog” and the qualification of “red,” for example, but without the overhead of its own copy of all the linkages. This is due to the fact that the complex “red dog” concept can be viewed in a single concept, albeit requiring two words to convey that concept in text.
By comparison, when referring to a specific dog (such as “that dog”) that has particular traits or associations, a simple concept neuron is created. The simple neuron refers to a specific instance of “dog” and is connected to “dog” by an INST_OF “dog” and from “dog” to “that dog” by an INST reln.
An additional type of neuron is referred to as the “clump” neuron. This is the concept of gathering “clumps” of information about an action that has taken place and garners with it all the history of that particular action or event. As such, every clump neuron contains a connection to a verb (a distinguishing characteristic). Such clumps are the repository for actions taken by nouns, and each such clump implies what can be viewed as the content of an independent clause, with a variant handling dependent clauses. In general, the brain parses a sentence and outputs a single Conceptual Clump which stores the parsed “thought.” Conceptual Clumps store the thought and not the words, i.e., it is the semantic organization of concepts for that particular sentence, it being understood that a sentence is normally thought of as defining a particular single thought (keeping in mind that some sentences convey multiple thoughts and they have to be dealt with separately). In storing just the thought or the sequence of concepts, the capability of capturing a diverse collection of input streams or concepts (i.e., “concept flows”) is provided for. The possibility of analyzing these different streams as being conceptually equal is also accounted for, and providing a diverse range of sentence regeneration for creating an output is also provided for. This will be described in more detail herein below in defining conceptual flows. In general, as will further be described herein below, one Conceptual Clump is a basic sentence clump that, at its most basic level, takes the words and phrases of a sentence and converts them to a series of semantic roles, one of which is the PAS verb wherein the main verb that assigns most of the other roles of a particular clump are defined. Further, as will be described herein below, each Conceptual Clump is defined as providing a role. It is both a neuron that has a defined set of concepts associated therewith such that it points to these particular concept neurons with a particular reln defining the relationship of that particular concept with the “clump” (that being a sentence) and also defines the role of the clump. There are multiple roles associated with clumps, however, which will be described and set forth herein below.
Referring now to
Referring now to
Referring now to
In general, the parser is a natural language parser which can utilize many different types of approaches. The type that is used in the present embodiment is a predicate-argument-parser using a Backus Nauer Form (BNF) layout description for the language. Actually, while some areas of the parser make use of conventional “predicate argument structure” (PAS) common in linguistics, it is not essential for operation. This BNF form is one of choice and many others could be used and are anticipated such that the use of such is not limiting and other parsers could be utilized to provide the parsing operation.
The tokenizer block 704 is the operation wherein incoming sentences are broken down into “tokens,” items corresponding to individual words and punctuation, but in which the words have already been located by some form of internal serial number, if they were already known. Therefore, this simplified list (non-text) is then forwarded to the parser for subsequent processing.
The parse block 706 is the device that breaks the sentences into its simpler parts, wherein the parser is defined by a top-down description of the language. In the particular parser algorithm utilized, a Backus Nauer Form (BNF) is utilized which is a natural language C++ parser for the description of the English grammar which is utilized to translate English grammar to computer language. Thus, the tokenizer initially breaks the sentence into items corresponding to individual words and punctuation and then the parser breaks the sentences down into their simpler parts and the constituent parts are saved in some manner. This is, in general, a “semantic” parser, and is driven largely by the grammar and syntax of valid sentences. These stacks of constituent parts are then passed on to the conceptualize block 708 to allow them to be converted into clump neurons. A “clump” as defined herein is a form of a neuron that remembers something that relates to action, aspect, or is only true for a specific time, such as “tomorrow.” Technically, any phrase—dependent or independent—can be formed into a clump, though that may be a poor use of memory space. Those phrases or clumps that simply define something, such as “all birds fly,” are more simply stored as relationships between simple neurons. A large class of information can be stored in this manner, although storing in neurons (not clump neurons) becomes impractical under many cases. In the system described herein, all sentences are formed into clumps; subsequent processes determine if they should be converted to neurons relns and deleted, or be permitted to remain. The main operations of conceptualization are:
In general, the parser builds many useful lists of data that include a history of recent content in a context pool (a context pool is comprised of relns recently used, i.e., the history thereof, and which may or may not have a temporal aspect thereto, i.e., they will decay after a period of time if they have not reoccurred in the discourse so as to be reset. This provides some knowledge of the recent history of the discourse.), and some of the utilities are called on by the conceptualize block 708 in order to resolve classes (general families) of neurons into specific neurons relating to the current topic. Some clumps can be reused (shared) by several other clumps as can sentence fragments that occur multiple times, such as prepositional phrases. “Bats fly at night” and “Of course, you may find bats near the bridge this evening because bats fly at night” share a common “semantic” clump. A higher level “controller” clump manages the connection of phrases and concepts to each other whereas the “Outline Clump” summarizes the content of the paragraph. As with regular neurons, clump neurons may be later discarded—not remembered—if not re-validated over a twenty-one-day period (described herein below).
Certain types of clumps are purely definitive in nature, and their data is more properly stored in a set of relationships between simple neurons. An example of this would be “The sky and water are blue.” These are definitive statements, as is “My dog has four paws.” This example shows possession, a static condition which can be stored as a central concept. Example statements that can be converted to relns include:
A clump that was converted to relns may be deleted or may be retained for further use by the control or outline clump. After the conversion process, the parse-to-clump process is concluded.
As noted herein above, connections between normal neurons in the brain are made through “relationals,” “reins” for short. Reins for other types of neurons (e.g., clump or identity neurons) have special reins and are given other names such as Roles for clump neurons. Each type of neuron has its own numbering sequence (or number space) for enumerating their relational connections.
For normal neurons, the reins are divided into two categories, those with weighted connections and those without weights. The structure of a rein in the data space is depicted in
Since only a 5-bit field is used to store the percentage, each count amounts to roughly 3.3%, going from a value of 0% for the bit value of “0” and a value of 100% for a bit value of “31.” Unless otherwise specified by the source data creating a linkage, the weight is set to approximately 50% by default. The various Op codes associated with the weighted neurons for one example of the system is set forth in Appendix A1.
Referring now to
Returning back to
The Cat Body neuron 906 has a plurality of constituent parts, these being neurons 914, 916 and 918 associated with paws, pointy ears and a tail, respectively. Each of these has a MADE_OF reln associated therewith, and each of these has a back-reln PART_OF back to the Cat Body neuron 906. In addition, the paws neuron 914 has a MADE_OF reln to a neuron 920 associated with claws, with a back-reln PART_OF to neuron 914.
As cat moves to higher level concepts, the Feline neuron 904, etc., a different higher level hierarchy is reached. However, the relns are not associated with hierarchy. This is merely embedded within the relns themselves. For example, the Feline neuron 904 is related to a higher level neuron, the Animal neuron 924, with a PARENT reln stored at the Feline neuron 904 pointing to the Animal neuron 924 and a CHILD reln stored at the Animal neuron 924 pointing to the Feline neuron 904. Understand that the reln stored at any given neuron defines the type of reln it is and then the NID associated with that reln defines the particular neuron to which it is related in the defined manner.
Additionally, the Animal neuron 924 can have a PARENT/CHILD relationship with respect to a Skunk neuron 926 (it being noted that there are probably different levels of PARENT/CHILD relationships therebetween but this has been reduced for simplicity purposes). The Skunk neuron 924 has an INST reln to a neuron 928 associated with the name Pepi. This is illustrated to show that neuron 924 also has associated therewith a POSSN relationship with respect to the neuron 912 for the white striped tail. Thus, both the Garfield neuron 908 and the Pepi neuron 928 have a relationship to the same white striped tail. Also illustrated is an ASSOC reln between the white Striped Tail Neuron 912 and the Tail neuron 918. This is a bidirectional neuron showing that there is an association between the two.
Referring further to
Referring now to
Referring now to
As noted in the index, there are different types of reins. Some are parent-like, some are child-like and some are sibling-like. The parent-like reins are reins such as PARENT, PART_OF, INST_OF and POSSN_OF. This means they point back to a higher hierarchical order. The child-like reins would be those such as CHILD, INST, MADE_OF and ATTRIB. The sibling-like reins would be those such as ASSOC and NAT_ATC.
In another query, suppose there is some issue as to whether Pepi is related to Garfield. This would require the neuron 928 and the neuron 908 to be searched backwards to a common PARENT/CHILD relationship, i.e., it would follow the parent-like link back to a common concept neuron. When it arrived at the common concept neuron, this would constitute the relationship.
The concept of “Clumps” is defined as a neuron that contains a reference to a verb (a requirement) and that takes a plurality of concepts, be it words or phrases of a sentence or otherwise, and converts them to a series of semantic roles. As such, it is capable of caprturing the knowledge embodied within an independent clause. With respect to clumps of sentences, this is again geared by the role of those sentences from a semantic standpoint. It should be understood that the term “relational interconnections” when used with concept neurons defines a relationship between one neuron and another neuron. In a similar manner, a “role” is still a relationship between a clump neuron and all of the concept neurons that make up the clump. The role defines the relationship of each of these neurons in the clump or each of the sentences within a clump. To understand the concept of clumps, it is first necessary to determine how clumps are formed and such discussion will follow.
Central to any sentence or thought is the main verb. It is the driver of the sentence car. For any given sentence, selecting a different main verb from that sentence can lead to a drastically different meaning The main verb assigns semantic “roles” or “responsibilities” to the various grammatical constituents, and when that verb changes, the entire sentence changes. The unique verb can occur in a certain manner, at a particular time, it can carry a theme, and there can be a main agent or something that experiences the verb's action. Modifiers such as roles, experiences and locations enable the transfer of words to concepts. The words are not stored—the concept behind the words are.
The PAS consists of multiple different roles that can be assigned to any given verb. An example of these roles are stated as follows:
The various roles can be assigned at different levels. At the sentence levels, there are applied “sentence roles.” These are in addition to the Semantic Roles assigned by the verb. At the sentence level, the Sentence Roles are frequently used to connect thoughts. Correlate pairs, such as “if-then” will establish a unique relationship between sentences. Adverbial conjunctions such as “however” denote contrast to a previous statement. These play a critical role in understanding relationships between thoughts.
Referring now to
The tokenization is initiated at a block 1202 to start at the most basic level. The target text must be prepped prior to attempting to parse it. A tokenizing process is applied to break the text into basic groupings. In language, these are often called words, i.e., the logical semantic element. These words do not have to be official words, as they could be an unknown collection of letters or a sequence of symbols. These “tokens” are the input that drives the parsing process. The next step in the process is associated with the Pre-Rules Layer, as indicated by a block 1204. The pre-parsed layer marks all the relevant tokens with flags that clue the later grammatical parser. For each sentence, the Pre-Rules need only be executed or run one time. They are not changed due to different verb attempts, because they hold true no matter what the main verb ends up being. The next step is the PAS Verb Selection at block 1206. The Predicate Argument Structure (PAS), or the main verb, is selected through a scoring system. The scoring system determines which possible verbs to try. Regardless of success, other options will also be selected and tried due to the recursive nature of the parser. For any given parse attempt, the PAS Verb selected is the main verb. Going forward, the parser assumes this to be true and proceeds as if it were so. This enables the parser to avoid the complexities of constantly attempting to resolve the issue during the grammatical parse. The next step is the Post-Rules Layer at block 1208. Post-rules are applied to the input tokens according to the assumed selected PAS Verb. In English, there are rules that can be applied once the verb is discerned. Since the parser assumes the main verb, in any given parse, the main verb has been discerned.
The next step in the process will be the grammatical parse, as represented by block 1210. This is a recursive process. When parsing text, there are many “decisions” that have to be made. Many words can operate at multiple word types. Improper grammar and punctuation is often used, and that cannot prevent the parser from its task. “Decision Nodes” have been implemented that track these decisions much through the course of the parse. An example of a decision node is the following:
The Cops claimed that criminal.
A decision point occurs after the main verb “claimed.” The PAS data for the verb “claimed” indicates that “claimed” assigns a role of “theme.” This theme represents the verb “claim.” As a theme, the entire role itself can be a nested clause with its own PAS verb. At the point “that” is encountered, the grammatical parser cannot be certain if a nesting clause exists, if that is a relative pronoun, if it is an irrelevant keyword, or if that is a determiner. A nested clause is referred to by Linguis as a “CP” or complementizer phrase. Complementizers can have their heads, or words that will lead them off, or they can be assumed. These cases would look as follows:
The decision node stores an enumerated set of information regarding the decision. Nodes are coated with the realm of possibility. Decision logic determines which possibility to choose and it records that choice in a log. Some nodes lead to ambiguity, while others do not. Upon failure, or success of any given parse, all ambiguous nodes will be chased. Essentially, the other choices are made and the parser attempts to parse that particular version. In handling decisions in this manner, the parsers hands are clean. There is really no decision because all decisions that leading to a valid parse are valid and acceptable at this stage.
The next step in the process is determining the role resolution. In that role resolution, the grammatical roles are converted to their PAS Role counterparts. A subject may become an actor, an experiencer, etc. The PAS verbs are defined through the use of various rules that are set subject to linguistic guidelines. These roles must then be scored, this scoring viewed as a competition. This is facilitated at a block 1212. The valid grammatical parse options are the competitors vying for the parse. There are multiple layers upon which the competition can be judged, as follows:
Although the grammer+PAS parser has been discussed herein, it should be understood that other parsers could be used. Grammatical parsing could be used, statistical based parsing (i.e., the type typically found in Google® type systems) could be used, or just the basic PAS parser could be used.
Conceptual Clumps, as described herein above, are a collection of concepts, wherein words are used to convey concepts. This collection of concepts is a collection that come together to form a thought. The output of the parser is a single clump at a block 1214 that is neatly stored in its conceptual form. During the scoring operation, either a fragment is returned, a desperation attempt is taken, etc. This is illustrated by blocks 1216, 1218 and 1220, each taking a separate path back to the initial tokenized block 1202 to pass through the process one additional time.
During the grammatical parse operation, there can be ambiguities, as well as at the verb selection. This ambiguity is resolved at an ambiguity node 1222. If the grammatical parse has been acceptable, it will pass to the ambiguity node 1222. Once any ambiguities are cured, this will pass back to the PAS Verb selection block 1206 and then to the scoring block 1212. The ambiguity nodes block 1222 determines if there are ambiguities and, if so, it will pass as to the last ambiguity node and then back to the grammatical parse. If the grammatical parse fails, it will pass back to the PAS Verb selection block also. With respect to ambiguities, there are two major types of ambiguity: lexical and structural. Lexical ambiguity occurs when one word can mean different things. Technically, the homograph head can be interpreted differently. Words like bank, jump, chair, or cup all have multiple meanings and uses. An example of such is, “American chair seeks arms.” There are actually two lexical ambiguities here. The first, i.e., is “chair” of the American variety or is “chair” of something that is American, e.g., leader, head-of-state? The other ambiguity is are these “arms” parts of a body or parts of a chair? In general, lexical ambiguities arise when words can function as two or more parts of speech. By comparison, structural ambiguity occurs when a phrase owner can be misapplied, such as in the phrase “He painted the actors in the nude.” The question would be as to whether the man was painting while nude or were the actors he painted nude. Generally, context can resolve structural ambiguity. Was the man known for painting nudes? Was he known to be an eccentric or radical artist? Is this statement being tied to another that may help ones understanding?
Various ambiguous combinations, bad punctuation, complex sentences and unknown words can lead to a wide variety of grammatical parses. For example, in the phrase “Chocko recognized Zools fly in the night.” There may be as many as fifteen different meanings that the sentence could have. For example, it could be “in the night, Chocko ‘recognized’ a certain type of fly.” or “Chocko ‘recognized’ Zools [that] fly. (flying Zools).”
As noted herein above, the clump basically gathers information about an action that took place and garners with all the history of that event. Such clumps are repositories for the actions taken by nouns and each such clump implies what can be viewed as the content of an independent clause, with a variant handling dependent clauses. Thus, a Conceptual Clump stores the parsed “thought,” And is generally used to hold the verb of the sentence, although it need not be. For convenience, clump neurons have their own number and space, as noted herein above.
At the basic level, the clump takes the words and phrases of the sentence and converts them to a series of semantic “roles.” Three types of semantic roles drive the basic sentence clump. The primary is the PAS Verb (ROLE_CLUMP_VERB). It is the main verb that assigns most of the other roles stored in the clump. It is important to note that different PAS verbs will assign different roles. Some verbs are not able to assign certain roles, and many times the roles that are assigned are restricted in various ways. These restrictions provide an aid in scoring a parse, as they will help an accurate sentence reconstruction. In addition to the main verb is the ROLE_TASPECT. It contains the tense and aspect that the PAS assigning verb utilized.
The last driving role at the basic sentence level is captured with one or more of the five modal roles: ROLE_M_INTENT, ROLE_M_ABILITY, ROLE_M_OBLIGATION, ROLE_M_DESIRE and ROLE_M_POSSIBILITY.
With these three roles, POSS, TASPECT, MODAL, it is possible to reconstruct the verb, the tense, the aspect and the modality. Something like, “Wanted to be jumping” could be captured with relns. The full sentence, “The rabbit may quickly jump over the carrot,” breaks down into Clump 2001 as illustrated in
As noted herein above numerous times, a single neuron represents a single concept, and connections to other neurons establish its meaning, representation and purpose within the context of the entire database. The clumps, on the other hand, utilize “semantic roles” to capture the history of some aspects of the concept within the brain. Establishing these semantic roles for nouns and verbs allows the system to more easily restate things. The allocation of roles (and rules for their use) to words are used as an existing hierarchy of words. With or without them, the system can choose alternative word-rendering or the same concept, but roles make that choice easier. The semantic roles thus act as a “glue” that takes the meaning implied by an existing neuron interconnection—with or without hierarchy—and guides their transformation into sentences where needed. Before proceeding further, it may be helpful to describe the general concept of semantic roles in terms of the PAS.
In general, all nouns in a sentence are considered to be arguments to a verb wherein each verb assigns one label, called a semantic role, to each noun. The total of semantic roles for a particular verb is the Predicate Argument Structure, or PAS for that verb. Again, note that PAS is just one of multiple parsers that could be utilized herein and it is anticipated that other parsers could be utilized.
In general, the goal of this system is to separate the semantics, or meaning, from the syntax, or form (such as word order). This system is designed to handle the various ways that one can change word order or even tense in English, but retain the same meaning. There are provided three examples of this word-order change. They are as follows:
There are three categories of roles provided, Universal Roles, Regular Role, and Specially-Assigned Roles. These are defined wherein Universal Roles are roles that may be used in any sentence no matter what the verb type. Regular Roles are roles that must be assigned by the verb; they may not appear in just any sentence, and Specially-Assigned Roles are those roles that may only be assigned by certain kinds of verbs. These roles are defined in Appendix B.
Returning to the clump definitions, in addition to the simple clump described in
The flow of thought usually ties sentences together with conjunctions, or through punctuation functioning as conjunctions (assumed conjunctions). These are at the sentence level and are used to coordinate, subordinate, or establish a condition (if/then). An explicit example of this is “Luke wanted peanuts, however he got cashews.” An assumed example of this is “Luke wanted peanuts. He got cashews.” One could choose to make two standard clumps and store a forward sentence role from one and a back link to the other, but that might be considered restrictive. There are various forms the two thoughts could come through, and if the system is allowed to pick any particular one to standardize on it might run into complexity issues that the system should not have to deal with (i.e., “Luke got peanuts but he wanted cashews.”).
A more accurate way to store the information is with a Controller Clump at a higher level, as described herein above. The assumption of the controller is that it progresses linearly, i.e., it is a linear flow of concepts. Connected clumps are stored in a linear fashion. If one is not explicitly expressed, the system will store them in a logical progression (i.e., Want, then, Realization, Expectation, then Reality). The controller is the essence of the connected thoughts and this is illustrated in
In
Referring now to
Each concept that played a role will have a link to the clump they played a role in. The bird clump can get back to the cause of its clump by going to the controller clump. A “conceptualizer” logic decides what to do with the clump. It may need to be broken down and stored as class level properties, if or even a process neuron.
Emotional impact of any clump can be stored by adding a ROLE_EMOT reln in the clump. For example, a particular statement of a particular political speech may have incited anger, and that could be stored in the exact offensive sentence level clump. However, the speech itself may not have been offensive, thus the “political speech” clump would not get the ROLE_EMOT.
Another asset is the ability of Experience neurons to point to clumps. If the experience of getting angry met the criteria, it may get its own Experience neuron (‘exper’). In this case we would link the exper to the clump and have the option of storing an EXPER_EMOT in the experience.
In the end, clumps are a collection of concepts/thoughts, and by interconnecting thoughts with neurons and assigning emotional impact to them we increase flexibility of the system and we are one step closer to emulating the human brain.
The Outline Clump (OC) is much like the table of contents for a book. It gives the overall purpose or subject of a discussion and provides a Table-of-Contents-like layout of the material. A single OC, for example, summarizes the contents of a training document the brain has absorbed. Another might outline a movie or an experience such as my “Hawaiian Vacation of 1999”.
The OC is a holding place for a series of Controller Clumps (CCs) arranged in a hierarchical fashion. At the lowest level, sentences are comprised of Semantic Clumps (SCs). Each paragraph, for example, is managed by a Controller Clump that includes a number of SCs and a final summary SC. If one is dealing with a book they are reading, higher-level CCs are arranged to account for sections of a chapter. Above them, an Outline Clump (OC) orders the chapter CCs into an overall book. It is possible to discard all the lower-level semantic clumps (SCs) except for the summary clumps, if desired, to provide a synopsis of the book. Each CC and OC has a summary clump attached to it, regardless of the level in the structure. For example, a “section” CC has below it a summary SC for every paragraph. The section itself has a summary SC that is a “roll-up” of the SCs for all the paragraphs below it. Finally, the Outline Clump (OC) has a summary SC that summarizes what the book itself is about.
The OC differs from other types of clumps in that it can wrap up both textual or discussion content as well as experiences (the “expers”, as discussed hereinabove). The types of knowledge in an Experience neuron is organized quite differently from clumps and conceptual neurons. It includes such things as expectations and anticipations (met or not) and various emotional and time stamps that relate to the experience. The OC has the least information of all clumps but contains the highest-level synopses of multiple types of knowledge. It is truly an outline or staging point from which to recall knowledge from many levels.
The use (and reuse) of clump neurons must be explicitly managed. A proposed new clump neuron may be similar to an existing clump neuron (“clump”). It may be shorter to create a MAKE_FROM neuron using the original clump as a pattern or template, rather than creating the full clump that largely replicates an existing item. The process for creating a non-duplicate clump takes the following steps:
When creating new clumps, it is necessary for the system to first determine if a similar one exists. The various degrees of matching of the proposed new clump and an existing clump are possible. A “matched” clump is one that has an identical role table set. That is, all of the roles are the same, and the role values are the same (the neuron IDs the roles point to). Alternatively, a partial match can exist wherein some roles match up exactly, but others do not. The system must then determine what threshold will create a new clump vs. reusing an existing one. As an example, consider the phrases “The rabbit bit Thomas,” “The rabbit bit Luke,” and “Skip bit the rabbit.” This is illustrated in
In the example of a non-marking clump, consider the phrase “Skip bit the rabbit” wherein only a single match exists, and that is on the verb. The other two roles do not match. For such non-matching clumps where there are more differences than matches, a new clump is created for the proposed clump.
Frame semantics is generally the study of how meaning is understood in the English language in terms of frames, wherein a frame can be understood as a “framework of concepts” that surround a particular word, which concepts are required for that word to be understood. In the presently disclosed embodiment, the verb is the word around which concepts are defined in the concept of a framework of concepts. Thus, a verb frame is a frame that consists of basic elements, which are called “frame elements” of the verb concept and the relations between those frame elements.
These frame elements are concepts that are intimately involved in any action, but these elements are not the action itself. For example, the verb “to give” cannot be understood without the concept of a giver, a receiver and a gift, as well as other frame elements. Without the giver, no one could perform the action. Giving would not occur at all. A gift given by a giver to no one is not given at all. Without a gift, nothing can be given. The presence of these elements is necessary for the full concept of giving to be understood. Thus, the frame of a verb is therefore defined by the entirety of the frame elements and the relationships of those elements to one another through the verb. To continue with the example of “give,” the giver is defined as “one who gives the gift to the recipient.” The gift is “the thing given by the giver to the recipient.” The recipient is “the one who is given the gift by the giver.” By using frames, a great deal of semantic information related to the verbs can be captured and utilized.
In general, specific activities are represented in frames, rather than “situation types.” The concepts that are specific to each activity are represented by the frame elements. The frame element is predicted by the activity word, this being the “verb.” Thus, for each verb, there will be a prediction in the frame elements that relates thereto. The frame elements capture concepts that remain constant even when different perspectives of a similar activity are being represented by the language. For example, when frame elements are used in conjunction with semantic roles, described hereinabove, the brain is able to understand that a “buyer” is an actor when the “buy” verb is used, but that it remains a “buyer” even when the “actor” position is taken by a “seller” when the “sells” verb is used to describe the same situation. Thus, both the “buy” verb and the “sell” verb would point to the same frame.
In general, as will be described, the overall brain will first parse the verb definitions and then it will create and utilize the frame elements.
Each verb has a set of semantic roles, which are utilized to determine a phrase's relationship to a verb as expressed in any sentence that the brain is reading. For example, take the situation as follows: a semantic role tells the brain that Bill is an actor in the sentence, “Bill bought a puppy from John.” The frame element tells the neuric brain that Bill is a buyer. In another sentence describing the same situation, “John sold Bill a puppy,” the semantic role tells the brain that the actor is John. The frame element tells the brain that he is a seller. This is illustrated in
When utilizing the semantic roles, it is possible to tell that different perspectives on a particular transaction, this transfer action, are being expressed. This is due to the fact that in one sentence, one of the entities is the actor, and in the other sentence, the other entity is the actor. In the sentence with the verb “buy,” the person buying the object is the actor. In the “sell” transaction, the recipient is the actor. However, in each of these, there will be a recipient and a giver and there will also be a common object. Thus, the frame elements remain the same for each of the entities. Bill always remains the buyer and John always the seller. This set of semantic roles for each verb, as described hereinabove, is defined by the PAS “Predicate Argument Structure.”
Frames and frame elements are created with the intent of capturing concepts in neurons. For each verb that is incorporated into the system, a set of unique frame elements are created and contribute to the recognition of concepts. The frame elements are accessed in conjunction with a matrix of information formed by categorical relationships, a hierarchy, semantic roles and definitions in order to understand the English language.
In creating a neuron, again, the example of the transitive action verb will be utilized wherein the person/thing doing the action and the person/thing to whom the action is done will be the type of verb that is described. For example, with the action “to license” there must be a licensor and a licensee. This concept is used in the limitation of the frames.
The terms verb-er and verb-ee represent the frame element neurons that are created to define the concepts of the entities that fill the subjects and object's slots of transitive verbs during the creation thereof. The verb-er frame element stands for the entity accomplishing the action of the verb; whereas the verb-ee frame element stands for the entity to whom the action is being done. Each of these frame element blocks will have a definition block associated therewith, i.e., a relationship to a definition. However, a particular neuron associated with a frame element may or may not have an English word associated with it. If it does, there will be a word pointer (Wp) associated therewith. Frame elements predicted by the verb are normally stored with no Wp and can utilize clump neurons in the definition block to basically capture the meaning. However, in some situations, there may be a word pointer to an English word. For example, a frame element for “one who is harmed” for the verb “harm” is the word “victim.” Thus, there will be a relationship between the frame element “one who is harmed” to the neuron associated with the word “victim.” However, for most frame elements, the definition block is all that will be provided which can refer to a clump neuron. During the parsing operation, the tokenizer determines whether it sees a verb-er or a verb-ee. When a verb-er or a verb-ee is recognized, a temporary neuron can be created that shows a relationship between that word and the verb ending of -er or -ee. The conceptualizer will then handle the firing neuron. Therefore, for the sentence “Bill buys a puppy from John,” the tokenizer will recognize that Bill is a buyer and will associate Bill with a verb-er frame element. Alternatively, the tokenizer could immediately retrieve/generate the “one who . . . ” neuron for each verb split of the parsed verb. Again, if the verb is in the sentence “Bill buys a puppy from John,” then the “one who buys or one who receives” neuron is retrieved.
In general, the tokenizer can recognize the neuron as a first need to look for merely for the “______ who verb” nouns such as “one who buys.” It can then decide which one is the actual frame element, i.e., between “thing that is damaged” and “person who is damaged,” and “tables that are damaged.” There could be a back Reln that points to the particular verb that identifies this as a frame element. In general, once it is recognized as a frame element, it is flagged in some way such that it can be identified as to which one is the verb-er or the verb-ee neuron and then the overall clump can be flagged as having associated therewith a framework. In order to retrieve a particular neuron, the verb neuron is examined and then the Relns are utilized to find the correct nouns that are associated with the framework. Of course, if it does not exist, then the framework must be created. This is facilitated by determining if the verb-er, i.e., the “harm-er,” is defined as “the one who harms,” and the verb-ee or “harm-ee” is the “one who is harmed.” The “harm-er” and the “harm-ee” could have the same clump such that the “harm-er” is the “one who harms a harm-ee.”
In order to define a verb, it is defined as having two main components. These are the technical and the text-based components. The technical (e.g., grammatical) information is read in at initiation of the system from a specially formatted file. It includes such matters as transitivity, required an optional semantic roles and restrictions of the semantic roles for each verb. Textual verb definitions are human-readable English descriptions of the word. They are parsed as ordinary English text by the parser, and then used to create the frame elements discussed hereinabove.
In order to define the verb “harm,” it is defined as “to harm is to damage a person.” This verb “harm” will be described in this system as having transitivity flags and also having a PAS. The frame elements for this particular verb can result in a large number of frame elements. For example, every role in the PAS associated with a particular verb such as “harm” should get a frame element. However, rather than describe each possible role associated with the verb “harm,” it is possible to generate frame elements only when they occur such that they would have a newly created neuron. As an example, one or more frame elements could be nested inside a sub clause. One example would be “to damage is to cause [to experience bad effects].” Where “[to experience bad effects]” is the effect of “cause.” It is possible to automatically generate the frame elements after the verb definition, i.e., when someone uses them. The exception to this could be the situation wherein “harm-ee” is defined as “victim,” and vice versa. For example, “a harm-er harms a victim or any harm-ee is a victim” or “a harm-ee is called a victim” or “one who is harmed is called a victim” or “anyone who is harmed is called a victim.” A second option is to automatically generate the frame elements when the system attempts to use one of the frame elements, i.e., “a harm-er” is a phrase utilized in a sentence, or the sentence contains the phrase “one who is harmed.” Another option is to explicitly generate everything. For example, “a giver gives a gift to a recipient” is one phrase. This represents a clump, which is defined with the verb and three nouns. This clump is embedded within the definition block of the particular framework. A second way is to explicitly generate everything with respect to the phrase “someone gives something to someone” wherein a sub-neuron can be created for each, with the clump neuron for the entire phrase being related to the definition block. This could, of course, also be the case with respect to the phrase “something gives something to something.” Alternatively, the phrase “a giver gives a gift to someone” would be an explicit example wherein this would use the verb-er and the verb-ee for the subject an object.
It will be appreciated by those skilled in the art having the benefit of this disclosure that this method and apparatus for defining an artificial brain via a plurality of concept nodes connected together through predetermined relationships provides a n artificial brain that arranges a plurality of concepts in individual nodes of a nodal array for the purpose of allowing them to have interconnecting relationships that can be used to define a concept flow. It should be understood that the drawings and detailed description herein are to be regarded in an illustrative rather than a restrictive manner, and are not intended to be limiting to the particular forms and examples disclosed. On the contrary, included are any further modifications, changes, rearrangements, substitutions, alternatives, design choices, and embodiments apparent to those of ordinary skill in the art, without departing from the spirit and scope hereof, as defined by the following claims. Thus, it is intended that the following claims be interpreted to embrace all such further modifications, changes, rearrangements, substitutions, alternatives, design choices, and embodiments.
Non-weighted reins are listed below. The entire 8-bit Cmd field is used in the enumeration. The enumeration value itself is not given because it changes from time to time.
The below table defines the weighted opcodes:
These roles may be used in any sentence, no matter the verb type.
ROLE_TIME (tim)
This role includes all time- or date-related phrases, including concurrence.
Time may be a prepositional phrase, an adverb phrase, or an appropriate proform.
Example: “The specimen is leaving the petryi dish now.”
ROLE_DURATION (dur)
This role includes all durations, such as “The heated discussion lasted for three hours,” and “I've eaten nothing but cookies and coke for a year.”
Duration may be a prepositional phrase headed by “for” followed by a period of time, a propositional phrase headed by “during” followed by a noun which denotes something happening over a period of time, or a complementizer phrase connected with ‘while’ or ‘as’.
Examples: “I was talking to the spacemen during the launch.” “Millicent Cow kissed the canary while the dogs looked on.”
ROLE_REASON (rsn)
The stated purpose for the action, for example “Katrin knew he wanted her to read that book, so she read it for him,” or “Bjorn sold his soul for $20.”
Reason may be a prepositional phrase beginning with because, a complementizer phrase beginning with the complementizer so, or in order that.
ROLE_MANNER (man)
An adverb-like phrase which describes how the verb was performed.
Example: “She died with dignity.”
Manner may be a prepositional phrase or an adverb phrase.
ROLE_ACCOMPANIMENT (acc)
This semantic role denotes the entities which accompanied the subject of the sentence. For example, “I went to the software store with Anne-Marie.” or “Go with God.”
The subject of the sentence need not be the Agent, as in “She was attacked with her friend Stacy.”
Accompaniment may be a prepositional phrase beginning with alongside or with, or it may be the adverb phrase together.
ROLE_INSTRUMENT (ins)
The Agent is the initiator of the action; the Instrument is the thing that the Agent used.
Example: “I brutally murdered him with a spatula.”
Note that an Agent need not be in the sentence for Instrument to be present, for example, in “He was killed by the sword,” the one doing the killing (the Agent) is not there, but the sword (the Instrument) is.
Instrument may be a noun phrase or gerund phrase.
These roles must be assigned by the verb; they may not appear in just any sentence.
ROLE_ACTOR (atr)
The person which does the action, as in “The redcoats are coming!”
Actor may be a noun phrase, gerund phrase, or complementizer phrase.
ROLE_EXPERIENCER (exp)
Experiencer is the noun which undergoes change or feeling, as in “Jonny feels very sad today,” or “He attacked me without warning!” Note: All state verbs must assign an exp in active cps. The verb “to become” assigns an experiencer based on the following line of reasoning: The verb “to change,” as in “Rudolph changed Nancy into a nicer person,” assigns an Actor (Rudolph) and an Experiencer (Nancy). In “to become,” as in “I became nicer,” the Actor is changing himself to be nicer. In our model, we have called him the Experiencer, though this is arbitrary and he just as easily could be the Actor.
Experiencer may be a noun phrase, gerund phrase, or complementizer phrase.
ROLE_THEME (thm)
Similar to Topic. As in, “I joined you in your quest for truth,” or “Quit involving me in your problems,” “Dating involves lots of money.”
Themes may be either abstract nouns or gerunds, or complementizer phrases.
ROLE_EFFECT (eff)
The outcome of an action. An Effect may only be assigned if the Effect noun came into existence because of the verb. That is, you must be able to replace the original verb with “effect” (not “affect”), and the sentence must hold true.
For example, in the sentence “She baked cookies.”, it is saying that she made cookies—she caused the cookies to exist by the act of baking Thus, “cookies” is the Effect.
On the other hand, in the sentence “She baked cookie dough.”, it is saying that she put the cookie dough through a process of baking, but not that she made it cookie dough by baking it. Therefore, “cookie dough” would not be considered Effect, but Experiencer.
Effect does not require an Actor to be assigned. The sentence “I died a painful death.” is an example of this. “I”, in this case, is an Experiencer, not an agent.
Effect may be a noun phrase OR an adjective due to a state or state verb—I made her angry. ‘her angry’ is the effect.
These roles may only be assigned by certain kinds of verbs
ROLE_STATE (sta)
This semantic role is for the express use of state verbs, such as “to be,” as in “I am happy,” and also for sensing verbs, such as “look,” as in “You look terrible.” Note that these are not noun phrases, but adjective phrases. This is a very rare phenomenon and very restricted —adjectives are only included as part of the predicate argument structure here because they are required by the verb. Other verbs that assign to adjective phrases are “act,” as in “You're acting strange today,” “seem” as in “You seem quite nice,” and “stay” as in “I stay warm most of the time.” State may be an adjective phrase only.
ROLE_IDENTITY (idt)
Identity was created for, but not limited to, being verbs, as in “I am Hannah”. “Hannah” receives the role of the identity, because it refers to the same entity as does the subject. Any noun phrase that is not the subject but is its co-referent is assigned the role of identity.
Identity may be a noun phrase, gerund phrase, or complementizer phrase.
ROLE_MEASURE (msr)
All measurement verbs assign this role, such as “Pterodactyl's wingspan measures forty feet.”
Measure may be a noun phrase or gerund phrase. This is the only role which can be a NP, but cannot function as the Object of a sentence.
This application is a continuation of U.S. patent application Ser. No. 12/748,262, filed on Mar. 26, 2010, now U.S. Pat. No. 8,463,720, issued on Jun. 11, 2013, and entitled METHOD AND APPARATUS FOR DEFINING AN ARTIFICIAL BRAIN VIA A PLURALITY OF CONCEPT NODES DEFINED BY FRAME SEMANTICS, which claims the benefit of U.S. Provisional Application for Patent Ser. No. 61/164,248, filed on Mar. 27, 2009, and entitled “FRAME THEORY AND IMPLEMENTATION,” the specification of which is incorporated herein in its entirety. This application is related to U.S. patent application Ser. No. 12/136,670, filed on Jun. 10, 2008, and entitled METHOD AND APPARATUS FOR DEFINING AN ARTIFICIAL BRAIN VIA A PLURALITY OF CONCEPT NODES CONNECTED TOGETHER THROUGH PREDETERMINED RELATIONSHIPS,” the specification of which is incorporated herein by reference. U.S. patent application Ser. No. 12/136,670 claims the benefit of U.S. Provisional Application Ser. No. 60/954,247, filed Aug. 6, 2007 and entitled “RELATIONAL INTER-NEURON CONNECTIONS” and U.S. Provisional Application Ser. No. 61/016,918 filed Dec. 27, 2007, and entitled “DISCUSSION PATENT” and is a Continuation-In-Part Application of U.S. patent application Ser. No. 11/758,667, filed Jun. 5, 2007 and entitled “METHOD FOR DETERMINING RELATIONSHIPS THROUGH USE OF AN ORDERED LIST BETWEEN PROCESSING NODES IN AN EMULATED HUMAN BRAIN,” which application claims benefit of U.S. Provisional Patent Application Ser. No. 60/811,299, filed Jun. 5, 2006, and entitled “THE CONCEPT OF GAMUT AND ITS USE,” and is a Continuation-in-Part of pending U.S. patent application Ser. No. 11/697,721, filed Apr. 7, 2007, and entitled “METHOD FOR SUBSTITUTING AN ELECTRONIC EMULATION OF THE HUMAN BRAIN INTO AN APPLICATION TO REPLACE A HUMAN,” which is a Continuation-in-Part of pending U.S. patent application Ser. No. 11/670,959, filed Feb. 2, 2007, and entitled “METHOD FOR MOVIE ANIMATION,” which is a Continuation-in-Part of pending U.S. patent application Ser. No. 11/425,688, filed Jun. 21, 2006, and entitled “A METHOD FOR INCLUSION OF PSYCHOLOGICAL TEMPERAMENT IN AN ELECTRONIC EMULATION OF THE HUMAN BRAIN,” which is a Continuation of U.S. application Ser. No. 11/154,313, filed Jun. 16, 2005, and entitled “METHOD FOR INCLUSION OF PSYCHOLOGICAL TEMPERAMENT IN AN ELECTRONIC EMULATION OF THE HUMAN BRAIN,” now U.S. Pat. No. 7,089,218, issued Aug. 8, 2006, which is a Continuation of abandoned U.S. application Ser. No. 11/030,452, filed Jan. 6, 2005, and entitled “A METHOD FOR INCLUSION OF PSYCHOLOGICAL TEMPERAMENT IN AN ELECTRONIC EMULATION OF THE HUMAN BRAIN,” which claims the benefit of U.S. Provisional Application for Patent Ser. No. 60/534,641, filed Jan. 6, 2004 entitled “A NEURIC BRAIN MODELING SYSTEM IN THE MILITARY ENVIRONMENT,” U.S. Provisional Application for Patent Ser. No. 60/534,492, filed Jan. 6, 2004, entitled “METHOD FOR INCLUSION OF PSYCHOLOGICAL TEMPERAMENT IN AN ELECTRONIC EMULATION OF THE HUMAN BRAIN,” U.S. Provisional Application for Patent Ser. No. 60/534,659, filed Jan. 6, 2004, entitled “DESIGN OF THE NEURIC BRAIN,” all now expired, and which U.S. application Ser. No. 11/697,721, filed Apr. 7, 2007, and entitled “METHOD FOR SUBSTITUTING AN ELECTRONIC EMULATION OF THE HUMAN BRAIN INTO AN APPLICATION TO REPLACE A HUMAN” also claims the benefit of priority from U.S. Provisional Application for Patent Ser. No. 60/764,442, filed Feb. 2, 2006, and entitled “USE OF THE NEURIC BRAIN MODEL IN MOVIE ANIMATION” and U.S. Provisional Application Ser. No. 60/790,166, filed Apr. 7, 2006, and entitled “BRAIN MODEL”. All of the above are incorporated herein by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61164248 | Mar 2009 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12748262 | Mar 2010 | US |
| Child | 13915303 | US |
