Conventional search engines typically rank search results using external information such as information from sources other than the webpages being ranked. For example, a conventional search engine may use the number of external links to a particular webpage to determine the importance of the particular webpage. The external links may reside in other sources (e.g., webpages, documents, etc.) and may direct a user to the particular webpage. In this manner, the conventional search engine may rank each webpage based upon a respective number of external links to each webpage.
Although external information is commonly used by conventional search engines to perform searches and rank webpages, it is often a poor indicator of the importance or value of each webpage. For example, there may be few or no external links pointing to a potentially important document, and therefore, the document may be not be returned or ranked lower than it should be by a conventional search engine. As another example, if a statue of a famous person has recently been defaced, a search using a conventional search engine for autobiographical information about the famous person may instead return a multitude of less-important results related to the defacing of the statue. As such, a user may be unable to locate webpages with more important or valuable information using a conventional search engine which relies on external information.
Accordingly, a need exists to improve determination of the importance or value of a webpage or other text. Additionally, a need exists to provide more relevant search results responsive to a search for content. Embodiments of the present invention provide novel solutions to these needs and others as described below.
Embodiments of the present invention are directed to a computer-implemented method, computer-readable medium and system for scoring a text. More specifically, themes within one or more texts may be determined and used to score each text, where an overall score for each text may indicate a respective importance and/or value of each text. The score for each text may be determined based upon a number of themes, type of themes, frequency of theme elements associated with the themes, distribution of theme elements associated with the themes, location of themes in the text, some combination thereof, etc. In this manner, the importance or value of one or more texts may be determined more accurately using information within each text (e.g., internal information) with reduced reliance upon external information (e.g., a number of hyperlinks pointing to a particular document). Additionally, more relevant search results can be returned to a user by using internal information to perform ranking operations and/or filtering operations associated with a search.
In one embodiment, a method of scoring a text includes determining a plurality of themes associated with a plurality of portions of the text, wherein each portion of the plurality of portions comprises at least one respective character. A plurality of scores are assigned to the plurality of themes, wherein each score of the plurality of scores corresponds to a respective theme of the plurality of themes. An overall score is determined for the text based on the plurality of scores.
In another embodiment, a computer-readable medium may have computer-readable program code embodied therein for causing a computer system to perform a method of scoring a text based on a content of the text. And in yet another embodiment, a system may include a processor and a memory, wherein the memory includes instructions that when executed by the system implement a method of scoring a text based on a content of the text.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements.
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings. While the present invention will be discussed in conjunction with the following embodiments, it will be understood that they are not intended to limit the present invention to these embodiments alone. On the contrary, the present invention is intended to cover alternatives, modifications, and equivalents which may be included with the spirit and scope of the present invention as defined by the appended claims. Furthermore, in the following detailed description of the present invention, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, embodiments of the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the present invention.
Some portions of the detailed descriptions which follow are presented in terms of procedures, logic blocks, processing and other symbolic representations of operations on data bits within a computer memory. These descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. In the present application, a procedure, logic block, process, or the like, is conceived to be a self-consistent sequence of steps or instructions leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, although not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system.
It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the present invention, discussions utilizing the terms such as “accepting,” “accessing,” “adding,” “analyzing,” “applying,” “assembling,” “assigning,” “associating,” “calculating,” “capturing,” “combining,” “communicating,” “comparing,” “collecting,” “creating,” “defining,” “depicting,” “detecting,” “determining,” “displaying,” “establishing,” “executing,” “filtering,” “generating,” “grouping,” “identifying,” “initiating,” “interacting,” “modifying,” “monitoring,” “moving,” “outputting,” “performing,” “placing,” “presenting,” “processing,” “programming,” “providing,” “querying,” “ranking,” “removing,” “repeating,” “sampling,” “sorting,” “storing,” “subtracting,” “transforming,” “using,” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
The results of the scoring may be used to perform at least one operation associated with a search (e.g., in accordance with process 900 of
In one embodiment, embodiments of the present invention may reduce reliance upon external information (e.g., a number of hyperlinks pointing to a particular document) to further improve the determination of the importance and/or value of at least one text, to improve searches for at least one text or other operations (e.g., filtering, ranking, etc.) related to searches for at least one text, etc. For example, where relatively few external links (e.g., hyperlinks) point to a more important or valuable text, the importance and/or value of the text may be more accurately determined using internal information compared to conventional solutions that rely upon external information to determine the importance and/or value of the text (e.g., which would determine that the importance and/or value of the text is relatively low given the relatively small number of hyperlinks pointing to the text). As another example, where a relatively large number of external links point to a less important or valuable text, the importance and/or value of the text may be more accurately determined using internal information compared to conventional solutions that rely upon external information to determine the importance and/or value of the text (e.g., which would determine that the importance and/or value of the text is relatively high given the relatively large number of hyperlinks pointing to the text).
In one embodiment, a search may be performed (e.g., by search engine 120) within intranet or private network 160 (e.g., of at least one text stored in text database 112) and results of the search may be provided to at least one computer system (e.g., 152, 154, etc.) within the private network. In one embodiment, one or more texts within text database 112 may include confidential information and/or may include relatively few or no hyperlinks to other texts within text database 112. Alternatively, a search may be performed (e.g., by search engine 120) at least partially outside private network 160 (e.g., on at least one text within text database 190, etc.). In this case, results of the search may be provided to at least one computer system within private network 160 (e.g., 152, 154, etc.) and/or at least one computer system outside private network 160 (e.g., 182, 184, etc.).
Private network 160 may include any number of computer systems or devices which can communicate with limited or no internet connectivity. Computer systems or devices within private network 160 may be coupled by a local area network (LAN), virtual private network (VPN), or the like.
Although
Step 220 involves determining a plurality of themes associated with the plurality of portions of the text (e.g., determined in step 210). In one embodiment, the number of portions of the text may be larger than the number of themes (e.g., not every portion of the text may be associated with a theme). Each theme determined in step 220 may be associated with at least one theme element (e.g., one or more words which are related to and/or provide examples of the theme), where the correlation between the themes and respective theme elements may be stored in theme element database 114 (e.g., as shown in
As shown in
Step 240 involves determining an overall score for the text based on the plurality of scores (e.g., assigned in step 230). The overall score may be calculated by summing the plurality of scores (e.g., the respective scores assigned to each theme in step 230) in one embodiment. And in one embodiment, the overall score determined in step 240 may indicate an importance or value of the text (e.g., based on one or more themes of the text).
Accordingly, process 200 may be used to determine an overall score for a text based on information within the text (e.g., internal information). Process 200 may be advantageously used to determine an overall score for a text where few or no external hyperlinks (e.g., within at least one other text) point to the text. Additionally, process 200 may be advantageously used to determine an overall score for a text (e.g., intended to be shared within private network 160) which includes confidential information. In this manner, more relevant search results can be returned to a user by using internal information (e.g., with reduced reliance upon external information) to perform ranking operations and/or filtering operations associated with a search.
Step 310 involves determining whether the portion (e.g., the first portion accessed in step 305 or another portion accessed in step 320) is found in a theme database (e.g., 114). Step 310 may be performed by comparing at least one character of a portion to at least one entry in the theme database (e.g., 114).
If the portion is not found in the theme database (e.g., the portion includes a word which is not a theme listed in the theme database), then it may be determined whether the text includes another portion in step 315. If the text does not include another portion, then step 385 may be performed as discussed herein. Alternatively, if the text does include another portion, then the next portion may be accessed in step 320 and then step 310 may be performed with respect to the next portion.
Alternatively, if the portion is found in the theme database (e.g., the portion includes the word “food” which is a theme listed in the theme database as shown in
As shown in
Step 335 involves determining whether a distribution of the plurality of instances of the at least one theme element in the text (e.g., identified in step 330) falls within a predetermined range. In one embodiment, a distribution falling within a predetermined range may be considered to be an “even distribution,” whereas a distribution falling outside of the predetermined range may be considered to be an “uneven distribution.” In one embodiment, the distribution (e.g., of the plurality of instances of the at least one theme element in the text) may be determined by averaging the “distances” (e.g., the number of words, characters, symbols, etc.) between each consecutive pair of instances of the at least one theme element. Each consecutive pair may include: two instances of the same theme element; or an instance of one theme element and an instance of another theme element. As such, in one embodiment, step 335 may involve calculating the average “distance” and comparing it to a predetermined range, where the predetermined range may vary based upon a length (e.g., number of words, characters, symbols, etc.) of the text.
If it is determined in step 335 that the average distance does not fall within the predetermined range, then the portion may be associated with a minor theme in step 340 and then step 315 may be performed. Alternatively, if it determined in step 335 that the average distance does fall within the predetermined range, then step 345 may be performed.
As shown in
In one embodiment, step 355 may also involve noting that association of the portion with a major theme is performed with reduced certainty (e.g., compared to the association performed in step 350). This notation may be used later in determining a score for the theme, an overall score for the text, in an application which utilizes the overall score (e.g., a search which uses the overall score to rank a plurality of texts, filter a plurality of texts, etc.), etc.
If a plurality of instances of the at least one theme element (e.g., a plurality of instances of only one theme element, at least one instance of a first theme element and at least one instance of a second theme element, etc.) are not found in the text in step 330, then it may be determined in step 360 as shown in
If it is determined in step 360 that the average distance does not fall within the predetermined range, then the portion may not be associated with any themes in step 365 and then step 315 may be performed. Alternatively, if it determined in step 360 that the average distance does fall within the predetermined range, then step 370 may be performed.
As shown in
Turning back to
Step 620 involves determining a distribution of a respective plurality of instances of at least one theme element for each theme in the text. In one embodiment, the distribution of theme elements for a particular theme may be determined by averaging the “distances” (e.g., the number of words, characters, symbols, etc.) between each consecutive pair of instances of the theme elements, where this may be repeated for each theme of the text. Each consecutive pair may include: two instances of the same theme element (e.g., a standard form of the theme element, a token of the theme element, some combination thereof, etc.); or an instance of one theme element (e.g., a standard form of the theme element, a token of the theme element, some combination thereof, etc.) and an instance of another theme element (e.g., a standard form of the theme element, a token of the theme element, some combination thereof, etc.).
As shown in
Step 640 involves determining a respective score for each theme based on at least one attribute of the text. For example, step 640 may involve determining a respective score for each theme based on a frequency of a plurality of instances of at least one theme element for the theme in the text (e.g., as determined in step 610), a distribution of a plurality of instances of at least one theme element for the theme in the text (e.g., as determined in step 620), a location of at least one instance of the theme in the text (e.g., as determined in step 630), some combination thereof, etc.
In one embodiment, a respective score for each theme may be calculated in step 640 by summing a plurality of scores (e.g., determined using attribute scoring database 116). For example, a first score associated with a frequency may be determined from attribute scoring database 116 (e.g., shown in
In one embodiment, the respective scores for each theme in a text (e.g., as determined in step 640) may be stored in text scoring database 113 as shown in
Step 920 involves ranking the plurality of webpages based on the respective overall scores. For example, the webpages may be arranged in order of increasing respective overall score, decreasing respective overall score, etc. The ranking performed in step 920 may be performed before a search of the plurality of webpages is performed in one embodiment. And in one embodiment, step 920 may be performed by a ranking component (e.g., 140).
As shown in
Step 940 involves accessing a search query submitted by a user. The search query may include at least one character, at least one word, at least one symbol, etc. In one embodiment, the search query may be input using a graphical user interface.
As shown in
Step 960 involves ranking the search results based at least in part on a respective overall score of each of the search results. For example, the search results may be arranged in order of increasing respective overall score, decreasing respective overall score, etc. The ranking performed in step 960 may be performed after the search of the plurality of webpages is performed in step 950 in one embodiment. In one embodiment, step 960 may be performed by a ranking component (e.g., 140). And in one embodiment, step 960 may involve scaling the respective overall scores of the search results (e.g., performed in accordance with process 1000 of
Step 1020 involves determining the number and type of themes of the search result which are found in the search query (e.g., submitted by a user in step 940 of process 900). In one embodiment, the number and type of themes may be determined using text scoring database 113 (e.g., as shown in
As shown in
S=Nmajor*Vmajor+Ncomp*Vcomp+Npotentialmajor*Vpotentialmajor+Nminor*Vminor
where Nmajor may be the number of major themes of the search result (e.g., “Text 1” as shown in
Step 1040 involves scaling the overall score associated with the search result based on the scaling factor (e.g., determined in step 1030). The overall score may be accessed from text scoring database 113 in one embodiment. In one embodiment, the scaling factor may be multiplied by the overall score to calculate a scaled overall score in step 1040. And in one embodiment, the scaled overall score may be stored in text scoring database 113.
As shown in
Turning back to
Step 980 involves outputting the search results (e.g., generated in step 950, ranked in step 960, filtered in step 970, etc.). The search results may be output for display (e.g., on a display device of a computer system), printing (e.g., on a printer coupled to a computer system), storage (e.g., on a computer-readable medium of a computer system), etc.
Accordingly, process 900 may be used to return more relevant search results by utilizing internal information (e.g., with reduced reliance upon external information) to perform ranking operations and/or filtering operations associated with a search. Process 900 may be advantageously used to perform at least one operation related to a search for a text where few or no external hyperlinks (e.g., within at least one other text) point to the text. Additionally, process 900 may be advantageously used to perform at least one operation related to a search for a text (e.g., intended to be shared within private network 160) which includes confidential information. And in one embodiment, at least one search may be performed using internal information in combination with external information to return search results.
Although process 900 has been described with respect to webpages, it should be appreciated that process 900 may be used to search for any type of document, file, or other type of text. Additionally, it should be appreciated that one or more of the steps of process 900 may be optional, and therefore, may not be performed in other embodiments.
The information of theme element database 114 as depicted in
In one embodiment, computer system platform 1100 may be used to implement content server 110, computer system 120, computer system 130, computer system 140, computer system 150, computer system 110, computer system 170, some combination thereof, etc. And in one embodiment, one or more components of computer system platform 1100 may be disposed in and/or coupled with a housing or enclosure.
In one embodiment, depicted by dashed lines 1130, computer system platform 1100 may include at least one processor 1110 and at least one memory 1120. Processor 1110 may include a central processing unit (CPU) or other type of processor. Depending on the configuration and/or type of computer system environment, memory 1120 may include volatile memory (e.g., RAM), non-volatile memory (e.g., ROM, flash memory, etc.), or some combination of the two. Additionally, memory 1120 may be removable, non-removable, etc.
In other embodiments, computer system platform 1100 may include additional storage (e.g., removable storage 1140, non-removable storage 1145, etc.). Removable storage 1140 and/or non-removable storage 1145 may include volatile memory, non-volatile memory, or any combination thereof. Additionally, removable storage 1140 and/or non-removable storage 1145 may include CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store information for access by computer system platform 1100.
As shown in
Communication interface 1170 may also couple computer system platform 1100 to one or more input devices (e.g., a keyboard, mouse, pen, voice input device, touch input device, etc.). In one embodiment, communication interface 1170 may couple computer system platform 1100 to one or more output devices (e.g., a display, speaker, printer, etc.).
As shown in
In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. Thus, the sole and exclusive indicator of what is, and is intended by the applicant to be, the invention is the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction. Hence, no limitation, element, property, feature, advantage, or attribute that is not expressly recited in a claim should limit the scope of such claim in any way. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
The present application is a Continuation of and claims priority to U.S. patent application Ser. No. 12/884,395 filed Sep. 17, 2010 entitled “METHOD AND SYSTEM FOR SCORING TEXTS,” naming Hong Liang Qiao as the inventor, which in turn claims the benefit of U.S. Provisional Patent Application No. 61/243,953, filed Sep. 18, 2009, entitled “SYSTEM AND METHODS FOR RANKING TEXTUAL INFORMATION AND SEARCH RESULTS BASED ON INFORMATIVITY,” naming Hong Liang Qiao as the inventor, both of which are incorporated herein by reference in their entirety and for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
5151857 | Matsui | Sep 1992 | A |
7213205 | Miwa et al | May 2007 | B1 |
7289982 | Saito | Oct 2007 | B2 |
7290207 | Colbath | Oct 2007 | B2 |
7376635 | Porcari | May 2008 | B1 |
7809568 | Acero | Oct 2010 | B2 |
8015183 | Frank | Sep 2011 | B2 |
20020178152 | Azzam | Nov 2002 | A1 |
20030115187 | Bode et al. | Jun 2003 | A1 |
20030130993 | Mendelevitch et al. | Jul 2003 | A1 |
20030140309 | Saito | Jul 2003 | A1 |
20040054661 | Cheung et al. | Mar 2004 | A1 |
20050108212 | Karimisetty et al. | May 2005 | A1 |
20050154690 | Nitta et al. | Jul 2005 | A1 |
20050267871 | Marchisio et al. | Dec 2005 | A1 |
20060010111 | Jones et al. | Jan 2006 | A1 |
20060031216 | Semple et al. | Feb 2006 | A1 |
20060041549 | Gundersen et al. | Feb 2006 | A1 |
20060173821 | Hennum et al. | Aug 2006 | A1 |
20060235689 | Sugihara et al. | Oct 2006 | A1 |
20070011154 | Musgrove | Jan 2007 | A1 |
20070016563 | Omoigui | Jan 2007 | A1 |
20070078822 | Cucerzan | Apr 2007 | A1 |
20070106657 | Brzeski et al. | May 2007 | A1 |
20070288421 | Chakrabarti et al. | Dec 2007 | A1 |
20080114750 | Saxena et al. | May 2008 | A1 |
20080120279 | Xue | May 2008 | A1 |
20080172377 | Kapadia et al. | Jul 2008 | A1 |
20090043749 | Garg et al. | Feb 2009 | A1 |
20090055390 | Maeda et al. | Feb 2009 | A1 |
20090089047 | Pell et al. | Apr 2009 | A1 |
20090182737 | Melman | Jul 2009 | A1 |
20090248511 | Mehta et al. | Oct 2009 | A1 |
20110072011 | Qiao | Mar 2011 | A1 |
20130060785 | Sweeney | Mar 2013 | A1 |
Number | Date | Country |
---|---|---|
2045728 | Apr 2009 | EP |
2048585 | Apr 2009 | EP |
1020000050225 | Aug 2000 | KR |
1020070052028 | May 2007 | KR |
1020080017686 | Feb 2008 | KR |
WO2011035210 | Mar 2011 | WO |
Entry |
---|
Demartini, Gianluca, “ARES: A Retrieval Engine Based on Sentiments,” Proceedings of the 33rd European Conference on Advances in Information Retrieval, Apr. 18, 2011. |
Hu et al., “Mining and Summarizing Customer Reviews,” Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2004. |
Lin, Chin-Yu et al.“Identifying Topics by Position”, Proceeding ANLC 1997 Proceedings of the Fifth Conference on Applied Natural Language Processing, pp. 283-290 (Retrieved on Jul. 11, 2013). Retrieved From the Internet:<URL: http://dl.acm.org/citation.cfm?id=974599>. |
Liu et al., “Opinion Observer: Analyzing and Comparing Opinions on the Web,” Proceedings of the 14th International Conference on World Wide Web, pp. 342-351, 2005. |
Liu et al., “Opinion Searching in Multi-Product Reviews,” Proceedings of the Sixth IEEE International Conference on computer and Information Technology, 2006. |
Magnini et al., “A WordNet-Based Approach to Named Entities Recognition,” in proceedings of the SemaNet'02 workshop entitled “Building and Using Semantic Networks,” 2002. |
Popescu et al., “Extracting Product Features and Opinions from Reviews,” Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, 2005. |
Qiao, Hong Liang, “Lexxe Search Engine,” from hllp://www.hcsnel.edu.au, Sep. 2006. |
Number | Date | Country | |
---|---|---|---|
20150379015 A1 | Dec 2015 | US |
Number | Date | Country | |
---|---|---|---|
61243953 | Sep 2009 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12884395 | Sep 2010 | US |
Child | 14585074 | US |