The invention is related to the field of digital information management and, in particular, to search and retrieval of the same.
The growth of the Internet introduced broad access to information not available before. Access to digital information sources, once an asset of a small group of professional, holding information technology skills, has become a daily tool for millions of the Internet users.
Lower skill levels for search of such information is now an inseparable part of searches made for information by most of the users. Skill and knowledge aspects became limiting factors for successful search and retrieve of such information. Such limitations present themselves in the composition of Boolean queries, knowledge of relevant information sources such as the AltaVista index at www.altavista.digital.com (maximum coverage of Internet documents by a single index is less then 40%). Many of the documents are accessed only by a direct reference from a person with a specific knowledge. Many of the information provided by querying an index such as Yahoo are not relevant. The search process is long, queries are modified many times and many information pieces are missed.
Natural language query is one suggested replacement for Boolean query method. However, a research from Search Insider (www.searchinsider.com) indicates clearly that users prefer the Boolean query methods and that search engines such as AltaVista and Yahoo (www.yahoo.com) provide require much improvement.
The present status of information search and retrieval in the Internet is characterized by long and tedious search process, poor relevancy of retrieved documents and low level of success in retrieval of relevant documents.
It is the purpose of the present invention to provide a method and tools for efficient search and retrieval of documents. The description in reference to the Internet is maid in a way of example only. It would be appreciated by those skilled in the art, that the proposed method is applicable to any digital information source.
In a preferred embodiment of the present invention, the system comprises a Server, Clients having a Human Interface (H/I) and communication with the server, a Database, a connection to the Internet and Software of that system.
A User of the Client is using the H/I to compose a query view various information pieces including retrieved documents or titles or summary of those documents. The Software traces the user's search activity, collecting data such as queries and relevant or irrelevant documents and information sources. The data is evaluated and stored in the Database.
The data is also compared to other data, collected from all users, available from the Database. A data that is relevant to assist the current search process is presented to the user. This data include highly ranked queries that are similar to the query composed by the current user and highly ranked documents retrieved in the past by those queries.
As the Database is the accumulation of many such search processes, made by many users, in the same subject, the current user can benefit from the many hours invested by others to find information in this subject.
This method is particularly effective when used within an organization, whereas the organization members search for information that is relevant to the activity of that organization. Thus the Database generated overtime is highly relevant to all members of such organization.
The invention will be better understood in reference to the following Figures:
Reference is made now to
A preferred embodiment of the invention is presented. System 100 for search and retrieval of documents includes:
Initial search is characterized by no data in System Database 108. At this stage System 100 can not assist the user to find the information he is looking for. In this stage System 100 traces the user's search session, collects data from the search session, processes the data and stores the results in the database.
In the present embodiment of the invention, the user composes a Boolean query using Human Interface 114. The user then submits the query to a search engine such as AltaVista. A set of titles and summaries in presented to the user by the search engine.
The user may now select some of the titles for a detailed review and ignore the others.
When the detailed document is presented to the user it is desired that the evaluation of the document, by the user, will be provided to the System. For that purpose a window is displayed with the document. The window contains a dual button interface indicating Y and N. To change from the document display back to the search session the user must click either the Y or the N. Y indicates that the document is relevant to the user and N indicates irrelevant document. System 100 also traces activities such as printing a document or saving a document on disk. These actions are considered as parts of positive evaluations of a document.
The user, repetitively composes improved queries, submits them to the search engine and evaluates results (direct or indirect evaluation). During the search session the user may submit queries to different sources such as AltaVista, Yahoo and Lycos (www.lycos.com). Also meta-search engines such as MetaCrawler (www.metacrawler.com) may be used.
When the user finishes the search session, the system has collected raw data ready for process. This data includes details such as the following:
A process of the data is begun at this stage to produce a set of valuable information in the System Database, the information contains details such as:
The data collected during the search session is then stored in the System Database together with the set of parameters and calculated ranks. This also includes submitted queries, URLs, summaries, terms and their relations and ranking.
The amount of such data accumulates more rapidly when the System is multi user. This is the case in organizations, where many members of the organization search for information regarding similar subjects.
Reference is made now to
In order to enable a comprehensive explanation, it is assumed that an amount of data has already been collected in System Database 108 by the process described hereinabove and this data is available for assistance of searches made by individuals.
Query Composition Section:
In a preferred embodiment of the invention, Query Composition section 200 contains Query window 202 where the current query is composed and Related Queries window 204 for display of relevant queries stored in System Database 108.
Basic query composition is done in Query window 202, by typing words, expressions, Boolean operators and conventional singes. Following are some examples:
Related queries are displayed in Related Queries window 204. In a simple implementation of the present invention, terms from Query window 202 are used to search System Database for stored queries that contains such terms.
The queries are displayed in Related Query window according to their rank, highest rank first.
In a more sophisticated implementation of the present invention, the queries containing terms of Query window 202 are specially ranked for display in Related Queries window 204. This ranking may first rank the queries in accordance to the number of terms from Query window 202 that are contained in these queries and then, a sub-level sorting is performed, where all queries of the same ranking are sub-sorted by their own rank (as stored in System Database 108). Other ranking schemes are possible.
In default, the top query of Related Query window 204 is highlighted. Any other query of window 204 can be highlighted by clicking on it. More then one query may be highlighted simultaneously. Double clicking a query of Query window 204 will copy the query to Query window 202, instead of what was previously in that window. Related Query window 204 will refresh then, according to the new query in Query window 202.
More queries may be observed in Related Queries window 204 by using Roll Slider 236.
Related Terms section 206 within Query Composition section 200 supports the process of query composition by listing terms that are related to the terms of the query in Query window 202. Related Terms section 206 contains four windows:
Nested Boolean relations are supported. For example, query of the type
Button ‘Go’, 216, is used to indicate that the composition of the query is complete and the system is to retrieve information in accordance to that query.
Documents Section:
Document section 218 is used to display titles and summaries of documents in accordance to the highlighted Query in Related Queries section 204.
Title Window:
The titles of the documents are displayed in Title window 220 are titles that are highly relater to the highlighted query of window 204, Query2 in the example of
The titles are available from System Database 108 and are displayed in order according to their ranking. High rank displayed first.
If the number of such titles is lower then No. of Titles 228 (20 in the example of
Each such group of titles is sub-sorted according to the rank of the titles.
Titles are also filtered for display by Which Title? window 232. In the example of
A single click on a title of window 220 will effect the display of summaries in Summary window 222 as explained hereinbelow.
A double click on a title of window 220 will display the document of that title.
Window 224 is an indicative window that displays the URL of the highlighted title of Window 220.
Summary Window:
The summaries of the documents that are displayed in Summary window 222 are related to the list of titles in window 220. The summary of the highlighted title, Title3 of window 220 in the example of
Double clicking a summary will display the document of that summary.
Preferences Section:
Preferences section 226 is used for input, by the user, of preferences for the search session. A maximum number of titles to be presented is indicated in window 228, adjustable by the user. Date Range windows 230 indicate the earliest and latest dates of that rang. Only documents that were updated in System Database 108 within this range will be presented. The dates are adjustable by the user. Which Title window 232 contains multi-choice options. Three such options may be:
Database windows 234 indicates the database to be used by the system.
Local window 238 is used to select the preferred local database to perform as System Database 108. This may be one of few local databases or a portion of a database. The different options may be indicated by names such as:
This arrangement is described in more details in Israeli patent application number 119183 dated Sep. 2, 1996 (Haim Zvi Melman et al.).
The selected database is used during the user's interaction with the human interface of
Internet window 240 is used to select the preferred Internet database sources. This is useful for submission of queries for search of new documents (or titles) that are not in the local database. Pre-configured selections of sources are available at this window.
Aided Search Session:
The aided search session will be described hereinbelow in reference to
For simplicity, all elements of
All elements of
It will be appreciated that the system can handle multiple simultaneous search sessions, conducted by different users, independently. Each user may use his own preferences configuration in Preferences window 226. The data collected from each user is added to System Database 108 to serve all users. Parts of System Database 108 may be limited for use by only few users, not accessible to others.
In this example, the preferences of window 226 will be as indicated in
The user may view documents, step back to the search process modifying his search activity in a variety of ways such as composing new queries, editing queries and changing preferences of window 226.
Following predetermined conditions (such as every 10 minutes or end of search session or every logout) System 100 is processing the new search information and generates new data for System Database 108. This data is added to the previously stored data for future aided search-sessions, as described hereinabove (section of Initial search process).
Simple queries such as of one or two Key Terms are the most intuitive and are frequently the first ones composed in a search session. In another embodiment of the invention, the user may submit such a simple query that in a present art search system will fail to produce useful results and provide many falls results. In the present invention, submission of such a query will actually result in submission of a number of more sophisticated queries, these are Related Queries available from System Database 108. These queries may be those of a rank above a predetermined threshold. The results will be those that are associated with the highly ranked Related Queries. This methods enables valuable results from a simple and intuitive query—not effective by itself.
A method is presented hereinbelow, to associate such simple queries that, in most cases, do not provide the desired results, with more sophisticated queries that are usually not intuitive and are composed only after few interaction with search results and query modifications accordingly.
A search session is defined to be the process of searching information related to a specific subject. A search session includes the composing of queries, submission of queries to a search engine, evaluation of results, modification of queries as a response to such search results, submission of such modified queries—and so on.
Two sessions are different if the subject is different.
In the present embodiment of the invention, semi-automatic session tracing is performed by the system. Queries are identified to belong to the same search session in the following way:
New search session starts by a query (normally after the application is activated). Each new or modified query is compared to all the previous queries. If at least one keyword of this query is used in one of the previous queries of that session—the new query is belongs of the same session.
If the user go through strategy change in his queries there may be no keyword relation anymore to previous queries even if this is the same search session. For example, a user may search for information on 35 mm film dimensions. He may start with a query “film and 35 mm” and change strategy to search for standard organizations with the query “iso”. To overcome this problem in the present embodiment, when this occurs, the system responds to the user with a question: “Have you started a new search session? Y/N”. If the user answers “N” the queries “film and 35 mm” and “iso” are associated with the same search session. Next time that the query “film and 35 mm” will be composed by a user, a reference will also be made to the query “iso” as a relevant query. Useful titles retrieved by the query “iso” will be available then also for the query “film and 35 mm”.
If the user replies “Y”, the previous set of queries are associated with one search session while the new query is the first one of the new search session.
In yet another embodiment of the invention, the data that is collected and processed trough the search sessions is used to generate and support direct information exchange and communication among the members of an organization.
As described hereinabove, during the search session Related Queries and Titles from System Database 108 are associated with the search activity of the user. Since such queries and titles are related also to other users who used them in the past, the names of such users can be presented to the current user for user to user communication.
In the present example, after the user has worked through at least a part of his search session, such a relation to Related Queries and Titles of System Database 108 has been established. The user interface of
This window contains names, email addresses and phone numbers of the users who used the Related Queries and Titles in the past.
The order of names in the window may by according to the order of Related Queries of window 236 of
The names are adjacent to checkboxes. The user may now, for example, use the checkboxes to select a subgroup of the names and then select an Email option. An email form addressed to the checked names will be opened. The user may then write an email to this group of user, asking for more information about their activity in the subject of his search session.
Of course, the user may also select to use the phone numbers to call these people.
An example that highlights the usefulness of this method is provided hereinbelow: A user may look for an international standard in a specific matter. By looking at the ISO Internet site (www.iso.ch) He may find a reference to the standard he needs but the standard itself is not available there. The standard has to be ordered separately, be paid for and delivered by mail.
In this example the user may place a relevant query in query window 202 in order to get names of people, in the organization, who are involved in that subject. Then he can email them an inquiry to find whether they have in possession the requested document. By doing so he may shorten the time and cost to get the required document.
It would be appreciated by those skilled in the art that efficiency of System 100 depends on the computers in use, communication networks and other device parameters.
The flow of process, as described hereinabove may be modified to suit less efficient devices by avoiding updating the windows of
It is also appreciated that non-Boolean query systems, such as Natural Language Queries, may be used in the present invention.
The hereinabove embodiments are described in a way of example and do does not specify a limited the scope of the invention.
The scope of the invention is defined solely by the claims provided hereinbelow:
Number | Date | Country | Kind |
---|---|---|---|
126373 | Sep 1998 | IL | national |
Number | Name | Date | Kind |
---|---|---|---|
4774655 | Kollin et al. | Sep 1988 | A |
4799254 | Dayton et al. | Jan 1989 | A |
5278980 | Pedersen et al. | Jan 1994 | A |
5321833 | Chang et al. | Jun 1994 | A |
5410693 | Yu et al. | Apr 1995 | A |
5428778 | Brookes | Jun 1995 | A |
5504887 | Malhotra et al. | Apr 1996 | A |
5544049 | Henderson et al. | Aug 1996 | A |
5576954 | Driscoll | Nov 1996 | A |
5577239 | Moore et al. | Nov 1996 | A |
5642502 | Driscoll | Jun 1997 | A |
5659732 | Kirsch | Aug 1997 | A |
5671404 | Lizée et al. | Sep 1997 | A |
5694593 | Baclawski | Dec 1997 | A |
5721902 | Schultz | Feb 1998 | A |
5742816 | Barr et al. | Apr 1998 | A |
5754938 | Herz et al. | May 1998 | A |
5794237 | Gore, Jr. | Aug 1998 | A |
5805911 | Miller | Sep 1998 | A |
5855020 | Kirsch | Dec 1998 | A |
5864845 | Voorhees et al. | Jan 1999 | A |
5864846 | Voorhees et al. | Jan 1999 | A |
5864863 | Burrows | Jan 1999 | A |
5913215 | Rubinstein et al. | Jun 1999 | A |
5940821 | Wical | Aug 1999 | A |
5956711 | Sullivan et al. | Sep 1999 | A |
5987457 | Ballard | Nov 1999 | A |
6006222 | Culliss | Dec 1999 | A |
6006225 | Bowman et al. | Dec 1999 | A |
6012055 | Campbell et al. | Jan 2000 | A |
6014665 | Culliss | Jan 2000 | A |
6018344 | Harada et al. | Jan 2000 | A |
6029165 | Gable | Feb 2000 | A |
6032145 | Beall et al. | Feb 2000 | A |
6115718 | Huberman et al. | Sep 2000 | A |
6144958 | Ortega et al. | Nov 2000 | A |
6169986 | Bowman et al. | Jan 2001 | B1 |
6185558 | Bowman et al. | Feb 2001 | B1 |
6226630 | Billmers | May 2001 | B1 |
6243091 | Berstis | Jun 2001 | B1 |
6256633 | Dharap | Jul 2001 | B1 |
6405190 | Conklin | Jun 2002 | B1 |
6415282 | Mukherjea et al. | Jul 2002 | B1 |
6421675 | Ryan et al. | Jul 2002 | B1 |
6460060 | Maddalozzo, Jr. et al. | Oct 2002 | B1 |
6484162 | Edlund et al. | Nov 2002 | B1 |
6745178 | Emens et al. | Jun 2004 | B1 |
20010034763 | Jacobs et al. | Oct 2001 | A1 |
20030187837 | Culliss | Oct 2003 | A1 |
20050071325 | Bem | Mar 2005 | A1 |
20050114325 | Liu et al. | May 2005 | A1 |
20060041843 | Billsus et al. | Feb 2006 | A1 |
20080250026 | Linden et al. | Oct 2008 | A1 |
Number | Date | Country |
---|---|---|
119183 | Sep 1996 | IL |
Entry |
---|
Finkelstein, Sheldon, Common Expression Analysis in Database Applications, 1982, ACM 0-89791-073-7/82/006/0235, p. 235-245. |
Office Action issued for U.S. Appl. No. 10/905,297 dated Oct. 14, 2011. |
Number | Date | Country | |
---|---|---|---|
20100106717 A1 | Apr 2010 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10905297 | Dec 2004 | US |
Child | 12613604 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09398289 | Sep 1999 | US |
Child | 10905297 | US |