Patent Grant
10120883
Many search engine services, such as Google and Overture, provide for searching for information that is accessible via the Internet. These search engine services allow users to search for display pages, such as web pages, that may be of interest to users. After a user submits a search request (also referred to as a “query”) that includes search terms, the search engine service identifies web pages that may be related to those search terms. To quickly identify related web pages, the search engine services may maintain a mapping of keywords to web pages. This mapping may be generated by “crawling” the web (i.e., the World Wide Web) to identify the keywords of each web page. To crawl the web, a search engine service may use a list of base web pages to identify all web pages that are accessible through those base web pages. The keywords of any particular web page can be identified using various well-known information retrieval techniques, such as identifying the words of a headline, the words supplied in the metadata of the web page, the words that are highlighted, and so on. The search engine service may generate a relevance score to indicate how related the information of the web page may be to the search request. The search engine service then displays to the user links to those web pages in an order that is based on their relevance.
Several search engine services also provide for searching for images that are available on the Internet. These image search engines typically generate a mapping of keywords to images by crawling the web in much the same way as described above for mapping keywords to web pages. An image search engine service can identify keywords based on text of the web pages that contain the images. An image search engine may also gather keywords from metadata associated with images of web-based image forums, which are an increasingly popular mechanism for people to publish their photographs and other images. An image forum allows users to upload their photographs and requires the users to provide associated metadata such as title, camera setting, category, and description. The image forums typically allow reviewers to rate each of the uploaded images and thus have ratings on the quality of the images. Regardless of how the mappings are generated, an image search engine service inputs an image query and uses the mapping to find images that are related to the image query. An image search engine service may identify thousands of images that are related to an image query and presents thumbnails of the related images. To help a user view the images, an image search engine service may order the thumbnails based on relevance of the images to the image query. An image search engine service may also limit the number of images that are provided to a few hundred of the most relevant images so as not to overwhelm the viewer. Unfortunately, the relevance determination may not be particularly accurate because image queries may be ambiguous (e.g., “tiger” may represent the animal or the golfer), the keywords derived from web pages may not be very related to an image of the web page (e.g., a web page can contain many unrelated images), and so on.
A typical image search engine service may also suggest additional image queries to a user. For example, if a user submits “tiger” as an image query, an image search engine service may display thumbnails of images relating to “tiger” in relevance order. That image search engine service may also display the text of suggested image queries, such as “white tiger,” “mystical tiger,” “Tiger Woods,” and so on. When a user selects one of the suggested image queries, that image search engine service searches for images relating to the selected image query and displays the thumbnails of the images as the search result. Such a user interface has several disadvantages. First, a user may not know from the text of the suggested image query whether the images relating to the suggested image query will be of interest to the user. For example, a user may not know from the suggested image query “mystical tiger” what type of images will be in the search result. Second, the ordering of the thumbnails based on relevance of the images to the image query may result in thumbnails for only one type of image being displayed (e.g., a Bengal tiger) in the first few pages of results. Thus, the user may need to view many pages to get a feel for the different types of images (e.g., a mystical tiger) that are related to the image query.
A method and system for providing a user interface for presenting images of clusters of an image search result is provided. The user interface system is provided with clusters of images as the search result of an image query. The user interface system displays the search result in a cluster/view form using a cluster panel and a view panel. The cluster panel contains a cluster area for each cluster. The cluster area for a cluster may include the name of the cluster and mini-thumbnails of some of the images of the cluster. The view panel may contain thumbnails of images of the search result in a lucky view or a mix view. In the lucky view, the view panel contains thumbnails of images of a single cluster that may be arranged in a grid. In the mix view, the view panel contains thumbnails of images from multiple clusters that may also be arranged in a grid. When a user selects a cluster area from the cluster panel, the user interface system displays a list view of thumbnails for that cluster in the view panel.
The user interface system may display a thumbnail list near a cluster area of the cluster panel. The thumbnail list contains mini-thumbnails of the images of the selected cluster. When a user selects a mini-thumbnail from the thumbnail list, the user interface system may display a detail view of the corresponding image in the view panel.
The user interface system displays a detail view of an image in the view panel when a user selects an image. The detail view may include metadata associated with the image such as camera setting, photographer, and so on. The user interface system may also display a thumbnail scroll list in the view panel along with the detail view. A thumbnail scroll list contains mini-thumbnails of images. The user interface may select images to be included in a thumbnail scroll list based on the context in which the image of the detail view was selected.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
A method and system for providing a user interface for presenting images of clusters of an image search result is provided. In one embodiment, the user interface system is provided with clusters of images as the search result of an image query. Each cluster of images includes a cluster name and for each image of the cluster, a thumbnail of the image, metadata associated with the image, and a link to the image. The images within a cluster may be ordered based on their relevance to the image query. The user interface system displays the search result in a cluster/view form using a cluster panel and a view panel. The cluster panel contains a cluster area for each cluster. The cluster area for a cluster may include the name of the cluster and mini-thumbnails of some of the images of the cluster. The cluster areas of the cluster panel may be ordered based on a relevance score of the images of the cluster to the image query or may be ordered based on the number of images in the cluster. The view panel may contain thumbnails of images of the search result in a list view or a mix view. In the list view, the view panel contains thumbnails of images of a single cluster that may be arranged in a grid. The thumbnails in list view may be ordered based on relevance of the corresponding images to the image query. In the mix view, the view panel contains thumbnails of images from multiple clusters that may also be arranged in a grid. The thumbnails in mix view may be ordered in an image relevance to cluster order in which the thumbnail of the most relevant image of each cluster is ordered first, followed by the thumbnail of the second most relevant image of each image cluster, and so on. The list view thus provides a view of the images of a single cluster, and the mix view provides a view of the most relevant images from each cluster. Moreover, the cluster panel allows a user to get an understanding of the images of each cluster from the mini-thumbnails of the cluster areas. When a user selects a cluster area from the cluster panel, the user interface system displays a list view of thumbnails for that cluster in the view panel. The cluster panel and the view panel may contain scrollbars for scrolling the content of the panel.
In one embodiment, the user interface system may display a thumbnail list near a cluster area of the cluster panel. When a user selects a cluster (e.g., by right clicking on a cluster area), the user interface system displays a thumbnail list that may overlay a portion of the cluster panel and the view panel. The thumbnail list contains mini-thumbnails of the images of the selected cluster. For example, the user interface system may display in a rectangular area the mini-thumbnails for the 30 images with the highest relevance. The user interface system may position the rectangular area just below and to the right of the cluster area for the selected cluster. When a user selects a mini-thumbnail from the thumbnail list, the user interface system may display a detail view of the corresponding image in the view panel. If the user selects multiple mini-thumbnails from the thumbnail list, the user interface system may display thumbnails of the corresponding images in the view panel. The user interface system may also provide a scrollbar for the thumbnail list when a cluster contains more images than can be effectively displayed as mini-thumbnails at the same time.
In one embodiment, the user interface system displays a detail view of an image in the view panel when a user selects an image (e.g., by selecting a thumbnail from the view panel or mini-thumbnail from a thumbnail list). The detail view may include metadata associated with the image such as camera setting, photographer, and so on. The user interface system may also display a thumbnail scroll list in the view panel along with the detail view. A thumbnail scroll list contains mini-thumbnails of images. A user can scroll through the mini-thumbnails and select a mini-thumbnail of interest. When a user selects a mini-thumbnail, the user interface system displays in the view panel a detail view of the image associated with the selected mini-thumbnail. The user interface may select images to be included in a thumbnail scroll list based on the context in which the image of the detail view was selected. For example, if the image for the detail view was selected from a thumbnail within the view panel, then the images of the other thumbnails displayed in the view panel would be included in the thumbnail scroll list. If the view panel was in list view, then the images of the same cluster would be included in the thumbnail scroll list. If the view panel was in mix view, then the images of multiple clusters would be included in the thumbnail scroll list. If the image for the detail view was selected from a thumbnail list, then the images of the same cluster would be included in the thumbnail scroll list.
The user interface component displays a query panel and submits an image query to the search for images component. Upon receiving the search result, the user interface component invokes the appropriate components to display the search result. The components for displaying the search result in different ways are a cluster view component 814, a list view component 815, a mix view component 816, a box view component 817, a detail view component 818, and a thumbnail list view component 819. The cluster view component controls the displaying of the cluster panel. The list view component controls the displaying of the view panel in list view. The mix view component controls the displaying of the view panel in mix view. The box view component controls the displaying of the box panel. The detail view component controls the displaying of the detail view of an image. The thumbnail list view component controls the displaying of a thumbnail list.
The computing devices on which the user interface system may be implemented may include a central processing unit, memory, input devices (e.g., keyboard and pointing devices), output devices (e.g., display devices), and storage devices (e.g., disk drives). The memory and storage devices are computer-readable media that may contain instructions that implement the user interface system. In addition, the data structures and message structures may be stored or transmitted via a data transmission medium, such as a signal on a communications link. Various communications links may be used, such as the Internet, a local area network, a wide area network, or a point-to-point dial-up connection.
The user interface system may provide a user interface to various computing systems or devices including personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. The user interface system may also provide its services to various computing systems such as personal computers, cell phones, personal digital assistants, consumer electronics, home automation devices, and so on.
The user interface system may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, and so on that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. The user interface system may be used to present content of various types, such as photographs, drawings, artwork, videos, music, and so on. Accordingly, the invention is not limited except as by the appended claims.
This application is a continuation application of U.S. patent application Ser. No. 12/634,662, filed on Jan. 23, 2006, which is a continuation application of U.S. Pat. No. 7,644,373, issued on Jan. 5, 2010, which are incorporated herein in their entirety by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4888646 | Umeda et al. | Dec 1989 | A |
| 5301018 | Smidth et al. | Apr 1994 | A |
| 5579471 | Barber et al. | Nov 1996 | A |
| 5642433 | Lee et al. | Jun 1997 | A |
| 5751286 | Barber et al. | May 1998 | A |
| 5802361 | Wang et al. | Sep 1998 | A |
| 5870740 | Rose et al. | Feb 1999 | A |
| 5875446 | Brown et al. | Feb 1999 | A |
| 5937422 | Nelson et al. | Aug 1999 | A |
| 5987456 | Ravela et al. | Nov 1999 | A |
| 6006218 | Breese et al. | Dec 1999 | A |
| 6041323 | Kubota | Mar 2000 | A |
| 6097389 | Morris et al. | Aug 2000 | A |
| 6115717 | Mehrotra et al. | Sep 2000 | A |
| 6128613 | Wong et al. | Oct 2000 | A |
| 6134541 | Castelli et al. | Oct 2000 | A |
| 6167397 | Jacobson et al. | Dec 2000 | A |
| 6240378 | Imanaka et al. | May 2001 | B1 |
| 6256623 | Jones | Jul 2001 | B1 |
| 6317748 | Menzies et al. | Nov 2001 | B1 |
| 6321226 | Garber et al. | Nov 2001 | B1 |
| 6363373 | Steinkraus | Mar 2002 | B1 |
| 6370527 | Singhal | Apr 2002 | B1 |
| 6445834 | Rising, III | Sep 2002 | B1 |
| 6470307 | Turney | Oct 2002 | B1 |
| 6473753 | Katariya et al. | Oct 2002 | B1 |
| 6493719 | Booth et al. | Dec 2002 | B1 |
| 6522782 | Pass et al. | Feb 2003 | B2 |
| 6523021 | Monberg et al. | Feb 2003 | B1 |
| 6549897 | Katariya et al. | Apr 2003 | B1 |
| 6556710 | Pass et al. | Apr 2003 | B2 |
| 6567936 | Yang et al. | May 2003 | B1 |
| 6578032 | Chandrasekar et al. | Jun 2003 | B1 |
| 6606659 | Hegli et al. | Aug 2003 | B1 |
| 6643641 | Snyder | Nov 2003 | B1 |
| 6704729 | Klein et al. | Mar 2004 | B1 |
| 6728752 | Chen et al. | Apr 2004 | B1 |
| 6748387 | Garber et al. | Jun 2004 | B2 |
| 6748398 | Zhang et al. | Jun 2004 | B2 |
| 6766320 | Wang et al. | Jul 2004 | B1 |
| 6775666 | Stumpf et al. | Aug 2004 | B1 |
| 6816850 | Culliss | Nov 2004 | B2 |
| 6823335 | Ikeda | Nov 2004 | B2 |
| 6847733 | Savakis et al. | Jan 2005 | B2 |
| 6892245 | Crump et al. | May 2005 | B1 |
| 6895552 | Balabanovic et al. | May 2005 | B1 |
| 6901411 | Li et al. | May 2005 | B2 |
| 6920448 | Kincaid et al. | Jul 2005 | B2 |
| 6944612 | Roustant et al. | Sep 2005 | B2 |
| 6970923 | Mukaiyama et al. | Nov 2005 | B1 |
| 6978275 | Castellanos et al. | Dec 2005 | B2 |
| 7010751 | Shneiderman | Mar 2006 | B2 |
| 7017114 | Guo et al. | Mar 2006 | B2 |
| 7047482 | Odom | May 2006 | B1 |
| 7051019 | Land et al. | May 2006 | B1 |
| 7065520 | Langford | Jun 2006 | B2 |
| 7099860 | Liu et al. | Aug 2006 | B1 |
| 7111002 | Zhang et al. | Sep 2006 | B2 |
| 7113944 | Zhang et al. | Sep 2006 | B2 |
| 7158878 | Rasmussen et al. | Jan 2007 | B2 |
| 7162468 | Schwartz et al. | Jan 2007 | B2 |
| 7287012 | Corston et al. | Oct 2007 | B2 |
| 7349899 | Namba | Mar 2008 | B2 |
| 7430566 | Li et al. | Sep 2008 | B2 |
| 7492921 | Foote | Feb 2009 | B2 |
| 7499916 | Liu et al. | Mar 2009 | B2 |
| 7725451 | Jing et al. | May 2010 | B2 |
| 20010020238 | Tsuda | Sep 2001 | A1 |
| 20010049700 | Ichikura | Dec 2001 | A1 |
| 20020035573 | Black et al. | Mar 2002 | A1 |
| 20020042793 | Choi | Apr 2002 | A1 |
| 20020042847 | Takats et al. | Apr 2002 | A1 |
| 20020052894 | Bourdoncle et al. | May 2002 | A1 |
| 20020055936 | Cheng et al. | May 2002 | A1 |
| 20020103890 | Chaudhuri et al. | Aug 2002 | A1 |
| 20020194166 | Fowler | Dec 2002 | A1 |
| 20030009469 | Platt et al. | Jan 2003 | A1 |
| 20030023600 | Nagamura et al. | Jan 2003 | A1 |
| 20030061334 | Hirata et al. | Mar 2003 | A1 |
| 20030063131 | Ma | Apr 2003 | A1 |
| 20030126235 | Chandrasekar et al. | Jul 2003 | A1 |
| 20030140033 | Iizuka et al. | Jul 2003 | A1 |
| 20030142123 | Malamud et al. | Jul 2003 | A1 |
| 20030144994 | Wen et al. | Jul 2003 | A1 |
| 20040015461 | Lo | Jan 2004 | A1 |
| 20040044469 | Bender et al. | Mar 2004 | A1 |
| 20040066414 | Czerwinski | Apr 2004 | A1 |
| 20040111438 | Chitrapura et al. | Jun 2004 | A1 |
| 20040225667 | Hu et al. | Nov 2004 | A1 |
| 20040236760 | Arkeketa et al. | Nov 2004 | A1 |
| 20040249774 | Caid et al. | Dec 2004 | A1 |
| 20040267740 | Liu et al. | Dec 2004 | A1 |
| 20050015366 | Carrasco et al. | Jan 2005 | A1 |
| 20050022106 | Kawai et al. | Jan 2005 | A1 |
| 20050027377 | Lucas et al. | Feb 2005 | A1 |
| 20050065959 | Smith et al. | Mar 2005 | A1 |
| 20050086337 | Quittek et al. | Apr 2005 | A1 |
| 20050097475 | Makioka et al. | May 2005 | A1 |
| 20050108200 | Meik et al. | May 2005 | A1 |
| 20050141497 | Wu | Jun 2005 | A1 |
| 20050144158 | Capper et al. | Jun 2005 | A1 |
| 20050165841 | Kasperkiewicz et al. | Jul 2005 | A1 |
| 20050188326 | Ikeda | Aug 2005 | A1 |
| 20060025985 | Vinberg et al. | Feb 2006 | A1 |
| 20060026152 | Zeng et al. | Feb 2006 | A1 |
| 20060117002 | Swen | Jun 2006 | A1 |
| 20060117003 | Ortega et al. | Jun 2006 | A1 |
| 20060204142 | West et al. | Sep 2006 | A1 |
| 20060242126 | Fitzhugh | Oct 2006 | A1 |
| 20060242178 | Butterfield et al. | Oct 2006 | A1 |
| 20070005320 | Vinberg et al. | Jan 2007 | A1 |
| 20070073748 | Barney | Mar 2007 | A1 |
| 20070133947 | Armitage et al. | Jun 2007 | A1 |
| 20070174269 | Jing et al. | Jul 2007 | A1 |
| 20070174790 | Jing et al. | Jul 2007 | A1 |
| 20070174865 | Jing et al. | Jul 2007 | A1 |
| 20070174872 | Jing et al. | Jul 2007 | A1 |
| 20070185866 | Evans | Aug 2007 | A1 |
| 20070198182 | Singh | Aug 2007 | A1 |
| 20070209025 | Jing et al. | Sep 2007 | A1 |
| 20080086468 | Jing et al. | Apr 2008 | A1 |
| 20080086686 | Jing et al. | Apr 2008 | A1 |
| 20080189253 | Oliver et al. | Aug 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 0750254 | Dec 1996 | EP |
| 0784259 | Jul 1997 | EP |
| 1020010105051 | Nov 2001 | KR |
| 1020020000680 | Jan 2002 | KR |
| 1020030023950 | Mar 2003 | KR |
| Entry |
|---|
| Kherfi, et al., “Image Retrieval from the World Wide Web Issues, Techniques and Systems,”, In Journal ACM Computing Surveys (CSUR), vol. 36, Issue 1, Mar. 1, 2004, pp. 35-67. |
| Krishnapuram, et al., “Low-Complexity Fuzzy Relational Clustering Algorithms for Web Mining”, In Proceedings of IEEE Transactions on Fuzzy Systems, vol. 9, Issue 4, Aug. 7, 2002, 28 Pages. |
| Kummamuru, et al., “A Hierarchical Monothetic Document Clustering Algorithm for Summarization and Browsing Search Results”, In Proceedings of the 13th international conference on World Wide Web, May 17, 2004, pp. 658-665. |
| Lempel, et al., “PicASHOW: Pictorial Authority Search by Hyperlinks on the Web”, In Journal ACM Transactions on Information Systems (TOIS), vol. 20, Issue 1, Jan. 1, 2002, pp. 438-448. |
| Li, et al., “Grouping www Image Search Results by Novel Inhomogeneous Clustering”, In Proceedings of the 11th International Multimedia Modelling Conference, Jan. 12, 2005, 7 Pages. |
| Li, et al., “Intuitive and Effective Interfaces for WWW Image Search Engine”, In Proceedings of the 12th annual ACM International conference on Multimedia, Oct. 10, 2004, 4 Pages. |
| Liu, et al., “Effective Browsing of Web Image Search Results”, In Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, Oct. 15, 2004, 7 Pages. |
| Zhang, L., “Enjoy High Quality Photos in Vertical Image Search Engine”, Submitted to the SIGCHI 2006 Conference on Human Factors in Computing Systems, 2006, 10 Pages. |
| Liu, et al., “Mining Topic—Specific Concepts and Definitions on the Web”, In Proceedings of the 12th international conference on World Wide Web, May 20, 2003, pp. 251-260. |
| Luo, et al., “A World Wide Web Based Image Search Engine Using Text and Image Content Features”, In Proceedings of the Electronic Imafing Science and Technology (SPIE), vol. 5018, Jan. 2003, pp. 123-130. |
| Maña-López, et al., “Multidocument Summarization: Added Value to Clustering in Interactive Retrieval”, In Journal ACM Transactions on Information Systems (TOIS), vol. 22, Issue 2, Apr. 1, 2004, pp. 215-241. |
| Mukherjea, et al., “Using Clustering and Visualization for Refining the Results of a WWW Image Search Engine”, In Proceedings of the 1998 workshop on New paradigms in information visualization and manipulation, Nov. 1, 1998, pp. 29-35. |
| Mysore, et al., “DIOGENES: A Distributed Search Agent”, Technical Report CSE-2003-24, Department of Computer Science and Engineering, May, 2003, 80 Pages. |
| Nie, et al., “Object-Level Ranking: Bringing Order to Web Objects”, In Proceedings of the 14th international conference on World Wide Web, May 10, 2005, 8 Pages. |
| Nie, et al., “Object-level Web Information Retrieval”, In Proceedings of Technical Report of Microsoft Research, 2005, 8 Pages. |
| Ong, et al., “FOCI: Flexible Organizer for Competitive Intelligence”, In Proceedings of the tenth international conference on Information and knowledge management, Oct. 5, 2001, 3 Pages. |
| Page, et al., “The PageRank Citation Ranking—Bringing Order to the Web”, In Technical Report of Stanford InfoLab Publication Server, Jan. 29, 1998, 17 Pages. |
| “International Search Report and Written Opinion Issued in PCT Application No. PCT/US2007/079983”, dated Jan. 16, 2008, 10 Pages. |
| Roussinov, et al., “Visualizing Internet Search Results with Adaptive Self-Organizing Maps”, In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, Aug. 1, 1999, 2 Pages. |
| Rui, et al., “Image Retrieval: Current Techniques, Promising Directions and Open Issues”, In Journal of visual communication and image representation , vol. 10, Issue 1, Mar. 1, 1999, pp. 39-62. |
| Sarkar, et al., “Graphical Fisheye Views”, In Magazine Communications of the ACM, vol. 37, Issue 12, Dec. 1, 1994, pp. 73-84. |
| Savakis, et al., “Evaluation of image appeal in consumer photography”, In Proceedings SPIE Human Vision and Electronic Imaging V, Jan. 2000, 10 Pages. |
| Schwartz, Steve, “Chapter 4: Organizing Pictures”, In Visual Quick Project Guide: Organizing and Editing Your Photos with Picasa, Published by Peachpit Press, May 10, 2005, 22 Pages. |
| Sclaroff, et al., “ImageRover: A Content-Based Image Browser for the World Wide Web”, In Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries, Jun. 20, 1997, 8 Pages. |
| Sclaroff, et al., “Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web”, In Journal Computer Vision and Image Understanding, vol. 75, Issue 1, Aug. 1999, pp. 86-98. |
| Shen, et al., “Giving Meanings to WWW Images”, In Proceedings of the eighth ACM international conference on Multimedia, Oct. 30, 2000, pp. 39-47. |
| Smeulders, et al., “Content-Based Image Retrieval at the End of the Early Years”, In Journal of IEEE Transactions on Pattern Analysis and Machine, vol. 22, Issue 12, Dec. 1, 2000, pp. 1349-1380. |
| Smith, et al., “Visually Searching the Web for Content”, In Journal of IEEE MultiMedia, vol. 4, Issue 3, Jul. 1, 1997, pp. 12-20. |
| Sullivan, Danny, “Hitwise Search Engine Ratings”, In Proceedings of Search Engine Watch, Incisive Interactive Marketing LLC, Aug. 23, 2005, 3 Pages. |
| Susstrunk, et al., “Color Image Quality on the Internet”, In Proceedings of Electronic Imaging, International Society for Optics and Photonics, vol. 5304, Dec. 22, 2003, 14 Pages. |
| Teevan, et al., “The Perfect Search Engine Is Not Enough: A Study of Orienteering Behavior in Directed Search”, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Apr. 24, 2004, pp. 415-422. |
| Tong, et al., “Classification of Digital Photos Taken by Photographers or Home”, In Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing—vol. Part I, Nov. 30, 2004, 8 Pages. |
| Toyama, et al., “Geographic Location Tags on Digital Images”, In Proceedings of the eleventh ACM international conference on Multimedia, Nov. 2, 2003, 11 Pages. |
| Vlachos, et al., “Indentifying Similarities, Periodicties and Bursts for Online Search Queries”, In Proceedings of the 2004 ACM SIGMOD international conference on Management of data, Jun. 13, 2004, 12 Pages. |
| Wang, et al., “Evaluating Contents-Link Coupled Web Page Clustering for Web Search Results”, In Proceedings of the eleventh international conference on Information and knowledge management, Nov. 4, 2002, pp. 499-506. |
| Wang, et al., “Grouping Web Image Search Result”, In Proceedings of the 12th annual ACM international conference on Multimedia, Oct. 10, 2004, pp. 436-439. |
| Wang, et al., “Large-Scale Duplicate Detection for Web Image Search”, In IEEE International Conference on Multimedia and Expo, Jul. 9, 2006, 4 Pages. |
| White, et al., “Similarity Indexing: Algorithms and Performance”, Proceedings of Conference on Storage and Retrieval for Image and Video Databases (SPIE), vol. 2670, San Jose, CA, Mar. 13, 1996, pp. 62-73. |
| Wies, Rene, “Policies in Network and Systems Management—Formal Definition and Architecture”, In Journal of Network and Systems Management, Plenum Publishing Corporation, vol. 2, No. 1, Mar. 1994, 17 Pages. |
| Woodruff, et al., “Using Thumbnails to Search the Web”, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Mar. 1, 2001, 8 Pages. |
| Wu, et al., “Finding More Useful Information Faster from Web Search Results”, In Proceedings of the twelfth international conference on Information and knowledge management, Nov. 3, 2003, pp. 568-571. |
| Xi, et al., “Link Fusion: A Unified Link Analysis Framework for Multi-Type Interrelated Data Objects”, In Proceedings of the 13th international conference on World Wide Web, May 17, 2004, pp. 319-327. |
| Yee, et al., “Faceted Metadata for Image Search and Browsing”, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Apr. 5, 2003, 8 Pages. |
| Zamir, et al., “Web Document Clustering—A Feasibility Demonstration”, In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, Aug. 1, 1998, 9 Pages. |
| Zeng, et al., “Learning to Cluster Web Search Results”, In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, Jul. 25, 2004, 8 Pages. |
| “Altavista Image”, Retrieved from «http://web.archive.org/web/20060422092837/http://www.altavista.com/», Retrieved Date: Apr. 22, 2006, 1 Page. |
| “Citeseer, Scientific Literature Digital Library”, Retrieved from «http://web.archive.org/web/20060701014444/http://citeseerist.psu.edu/», Jul. 1, 2006, 1 Page. |
| “Ditto”, Retrieved from «http://web.archive.org/web/20060712142218/http://www.ditto.com/», Jul. 12, 2006, 1 Page. |
| “Flickr”, Retrieved from «https://web.archive.org/web/20050218030404/http://flickr.com/», Feb. 18, 2005, 5 Pages. |
| “Formula for Calculating the Top Rated 250 Titles in imdb”, Retrieved from «http://web.archive.org/web/20060706043658/http://www.imdb.com/chart/top», Jul. 6, 2006, 8 Pages. |
| “Froogle, Google Product Search”, Retrieved from «http://web.archive.org/web/20050714032626/http://froogle.google.com/», Jul. 14, 2005, 1 Page. |
| “Google Image Search”, Retrieved from «http://images.google.com», Retrieved Date: Jun. 10, 2007, 1 Page. |
| “Google Maps, Google Local Search”, Retrieved from «http://local.google.com/», Retrieved Date: Jul. 14, 2006, 1 Page. |
| “Google Scholar Paper Search”, Retrieved from «http://Scholar.google.com», Retrieved Date: Jul. 13, 2006, 1 Pages. |
| “Google Web Search”, Retrieved from «http://www.google.com», Retrieved Date: Jun. 7, 2007, 3 Pages. |
| “GoogleNews, Google News Search”, Retrieved from «http://news.google.com», Retrieved Date: Jul. 14, 2006, 4 Pages. |
| “GoogleVideo, Google Video Search”, Retrieved from «http://web.archive.org/web/20060714183439/http://video.google.com/», retrieved Date: Jul. 14, 2006, 2 Pages. |
| “MSRA Clustering Search”, Retrieved from «http://web.archive.org/web/20070613192108/http://rwsm.directtaps.net/», Retrieved Date: Jun. 13, 2007, 1 Page. |
| “Photosig”, Retrieved from «http://www.photosig.com», Retrieved Date: Aug. 17, 2006, 3 Pages. |
| “PicSearch”, Retrieved from «http://www.picsearch.com/», Jul. 14, 2006, 1 Page. |
| “Picsearch Image Search”, Retrieved from «http://www.picsearch.com/index.cgi?q=tiger», Retrieved Date: Jan. 5, 2006, 2 Pages. |
| “Vivisimo Clustering Search”, Retrieved from «https://web.archive.org/web/20070629130814/http://search.vivisimo.com/», Retrieved Date: Jun. 7, 2007, 4 Pages. |
| “Yahoo Homepage Search”, Retrieved from «http://www.yahoo.com/», Jun. 7, 2007, 1 Pages. |
| “Yahoo Image Search”, Retrieved from «http://images.search.yahoo.com/», Retrieved Date: Jun. 7, 2007, 3 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 11/337,945”, dated Oct. 16, 2008, 20 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 11/337,945”, dated Mar. 6, 2008, 13 Pages. |
| “Notice of Allowance Issued in U.S. Appl. No. 11/337,945”, dated Oct. 21, 2009, 4 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 11/337,945”, dated May 26, 2009, 11 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated Jul. 19, 2013, 14 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated May 8, 2014, 28 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated Oct. 7, 2015, 27 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated Jun. 4, 2015, 25 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated Dec. 6, 2013, 22 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 12/634,662”, dated Mar. 1, 2013, 14 Pages. |
| “Notice of Allowance Issued in U.S. Appl. No. 12/634,662”, dated Mar. 22, 2016, 9 Pages. |
| Brin, et al., “The Anatomy of a Large-Scale Hypertextual (Web) Search Engine”, In Proceedings of the seventh international conference on World Wide Web, Apr. 1, 1998, 20 Pages. |
| Broder, Andrei, “A Taxonomy of Web Search”, In ACM SIGIR Forum, vol. 36, Issue 2, Sep. 1, 2002, 8 Pages. |
| Cai, et al., “Hierarchical Clustering of WWW Image Search Results Using Visual, Textual and Link Analysis”, In Proceedings of the 12th annual ACM international conference on Multimedia, Oct. 10, 2004, 8 Pages. |
| Chang, et al., “Image Information Systems: Where do we go from here?”, In Proceedings of IEEE Transactions on Knowledge and Data Engineering, vol. 4, Issue 5, Oct. 1992, pp. 431-442. |
| Chau, et al., “Personalized Spiders for Web Search and Analysis”, In Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, Jan. 1, 2001, 9 Pages. |
| Chen, et al., “Bringing Order to the Web: Automatically Categorizing Search Results”, In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, Apr. 1, 2000, 9 Pages. |
| Chen, et al., “iFind: A Web Image Search Engine”, In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, Sep. 1, 2001, 1 Page. |
| Dumais, “Optimizing Search by Showing Results in Context”, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Mar. 1, 2001, 8 Pages. |
| Ferragina, et al., “The Anatomy of a Clustering Engine for Web-Page Snippets”, In Proceedings of Fourth IEEE International Conference on Data Mining ICDM '04, Tech Report: TR-04-05, Jan. 29, 2004, 21 Pages. |
| Frankel, et al., “WebSeer: An Image Search Engine for the World Wide Web”, In Technical Report 96-14, University of Chicago, Aug. 1, 1996, 24 Pages. |
| Fullford, et al., “A Federation Tool: Using the Management Object Model (MOM) to Manage, Monitor and Control an HLA Federation”, In Proceedings of Spring Simulation Interoperability Workshop, Mar. 1999, 5 Pages. |
| Glance, Natalie S., “Community Search Assistant”, In Proceedings of the 6th international conference on Intelligent user interfaces, Jan. 1, 2001, 8 Pages. |
| Halkidi, et al., “THESUS: Organizing Web document Collections Based on Link Semantics”, In Journal the International Journal on Very Large Data Bases (VLDB J), vol. 12 Issue, Nov. 1, 2003, 13 Pages. |
| Han, et al., “Intelligent Metasearch Engine for Knowledge Management”, In Proceedings of the twelfth international conference on Information and knowledge management, Nov. 3, 2003, pp. 492-495. |
| He, et al., “Imagerank : Spectral Techniques for Structural Analysis of Image Database”, In Proceedings of the 2003 International Conference on Multimedia and Expo, vol. 2, Jul. 6, 2003, pp. 25-28. |
| Hearst, et al., “Reexamining the Cluster Hypothesis: Scatter/Gather on—Retrieval Results”, In Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, Aug. 18, 1996, pp. 76-84. |
| Huang, et al., “Force-Transfer: A New Approach to Removing Overlapping Nodes in Graph Layout”, In Proceedings of the 26th Australasian computer science conference, vol. 16, Feb. 1, 2003, 10 Pages. |
| Huang, et al., “Image Indexing Using Color Correlograms”, In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), Jun. 17, 1997, 7 Pages. |
| Indurkhya, et al., “Solving Regression Problems with Rule-based Classifiers”, In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, Aug. 26, 2001, pp. 287-292. |
| Jansen, et al., “Real Life Information Retrieval: A Study of User Queries on the Web”, In Proceedings of ACM SIGIR Forum, vol. 32, Issue 1, Apr. 1, 1998, 12 Pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20160357741 A1 | Dec 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12634662 | Dec 2009 | US |
| Child | 15183712 | US | |
| Parent | 11337945 | Jan 2006 | US |
| Child | 12634662 | US |
