METHOD OF DYNAMICALLY CREATING REAL TIME PRESENTATIONS RESPONSIVE TO SEARCH EXPRESSION

Information

  • Patent Application
  • 20080092051
  • Publication Number
    20080092051
  • Date Filed
    October 11, 2006
    19 years ago
  • Date Published
    April 17, 2008
    18 years ago
Abstract
The disclosure describes a method of dynamically creating real-time presentations responsive to search expressions. The method comprises retrieving information from search engines, parsing the retrieved information to create dynamically a structured document including mark-up tags, and rendering the structured document as a slide show presentation of images by a multimedia presentation module. The structured document may be editable, annotatable, storable, and publishable by a user viewing the slide show presentation on the client device. The information retrieved from the one or more search engines may be restricted to one or more specified web domains. Pertinent textual information about the object of interest may also be retrieved along with the image information for convenient review by the user. Each displayed image in the slideshow presentation may have an embedded hyperlink to the source page of the image.
Description

BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 shows a block diagram of an embodiment of the invention.



FIG. 2 shows a flow diagram illustrating the process flow of an embodiment of the invention.



FIG. 3 shows a block diagram of another embodiment of the present invention.



FIG. 4 shows a flow diagram illustrating the process flow of another embodiment of the present invention.



FIG. 5 shows an embodiment of a user-interface on a client device, disclosing an embodiment of the invention.



FIG. 6 shows an embodiment of a user-interface on a client device, disclosing another embodiment of the present invention.



FIG. 7 shows an embodiment of a user-interface on a client device, disclosing yet another embodiment of the invention.



FIG. 8 shows an embodiment of a user-interface on a client device, disclosing an embodiment of the invention.





DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

An object of the invention is to facilitate fast and parallel review of relevant information instead of the conventional serial search from a search results page. Another object of the invention is to create automatically a flip-book style slide show presentation that allows for interesting, user-friendly, and passive review of selected images and textual information and dramatically reduces the number of user actions (clicks) required as compared with a conventional serial search. This kind of presentation may be particularly effective on internet connected small form factor mobile devices (for example, mobile phones, PDAs, etc.)


Another object of the invention is to enable a user to conveniently organize visual and textual information by automatically authoring a structured document (for example, an XML based document) so that information contained in the structured document could be rendered in different client devices (for example, a personal computer, a mobile device, a television, etc.) as a slideshow presentation. This can enable the same information to be automatically adapted for display in different client devices viewing data from across a vast number of sources.


Another object of the invention is to allow a user to edit and annotate the slideshow presentation of visual, textual, and audio information relating to a subject of interest obtained from the internet, from specific web domains, or from a user's collection and/or database. Adding relevant text over or around the image (user can determine what high-value info they want to add)—creates a compelling and informative snapshot, thus eliminating the need for excessive serial “blind” investigation of links in a convention search results page.


Another object of the invention is to allow a user to share the presentations created by him with others by saving and publishing the slideshow presentation (for example, to a web URL or to a database) and by sending the URL of the presentation to his contacts by email.


Another object of the invention is to facilitate a highly-efficient parallel search paradigm that is not bound by spatial 2D (or even 3D) constraints of the traditional page/list view and incorporates the additional dimension of time in the slide show presentation.


In the following description of various embodiments including the preferred embodiment, reference is made to the accompanying drawings, which show by way of illustration the embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the spirit or scope of the invention. Those skilled in the art will readily appreciate that the detailed description given herein with respect to these drawings is for explanatory purposes as the invention extends beyond these limited embodiments.



FIG. 1 shows a block diagram of an embodiment of the invention as disclosed herein. The embodiment discloses a client machine 150 connectable to a web server 100 and one or more search engines 120. The client machine 150 includes a module 130 for creating structured documents having markup tags, an editing & annotating module 160, and a client side presentation module 170. The web server 100 includes a module to publish structured documents to a unique web URL 180, and a module to publish structured documents to a database 140.


A user enters a search expression 110 in the client machine 150. A search expression 110 can be a particular word, phrase, or collection of words pertaining to which an image search is to be conducted. The client machine 150 can be a PC, a mobile device, a television, etc. The client machine 150 passes the search expression 110 to the search engines 120. The search engines 120 can be commercial databases of indexed web pages on the World Wide Web (for example, Google™, Altavista™, MSN™, Wikipedia™, Flickr™, and other commercial databases (such as, travelocity.com, car.com) etc.). The search engines 120 return the information corresponding to the search expression such as, but not limited to image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, abstracts and alt text, etc.


The information retrieved from the search engines 120 can be sent for conversion to the module 130 for creating structured documents having mark-up tags. The module 130 for creating structured documents converts the retrieved information into a structured document. The structured document can be a document having multiple mark-up tags. Examples of the structured document can be extensible mark up language (XML) based documents, hypertext markup language (HTML) based documents, standard generalized mark-up language (SGML) based documents, etc. The user can view the thumbnails of the images retrieved from the internet. Further, based on choice or requirement the user can edit/annotate the structured document or he can publish the structured document with or without editing. The user can publish the structured document to a unique web URL using the module for publishing structured document to a unique web URL 180 or it can be published to a database 140 (both residing on the web server 100).


If the user opts for editing and annotating the structured document, the system can send the structured document to the editing and annotating module 160 residing on the client machine 150. The editing & annotating module 160 facilitates the user to do a variety of editing tasks, for example, but not limited to, annotate, insert comments, add images, remove images, resize images, crop images, add layered mark-up to images, combine one or more images into a single image file, change the sequence of images, edit the transitions between images, add audio clips to the presentations, and blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source, etc.


The edited/annotated structured documents can be rendered by the client side presentation module 170 to display a slide show of images. In another embodiment the edited/annotated structured documents can also be rendered by the client side presentation module 170 to display a formatted printable page and/or a PDF document depending upon the user's requirement. The client side presentation module 170 can be a multimedia rendering application, and/or a document rendering application. Examples of the multimedia rendering application can be a Flash player, etc. and the document rendering application can be a Microsoft office tool, Adobe Acrobat Reader, etc. If the user wants, he/she can save the edited/annotated structured document to the database 140 residing on the web server 100 for future use.



FIG. 2 shows a flow diagram illustrating the process flow of an embodiment of a method of dynamically creating customized presentations corresponding to a search expression.


In step 200, a search expression can be sent to one or more search engines using a client machine for real time search. A search expression can be a particular word, phrase, or collection of words.


In step 210, the client machine retrieves the information corresponding to the search expression from one or more search engines. The information can include, but not limited to, image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, abstracts and alt text, etc.


In step 220, the retrieved information can be sent to a module for creating structured documents, wherein the information can be parsed to create a structured document having mark-up tags.


In step 230, the structured document can be rendered as a slide show presentation, a formatted printable page, and/or a PDF document in the client device using a client side presentation module or the structured document can be sent to the editing and annotating module.


In step 240, the structured document can be sent for editing and annotating as per user's choice. The user can do a variety of editing and annotating tasks.


In step 250, the structured document after editing/annotating can be stored to the database or can be published to a unique web URL that can be accessed using any web browser, and/or it can be rendered as a slide show to the user.



FIG. 3 shows a block diagram of an embodiment of the invention as disclosed herein. The embodiment discloses a system of dynamically creating customized presentations corresponding to a search expression. The embodiment includes a web server 300 connectable with a client machine 350 and one or more search engines 320. The web server 300 includes a module 330 for creating structured documents having mark-up tags, a module 380 to publish structured documents to a unique web URL and a module 340 to publish structured documents to a database for storing purpose. The client machine 350 includes an editing & annotating module 360 and a client side presentation module 370.


A user enters a search expression 310 using the client machine 350. The client machine 350 can be a PC, a mobile device, a television, etc. The client machine 350 using a web browser sends the search expression 310 to the web server 300. The web server 300 can be any computer, which is responsible for accepting HTTP requests from the web browser on the client machine 350 and responding to the HTTP requests and serving back to the web browser the required information.


The web server 300 passes the search expression 310 to the one or more search engines 320. The one or more search engines 320 return the information corresponding to the search expression 310. The information can include, but not be limited to, image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, abstracts and alt text, etc.


The information retrieved from the one or more search engines 320 can be sent to the module 330 for creating a structured document having mark-up tags. The structured document can be a document having multiple mark-up tags. Examples of structured documents can be extensible mark up language (XML) based documents, hypertext markup language (HTML) based documents, standard generalized mark-up language (SGML) based documents, and the like.


The structured document may be edited and annotated by a user using the editing & annotating module 360 residing on the client machine 350. The user may publish the structured document to a unique web URL 380, or to a database 340 residing on the web server 300 depending upon his/her choice. The editing & annotating module 360 enables the user to do a variety of editing and annotating tasks, for example, but not limited to, annotate, insert comments, add images, remove images, resize images, crop images, add layered mark-up to images, combine one or more images into a single image file, change the sequence of images, edit the transitions between images, add audio clips to the presentations, and to blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source, etc. The structured document can be rendered by the client side presentation module 370 to display a slide show of images before or after sending the structured document to the editing and annotating module. The structured document can also be displayed as a formatted printable page and/or a PDF document depending upon the user's requirement. The client side presentation module 170 can be a multimedia rendering application, and/or a document rendering application. Example of the multimedia rendering application can be a Flash player, etc and the document rendering application can be a Microsoft office tool, Adobe Acrobat Reader, etc. The structured document can be published to a unique web URL or it can be saved to the database 340 for future use.



FIG. 4 shows a flow diagram illustrating the process flow of a method of dynamically creating customized presentations corresponding to a search expression.


In step 400, a search expression can be sent to a web server using a client machine. A search expression can be a particular word, phrase, or collection of words.


In step 410, the search expression can be transmitted from the web server to one or more search engines for real time search.


In step 420, the web server retrieves the information corresponding to the search expression from the one or more search engines.


In step 430, the retrieved information can be sent to a module for creating structured documents, wherein the retrieved information can be parsed to create a structured document having mark-up tags.


In step 440, the structured document can be rendered as a slide show presentation, a formatted printable document and/or a PDF document in the client device using the client side presentation module and/or it may be sent to an editing and annotating module.


In step 450, the structured document can be sent for editing and annotating as per user's choice.


In step 460, the structured document after editing/annotating can be stored to the database or can be published to a unique web URL that can be accessed using any web browser, and/or it can be rendered as a slide show, a formatted printable document and/or a PDF document to the user.



FIG. 5 shows an embodiment of a user-interface on a client device, disclosing a user-interface for dynamically authoring customized presentations corresponding to a search expression. The embodiment includes a search box 500 in which a user can input a search expression 510. The search expression 510 can be sent to one or more search engines for real time search. The one or more search engines provide desired information such as, but not limited to, image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, abstracts, and alt text, etc. corresponding to the search expression 510. A web browser residing on the client device can display thumbnails of images in the form of a thumbnail gallery 520 to the user. The user can select a set of thumbnails 530 from the thumbnail gallery 520 using any one of several methods such as drag-and-drop method, click to select method, etc.


The information retrieved from the one or more search engines for the selected set of thumbnails can be sent to a module for creating a structured document (not shown) having mark-up tags. The module for creating structured documents converts the information corresponding to the selected set of thumbnails into a structured document. The structured document can be rendered by the client side presentation module (not shown) to display a slide show presentation 540 on the user-interface. The method enables the user to view the complete slideshow of selected and ordered images without having to serially drill the link for each image.



FIG. 6 shows an embodiment of a user-interface showing a few options for editing/annotating a slide show presentation 605 of selected images corresponding to a structured document. The embodiment discloses a user interface with several editing/annotating options. The slide show presentation 605 can be displayed to the user. The user can be provided with several editing options such as, but not limited to, “save” 620, “add text” 630, “delete an image” 635, “E-mail” 640, “insert an image” 650, etc. For example, the user can use the editing option “delete an image” 635 to delete an image from the slide show presentation. The editing & annotating module before implementing any instruction seeks confirmation 610 from the user's end. The user can use the editing option “Add Text” 630 to annotate each image of the slide show presentation. Similarly, the user can use the editing option “save” 620 and publish the structured document (not shown) to a database (not shown) residing on a web server (not shown). After completion of editing and annotating, the user can use the option “e-mail” 640 to send the saved structured document (not shown) to his contacts. It is to be understood that all the editing options basically modify the structured document. The slide show presentation displays the changes to the user when the modified structured document is rendered by a client side presentation module (not shown).



FIG. 7 shows an embodiment of a user-interface for some other editing options (not a complete list of editing options) for a slide show presentation corresponding to a structured document. The embodiment discloses some editing options such as “add caption text” 710, “transition mode” 720, and “time duration” 730, etc. A user can use the editing option “add caption text” 710 to add details such as image name, user comments, etc. to images displayed in the slideshow presentation. The user can use the editing option “transition mode” 720 to change the transition style between consecutive images of the slide show presentation. Examples of “transition mode” can be “drop”, “squeeze down”, “squeeze up”, “move left”, “move right”, etc. Similarly, the user can use the editing option “time duration” 730 to variate the time interval between the transitions of images. All the changes can be saved in a structured document using a “Save Changes” 740 option. It is to be understood that all the editing options basically modify the structured document. The slide show presentation displays the changes to the user when the modified structured document is rendered by a client side presentation module (not shown).


In a conventional search system, search results entirely depend upon the formation of search expressions. Variation of single word in a search expression may lead to entire new set of search results. Thus, to facilitate a user, the embodiment discloses an alternative way of forming a search query, which can be termed as a rollover search expression. In the rollover search expression as the user's mouse will roll over a suggested search phrase, an automatic search query is generated, which will yield search results from search engines.



FIG. 8 shows an embodiment of a web page in which some of the search expressions are part of the text of the web page, and the web page is programmed such that when a user's mouse will roll over say the search expression 810 (“Ford F 150” in this example), an automatic search query is generated corresponding to the search expression 810, and information related to the search expression 810 “Ford F 150” can be retrieved from one or more search engines and/or specific web domains. A set of thumbnails 820 corresponding to the search expression is displayed to the user as a thumbnails galley. The user selects some images from the thumbnails galley. A structured document corresponding to the selected images is created which can be rendered as a slide show presentation 830 by a client side presentation module and displayed to the user. The user can use an editing option “add comments” 840 to add comments to each image.


Having fully described the preferred embodiment, other equivalent or alternative methods of retrieving information, creating structured documents, editing and annotating the structured documents, rendering the structured documents as slide show presentations by a rendering software, and publishing the documents according to the present invention will be apparent to those skilled in the art. The invention has been described above by way of illustration, and the specific embodiment disclosed is not intended to limit the invention to the particular forms disclosed. For example, the embodiments described in the foregoing were directed to providing you clear ideas about the preferred modes, including the best mode, of making and using the present invention; however, in alternate embodiments, those skilled in the art may implement the invention using various other means without deviating from the central idea of the invention. The invention therefore covers all modifications, equivalents, and alternatives falling within the spirit and scope of the following claims.

Claims
  • 1. A method of dynamically creating real-time presentations responsive to search expressions, comprising: retrieving from one or more search engines information responsive to a search expression, the information including one or more of image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, and abstracts;parsing the information retrieved from the one or more search engines to create dynamically, in real-time, a structured document including mark-up tags;rendering, in real-time, the structured document as a slide show presentation of images by a multimedia presentation module residing in a client device.
  • 2. The method of claim 1, wherein the structured document is editable, annotatable, storable, and publishable by a user viewing the slide show presentation on the client device;the editing capability includes one or more of the ability by the user to select images, add images, to remove images, to resize images, to crop images, to add layered mark-up to images, to combine one or more of the images into a single image, to change the sequence of images, to edit the transitions between images, to add audio clips to the presentation, and to blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source;the editing options may be manually or dynamically selected from a template-based edit decision list;the annotation capability includes the ability by the user to annotate the images with image captions or user comments;the storing capability includes the ability by the user to store the structured document in a database; andthe publishing capability includes the ability by the user to publish the structured document to a web URL so that the web URL can be shared by the user with other users and the slideshow presentation is viewable, editable, and annotatable by the other users.
  • 3. The method of claim 1, wherein the information retrieved from the one or more search engines is restricted to one or more specified web domains.
  • 4. The method of claim 3, wherein: the image information retrieved from the one or more specified web domains includes information on multiple images for an object of interest;pertinent textual information about the object of interest is also retrieved along with the image information; andthe images and the pertinent textual information associated with the object of interest are displayed together for convenient review by the user.
  • 5. The method of claim 1, wherein the structured document is an XML based document.
  • 6. The method of claim 1, wherein a rollover of a mouse by a user on a search expression included in a web page triggers transmission of the search expression to the one or more search engines.
  • 7. The method of claim 1, wherein each displayed image in the slideshow presentation has an embedded hyperlink to the source page of the image, for a user to view related information on the source page.
  • 8. A method of dynamically creating real-time presentations responsive to search expressions, comprising: transmitting a search expression from a client device having a web browser to a web server;transmitting, in real-time, the search expression from the web server to one or more search engines;retrieving from the one or more search engines information responsive to a search expression, the information including one or more of image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, and abstracts;parsing the information retrieved from the one or more search engines, to create dynamically, in real-time, a structured document having mark-up tags;transmitting, in real-time, the structured document from the web server to the client device; andrendering, in real-time, the structured document as a slide show presentation of images by a client side multimedia presentation module
  • 9. The method of claim 9, wherein: the structured document is editable, annotatable, and publishable by a user viewing the slide show presentation on the client device;the editing capability includes one or more of the ability by the user to add images, to remove images, to resize images, to crop images, to add layered mark-up to images, to combine one or more of the images into a single image, to change the sequence of images, to edit the transitions between images, to add audio clips to the presentation, and to blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source;the editing options may be manually or dynamically selected from a template-based edit decision list;the annotation capability includes the ability to annotate the images with image captions or user comments;the storing capability includes the ability by the user to store the structured document in a database; andthe publishing capability includes the ability to publish the structured document to a web URL, so that the web URL can be shared with other users and the slideshow presentation is viewable, editable, and annotatable by the other users.
  • 10. The method of claim 8, wherein the client device is selected from the group consisting of a personal computer, a mobile device, and a television.
  • 11. The method of claim 8, wherein: the image information retrieved from one or more specified web domains includes information for multiple images for an object of interest;pertinent textual information about the object of interest is also retrieved along with the image information; andthe images and the pertinent textual information associated with the object of interest are displayed together for convenient review by the user.
  • 12. The method of claim 8, wherein the structured document is an XML based document.
  • 13. A computer-readable medium having a computer program saved thereupon, said computer program comprising instructions for: retrieving from one or more search engines information responsive to a search expression, the information including one or more of image URLs, thumbnail URLs, source page URLs, web domain URLs, textual information, tags, metadata, and abstracts;parsing the information retrieved from the one or more search engines to create dynamically, in real-time, a structured document including mark-up tags; andrendering, in real-time, the structured document as a slide show presentation of images by a multimedia presentation module.
  • 14. The computer-readable medium of claim 13, wherein: the computer program has additional instructions for editing, annotating, storing, and publishing the structured document by a user viewing the slide show presentation on the client device;the editing functionality includes one or more of the ability by the user to add images, to remove images, to resize images, to crop images, to add layered mark-up to images, to combine one or more of the images into a single image, to change the sequence of images, to edit the transitions between images, to add audio clips to the presentation, and to blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source;the editing options may be manually or dynamically selected from a template-based edit decision list;the annotation functionality includes the ability to annotate the images with image captions or user comments;the storing capability includes the ability by the user to store the structured document in a database; andthe publishing functionality includes the ability to publish the structured document to a web URL, so that the web URL can be shared with other users and the slideshow presentation is viewable, editable, and annotatable by the other users.
  • 15. The computer-readable medium of claim 13, wherein: the image information retrieved from the one or more specified web domains includes information for multiple images for an object of interest;pertinent textual information about the object of interest is also retrieved along with the image information; andthe images and the pertinent textual information associated with the object of interest are displayed together for convenient review by the user.
  • 16. The computer-readable medium of claim 13, wherein a rollover of a mouse by a user on a search expression included in a web page triggers transmission of the search expression to the one or more search engines.
  • 17. The computer-readable medium of claim 13, wherein each displayed image in the slideshow presentation has an embedded hyperlink to the source page of the image, for a user to view other related information on the source page.
  • 18. A system for dynamically creating customized presentations responsive to search expressions, comprising: a web server, including:a module for creating a structured document from information responsive to a search expression retrieved from one or more search engines,a module for storing the structured document in a database on the web server, anda module for publishing the structured document to a web URL; anda client device connectable to the web server by an internet connection, the client device including:an editing module for editing the structured document, an annotation module for annotating the structured document; anda multimedia presentation module for rendering the structured document as a slideshow presentation of images in real-time.
  • 19. The system of claim 18, wherein: the editing module includes one or more of the functionality by the user to add images, to remove images, to resize images, to crop images, to add layered mark-up to images, to combine one or more of the images into a single image, to change the sequence of images, to edit the transitions between images, to add audio clips to the presentation and to blend in the presentation the images retrieved using the one or more search engines with other images or audio clips retrieved from any other source;the editing options may be manually or dynamically selected from a template-based edit decision list;the annotation module includes the functionality to annotate the images with image captions or user comments;the publishing module includes the functionality to publish the structured document to a web URL, so that the web URL can be shared with other users and the slideshow presentation is viewable, editable, and annotatable by the other users.
  • 20. The system of claim 18, wherein: the image information retrieved from one or more specified web domains includes information about multiple images for an object of interest;pertinent textual information about the object of interest is also retrieved along with the image information; andthe images and the pertinent textual information associated with the object of interest are displayed together for convenient review by the user.