Displaying a long sequence of images in a short amount of time

Information

  • Patent Application
  • 20070177208
  • Publication Number
    20070177208
  • Date Filed
    February 01, 2006
    18 years ago
  • Date Published
    August 02, 2007
    16 years ago
Abstract
A method and apparatus is disclosed herein for displaying a long sequence of images in a short amount of time. In one embodiment, the method comprises selecting page images for display from a plurality of page images corresponding to an image-based document, the plurality of page images including merged page images and each merged page image having salient content from multiple successive page images of the image-based document merged into one image; and serially displaying the selected page images on a display.
Description

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be understood more fully from the detailed description given below and from the accompanying drawings of various embodiments of the invention, which, however, should not be taken to limit the invention to the specific embodiments, but are for explanation and understanding only.



FIG. 1 is a flow diagram of one embodiment of a process for displaying images;



FIG. 2 illustrates the identification of salient content of a page;



FIG. 3 is a flow diagram of one embodiment of a process for performing segmentation to identify the salient content of a page;



FIG. 4 illustrates an example of a histogram;



FIG. 5 illustrates the merging process that combines the salient features of multiple pages into a single merged page;



FIG. 6 is a flow diagram of one embodiment of a process for combining the salient features of multiple pages into a single merged image;



FIG. 7 is a flow diagram of one embodiment of a speed control process;



FIG. 8 is a flow diagram for the control process for the page refresh timer that refreshes the pages shown on the screen;



FIG. 9 is a flow diagram of one embodiment of the process for jumping back;



FIG. 10 is one embodiment of a system to perform the segmentation and merging system processes;



FIG. 11 illustrates the run-time application system portion for displaying the page images;



FIG. 12 is a flow diagram of another embodiment of a process for displaying images;



FIG. 13 is a flow diagram of yet another embodiment of a process for displaying images;



FIG. 14 is a flow diagram of still another embodiment of a process for displaying images;



FIG. 15 is a flow diagram of one embodiment of a process for extracting and scoring features;



FIG. 16 is a flow diagram of one embodiment of a process for computing a feature value;



FIG. 17 illustrates a document in which most pages have no pictures and a few have large pictures;



FIG. 18 is a flow diagram of one embodiment of a process for creating distribution tables for each feature;



FIGS. 19A and 19B are flow diagrams of one embodiment of a process for creating percentile rankings for each score for each feature;



FIG. 20 is a flow diagram of one embodiment of a process for calculating the “mode,” or most popular score, for each feature;



FIG. 21 is a flow diagram of one embodiment of a process for determining each page's importance;



FIG. 22 is a flow diagram of one embodiment of a normalization process; and



FIG. 23 is a block diagram of an exemplary computer system that may perform one or more of the operations.


Claims
  • 1. A method comprising: selecting page images for display from a plurality of page images corresponding to an image-based document, the plurality of page images including merged page images and each merged page image having salient content from multiple successive page images of the image-based document merged into one image; andserially displaying the selected page images on a display.
  • 2. The method defined in claim 1 wherein selecting the page images for display comprises selecting a subset of the plurality of pages images based on a control information indicative of a rate at which the selected page images are to be serially displayed.
  • 3. The method defined in claim 2 wherein serially displaying the selected page images enables the document to be scanned at a speed exceeding a refresh rate of the display.
  • 4. The method defined in claim 1 wherein the plurality of page images includes a first set of merged page images having salient content from a first number of page images of the image-based document merged into one image and a second set of merged page images having salient content from a second number of page images of the image-based document merged into one image, the first and second numbers being different, and further wherein selecting the page images for display comprises selecting the first set of merged page images if the rate at which the document is to be displayed is at a first rate and selecting the second set of merged page images if the rate at which the document is to be displayed is at a second rate.
  • 5. The method defined in claim 1 further comprising: identifying salient content on pages of the image-based document; andcreating the plurality of page images by merging identified salient content of multiple pages of the image based document into single images.
  • 6. The method defined in claim 5 wherein creating the plurality of pages comprises: creating a first set of merged pages having salient content from a first number of page images of the image-based document merged into one image;creating a second set of merged pages having salient content from a second number of page images of the image-based document merged into one image, the second number being a multiple of the first number;creating a third set of merged pages having salient content from a third number of page images of the image-based document merged into one image, the third number being a multiple of the second number; andwherein selecting the page images comprises selecting the first, second or third sets based on a speed control input.
  • 7. The method defined in claim 5 wherein identifying the salient content comprises: computing a histogram of each page of the image-based document; andfinding features based on information from the histogram.
  • 8. The method defined in claim 7 wherein finding the features comprises one or more of: finding lineheights and separations;finding headers;finding footers;finding columnation;finding blank areas;finding tables;finding graphical images; andfinding text areas.
  • 9. The method defined in claim 7 wherein finding the features comprises analyzing text to identify one or more of a group consisting of headings, boldness, justification, centering, line height, line separation and indentation.
  • 10. The method defined in claim 7 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises: adding overlapping salient content from two or more pages to a single page image in decreasing size order.
  • 11. The method defined in claim 7 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises: adding overlapping salient content from two or more pages to a single page image in an order with increasing transparency as each one of the overlapping salient content is added.
  • 12. The method defined in claim 7 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises adding text to a single page image resulting from merging two or more pages, the added text being a version of original text from one of the two or more pages that has been modified to display differently than the original text.
  • 13. The method defined in claim 1 wherein page images are displayed, as a function of an input control, according to a merge level indicative of a number of pages of the image-based document per merged image and a rate indicative of the number of merged page images per second based on the merge level.
  • 14. The method defined in claim 13 wherein the page images are displayed in order forward or backward based on a direction indication.
  • 15. The method defined in claim 13 wherein the merge level and the rate are set as a function of the input control and the size of the image-based document.
  • 16. The method defined in claim 1 wherein serially displaying the selected page images on the display comprises displaying the selected page images in an order either forward or backward, and further comprising jumping back to one or more selected page images based on the input control.
  • 17. The method defined in claim 16 wherein jumping back to one or more selected page images comprises jumping back to a page image based on an interestingness measure associated with the page image.
  • 18. An article of manufacture having one or more recordable media storing instructions thereon which, when executed by a system, causes the system to perform a method comprising: selecting page images for display from a plurality of page images corresponding to an image-based document, the plurality of page images including merged page images and each merged page image having salient content from multiple successive page images of the image-based document merged into one image; andserially displaying the selected page images on a display.
  • 19. The article of manufacture defined in claim 18 wherein selecting the page images for display comprises selecting a subset of the plurality of pages images based on a control information indicative of a rate at which the selected page images are to be serially displayed.
  • 20. The article of manufacture defined in claim 19 wherein serially displaying the selected page images enables the document to be scanned at a speed exceeding a refresh rate of the display.
  • 21. The article of manufacture defined in claim 18 wherein the plurality of page images includes a first set of merged page images having salient content from a first number of page images of the image-based document merged into one image and a second set of merged page images having salient content from a second number of page images of the image-based document merged into one image, the first and second numbers being different, and further wherein selecting the page images for display comprises selecting the first set of merged page images if the rate at which the document is to be displayed is at a first rate and selecting the second set of merged page images if the rate at which the document is to be displayed is at a second rate.
  • 22. The article of manufacture defined in claim 18 wherein the method further comprises: identifying salient content on pages of the image-based document; andcreating the plurality of page images by merging identified salient content of multiple pages of the image based document into single images.
  • 23. The article of manufacture defined in claim 22 wherein creating the plurality of pages comprises: creating a first set of merged pages having salient content from a first number of page images of the image-based document merged into one image;creating a second set of merged pages having salient content from a second number of page images of the image-based document merged into one image, the second number being a multiple of the first number;creating a third set of merged pages having salient content from a third number of page images of the image-based document merged into one image, the third number being a multiple of the second number; andwherein selecting the page images comprises selecting the first, second or third sets based on a speed control input.
  • 24. The article of manufacture defined in claim 22 wherein identifying the salient content comprises: computing a histogram of each page of the image-based document; andfinding features based on information from the histogram.
  • 25. The article of manufacture defined in claim 24 wherein finding the features comprises one or more of: finding lineheights and separations;finding headers;finding footers;finding columnate;finding blank areas;finding tables;finding graphical images; andfinding text areas.
  • 26. The article of manufacture defined in claim 24 wherein finding the features comprises analyzing text to identify one or more of a group consisting of headings, boldness, indentation, justification, centering, line heights and line separations.
  • 27. The article of manufacture defined in claim 24 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises: adding overlapping salient content from two or more pages to a single page image in decreasing size order.
  • 28. The article of manufacture defined in claim 24 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises: adding overlapping salient content from two or more pages to a single page image in an order with increasing transparency as each one of the overlapping salient content is added.
  • 29. The article of manufacture defined in claim 24 wherein merging identified salient content of multiple pages of the image-based document into single pages comprises adding text to a single page image resulting from merging two or more pages, the added text being a version of original text from one of the two or more pages that has been modified to display differently than the original text.
  • 30. The article of manufacture defined in claim 18 wherein page images are displayed, as a function of an input control, according to a merge level indicative of a number of pages of the image-based document per merged image and a rate indicative of the number of merged page images per second based on the merge level.
  • 31. The article of manufacture defined in claim 30 wherein the page images are displayed in order forward or backward based on a direction indication.
  • 32. The article of manufacture defined in claim 30 wherein the merge level and the rate are set as a function of the input control and the size of the image-based document.
  • 33. The article of manufacture defined in claim 18 wherein serially displaying the selected page images on the display comprises displaying the selected page images in an order either forward or backward, and wherein the method further comprises jumping back to one or more selected page images based on the input control.
  • 34. The article of manufacture defined in claim 33 wherein jumping back to one or more selected page images comprises jumping back to a page image based on an interestingness measure associated with the page image.