Compensating for cognitive load in jumping back

Information

  • Patent Application
  • 20070180378
  • Publication Number
    20070180378
  • Date Filed
    February 01, 2006
    19 years ago
  • Date Published
    August 02, 2007
    17 years ago
Abstract
A method and apparatus is disclosed herein for compensating for cognitive load in jumping back. In one embodiment, the method comprises serially displaying a sequence of page images; receiving a user input to stop sequencing through the page images; determining a location of a page image in the sequence of page images representing a point at which the user intended to stop in the sequence of page images but for display speed of the sequence of images and user reaction time in providing an indication of the point at which the user intended to stop, the location being selected based on the image display rate and the reaction time associated with the user; and automatically jumping back to the page image at the location in the sequence of page images.
Description

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be understood more fully from the detailed description given below and from the accompanying drawings of various embodiments of the invention, which, however, should not be taken to limit the invention to the specific embodiments, but are for explanation and understanding only.



FIG. 1 is a flow diagram of one embodiment of a process for displaying images;



FIG. 2 illustrates the identification of salient content of a page;



FIG. 3 is a flow diagram of one embodiment of a process for performing segmentation to identify the salient content of a page;



FIG. 4 illustrates an example of a histogram;



FIG. 5 illustrates the merging process that combines the salient features of multiple pages into a single merged page;



FIG. 6 is a flow diagram of one embodiment of a process for combining the salient features of multiple pages into a single merged image;



FIG. 7 is a flow diagram of one embodiment of a speed control process;



FIG. 8 is a flow diagram for the control process for the page refresh timer that refreshes the pages shown on the screen;



FIG. 9 is a flow diagram of one embodiment of the process for jumping back;



FIG. 10 is one embodiment of a system to perform the segmentation and merging system processes;



FIG. 11 illustrates the run-time application system portion for displaying the page images;



FIG. 12 is a flow diagram of another embodiment of a process for displaying images;



FIG. 13 is a flow diagram of yet another embodiment of a process for displaying images;



FIG. 14 is a flow diagram of still another embodiment of a process for displaying images;



FIG. 15 is a flow diagram of one embodiment of a process for extracting and scoring features;



FIG. 16 is a flow diagram of one embodiment of a process for computing a feature value;



FIG. 17 illustrates a document in which most pages have no pictures and a few have large pictures;



FIG. 18 is a flow diagram of one embodiment of a process for creating distribution tables for each feature;



FIGS. 19A and 19B are flow diagrams of one embodiment of a process for creating percentile rankings for each score for each feature;



FIG. 20 is a flow diagram of one embodiment of a process for calculating the “mode,” or most popular score, for each feature;



FIG. 21 is a flow diagram of one embodiment of a process for determining each page's importance;



FIG. 22 is a flow diagram of one embodiment of a normalization process; and



FIG. 23 is a block diagram of an exemplary computer system that may perform one or more of the operations.


Claims
  • 1. A method comprising: serially displaying a sequence of page images;receiving a user input to stop sequencing through the page images;determining a location of a page image in the sequence of page images representing a point at which the user intended to stop in the sequence of page images but for display speed of the sequence of images and user reaction time in providing an indication of the point at which the user intended to stop, the location being selected based on the image display rate and the reaction time associated with the user; andautomatically jumping back to the page image at the location in the sequence of page images.
  • 2. The method defined in claim 1 further comprising selecting the reaction time associated with the user from a plurality of available reaction times based on the image display rate.
  • 3. The method defined in claim 2 wherein selecting the reaction time associated with the user from a plurality of available reaction times based on the image display rate comprises: selecting a first reaction time when the image display rate is at a first rate; andselecting a second reaction time when the image display rate is at a second rate, the first reaction time being greater than the second reaction time, wherein the first rate is greater than the second rate.
  • 4. The method defined in claim 2 wherein the plurality of reaction times is a set of reaction times for the user.
  • 5. The method defined in claim 4 wherein the plurality of reaction times is set as a result of a calibration process.
  • 6. The method defined in claim 1 wherein the location is selected based on an interestingness measure of a page at the location.
  • 7. The method defined in claim 1 wherein the page images are from a plurality of page images corresponding to an image-based document, the plurality of page images including merged page images and each merged page image having salient content from multiple page images of the image-based document merged into one image.
  • 8. The method defined in claim 1 wherein the plurality of page images includes a first set of merged page images having salient content from a first number of page images of the image-based document merged into one image and a second set of merged page images having. salient content from a second number of page images of the image-based document merged into one image, the first and second numbers being different, and further wherein selecting the page images for display comprises selecting the first set of merged page images if the rate at which the page images are to be display is a first rage and selecting the second set of merged page images if the rate at which the page images are to be display is at a the second rate.
  • 9. The method defined in claim 1 further comprising: identifying salient content on pages of the image-based document; andcreating the plurality of page images by merging identified salient content of multiple pages of the image based document into single pages.
  • 10. The method defined in claim 9 wherein creating the plurality of pages comprises: creating a first set of merged pages having salient content from a first number of page images of the image-based document merged into one image;creating a second set of merged pages having salient content from a second number of page images of the image-based document merged into one image, the second number being twice the first number;creating a third set of merged pages having salient content from a third number of page images of the image-based document merged into one image, the third number being twice the second number; andwherein selecting the page images comprises selecting the first, second or third sets based on a speed control input.
  • 11. The method defined in claim 9 wherein identifying the salient content comprises: computing a histogram of each page of the image-based document; andfinding features based on information from the histogram.
  • 12. The method defined in claim 1 wherein page images are displayed, as a function of an input control, according to a merge level indicative of a number of pages of the image-based document per merged image and a rate indicative of the number of merged page images per second based on the merge level.
  • 13. The method defined in claim 12 wherein the page images are displayed in order forward or backward based on a direction indication.
  • 14. An article of manufacture having one or more recordable media storing instructions thereon which, when executed by a system, causes the system to perform a method comprising: serially displaying a sequence of page images;receiving a user input to stop sequencing through the page images;determining a location of a page image in the sequence of page images representing a point at which the user intended to stop in the sequence of page images but for display speed of the sequence of images and user reaction time in providing an indication of the point at which the user intended to stop, the location being selected based on the image display rate and the reaction time associated with the user; and automatically jumping back to the page image at the location in the sequence of page images.
  • 15. The article of manufacture defined in claim 14 wherein the method further comprises selecting the reaction time associated with the user from a plurality of available reaction times based on the image display rate.
  • 16. The article of manufacture defined in claim 15 wherein selecting the reaction time associated with the user from a plurality of available reaction times based on the image display rate comprises: selecting a first reaction time when the image display rate is at a first rate; andselecting a second reaction time when the image display rate is at a second rate, the first reaction time being greater than the second reaction time, wherein the first rate is greater than the second rate.
  • 17. The article of manufacture defined in claim 15 wherein the plurality of reaction times is a set of reaction times for the user.
  • 18. The article of manufacture defined in claim 17 wherein the plurality of reaction times is set as a result of a calibration process.
  • 19. The article of manufacture defined in claim 14 wherein the location is selected based on an interestingness measure of a page at the location.
  • 20. The article of manufacture defined in claim 14 wherein the page images are from a plurality of page images corresponding to an image-based document, the plurality of page images including merged page images and each merged page image having salient content from multiple page images of the image-based document merged into one image.
  • 21. The article of manufacture defined in claim 14 wherein the plurality of page images includes a first set of merged page images having salient content from a first number of page images of the image-based document merged into one image and a second set of merged page images having salient content from a second number of page images of the image-based document merged into one image, the first and second numbers being different, and further wherein selecting the page images for display comprises selecting the first set of merged page images if the rate at which the page images are to be display is a first rage and selecting the second set of merged page images if the rate at which the page images are to be display is at a the second rate.
  • 22. The article of manufacture defined in claim 14 wherein the method further comprises: identifying salient content on pages of the image-based document; andcreating the plurality of page images by merging identified salient content of multiple pages of the image based document into single pages.
  • 23. The article of manufacture defined in claim 22 wherein creating the plurality of pages comprises: creating a first set of merged pages having salient content from a first number of page images of the image-based document merged into one image;creating a second set of merged pages having salient content from a second number of page images of the image-based document merged into one image, the second number being twice the first number;creating a third set of merged pages having salient content from a third number of page images of the image-based document merged into one image, the third number being twice the second number; andwherein selecting the page images comprises selecting the first, second or third sets based on a speed control input.
  • 24. The article of manufacture defined in claim 22 wherein identifying the salient content comprises: computing a histogram of each page of the image-based document; andfinding features based on information from the histogram.
  • 25. The article of manufacture defined in claim 14 wherein page images are displayed, as a function of an input control, according to a merge level indicative of a number of pages of the image-based document per merged image and a rate indicative of the number of merged page images per second based on the merge level.
  • 26. The article of manufacture defined in claim 25 wherein the page images are displayed in order forward or backward based on a direction indication.