Systems, methods, and computer program products providing an integrated user interface for reading content

Information

  • Patent Grant
  • 9361130
  • Patent Number
    9,361,130
  • Date Filed
    Monday, May 3, 2010
    14 years ago
  • Date Issued
    Tuesday, June 7, 2016
    8 years ago
Abstract
A method performed by a portable, processor-based device with a display screen is disclosed. The method includes rendering a Graphical User Interface (GUI) on the display screen. The GUI includes a first scrollable column with a plurality of graphical elements arranged sequentially within the first column, each graphical element of the plurality of graphical elements associated with at least one article of a plurality of articles. The GUI also includes a second scrollable column with a plurality of independent text portions, each of the text portions corresponding to a respective article. The method further includes coordinating the first and second scrollable columns so that when a first article is selected a first text portion associated with the first article is displayed on the display screen, and a first graphical element associated with the first article is displayed next to the first text portion.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is related to U.S. patent application Ser. No. 12/772,752, filed May 3,2010 and entitled, “SYSTEMS, METHODS, AND COMPUTER PROGRAM PRODUCTS PROVIDING AN ARTICLE SELECTION STRUCTURE,” which is incorporated by reference herein in its entirety.


TECHNICAL FIELD

The present disclosure relates, in general, to user interfaces and, more specifically, for user interfaces for reading content.


BACKGROUND

In the last decade people have changed the way they consume content. One big shift is the ubiquity of smart phones and other handheld devices that offer access to web-based content and media applications (“apps”). However, handheld devices tend to have limitations. In particular, people tend to use phones for short bursts of time. In one example, a user is waiting in a line and pulls out his or her phone to use for ninety seconds or so. The user may read an article or search for a particular small piece of information. In general, handheld content consumption tends to be quite targeted. It is generally assumed that, because the screen is kept small, handheld devices are annoying to use. Users typically do not want to use handheld devices or for significant content consumption. Of course, the above-described phenomenon is a generality, and some users employ handheld devices for more than that, but the above-described use is the preferred use modality.


Recently, tablet or slate computers have become increasingly popular. Tablet computers usually have a touchscreen about the size of a typical laptop computer's screen or larger while omitting an integrated, physical keyboard. The tablet computer provides a virtual keyboard upon the touchscreen when needed. In general, tablet computers have a slightly different use modality than do handheld devices or laptops because of their larger screens. It would be helpful to have user interfaces for consuming content that are especially convenient for use with tablet computers.


BRIEF SUMMARY

Various embodiments of the invention include systems, methods, and computer program products to provide a Graphical User Interface (GUI) that has independently-scrollable and coordinated columns, where one column has text and another column has graphical elements (e.g., still pictures, video, ads, interactive “widgets”, 3D models, and/or the like.—implemented with HTML, flash or other plugins).


Various embodiments of the invention separate graphical elements from text and treat them differently. In one example, the text of an article is presented on one side, and the graphical elements are presented on the other side. The graphical elements from multiple articles are presented in one continuous column, and the text from the multiple articles is presented in another continuous column. The graphical elements give the user a sense of what the various articles are about by showing the content of the graphical elements. The graphical elements can also be used as a navigation mechanism for letting the user select particular articles to read. In one example, selecting any one of the graphical elements will load the article by scrolling the text column to align the text associated with the selected graphical element. Similarly, the text column can be scrolled and a text portion selected to load an article. When a text portion is selected, the graphical element column is automatically scrolled to align the graphical elements of the selected article with the text.


The foregoing has outlined rather broadly the features and technical advantages of the present invention in order that the detailed description of the invention that follows may be better understood. Additional features and advantages of the invention will be described hereinafter which form the subject of the claims of the invention. It should be appreciated by those skilled in the art that the conception and specific embodiment disclosed may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the present invention. It should also be realized by those skilled in the art that such equivalent constructions do not depart from the spirit and scope of the invention as set forth in the appended claims. The novel features which are believed to be characteristic of the invention, both as to its organization and method of operation, together with further objects and advantages will be better understood from the following description when considered in connection with the accompanying figures. It is to be expressly understood, however, that each of the figures is provided for the purpose of illustration and description only and is not intended as a definition of the limits of the present invention.





BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present invention, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:



FIG. 1 is an illustration of an exemplary Graphical User Interface (GUI) adapted according to one embodiment of the invention;



FIG. 2 shows the exemplary GUI of FIG. 1 with visual effects adapted according to one embodiment;



FIG. 3 shows the GUI of FIG. 1 with two columns operating according to one exemplary embodiment of the invention;



FIG. 4 is an illustration of an exemplary GUI adapted according to one embodiment of the invention;



FIG. 5 is an illustration of an exemplary method adapted according to one embodiment of the invention;



FIG. 6 is an illustration of an exemplary system adapted according to one embodiment of the invention; and



FIG. 7 illustrates an example computer system adapted according to one embodiment of the present invention.





DETAILED DESCRIPTION


FIG. 1 is an illustration of exemplary Graphical User Interface (GUI) 100 adapted according to one embodiment of the invention. In one example, GUI 100 is presented upon a display screen of processor-based device 150. Appropriate processor-based devices include but are not limited to laptop computers, desktop computers, tablet computers (e.g., the iPad™, available from Apple), and portable devices. Some embodiments are especially adapted for use with touchscreen devices, though the scope of embodiments is not so limited, as devices that use computer pointing devices (e.g., a mouse or touchpad) may be adapted for use in some designs as well. In some embodiments, GUI 100 is part of app that is downloaded and run on a processor-based device, while other embodiments may implement GUI 100 as a plug-in for a browser, an interface for a website, and/or the like.


GUI 100 includes a first column 110 and a second column 120, both of which are scrollable. For instance, a user on a touchscreen device may use a finger swipe to move a column up or down within GUI 100, or a user with a mouse may grab and drag a column up or down.


GUI 100 divides the text and graphical elements from articles into two columns. In this particular view, headline 101 and text reading area 103 are part of an article that also includes graphical element 123. Similarly, headline 105 and text reading area 107 are part of an article that also includes graphical element 127. The advertising portion 125 is optional and may or may not be related to either one of the articles. Furthermore, property branding portion 121 is also optional and may or may not be germane to either of the articles. The arrangement of FIG. 1 is exemplary and non-limiting. Other embodiments may include two or more graphical elements for any given article (rather than just one), and property branding portions and advertising portions may be more or less numerous or arranged in different ways than that shown in FIG. 1.


Furthermore, column 110 includes the text from at least two articles, and it is understood that in some embodiments column 110 can scroll up or down to access any number of articles. Column 120 includes graphical elements from at least two articles, and in some embodiments may include graphical elements from any number of articles. FIG. 1 shows two articles for ease of illustration, though GUI 100 can be designed to include as many articles as a user desires.


A human user is presented articles through GUI 100 in a novel manner. The user sees the articles by text, perhaps the article text itself and/or a title/abstract structure. The user also sees the articles by the graphical elements associated therewith. The user can select an article either by selecting an entry in column 110 or in column 120. In one example, the user desires to choose content by graphical elements, so the user scrolls through column 120 until he or she sees a graphical element that looks interesting. The user then selects the graphical element by, for example, tapping the graphical element, using a mouse click, or positioning the graphical element at the top or center of the screen and waiting a specified amount of time, though the particular scope of embodiments is not limited to any technique for selecting a graphical element. When the user selects a graphical element, GUI 100 brings up the text associated with that graphical element.


In another example, the user desires to choose an article based on the text portions in column 110. The user scrolls through column 110 and selects an entry. GUI 100 automatically scrolls an associated graphical element to the top to bring up the article.


Additionally or alternatively, a user can browse through either one of columns 110 and 120 as the other column automatically adjusts to align with the column that is scrolled by the user. For instance, as a user swipes to browse column 120, and GUI 100 automatically aligns column 110 so that the appropriate text portions are aligned with the graphical elements as the graphical elements move. In any event, the GUI 100 provides an automated technique to align content as a user's attention moves from one article to another.


Though GUI 100 is centered around scrolling functions, various embodiments do not preclude the use of other navigation techniques. For instance, the embodiment of FIG. 1 includes buttons 115-118 for navigating. Button 115 provides for the selected article to be opened in an embedded web browser; button 116 allows an article to be shared by email, Multi Media Messaging Service (MMS), or other way; button 117 allows one column 110, 120 or the other to be expanded to the full screen. Button 118 allows the columns 110, 120 to be swapped in place to accommodate right- and left-handed users equitably. In an additional example, though not shown, a button can be provided for going to the next article. Buttons 115-118 are exemplary, as other types of interfaces and functions can be adapted for use by various embodiments.


Various visual effects may be included in some embodiments to add a more user-friendly and intuitive feel to GUI 100. An example of a visual effect is emphasizing pictures and texts from selected articles while de-emphasizing pictures and text from unselected articles. FIG. 2 shows exemplary GUI 100 with visual effects adapted according to one embodiment. In FIG. 2, text portion 202 is associated with a selected article, as are graphical elements 206 and 207. By contrast, text portion 204 and graphical element 208 are displayed upon GUI 100 but are not selected.


Text portion 202 and graphical elements 206, 207 are rendered with full fidelity, whereas text portion 204 and graphical element 208 are rendered with reduced fidelity. For example, text portion 204 and graphical element 208 might be rendered partially transparent or partially faded to white or some other color for de-emphasis, and other renderings are possible to represent activity or inactivity. Additionally or alternatively, visual effects may also be added to text portion 202 and graphical elements 206, 207, e.g., a frame or visual decoration around the border of text portion 202 and graphical elements 206, 207. The visual effects can be adjusted as other articles are selected and/or columns 110, 120 are scrolled.


Various embodiments also automatically align the content of an article as a user scrolls within the article. FIG. 3 shows GUI 100 with columns 110, 120 operating according to one exemplary embodiment of the invention. In this example, the text portion 300 is longer than the screen upon which GUI 100 is rendered; therefore, scrolling is necessary to view all of the text portion. Similarly, the article has five pictures 302-310 that span an area longer than the screen, so scrolling is also necessary in order to see all of the pictures 302-310. In this example, as the user scrolls column 110, the graphical elements 302-310 in column 320 are scrolled at a rate proportional to that of the text and appropriate for the number of graphical elements. Thus, as the bottom of the text portion 300 is reached, the last picture 310 is reached as well. Additionally or alternatively, one or more of the graphical elements 302-310 are cued to sections within text portion 300 so that as those sections are scrolled within view, the appropriate graphical elements are aligned as well. Furthermore, should the user scroll through column 120, text box 110 is also scrolled proportionately and/or by cues to synchronize text and graphical element.


In one example, a user manually scrolls while reading an article. In the example of a touchscreen tablet computer, the user drags his or her thumb up the text portion 300 while reading. If there is just one graphical element associated with the article, then in one example, the graphical element stays stationary until the user gets to the end of the article, at which point the graphical element switches over to another graphical element. In another example, when more than fifty percent of the scrolling area is the next article, then the graphical element alpha fades as the next graphical element associated with the article shows up. The same techniques can be used for text portions as a user scrolls the graphical elements. Any manner of transitioning between articles can be used by various embodiments.



FIG. 400 is an illustration of exemplary GUI 400 adapted according to one embodiment of the invention. GUI 400 operates in a similar manner to GUI 100 of FIG. 1. For instance, GUI 400 includes column 410 for text portions of articles and column 420 for graphical elements of articles. As in FIG. 1, columns 410, 420 can be independently scrolled and are coordinated so as to automatically align the content of a particular article.


GUI 400 also includes column 430, integrated in GUI 400 with columns 410, 420. The items in column 430 correspond to available articles. A user can select one, some, all, or none of the available articles to be viewed. Upon selection, an article is divided into text and graphics and distributed in columns 410, 420. Column 430 includes indicators showing which of the articles have been selected and are available for viewing in columns 410, 420. Specifically, column 430 includes circles that when filled in, colored, or otherwise visually marked, indicate that a corresponding article has been selected. In FIG. 4, circles 401-404 are visually marked to indicate having been selected. The operation of a feature, such as that shown in column 430, is described in more detail in U.S. patent application Ser. No. 12/772,752, filed concurrently herewith and entitled, “SYSTEMS, METHODS, AND COMPUTER PROGRAM PRODUCTS PROVIDING AN ARTICLE SELECTION STRUCTURE,” which is incorporated by reference herein in its entirety.



FIG. 5 is an illustration of exemplary method 500 adapted according to one embodiment of the invention. Method 500 may be performed, for example, by a processor-based device executing a program that instantiates the functional modules shown in FIG. 6.


In block 501, a GUI is rendered on a display screen. The GUI has a first scrollable column with multiple graphical elements arranged sequentially within the first column, each graphical element of the plurality of graphical elements associated with at least one article of a plurality of content articles. The GUI also has a second scrollable column with a plurality of independent text portions, each of the text portions corresponding to a respective article.


In block 502, the first and second scrollable columns are coordinated so that when a first article is selected a first text portion associated with the first article is displayed on the display screen, and a first graphical element associated with the first article is displayed next to the first text portion. In one example, the graphical elements are scrolled though, and the text column is scrolled as well to align with the graphical elements. In another example, the text portions are scrolled through, and the graphical elements are scrolled as well to align with the text. Thus, when a user selects an article for attention, the text and graphical element of that article are synchronized so that the user sees both in an intuitive manner.


In block 503, a third column is rendered in the GUI, the third column including a list of the content articles. The third column also has multiple selectable features allowing user input to select one or more of the content articles. When an article is selected, it is placed in the first and second scrollable columns. An example of the third column is column 430 of FIG. 4.


In block 504, the selected content articles are loaded for offline use. For example, the selected articles can be placed in memory and retrieved for access later, whether the computer is online or offline.


Various embodiments are not limited to the exact method shown in FIG. 5. Various embodiments may add, omit, rearrange, or modify actions. For instance, many embodiments will render the three columns perceptibly simultaneously, so that actions of block 503 are performed with actions of block 501. Furthermore, it is understood that the items in the first scrollable column may include any type of graphical element, so that one or more videos or other presentations may be placed in the first scrollable column to accompany text content in the first column. Additionally, the term “article” is used herein in the examples above to refer to magazine or newspaper articles, though the term is not limited thereto. Articles may include other divisions of content, such as book chapters and/or the like.



FIG. 6 is an illustration of an exemplary system 600 adapted according to one embodiment of the invention. System 600 includes functional modules 601 and 602. The divisions of the functional modules is conceptual and exemplary, as the functions may be performed by a single functional unit or divided between two or more functional units different than those shown in FIG. 6.


Some embodiments include one or more advantages over other techniques. For instance, various embodiments provide a GUI that leverages the capabilities and expected use modalities of tablet computers. The expectation for the tablet or slate category of computers is that they are more likely to be used in a casual, comfortable kind of scenario. In one example, a user is sitting on a couch, lying on a bed, or sitting at a kitchen countertop, perhaps watching television or eating. Instead of reading the back of the cereal box, the user is using the tablet.


It is expected that tablet computers are going to be used in a casual discovery mode where the user has ten minutes or half an hour and wants to browse content for something interesting to pass the time. Various embodiments provide a new and intuitive way for users to consume content, especially on tablet computers. Furthermore, various embodiments are especially useful for newspapers, magazine, blogs, e-books and other syndicated content that provides both text and graphics.


Additionally, various embodiments have desirable ergonomic qualities when used with tablet computers. Tablet computers tend to be heavier than handheld devices (e.g., phones), and are often grasped by a user with one hand while the other hand is used to make gestures on the screen. In some embodiments, a single hand can be used to select among articles by scrolling through one or both columns of text and graphical elements.


In another single-handed use, a user can recline on a couch having one hand on, e.g., a cup of coffee, and with the other hand, the user can both hold the device and thumb-navigate. Also, when placed in the lap, the user may desire to navigate using both thumbs. In some embodiments, a user can access most or all of the GUI with his or her hands at the bottom right and bottom left hand corner of the screen by dragging the columns up and down.


When implemented via computer-executable instructions, various elements of embodiments of the present invention are in essence the software code defining the operations of such various elements. The executable instructions or software code may be obtained from a tangible readable medium (e.g., a hard drive media, optical media, RAM, EPROM, EEPROM, tape media, cartridge media, flash memory, ROM, memory stick, and/or the like). In fact, readable media can include any medium that can store information.



FIG. 7 illustrates an example computer system 700 adapted according to one embodiment of the present invention. That is, computer system 700 comprises an example system on which embodiments of the present invention may be implemented (such as processor-based device 150 of FIG. 1). Central processing unit (CPU) 701 is coupled to system bus 702. CPU 701 may be any general purpose or specialized purpose CPU. However, the present invention is not restricted by the architecture of CPU 701 as long as CPU 701 supports the inventive operations as described herein. CPU 701 may execute the various logical instructions according to embodiments of the present invention. For example, one or more CPUs, such as CPU 701, may execute machine-level instructions according to the exemplary operational flows described above in conjunction with FIG. 5.


Computer system 700 also preferably includes random access memory (RAM) 703, which may be SRAM, DRAM, SDRAM, or the like. In this example, computer system 700 uses RAM 703 to buffer 302 of FIG. 3. Computer system 700 preferably includes read-only memory (ROM) 704 which may be PROM, EPROM, EEPROM, or the like. RAM 703 and ROM 704 hold user and system data and programs, as is well known in the art.


Computer system 700 also preferably includes input/output (I/O) adapter 705, communications adapter 711, user interface adapter 708, and display adapter 709. I/O adapter 705, user interface adapter 708, and/or communications adapter 711 may, in certain embodiments, enable a user to interact with computer system 700 in order to input information, such as hand gestures (via a touchscreen or a pointing device) that indicate that one or more columns should be scrolled.


I/O adapter 705 preferably connects to storage device(s) 706, such as one or more of hard drive, compact disc (CD) drive, floppy disk drive, tape drive, etc. to computer system 700. The storage devices may be utilized when RAM 703 is insufficient for the memory requirements associated with storing media data. Communications adapter 711 is preferably adapted to couple computer system 700 to network 712 (e.g., the Internet, a LAN, a cellular network, etc.). User interface adapter 708 couples user input devices, such as keyboard 713, pointing device 707, and microphone 714 and/or output devices, such as speaker(s) 715 to computer system 700. Display adapter 709 is driven by CPU 701 to control the display on display device 710 to, for example, display the articles.


While the above examples are provided in the context of tablet computers with touchscreens, the scope of embodiment is not so limited. For instance, some embodiments may be adapted for use with handheld devices, laptop computers, desktop computers, workstations, and/or other process-based devices with a GUI. Additionally, some embodiments can be used with devices that do not have a touchscreen but, instead, rely on another manner of screen navigation, such as pointing, hotkeys, and the like. Moreover, embodiments of the present invention are not limited to general purpose computers and may be implemented on other types of processors, such as application specific integrated circuits (ASICs) or very large scale integrated (VLSI) circuits. In fact, persons of ordinary skill in the art may utilize any number of suitable structures capable of executing logical operations according to the embodiments of the present invention.


Although the present invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims. Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. As one of ordinary skill in the art will readily appreciate from the disclosure of the present invention, processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized according to the present invention. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.

Claims
  • 1. A method, comprising: at a portable computing device with a touch screen display: displaying a plurality of articles in a first scrollable column and a second scrollable column on the touch screen display, wherein: the first scrollable column and the second scrollable column are independently scrollable;a respective article in the plurality of articles includes text for the respective article, and one or more graphical elements contained within the respective article that are a distinct subset of the respective article from the text of the respective article;the text for the respective article is displayed in the first scrollable column on the touch screen display;the one or more graphical elements contained within the respective article are displayed in the second scrollable column on the touch screen display;the first scrollable column and the second scrollable column are separate from each other, and are displayed concurrently with each other;detecting selection of a first article in the plurality of articles;in response to detecting selection of the first article in the plurality of articles, concurrently displaying text for the selected first article in the first scrollable column and a first graphical element contained within the selected first article in the second scrollable column, next to the text for the selected first article in the first scrollable column; and,in response to a first input that scrolls the selected first article in either of the first scrollable column or the second scrollable column, automatically concurrently scrolling the other scrollable column, of the first scrollable column and the second scrollable column, at a rate such that an end of the text in the selected first article in the first scrollable column is reached as a last graphical element in the selected first article in the second scrollable column is reached.
  • 2. The method of claim 1, wherein the one or more graphical elements contained within the respective article include still pictures, video, ads, interactive widgets, and/or 3D models.
  • 3. The method of claim 1, wherein the selected first article is concurrently displayed with one or more unselected articles in the plurality of articles and the selected first article is visually emphasized relative to the one or more unselected articles.
  • 4. The method of claim 1, including: detecting a second input; and,in response to detecting the second input: scrolling the first scrollable column to display text for a second article in the plurality of articles, distinct from the text in the selected first article; andscrolling the second scrollable column to display a second graphical element contained within the second article, distinct from the first graphical element contained within the selected first article, next to the text for the second article in the first scrollable column.
  • 5. The method of claim 4, wherein the second input is a finger swipe on the touch screen display on the first scrollable column or the second is a finger swipe on the touch screen display on the second scrollable column.
  • 6. The method of claim 4, wherein the second is activation of a button for going to a next article in the plurality of articles.
  • 7. The method of claim 1, wherein graphical elements contained within the selected first article are cued to sections within the text for the selected first article, the method including: detecting a second input; and,in response to detecting the second input: scrolling, in the first scrollable column, the text for the selected first article from a first section of text to a second section of text in the selected first article; andscrolling, in the second scrollable column, graphical elements contained within the selected first article from a first graphical element cued to the first section of text to a second graphical element cued to the second section of text.
  • 8. A portable computing device, comprising: a touch screen display;one or more processors;memory; andone or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a plurality of articles in a first scrollable column and a second scrollable column on the touch screen display, wherein: the first scrollable column and the second scrollable column are independently scrollable;a respective article in the plurality of articles includes text for the respective article, andone or more graphical elements contained within the respective article that are a distinct subset of the respective article from the text of the respective article;the text for the respective article is displayed in the first scrollable column on the touch screen display;the one or more graphical elements contained within the respective article are displayed in the second scrollable column on the touch screen display;the first scrollable column and the second scrollable column are separate from each other, and are displayed concurrently with each other;detecting selection of a first article in the plurality of articles;in response to detecting selection of the first article in the plurality of articles, concurrently displaying text for the selected first article in the first scrollable column and a first graphical element contained within the selected first article in the second scrollable column, next to the text for the selected first article in the first scrollable column; and,in response to a first input that scrolls the selected first article in either of the first scrollable column or the second scrollable column, automatically concurrently scrolling the other scrollable column, of the first scrollable column and the second scrollable column, at a rate such that an end of the text in the selected first article in the first scrollable column is reached as a last graphical element in the selected first article in the second scrollable column is reached.
  • 9. The device of claim 8, wherein the one or more graphical elements contained within the respective article include still pictures, video, ads, interactive widgets, and/or 3D models.
  • 10. The device of claim 8, wherein the selected first article is concurrently displayed with one or more unselected articles in the plurality of articles and the selected first article is visually emphasized relative to the one or more unselected articles.
  • 11. The device of claim 8, including instructions for: detecting a second input; and,in response to detecting the second input: scrolling the first scrollable column to display text for a second article in the plurality of articles, distinct from the text in the selected first article; andscrolling the second scrollable column to display a second graphical element contained within the second article, distinct from the first graphical element contained within the selected first article, next to the text for the second article in the first scrollable column.
  • 12. The device of claim 8, wherein the second input is a finger swipe on the touch screen display on the first scrollable column or the second input is a finger swipe on the touch screen display on the second scrollable column.
  • 13. The device of claim 8, wherein the second input is activation of a button for going to a next article in the plurality of articles.
  • 14. The device of claim 8, wherein graphical elements contained within the selected first article are cued to sections within the text for the selected first article, the device including instructions for: detecting a second input; and,in response to detecting the second input: scrolling, in the first scrollable column, the text for the selected first article from a first section of text to a second section of text in the selected first article; andscrolling, in the second scrollable column, graphical elements contained within the selected first article from a first graphical element cued to the first section of text to a second graphical element cued to the second section of text.
  • 15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable computing device with a touch screen display, cause the device to: display a plurality of articles in a first scrollable column and a second scrollable column on the touch screen display, wherein: the first scrollable column and the second scrollable column are independently scrollable;a respective article in the plurality of articles includes text for the respective article, andone or more graphical elements contained within the respective article that are a distinct subset of the respective article from the text of the respective article;the text for the respective article is displayed in the first scrollable column on the touch screen display;the one or more graphical elements contained within the respective article are displayed in the second scrollable column on the touch screen display;the first scrollable column and the second scrollable column are separate from each other, and are displayed concurrently with each other;detecting selection of a first article in the plurality of articles;in response to detecting selection of the first article in the plurality of articles, concurrently displaying text for the selected first article in the first scrollable column and a first graphical element contained within the selected first article in the second scrollable column, next to the text for the selected first article in the first scrollable column; and,in response to a first input that scrolls the selected first article in either of the first scrollable column or the second scrollable column, automatically concurrently scrolling the other scrollable column, of the first scrollable column and the second scrollable column, at a rate such that an end of the text in the selected first article in the first scrollable column is reached as a last graphical element in the selected first article in the second scrollable column is reached.
  • 16. The computer readable storage medium of claim 15, wherein the one or more graphical elements contained within the respective article include still pictures, video, ads, interactive widgets, and/or 3D models.
  • 17. The computer readable storage medium of claim 15, wherein the selected first article is concurrently displayed with one or more unselected articles in the plurality of articles and the selected first article is visually emphasized relative to the one or more unselected articles.
  • 18. The computer readable storage medium of claim 15, including instructions, which when executed by the portable computing device with the touch screen display, cause the device to: detect a second input; and,in response to detecting the second input: scroll the first scrollable column to display text for a second article in the plurality of articles, distinct from the text in the selected first article; andscroll the second scrollable column to display a second graphical element contained within the second article, distinct from the first graphical element contained within the selected first article, next to the text for the second article in the first scrollable column.
  • 19. The computer readable storage medium of claim 15, wherein the second input is a finger swipe on the touch screen display on the first scrollable column or the second input is a finger swipe on the touch screen display on the second scrollable column.
  • 20. The computer readable storage medium of claim 15, wherein the second input is activation of a button for going to a next article in the plurality of articles.
  • 21. The computer readable storage medium of claim 15, wherein graphical elements contained within the selected first article are cued to sections within the text for the selected first article, the computer readable storage medium including instructions, which when executed by the portable computing device with the touch screen display, cause the device to: detect a second input; and,in response to detecting the second input: scroll, in the first scrollable column, the text for the selected first article from a first section of text to a second section of text in the selected first article; andscroll, in the second scrollable column, graphical elements contained within the selected first article from a first graphical element cued to the first section of text to a second graphical element cued to the second section of text.
US Referenced Citations (128)
Number Name Date Kind
4899292 Montagna et al. Feb 1990 A
5414809 Hogan et al. May 1995 A
5487167 Dinallo et al. Jan 1996 A
5623589 Needham Apr 1997 A
5659742 Beattie et al. Aug 1997 A
5712995 Cohn Jan 1998 A
5742816 Barr et al. Apr 1998 A
5748931 Jones May 1998 A
5929848 Albukerk et al. Jul 1999 A
5930809 Middlebrook Jul 1999 A
5960448 Reichek et al. Sep 1999 A
5991751 Rivette et al. Nov 1999 A
5995978 Cullen et al. Nov 1999 A
6014643 Minton Jan 2000 A
6018749 Rivette et al. Jan 2000 A
6026409 Blumenthal Feb 2000 A
6029146 Hawkins et al. Feb 2000 A
6058379 Odom et al. May 2000 A
6061695 Slivka et al. May 2000 A
6141007 Lebling Oct 2000 A
6369811 Graham et al. Apr 2002 B1
6415307 Jones et al. Jul 2002 B2
6421694 Nawaz et al. Jul 2002 B1
6442574 Schumacher et al. Aug 2002 B1
6466237 Miyao et al. Oct 2002 B1
6581070 Gibbon Jun 2003 B1
6625583 Silverman et al. Sep 2003 B1
6667810 Jeyachandran et al. Dec 2003 B1
6727930 Currans et al. Apr 2004 B2
6738084 Kelley et al. May 2004 B1
6748385 Rodkin et al. Jun 2004 B1
6920613 Dorsey et al. Jul 2005 B2
7076457 Yamamoto et al. Jul 2006 B2
7092939 Koll Aug 2006 B2
7117523 Kasahara et al. Oct 2006 B2
7228492 Graham Jun 2007 B1
7331517 Inakoshi et al. Feb 2008 B2
7346668 Willis Mar 2008 B2
7356760 Jaeger Apr 2008 B2
7370283 Othmer May 2008 B2
7430724 Othmer Sep 2008 B2
7493499 Deaver et al. Feb 2009 B1
7580702 Othmer Aug 2009 B2
7606444 Erol et al. Oct 2009 B1
7756871 Yacoub et al. Jul 2010 B2
7770099 Young Aug 2010 B2
7787818 Shapiro et al. Aug 2010 B2
7912829 Mathes et al. Mar 2011 B1
7933338 Choudhry Apr 2011 B1
7933632 Flynt et al. Apr 2011 B2
8042063 Lin-Hendel Oct 2011 B1
8131626 Langridge Mar 2012 B2
8176515 Ahmad et al. May 2012 B2
8301586 Lattyak et al. Oct 2012 B1
8402374 Rose Mar 2013 B1
8560485 Labrou et al. Oct 2013 B2
8739019 Nevins May 2014 B1
20010004256 Iwata et al. Jun 2001 A1
20010047373 Jones et al. Nov 2001 A1
20020035697 McCurdy et al. Mar 2002 A1
20020083064 Davis et al. Jun 2002 A1
20020090934 Mitchelmore Jul 2002 A1
20020156719 Finebaum et al. Oct 2002 A1
20030014445 Formanek et al. Jan 2003 A1
20030020671 Santoro et al. Jan 2003 A1
20030079177 Brintzenhofe et al. Apr 2003 A1
20030187954 Wen et al. Oct 2003 A1
20030189731 Chang Oct 2003 A1
20030191696 Yamamoto et al. Oct 2003 A1
20030200507 Stern et al. Oct 2003 A1
20040039589 Lee Feb 2004 A1
20040068458 Russo Apr 2004 A1
20040078814 Allen Apr 2004 A1
20040090462 Graham May 2004 A1
20040095376 Graham et al. May 2004 A1
20040098671 Graham May 2004 A1
20040168206 Stienstra Aug 2004 A1
20040175036 Graham Sep 2004 A1
20040268413 Reid et al. Dec 2004 A1
20050034068 Jaeger Feb 2005 A1
20050066268 Bieber Mar 2005 A1
20050091574 Maaniitty Apr 2005 A1
20050134578 Chambers Jun 2005 A1
20050198056 Dumais Sep 2005 A1
20050262448 Vronay et al. Nov 2005 A1
20050267873 Kettner et al. Dec 2005 A1
20050283734 Santoro et al. Dec 2005 A1
20050289468 Kahn et al. Dec 2005 A1
20060020596 Liu et al. Jan 2006 A1
20060085741 Weiner et al. Apr 2006 A1
20060213976 Inakoshi et al. Sep 2006 A1
20060236261 Forstall et al. Oct 2006 A1
20060253459 Kahn et al. Nov 2006 A1
20060277488 Cok Dec 2006 A1
20070055931 Zaima et al. Mar 2007 A1
20070079236 Schrier et al. Apr 2007 A1
20070082707 Flynt et al. Apr 2007 A1
20070104366 Sprague et al. May 2007 A1
20070198741 Duffy et al. Aug 2007 A1
20070220607 Sprosts et al. Sep 2007 A1
20070245251 Kim et al. Oct 2007 A1
20070256024 Schell et al. Nov 2007 A1
20070260586 Savona et al. Nov 2007 A1
20080052742 Kopf et al. Feb 2008 A1
20080086369 Kiat et al. Apr 2008 A1
20080104535 DeLine et al. May 2008 A1
20080109764 Linnamaki May 2008 A1
20080141126 Johnson et al. Jun 2008 A1
20080165209 Kondo et al. Jul 2008 A1
20080181498 Swenson et al. Jul 2008 A1
20080200153 Fitzpatrick et al. Aug 2008 A1
20080229352 Pino et al. Sep 2008 A1
20080244422 Hilgers et al. Oct 2008 A1
20090031247 Walter et al. Jan 2009 A1
20090183083 Hedges Jul 2009 A1
20090183103 McCartie et al. Jul 2009 A1
20090222754 Phillips et al. Sep 2009 A1
20090254399 Cristol Oct 2009 A1
20090307721 Afram Dec 2009 A1
20090316198 Takeuchi et al. Dec 2009 A1
20090319888 Oygard Dec 2009 A1
20100031169 Jang Feb 2010 A1
20100031366 Knight et al. Feb 2010 A1
20100138756 Saund Jun 2010 A1
20120137200 Shar et al. May 2012 A1
20130124953 Fan et al. May 2013 A1
20130232148 MacDonald Sep 2013 A1
20130325463 Greenspan et al. Dec 2013 A1
Non-Patent Literature Citations (30)
Entry
International Search Report and Written Opinion issued for PCT/US2011/035010, dated Jul. 19, 2011, 7 pages.
International Preliminary Report on Patentability, dated Jan. 25, 2011, received in International Patent Application No. PCT/US2008/082986, 6 pages.
Fails, “Mobile Collaboration for Young Children,” Human-Computer Interaction Lab, Computer Science Department, University of Maryland, College Park, MD, Apr. 19, 2007, 4 pages.
Hinckley et al., “Stitching: Pen Gestures that Span Multiple Displays,” Microsoft Research, Redmond, WA, May 2, 2004, 9 pages.
Rekimoto, “Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments,” Sony Computer Science Laboratory Inc., Tokyo, Japan, Nov. 18, 1997, 9 pages.
Streitz et al., “Roomware®—The Second Generation,” Integrated Publication and Information Systems Institute (IPSI), Darmstadt, Germany, 2 pages.
Office Action, dated Sep. 16, 2010, received in U.S. Appl. No. 11/948,806, 11 pages.
Final Office Action, dated Feb. 28, 2011, received in U.S. Appl. No. 11/948,806, 10 pages.
Office Action, dated Oct. 19, 2011, 2010, received in U.S. Appl. No. 11/948,806, 10 pages.
Final Office Action, dated Aug. 2, 2012, received in U.S. Appl. No. 11/948,806, 13 pages.
Office Action, dated Dec. 21, 2012, received in U.S. Appl. No. 11/948,806, 11 pages.
Final Office Action, dated Sep. 11, 2013, received in U.S. Appl. No. 11/948,806, 14 pages.
Office Action, dated Apr. 14, 2011, received in U.S. Appl. No. 12/180,485, 18 pages.
Final Office Action, dated Oct. 31, 2011, received in U.S. Appl. No. 12/180,485, 18 pages.
Office Action, dated Apr. 12, 2012, received in U.S. Appl. No. 12/180,485, 18 pages.
Final Office Action, dated Dec. 31, 2012, received in U.S. Appl. No. 12/180,485, 19 pages.
Office Action, dated May 24, 2013, received in U.S. Appl. No. 12/180,485, 20 pages.
Final Office Action, dated Dec. 4, 2013, received in U.S. Appl. No. 12/180,485, 23 pages.
Office Action, dated Jul. 18, 2014, received in U.S. Appl. No. 12/180,485, 23 pages.
Final Office Action, dated Feb. 12, 2015, received in U.S. Appl. No. 12/180,485, 18 pages.
Office Action, dated Jul. 20, 2012, received in U.S. Appl. No. 12/836,427, 19 pages.
Final Office Action, dated Feb. 15, 2013, received in U.S. Appl. No. 12/836,427, 19 pages.
Office Action, dated Oct. 7, 2013, received in U.S. Appl. No. 12/836,427, 19 pages.
Final Office Action, dated Jul. 17, 2014, received in U.S. Appl. No. 12/836,427, 22 pages.
Office Action, dated Apr. 6, 2015, received in U.S. Appl. No. 12/836,427, 8 pages.
International Search Report and Written Opinion, dated Jan. 16, 2009, received in International Patent Application No. PCT/US2008/082982, which corresponds with U.S. Appl. No. 11/948,806, 6 pages.
International Preliminary Report on Patentability, dated Jun. 1, 2010, received in International Patent Application No. PCT/US2008/082982, 6 pages.
International Search Report and Written Opinion, dated Jan. 16, 2009, received in International Patent Application No. PCT/US2008/082986, which corresponds with U.S. Appl. No. 12/180,485, 7 pages.
International Preliminary Report on Patentability, dated Jan. 25, 2011, received in International Patent Application No. PCT/US2008/082986, 7 pages.
International Preliminary Report on Patentability, dated Nov. 6, 2012, received in International Patent Application No. PCT/US2011/035010, 6 pages.
Related Publications (1)
Number Date Country
20120254745 A1 Oct 2012 US