The present disclosure relates to commonly owned, concurrently filed U.S. application Ser. No. 13/931,559 filed Jun. 28, 2013, entitled “DATA DISPLAYS IN A TILE-BASED USER INTERFACE”, the content of which is incorporated herein by reference in its entirety for all purposes.
Unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
Tile-based user interfaces (UIs) are becoming increasingly common in mobile computing devices. A tile-based application may present its UI in a tile that is displayed among several other tiles in the display area of an output device. The amount of information available from a tile is limited because the tile typically occupies only a small portion of the display area. Similarly, the functionality that is available through a tile is limited due to the small size of the tile. Access to the detailed information and full functionality of a tile-based application requires the user to bring up a full-screen view of the application's UI.
In the following description, for purposes of explanation, numerous examples and specific details are set forth in order to provide a detailed understanding of the present disclosure. It will be evident, however, to one skilled in the art that the present disclosure as expressed in the claims may include some or all of the features in these examples alone or in combination with other features described below, and may further include modifications and equivalents of the features and concepts described herein.
Users may access applications 14 running on the backend systems 12 using their computing devices 102. Typical computing devices 102 include desktop computers, laptop computers, and the like. In accordance with the present disclosure, the backend servers 12 may be accessed using mobile computing devices 102a, 102b, such as computing tablets, smart phones, and the like.
In addition to applications 14 running on the backend servers 12, in some embodiments, some applications 14 may be installed and executed on the computing devices 102. Services provided by the backend systems 12 may be accessed, for example, using web interface technology such as the web services description language (WSDL), the simple object access protocol (SOAP), and so on.
In accordance with the present disclosure, “tiling” may be used to allow users to have concurrent access to several applications at a time on their computing devices 102. For example, computing device 102a shows a display having several tiles 122 presented on the display. Each tile 122 may be associated with an application 14. The UI for each application 14 may be presented in a “tile view” 124a or in a “full-screen view” 124b. As will be explained in more detail, the user may switch between the UI in the tile view 124a and the UI in full-screen view.
Referring now to
Each tile 122 may be associated with an application 14. For example,
In accordance with the present disclosure, when a UI (e.g., 124a) is presented in a tile (e.g., 122a), the UI may present an “abbreviated representation” of the information generated by its associated application (e.g., 14a). In some embodiments, the abbreviated representation of information may be generated by the application, which may then be presented in the tile view UI. Accordingly, the application may be said to be in “tile” mode. Thus, for example,
Further in accordance with the present disclosure, when a UI is presented in full-screen mode (e.g., 124b), the UI may present a “detailed representation” of the information generated by its application (e.g., 14a). Accordingly, the application may be said to be in “full-screen” mode. For example,
The specific information that constitutes an abbreviated representation of the information that is generated by an application 14 will vary from one application to another. In accordance with the present disclosure, for example, an abbreviated representation may take into account the limited display area of the tile (e.g., 122a) in which the tile view UI (e.g., 124a) is presented. For instance, depending on the size of the tile, it may not be practical to display scroll bars in the tile view UI that is presented in that tile. Accordingly, the abbreviated representation of information that is presented in the tile view UI may be “complete” in the sense so that the user need not scroll the tile view UI to view the data; all of the data should be presented in the viewable area of the tile. In
As alluded to above, an abbreviated representation may omit many of the graphical UI (GUI) elements and data elements that the application 14 may generate.
Referring now to
A further aspect of the actionable UI is that in tile view, the application 14 remains “active”, firstly in order to receive and respond to actionable input, but also to continue generating output for presentation in the tile view UI. For example, if the application is a stock market ticker application, the application is active when the UI is in full-screen view presenting, for instance, detailed information for a given stock (e.g., buy and sell prices, options trading information, and so on), functionality (e.g., buy and sell buttons), and so on. When the UI is in tile view, only abbreviated information is presented (e.g., only the current buy and sell price of the stock), but the application executing in tile mode nonetheless remains active. For example, the current buy and sell price presented in the tile view UI may be dynamically updated in real time fashion as the application produces new buy and sell price values.
Referring to
Referring to
The processing unit 412 may comprise a single-processor configuration, or may be a multi-processor architecture. The system memory 414 may include read-only memory (ROM) and random access memory (RAM). The internal data storage device 416 may be an internal hard disk drive (HDD), a magnetic floppy disk drive (FDD, e.g., to read from or write to a removable diskette), an optical disk drive (e.g., for reading a CD-ROM disk, or to read from or write to other high capacity optical media such as the DVD), and so on. In a configuration where the computing device 102 is a mobile device, the internal data storage 416 may be a flash drive.
The internal data storage device 416 and its associated non-transitory computer-readable storage media provide nonvolatile storage of data, data structures, computer-executable instructions, and so forth. Although the description of computer-readable media above refers to a HDD, a removable magnetic diskette, and a removable optical media such as a CD or DVD, it is noted that other types of media which are readable by a computer, such as zip drives, magnetic cassettes, flash memory cards, cartridges, and the like, may also be used, and further, that any such media may contain computer-executable instructions for performing the methods disclosed herein.
The system memory 414 and/or the internal data storage device 416 may store a number of program modules, including an operating system (OS) 432, one or more application programs 434, program data 436, and other program/system modules 438. For example, the application programs 434, which when executed, may cause the computing part 402 to perform method steps of
In some embodiments, access to the computing part 402 may be provided by an input component 444 (e.g., keyboard, mouse, etc.) and an output component 446. In some embodiments, where the computing device 102 is mobile device, the input 444 and output 446 may be components of a touch-sensitive device. In other embodiments, such as in a laptop computer, the input 444 may be a touch pad and the output 446 may be a display panel.
Referring to
At block 504, user input may be received. The user input may be a gesture made on the display device (e.g., 104,
The user input may be directed to the application associated with the tile.
At block 506, a determination is made if the user input indicates a “zoom in” action directed to a tile. In some embodiments, for example, the zoom in action may comprise pinch gesture performed in the area of the tile to be zoomed into. In particular, the pinch gesture may be a “reverse” pinch in which two of the user's fingers (e.g., thumb and forefinger) are placed close together and then moved apart. It will be appreciated that in other embodiments, the zoom in action may comprise any other suitable gesture (e.g., a double tap). If at block 506, the user input is determined to be a zoom in gesture, then processing may proceed to block 532 to process the zoom in gesture. This will be described in more detail in connection with
If at block 506, the user input is determined not to be a zoom in gesture, then processing may proceed to block 508, where a determination is made whether the user input indicates a “zoom out” action directed to a tile. In some embodiments, for example, a zoom out action may comprise pinch gesture (e.g., two fingers spaced apart and brought close together) performed in the area of the tile to be zoomed out of. It will be appreciated that in other embodiments, the zoom out action may be any other suitable gesture. If at block 508, the user input is determined to be a zoom out gesture, then processing may proceed to block 542 to process the zoom out gesture, which will be described in more detail below in connection with
If at block 508, the user input is determined not to be a zoom out gesture, then processing may proceed to block 510, where a determination is made whether the user input indicates some other gesture directed to a tile. For example, in some embodiments the user input may be a gesture to move a tile to a new location. In other embodiments, the user input may be a gesture to move the entire display of tiles in order to bring other tiles into view in the display area 106, and so on. If the user input is another gesture directed to a tile, then processing may proceed to block 552 to process the gesture. Processing from block 552 may then return to block 504 to receive further user input.
If at block 510, the user input is determined not to be another gesture that is directed to a tile, then processing may proceed to block 512. In some embodiments, the user input at this point may be deemed to be directed to the application associated with the tile on which the gesture was made. Accordingly, at block 512, the user input may be processed by the application, which may or may not generate new information.
If, at block 514, the UI does not need to be updated (e.g., because no new information was generated, or the newly generated information does not affect the presentation in the UI), then processing may return to block 504 to receive further user input. If, on the other hand, new information is generated that needs to be displayed in the UI, then processing proceeds to block 516.
At block 516, if the UI is in tile view, then at block 518, the application may generate an abbreviated representation of the newly generated information. For example, a to-do item (e.g., as illustrated in 124b) contains much more information than can be practically presented in a tile view UI. Accordingly, at block 518, the TODO application 14a may generate an abbreviated representation of the to-do item; e.g., the abbreviated representation may include the time of the to-do item and only one party associated with the to-do item. The tile view UI may then be updated with the abbreviated representation of the newly generated information. Processing from block 518 may then return to block 504 to receive further user input.
If, at block 516, the UI is in full-screen view, then at block 520, the application may generate a detailed representation of the newly generated information. In the to-do example, the newly generated information may include all the details of the to-do item. More generally, however, the newly generated information may include new or additional graphical elements; e.g., to show additional data, additional functions, additional elements in the UI, and so on resulting from the application's response to the user input which can be presented in the full-screen UI. Processing from block 520 may then return to block 504 to receive further user input.
Referring now to
As explained above, when the user makes a zoom in gesture on a tile, the UI presented in that tile will expand from tile view to a full-screen view, where the full-screen UI may occupy substantially all of the display area 106 of the display device 104. In accordance with the present disclosure, the tile view to full-screen animation includes visual cues that enable the user to remain cognizant of which tile is expanding and thus maintain their awareness of the application that is being zoomed into. As will be explained below, the animation employs several such cues.
At block 532-1, if the UI is already zoomed in to full-screen, then the process may terminate. Otherwise, processing proceeds to block 532-2, where a full-screen image of the UI in full-screen view is obtained. The full-screen image may be a default image of the UI, for example a home screen. In some embodiments, the full-screen image may be stored locally in the computing device 102, or in other embodiments may be provided to the computer by the backend servers 12.
At block 532-3, the tile that is zoomed into may be replaced by the full-screen image of the UI, sized to match the size of the tile being replaced. Replacement with the full-screen image may serve as an initial visual cue that the user has activated the zoom in action on the tile.
At block 532-4, the full-scale image that now replaces the tile may begin to scale up to fill the display area 106. In some embodiments, there may be a delay from the time of the replacement image replacement to the beginning of the scaling-up animation. In some embodiments, prior to commencing with the animation, the replacement image may be flashed (e.g., change colors) for a moment to draw the user's attention to the location of the tile in the display area 106. The scaling up animation may then proceed.
Referring for a moment to
For example, the image 602 may scale up such that each side of the image (e.g., left, right, top, and bottom) moves toward respective sides 106a, 106b, 106c, and 106d of the display area 106. The speed of motion of the sides L, T, R, and B may be such that they reach their respective sides 106a-106d of the display area 106 at substantially the same time. This animation ensures a visually linear or uniform expansion to full-screen irrespective of the original size of the tile and starting aspect ratio of the tile (i.e., the starting aspect ratio of the tile can be different from the aspect ratio of the full-screen UI). This may be advantageous in that the tile sizes and tile aspect ratios can be selected for arrangement in the display area 106 without the design constraint of how a given tile will scale to full-screen view.
In some embodiments, the speed of the animation may be sufficiently slow as to further enhance the visual effect. For example, in some embodiments, the animation may last on the order of seconds, allowing the user to visually track the expansion. In other embodiments, the animation may last for a longer period of time or a shorter period of time. In still other embodiments, the speed may be selectable by the user. In some embodiments, additional animation elements (e.g., expanding wire frame) may be provided in the animation to further enhance the visual experience.
Returning to
Referring now to
As explained above, when the user makes a zoom out gesture on a full-screen UI, the UI will reduce in size from full-screen view to tile view. In accordance with the present disclosure, the full-screen view to tile view animation includes restoring the UI to tile view at the location in the display area 106 where the tile was located when the zoom in action was made, and to the original size of the tile.
At block 542-1, if the UI is already zoomed out to tile view, then the process may terminate. Otherwise, processing proceeds to block 542-2, where a screen shot image of the UI in full-screen view is obtained. For example, a screen shot of the current state of the full-screen UI.
At block 542-3, an animation of the scaling down of the full-screen UI may begin with the live full-screen UI that is presented in the display area 106 being replaced by the screen shot image of the UI obtained in block 542-2.
At block 542-4, the screen shot image of the UI that now replaces the live UI may begin to scale down, marking the beginning of the animation. In some embodiments, the screen shot image will scale down to the size of the tile that was zoomed into. The animation may complete with the scaled-down screen shot image being located in the display area 106 where the tile was originally located at the time that the zoom in action on the tile was made. In addition, any surrounding tiles that were also displayed in the display area 106 at the time of the zoom in action may be re-displayed in the display area. This restores the display area 106 to the pre-zoom in visual state, returning the user to a state of the display that they expect to see. In some embodiments, the scaling down animation may generally proceed in the reverse direction as the scaling up animation described above.
At block 542-5, upon completion of the animation, the screen shot image may be replaced with the tile view UI. At this point, the zoom out of the full-screen UI to tile view may be deemed to have completed.
Turning now to
The sequence shown in
The above description illustrates various embodiments of the present disclosure along with examples of how aspects of the particular embodiments may be implemented. The above examples should not be deemed to be the only embodiments, and are presented to illustrate the flexibility and advantages of the particular embodiments as defined by the following claims. Based on the above disclosure and the following claims, other arrangements, embodiments, implementations and equivalents may be employed without departing from the scope of the present disclosure as defined by the claims.
Number | Name | Date | Kind |
---|---|---|---|
5537618 | Boulton et al. | Jul 1996 | A |
5590250 | Lamping et al. | Dec 1996 | A |
6085202 | Rao et al. | Jul 2000 | A |
7113088 | Frick et al. | Sep 2006 | B2 |
7376585 | Haller | May 2008 | B2 |
7634733 | Sadikaili et al. | Dec 2009 | B2 |
7949954 | Jezek | May 2011 | B1 |
8296667 | Tewari et al. | Oct 2012 | B2 |
8365090 | Ording | Jan 2013 | B2 |
8527909 | Mullany | Sep 2013 | B1 |
8941657 | Agarwal et al. | Jan 2015 | B2 |
20020073146 | Bauer | Jun 2002 | A1 |
20050044058 | Matthews | Feb 2005 | A1 |
20050283739 | Mohr et al. | Dec 2005 | A1 |
20060026535 | Hotelling et al. | Feb 2006 | A1 |
20080165403 | Grasshoff | Jul 2008 | A1 |
20090031247 | Walter | Jan 2009 | A1 |
20090164944 | Webster | Jun 2009 | A1 |
20090178009 | Dotson et al. | Jul 2009 | A1 |
20100231595 | Dang et al. | Sep 2010 | A1 |
20100269062 | Kobylinski | Oct 2010 | A1 |
20100283743 | Coddington | Nov 2010 | A1 |
20110074710 | Weeldreyer et al. | Mar 2011 | A1 |
20110107220 | Perlman | May 2011 | A1 |
20110109632 | Gorev | May 2011 | A1 |
20110145759 | Leffert | Jun 2011 | A1 |
20110209100 | Hinckley et al. | Aug 2011 | A1 |
20110283188 | Farrenkopf et al. | Nov 2011 | A1 |
20110283231 | Richstein et al. | Nov 2011 | A1 |
20110283242 | Chew et al. | Nov 2011 | A1 |
20110298724 | Ameling et al. | Dec 2011 | A1 |
20110302527 | Chen et al. | Dec 2011 | A1 |
20120007868 | Buck | Jan 2012 | A1 |
20120030275 | Boller et al. | Feb 2012 | A1 |
20120081292 | Sirpal | Apr 2012 | A1 |
20120089950 | Tseng | Apr 2012 | A1 |
20120092267 | Haug | Apr 2012 | A1 |
20120096394 | Balko et al. | Apr 2012 | A1 |
20120151417 | Wong et al. | Jun 2012 | A1 |
20120306930 | Decker et al. | Dec 2012 | A1 |
20130016128 | Bhatt | Jan 2013 | A1 |
20130067390 | Kwiatkowski et al. | Mar 2013 | A1 |
20130067391 | Pittappilly et al. | Mar 2013 | A1 |
20130067398 | Pittappilly et al. | Mar 2013 | A1 |
20130067420 | Pittappilly et al. | Mar 2013 | A1 |
20130080884 | Lisse et al. | Mar 2013 | A1 |
20130080975 | Geithner | Mar 2013 | A1 |
20130155116 | Paretti | Jun 2013 | A1 |
20130179644 | Tomi | Jul 2013 | A1 |
20130229440 | MacDonald | Sep 2013 | A1 |
20130335337 | Chua | Dec 2013 | A1 |
20140047381 | Fan et al. | Feb 2014 | A1 |
20140281868 | Vogel et al. | Sep 2014 | A1 |
20140300603 | Greenfield | Oct 2014 | A1 |
20140372924 | Shih | Dec 2014 | A1 |
20150007078 | Feng et al. | Jan 2015 | A1 |
20150149329 | Tam | May 2015 | A1 |
Entry |
---|
Root, Users Guide 5.26, published in Dec. 2009, available at <URL=ftp://root.cern.ch/root/doc/Users_Guide_5_26. |
Redfin Blog, “Cluster Buck Rogers,” Oct. 25, 2010 available at: <URL=https://www.redfin.com/blog/2010/10/cluster_buck_rogers.html#.VQw47PldXII>, last accessed Apr. 28, 2015. |
Number | Date | Country | |
---|---|---|---|
20150007099 A1 | Jan 2015 | US |