Overflow stack user interface

Information

  • Patent Grant
  • 8892997
  • Patent Number
    8,892,997
  • Date Filed
    Friday, June 8, 2007
    18 years ago
  • Date Issued
    Tuesday, November 18, 2014
    11 years ago
Abstract
Systems and methods for providing an overflow stack. An overflow stack can be generated based upon adjustments to a group display area and based upon application of one or more display criterion. An overflow stack can include representation of any system objects that can not be displayed in an adjusted group display area based upon the one or more display criterion.
Description
BACKGROUND

A graphical user interface allows a large number of graphical objects or items to be displayed on a display screen at the same time. Leading personal computer operating systems, such as the Apple Mac OS®, provide user interfaces in which a number of graphical representations of system objects can be displayed according to the needs of the user. Example system objects include system functions, alerts, windows, peripherals, files, and applications, Taskbars, menus, virtual buttons, a mouse, a keyboard, and other user interface elements provide mechanisms for accessing and/or activating the system objects corresponding to the displayed representations.


The graphical objects and access to the corresponding system objects and related functions, however, should be presented in a manner that facilitates an intuitive user experience. The use of metaphors that represent concrete, familiar ideas facilitate such an intuitive user experience. For example, the metaphor of a document or photo can be used to identify an electronic file; the metaphor of fife folders can be used for storing documents, etc.


SUMMARY

Disclosed herein are methods, apparatus and systems including an overflow stack user interface. In an implementation, a computer-implemented method associates graphical representations of system objects into a group and displays the group in a group display area. The group display area can be adjusted, and a determination can he made whether the associated graphical representations of system objects can be displayed in the adjusted group display area based upon one or more display criterion. A representation of two or more of the associated graphical representations of system objects can be provided by a stack item if the associated graphical representations of system objects can not be displayed in the adjusted group display area based on the one or more display criterion.


In another implementation, a computer-readable medium stores instructions that upon execution cause a processing device to associate graphical representations of system objects in a group and display the graphical representations of system objects in a group display area. Adjustment of the group display area can be made based upon user input, and a determination can be made whether the associated graphical representations of system objects can be displayed in the adjusted group display area based upon one or more display criterion. A representation of two or more of the associated graphical representations of system objects can be provided in a stack item based on the display criterion.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram of an example system that can be utilized to implement the systems and methods described herein.



FIG. 2A is a block diagram of an example user interface architecture.



FIG. 2B is a block diagram depicting an example stack item.



FIG. 3 is a block diagram of an example system layer structure that can be utilized to implement the systems and methods described herein.



FIG. 4 is a block diagram of a display environment illustrating an example overflow stack.



FIGS. 5A-5C are block diagrams depicting an example display environment adjustment generating an overflow stack.



FIGS. 6A and 6B are block diagrams depicting an example display environment adjustment including a prioritization.



FIGS. 6C and 6D are block diagrams depicting an example display environment adjustment including an alternative prioritization.



FIG. 7 is a flowchart illustrating an example method of providing an overflow stack.



FIG. 8 is a flowchart illustrating an example method of providing a prioritization for an overflow stack.





DETAILED DESCRIPTION


FIG. 1 is a block diagram of an example system 100. The system 100 can, for example, be implemented in a computer device, such as any one of the personal computer devices available from Apple Computer, Inc., or other electronic devices. Other example implementations can also include video processing devices, multimedia processing devices, portable computing devices, portable communication devices, set fop boxes, personal digital assistants, and other electronic devices.


The example system 100 includes a processing device 102, a first data store 104, a second data store 106, a graphics device 108, input devices 110, output devices 112, and a network device 114. A bus system 116, such as a data bus and a motherboard, can be used to establish and control data communication between the components 102, 104, 106, 108, 110, 112 and 114. Other example system architectures, however, can also be used.


The processing device 102 can, for example, include one or more microprocessors. The first data store 104 can, for example, include a random access memory storage device, such as a dynamic random access memory, or other types of computer-readable medium memory devices. The second data store 106 can, for example, include one or more hard drives, a flash memory, and/or a read only memory, or other types of computer-readable medium memory devices.


The graphics device 108 can, for example, include a video card, a graphics accelerator card, or a display adapter, and is configured to generate and output images to a display device. In one implementation, the graphics device 108 can be realized in a dedicated hardware card connected to the bus system 116. In another implementation, the graphics device 108 can be realized in a graphics controller integrated into a chipset of the bus system 118. Other implementations can also be used.


Example input devices 110 can include a keyboard, a mouse, a stylus, a video camera, a multi-touch surface, etc., and example output devices 112 can include a display device, an audio device, etc.


The network interface 114 can, for example, include a wired or wireless network device operable to communicate data to and from a network 118. The network 118 can include one or more local area networks (LANs) or a wide area network (WAN), such as the internet.


In an implementation, the system 100 includes instructions defining an operating system stored in the first data store 104 and/or the second data store 108. Example operating systems can include the MAC OS® X series operating system, the WINDOWS® based operating system, or other operating systems. Upon execution of the operating system instructions, access to various system objects is enabled. Example system objects include data files, applications, functions, windows, etc. To facilitate an intuitive user experience, the system 100 includes a graphical user interface that provides the user access to the various system objects and conveys information about the system 100 to the user in an intuitive manner.



FIG. 2A is a block diagram of an example user interface architecture 200. The user interface architecture 200 includes a user interface (UI) engine 202 that provides the user access to the various system objects 204 and conveys information about the system 100 to the user.


Upon execution, the UI engine 202 can cause the graphics device 108 to generate a graphical user interface on an output device 112, such as a display device. In one implementation, the graphical user interface can include a multidimensional desktop 210 and a multidimensional application environment 212. In an implementation, the multidimensional desktop 210 and the multidimensional application environment 212 include x-, y- and z-axis aspects, e.g., a height, width and depth aspect. The x-, y- and z-axis aspects may define a three-dimensional environment, e.g., a “3D” or “2.5D” environment that includes a z-axis, e.g., depth, aspect.


In an implementation, the multidimensional desktop 210 can include visualization objects 220, a visualization object receptacle 222, and stack items 224. An example implementation of a visualization object receptacle 300 is the “Dock” user interface in the MAC OS® X Leopard operating system. Other implementations can also be used. In some implementations, the visualization objects 220, the visualization object receptacle 222 and the stack items 224 can be presented in a pseudo-three dimensional (i.e., “2.5D”) or a three-dimensional environment as graphical objects having a depth aspect.


A visualization object 220 can, for example, be a visual representation of a system object, in some implementations, the visualization objects 220 are icons. Other visualization objects can also be used, e.g., alter notification windows, menu command bars, windows, or other visual representations of system objects.


In an implementation, the multidimensional application environment 212 can include an application environment distributed along a depth aspect. For example, a content frame, e.g., an application window, can be presented on a first surface, and control elements, e.g., toolbar commands, can be presented on a second surface.



FIG. 2B is a block diagram depicting an example stack item 230. Stack items are described in detail in U.S. application Ser. No. 11/760,595, entitled “MULTIDIMENSIONAL DESKTOP,” filed on Jun. 8, 2007, which is hereby incorporated by reference, in one implementation, the stack item 230 is a system object that includes a plurality of stack elements, e.g., stack elements 232, 234, 236 and 238, such as icons corresponding to system objects. The stack item 230 is associated with the stack elements 232, 234, 236 and 238 so that selection of the stack item can provide access to any of the stack elements 232, 234, 236 and 238. In one implementation, a stack element can, for example, be realized by a corresponding icon of a system object. In another implementation, a stack element can, for example, be realized by a corresponding thumbnail icon of a system object, in another implementation, a stack element can, for example, be realized by a different corresponding icon of a system object. In another implementation, a stack element can, for example, be realized by a common stack element icon. Other stack element realizations can also be used.


In one implementation, the stack elements 232, 234, 236 and 238 are aggregated in an overlapping arrangement as shown in FIG. 2B. Other stack arrangements can also be used. In one implementation, each stack element 232, 234, 236 and 238 displays a corresponding unique indicium 232, 234, 236 and 238, e.g., a thumbnail preview of an image associated with the stack element or the first page of a document associated with the stack element. Other unique indicium or unique indicia can also be used. For example, stack items corresponding to images can be of the same aspect of the image, e.g., a 4×5 aspect, and 9×12 aspect, etc. Likewise, stack items corresponding to documents can be of the same aspect of a paper selection, e.g., an 8.5×11 aspect, an A4 aspect, etc. Other unique indicium or indicia can also be used, e.g., a document size and/or a document date can be displayed in each stack element, etc.


The stack item 230 can include icons related to different types of system objects. For example, a stack item can include stack elements related to peripheral devices, e.g., hard drives, universal serial bus devices, etc.; or can include stack elements related to application windows; or can include stack elements related to system functions, e.g., menus, a shutdown function, a sleep function, a backup function, etc.; or can includes stack elements related to recent system alerts; or other system objects.



FIG. 3 is block diagram of example system layers 600 that can be utilized to implement the systems and methods described herein. Other system layer implementations, however, can also be used.


In an implementation, a user interface engine, such as the UI engine 202, or another UI engine capable of generating a three-dimensional user interface environment, operates at an application level 602 and implements graphical functions and features available through an application program interface (API) layer 804. Example graphical functions and features include graphical processing, supported by a graphics API, image processing, support by an imaging API, and video processing, supported by a video API.


The API layer 604, in turn, interfaces with a graphics library layer 606. The graphics library layer 604 can, for example, be implemented as a software interface to graphics hardware, such as an implementation of the OpenGL specification. A driver/hardware layer 808 includes drivers and associated graphics hardware, such as a graphics card and associated drivers.



FIG. 4 is a block diagram of an example display environment illustrating an example overflow stack. One or more stack items (e.g., overflow stack 406) can enable the user to adjust a display environment from a size 400a to a size 400b while retaining a views associated with a group of system objects 402a-h, 404a-h. In some implementations, graphical representations of system objects can be scaled during an adjustment to fit within the display environment. In further implementations, an overflow stack 406 can be generated based upon display criteria associated with the group or with the graphical representation of system objects.


In some implementations, a display environment 400a can be reduced to a scaled display environment 400b based upon user input. In such implementations, display criteria can be used to determine whether the graphical representations of the system objects can be displayed in the scaled display environment 400b. In some implementations, an aspect ratio associated with the graphical representations of system objects can be reduced in size to fit the graphical representations within the display environment. In some implementations, a minimum size and/or maximum size can be associated with the graphical representations. In other implementations, a spacing between the graphical representations of system objects can be reduced. In further implementations, a minimum or maximum spacing between graphical representations of system objects can be specified. The minimum size, maximum size, minimum spacing and maximum spacing can be included as display criteria.


In those implementations where the display criteria prevents the graphical representation of each of the system objects from being displayed in the display environment 400b, an overflow stack 406 can be generated. The overflow stack 406 can include those graphical representations of system objects, which are not displayed in the scaled display environment 400b based on the display criteria, e.g., 402a-h. Those graphical representations of system objects 404a-h which can be displayed in the adjusted display environment 400b can retain their position within the scaled display environment 400b.


In other implementations, a display environment 400b can be enlarged to a scaled display environment 400a based upon user input. In such implementations, display criteria can be used to determine whether the graphical representations of the system objects included in an overflow stack 406 can be displayed in the scaled display environment 400a. In some implementations, the graphical representations of system objects can be enlarged in size to fit the graphical representations within the display environment. In some implementations, a user or a programmer can set a minimum size or maximum size associated with the graphical representations. In some implementations, such scaling and spacing adjustments can be performed until the display environment is operable to display of the graphical representation of each of the system objects 402a-h included in the overflow stack 406 based upon the display criteria.


In extensions to the above implementations, the display environment can be adjusted based upon system constraints. For example, a new application launched by the system or a user might reduce any display environment available for the display environment from display environment 400a to display environment 400b. Thus, the system might adjust the display environment 400a to scaled display environment 400b. Alternatively, an existing application can be reduced or terminated, enabling the system to use additional display environment. Thus, the system might adjust the display environment 400b to scaled display environment 400a.


In further examples, a display environment might be terminated. For example a display device (e.g., a monitor) might be disconnected from the system. In some implementations, when a display environment is terminated, the graphical representations of those system objects being viewed in the terminated display environment can be transferred to a second display environment (e.g., a second display device). The graphical representations of those system objects transferred to the second display environment can be represented, in some implementations, using a stack item (e.g., an overflow stack). Thus, the graphical representations of those system objects and the association between those system objects in the terminated display environment are not lost, but instead can be transferred to a remaining display environment as an overflow stack.



FIGS. 5A-5C are block diagrams depicting an example display environment adjustment generating an overflow stack. The display environment 500a can include a number of graphical representations 502a-p of system objects grouped together based upon an association (e.g., user input common file type, creation date, etc.). In some implementations, the display environment 500a can result from a user selecting and associating a number of graphical representations 502a-p of system objects. In other implementations, the display environment 500a can result from the selection of a group stack representation. In some implementations, the display environment 500a can represent each of the system objects in a matrix including the graphical representations of the system objects, in some implementations, the system objects might not be grouped, but rather those system objects included in a window, such as for example, when the user is viewing contents associated with a directory.



FIG. 5B depicts an example display environment adjustment being initiated. The display environment adjustment is operable to adjusting the original display environment 500a to a scaled display environment 500b. This example shows a reduction of the display environment size. However, other examples can include an enlargement of the display environment size. Display criteria associated with the group can be operable to determine whether the graphical representation of each of the system objects can be include in the scaled display environment 500b. In this example, graphical representations 502a, 502b, 502c, 502d, 502h, 502i, 502o and 502p are excluded from the scaled display environment 500b based upon the display criteria. Graphical representations 502a, 502b, 502c, 502d, 502h, 502i, 502o and 502p can be collapsed into an overflow slack 504. The overflow stack 504 in various implementations, can include a stacked representation of each of the graphical representations 502a, 502b, 502c, 502d, 502h, 502i, 502o and 502p excluded from the scaled display environment 502b by the display criteria.



FIG. 5C depicts the scaled display environment. The sealed display environment 500b can include those graphical representations 502e, 502f, 502g, 502i, 502j, 502k, 502m, 502n which can be included within the scaled display environment 500b based upon the display criteria. The scaled display environment 500b can also include a stack representation 504 of those graphical representations of display objects which are not included in the display environment based upon the display criteria.


In some implementations, a system can include a prioritization associated with the system objects represented by a grouping. FIGS. 6A and 6B show an example display environment adjustment based upon a prioritization of associated system objects. The graphical representations 610a-p of system objects include a prioritization. In various implementations, the system objects can be prioritized based upon any metric associated with the objects. For example, the prioritization can be based upon alphabetical order of the object names, creation date, last modified date, file type, etc. In other implementations, the prioritization can be based upon user input. In the example shown, system objects represented by graphical representations 610a-h are higher in priority than those system objects represented by graphical representations 610i-p. Thus, the system objects represented by graphical representations 610i-p are used to generate a stack item (e.g., an overflow stack 630a).


As shown in FIG. 6B, the system objects that remain in the group display area 600b are represented by graphical representations 610a-h and are accompanied by the overflow stack 630a. In some implementations, the graphical representations 610a-h can be rearranged based upon the new group display area 600b.


In another example prioritization, FIGS. 6C and 6D show another example display environment adjustment based upon a prioritization of associated system objects. The graphical representations 650a-p of system objects include a prioritization. In this example, system objects represented by graphical representations 850a-h are higher in priority than those system objects represented by graphical representations 650i-p based upon the prioritization of the system objects. Thus, the system objects represented by graphical representations 650i-p are used to generate a stack item (e.g., an overflow stack 630b).


As shown in FIG. 6D, the system objects that remain in the group display area 600d are represented by graphical representations 610a-h and are accompanied by the overflow stack 630b. In some implementations, the graphical representations 650a-h can be rearranged based upon the new group display area 600d.


In some implementations, the overflow stack 630a, 630b can be displayed in a variety of ways. For example, in some implementations, the overflow stack can include stack representations depicting each of the system objects included in the overflow stack 630a, 630b. In further implementations, the overflow stack can expand or rotate to show graphical representations associated with each of the system objects included in the overflow stack 630a, 630b. In other implementations, the overflow stack 630a, 630b might not include stack representations associated with each of the system objects, but instead merely serve as an indication that the group includes more system objects not displayed by within the group display area 600b, 600d.



FIG. 7 is a flowchart illustrating an example method 700 for displaying graphical objects on a display space including providing an overflow stack. At stage 702, graphical representations of system objects are associated with a group. The graphical representations of system objects can be associated with a group, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2-3). In various implementations, the graphical representations can be associated based upon user input, system rules, etc.


At stage 704, associated graphical representations can be displayed in a group display area. The graphical representations can be displayed in a group display area, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2-3) in conjunction with an API layer (e.g., API layer 304 of FIG. 3), a graphics library (e.g., graphics library 306 of FIG. 3) and a graphics card and display device (e.g., drivers/hardware 308 of FIG. 3). In some implementations, the group display area can include a matrix display of the graphical representations of those system objects included in the group and/or stack items (e.g., an overflow stack) based upon display criteria.


At stage 706, the group display area can be adjusted. The group display area can be adjusted, for example, by a user interface (e.g., UI engine 202, 302 of FIGS. 2-3). In some implementations, the group display area is adjusted based upon user input. In additional implementations, the group display area can be adjusted based upon system constraints (e.g., a new application launch).


At stage 708, a determination is made whether the associated graphical representations can be displayed in the adjusted group display area. The determination can be made, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2-3). In some implementations, the determination can be made based upon display criteria associated with the system, with the group, or with the system objects themselves. Display criteria, in various implementations, can include a minimum or maximum graphical representation associated with system objects, minimum or maximum spacing distance between graphical representations of system objects, etc. Other display criteria are possible.


At stage 710, two or more of the graphical representations of system objects can be represented in a stack item based upon the determination. Two or more of the graphical representations of system objects can represented in a stack item, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2-3), in some. implementations, the stack item can include a stack representation associated with each of the system objects represented by the stack item. In some implementations, the stack item can rotate to enable a user to see the system objects represented by the stack item. In further implementations, the stack item can be expanded to view the system objects represented by the stack item.



FIG. 8 is a flowchart illustrating an example method of providing a prioritization for an overflow stack. At stage 802, system objects can be prioritized based upon a prioritization. The system objects can be prioritized, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2, 3). In some implementations, the prioritization can be provided, for example, by a user. The prioritization can be based upon measurable object characteristics (e.g., size, object name, creation date, modified date, etc.). In other implementations, the user can provide user input prioritizing the system objects based upon the user's own interpretation of the priority of the system objects.


At stage 804, a determination can be made as to whether the associated graphical representations can be displayed in an adjusted group display area. The determination can be made, for example, by a user interface engine (e.g., user interface engine 202, 302 of FIGS. 2-3). In some implementations, the determination can be made based upon display criteria associated with the system, group, or the system objects.


At stage 806, two or more of the graphical representations of system objects with the lowest priority can be represented in a stack item based upon the determination. The representation of system objects in a stack item can be performed, for example, by a user interface engine (e.g., UI engine 202, 302 of FIGS. 2-3). In some implementations, the system objects with lowest priority among a group can be represented by a stack representation. In further implementations, additional system objects can be added to the stack, based upon additional adjustment of a group display area. In these implementations, graphical representations associated with the lowest priority system objects are added to the stack item first, and graphical representations of the next lowest priority can be added to the stack item second, etc.


In various implementations, an overflow stack can be removed from the group display area based upon the group display area being enlarged and based upon the display criteria. When the group display area is enlarged enough to display each of the graphical representations of system objects included in the group in accordance with the display criteria, the overflow stack can be removed and the graphical representation of ail system objects within the group can be displayed.


The apparatus, methods, flow diagrams, and structure block diagrams described in this patent document may be implemented in computer processing systems including program code comprising program instructions that are executable by the computer processing system. Other implementations may also be used. Additionally, the flow diagrams and structure block diagrams described in this patent document, which describe particular methods and/or corresponding acts in support of steps and corresponding functions in support of disclosed structural means, may also be utilized to implement corresponding software structures and algorithms, and equivalents thereof.


This written description sets forth the best mode of the invention and provides examples to describe the invention and to enable a person of ordinary skill in the art to make and use the invention. This written description does not limit the invention to the precise terms set forth. Thus, while the invention has been described in detail with reference to the examples set forth above, those of ordinary skill in the art may effect alterations, modifications and variations to the examples without departing from the scope of the invention.

Claims
  • 1. A computer-implemented method, comprising: providing for display, in a group display area, a first graphical representation of a first object at an original position, the group display area having a size adjustable by a user;providing for display one or more second graphical representations each representing a separate second object in the group display area;resizing the group display area, including reducing the size of the group display area upon receiving a user input;determining that at least one second graphical representation is located in a portion of the group display area that is visible before the size of the group display area is reduced and invisible after the size of the group display area is reduced, and that the first graphical representation is located in a portion of the group display area that is visible both before and after the size of the group display area is reduced;generating a stack item including a first stack element and one or more second stack elements, the first stack element representing the first object, each second stack element representing a second object;excluding the first graphical representation and the one or more second graphical representations from the resized group display area such that both the first graphical representation and the one or more second graphical representations are invisible; andproviding for display, in the resized group display area, the stack item at the original position of the first graphical representation, wherein a greater reduction in the size of the group display area during the resizing causes more second graphical representations to be excluded from display and more second graphical objects be represented in the stack item.
  • 2. The computer implemented method of claim 1, further comprising: prioritizing the first stack element and a second stack element based upon a prioritization of the first object and a second object.
  • 3. The computer implemented method of claim 2, wherein the prioritization of the first object and the second object is based upon user input.
  • 4. The computer implemented method of claim 2, wherein the prioritization of the first object and the second object is based upon a date associated with each of the first object and the second object.
  • 5. The computer implemented method of claim 2, wherein the prioritization of the first object and the second object is based upon an application associated with each of the first object and the second object.
  • 6. The computer implemented method of claim 1, further comprising: adjusting an aspect ratio associated with each of the first graphical representation and each second graphical representation based upon adjusting the group display area.
  • 7. The computer implemented method of claim 6, comprising determining that the first graphical representation is to be excluded based on one or more display criteria, wherein the one or more display criteria comprise a minimum aspect ratio associated with the first graphical representation and each second graphical representation.
  • 8. The computer implemented method of claim 7, wherein the one or more display criteria comprise a prioritization associated with the first object and each second object.
  • 9. The computer implemented method of claim 1, wherein the first stack element and the one or more second stack elements are aggregated in an overlapping arrangement.
  • 10. The computer implemented method of claim 1, further comprising: determining that a display environment associated with the group display area has been terminated; anddisplaying graphical representations of objects in the group in a new stack item in a second display environment.
  • 11. The computer implemented method of claim 1, wherein each second graphical representation does not fit within the resized group display area.
  • 12. The computer implemented method of claim 1, further comprising: resizing the resized group display area into a second resized group display area;further determining, based upon one or more display criteria, that the first graphical representation and the first graphical representation are to be displayed in the second resized group display area;in response to the further determining, removing the stack item; anddisplaying the first representation and second representation in the second resized group display area.
  • 13. The computer implemented method of claim 1, where resizing the group display area includes scaling the group display area.
  • 14. A non-transitory computer-readable medium storing instructions that are executable by a processing device, and upon such execution cause the processing device to perform operations comprising: providing for display, in a group display area, a first graphical representation of a first object at an original position, the group display area having a size adjustable by a user;providing for display one or more second graphical representations each representing a separate second object in the group display area;resizing the group display area based upon a first user input, including reducing the size of the group display area upon receiving a user input;determining that at least one second graphical representation is located in a portion of the group display area that is visible before the size of the group display area is reduced and invisible after the size of the group display area is reduced, and that the first graphical representation is located in a portion of the group display area that is visible both before and after the size of the group display area is reduced;generating a stack item including a first stack element and one or more second stack elements, the first stack element representing the first object, each second stack element representing the second object;excluding the first graphical representation and the one or more second graphical representations from the resized group display area such that both the first graphical representation and the one or more second graphical representations are invisible; andproviding for display, in the resized group display area, the stack item in the original position of the first graphical representation, wherein a greater reduction in the size of the group display area during the resizing causes more second graphical representations to be excluded from display and more second graphical objects be represented in the stack item.
  • 15. The non-transitory computer-readable medium of claim 14, the operations comprising: prioritizing the first stack element and a second stack element based upon a prioritization of the first object and a second object.
  • 16. The non-transitory computer-readable medium of claim 14, the operations comprising: adjusting an aspect ratio associated with each of the first graphical representation and each second graphical representation based upon adjusting the group display area.
  • 17. The non-transitory computer-readable medium of claim 16, comprising determining that the first graphical representation is to be excluded based on one or more display criteria, wherein the one or more display criteria comprise a minimum aspect ratio associated with the first graphical representation and each second graphical representation.
  • 18. The non-transitory computer-readable medium of claim 17, wherein the one or more display criteria comprise a prioritization associated with the first object and each second object.
  • 19. The non-transitory computer-readable medium of claim 14, the operations comprising: associating the first graphical representation and each second graphical representation in response to a second user input.
  • 20. The non-transitory computer-readable medium of claim 14, the operations comprising: resizing the resized group display area into a second resized group display area;further determining, based upon one or more display criteria, that the first graphical representation and the first graphical representation are to be displayed in the second resized group display area;in response to the further determining, removing the stack item; anddisplaying the first representation and second representation in the second resized group display area.
  • 21. A system, comprising: one or more computers configured to perform operations comprising: providing for display, in a group display area, a first graphical representation of a first system object in an original position, the group display area having a size adjustable by a user;providing for display one or more second graphical representations each representing a separate second object in the group display area;resizing the group display area, including reducing the size of the group display area upon receiving a user input;determining that at least one second graphical representation is located in a portion of the group display area that is visible before the size of the group display area is reduced and invisible after the size of the group display area is reduced, and that the first graphical representation is located in a portion of the group display area that is visible both before and after the size of the group display area is reduced;generating a stack item including a first stack element and one or more second stack elements, the first stack element representing the first object, each second stack element representing a second object;excluding the first graphical representation and the second graphical representation from the resized group display area such that both the first graphical representation and the one or more second graphical representations are invisible; andproviding for display, in the resized group display area, the stack item in the original position of the first graphical representation, wherein a greater reduction in the size of the group display area during the resizing causes more second graphical representations to be excluded from display and more second graphical objects be represented in the stack item.
  • 22. The system of claim 21, the operations further comprising: prioritizing the first stack element and a second stack element based upon a prioritization of the first object and a second object.
  • 23. The system of claim 21, the operations further comprising: adjusting an aspect ratio associated with each of the first graphical representation and the second graphical representation based upon adjusting the group display area.
  • 24. The system of claim 21, the operations further comprising: adjusting a spacing between each of the first graphical representation and the second graphical representation based upon adjusting the group display area.
  • 25. The system of claim 21, the operations further comprising: receiving user input requesting association of the first graphical representation and the second graphical representation into a group; andassociating the first graphical representation and the second graphical representation into the group based upon the user input.
US Referenced Citations (184)
Number Name Date Kind
5317687 Torres May 1994 A
5339390 Robertson et al. Aug 1994 A
5452414 Rosendahl et al. Sep 1995 A
5461710 Bloomfield et al. Oct 1995 A
5515486 Amro et al. May 1996 A
5555354 Strasnick et al. Sep 1996 A
5565657 Merz Oct 1996 A
5657049 Ludolph et al. Aug 1997 A
5673377 Berkaloff Sep 1997 A
5678015 Goh Oct 1997 A
5736985 Lection et al. Apr 1998 A
5745109 Nakano et al. Apr 1998 A
5745715 Pickover et al. Apr 1998 A
5754809 Gandre May 1998 A
5767854 Anwar Jun 1998 A
5767855 Bardon et al. Jun 1998 A
5801699 Hocker et al. Sep 1998 A
5802466 Gallant et al. Sep 1998 A
5825361 Rubin et al. Oct 1998 A
5835094 Ermel et al. Nov 1998 A
5847707 Hayashida Dec 1998 A
5880733 Horvitz et al. Mar 1999 A
6002403 Sugiyama et al. Dec 1999 A
6005579 Sugiyama et al. Dec 1999 A
6016145 Horvitz et al. Jan 2000 A
6025827 Bullock et al. Feb 2000 A
6025839 Schell et al. Feb 2000 A
6043817 Bolnick et al. Mar 2000 A
6043818 Nakano et al. Mar 2000 A
6054989 Robertson et al. Apr 2000 A
6088032 Mackinlay Jul 2000 A
6122647 Horowitz et al. Sep 2000 A
6160553 Robertson et al. Dec 2000 A
6166738 Robertson et al. Dec 2000 A
6188405 Czerwinski et al. Feb 2001 B1
6229542 Miller May 2001 B1
6243093 Czerwinski et al. Jun 2001 B1
6243724 Mander et al. Jun 2001 B1
6262732 Coleman et al. Jul 2001 B1
6271842 Bardon et al. Aug 2001 B1
6275829 Angiulo et al. Aug 2001 B1
6281898 Nikolovska et al. Aug 2001 B1
6313855 Shuping et al. Nov 2001 B1
6363404 Dalal et al. Mar 2002 B1
6388181 Moe May 2002 B2
6414677 Robertson et al. Jul 2002 B1
6426761 Kanevsky et al. Jul 2002 B1
6469722 Kinoe et al. Oct 2002 B1
6480210 Martino et al. Nov 2002 B1
6542168 Negishi et al. Apr 2003 B2
6570597 Seki et al. May 2003 B1
6577304 Yablonski et al. Jun 2003 B1
6577330 Tsuda et al. Jun 2003 B1
6583798 Hoek et al. Jun 2003 B1
6590593 Robertson et al. Jul 2003 B1
6597358 Miller Jul 2003 B2
6727924 Anderson Apr 2004 B1
6734884 Berry et al. May 2004 B1
6765567 Roberson et al. Jul 2004 B1
6886138 Laffey et al. Apr 2005 B2
6922815 Rosen Jul 2005 B2
6938218 Rosen Aug 2005 B1
6983424 Dutta Jan 2006 B1
7028050 Rose Apr 2006 B1
7043701 Gordon May 2006 B2
7093199 Cragun et al. Aug 2006 B2
7107549 Deaton et al. Sep 2006 B2
7119819 Robertson et al. Oct 2006 B1
7134095 Smith et al. Nov 2006 B1
7137075 Hoshino et al. Nov 2006 B2
7146576 Chang et al. Dec 2006 B2
7148892 Robertson et al. Dec 2006 B2
7168051 Robinson et al. Jan 2007 B2
7178111 Glein et al. Feb 2007 B2
7216305 Jaeger May 2007 B1
7222309 Chupin et al. May 2007 B2
7249327 Nelson et al. Jul 2007 B2
7263667 Hoellerer et al. Aug 2007 B1
7266768 Ferlitsch et al. Sep 2007 B2
7292243 Burke Nov 2007 B1
7299418 Dieberger Nov 2007 B2
7299419 Evans Nov 2007 B2
7441201 Printezis Oct 2008 B1
7478326 Holecek et al. Jan 2009 B2
7480873 Kawahara Jan 2009 B2
7490314 Yuknewicz et al. Feb 2009 B2
7512902 Robertson et al. Mar 2009 B2
7523391 Eizenhoefer Apr 2009 B1
7536650 Robertson et al. May 2009 B1
7543245 Irimajiri Jun 2009 B2
7546538 Shuping et al. Jun 2009 B2
7562312 Rochford et al. Jul 2009 B2
7587681 Kake et al. Sep 2009 B2
7603652 Makowski et al. Oct 2009 B2
7665033 Byrne et al. Feb 2010 B2
7673241 Sun et al. Mar 2010 B2
7698658 Ohwa et al. Apr 2010 B2
7730425 de los Reyes et al. Jun 2010 B2
7792748 Ebersole et al. Sep 2010 B1
7991720 Mander et al. Aug 2011 B2
7996782 Hayles et al. Aug 2011 B2
8001472 Gilley et al. Aug 2011 B2
8095882 Kashi Jan 2012 B2
8136088 Makowski et al. Mar 2012 B2
8185220 Lloyd May 2012 B2
8250486 Lentz Aug 2012 B2
8381122 Louch et al. Feb 2013 B2
8473859 Chaudhri et al. Jun 2013 B2
20010028369 Gallo et al. Oct 2001 A1
20020010718 Miller Jan 2002 A1
20020033848 Sciammarella et al. Mar 2002 A1
20020080180 Mander et al. Jun 2002 A1
20020091739 Ferlitsch et al. Jul 2002 A1
20020113820 Robinson et al. Aug 2002 A1
20020135538 Rosen Sep 2002 A1
20020140746 Gargi Oct 2002 A1
20020167546 Kimbell et al. Nov 2002 A1
20030007017 Laffey et al. Jan 2003 A1
20030052927 Barksdale et al. Mar 2003 A1
20030088452 Kelly May 2003 A1
20030090510 Shuping et al. May 2003 A1
20030128242 Gordon Jul 2003 A1
20030142143 Brown et al. Jul 2003 A1
20030146927 Crow et al. Aug 2003 A1
20030160815 Muschetto Aug 2003 A1
20030169303 Islam et al. Sep 2003 A1
20030179234 Nelson et al. Sep 2003 A1
20030179237 Nelson et al. Sep 2003 A1
20030179240 Gest Sep 2003 A1
20030189602 Dalton et al. Oct 2003 A1
20030222902 Chupin et al. Dec 2003 A1
20040030741 Wolton et al. Feb 2004 A1
20040066411 Fung et al. Apr 2004 A1
20040066414 Czerwinski et al. Apr 2004 A1
20040090472 Risch et al. May 2004 A1
20040109025 Hullot et al. Jun 2004 A1
20040109031 Deaton et al. Jun 2004 A1
20040135820 Deaton et al. Jul 2004 A1
20040155909 Wagner Aug 2004 A1
20040179519 Basso et al. Sep 2004 A1
20040212640 Mann et al. Oct 2004 A1
20050010876 Robertson et al. Jan 2005 A1
20050022139 Gettman et al. Jan 2005 A1
20050066292 Harrington Mar 2005 A1
20050091596 Anthony et al. Apr 2005 A1
20050183009 Hannebauer et al. Aug 2005 A1
20050204306 Kawahara et al. Sep 2005 A1
20050240880 Banks et al. Oct 2005 A1
20050243373 Silverbrook et al. Nov 2005 A1
20050283742 Gusmorino et al. Dec 2005 A1
20060010379 Kashi Jan 2006 A1
20060015818 Chaudhri et al. Jan 2006 A1
20060107229 Matthews et al. May 2006 A1
20060136840 Keely et al. Jun 2006 A1
20060161861 Holecek et al. Jul 2006 A1
20060161868 Van Dok et al. Jul 2006 A1
20060174211 Hoellerer et al. Aug 2006 A1
20060212833 Gallagher et al. Sep 2006 A1
20060224986 Lindsay et al. Oct 2006 A1
20070011617 Akagawa et al. Jan 2007 A1
20070055947 Ostojic et al. Mar 2007 A1
20070124699 Michaels May 2007 A1
20070164989 Rochford et al. Jul 2007 A1
20070192727 Finley et al. Aug 2007 A1
20070214431 Amadio et al. Sep 2007 A1
20070214436 Myers Sep 2007 A1
20070226652 Kikuchi et al. Sep 2007 A1
20070261003 Reissmueller Nov 2007 A1
20080040678 Crump Feb 2008 A1
20080059893 Byrne et al. Mar 2008 A1
20080072252 Morris et al. Mar 2008 A1
20080126956 Kodosky et al. May 2008 A1
20080134086 Liao et al. Jun 2008 A1
20080220747 Ashkenazi et al. Sep 2008 A1
20080222295 Robinson et al. Sep 2008 A1
20080263463 Neumann Oct 2008 A1
20080270946 Risch et al. Oct 2008 A1
20080307330 Louch et al. Dec 2008 A1
20080307335 Chaudhri et al. Dec 2008 A1
20080307360 Chaudhri et al. Dec 2008 A1
20080307364 Chaudhri et al. Dec 2008 A1
20090031246 Cowtan et al. Jan 2009 A1
20090228827 Robertson et al. Sep 2009 A1
20090307623 Agarawala et al. Dec 2009 A1
Non-Patent Literature Citations (17)
Entry
Three-Dimensional Desktop—Google Search [on-line], [retrieved Nov. 9, 2006]. Retrieved from the Internet URL: http://www.google.com/search?sourceid=navclient&ie=U...LJ:2006-42,GGLJ:en&q=%22three+dimensional+desktop%22.
3DNA Desktop [online], [retrieved Nov. 9, 2006]. Retrieved from the Internet URL: http://www.3dna.net/products/desktop.htm.
Metisse—Screenshots [on-line], [retrieved Nov. 9, 2006]. Retrieved from the Internet URL: http://insitu.lri.fr/˜chapuis/metisse/screenshots.
Spatial Research [on-line], [retrieved Nov. 9, 2006]. Retrieved from the Internet URL: http://www.spatialresearch.com/spaces.
The TaskGallery [on-line], [retrieved Nov. 9, 2006]. Retrieved from the Internet URL: http://research.microsoft.com/ui/TaskGaller.
Rotate Widow, Java Technology Powers Vodafone Mobile Games Worldwide. Copyright 1994-2006 Sun Microsystems, Inc. [on-line], [retrieved Nov. 9, 2006], Retrieved from the Internet URL: http://www.sun.com/jsp—utils/ScreenShotPopup.jsp?title=R...ss/&im=md—1.jpg&alt=Generic%20Screen%20Shot%20Alt%20Text.
Switch Desktops, Copyright 1994-2006 Sun Microsystems, Inc. [on-line], [retrieved Nov. 9, 2006], Retrieved from the internet URL: http://www.sun.com/jsp—utils/ScreenShotPopup.jsp?title=Sw.../&im=pan-r—3.jpg&alt-Generic%20Screen%20Shot%20Alt%20Text11/9/2006.
Stanford Panorama, Copyright 1994-2006 Sun Microsystems, Inc. [on-line], [retrieved Nov. 9, 2006], Retrieved from the internet URL: http://www.sun.com/jsp—utils/ScreenShotPopup.jsp?title=St.../&im=pan—2.jpg&alt=Generic%20Screen%20Shot%20Alt%20Text11/9/2006.
Java Solaris Communities Partners My Sun Sun [on-line], [retrieved Nov. 9, 2006], Retrieved from the internet URL: http://www.sun.com/software/looking—glass/details.xml.
3D Desktop Project by Sun MicroSystems: A Revolutionary Evolution of Today's Desktop [online]. [retrieved Nov. 9, 2006], Retrieved from the internet URL: http://www.lg3d.dev.java.net.
Agarawala A. and Balakrishnan R. (2006). “Keepin' It Real: Pushing the Desktop Metaphor with Physics, Piles and the Pen”. [on-line], [retrieved May 14, 2008]. Retrieved from the internet URL: http://bumptop.com/BumpTop. Montréal, Québec, Canada.
BumpTop 3D Desktop Prototype—www.bumptop.com. (2008). [on-line], [retrieved May 14, 2008]. Retrieved from the internet URL: http://www.youtube.com/watch?v=M0ODskdEPnQ.
Hideya Kawahara and Paul Byme, Project Looking Glass Cool LG3D Apps and How to Write Them Powerpoint, 2005 JavaOne Conference Session 7992, 32 slides.
Dana Nourie and Hideya Kawahara, Project Looking Glass: Its Architecture and a Sneak Preview of the API, Nov. 2004.
Authorized Officer Marja Brouwers, Notification of Transmittal of the International Search Report and the Written Opinion, PCT/US2008/065324, mailed Oct. 14, 2008, 11 pages.
Authorized Officer Beate Giffo-Schmitt, Notification Concerning Transmittal of International Preliminary Report on Patentability, PCT/US2008/065324, mailed Dec. 23, 2009, 6 pages.
Schultz, Greg, “Windows Aero—Vista's Premium User Interface,” Nov. 30, 2006, 5 pages.
Related Publications (1)
Number Date Country
20080307303 A1 Dec 2008 US