Implementations are described that relate to information processing. Various particular implementations relate to providing information in a user interface.
User interfaces provide an indication of available documents and applications. However, user interfaces often do not provide useful information to a user beyond the indications of the available documents and applications. There is a continuing need for more helpful user interfaces.
According to a general aspect, item information is provided identifying an item. The item information allows the provision, on a user-interface, of an indication of the item. An application is determined that can be used to interact with the item. The application is determined based on a dynamic attribute of the item. Application information is provided identifying the application. The application information allows the provision of an indication of the application concurrently with provision of the indication of the item.
The details of one or more implementations are set forth in the accompanying drawings and the description below. Even if described in one particular manner, it should be clear that implementations may be configured or embodied in various manners. For example, an implementation may be performed as a method, or embodied as an apparatus, such as, for example, an apparatus configured to perform a set of operations or an apparatus storing instructions for performing a set of operations, or embodied in a signal. Other aspects and features will become apparent from the following detailed description considered in conjunction with the accompanying drawings and the claims.
The inventors have determined various manners in which user interfaces can be more helpful. One such manner is based on the inventors' recognition that it would be helpful to see a multi-application use history visually, or in a list view, from a top level such as an idle or a widget screen. A list view shows, in at least one implementation, a list of applications. A top level refers, for example, to a top level of a user interface, in which the top level is typically, or even always, visible and/or accessible to a user. A second such manner is based on the inventors' recognition that it would be helpful for a user to see which applications were used in relation to the user's tasks and activities. Various implementations are directed to these recognitions.
As a preview of some of the features presented in this application, a particular implementation allows a user to select a document icon being displayed on a computer screen. The implementation then automatically provides smaller icons of the last three applications that were used to open that document. The three smaller icons are provided under the document icon, in an ordered manner. A first small icon represents the most recently used application, and is positioned immediately under the document icon. A second small icon represents the next most recently used application, and is positioned immediately under the first small icon. A third small icon represents the third most recently used application, and is positioned immediately under the second small icon. Thus, the user is provided a visual display of the three most recently used applications that have been most recently used to open the document. The provision of the three smaller icons, in an ordered manner, provides the user valuable information about the use history of the document. Further, given the proliferation in types of documents and numbers of applications on a typical user computer system, the provision of use history information can be a valuable tool for a user.
Referring to
In various implementations, a system keeps track of all applications that are launched after an SMS application (for example, by opening a browser application after reading a text message), or of all applications that are launched from within the SMS application (for example, by opening a browser from within a text message by clicking on a hyperlink in the text message). Additional variations track the next several (for example, three to five) applications that are launched, and/or applications that are launched within a particular time limit or threshold. The SMS application is only an example of a base application from which to track serially tasked applications. Accordingly, serially tasked applications are tracked with respect to other applications as well.
Referring to
Prior to the point in time depicted in
A week later, the user wants to review the event information, but cannot remember exactly where she saw the event information. However, the user recalls receiving a message through the SMS application. To find the event information, using the SMS application, the user wants to use a serially-tasked-applications feature to determine the applications that were serially-tasked after the SMS application. At this point, we are at
The serially-tasked-applications feature is invoked using a user interface control, such as, for example, by long tapping the SMS icon 130 or using a button.
Referring to
Referring to
The screen 110 also includes a first bright arrow 360 extending from the browser icon 340 to the SMS icon 230, and a second bright arrow 370 extending from the email icon 350 to the SMS icon 230. The bright arrows 360 and 370 further indicate the associated applications were serially tasked after the SMS application.
After the point in time shown by
A number of options are available to provide a more enduring indication of the order of the serially tasked applications. In one implementation, there is a noticeable delay between snapping the browser icon 340 and snapping the email icon 350. In a second implementation, the snapped icons are positioned near the SMS icon 230 in order, such as, for example, by positioning the browser icon 340 closer than the email icon 350, with respect to the SMS icon 230.
Additionally, all icons in the screen 110 of
Referring to
In other implementations, the user may have separately opened the browser application, perhaps even exiting the SMS application first, rather than launching the browser application from within the SMS application. Additionally, the user may have separately opened the email application, perhaps even exiting the browser application, rather than launching the email application from within the browser application. In such implementations, the system tracks the serial-tasking history without regard to the manner in which subsequently used applications are launched.
Various implementations discussed above with respect to
Other implementations keep historical data for a specified period of time (for example, one week or one month). In such implementations, considering the example of
Referring to
Referring to
The social media site allows the user to see what her friends are watching, listening to, and sharing. The user wants to see what the friend 520 recommends. To do so, the user selects either the recommend button 530 or the recommend menu option 540.
Referring to
The distance from the friend 620 to the three different recommendation sections 652, 654, and 656 indicates degree. For example, in some implementations, the distance from the friend 620 indicates a degree of recommendation. Thus, the item in the first recommendation section 652 is recommended the most by the friend 620.
The first recommendation from the friend 620 is shown as a movie, and has a number in the first recommendation section 652 of 7. The recommendation is for a single movie, and the name of the movie can be obtained through various mechanisms, such as, for example, clicking or hovering. The number 7 indicates the degree of the recommendation (a higher number is a higher recommendation).
In a manner analogous to the first recommendation, it can be seen that the second recommendation from the friend 620 is shown as a song, and the song has a recommendation level of 3. Similarly, the third recommendation from the friend 620 is shown as a television (“TV”) show, and the TV show has a recommendation level of 2.
In other implementations, the first recommendation is for the category of “movies” and not for a specific movie, and the number 7 indicates the number of recommendations in the category. Hence, with 7 movie recommendations, the movie category would be the most highly recommended category. Similarly, the second recommendation is for the category of songs, with 3 songs being recommended. And finally, the third recommendation is for the category of TV shows, with 2 shows being recommended.
Referring to
Referring to
Other implementations allow, for example, a picture icon of a friend (in a social media application) to have media recommendations appear near the friend's icon when you select the friend. As above, the distance of the media recommendation from the friend's icon indicates how much the friend recommends the various media recommendations.
In most of the implementations discussed with respect to
Referring to
Referring to
Referring to
Three communication services are displayed in the screen 1000. These are indicated by (i) an SMS icon 1020, (ii) a TV icon 1030, and (iii) an email icon 1040. The three icons 1020, 1030, and 1040 are ordered, from left to right, under the selected contact 1010, in order of highest preference. Thus, the most preferred communication mechanism between the user and the selected contact 1010 is texting (indicated by the SMS icon 1020), followed by video sharing (indicated by the TV icon 1030), followed by email (indicated by the email icon 1040).
Other implementations provide additional communication options, such as, for example, telephone. Additionally, various implementations provide the rank-ordered communication options for a given contact in different manners, such as, for example:
Referring to
Referring to
Referring to
Referring to
As with several previous implementations, the more highly ranked restaurants are placed in a position that is closer to the users current location. Thus, restaurant choice “01” is the most highly ranked, and is placed closest to the user's current location.
Other implementations, display the restaurants options in a directional manner. That is, the restaurant recommendations are shown in the direction of the actual restaurant. However, the distance between the user's current location and the displayed restaurant recommendation is still reflective of the level of the ranking. Accordingly, if the user was walking to the north, the user may prefer to select a restaurant that is in a northerly direction. The user would be able to see, for example, and at a quick glance, the most highly ranked restaurant that is in a northerly direction.
Referring to
Various implementations relate to documents stored on a computer, for example. In certain of these implementations, various lists can be generated and the list, or corresponding icons, can be displayed for a given document. These lists include, for example:
Various implementations operate over networks, and not simply single computer systems. In one such implementation, a list is generated for a given stored object (for example, a movie, a word processing document) that indicates all of the locations on the network at which the object is stored. For example, in a home network, a user might select a particular CD, and upon selecting the CD or upon selecting the list feature (using, for example, a right-click of a mouse), a list would be accessed showing that the CD is stored on a laptop, a DVR, and two external hard drives. The list entries can also be rank-ordered according to, for example, the date of the copy of the CD, or the distance from the current networked device to the location of the copy of the CD. Upon selection of the object, the icons for the laptop, DVR, and two hard drives, can be displayed in a manner analogous, for example, to the icons 1020-1040 of
Referring to
The process 1500 includes providing an indication of an item (1510). The indication of the item is provided, in at least one implementation, on a user-interface. The indication of the item includes, for example, the visual display of (i) the SMS icon 130, 230, or 430, (ii) the friend 520 or 620, and/or (iii) the contact 910 or the selected contact 1010.
The process 1500 also includes providing an indication of an application that can be used to interact with the item, with the application having been determined according to a dynamic attribute of the item (1520). The indication of the application is provided, for example, on a device that may be different from, or the same as, the user-interface device used in the operation 1510. The indication of the application is provided, for example, concurrently with the provision of the indication of the item in the operation 1510.
Providing two indications concurrently means that the two indications are provided in at least an overlapping period of time. This allows a user, for example, to see both indications on a display simultaneously for at least a period of time. In one implementation, for example, a first indication is displayed from time t0 through time t3, and a second indication is displayed from a time t1 through time t4. Thus, both indications are displayed at the same time during the time t1 through time t3, in which time t1 through time t3 is an overlapping period of time. Therefore, both indications are said to be displayed concurrently.
An “application”, as used in this document is intended to distinguish from, for example, “data”. An application generally involves the use of software to perform a function. That software can be, for example, compiled code or interpreted code. An application can also refer to a specific application, such as, for example, a particular word processing application produced by a specific company. However, an application can also refer to a class of applications, such as, for example, an email application, an SMS application, or a word processing application.
An “item”, as used in this application is intended to be a broad term that includes, for example, applications as well as data. Examples of an “item” include an SMS application (see, for example,
A “user interface” or “user interface device”, as used in this application is intended to be a broad term that includes any device or component capable of providing at least one-way communication with a user in any form. User interfaces include, for example, a speaker, a display, a microphone, a keyboard, or a mouse.
The indication of the application includes, for example, the visual display of (i) the browser icon 340, which can be used to interact with the SMS icon 230, (ii) the email icon 350, which can be used to interact with the SMS icon 230, (iii) the SMS icon 1020, which can be used to interact with the selected contact 1010, and/or (iv) the email icon 1040, which can be used to interact with the selected contact 1010. In the implementations of
Many implementations described in this application are performed entirely, or primarily, on a single user-interface device. Such devices include, for example, a tablet, a cell phone, and/or a laptop. However, other implementations are distributed, with most of the processing and storage occurring on one or more devices that are separate from the user-interface device. In several such implementations, a networked computer system stores the applications and the documents, and provides information to a user-interface device that is used principally as a display and input device.
In one such implementation, a networked computer stores a word processing application and an associated icon, and a word processing document and an associated icon. The computer sends communication information, including the icons, to a remote user interface. This information allows the user interface to access the word processing application and document that are stored on the networked computer.
In this implementation, the networked computer maintains, for example, the use history of the word processing document. Accordingly, when a user requests use history information, the networked computer determines, based on this use history, that, for example, the word processing application is the most recent application to access the word processing document. The networked computer then sends information to the user interface allowing the user interface to provide a display in which, for example, the word processing icon is snapped to the word document icon.
Referring to
The process 1600 includes providing information allowing the provision of an indication of an item (1610). The indication of the item is provided, for example, on a user-interface device. The networked computer described just above provides, for example, information allowing the icon for the word processing document to be provided on the user interface. The user interface of this implementation receives the information and provides the icon on the display of the user interface.
The process 1600 also includes determining, based on a dynamic attribute of the item, an application that can be used to interact with the item (1620). The networked computer described just above determines, for example, that the word processing application can be used to interact with the word processing document. Further, the networked computer determines, based on the use history, that the word processing application satisfies the attribute of being the most recent application to access the word processing document. Because different applications can access the word processing document, being the most recent application to access to the word processing document is a dynamic attribute.
The process 1600 also includes providing information allowing the provision of an indication of the application (1630). The information of at least one implementation also identifies the application. Further, the information allows the indication of the application to be provided, in various implementations, (i) concurrently with the indication of the item (using the information provided in the operation 1610), and (ii) on the same, or a different, user-interface device as is used to provide the indication of the item (using the information provided in the operation 1610). The networked computer described just above provides, for example, information identifying the word processing application, and allowing the user interface to snap the word processing icon to the icon for the word processing document.
Additional implementations of the process 1600 are also provided throughout this application. For example, the tablet 100 (i) provides the information to its internal display controller to brighten the SMS icon 130 and thereby produce the SMS icon 230, (ii) determines that the browser icon 240 can be used to interact with the SMS icon 230, and is a serially-tasked application (a dynamic attribute) with the SMS icon 230, and accordingly (iii) provides information to brighten and snap the browser icon 240, resulting in the browser icon 340 and then the browser icon 440.
As another example, the device of
Referring to
The processor 1710 is, for example, any of the options for a processor described throughout this application. The processor 1710 can also be, or include, for example, the processing components inherent in the devices shown or described with respect to
The presentation device 1720 is, for example, any device suitable for providing any of the indications described throughout this application. Such devices include, for example, all user interface devices described throughout this application. Such devices also include, for example, the display components shown or described with respect to
Various implementations have been described that provide an indication of, for example, an item or an application. Such indications are typically sensory indications that provide an indication that is perceived by a user using one or more of the user's senses. For example, a sensory indication includes, in various implementations, a visual indication, an audible indication, or a vibratory indication.
Additionally, various presentation devices have been described. Such presentation devices are typically sensory presentation devices that present information in a sensory manner. For example, a sensory presentation device includes, in various implementations, a display for providing a visual presentation, or a speaker for providing an audible presentation.
Different implementations vary one or more of a number of features. Some of those features, and their variations, are described below:
This application provides multiple block and flow diagrams, including the flow diagrams of
We have thus provided a number of implementations. Various implementations snap application icons together to show related applications at a glance, based on various combinations of, for example, the following features: (i) visualized application task history, (ii) (use) hierarchy, (iii) content attributes, (iv) media inter-relationships, and/or (v) entity categorization. Additionally, various implementations relate to one or more of the following feature keywords: application use history, use sequence, visual user-interface history, use relations, task tracking, sensory memory user-interface, human visual sensor, and/or human visual sensory memory.
Further, various implementations can be described, in whole or part, as providing a magnetic user-interface, a sticky user-interface, or an auto-sticking feature. For example, the icons that are snapped to a given icon, or that are displayed in a defined hierarchical positioning with respect to the given icon (see, for example,
It should be noted, however, that variations of the described implementations, as well as additional applications, are contemplated and are considered to be within our disclosure. Additionally, features and aspects of described implementations may be adapted for other implementations.
Several of the implementations and features described in this application may be used in the context of the AVC Standard, and/or AVC with the MVC extension (Annex H), and/or AVC with the SVC extension (Annex G). AVC refers to the existing International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) Moving Picture Experts Group-4 (MPEG-4) Part 10 Advanced Video Coding (AVC) standard/International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 Recommendation (referred to in this application as the “H.264/MPEG-4 AVC Standard” or variations thereof, such as the “AVC standard”, the “H.264 standard”, or simply “AVC” or “H.264”). Additionally, these implementations and features may be used in the context of another standard (existing or future), or in a context that does not involve a standard.
Reference to “one embodiment” or “an embodiment” or “one implementation” or “an implementation” of the present principles, as well as other variations thereof, mean that a particular feature, structure, characteristic, and so forth described in connection with the embodiment is included in at least one embodiment of the present principles. Thus, the appearances of the phrase “in one embodiment” or “in an embodiment” or “in one implementation” or “in an implementation”, as well any other variations, appearing in various places throughout the specification are not necessarily all referring to the same embodiment.
Additionally, this application or its claims may refer to “determining” various pieces of information. Determining the information may include one or more of, for example, estimating the information, calculating the information, predicting the information, or retrieving the information from memory.
Further, this application or its claims may refer to “accessing” various pieces of information. Accessing the information may include one or more of, for example, receiving the information, retrieving the information (for example, memory), storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, predicting the information, or estimating the information.
It is to be appreciated that the use of any of the following “/”, “and/or”, and “at least one of”, for example, in the cases of “NB”, “A and/or B” and “at least one of A and B”, is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of “A, B, and/or C” and “at least one of A, B, and C” and “at least one of A, B, or C”, such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as readily apparent by one of ordinary skill in this and related arts, for as many items listed.
Additionally, many implementations may be implemented in a processor, such as, for example, a post-processor or a pre-processor. The processors discussed in this application do, in various implementations, include multiple processors (sub-processors) that are collectively configured to perform, for example, a process, a function, or an operation. For example, the processor 1710 is, in various implementations, composed of multiple sub-processors that are collectively configured to perform the operations of the processor 1710. Further, other implementations are contemplated by this disclosure.
The implementations described herein may be implemented in, for example, a method or a process, an apparatus, a software program, a data stream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed may also be implemented in other forms (for example, an apparatus or program). An apparatus may be implemented in, for example, appropriate hardware, software, and firmware. The methods may be implemented in, for example, an apparatus such as, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, computers, cell phones, tablets, portable/personal digital assistants (“PDAs”), and other devices that facilitate communication of information between end-users.
Implementations of the various processes and features described herein may be embodied in a variety of different equipment or applications. Examples of such equipment include an encoder, a decoder, a post-processor, a pre-processor, a video coder, a video decoder, a video codec, a web server, a set-top box, a router, a laptop, a personal computer, a tablet, a cell phone, a PDA, and other communication devices. As should be clear, the equipment may be mobile and even installed in a mobile vehicle.
Additionally, the methods may be implemented by instructions being performed by a processor, and such instructions (and/or data values produced by an implementation) may be stored on a processor-readable medium such as, for example, an integrated circuit, a software carrier or other storage device such as, for example, a hard disk, a compact diskette (“CD”), an optical disc (such as, for example, a DVD, often referred to as a digital versatile disc or a digital video disc), a random access memory (“RAM”), or a read-only memory (“ROM”). The instructions may form an application program tangibly embodied on a processor-readable medium. Instructions may be, for example, in hardware, firmware, software, or a combination. Instructions may be found in, for example, an operating system, a separate application, or a combination of the two. A processor may be characterized, therefore, as, for example, both a device configured to carry out a process and a device that includes a processor-readable medium (such as a storage device) having instructions for carrying out a process. Further, a processor-readable medium may store, in addition to or in lieu of instructions, data values produced by an implementation.
As will be evident to one of skill in the art, implementations may produce a variety of signals formatted to carry information that may be, for example, stored or transmitted. The information may include, for example, instructions for performing a method, or data produced by one of the described implementations. For example, a signal may be formatted to carry as data the rules for writing or reading syntax, or to carry as data the actual syntax-values generated using the syntax rules. Such a signal may be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information that the signal carries may be, for example, analog or digital information. The signal may be transmitted over a variety of different wired or wireless links, as is known. The signal may be stored on a processor-readable medium.
A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, elements of different implementations may be combined, supplemented, modified, or removed to produce other implementations. Additionally, one of ordinary skill will understand that other structures and processes may be substituted for those disclosed and the resulting implementations will perform at least substantially the same function(s), in at least substantially the same way(s), to achieve at least substantially the same result(s) as the implementations disclosed. Accordingly, these and other implementations are contemplated by this application.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US12/67581 | 12/3/2012 | WO | 00 |