Linked widgets

Abstract

Systems, methods, computer-readable mediums, user interfaces and other implementations are disclosed for manually or automatically linking widgets. The automatic linking of widgets includes detecting a trigger event associated with a first widget, and providing access to a second widget in response to the trigger event. The trigger event can be the downloading, previewing, installation, launching, updating, operating or any other interaction with one or more widgets. The trigger event can also be the exercise of a function or feature of a widget. In some implementations, a communication path or channel is established between widgets for sharing information. In other implementations, linked widgets are provided access to shared information. A widget link manager can be used to manually establish links between widgets and to designate shared information, restrictions, etc.

Description

RELATED APPLICATIONS

This application is related to the following jointly owned and patent applications, each incorporated herein by reference in its entirety:

• • U.S. Provisional Patent Application No. 60/583,125, for “Procedurally Expressing Graphic Objects for Web Pages,” filed Jun. 25, 2004;
  • U.S. patent application Ser. No. 10/874,829, for “User Interface for Assisting in the Installation of an Asset,” filed Jun. 22, 2004;
  • U.S. patent application Ser. No. 10/877,968, for “Unified Interest Layer For User Interface,” filed Jun. 25, 2004;
  • U.S. patent application Ser. No. 11/148,010, for “Preview and Installation of User Interface Elements in a Display Environment,” filed Jun. 7, 2005;
  • U.S. Provisional Patent Application No. 60/734,016, for “Preview Including Theme Based Installation of User Interface Elements In A Display Environment,” filed Nov. 4, 2005, which provisional patent application is incorporated herein by reference in its entirety;
  • U.S. Provisional Patent Application No. 60/730,956, for “Widget Security,” filed Oct. 27, 2005, which provisional application is incorporated herein by reference in its entirety;
  • U.S. patent application Ser. No. 11/282,110, for “Preview Including Theme Based Installation of User Interface Elements In A Display Environment,” filed Nov. 16, 2005;
  • U.S. Provisional Patent Application No. 60/737,899, for “Management of User Interface Elements In A Display Environment,” filed Nov. 18, 2005; and
  • U.S. patent application Ser. No. 11/346,603, for “Multiple Dashboards,” filed Feb. 1, 2006.

TECHNICAL FIELD

The disclosed implementations relate generally to graphical user interfaces.

BACKGROUND

A hallmark of modern graphical user interfaces is that they allow a large number of graphical objects or items to be displayed on a display screen at the same time. Leading personal computer operating systems, such as Apple Mac OS®, provide user interfaces in which a number of windows can be displayed, overlapped, resized, moved, configured, and reformatted according to the needs of the user or application. Taskbars, menus, virtual buttons and other user interface elements provide mechanisms for accessing and activating windows even when they are hidden behind other windows.

Although users appreciate interfaces that can present information on a screen via multiple windows, the result can be overwhelming. For example, users may find it difficult to navigate to a particular user interface element or to locate a desired element among a large number of onscreen elements. The problem is further compounded when user interfaces allow users to position elements in a desired arrangement, including overlapping, minimizing, maximizing, and the like. Although such flexibility may be useful to the user, it can result in a cluttered display screen. Having too many elements displayed on the screen can lead to “information overload,” thus inhibiting the user to efficiently use the computer equipment.

Many of the deficiencies of conventional user interfaces can be reduced using “widgets.” Generally, widgets are user interface elements that include information and one or more tools (e.g., applications) that let the user perform common tasks and provide fast access to information. Widgets can perform a variety of tasks, including without limitation, communicating with a remote server to provide information to the user (e.g., weather report), providing commonly needed functionality (e.g., a calculator), or acting as an information repository (e.g., a notebook). Widgets can be displayed and accessed through a user interface, such as a “dashboard layer,” which is also referred to as a “dashboard.” Widgets and dashboards are described in co-pending U.S. patent application Ser. No. 10/877,968, entitled “Unified Interest Layer For User Interface.”

Due to the large number of widgets available to a user, a virtual desktop or dashboard can become cluttered and disorganized, making it difficult for the user to quickly locate and access a widget. Moreover, the user may have to invoke multiple widgets to perform a single task, which can lead to an inefficient use of widget resources. In some cases, the user may not readily recognize the relationship between two widgets, which leads to additional inefficiencies when using widgets.

SUMMARY

Systems, methods, computer-readable mediums, user interfaces and other implementations are disclosed for linking widgets by detecting a trigger event associated with a first widget, and providing access to a second widget in response to the trigger event. The trigger event can be the downloading, previewing, installation and/or launching of a widget. The trigger event can also be the exercise of a function or feature of a widget. In some implementations, a communication path or channel is established between widgets for sharing information. In other implementations, linked widgets are provided access to shared information. A widget link manager can be used to establish links between widgets and to designate shared information, restrictions, etc.

In some implementations, a method of linking widgets includes: providing a first widget; providing a second widget; and linking the first and second widgets.

In some implementations, a method of linking widgets includes detecting a trigger event associated with a first widget, and providing access to a second widget in response to the trigger event.

In some implementations, a method of linking widgets includes: interacting with a first widget; generating a first output from the first widget in response to the interaction; interacting with a second widget linked to the first widget; and generating a second output from the second widget based at least in part on the first output from the first widget.

In some implementations, a method of linking widgets includes: generating a list of link information for a plurality of widgets; selecting a widget for linking; determining a set of widgets available for linking with the selected widget based on the link information; and linking the selected widget with at least one widget in the set of widgets.

In some implementations, a widget linking system includes a widget link manager for establishing an available link between a first widget and a second widget, and a widget linker for linking the first widget with the second widget.

In some implementations, a method of linking widgets includes: selecting a first widget; determining a first set of information that can be shared by the first widget; selecting a second widget; determining a second set of information that can be shared by the second widget; linking the first and second widgets; and establishing communication between the first and second widgets for sharing the first and second sets of information.

Other implementations are disclosed which are directed to systems, methods, computer-readable mediums and user interfaces.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a hardware architecture for implementing dashboards.

FIG. 2 is a flow diagram of a process for activating and using a dashboard.

FIG. 3 is a block diagram of a software architecture for implementing dashboards.

FIG. 4A is a screen shot depicting a desktop user interface prior to activation of a dashboard.

FIG. 4B is a screen shot depicting an initial state for a dashboard.

FIG. 4C is a screen shot depicting a configuration bar for a dashboard.

FIG. 4D is a screen shot depicting user selection of a widget from the configuration bar.

FIG. 5A is a screen shot depicting an implementation of linked widgets.

FIG. 5B illustrates the exchange of information between linked widgets.

FIG. 6 is a flow diagram of an exemplary automatic widget linking process.

FIG. 7 is a block diagram of an implementation of a software architecture for linked widgets.

FIG. 8 is a flow diagram of an implementation of a manual widget linking process.

FIG. 9A is a screen shot depicting the manual linking of widgets using an exemplary widget link manager.

FIG. 9B is a screen shot depicting the manual linking of widgets using bridging elements.

DETAILED DESCRIPTION

Hardware Architecture

FIG. 1 is a block diagram of a hardware architecture 100 for implementing linked widgets. The architecture 100 includes a personal computer 102 coupled to a remote server 107 via a network interface 116 and a network connection 108 (e.g., local area network, wireless network, Internet, intranet, etc.). The computer 102 generally includes a processor 103, memory 105, one or more input devices 114 (e.g., keyboard, mouse, etc.) and one or more output devices 115 (e.g., a display device). A user interacts with the architecture 100 via the input and output devices 114, 115.

The computer 102 also includes a local storage device 106 and a graphics module 113 (e.g., graphics card) for storing information and generating graphical objects, respectively. The local storage device 106 can be a computer-readable medium. The term “computer-readable medium” refers to any medium that participates in providing instructions to a processor for execution, including without limitation, non-volatile media (e.g., optical or magnetic disks), volatile media (e.g., memory) and transmission media. Transmission media includes, without limitation, coaxial cables, copper wire, fiber optics, and computer buses. Transmission media can also take the form of acoustic, light or radio frequency waves.

While linked widgets are described herein with respect to a personal computer 102, it should be apparent that the disclosed implementations can be incorporated in, or integrated with, any electronic device that is capable of using widgets, including without limitation, portable and desktop computers, servers, electronics, media players, game devices, mobile phones, email devices, personal digital assistants (PDAs), televisions, etc.

A dashboard system and method for managing and displaying dashboards and linked widgets can be implemented as one or more plug-ins that are installed and run on the personal computer 102. The plug-ins can be configured to interact with an operating system (e.g., MAC OS® X, WINDOWS XP, LINUX, etc.) and to perform the various dashboard and widget functions, as described with respect of FIGS. 2-8. The dashboard system and method can also be implemented as one or more software applications running on a computer system (e.g., computer 102). In some implementations, a dashboard system can be another widget that is configurable to communicate with other widgets, applications and/or operating systems. The dashboard system and method can also be characterized as a framework or model that can be implemented on various platforms and/or networks (e.g., client/server networks, stand-alone computers, portable electronic devices, mobile phones, etc.), and/or embedded or bundled with one or more software applications (e.g., email, media player, browser, etc.).

For illustrative purposes, widgets (including linked widgets) are described as a feature of an operating system. Linked widgets, however, can be implemented in other contexts as well, including e-mail environments, desktop environments, application environments, hand-held display environments, and any other display environments.

Dashboard Overview

FIG. 2 is a flow diagram of an implementation of a process for activating and using one or more dashboard layers. A dashboard layer (also referred to herein as a “unified interest layer” or “dashboard”) is used to manage and display widgets (including linked widgets). A user can invoke a dashboard (202) by hitting a designated function key or key combination, or by clicking on an icon, or by selecting a command from an onscreen menu, or by moving an onscreen cursor to a designated corner of the screen. Alternatively, a dashboard layer can be invoked programmatically by another system, such as an application or an operating system, etc.

In response to such invocation, the current state of the user interface is saved (203), the user interface is temporarily inactivated (204), an animation or effect is played or presented to introduce the dashboard (205) and the dashboard is displayed with one or more widgets (206). If applicable, a previous state of the dashboard is retrieved, so that the dashboard can be displayed in its previous configuration.

In some implementations, the dashboard is overlaid on an existing user interface (UI) (e.g., a desktop UI). When the dashboard is activated, the existing UI may be faded, darkened, brightened, blurred, distorted, or otherwise altered to emphasize that it is temporarily inactivated. The existing UI may or may not be visible behind the dashboard. The UI can also be shrunk to a small portion of the display screen while the dashboard is active, and can be re-activated by clicking on it. In some implementations, the UI is shrunk and presented as a widget. The UI can be re-activated by clicking on the widget. In some implementations the UI remains active when the dashboard is active.

The user interacts with and/or configures widgets as desired (207). In some implementations, the user can move widgets around the screen, and can resize widgets if applicable. Some widgets are resizable and some have a fixed size. A widget author can specify whether a widget can be resized. Some widgets automatically resize themselves based on the amount or nature of the data being displayed. Widgets can overlap and or repel one another. For example, if the user attempts to move one widget to a screen position occupied by another widget, one of the widgets is automatically moved out of the way or repelled by the other widget. In some implementations, a user can link widgets together using a widget link manager, as described with respect to FIG. 8.

In some implementations, the user dismisses the dashboard (208) by invoking a dismissal command, which causes the UI layer to return or re-present itself to the display screen. In some implementations, the dashboard is dismissed when the user presses a function key or key combination (which may be the same or different than the key or combination used to activate the dashboard), or clicks on a close box or other icon, or clicks on negative space within the dashboard (e.g., a space between widgets), or moves an onscreen cursor to a predefined corner of the screen. Other dismissal methods are possible.

In some implementations, the dashboard is automatically dismissed (i.e., without user input) after some predetermined period of time or in response to a trigger event. An animation or other effect can be played or presented to provide a transition as the dashboard is dismissed (209). When the dashboard is dismissed, the current configuration or state of the widgets (e.g., position, size, etc.) is stored, so that it can be retrieved the next time the dashboard is activated. In some implementations, an animation or effect is played or presented when re-introducing the UI. The UI is restored to its previous state (210) so that the user can resume interaction with software applications and/or the operating system.

In some implementations, the dashboard is configurable. The user can select a number of widgets to be displayed, for example, by dragging the widgets from a configuration bar (or other user interface element) onto the dashboard. The configuration bar can include different types of widgets, and can be categorized and/or hierarchically organized. In some implementations, in response to the user dragging a widget onto the configuration bar, the widget is downloaded from a server and automatically installed (if not previously installed). In some implementations, certain widgets can be purchased, so the user is requested to provide a credit card number or some other form of payment before the widget is installed on the user's device. In some implementations, widgets are already installed on the user's device, but are only made visible when they have been dragged from the configuration bar onto the dashboard. The configuration bar is merely an example of one type of UI element for configuring the dashboard. Other configuration mechanisms can be used, such as an icon tray or menu system.

It should be apparent that there are many ways in which dashboards and widgets can be displayed other than those implementations described herein. For example, widgets can be displayed on any user interface or user interface element, including but not limited to desktops, browser or application windows, menu systems, trays, multi-touch sensitive displays and other widgets.

Software Architecture

FIG. 3 is a block diagram of a software architecture 300 for implementing dashboards for installing, displaying and launching linked widgets. The software architecture 300 generally includes a dashboard server 301, one or more dashboard clients 302, one or more widgets 303 and an operating system 305. The server 301 and/or clients 302 use dashboard configuration information 304 to specify configuration options for displaying the widgets 303, including access levels, linking information and the like (if applicable). Such configuration information can include information for two or more dashboards configured by the same user or by different users.

In some implementations, the widgets 303 are displayed using HTML and related web technology. The dashboard server 301 manages and launches the dashboard client 302 processes. Each dashboard client 302 loads a widget 303 (e.g., an HTML webpage) and related resources needed to display the page. In some implementations, the dashboard clients 302 display the widgets 303 without a conventional window frame, menu bar, or other components typically associated with on-screen windows. This technique provides a clean, straightforward display of the overall dashboard to reduce confusion and clutter. The dashboard clients 302 display their respective widgets 303 by rendering web pages into a “WebView,” as described in U.S. patent application Ser. No. 11/148,010, entitled “Preview and Installation of User Interface Elements in a Display Environment.” The size of each WebView can be defined as metadata associated with the corresponding widget 303. The server 301 provides data for rendering the dashboard layer that can be overlaid on a desktop user interface. In some implementations, the widgets 303 are rendered into the dashboard layer, which is drawn on top of the desktop user interface, so as to partially or completely obscure the desktop user interface while the dashboard layer is active.

Dashboard Server

The dashboard server 301 (also referred to as “server”) can be a stand-alone process or embedded in another process. The server 301 can be located at the computer 102 or at the remote server 107. In some implementations, the server 301 provides functionality for one or more processes, including but not limited to: non-widget UI management, window management, fast login, event management, loading widgets, widget arbitration, Core Image integration and widget preference management, as described in U.S. patent application Ser. No. 11/148,010, entitled “Preview and Installation of User Interface Elements in a Display Environment.”

Dashboard Client

In some implementations, a dashboard client 302 is a process that uses, for example, objects that are defined as part of a development environment, such as Apple Computer's Cocoa Application Framework (also referred to as the Application Kit, or AppKit) for the Mac OS® operating system. In some implementations, the dashboard clients 302 can be implemented as simplified browser screens that omit conventional interface features such as a menu bar, window frame, and the like.

Widget Format

In one implementation, each widget 303 is implemented as an HTML file. The HTML file can reference other local and remote resources such as style sheets (e.g., Cascading Style Sheets), other HTML files, JavaScript files, images, and the like. Widgets 303 can be implemented using, for example, a flat bundle file format or a packaged HTML file format. In some implementations, the Flat Bundle format includes an info.plist file.

The Info.plist files describes a widget 303 and provides an identifier for a widget 303. Table I provides an example of Info.plist file contents.

TABLE I
Example of Info.plist File Contents
Key	Type	Description/Value
CFBundleIdentifier	CFString	com.apple.widget
		<widget name>
CFBundleName	CFString	Name of the widget.
MainHTML	CFString	Name of main
		HTML resource.
Width	CFNumber	Default width of the
		widget.
Height	CFNumber	Default height of the
		widget.
DefaultImage	CFString	Resource name of
		default PNG file.
Plugin (optional)	CFString	Resource name of
		native plug-in.
AllowFileAccessOutsideofWidget	Boolean	Access to files across
		the file system;
		limited by the users
		permissions.
AllowFullAccess	Boolean	Access to the file
		system, Web Kit and
		standard browser
		plug-ins, Java
		applets, network
		resources, and
		command-line
		utilities.
AllowInternetPlugins	Boolean	Access to Web Kit
		and standard
		browser plug-ins.
AllowJava	Boolean	Access to Java
		applets.
AllowNetworkAccess	Boolean	Access to any
		resources that are
		not file based.
AllowSystem	Boolean	Access to command-
		line utilities using
		widget script object.
WidgetLinkInfo	CFString1 . . . CFStringN	Names of widgets
		that can be linked

The keys AllowFileAccessOutsideofWidget, AllowFullAccess AllowInternetPlugins, AllowJava, AllowNetworkAccess, and AllowSystem are Boolean types that can be set by a widget author to enable certain levels of resource access.

In some implementations, the Info.plist file includes N WidgetLinkInfo strings, for storing the names of widgets that can be linked to the widget associated with the Info.plist file. This information can be used to automatically link widgets, as described with respect to FIGS. 5-8. Note that the additional widget link information can be included in the Info.plist file and/or one or more other files bundled with the widget, depending upon the widget design.

Dashboard Invocation

FIG. 4A depicts a desktop user interface 400 prior to activation of a dashboard. The desktop user interface 400 (also referred to herein as “desktop”) is a conventional user interface as may be provided by an operating system, such as Mac OS®. The desktop 400 has a background image, menu bar 401, and other standard features. As is known in the art, the desktop 400 may also include windows, icons, and other elements (not shown). The user activates the dashboard by selecting an item from a menu, or by clicking on an icon, or by pressing a function key or key combination, or by some other means for invoking activation. A dashboard does not have to be activated on a desktop; rather the dashboard can be activated and displayed on any display screen with or without a desktop.

FIG. 4B depicts an initial state for a dashboard layer 402. In some implementations, a configuration bar icon 403 is initially displayed. Alternatively, upon activation the dashboard layer 402 can display one or more default widgets 405, 407. If the dashboard layer 402 has previously been activated and configured, the widgets 405, 407, can be displayed as previously configured. The dashboard layer 402 is not necessarily visible as a distinct layer. However, its various components (such as widgets, icons, and other features) are visible. In some implementations, these components are displayed in a transparent layer, thus maintaining the visibility of the desktop 400 to the user. In some implementations, the desktop 400 and its components are darkened (or blurred, or otherwise visually modified) while the dashboard layer 402 is active, so as to emphasize that the desktop 400 is temporarily inactive. In other implementations, the desktop 400 is not visible while the dashboard layer 402 is active. The user can reactivate the desktop 400 and dismiss the dashboard layer 402 by, for example, selecting on an area of the screen where no dashboard element is displayed (i.e., “negative space”). In some implementations, other commands, key combinations, icons, or other user input can be used to dismiss the dashboard layer 402.

In some implementations, the user can drag the icon 403 to any location on the screen, and the position of the icon 403 will remain persistent from one invocation of the dashboard layer 402 to the next. The user can click on the icon 403 to activate the configuration bar 408, as shown in FIG. 4C. The configuration bar 408 provides access to various widgets that can be placed on the dashboard. In some implementations, a text label is shown for each available widget (e.g., calculator, stocks, iTunes®, etc.). In some implementations, an icon is shown for each available widget (e.g., calculator icon 410). If many widgets are available, the widgets may be arranged hierarchically by type (e.g., game widgets, utility widgets, etc.), or alphabetically, or by any other categorization methodology. For example, a number of categories may be displayed, and clicking on one of the categories causes a pull-down menu to be displayed, listing a number of widgets in that category. In some implementations, a buy widget 406 is also available, allowing the user to select widgets from an online store or website.

Note that the particular configuration and appearance of configuration bar 408 in FIG. 4C is merely exemplary, and that many other arrangements are possible. For example, widgets can be installed from other locations, other applications or other environments, without requiring that they first be part of the configuration bar 408. The user can dismiss the configuration bar 408 by clicking on dismissal button or icon 404. The configuration bar can include a user interface element 412 for scrolling.

Installation of Elements

Elements, including user interface elements such as widgets can be installed in a display environment as discussed below. One display environment, a dashboard, will be used for illustrative purposes. Installation can include a preview operation as is discussed below. Installation can include selection of the element, such as by a drag and drop action. Other selection means can be used. In one example, a user can drag widgets from configuration bar 408 onto the surface of the dashboard (in other words, anywhere on the screen), using standard drag-and-drop functionality for moving objects on a screen.

FIG. 4D depicts the selection of the calculator widget icon 410 from the configuration bar 408. The calculator icon 410 which is associated with a calculator widget 409 is highlighted, or otherwise augmented or embellished, to indicate that it has been selected by a user with cursor 411.

In some implementations, widgets in the configuration bar 408 are smaller than their actual size when installed. When the user clicks on a widget and begins to drag it into a dashboard or other display environment, the widget can be animated to its actual or installed size to assist the user in the real-time layout of the dashboard. By animating the widget to its actual size, the user will know the actual size of the widget prior to its installation.

In some implementations, an animation, such as a ripple animation, is shown when the user “drops” a widget by releasing a mouse button (or equivalent input device) to place a widget at the desired location. In one implementation, the dragging of the widget to the dashboard layer 402 invokes an installation process for installing the widget including previewing. After installation, the user can move a widget, to any other desired location, or can remove the widget from the screen, for example by dragging it off the screen, or dragging it back onto the configuration bar 408, by invoking a remove command, disabling a widget in a menu associated with a widget manager or canceling the installation during the preview. In some implementations, the position, state, and configuration of a widget are preserved when the dashboard layer 402 is dismissed, so that these characteristics are restored the next time the dashboard layer 402 is activated.

In some implementations, widgets and/or dashboard layers (including widgets) can be installed from within a running application. For example, a widget and/or dashboard (including widgets) can be an attachment to an email. When the user clicks the attachment, an installation process is invoked for the widget and/or dashboard which can also include a preview.

Widgets can be created or instantiated using an installer process. The installer process can include a separate user interface or an integrated user interface (e.g., integrated in the display environment or separate from the display environment, for example, in another display environment associated with another application, such as an email application) for selecting and installing widgets in a display environment. For example, a widget received as an email attachment can be launched by a user from directly within a user interface of the email application.

Widgets can be created or instantiated using an installer process. The installer process can include a separate user interface or an integrated user interface (e.g., integrated in the display environment or separate from the display environment for example in another display environment associated with another application, such as an email application) for selecting and installing widgets in a display environment. Thus, the installation area for the widget can be embedded within an application display area or window. For example, if a user receives a widget as an attachment to an email, the user can invoke and install the widget from within the email message window without the need for a separate installation window.

In general, an installer process is used to provide additional functionality to the creation/instantiation process, beyond the simple drag and drop operation describe above. Additional functionality can include preview, linking, security and deletion functionality in a singular interface. The installer process can be a separate process or combined in another process. The installer process can itself be a separate application that is executable to install widgets (or other elements) in a display environment. As used herein, the term “process” refers to a combination of functions that can be implemented in hardware, software, firmware or the like.

The use of nested display areas associated with different dashboard environments enables users to organize dashboards into hierarchies. For example, a dashboard environment including widgets for use with operating system utilities can include nested display areas for displaying widgets associated with particular types of utilities (e.g., date and time, memory management, network resource management, etc.)

Linked Widgets

FIG. 5A is a screen shot depicting an implementation of linked widgets. Linked widgets can be displayed in any display environment, such as a dashboard layer 506 overlaid on a desktop user interface 504. In some implementations, the user interface 504 can be a conventional UI provided by an operating system, such as the Mac OS® or Windows® operating systems.

In some implementations, the user interface 504 includes a background image, a menu bar 502, and other UI common features (e.g., windows, icons, etc.). The user can activate the dashboard layer 506 by selecting an item from the menu bar 502, or by clicking an icon, or by pressing a function key or key combination, or by some other means for invoking activation. In some implementations, a configuration bar 503 is displayed, which includes one or more widget icons and a widget link manager icon 514. The configuration bar 503 can be scrolled from left to right to reveal more widget icons. A user can install a widget by dragging its associated widget icon from the configuration bar 503 and dropping it in the dashboard layer 506, or by using other installation techniques, as described with respect to FIG. 4D.

Automatic Widget Linking

In some implementations, two or more widgets are automatically linked in response to a trigger event. A trigger event can be generated by downloading, installing, previewing, launching, manipulating, updating, operating or otherwise interacting with a widget. A trigger event can also be generated by exercising the functionality of a widget.

Widgets can be automatically or manually linked together based on any suitable criteria or no criteria. For example, widgets can be linked based on the type of data or information the widgets use or share (e.g., time, date, place, etc.), the origin of the widgets (e.g., received from friends, downloaded from a common website, etc.) and the time when the widgets were downloaded (e.g., widgets downloaded at the same time of day). Widgets can be linked based on their membership in a widget class (e.g., financial widgets, stock market widgets, etc.). Widgets can also be linked based on their participation in a process or workflow (e.g., a stock market widget providing data to a 3D graph widget).

The concept of linked widgets can be illustrated by the following example involving a search widget 508, a map widget 510 and a weather widget 512. When the user installs the search widget 508 in the dashboard layer 506, a trigger event is generated which causes the map widget 510 and the weather widget 512 to be automatically linked to the search widget 508 and displayed in the dashboard layer 506. A user enters a search query in a search box of the search widget 508 to determine the location of a favorite restaurant. The search widget 508 returns location information (e.g., address, coordinates, etc.) for the restaurant, which is shared with the map widget 510 and the weather widget 512. The map widget 510 uses the address to generate a map and driving directions. The weather widget 512 uses the address to determine the current weather for the location of the restaurant. If the map and weather widgets 510, 512, are already installed and launched in the dashboard layer 506 when the search widget 508 is installed, then the links are established directly without re-installing and launching the widgets 510, 512. If the widgets 510, 512, are not installed, then the widgets 510, 512 are installed and launched before or after being linked. If the widgets 510, 512 are not available on the computer system 102, a message is displayed instructing the user on how to obtain the widgets 510, 512 from another source. For example, the message can include a link to a website where the widgets 510, 512 can be downloaded to the computer system 102.

Generally, any two widgets can be linked and share information. The amount and type of information shared is dependant on the widgets that are linked. For example, the widgets 508, 510 and 512 could share location information (e.g., address, latitude, longitude, etc.).

The widgets 508, 510 and 512 are examples of widgets that can be linked based on the type of information the widgets use and share (i.e., location information). Other examples of widgets that can be linked include but are not limited to: a calendar widget that can be linked to a scheduling widget; a dictionary widget that can be linked to a word processing widget; a telephone directory widget that can be linked to dial-up widget; a stock widget that can be linked to a graph widget for presenting stock information in different types of graphs (e.g., pie graph, bar graph, etc.); an image processing/editing widget that can be linked to a picture frame widget for viewing a digital image; and a media player widget that can be linked to a ticket vending widget (e.g., a Ticketmaster™ widget) for providing a touring schedule and a mechanism for purchasing concert tickets to see an artist whose song is currently playing in the media player widget.

In some implementations, widgets can be linked to one or more non-widget applications and can interact with and receive data from those applications. A non-widget application can also provide a bridge between two or more widgets. For example, when an application is invoked (e.g., a word processor) can search for widgets that can support the application or specific feature of the application (e.g., dictionary or thesaurus widgets). The widgets can communicate directly with each other and/or indirectly through the application.

In some implementations, links are established between widgets only if one or more conditions, events or triggers are satisfied. For example, a link may only be established upon completion of one or more tasks, or at a certain time of day, or only between widgets that are currently running, or only between widgets in the same dashboard layer, etc. The conditions for establishing links can be a set of rules that should be satisfied before a link is established. The rules can be generated manually by the user or programmatically at run time. Rules can also be dynamically generated by a running widget or non-widget application that is associated with widgets. The rules can be stored in a widget file or other data structure. The rules for linking widgets can be different based on the type of device where the widgets reside (e.g., a portable device, mobile phone, etc.).

Linked widgets can be located in the same dashboard or different dashboards in a multiple dashboard environment. In some implementations, linked widgets can communicate even when installed in different display environments. Linked widgets can reside on a single device or on multiple devices and communicate over a network connection established between the devices (e.g., Internet, Ethernet, wireless, etc.).

In some implementations, linked widgets include a link element 516 (e.g., a button), which if selected disables links to other widgets. For example, clicking on the link element 516 of the search widget 508 causes the map and weather widgets 510, 512, to be unlinked to the search widget 508. In some implementations, when widgets are unlinked they are altered or obfuscated in the dashboard layer 506 (e.g., grayed out, dimmed, made semi-translucent, etc.). Alternatively, unlinked widgets can remain visible but a link indicator 518 (e.g., a virtual lamp, etc.) is altered to indicate a widget's link status. For example, the link indicator 518 can change color (e.g., from green to red) to assist users to visually identify the link status of a widget. In other implementations, the icon associated with a widget is modified to indicate the widgets link status (e.g., the icon change colors or displays informative text).

In some implementations, widgets that are linked (or that are capable of being linked) have a gravitational or magnetic attraction or repulsion to each other. For example, when two widgets are linked together, the widgets positions in a dashboard layer or other user interface can be automatically adjusted so the linked widgets are adjacent or proximate to each other. Under such a simulated gravitational attraction or repulsion, widgets can cluster together in the dashboard layer or user interface to indicate their linked status. The clustering visually indicates to the user that the widgets are linked (or not linked) or that the widgets can be linked. A visual indication of the strength of a link (or the potential to link) can be displayed by changing one or more properties of the widgets, such as the color of the widgets or the distance between widgets. For example, red widgets could indicate a strong link (or potential to link) and green widgets could indicate a weak link (or potential to link). Also, a shorter distance between linked widgets in a dashboard layer or user interface could indicate a stronger link (or potential to link) than widgets that are separated by a greater distance. If the user moves a widget around a dashboard layer or a user interface, other widgets in the dashboard layer or user interface can be attracted to or repulsed by the moving widget to indicate their link status or link potential.

Widgets can be linked in a variety of topologies. For example, a single widget can be linked to multiple widgets and configured to provide those widgets with common or personalized information (e.g., a broadcasting widget). In some implementations, a widget can behave like a server (“server widget”) and interact and exchange information with one or more “client” widgets.

In some implementations, widgets can be linked at several levels and conceptually organized into a widget hierarchy, for example, forming a “tree” structure where the widget at the top of the tree is a “root” widget and the other widgets are “leafs” or “node” widgets.

In some implementations, the linkage between two or more widgets can be bi-directional, so that each widget in a pair of linked widgets can be invoked (e.g., launched, installed, updated, etc.) by the other widget in the pair. Also, each widget in a widget pair can transmit and receive information from the other widget in the pair.

In some implementations, the user interface 504 can be obfuscated to reveal a dashboard layer 506 containing only linked widgets. For example, the user can press a predetermined key combination or other input mechanism, which causes the appearance of unlinked widgets to be altered or otherwise obfuscated so that only linked widgets are visible on the display screen. A key combination can be specified by the user in a preference pane or other user input mechanism.

In some implementations, a widget link manager enables a user to manually establish and edit widget links, as described with respect to FIG. 8. A widget link manager icon 514 for invoking the widget link manager can reside anywhere in the desktop user interface 504 and/or in the configuration bar 503, as shown in FIG. 5A. The icon 514 can be used to toggle between a dashboard layer or desktop and a user interface for the widget manager.

FIG. 5B illustrates the exchange of information between linked widgets. In this example, a phone book widget 520 and a sports widget 522 are residing in a dashboard layer or user interface. The phone book widget 520 includes typical phonebook information, such as addresses and telephone numbers. The sports widget 522 includes information related to sporting events, including information related to sports venues. In this example, the sports widget 522 information does not include addresses and telephone numbers of sports venues.

When a link is manually or automatically established between the phone book widget 520 and the sports widget 522, information can be exchanged between the phone book widget 520 and the sports widget 522. For example, the sports widget 522 can send the phone book widget 520 the name of a sports venue. The phone book widget 520 can then use the name of the sport venue to look up the address and telephone number of the sports venue. Once the address and number are retrieved, the phone book widget 520 sends the address and telephone-number to the sports widget 522, where the information can be used to augment or enhance the sporting event information 524.

Automatic Widget Linking Process

FIG. 6 is a flow diagram of an exemplary automatic widget linking process 600. The steps of process 600 do not necessarily have to occur in a specific order, and at least some steps can be executed in a multi-threading and/or multi-processing environment.

The process 600 begins when a widget linking trigger event is detected (602). A widget linking trigger event can generated (e.g., by a dashboard server) in response to the downloading, installation, previewing, launching, updating, manipulation, operation and/or interaction with a widget. A widget linking trigger event can also be the exercise of a feature or functionality of one or more widgets. A widget linking trigger event can be generated by user input or programmatically by software (e.g., operating system, application, etc.) or hardware (e.g., mouse click, hardware plug-in, etc.).

In response to a trigger event, the process 600 determines a set of candidate widgets that can be linked (604). Candidate widgets can be determined from predetermined or dynamically generated link information. In some implementations, predetermined link information can be stored in the dashboard configuration information 304, as shown in FIG. 3. The link information can be included by a widget's author in files associated with each widget (e.g., info.plist), or created by the user with the widget link manager, as described with respect to FIG. 8. Link information can also be dynamically created while a widget is running or not. For example, widgets that are running can be forming new links, terminating or reviving existing links, generating or receiving new data sources and the like. This dynamically generated link information can be stored during runtime in memory or other computer-readable medium (e.g., hard disk).

In some implementations, a dashboard can scan for installed widgets to create a collection of linkages, or possible linkages which are stored during runtime. In some implementations, the user can control the linkages which can be stored by the dashboard server. For example, the user can manually establish linkages using a widget link manager or bridging elements, as described with respect to FIGS. 9A and 9B.

When a set of candidate widgets is determined, the process 600 automatically links (and installs and launches, if necessary) the candidate widgets (606). In some implementations a manual step can be used in combination with the process 600 by automatically presenting a user interface that includes a list of candidate widgets that can be linked to a particular widget (e.g., the widget that generated the trigger event). The candidate widgets can be organized into a file system that can be navigated. For example, launched widgets that are running on the host device can be listed separately from widgets that are residing on the host device but have not been launched.

The user can manually select one or more widgets from the candidate widget list for linking. In other embodiments, a link or other mechanism can be provided in the dashboard layer and/or in a configuration bar that the user can select to invoke the user interface having candidate widgets and/or to direct the user to another source of candidate widgets (e.g., a link to a website).

In some implementations, a communication channel is established between the linked widgets using known object oriented programming (OOP) techniques and languages (e.g., Java, C++, Smalltalk, etc.) for transmitting and receiving messages (608). In some implementations, each widget in a linked pair of widgets can “pull” information from the other widget, “push” information to the other widget, or both (i.e., bidirectional communication). In other implementations, each widget writes information to a shared memory or storage location (e.g., local storage 106) where it can be read by other widgets. The type and amount of information shared is dependent on the needs of the widgets that are linked. An examples of shared link information would be the coordinate or location data between the widgets 508, 510 and 512, as described with respect to FIG. 5A.

In some implementations, the widgets share security information (e.g., keys, secret data, etc.) for secured communications. When widgets share information, there is a danger that malicious widgets will gain access to restricted information. If confidential information is to be shared between widgets, then the widgets can be signed and undergo an authentication procedure during linking using one or more known authentication techniques (e.g., Digital Signature Algorithm (DSA)).

When communication between linked widgets is established, the process 600 monitors the link status (610) for changes. Changes could be failed links, temporarily disable links, new links, etc. The process 600 detects any changes and modifies the link information as appropriate. For example, if a new link is established the process 600 will add the link to the link information associated with the widgets forming the link, as described with respect to Table I.

Software Architecture for Linking Widgets

FIG. 7 is a block diagram of an implementation of a software architecture for linking widgets. The software architecture 700 is similar to the architecture described with respect to FIG. 3. However, the dashboard server 706 includes a widget linker 708 and a widget link manager 710. The widget link manager 710 is described with respect to FIG. 8. The software architecture 700 is exemplary and other architectures can be realized having more or fewer components and/or processes. For example, the widget linker 708 and widget link manager 710 can be independent or stand-alone applications, processes, components, or services that can operate independent of the dashboard server 706, including as an operating system component or plug-in. The software architecture 700 can include dashboard configuration information 712 and an operating system 714.

The widget linker 708 is responsible for implementing the process 600, as described with respect to FIG. 6. In some implementations, the widget linker 708 monitors the downloading, installation, previewing and launching of widgets and detects trigger events for linking In response to a trigger event, the widget linker 708 can match a unique widget identifier (e.g., a hash) for the trigger widget with a list of candidate widgets that can be linked to the triggering widget (“candidate link widgets”). In some implementations, the widget linker 708 can store and maintain a link flag or link key for each candidate link widget, together with a memory address for accessing shared information. Setting the flag will cause the widget to read information from the address provided by the widget linker 708. The widget linker 708 will also install and/or launch the candidate linked widgets (widgets with set link flags), if the candidate link widgets have not been installed and/or launched. An example data structure for linked widgets is show in Table I below.

TABLE I
Data Structure For Link Information
Widget Name	Widget ID	Linked To:	Sharing:	Link Flag
Search	ID1	ID2, ID3, . . .	location, . . .	On
Map	ID2	ID1, ID3 . . .	None.	On
Weather	ID3	ID1, ID2 . . .	None.	On
Other Widgets	. . .	. . .	. . .	. . .

Referring to Table I, an exemplary data structure includes a Name field, a Widget ID field, a Linked To field and a Sharing field. More or fewer fields can be used, as desired. The Name field stores the name of the widget, the Widget ID field stores a unique ID for the widget (e.g., a fingerprint or hash), the Linked To field includes the Widget IDs for all the widgets that are linked to the widget identified in the Name and Widget ID fields. The Sharing field includes a description of information to be shared by the widget having the Widget ID. The data structure can be stored as a text file in a directory where it can be edited by a user through, for example, a text editor.

In some implementations, the widget linker 708 keeps track of the physical and/or logical address locations of shared information, the types of data that can be shared and the widgets that are allowed to share data. In some implementations, the user or a system administrator can prevent a widget from sharing its data with any other widget (e.g., as a security precaution) by setting the “sharing” field to None. Content feeds and other external information sources can be similarly protected. In some implementations, some widget data can be shared and other widget data can remain private. Such an implementation can be realized by adding one or more additional fields in the data structure shown in Table I. For example, one or more fields can be added that list the source of a trigger event or that stores instantaneous IDs for multiple instances of widgets.

Manual Widget Linking Process

FIG. 8 is a flow diagram of an implementation of a manual widget linking process 800. The steps of process 800 do not necessarily have to occur in a specific order, and at least some steps can be executed in a multi-threading and/or multi-processing environment.

The process 800 begins when the user selects a first widget for linking (802). In some implementations, the first widget includes a linking mechanism (e.g., menu item, button) which, when selected (e.g., mouse clicked), configures the widget for linking with other widgets, and invokes a widget link manager for manually establishing links with other widgets. In other implementations, the widget flips when the linking mechanism is selected, and a widget link manager user interface is presented on the backside of the widget. An example of a user interface for a widget link manager is described with respect to FIG. 9A.

After the first widget is selected, the user can select information belonging to the first widget which can be shared with other widgets. In some cases, the user may desire to keep certain widget information private but allow other widget information to be made public (i.e., shared with other widgets). In some cases, there may be restrictions on the number and types of widgets that can be linked to the first widget. For example, widgets that have access to certain local or network resources (e.g., file systems, private information, etc.) may be restricted by the user (or the user's privileges) from linking with other widgets for security reasons. For example, a user can turn off automatic widget linking for all or some widgets, or restrict certain widgets from linking with certain other widgets. Such restrictions or any other security methods can be specified or set by a user or administrator through a security preference pane or other input mechanism. These restrictions can be placed in a widget file that is distributed with the widget (e.g., info.plist) or added at a later time by a system administrator or user through a widget manager, as described with respect to FIG. 9A.

The user selects a second widget for linking with the first widget (804). The user can also select information belonging to the second widget which can be shared with the first widget. Once the first and second widgets are specified, including a specification of shared data, the widgets can be linked (806).

Manually Linking Widgets Using a Widget Link Manager

FIG. 9A is a screen shot depicting the manual linking of widgets using an exemplary widget link manager 900. The widget link manager 900 can be a stand-alone application, an operating system component or plug-in or a widget. The functionality of the widget link manager 900 will now be described in reference to the exemplary search, map and weather widgets 508, 510 and 512. It should be appreciated that the widget link manager 900 can operate on any number or type of widgets and is not limited to the widgets disclosed.

In some implementations, the widget link manager 900 is invoked by clicking on the widget link manager icon 514 or other input mechanism (e.g., key combination, menu option, etc.). The widget link manager 900 can be closed by clicking the button 908 or other input mechanism. When invoked the widget link manager provides a display area including a search panel 902 and a link panel 904. The search panel 902 includes a search box 906 for searching for widgets and a browse button 912. For example, a user can put name of a widget in the search box 906 and click a “Go” button 910 to run a search for the search widget 508. Alternatively, the user can browse a directory structure for widgets, using techniques commonly employed by file systems to search for files (e.g., Mac OS® Finder or Spotlight).

When the search widget 508 is selected its icon or other identifier can be displayed in the search area 902. To link the search widget 508 with the map widget 510, the user can, for example, drag the icon for the map widget 510 from the configuration bar 503 and drops the icon in the link area 904. In some implementations, the widget link manager 900 determines whether the map widget 510 can be linked to the search widget 508 by, for example, examining link information for the widgets. If the map widget 510 can be linked, the map widget 510 can appear in a list 914 of linked widgets in the link area 904. If the map widget 510 cannot be linked to the search widget 508, the map widget 510 is not displayed in the list 914 and the user is notified (e.g., by an alert message). A link failure could occur if the map and search widgets 508, 510, are restricted from being linked to each other, or if there is insufficient link information available for one or both widgets, or for any other reason (e.g., security restrictions). Note that the link information shared is dependant on the widgets that are linked. For example, the search, map and weather widgets would share location information (e.g., address, latitude, longitude, etc.).

It should be apparent that other implementations of the widget link manager 900 are possible. For example, all or part of the functionality of the widget link manager 900 can be accessible on the flip-side of a widget. If a user wants to link widgets, the user can flip the widget to display the search area 902 and link area 904.

Manually Linking Widgets Using Bridging Elements

FIG. 9B is a screen shot depicting the manual linking of widgets 508, 510 and 512 using bridging elements 916. Bridging elements are objects that can be used to visually connect two or more objects in a user interface. For example, a user can select or click on a dock 918a located on widget 508 to grab hold of a first bridging element 916a. The user can then click and drag the first bridging element 916a to a dock 918b located on widget 510. In this example, the first bridging element 916a is shown as a solid line, but other bridging elements are possible (e.g., a dashed line). In some implementations, the user can grab the first bridging element 916a by clicking a mouse button and holding the button down while dragging the end of the first bridging element 916a to the dock 918b. In some implementations, the user clicks on the docks 918a and 918b and a bridging element 916a is automatically displayed between the two docks 918a and 918b.

When the end of the first bridging element 916a is over or in the proximity of the dock 918b, the user releases the mouse button and the bridge between the widgets 508 and 510 is completed, resulting in the widgets 508 and 510 being linked. The user can repeat the same procedure using a second bridging element 916b and docks 918a and 918c. In some implementations, the bridging element is displayed until the widgets are linked at which time is removed or otherwise obfuscated. For example, once the widgets have been bridged, the bridging element can disappear or be obfuscated and the widget's properties or characteristics can be altered to indicate link status (e.g., the widgets change color).

In some implementations, the widgets can be unlinked by clicking on each widget of a link, which causes the bridging element to be displayed again. The user can then manually “snip” the bridging element by clicking on it with a mouse or other pointing device. Other techniques for removing links using bridging elements are possible.

It will be understood by those skilled in the relevant art that the above-described implementations are merely exemplary, and many changes can be made without departing from the true spirit and scope of the present invention. Therefore, it is intended by the appended claims to cover all such changes and modifications that come within the true spirit and scope of this invention.

Claims

1. A computer-implemented method of linking widgets, comprising: generating a dashboard layer, where the dashboard layer is at least partially overlaid on an existing user interface;installing, in the dashboard layer, a first widget;installing, in the dashboard layer, a second widget, wherein the first widget and the second widget are separate applications; anddetermining the first widget and the second widget are associated based on predefined criteria; in response to the determination, automatically linking the first and second widgets, the linking includingchanging a visual appearance or positions of the first and second widgets in the dashboard layer to indicate the widgets are linked and the strength of the link,wherein the method is performed by one or more hardware processors.

2. The method of claim 1, where installing the second widget in the dashboard layer, comprises: detecting a trigger event associated with the first widget;responsive to the trigger event,searching a list of contextually relevant widgets;selecting the second widget from the list; andinstalling the second widget in the dashboard layer.

3. The method of claim 2, wherein the list is a data structure of link information, including a field for indicating shared information.

4. The method of claim 1, comprising: displaying the second widget in the dashboard layer; andallowing interaction with the second widget.

5. The method of claim 1, wherein the predefined criteria includes a type of data or information the widgets use or share.

6. The method of claim 1, wherein the predefined criteria includes an origin of the widgets.

7. The method of claim 1, wherein the predefined criteria includes a time of day.

8. The method of claim 1, wherein linking-comprises: determining if the second widget is available for linking; andautomatically linking the second widget to the first widget.

9. The method of claim 1, wherein the predefined criteria includes participation in a process or workflow.

10. A tangible, non-transitory computer-readable storage medium having stored thereon instructions, which, when executed by a processor, causes the processor to perform operations comprising: generating a dashboard layer, where the dashboard layer is at least partially overlaid on an existing user interface, such that when the dashboard is active, the existing user interface is faded to emphasize that the user interface is temporarily inactive;installing, in the dashboard layer, a first widget;installing, in the dashboard layer, a second widget; andduring the installing of the first or second widget, automatically linking the first and second widgets based on predefined criteria, the automatic linking including changing a visual appearance or positions of the first and second widgets in the dashboard layer to indicate the widgets are linked and the strength of the link.

11. The computer-readable medium of claim 10, comprising: detecting a trigger event associated with the first widget;responsive to the trigger event, searching a list of contextually relevant widgets;selecting the second widget from the list; andinstalling the second widget in the dashboard layer.

12. The computer-readable medium of claim 11, wherein the list is a data structure of link information, including a field for indicating shared information.

13. The computer-readable medium of claim 10, comprising: displaying the second widget in a dashboard layer; andallowing interaction with the second widget.

14. The computer-readable medium of claim 10, where the predefined criteria includes a type of data or information the widgets use or share.

15. The computer-readable medium of claim 10, where the predefined criteria includes an origin of the widgets.

16. The computer-readable medium of claim 10, where the predefined criteria includes a time of day.

17. The computer-readable medium of claim 10, wherein linking comprises: determining if the second widget is available for linking; andautomatically linking the second widget to the first widget.

18. The computer-readable medium of claim 10, where the predefined criteria includes participation in a process or workflow.

19. A system for linking widgets, comprising: one or more processors;memory coupled to the one or more processors and storing instructions that when executed by the one or more processors causes the one or more processors to perform operations comprising: generating a dashboard layer, where the dashboard layer is at least partially overlaid on an existing user interface;installing, in the dashboard layer, a first widget;installing, in the dashboard layer, a second widget,wherein the first widget and the second widget are separate applications; determining the first widget and the second widget are associated based on predefined criteria; andin response to the determination, automatically linking the first and second widgets, the linking including changing a visual appearance or positions of the first and second widgets in the dashboard layer to indicate the widgets are linked and the strength of the link.

20. The system of claim 19, where installing the second widget in the dashboard layer, comprises: detecting a trigger event associated with the first widget;responsive to the trigger event, searching a list of contextually relevant widgets;selecting the second widget from the list; andinstalling the second widget in the dashboard layer.

21. The system of claim 20, wherein the list is a data structure of link information, including a field for indicating shared information.

22. The system of claim 19, comprising: displaying the second widget in a dashboard layer; andallowing interaction with the second widget.

23. The system of claim 19, where the predefined criteria includes a type of data or information the widgets use or share.

24. The system of claim 19, where the predefined criteria includes an origin of the widgets.

25. The system of claim 19, where the predefined criteria includes a time of day.

26. The system of claim 19, wherein linking-comprises: determining if the second widget is available for linking; andautomatically linking the second widget to the first widget.

27. The system of claim 19, where the predefined criteria includes participation in a process or workflow.