This application is related to U.S. Provisional Application No. 62/316,526, titled “UNIVERSAL NOTIFICATION PIPELINE”, filed Mar. 31, 2016, and incorporated herein by reference.
A goal of computing is to provide information to people. Assuming that a person uses a computing device to access information, competing factors can bear on how and when information should be presented. For example, a user's goals may vary according to how much time is available, what activity the user is engaged in, the importance of available information, etc. The amount and type of information that is available and the frequency at which it becomes available can vary significantly. Moreover, computing devices that display information have a wide range of power capabilities, computing capacity, display size, and types of input devices. A given piece of information could potentially be destined for a small device worn on a wrist and a device with a large display in a building lobby.
To accommodate the variety and complexity of information presentation factors, software developers have designed different types of notification mechanisms or notification surfaces. For example, many operating systems or graphical user shells provide different notification surfaces for different contexts. For instance, a lock screen or login screen might have a notification surface, a “home” or “start” screen for launching applications might have icons capable of displaying notifications or information about them, a tool or status bar might have a user interface element that can be activated to display notifications, or a “toast” notification surface might be provided. In any case, these kinds of notification surfaces often have different sizes, consume different types or formats of information, implement different semantics, and are interfaced through different application programming interface (API) or protocols.
The inventors alone have realized that it is becoming difficult for developers to write software that can take advantage of the variety of notification surfaces available on different platforms. The inventors have appreciated that a developer writing software to disseminate a single item of information might currently need to write many sections of code, each customized for respective notification surfaces. In addition, if a single item of notification information is intended to be displayed by multiple notification surfaces of a same device, multiple notification messages of varying content and format might need to be transmitted, resulting in duplicative transmission of the same item of information, possibly resulting in multiple process “wake ups” and other overhead at the receiving device. Consequently, the inventors alone have realized that providing a universal notification mechanism on a computing device can potentially ease some of the problems related to the proliferation of notification surfaces.
The following summary is included only to introduce some concepts discussed in the Detailed Description below. This summary is not comprehensive and is not intended to delineate the scope of the claimed subject matter, which is set forth by the claims presented at the end.
Inventive embodiments described herein relate to a universal approach for handling user interface notifications. A notification pipeline on a device acts as an intermediary between applications on the device and notification surfaces on the device. Notification surfaces may register themselves with the notification pipeline to become active subscribers to the pipeline. Applications or other processes submit to the notification pipeline notifications complying with a same format, schema, structure, etc. The notification pipeline broadcasts the notification to the subscribed notification surfaces, which in turn determine whether or how to handle and perhaps display information in the notification based on the content of the notification.
Many of the attendant features will be explained below with reference to the following detailed description considered in connection with the accompanying drawings.
The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein like reference numerals are used to designate like parts in the accompanying description.
Embodiments discussed below relate to a universal notification pipeline. Notification surfaces in general will be described first, including some graphical attributes, their technical features, and how they have been implemented. A notification pipeline is described next. A publisher-subscriber design is explained, as well as techniques to integrate the notification pipeline into existing notification surfaces or managers.
Local software elements, typically applications 150, execute on the computing device 120 and submit notifications to whichever notification surfaces they are programmed to interface with. To accommodate remote notifications received from a network via a network interface card 152 and network stack 154, a push listener 156 background process may receive and handle network notifications, for instance in the form of HyperText Transfer Protocol (HTTP) messages. As can be seen in
As can be seen in
First, clients and notification surfaces should be built or modified to use a common notification format. An aspect of the pub-sub design of the notification pipeline 180 is that each notification received from a client by the notification pipeline 180 is passed to each notification surface that is currently subscribed to the notification pipeline 180. Any client or notification surface that participates should implement a same notification format or data structure. For example, if notification payloads are implemented as eXtensible Mark-up Language (XML) code, then each notification should conform to a same XML schema. In that case, clients should be programmed to format their notifications as XML code conformant to a notification schema. Examples are described in the application referenced above in the “RELATED APPLICATIONS” section. Other types of data packaging or formatting may be used for notifications. For instance, well-defined data structures (e.g., JavaScript Object Notation), portable objects, sets of key-value pairs in text form, etc. Of note will be a “contract” or understanding that any subscribed notification surface will be able to at least parse and interpret (possibly using other facilities) a notification that complies with the agreed-upon data format. How a notification surface handles the content of a compliant notification, if at all, is up to the notification surface. Although, semantic conventions may be attached to features of notifications.
Second, the clients and notification surfaces should be coded to use a same API or other type of software interface to access the notification pipeline 180. A notification pipeline API can be as simple as a “subscribe( )” call, a “publish( )” call, and possibly an “unsubscribe( )” call, although other calls or methods may be helpful, as discussed later. As described in detail below, notification surfaces call “subscribe( )” or an equivalent to become subscribers and consequently receive notifications. Clients call “publish( )” to pass a notification as a parameter, event, or the like.
The left side of
In one embodiment, an inter-process communication (IPC) mechanism 208 may be used to pass notifications from the notification pipeline 180 to the subscribed notification surfaces. For instance, an event routing/sinking mechanism of the operating system may be used, where each notification surface listens for a notification-type event and implements an event handler for the same. Other IPC mechanisms may be used, for instance shared memory, message queues, pipes, etc. Although overhead and performance might be prohibitive, the notification pipeline can also be implemented as an application-level protocol built on top of the local network protocol stack. Notifications could be formed as HTTP requests, for instance. Internally generated notifications would only pass through a loopback interface and notifications from a network would be directly handled by the pipeline (a push listener, for instance, might be obviated). An IPC approach will likely be preferable.
Regarding the assumption that various notification surfaces have already subscribed, it is convenient for a notification surface to invoke the subscribe function 202 in its initialization code. A typical notification surface will begin executing at boot time, login, etc. Some notification surfaces may take advantage of the unsubscribe function 210 (see
The notification pipeline 180 may also implement gatekeeper functionality. For instance, the notification pipeline 180 can check each incoming notification for conformance with the standard schema or format, which can alleviate the notification surfaces from each having to perform the same function.
For instance, a notification might be defined as being bound to “medium” sized notification surfaces or notification surfaces greater than a certain size. Different style hints or notification content might be associated with different bindings. Put another way, a notification publisher need not specify particular notification surfaces, but rather specifies the types or properties for which a notification is intended, all subscribed notification surfaces receive the notification, and each subscriber 242 handles the notification according to its own traits compare to the specifications of the notification. In
The notification pipeline can also help avoid forward and backward compatibility issues. Further to that purpose, the standard format or schema can include an “optional” construct or tag. Each surface is guaranteed to be able to at least recognize and parse the optional tag. Older surfaces might ignore such optional notification content, but newer surfaces might be programmed to act upon the optional content. As new notification surface features arise, newer clients will be able to plug into them without affecting backward compatibility of the older clients. For example, if a software developer wants to support video in a toast, and perhaps a first version of a graphical shell does not support video toast but a second version does, if the notifying client puts the video content in the optional part of the notification, then the same notification payload can be sent without regard for whether the first or second version will be handling it.
In some cases, a notification surface might need to know which application on its computing device submitted a notification. As noted above, the notification pipeline can automatically identify which application has submitted a notification and provide that information with the broadcasted publication of the notification. This allows the application-specific recipient to direct the content of the notification to the appropriate sub-surface or object. For instance, if a badge style notification is published with the identity of the application that published it, a recipient can update the icon of the corresponding application. In other words, the notification pipeline can be designed to enable implicit association of applications and notifications. Two different processes with multiple notification surfaces, all or many of which are associated with particular respective applications, can, through one subscription, receive notifications from the respective applications and direct them to the appropriate application-specific notification surfaces.
The computing device 120 may have a display 252, a network interface 254, as well as storage hardware 256 and processing hardware 258, which may be a combination of any one or more: central processing units, graphics processing units, analog-to-digital converters, bus chips, FPGAs, ASICs, Application-specific Standard Products (ASSPs), or Complex Programmable Logic Devices (CPLDs), etc. The storage hardware 256 may be any combination of magnetic storage, static memory, volatile memory, non-volatile memory, optically or magnetically readable matter, etc. The meaning of the term “storage”, as used herein does not refer to signals or energy per se, but rather refers to physical apparatuses and states of matter. The hardware elements of the computing device 250 may cooperate in ways well understood in the art of computing. In addition, input devices may be integrated with or in communication with the computing device 250. The computing device 250 may have any form factor or may be used in any type of encompassing device. The computing device 250 may be in the form of a handheld device such as a smartphone, a tablet computer, a gaming device, a server, a rack-mounted or backplaned computer-on-a-board, a system-on-a-chip, or others.
Embodiments and features discussed above can be realized in the form of information stored in volatile or non-volatile computer or device readable storage hardware. This is deemed to include at least storage hardware such as optical storage (e.g., compact-disk read-only memory (CD-ROM)), magnetic storage hardware, flash read-only memory (ROM), and the like. The information stored in storage hardware can be in the form of machine executable instructions (e.g., compiled executable binary code), source code, bytecode, or any other physical hardware having a physical state that can transfer information to processing hardware to enable or configure computing devices to perform the various embodiments discussed above. This is also deemed to include at least volatile memory such as random-access memory (RAM) and/or virtual memory storing information such as central processing unit (CPU) instructions during execution of a program carrying out an embodiment, as well as non-volatile media storing information that allows a program or executable to be loaded and executed. The embodiments and features can be performed on any type of computing device, including portable devices, workstations, servers, mobile wireless devices, and so on.
Number | Name | Date | Kind |
---|---|---|---|
8463858 | Bouazizi | Jun 2013 | B2 |
9118614 | Rogers et al. | Aug 2015 | B1 |
20030169749 | Huang | Sep 2003 | A1 |
20030208549 | El-Shimi | Nov 2003 | A1 |
20070078935 | Garcia-Martin | Apr 2007 | A1 |
20080039008 | Chen | Feb 2008 | A1 |
20080080677 | Samdadiya | Apr 2008 | A1 |
20080126455 | Francfort | May 2008 | A1 |
20100037248 | Lo | Feb 2010 | A1 |
20100325201 | Chitturi et al. | Dec 2010 | A1 |
20120102168 | Mercuri | Apr 2012 | A1 |
20120233272 | Bedi et al. | Sep 2012 | A1 |
20130013804 | Traynor | Jan 2013 | A1 |
20130066980 | Vasters | Mar 2013 | A1 |
20130217416 | Matthews, III | Aug 2013 | A1 |
20130311291 | Ward | Nov 2013 | A1 |
20140032707 | Doshi | Jan 2014 | A1 |
20140164514 | Eteminan | Jun 2014 | A1 |
20140229862 | St. Clair | Aug 2014 | A1 |
20170099329 | Karneges | Apr 2017 | A1 |
Entry |
---|
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US2017/024402”, dated Jul. 7, 2017, 14 Pages. |
“Versioned notification API”, Retrieved on: Mar. 17, 2016 Available at: https://specs.openstack.org/openstack/nova-specs/specs/mitaka/approved/versioned-notification-api.html. |
“Sending and Scheduling Push Notifications”, Retrieved on: Mar. 17, 2016 Available at: http://docs.appcelerator.com/platform/latest/#!/guide/Sending_and_Scheduling_Push_Notifications. |
Sadun, Erica, “The iPhone Developer's Cookbook: Push Notifications”, Published on: Jan. 4, 2009 Available at: http://www.informit.com/articles/article.aspx?p=1433733&seqNum=5. |
Xu, Ray, “Quickstart: Sending a local toast notification and handling activations from it (Windows 10)”, Published on: Jul. 8, 2015 Available at: https://blogs.msdn.microsoft.com/tiles_and_toasts/2015/07/08/quickstart-sending-a-local-toast-notification-and-handling-activations-from-it-windows-10/. |
Jamil, Tahseen, “Microsoft Launches Notifications Visualizer for Windows 10”, Published on: Nov. 3, 2015 Available at: http://www.c-sharpcorner.com/news/microsoft-launches-notifications-visualizer-for-windows-10. |
“Using Oracle Mobile Cloud Service”, Retrieved on: Mar. 17, 2016 Available at: https://docs.oracle.com/cloud/latest/mobilecs_gs/MCSUA/GUID-C39695F6-9012-4A63-ADDF-47F04BF0AC73.htm#MCSUA-GUID-C39695F6-9012-4A63-ADDF-47F04BF0AC73. |
“2.2.3.5 Notify Payload (Payload Type 0x0B) Packet”, Retrieved on: Mar. 17, 2016 Available at: https://msdn.microsoft.com/en-us/library/cc223903.aspx. |
Hale, David, “Windows Push Notification Services (WNS) overview”, Retrieved on: Mar. 17, 2016 Available at: https://msdn.microsoft.com/en-us/windows/uwp/controls-and-patterns/tiles-and-notifications-windows-push-notification-services-wns-overview. |
Hale, David, “Adaptive and interactive toast notifications”, Retrieved on: Mar. 17, 2016 Available at: https://msdn.microsoft.com/en-us/windows/uwp/controls-and-patterns/tiles-and-notifications-adaptive-interactive-toasts. |
“APNs Provider API”, Published on: Mar. 3, 2016 Available at: https://developer.apple.com/library/ios/documentation/NetworkingInternet/Conceptual/RemoteNotificationsPG/Chapters/APNsProviderAPI.html. |
Liu, Qianting, “The Usage of Microsoft Push Notification Service on Mobile Devices”, In Thesis for the Degree of Master of Science in Technology, May 12, 2011, 70 pages. |
Damaggio, Elio, “Delivering push notifications to millions of devices with Windows Azure Notification Hubs”, Published on: Sep. 16, 2013 Available at: https://blogs.windows.com/buildingapps/2013/09/16/delivering-push-notifications-to-millions-of-devices-with-windows-azure-notification-hubs/. |
“Registering, Scheduling, and Handling User Notifications”, Published on: Dec. 21, 2015 Available at: https://developer.apple.com/library/ios/documentation/NetworkingInternet/Conceptual/RemoteNotificationsPG/Chapters/IPhoneOSClientImp.html. |
Number | Date | Country | |
---|---|---|---|
20170285882 A1 | Oct 2017 | US |
Number | Date | Country | |
---|---|---|---|
62316526 | Mar 2016 | US |