Patent Application
20190349324
People interact with computer applications through user interfaces. While audio, tactile, and similar forms of user interfaces are available, visual user interfaces through a display device are the most common form of a user interface. With the development of faster and smaller electronics for computing devices, smaller size devices such as handheld computers, smart phones, tablet devices, and comparable devices have become common. Such devices execute a wide variety of applications ranging from communication applications to complicated analysis tools. Many such applications facilitate communications.
In a communication application user interface, the messages (and other items such as calendar invites) may look the same in a user's inbox. Thus, it may be hard for the user to identify and search for messages that are important to him/her. The user may also need to open a reading pane to act on the listed messages.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to exclusively identify key features or essential features of the claimed subject matter, nor is it intended as an aid in determining the scope of the claimed subject matter.
Embodiments are directed to a rich preview of a communication in a communication summary. In some examples, a communication application may analyze a communication to identify relevant items within the communication. A communication summary of the communication may be created with the relevant items. Next, the communication summary may be presented with the relevant items. Interaction elements may be provided to manage a presentation of the relevant items.
These and other features and advantages will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory and do not restrict aspects as claimed.
As briefly described above, rich preview of a communication may be provided in a communication summary by a communication application. The communication application may initiate a process to provide the rich preview of a communication with an operation to analyze the communication. The communication may be analyzed to identify relevant items. The relevant items may include an image, a video, an audio, a document, a link, a task, and/or a meeting, among others. A communication summary of the communication may be created with the relevant items. The relevant items may be customized for a presentation based on a type of the relevant item.
The communication summary may be presented with the relevant items within a summary user interface (UI). The relevant items may be dynamically sized based on attributes of the relevant items and the size of the communication summary. Furthermore, interaction elements may be provided to manage the presentation of the relevant items. An interaction element may include operations to launch an application associated with a relevant item to present and manage the relevant item.
In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations, specific embodiments, or examples. These aspects may be combined, other aspects may be utilized, and structural changes may be made without departing from the spirit or scope of the present disclosure. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims and their equivalents.
While some embodiments will be described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a personal computer, those skilled in the art will recognize that aspects may also be implemented in combination with other program modules.
Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that embodiments may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and comparable computing devices. Embodiments may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
Some embodiments may be implemented as a computer-implemented process (method), a computing system, or as an article of manufacture, such as a computer program product or computer readable media. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program that comprises instructions for causing a computer or computing system to perform example process(es). The computer-readable storage medium is a physical computer-readable memory device. The computer-readable storage medium can for example be implemented via one or more of a volatile computer memory, a non-volatile memory, a hard drive, a flash drive, a floppy disk, or a compact disk, and comparable hardware media.
Throughout this specification, the term “platform” may be a combination of software and hardware components to provide a rich preview of a communication in a communication summary. Examples of platforms include, but are not limited to, a hosted service executed over a plurality of servers, an application executed on a single computing device, and comparable systems. The term “server” generally refers to a computing device executing one or more software programs typically in a networked environment. More detail on these technologies and example operations is provided below.
A computing device, as used herein, refers to a device comprising at least a memory and a processor that includes a desktop computer, a laptop computer, a tablet computer, a smart phone, a vehicle mount computer, or a wearable computer. A memory may be a removable or non-removable component of a computing device configured to store one or more instructions to be executed by one or more processors. A processor may be a component of a computing device coupled to a memory and configured to execute programs in conjunction with instructions stored by the memory. A file is any form of structured data that is associated with audio, video, or similar content. An operating system is a system configured to manage hardware and software components of a computing device that provides common services and applications. An integrated module is a component of an application or service that is integrated within the application or service such that the application or service is configured to execute the component. A computer-readable memory device is a physical computer-readable storage medium implemented via one or more of a volatile computer memory, a non-volatile memory, a hard drive, a flash drive, a floppy disk, or a compact disk, and comparable hardware media that includes instructions thereon to automatically save content to a location. A user experience—a visual display associated with an application or service through which a user interacts with the application or service. A user action refers to an interaction between a user and a user experience of an application or a user experience provided by a service that includes one of touch input, gesture input, voice command, eye tracking, gyroscopic input, pen input, mouse input, and keyboards input. An application programming interface (API) may be a set of routines, protocols, and tools for an application or service that enable the application or service to interact or communicate with one or more other applications and services managed by separate entities.
In a diagram 100, a computing device 104 may execute a communication application 102. Examples of the communication application 102 may include an email processing application, a messaging application, and/or a conferencing application, among others. The computing device 104 may include a tablet device, a laptop computer, a desktop computer, and a smart phone, among others. The computing device 104 may include a special purpose computing device configured to provide communications management through a display component configured to display communications, a communication component configured to transmit communications, and/or a storage component configured to store communications, among other components.
The computing device 104 may display the communication application 102 to a participant 110. The participant (such as a person) may receive and transmit a communication 109 (and other communications) to communicate with other participants. The participant 110 may be allowed to interact with the communication application 102 through an input device or touch enabled display component of the computing device 104. The computing device 104 may also include a display device such as the touch enabled display component, and a monitor, among others to provide the communication application 102 to the participant 110.
A rendering module of the communication application 102 may present a summary UI 107 of communications between the participant 110 and other participants. The rendering module may also display a communication 109 associated with one of the communication summaries. The communication 109 may include an email, a message, a video conference, and/or an audio conference, among others.
A content module of the communication application 102 may analyze the communication 109 to identify a relevant item 114 within the communication. The relevant item may include an image, a video, an audio, a document, a link, a task, and/or a meeting, among others. A communication summary 112 of the communication 109 may be created with the relevant item 114. Next, the communication summary 112 may be presented with the relevant item 114 within the summary UI 107. The relevant item 114 may be dynamically sized based on attributes of the relevant item 114 and the size of the communication summary 112. Interaction elements may be also provided to manage the presentation of the relevant item 114.
The communication 109 may be stored and managed locally within the computing device 104. Alternatively, the communication 109 may be retrieved from a server 108 such as a content server, and/or a communication server, among others that manages communications. Another example of the server 108 may include an email server that provides communications to be presented by the communication application 102. Furthermore, the computing device 104 may communicate with the server 108 through a network. The network may provide wired or wireless communications between nodes such as the computing device 104, or the server 108, among others.
Alternatively, the server 108 may provide the communication application 102. The server 108 may also provide a client interface of the communication application 102 for presentation by the computing device 104. The server 108 may execute operations to provide a rich preview of a communication in a communication summary through the communication application 102.
The participant 110 may interact with the communication application 102 with a keyboard based input, a mouse based input, a voice based input, a pen based input, and/or a gesture based input, among others. The gesture based input may include one or more touch based actions such as a touch action, a swipe action, and a combination of each, among others.
While the example system in
In a diagram 200, a communication application 202 may provide UI elements to present communication summaries and communications. A rendering module of the communication application 202 may provide a navigation UI 204 that includes navigation elements to display groupings of communication summaries in summaries UI 212. For example, a navigation element 206 may include operations to display communication summaries of communications within an inbox. The rendering module may also present other navigation elements grouping the communications based on criteria selected by a participant or other entities within the navigation UI 204.
The rendering module of the communication application 202 may provide the summaries UI 212 to present communication summaries. A communication summary 214 may include a description of a sender, a subject, and/or a presentation of a communication 216. In response to an action on the communication summary 214, the rendering module may display the communication 216. A subject, a sender, and/or a receiver of the communication 216 may be displayed along with content of the communication 216.
The content of the communication 216 may include items such as an image, a video, an audio, a document, a link, a task, and/or a meeting, among other relevant items to a participant. As such, a content module of the communication application 202 may analyze the communication 216 to identify relevant items. Images (222, 224) may be identified as the relevant items. An image 222 may be detected as inserted into the communication 216 as an attachment. An image 224 may be detected as embedded into the communication 216.
The content module of the communication application 202 may create the communication summary 214 with a relevant item 218. The relevant item 218 may be created from the image 222. In an example scenario, a read status associated with the image 222 may be identified as unread. The relevant item 218 may be rescaled to draw a participant's attention to the image 222 within the communication 216. The relevant item 218 may be rescaled dynamically to maximize a size of the image 222 presented within the communication summary 214. The size of the image 222 may be rescaled for the relevant item 218 based on available width or available height in the communication summary 214. A zoom control element 219 may be provided to manually manage rescaling of the relevant item 218 or another relevant item.
Other relevant items such the image 224 may also be presented within the communication summary 214. The relevant item 220 be created from the image 224. The relevant item 220 may be presented with an interaction element that indicates availability of additional relevant items associated with the communication 216. For example, the rendering module may be unable to display multiple images as relevant items in the communication summary 214 due to insufficient size, width, and/or height of the communication summary 214. In such a scenario, the relevant item 220 may be actionable and may include operations to display the other relevant items in response to an action on the relevant item 220.
Alternatively, the images (222 and 224) and other images may be sorted based on importance criteria. The importance criteria may be a ranking provided by a participant to the images (222 and 224) and other images. The images (222 and 224) and the other images may be sorted based on a range from a high importance value to a low importance value.
The images (222 and 224) and other images may also be presented as the relevant items (218 and 220) and other relevant items, as sorted, within the communication summary 214. A navigation element may also be provided to access the other relevant items when a size of the communication summary 214 is insufficient to display the other relevant items.
The rendering module of the communication application 202 may also provide the relevant items (218 and 220) with operations to launch an application associated with the images (222 and 224). The application may be launched in response to a detected action on the relevant items (218 and 220). The application may be launched to provide further functionality to manage the images (222 and 224), such as editing functionality, among others.
In a diagram 300, a communication application 302 may provide a communication summary 314 of a communication 316 within a communication UI 312. The communication 316 may be analyzed by a content module of the communication application 302 to identify relevant items. A document 322 attached to the communication 316 may be identified as a relevant item. The content module may create the relevant item 318 from the document 322. The relevant item 318 may include attributes of the document 322 such as a document type, a document name, and/or recent activities associated with the document 322, among others. The recent activities may include a recent access to the document 322 by a participant of the communication or by other entities.
The relevant item 318 may be presented by a rendering module of the communication application 302 within the communication summary 314. The relevant item 318 may include a document type, a document name, and/or one or more recent activities associated with the document 322. The relevant item 318 may also be presented with an interaction element. In response to an action on the relevant item 318, operations to launch an application associated with the document may be executed. The application may provide further functionality to manage the document 322.
A video 324 may also be identified as a relevant item. The content module of the communication application 302 may analyze the communication 316 to identify the video 324. The content module may create the relevant item 320 from the video 324. The relevant item 320 may include attributes of the video 324 such as a title, a source, and/or a description of the video 324, among others.
The relevant item 320 may be presented by a rendering module of the communication application within the communication summary 314. The relevant item 320 may include a title, a source, and/or a description of the video 324. The relevant item 320 may also be presented with an interaction element 321. Operations to play the relevant item 320 in the communication summary 314 may be executed in response to a detected action on the interaction element 321.
Another interaction element may also provide operations to launch an application associated with the video 324 in response to an action on the relevant item 320. The application may provide further functionality to display and manage the video 324. The video 324 may also be provided with an interaction element 325 to display and manage the video within the communication 316.
In a diagram 400, a content module of a communication application 402 may parse a content 418 of a communication 416 to identify a link 428. The link 428 may be used to create a relevant item 424. Attributes 426 of the link 428 may also be identified and inserted into the relevant item 424. The attributes 426 may include a title, a source, and/or a description, among others.
A rendering module of the communication application 402 may display the relevant item 424 within the communication summary 414. The attributes 426 of the relevant item may also be displayed. Furthermore, the relevant item 424 may also be provided with an interaction element. In response to an action on the relevant item 424, operations to access a source associated with the link 428 may be executed.
In another scenario, a content 418 of the communication 416 may be parsed by the content module of the communication application 402 to identify a task 420 (or a meeting) associated with the communication 416. Attributes of the task 420 (or the meeting) may also be identified. The attributes may include a subject, and/or a time, among others. A relevant item 422 may be created with the attributes such as the subject and/or time of the task 420 (or meeting). The relevant item 422 may be presented within the communication summary 414. The relevant item 422 may also include a reminder associated with the task 420 (or the meeting).
As discussed above, the application may be employed to perform operations to provide a rich preview of a communication in a communication summary. An increased user efficiency with the communication application 102 may occur as a result of presenting relevant items of a communication in a communication summary. Additionally, automating content promotion and presentation within a communication summary may reduce processor load, increase processing speed, conserve memory, and reduce network bandwidth usage.
Embodiments, as described herein, address a need that arises from a lack of efficiency between the participants interacting through communication applications executed on various computing devices. The actions/operations described herein are not a mere use of a computer, but address results that are a direct consequence of software used as a service offered to large numbers of users and applications.
The example scenarios and schemas in
Client applications executed on any of the client devices 511-513 may facilitate communications via application(s) executed by servers 514, or on individual server 516. A communication application may analyze a communication to identify relevant items (such as an image, and/or a video, among others) within the communication. A communication summary of the communication may be created with the relevant items. Next, the communication summary may be presented with the relevant items. Interaction elements to manage a presentation of the relevant items may also be provided. The communication application may store data associated with the communication in data store(s) 519 directly or through database server 518.
Network(s) 510 may comprise any topology of servers, clients, Internet service providers, and communication media. A system according to embodiments may have a static or dynamic topology. Network(s) 510 may include secure networks such as an enterprise network, an unsecure network such as a wireless open network, or the Internet. Network(s) 510 may also coordinate communication over other networks such as Public Switched Telephone Network (PSTN) or cellular networks. Furthermore, network(s) 510 may include short range wireless networks such as Bluetooth or similar ones. Network(s) 510 provide communication between the nodes described herein. By way of example, and not limitation, network(s) 510 may include wireless media such as acoustic, RF, infrared and other wireless media.
Many other configurations of computing devices, applications, data sources, and data distribution systems may be employed to provide a rich preview of a communication in a communication summary. Furthermore, the networked environments discussed in
For example, computing device 600 may be used as a server, desktop computer, portable computer, smart phone, special purpose computer, or similar device. In an example basic configuration 602, the computing device 600 may include one or more processors 604 and a system memory 606. A memory bus 608 may be used for communication between the processor 604 and the system memory 606. The basic configuration 602 may be illustrated in
Depending on the desired configuration, the processor 604 may be of any type, including but not limited to a microprocessor (μP), a microcontroller (μC), a digital signal processor (DSP), or any combination thereof. The processor 604 may include one more levels of caching, such as a level cache memory 612, one or more processor cores 614, and registers 616. The example processor cores 614 may (each) include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP Core), or any combination thereof. An example memory controller 618 may also be used with the processor 604, or in some implementations, the memory controller 618 may be an internal part of the processor 604.
Depending on the desired configuration, the system memory 606 may be of any type including but not limited to volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. The system memory 606 may include an operating system 620, a communication application 622, and a program data 624. The communication application 622 may include components such as a content module 626 and a rendering module 627. The content module 626 and the rendering module 627 may execute the processes associated with the communication application 622. The content module 626 may analyze a communication to identify relevant items (such as an image, and/or a video, among others) within the communication. A communication summary of the communication may be created with the relevant items. Next, the rendering module 627 may present the communication summary with the relevant items. Interaction elements to manage a presentation of the relevant items may also be provided.
Components of the communication application 622 (such as a user interface) may also be displayed on a display device associated with the computing device 600. An example of the display device may include a hardware screen that may be communicatively coupled to the computing device 600. The display device may include a touch based device that detects gestures such as a touch action. The display device may also provide feedback in response to detected gestures (or any other form of input) by transforming a user interface of the communication application 622, displayed by the touch based device. The program data 624 may also include, among other data, communication data 628, or the like, as described herein. The communication data 628 may include a relevant item, and/or a communication, among others.
The computing device 600 may have additional features or functionality, and additional interfaces to facilitate communications between the basic configuration 602 and any desired devices and interfaces. For example, a bus/interface controller 630 may be used to facilitate communications between the basic configuration 602 and one or more data storage devices 632 via a storage interface bus 634. The data storage devices 632 may be one or more removable storage devices 636, one or more non-removable storage devices 638, or a combination thereof. Examples of the removable storage and the non-removable storage devices may include magnetic disk devices, such as flexible disk drives and hard-disk drives (HDD), optical disk drives such as compact disk (CD) drives or digital versatile disk (DVD) drives, solid state drives (SSD), and tape drives, to name a few. Example computer storage media may include volatile and nonvolatile, removable, and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data.
The system memory 606, the removable storage devices 636 and the non-removable storage devices 638 are examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVDs), solid state drives, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store the desired information and which may be accessed by the computing device 600. Any such computer storage media may be part of the computing device 600.
The computing device 600 may also include an interface bus 640 for facilitating communication from various interface devices (for example, one or more output devices 642, one or more peripheral interfaces 644, and one or more communication devices 646) to the basic configuration 602 via the bus/interface controller 630. Some of the example output devices 642 include a graphics processing unit 648 and an audio processing unit 650, which may be configured to communicate to various external devices such as a display or speakers via one or more A/V ports 652. One or more example peripheral interfaces 644 may include a serial interface controller 654 or a parallel interface controller 656, which may be configured to communicate with external devices such as input devices (for example, keyboard, mouse, pen, voice input device, touch input device, etc.) or other peripheral devices (for example, printer, scanner, etc.) via one or more I/O ports 658. An example communication device 666 includes a network controller 660, which may be arranged to facilitate communications with one or more other computing devices 662 over a network communication link via one or more communication ports 664. The one or more other computing devices 662 may include servers, computing devices, and comparable devices.
The network communication link may be one example of a communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and may include any information delivery media. A “modulated data signal” may be a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), microwave, infrared (IR) and other wireless media. The term computer readable media as used herein may include both storage media and communication media.
The computing device 600 may be implemented as a part of a general purpose or specialized server, mainframe, or similar computer, which includes any of the above functions. The computing device 600 may also be implemented as a personal computer including both laptop computer and non-laptop computer configurations.
Example embodiments may also include methods to provide a rich preview of a communication in a communication summary. These methods can be implemented in any number of ways, including the structures described herein. One such way may be by machine operations, of devices of the type described in the present disclosure. Another optional way may be for one or more of the individual operations of the methods to be performed in conjunction with one or more human operators performing some of the operations while other operations may be performed by machines. These human operators need not be collocated with each other, but each can be only with a machine that performs a portion of the program. In other embodiments, the human interaction can be automated such as by pre-selected criteria that may be machine automated.
Process 700 begins with operation 710, where a communication application may analyze the communication to identify relevant items within the communication. The items may include an image, a video, an audio, a document, a link, a task, and/or a meeting, among others. At operation 720, a communication summary of the communication may be created with the relevant items. The relevant items may be processed for a presentation based on a type of the relevant item.
At operation 730, the communication summary may be presented with the relevant items within a summary user interface (UI). The relevant items may be dynamically sized based on attributes of the relevant items and the size of the communication summary. At operation 740, interaction elements may be provided to manage the presentation of the relevant items. An interaction element may include operations to launch an application associated with a relevant item to present and manage the relevant item.
The operations included in process 700 are for illustration purposes. Providing relevance based dynamic hashtag navigation may be implemented by similar processes with fewer or additional steps, as well as in different order of operations using the principles described herein. The operations described herein may be executed by one or more processors operated on one or more computing devices, one or more processor cores, specialized processing devices, and/or general purpose processors, among other examples.
In some examples, a computing device for providing a rich preview of a communication in a communication summary is described. The computing device includes a display device, a memory configured to store instructions associated with a communication application, and one or more processors coupled to the memory and the display device. The one or more processors execute the communication application in conjunction with the instructions stored in the memory. The communication application includes a content module and a rendering module. The content module is configured to analyze the communication to identify one or more relevant items within the communication and create the communication summary of the communication with the one or more relevant items. The rendering module is configured to present, on the display device, the communication summary with the one or more relevant items and provide, on the display device, one or more interaction elements to manage a presentation of the one or more relevant items.
In other examples, the one or more relevant items includes one or more of: an image, a video, an audio, a document, a link, a task, and a meeting. The content module is further configured to identify an image as one of the one or more relevant items, detect a reading status of the image as unread. The rendering module is further configured to rescale, on the display device, the image to maximize a size of the image within the communication summary. The content module is further configured to identify two or more images as the one or more relevant items and sort the two or more images based on an importance criteria, where the two or more images are sorted based on a range from a high importance value to a low importance value. The rendering module is further configured to present, on the display device, the two or more images, as sorted, within the communication summary, where a navigation element is provided to access a subset of the two or more images when a size of the communication summary is insufficient to display the subset of the two or more images.
In further examples, the content module is further configured to identify a document as the one or more relevant items and detect attributes of the document, where the attributes include a document type, a document name, and one or more recent activities associated with the document. The rendering module is further configured to present, on the display device, the document type, the document name, and the one or more recent activities associated with the document within the communication summary. The content module is further configured to identify a video as one of the one or more relevant items and detect attributes of the video, where the attributes include a title, a source, and a description of the video. The rendering module is further configured to present, on the display device, the title, the source, and the description of the video within the communication summary. The content module is further configured to identify a link as one of the one or more relevant items and detect attributes of the link, where the attributes include a title, a source and a description of the link. The rendering module is further configured to present, on the display device, the title, the source, and the description of the link within the communication summary.
In some examples, a method executed on a computing device for providing a rich preview of a communication in a communication summary is described. The method includes analyzing the communication to identify one or more relevant items within the communication, where the one or more relevant items include one or more of an embedded item and an attached item, creating the communication summary of the communication with the one or more relevant items, presenting the communication summary with the one or more relevant items, and providing one or more interaction elements to allow for an interaction with the one or more relevant items.
In other examples, the method further includes detecting a meeting associated with the communication as one or the one or more relevant items, displaying a topic, a time, and a location of the meeting within the communication summary, detecting a conflict between the meeting and another meeting, and displaying the conflict within the communication summary, where the conflict includes one or more of the topic, the time, and the location associated with the meeting and the other meeting. The method further includes analyzing a content of the communication to identify a task as one of the one or more relevant items, parsing a subject and a time of the task, and presenting the subject and the time of the task within the communication summary.
In some examples a computer-readable memory device with instructions stored thereon for providing a rich preview of a communication in a communication summary is described. The instructions include actions that are similar to the actions of the method.
The above specification, examples and data provide a complete description of the manufacture and use of the composition of the embodiments. Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims and embodiments.
This application is a continuation of U.S. application Ser. No. 14/966,360, filed Dec. 11, 2015, the entire content of which is incorporated by reference herein.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14966360 | Dec 2015 | US |
| Child | 16524623 | US |
