Email (also referred to as electronic mail) allows users to exchange content across a network. Originally, email was configured to include textual content that was communicated through the use of a header across a network between desktop computing devices and servers. The functionality of email continues to expand, such that email may be used to communicate a wide variety of different content to a wide variety of computing devices. However, traditional techniques that were used to view emails remain relatively unchanged and therefore provide a view of the email having limited “richness.”
Email viewing techniques are described. In implementations, a determination is made regarding one or more types of content that are included in an email through examination of metadata that describes the one or more types of content. The determination is made responsive to selection of an email in a user interface for output. A choice is made from one of a plurality of views for the email based on the determination; and the email is output in a user interface using the chosen view.
In implementations, a plurality of emails received via a network connection at the client device is parsed to locate content using metadata, the metadata being communicated with the email and describing respective content. The content from the plurality of emails is combined that pertains to a particular event and the combined content is output that pertains to the particular event in a user interface at the client device.
In implementations, one or more computer-readable media comprise instructions that are stored thereon that, responsive to execution by a client device, cause the client device to output a user interface having a plurality of representations of views that are selectable to show different combinations of content taken from emails received by the client device via a network.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items.
Overview
Email was originally used to communicate text between computers over a network. The functionality of email continued to increase to include content of ever expanding types, such as files, images, and so on. However, the traditional techniques that were developed to view email have not changed and therefore give a relatively static view of the email.
Email viewing techniques are described. In implementations, content of email is leveraged to provide a variety of views of the email. For example, the email may include metadata that describes content included in the email, such as images, dates and times of a travel itinerary, billing information, and so on. This description may be leveraged by an entity that receives the email to provide a variety of different views of the email according to the metadata.
For instance, a user interface may be configured to view images taken from emails without having to view each email, separately. In this way, a user may readily locate a desired image without navigating through each of the emails. In another instance, content from emails may be combined, such as to show a view of a travel itinerary using content taken from a plurality of emails, such as an airfare confirmation, hotel confirmation, car rental confirmation, and so on. A variety of other views and metadata techniques are also contemplated, further discussion of which may be found in relation to the following sections.
In the following discussion, an example environment is first described that is operable to perform email viewing techniques. Example metadata schema and example procedures are then described, which may be performed in the example environment and elsewhere. Accordingly, the example environment is not limited to implementation of the example metadata schema and example procedures. Likewise, the example procedures and example metadata schema are not limited to implementation in the example environment.
Example Environment
Although the network 108 is illustrated as the Internet, the network may assume a wide variety of configurations. For example, the network 108 may include a wide area network (WAN), a local area network (LAN), a wireless network, a public telephone network, an intranet, and so on. Further, although a single network 108 is shown, the network 108 may be configured to include multiple networks. For instance, the email originator 106 and the service provider 102 may use a corporate Intranet to communicate, one to another. Additionally, both the client device 104 and the service provider 102 may be communicatively coupled over the Internet. A wide variety of other instances are also contemplated.
A service provider 102 is illustrated as having an email 110 that was composed at the email originator 106 for delivery to the client device 104, e.g., through a “store and forward” technique. Other embodiments are also contemplated, however, such as through direct delivery of the email from the email originator 106 to the client device 104 (i.e., the email originator 106 and the service provider 102 are combined). For purposes of the following discussion, the email 110 may be representative of one or more emails. Accordingly, the email 110 may be referred to in singular (e.g., the email 110) and plural (e.g., the emails 110) forms.
The email 110 includes a header 112 and content 114. The header 112 includes information that is usable to deliver the email 110, such as an email address of an intended recipient. e.g., the client device 104. The header 112 may also include other information such as an email address of the email originator 106, a subject header, and so on.
The content 114 may be representative of a variety of different types of content that may be included in the email 110. For example, the content 114 may include textual content that may be configured in a variety of different ways, such as text of a letter, billing information, purchase confirmation information, contact information, banking information, scheduling information, and so on. The content 114 may also include a variety of non-textual content, such as images, music files, video files, links to other content over the network 108, and so on.
The email 110 is further illustrated as including metadata 116 that describes the content 114 of the email 110. For example, the metadata 116 may follow a schema that may describe both textual and non-textual content 114 of the email 110. This description may then be leveraged to provide rich views that leverage the particular types of content 114 included in the email 110. For example, the email originator 106 is illustrated as including an email communication module 118 that is representative of functionality of the email originator 106 to compose the email 110. The email communication module 118, for instance, may provide a user interface that is output to receive inputs that are used to compose the email 110, such as to address the email 110 (i.e., form the header 112) as well as specify content 114 for inclusion in the email 110, e.g., to type text, attach a file, and so on.
The email communication module 118 is also illustrated as including a metadata generation module 120 that is representative of functionality of the email originator 106 to generate the metadata 116 for inclusion in the email 110. As previously described, the metadata 116 generated by the metadata generation module 120 is configured to describe the types of content 114 included in the email. For example, the metadata 116 may include an XML tag that specifies the following content 114 describes a purchase amount. This is different than traditional techniques that specified formatting that is to be applied to the content 114, e.g., an HTML tag specifying that the following text was to be bolded. The email 110 having the header 112, content 114, and metadata 116 is then transmitted by the email originator 106 via the service provider 102 in this example.
The service provider 102 is illustrated as including an email manager module 112 that is representative of functionality to manage email 110 delivery. For example, the email manager module 112 may employ a “store and forward” system to deliver the email 110 to the client device 104 as specified by information in the header 112. The email manager module 122 is also illustrated as including a metadata manager module 124 that is representative of functionality of the service provider 102 regarding the metadata 116. For example, the metadata manager module 124 may be configured to supplement the metadata 116 included in the email 110, reformat the metadata 116, originate “new” metadata for inclusion in the email 110, and so on. The email manager module 122 may then deliver the email 110 to an intended recipient, which is the client device 104 in this example.
The client device 104 is illustrated as included an email communication module 126 that is representative of functionality regarding receipt and viewing of emails. The email communication module 126 may also include functionality to compose emails as previously described for the email communication module 118 of the email originator 106. The email communication module 126 is also illustrated as including a metadata parsing module 128 that is representative of functionality to examine metadata 116 in the email 110 and leverage this examination to provide one or more different views of the email 110. The views may be configured in a variety of ways.
The metadata 116, for example, may be parsed by the metadata parsing module 128 to extract data that describes the content 114 of the email. Thus, in this example the metadata 116 is unstructured. In another example, the metadata 116 may be structured to define the content 114 in the email, such as by following a particular schema. The metadata 116 may then be leveraged to provide views that take advantage of the content 114 included in the email 110, such as to provide a view that is for a specific type of content (e.g., images, documents, and so on), combine content 114 from emails to provide an aggregate view, and so forth, further discussion of which may be found in relation to the following figures.
Generally, any of the functions described herein can be implemented using software, firmware, hardware (e.g., fixed logic circuitry), manual processing, or a combination of these implementations. The terms “module,” “functionality,” and “logic” as used herein generally represent software, firmware, hardware, or a combination thereof. In the case of a software implementation, the module, functionality, or logic represents program code that performs specified tasks when executed on a processor (e.g., CPU or CPUs). The program code can be stored in one or more computer readable memory devices, such as digital video discs (DVDs), read-only memory (ROM), compact discs (CDs), hard drives, flash drives, and so on. The features of the email view techniques described below are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
The representation “Photos and Videos” is illustrated as selected in the user interface 202. Responsive to this selection, the metadata parsing module 128 causes output of representations photos and videos (e.g., thumbnails) taken from emails received at the client device 104. Representations of the photos and videos are arranged chronologically in groups in this example, which include “most recent” and “last month.” Thus, in this example a user may select “photos and videos” from the quick view menu to locate a desired photo or video without having to navigate through a plurality of individual emails. Similar techniques may also be employed to locate different types of content, such as for the “Documents” view, “Newsletters” view, and so on. In another example, content from different emails may be combined that pertain to a common event, further discussion of which may be found in relation to the following figure.
This metadata may then be arranged and output as a travel itinerary view 304 in the user interface 302. The illustrated travel itinerary view 304 arranges the metadata information by flights, car rental, and then hotel. The travel itinerary view 304 also include a selectable portion 306 to view other itineraries. Thus, a variety of different metadata 116 may be included in emails 110 by the email originator 106 to support different views of the email 110. Example metadata is further described in the following section.
Example Schema
The following gives examples of metadata schema that may be employed for a variety of different types of content. It should be readily apparent that these are but a few examples, as a metadata schema may be structured in a variety of ways to describe content of an email.
Media and Routing
A variety of different types of media may be incorporated within the email 110. Accordingly, the metadata 116 schema may be configured to describe these types of media. For example, the schema may describe a message type, originating site, a sender's name, and details. The schema may also describe a use for the media, such as to output as a promotional trailer, as well as techniques to consume the media, such as to embed a media player into the email 110. Accordingly, the metadata parsing module 128 may examine the schema and determine a view to be used to display the email 110, and more particularly the content 114 of the email.
Social Networks
Social networks may leverage email to communicate a variety of different content to users of the network. As a “base” level, the metadata schema may describe a message type and subtype, a site and site URL that originated the email, a sender's name and email address, a sender's profile, and so on. The schema may also address a variety of other mechanisms that may be used by the social network to communicate.
The social network, for example, may support notes (e.g., a “wall post”) to communicate between users. An email notification may be sent responsive to such a post to notify a user of the note. Accordingly, the metadata schema may be structured to describe the content of the email that pertains to the note, such as the “base level” information above, as well as a sender's profile, message details, a message URL, button text (e.g., “write to your friend's wall”), and so on. Similar schemas may be employed for comments (e.g., comment text, button text to reply, a site URL); invitations such as a friend request, group, request, event request (e.g., sender's profile, event details, button to accept and decline); and so on.
Commercial Email
The metadata schema may be arranged to address a variety of different types of content in commercial email. Emails related to shopping for instance, may include a schema that specifies a message type (e.g., receipt, tracking), originating site, site URL, message details (e.g., order number, tracking number), date, and so on. Likewise, emails relating to finance may include metadata 116 that describes the content 114, such as message type (e.g., bill, payment confirmation, statement), message details (e.g., invoice #, confirmation number), a link to the statement or bill, date and so on. Similar techniques may be used to specify travel information, e.g., a schema that specifies that the email pertains to an itinerary, departure dates, departure information, arrival dates and information, flight numbers, car rental information, and so on. In this way, the metadata parsing module 128 may efficiently locate this content 114 and provide a view that is optimized for the metadata.
Example Procedures
The following discussion describes email view techniques that may be implemented utilizing the previously described systems and devices. Aspects of each of the procedures may be implemented in hardware, firmware, or software, or a combination thereof. The procedures are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. In portions of the following discussion, reference will be made to the environment 100 of
Metadata is defined that describes the content in the composed email, the defined metadata not being configured for viewing along with the content of the email (block 404). The metadata may be defined in a variety of ways. For example, the metadata generation module 120 may output a user interface such that a user may manually specify the metadata 116. In another example, the metadata generation module 120 may parse the content 114 of the email 110 and generate the metadata that describes the content 114. A variety of other examples are also contemplated, such as through generation of the metadata 116 at the service provider 102 using a metadata manager module 124.
A communication is formed that includes the email having the defined metadata (block 406). The communication, for instance, may form the email 110 to include the header 112, the content 114, and the metadata 116 for communication over the network 108. The communication that includes the email having the defined metadata is communicated (block 408). In this way, the email originator 106 and/or the service provider 102 may provide metadata 116 that may be leveraged to view the content 114, further discussion of which may be found in relation to the following figure.
A choice is made of one of a plurality of views for the email based on the determination (block 504). The email is output in a user interface using the chosen view (block 506). As described, the metadata parsing module 128 may determine from the metadata 116 the type of content 114 included in the email 110. The metadata parsing module 128 may then choose from a plurality of preconfigured views a particular view that corresponds to the type. For example, the metadata parsing module 128 may determine that the email 110 includes travel information and therefore display the email in a travel itinerary view. In another example, the metadata parsing module 128 may determine that the content 114 of the email 110 is a receipt and therefore display the email 110 in a receipt view with other receipts received via email at the client device 104. In a further example the metadata parsing module 128 may determine that the email 110 includes images and open the email 110 in an image viewer. In an implementation, the metadata parsing module 128 performs these actions automatically and without user intervention.
The content from the emails is combined that pertains to a particular event (block 604). The content 114, for example, may correspond to a particular date range, to a particular location that is not a user's home or business location (e.g., a trip), have a particular title (e.g., birthday party, wedding), and so on. Content 114 that corresponds to the particular event may then be combined into a view. In an implementation, specific content 114 is selected form the emails 110 such that some of the content from the email is not combined. For example, the content 114 to be combined might describe flight arrival and departure times. However, other content 114 (e.g., advertising) that is not considered pertinent in the view is not combined. Thus, the metadata parsing module 128 may leverage the metadata 116 to locate content 114 of potential interest to a user of the client device 104. The combined content is then output that pertains to the particular event in a user interface at the client device (block 606), e.g., the user interface 302 that displays a travel itinerary of
Although the invention has been described in language specific to structural features and/or methodological acts, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed invention.
Number | Name | Date | Kind |
---|---|---|---|
6606644 | Ford et al. | Aug 2003 | B1 |
6704771 | Gough | Mar 2004 | B1 |
6784899 | Barrus et al. | Aug 2004 | B1 |
6895438 | Ulrich | May 2005 | B1 |
6965926 | Shapiro et al. | Nov 2005 | B1 |
7512659 | Keohane et al. | Mar 2009 | B2 |
7599952 | Parkinson | Oct 2009 | B2 |
7865394 | Calloway et al. | Jan 2011 | B1 |
9185064 | Craddock et al. | Nov 2015 | B2 |
20020013692 | Chandhok et al. | Jan 2002 | A1 |
20020073117 | Newman | Jun 2002 | A1 |
20020078158 | Brown et al. | Jun 2002 | A1 |
20020107931 | Singh et al. | Aug 2002 | A1 |
20030018731 | Watanabe et al. | Jan 2003 | A1 |
20030135659 | Bellotti et al. | Jul 2003 | A1 |
20030212902 | van der Made | Nov 2003 | A1 |
20030217061 | Agassi et al. | Nov 2003 | A1 |
20040003097 | Willis et al. | Jan 2004 | A1 |
20050010646 | Shiina | Jan 2005 | A1 |
20050027779 | Schinner | Feb 2005 | A1 |
20050038861 | Lynn et al. | Feb 2005 | A1 |
20050044003 | O'Keeffe et al. | Feb 2005 | A1 |
20050060341 | Shiina | Mar 2005 | A1 |
20050154692 | Jacobsen et al. | Jul 2005 | A1 |
20050193369 | Brumme et al. | Sep 2005 | A1 |
20050278626 | Malik | Dec 2005 | A1 |
20060020548 | Flather | Jan 2006 | A1 |
20060064469 | Balasubrahmaniyan et al. | Mar 2006 | A1 |
20060080269 | MacLaurin | Apr 2006 | A1 |
20060080278 | Neiditsch et al. | Apr 2006 | A1 |
20060150256 | Fanton et al. | Jul 2006 | A1 |
20060161868 | Van Dok et al. | Jul 2006 | A1 |
20060190830 | Gerstl et al. | Aug 2006 | A1 |
20060224937 | Sudoh et al. | Oct 2006 | A1 |
20060259763 | Cooperstein et al. | Nov 2006 | A1 |
20070016609 | Kim et al. | Jan 2007 | A1 |
20070078872 | Cohen | Apr 2007 | A1 |
20070257916 | Krishnamoorthi | Nov 2007 | A1 |
20070271129 | Dutton et al. | Nov 2007 | A1 |
20080046831 | Imai et al. | Feb 2008 | A1 |
20080086703 | Flynt et al. | Apr 2008 | A1 |
20080119168 | Farkas et al. | May 2008 | A1 |
20080126353 | Baude et al. | May 2008 | A1 |
20080127292 | Cooper et al. | May 2008 | A1 |
20080141154 | Balassanian | Jun 2008 | A1 |
20080147814 | Damm et al. | Jun 2008 | A1 |
20080163359 | Conti et al. | Jul 2008 | A1 |
20080244022 | Johnson | Oct 2008 | A1 |
20080306972 | Wilkin et al. | Dec 2008 | A1 |
20090013053 | Wehner et al. | Jan 2009 | A1 |
20090030774 | Rothschild et al. | Jan 2009 | A1 |
20090077182 | Banjara et al. | Mar 2009 | A1 |
20090089380 | Wang et al. | Apr 2009 | A1 |
20090100073 | Dargahi et al. | Apr 2009 | A1 |
20090100332 | Kanjilal et al. | Apr 2009 | A1 |
20090106674 | Bray et al. | Apr 2009 | A1 |
20090112806 | Cheng et al. | Apr 2009 | A1 |
20090138937 | Erlingsson et al. | May 2009 | A1 |
20090157818 | Cook et al. | Jun 2009 | A1 |
20090177962 | Gusmorino et al. | Jul 2009 | A1 |
20090183251 | Deinlein et al. | Jul 2009 | A1 |
20090307615 | Jalon et al. | Dec 2009 | A1 |
20100005399 | Friedman et al. | Jan 2010 | A1 |
20100024036 | Morozov et al. | Jan 2010 | A1 |
20100030860 | Iwasawa et al. | Feb 2010 | A1 |
20100057864 | Laird-McConnell | Mar 2010 | A1 |
20100125448 | Goswami | May 2010 | A1 |
20100161903 | Sato et al. | Jun 2010 | A1 |
20100223664 | Naranjo et al. | Sep 2010 | A1 |
20100299396 | Memon et al. | Nov 2010 | A1 |
20110066692 | Ciancio-Bunch et al. | Mar 2011 | A1 |
20110078612 | Matsuzawa et al. | Mar 2011 | A1 |
20110145768 | Leffert et al. | Jun 2011 | A1 |
20110145926 | Dalcher et al. | Jun 2011 | A1 |
20110167354 | Raghunath et al. | Jul 2011 | A1 |
20110179362 | Craddock et al. | Jul 2011 | A1 |
20110191098 | Thomas et al. | Aug 2011 | A1 |
20110208732 | Melton et al. | Aug 2011 | A1 |
20110225257 | Tilden et al. | Sep 2011 | A1 |
20110246945 | Caine et al. | Oct 2011 | A1 |
20110302258 | Huynh et al. | Dec 2011 | A1 |
20120023416 | Khoo | Jan 2012 | A1 |
20120042025 | Jamison et al. | Feb 2012 | A1 |
20120321196 | Tanigawa et al. | Dec 2012 | A1 |
Number | Date | Country |
---|---|---|
1610907 | Apr 2005 | CN |
1771498 | May 2006 | CN |
101681357 | Mar 2010 | CN |
1182600 | Feb 2002 | EP |
1236331 | Jul 2003 | EP |
WO-0052551 | Sep 2000 | WO |
WO-2009108387 | Sep 2009 | WO |
Entry |
---|
“International Search Report”, dated Apr. 28, 2011, Application No. PCT/US2010/049005, Filed Date: Sep. 15, 2010, pp. 10. |
“Webmaster Tool Help”, Retrieved at << http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=99170>>, Feb. 24, 2010, pp. 2. |
Max., “Google Visualization API”, Retrieved at << http://www.maxkiesler.com/2009/07/19/google-visualization-api/>>, Jul. 19, 2009, pp. 2. |
Ukelson, Jacob., “Combining Structured, Semistructured and Unstructured Data in Business Applications”, Retrieved at << http://www.information-management.com/infodirect/20061201/1069202-1.html >>, Dec. 2006, pp. 5. |
“Xoopit Team Blog”, Retrieved from: <http://blog.xoopit.com/> on Apr. 23, 2010, (Jul. 22, 2009),8 pages. |
“Triplt—Travel Itinerary”, Retrieved from: <http://www.tripit.com/> on Apr. 23, 2010, (Apr. 23, 2010),1 page. |
“Final Office Action”, U.S. Appl. No. 12/688,479, dated May 8, 2014, 31 pages. |
“Extended European Search Report”, EP Application No. 11733268.4, dated Mar. 5, 2014, 8 pages. |
“International Search Report and Written Opinion”, Application No. PCT/US2011/020827, dated Aug. 19, 2011, 9 pages. |
“Java Virtual Machine”, Wikipedia, Dec. 30, 2009, 6 pages. |
“Non-Final Office Action”, U.S. Appl. No. 12/688,479, dated Sep. 12, 2014, 28 pages. |
“Notice of Allowance”, U.S. Appl. No. 12/688,479, dated Jul. 2, 2015, 12 pages. |
“Foreign Office Action”, CN Application No. 201110112082.5, dated May 22, 2015, 13 Pages. |
“Final Office Action”, U.S. Appl. No. 12/688,479, (dated Aug. 23, 2012), 28 pages. |
“11 Ways Computer Viruses are Spread”, retrieved from <http://antivirus-software.topchoicereviews.com/11-ways-computer-viruses-are-spread—216.html> on Aug. 18, 2013 using the version captured on Dec. 2, 2008 from www.archive.org, (Dec. 2, 2008), 3 pages. |
“How Does a Computer Get Infected with a Virus or Spyware?”, retrieved from <http://www.computerhope.com/issues/ch001045.htm> on Aug. 18, 2013 using the version captured on Apr. 11, 2008 from www.archive.org, (Apr. 11, 2008), 3 pages. |
“Non-Final Office Action”, U.S. Appl. No. 12/688,479, (dated Sep. 9, 2013), 37 pages. |
“Foreign Office Action”, CN Application No. 201180006005.X, dated Mar. 2, 2015, 22 pages. |
“Final Office Action”, U.S. Appl. No. 12/688,479, dated Feb. 24, 2015, 31 pages. |
“Email Marketing Solutions (Formerly Email Labs)”, Website, 2009 Lyris Inc., retrieved from <http://www.lyris.com/solutions/lyris-hq/email-marketing/> on Nov. 9, 2009, 2 pages. |
“Non-Final Office Action”, U.S. Appl. No. 12/688,479, (dated Feb. 6, 2012), 35 pages. |
Bellotti, Victoria et al., “Taking Email to Task: The Design and Evaluation of a Task Management Centered Email Tool”, Conference on Human Factors in Computing Systems, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, (2003), 8 pages. |
Hendrickson, Mark “Fuser: Manage All Your Email and Social Networking Messages in One Place”, retrieved from <http://www.techcrunch.com/2007/09/25/fuser-manage-all-your-email-and-social-networking-messages-in-one-place/,(Sep. 25, 2007), 16 pages. |
Surendran, Arun C., et al., “Automatic Discovery of Personal Topics to Organize Email”, Microsoft Research, 2nd Conference on Email and Anti-Spam, retrieved from <http://www.ceas.cc/papers-2005/145.pdf,(Jul. 2005), 6 pages. |
“Foreign Office Action”, CN Application No. 201180006005.X, dated Oct. 29, 2015, 22 pages. |
“Corrected Notice of Allowance”, U.S. Appl. No. 12/688,479, dated Oct. 13, 2015, 7 pages. |
“Extended European Search Report”, EP Application No. 10850394.7, dated Feb. 20, 2015, 7 pages. |
“Office Action Issued in European Patent Application No. 10850394.7”, dated Feb. 19, 2016, 5 Pages. |
Number | Date | Country | |
---|---|---|---|
20110264685 A1 | Oct 2011 | US |