The described embodiments set forth a technique for annotating and/or marking attachments in electronic messages.
People in most organizations communicate with one another by exchanging electronic messages (e.g., electronic mail (email) messages, text messages, instant messages, etc.). Generally, a sender of an electronic message includes various types of attachments (e.g., documents, images, etc.) in the electronic message.
Oftentimes, the sender or recipient desires to convey, share, or highlight particular information associated with the attachment or portions of the attachment. While it is common to include text along with the attachment in the electronic message, the text is included separate from the attachment and does not adequately emphasize relevant portions of the attachment. Consequently, there is a need for the sender or the recipient to be able to mark and/or annotate particular portions/sections of the attachment directly within the electronic message such that relevant portions of the attachment can be adequately emphasized.
Representative embodiments set forth herein disclose various techniques for annotating and/or marking attachments in electronic messages (for example, email). In particular, the embodiments set forth various techniques for allowing a user to edit attachments included in the email. The user can edit (i.e., markup and/or annotate) the attachments directly within an email window displayed via an email client. According to one embodiment, the user can include and edit an attachment while composing a new email via the email client. In another embodiment, the user can reply to a received email that includes a received attachment. In this case, the user can edit the received attachment while replying to the email. The user can also include and edit another attachment in the reply.
To allow the user to edit the attachment (either while composing a new email or replying to a received email), the email client is configured to launch a markup application within the email window that displays the attachment. The markup application generates an editable version of the attachment within the email window. The markup application also presents a toolbar that includes multiple buttons that can be selected by the user to perform various operations (e.g., draw, add text, add arrows, etc.) on the editable version of the attachment. The markup application tracks the edits made to the attachment. When an input to close the markup application is received, the edits are applied to the attachment to generate a modified attachment within the email window. In this manner, the email client allows the user to make edits to attachments directly within the email window (i.e., without having to leave the email window).
This Summary is provided merely for purposes of summarizing some example embodiments so as to provide a basic understanding of some aspects of the subject matter described herein. Accordingly, it will be appreciated that the above-described features are merely examples and should not be construed to narrow the scope or spirit of the subject matter described herein in any way. Other features, aspects, and advantages of the subject matter described herein will become apparent from the following Detailed Description, Figures, and Claims.
Other aspects and advantages of the embodiments described herein will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the described embodiments.
The included drawings are for illustrative purposes and serve only to provide examples of possible structures and arrangements for the disclosed inventive apparatuses and methods for providing wireless computing devices. These drawings in no way limit any changes in form and detail that may be made to the embodiments by one skilled in the art without departing from the spirit and scope of the embodiments. The embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements.
Representative applications of apparatuses and methods according to the presently described embodiments are provided in this section. These examples are being provided solely to add context and aid in the understanding of the described embodiments. It will thus be apparent to one skilled in the art that the presently described embodiments can be practiced without some or all of these specific details. In other instances, well known process steps have not been described in detail in order to avoid unnecessarily obscuring the presently described embodiments. Other applications are possible, such that the following examples should not be taken as limiting.
Typically, various organizations utilize email clients to allow users to exchange emails. An email client is an application that enables a user to receive, compose, send, and organize emails. The email client can include a native email client that is configured to run on a particular platform, such as a Mac-based email client developed for the Mac OS (operating system). Oftentimes, a user includes an attachment (for example, an image, a document, etc.) in an email and provides some information associated with the attachment in the form of text in the email. This text is provided separately (i.e., a separate area in an email window/interface) from the attachment.
As previously noted herein, the separately provided text does not adequately emphasize relevant portions of the attachment. Accordingly, the embodiments set forth herein provide various techniques for marking and/or annotating attachments directly within the email window such that relevant portions of the attachment can be adequately emphasized. In particular, the email client enables the user to edit the attachment in-place within the email window (i.e., without leaving the email).
According to one embodiment and to achieve the foregoing techniques, the email client is configured to launch a markup application within the email window that allows the user to edit the attachment displayed in the email window. The markup application generates an editable version of the attachment within the email window. The editable version of the attachment maintains the appearance (in terms of shape, size, and/or other attributes) of the original attachment and enables the user to edit the attachment in-place within the email window.
According to one embodiment, once the user has completed the edits, the markup application is closed and a modified attachment including the edits is displayed within the email window. Any edits made are stored within a metadata portion of the modified attachment. If the user chooses to make further edits to the modified attachment, the email client launches the markup application again. The markup application extracts the edits stored in the metadata and generates an editable version of the modified attachment to allow the user to make further edits. The user is allowed to make edits up until the email is sent. Prior to sending the email, the email client removes the metadata portion of the attachment.
According to another embodiment, the metadata portion of the modified attachment is encrypted by the markup application. By encrypting the metadata associated with the edits, associated information can be kept secure and protected from external entities. For example, if the user tries to send the email via a third-party mail client rather than the email client (i.e., the native email client), the encryption of the metadata is necessary because the third-party mail client does not remove the metadata portion prior to sending the email.
Accordingly, the foregoing approaches provide techniques for editing attachments within emails. A more detailed discussion of these techniques is set forth below and described in conjunction with
According to the illustration of
The email client 116 is utilized by a user of the client device 110 to receive, compose, send, and organize emails. The email client 116 communicates with the mail server 120 to send and receive emails in a known manner, as will be appreciated to those of skill in the art.
According to one embodiment, the email client 116 can be utilized by the user to compose a new email message. As will be appreciated, a user can select a “New Message” button displayed in a toolbar or press “Command-N” to open a new message window. For example, email client 116 can display a new message window 200 (as shown in
Below the toolbar 210, the new message window 200 includes a “To” field, a “Cc” field, a “Bcc” field, and a “Subject” field, as will be appreciated. Toolbar 210 further includes a “From” menu that enables the user to select a particular account from which the user desires to send the email that is being created. When the user selects the “From” menu, a number of email accounts configured with the email client 116 are displayed of which the user selects the particular desired account.
A bottom portion of the new message window 200 includes a message body 220. The user can formulate the email message within the message body 220. Typically, the user includes text, attachments, links, and/or other items within the message body 220. The user can select one or more attachments 230 (referred to hereinafter as “the attachment 230”) to be included in the message body 220 by selecting the attach document button 214. In some cases, the user can drag the attachment 230 into the message body instead of or in addition to selecting the attach document button 214. The attachment 230 can be displayed directly within the message body 220. The attachment 230 can include an image, a document, and/or other type of attachment. In one embodiment, the attachment 230 includes an image in any image file format (for example, JPEG, PNG, TIFF, BMP, GIF, or other formats). In one embodiment, the attachment 230 includes a document in a portable document format (PDF).
The user can format the text in the message body 220 using different fonts, sizes, colors, and alignment by selecting the show format bar button 216. The user can select one or more images/photos to be included in the message body 220 from a personal photo library by selecting the show/hide photo browser button 218.
According to one embodiment, once the attachment 230 is included in the message body 220, a user may edit the attachment 230 directly within the message body 220. The email client 116 detects the attachment 230 within the message body 220. The email client 116 determines a type of the attachment 230. For example, the email client 116 may determine that the attachment 230 is an image (of a particular format) or a PDF document.
Upon selection of the attachment 230, email client 116 displays an icon 240 around the top-right corner of the attachment 230. The icon 240 and the placement of the icon 240 on attachment 230 is exemplary, and other graphical elements and placements can be utilized without departing from the scope of this disclosure. In one embodiment, the user may select the attachment 230 by moving the pointer 235 over the attachment 230. In other words, movement of the pointer 235 over the attachment 230 causes the email client 116 to display the icon 240.
Selection of icon 240 causes the email client 116 to display a menu of services 242, as shown in
Email client 116 displays the list of identified services received from the services infrastructure 130 in the menu of services 242. A user can select the markup service 244 as shown in
According to one embodiment, the markup application generates an editable version of the attachment 250 (referred to hereinafter as “editable version” 250) within the message body 220, as shown in
In addition to the editable version 250, the markup application displays a toolbar 260 that includes a number of buttons 261, 262, 263, 264, 265, 266. Each of these buttons 261, 262, 263, 264, 265, 266 can be selected by the user to perform various operations on the editable version 250. For example, button 261 can be selected to draw on the editable version 250, button 262 can be selected to add text to the editable version 250, button 263 can be selected to crop a portion of the editable version 250, button 264 can be selected to add arrows/pointers to a portion of the editable version 250, button 265 can be selected to erase a portion of the drawing/text added to the editable version 250, and button 266 can be selected to close the markup application. The user may select one or more of the buttons 261, 262, 263, 264, 265, 266 to markup and/or annotate the editable version 250. Other buttons associated with other operations may be included in the toolbar 260. Also, other selectable graphical elements such as icons may be used instead of or in addition to the buttons 261, 262, 263, 264, 265, 266, as will be appreciated.
For example, the attachment 230 can include an image (e.g., a raster image) which is edited by the markup application to generate a modified image. The image is edited by manipulating the pixels of the image. The edits (for example, drawing 270) made to the modified image can be burnt into the image in terms of pixels. However, if the user were to launch the markup application again to make any changes to the edits or make new edits to the image, the markup application allows the user to make changes to the edits as though the edits were not burnt into the image. This is made possible by storing edit data (i.e., data associated with the edits) in a metadata portion of the modified image. In one embodiment, when the attachment 230 includes a PDF document, the markup application also supports standard annotations provided by the PDF file format.
According to an embodiment, the original attachment 230 includes original metadata associated with the original attachment 230. For an image, the metadata can include information such as image size, image resolution, date of creation, and/or other information. For a document, the metadata can include information such as, document size, author of document, date of creation, summary of document, and/or other information. Once edits are made and the markup application is closed, the markup application can add the edit data to a metadata portion of the modified attachment. Thus, the metadata portion of the modified attachment 280 includes the original metadata and edit data associated with the edits. For example, when the attachment is an image, the modified image includes the original image and edits and the metadata portion of the modified image includes the original image metadata and the edit data.
If the user chooses to make further edits to the modified attachment 280, the user can move the pointer over the modified attachment 280, select icon 240, select markup service 244 and the markup application can be launched again in a manner similar to that described in
Once the user has completed composing the email and editing the attachment, the user can select the send button 212 to send the email. Prior to sending the email, the email client 116 removes the metadata portion of the modified attachment 280. The email client 116 can remove the edits from the metadata by calling appropriate APIs (application programming interfaces). A recipient of the email is capable of viewing the modified attachment 280 (with the edits) using any application or on any platform. In other words, the modified attachment 280 is application and platform independent.
According to another embodiment, the metadata portion of the modified attachment 280 is encrypted by the markup application. When the email client 116 (which is the native email client) is used to send the email with the modified attachment 280, the email client 116 can remove the metadata portion from the modified attachment (i.e., the metadata portion is completely stripped out from the modified attachment 280 prior to sending the email). However, when a user uses a third-party mail client (for example, a web-based mail client or other non-native email client) to send the email with the modified attachment 280, the metadata portion (including the edit data) needs to be kept secure and protected from external entities by encrypting the metadata portion. This is because the third-party mail client does not remove the metadata portion of the modified attachment 280 prior to sending the email. For example, a user may have edited a legal document within the email by cropping a section of the legal document (i.e., removing a portion of the legal document). The edit data associated with the edits made to the legal document is included in the metadata portion of the legal document. If the third-party mail client is used to send out the email, the metadata portion of the legal document needs to be encrypted to avoid this information from being exposed to malicious entities.
In an exemplary scenario, the user may use the email client 116 (native email client) to compose an email with the attachment 230 and make edits to the attachment 230 within the email. While the user is using the email client 116, the user can keep making edits to the attachment 230. When the user is done making the edits, the modified attachment 280 is displayed within the email and the user may choose to save the email as a draft. Thereafter, the user may open the email with the modified attachment 280 via the third-party mail client. The user can simply view the modified attachment 280 via the third-party mail client but cannot make any edits to the modified attachment 280. For example, in the case of the raster image, the user can view the edits burnt into the image but cannot make any further changes to the image. If the user sends the email via the third-party mail client, the metadata (or edit data) is not compromised because it is encrypted.
According to one embodiment, the user can edit attachments while replying to an email received from another user. For example, the email received from the other user can include an attachment. The user can select a reply button (not illustrated in the FIGs) to reply to a received email that includes a received attachment. In this case, the user can edit the received attachment within the message body of the reply in a manner similar to that described in
According to one embodiment, the user may utilize multiple client devices to edit the original attachment 230. For instance, though
While the techniques for editing attachments have been described in terms annotating and/or marking attachments included in an email message, the techniques can be applied to attachments included in other types of electronic messages as well without departing from the scope of this disclosure.
At step 304, the email client 116 generates a request for services for the attachment 230. The request is communicated to services infrastructure 130 and includes the type and/or format of the attachment 230. The request is generated in response to a user selection of an icon (for example icon 240) displayed on the attachment 230. At step 306, the email client 116 receives a list of services (including a markup service) associated with the attachment 230 from the services infrastructure 130. The received services can allow actions (for example, markup) to be performed on the attachment 230. The email client 116 displays the received list of services in a menu (for example, menu 242).
At step 308, the email client 116 receives a selection of the markup service (example, markup service 244). At step 310, the email client 116 launches a markup application associated with the markup service 244. The markup application is launched within the email and allows the user to edit the attachment directly within the email. The markup application generates an editable version of the attachment within the email (for example, editable version 250). Along with the editable version 250, the markup application displays a toolbar 260 with a number of buttons 261, 262, 263, 264, 265 that can be selected by the user to perform various operations (e.g., draw, add text, add arrows, etc.) on the editable version 250. Once the user has completed the edits, the edits are applied to the attachment 230 to generate a modified attachment (for example, modified attachment 280) and the edits are stored in the metadata portion of the modified attachment 280.
At step 312, email client 116 displays the modified attachment 280. At step 314, the email client 116 receives an input to send the email (by clicking the send button 212, for example). Prior to sending the email, the email client 116 removes the metadata portion of the modified attachment, at step 316.
At step 406, the markup application tracks the edits as they are made to the attachment. At step 408, the markup application generates a modified attachment 280 that includes the edits. The markup application may apply the edits to the attachment 230 to generate the modified attachment 280. At step 410, the markup application adds edit data associated with the edits to a metadata portion of the modified attachment. According to one embodiment, steps 408 and 410 are performed when a user input to close the markup application is received. In one embodiment, the markup application can encrypt the metadata portion of the modified attachment.
The computing device 500 also include a storage device 540, which can comprise a single disk or a plurality of disks (e.g., hard drives), and includes a storage management module that manages one or more partitions within the storage device 540. In some embodiments, storage device 540 can include flash memory, semiconductor (solid state) memory or the like. The computing device 500 can also include a Random Access Memory (RAM) 520 and a Read-Only Memory (ROM) 522. The ROM 522 can store programs, utilities or processes to be executed in a non-volatile manner. The RAM 520 can provide volatile data storage, and stores instructions related to the operation of the computing device 500.
The various aspects, embodiments, implementations or features of the described embodiments can be used separately or in any combination. Various aspects of the described embodiments can be implemented by software, hardware or a combination of hardware and software. The described embodiments can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, DVDs, magnetic tape, hard disk drives, solid state drives, and optical data storage devices. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the described embodiments. However, it will be apparent to one skilled in the art that the specific details are not required in order to practice the described embodiments. Thus, the foregoing descriptions of specific embodiments are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the described embodiments to the precise forms disclosed. It will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings.
Number | Name | Date | Kind |
---|---|---|---|
8271893 | Tighe | Sep 2012 | B1 |
20040268246 | Leban | Dec 2004 | A1 |
20060075041 | Antonoff | Apr 2006 | A1 |
20120284639 | Yuniardi | Nov 2012 | A1 |
20140019843 | Schmidt | Jan 2014 | A1 |
Entry |
---|
Peter Krogh, “Parametric Image Editing”, Nov. 16, 2009, dpbestflow.org, <http://www.dpbestflow.org/image-editing/parametric-image-editing>. |
Peter Krogh, “Metadata Handling”, Mar. 16, 2010, dpbestflow.org, <http://dpbestflow.org/metadata/metadata-handling>. |
“6 Reasons Why You Should Stop Using Desktop Email Clients in Favour of Web-Based Options”, Alcorn, makeuseof.com, <http://www.makeuseof.com/tag/stop-desktop-email-clients-stop-opinion/>, Jan. 20, 2012. |
“Secure email with encrypted PDF, ZIP, Word or Excel,” EncOffice, <http://www.oraxcel.com/projects/encoffice/help/secure_email.html>, Mar. 25, 2008. |
“What Is an API & What Are They Good for?,” Kashyap, makeuseof.com, <http://www.makeuseof.com/tag/api-good-technology-explained/>, Aug. 24, 2010. |
“Working with File Attachments”; IBM Knowledge Center; <http://www.ibm.com/support/knowledgecenter/SSKTWP_8.0.1/com.ibm.notes.help.doc/DOC/H_USING_FILE_ATTACHMENTS_IN_A_DOCUMENT_OVER.html>. |
“IBM Notes”; Wikipedia; <https://web.archive.org/web/20130609031946/http://en.wikipedia.org/wiki/IBM_Notes>; published prior to Jun. 9, 2013. |
“Reduce the Size of Pictures and Attachments in Outlook email messages”; Microsoft; <https://support.office.com/en-us/article/reduce-the-size-of-pictures-and-attachments-in-outlook-email-messages-d0b6b6bf-3b08-4dad-a01c-533719d1c005#ID0EABAAA=Office_2010_-_2013>; (Year: 2016). |
Number | Date | Country | |
---|---|---|---|
20150347368 A1 | Dec 2015 | US |