This invention relates generally to networked communications. More particularly, this invention relates to techniques for augmenting a message to facilitate spam identification.
Unsolicited bulk electronic messages are commonly referred to as spam. Spam may be in the form of an email message, a Short Message Service (SMS) text message, a Multi-Media Service (MMS) message and the like.
There are ongoing efforts to identify and isolate spam messages because they are considered an annoyance to message recipients and they generate unwanted traffic for network operators.
A computer includes a processor and a memory connected to the processor. The memory stores instructions executed by the processor to augment a message with network node attributes derived by linking from an original network node specified in the message to additional network nodes associated with the original network node. Message signatures representing the network node attributes are generated. The message signatures are evaluated to characterize the message.
The invention is more fully appreciated in connection with the following detailed description taken in conjunction with the accompanying drawings, in which:
Like reference numerals refer to corresponding parts throughout the several views of the drawings.
The server 104 also includes standard components, such as a central processing unit 130, input/output devices 134, a bus 134 and a network interface circuit 136. A memory 140 is also connected to the bus 134. The memory 140 stores executable instructions to implement operations of the invention. The modules may include a standard message server 142. The standard message server 142 has an associated message augmentation module 144, which includes executable instructions to augment a message with network node attributes, which are derived from an original network node specified in the message. The original network node may be in the message header or the body of the message.
The memory 140 also stores a message classifier 146, which includes executable instructions to generate message signatures representing features in the message and the network node attributes. The message classifier 146 evaluates the message signatures to characterize the message. For example, the message classifier 146 may compare the message signatures to message signatures known to be associated with spam. If the message signature matches are found, then the message may be deemed spam. The message may then be quarantined and the recipient may be identified about the quarantined message.
Initially, a message is received 200 (e.g., by the message server 142). A message augmentation decision is then made 202 (e.g., by message augmentation module 144). If augmentation is to occur (202—yes), then augmentation criteria is applied 204 to augment the message 206. For example, original network node information, such as a network device name and a network device address may be augmented with network node attributes derived from the original network node information. The network node information may include a starting set of Internet Protocol (IP) addresses and hostnames from any location within a message. An IP address is a numerical label assigned to each device in a computer network that uses the Internet Protocol for communications. A hostname is a label assigned to a device in a computer network. The hostname may be a simple name or may be appended to a domain name. A domain name is a name in the Domain Name System (DNS). A host name has a corresponding IP address. Thus, for a given set of IP addresses and hostnames, related IP addresses and hostnames may be identified. For example, DNS lookups of hostnames and IP addresses may be used to relate a hostname to its DNS name server, relate hostnames to the IP address to which it resolves, etc.
The network node attributes may include naming system records. For example, the naming system may be selected from DNS, Network Information Service (NIS), Server Message Block (SMB), WhoIs, Web Extensible Internet Registration Data Service (WEIRDS) and Alexa®. In the case of DNS, the naming system records may be an address record, a pointer, a name server, a mail exchange and the like. Other useful DNS record types include zone information (SOA), text information (TXT, which often includes Sender Policy Framework (SPF) information and Domain Keys Indentified Mail (DKIM) information. Lookups of a base domain of a hostname may also be useful (e.g., foo.com for mail.foo.com). The resultant response records may be linked to provide features to characterize a message. For example, a tuple may be formed, which includes a query item, response record type and related item. The tuple may then be stored in a database for future reference.
After an initial augmentation of the message, control returns to block 202, where a decision is made whether to further augment the message with additional network node attributes. Thus, potential recursive linking may be invoked to find several levels of network related items. In one embodiment, dynamically updated logic can change which relationships to track between items and how far to expand the set of relationships. For example, the logic could be changed to stop performing certain DNS lookups, start performing other DNS lookups, or to stop expanding the set of relationships at a new depth.
If message augmentation is completed (202—No), then message signatures are generated for the message 208. The message signatures represent features in the message and/or the network node attributes. The message signature may be a string from the message, a hash of such a string or other segment of the message. The message signature may be based upon network node attributes or a hash thereof. Multiple signatures may be associated with a single message.
The message signatures are then evaluated 210. For example, the message signatures are compared to signatures known to be indicative of spam. That is, the generated message signatures are compared to signatures in a database of messages previously identified as spam.
If spam is not identified (212—No), then the message is delivered 214. If spam is identified (212—Yes), then the message may be quarantined 216 and a recipient may be notified 218 of the quarantined message.
The foregoing operations may be used to process the following message:
In this case, the original network nodes include the following Hostnames and IP addresses:
In this example, the message augmentation module 144 performs DNS lookups to find the following relationships, additional hostnames, and IP addresses:
The relationships are added to the message as the following headers, resulting in the following message:
This augmented message may then be processed by the message classifier 146. For example, the message may be deemed spam and may then be quarantined.
Another embodiment of the invention may more deeply utilize the graph of relationships between hostnames and IP addresses. The embodiment uses the relationships of the underlying graph network to define an overlay network of nodes having the same property (for example, a spam characteristic.). For example, consider the following two messages.
These messages may be evaluated, as shown in
Thus, relationships between domain names and IP addresses present in a message may be used to identify related domain names and/or IP addresses that are not present in the message. These relationships can be used to impute spam characteristics to related nodes. For example, if the spammer.com domain is known to be spam, related nodes in the graph of
Any number of processing techniques may be used to uncover relationships between nodes. For example, one procedure may be used to get a full set of information on a single node (domain name or IP address), another procedure may be used to get information on direct neighbor nodes, and another procedure may be used to graph all nodes reachable from a given host node.
Given a fully defined graph of relationships between nodes, algorithms can then examine this graph and spread node characteristics (such as spam categorization) given a method for identifying a root set of nodes combined with one or more inductive steps for spreading node characteristics. For example, one might define the root set of nodes as those already known to have a spam characteristic according to some external source. One inductive step may be defined as “if most of the children of this node have a given characteristic, and the children are related via a specific property, then spread the characteristic to the parent node.” Another might say “if a child node has a relationship of a specific type to a parent node, then spread the characteristic to the child node.” This inductive step is then reapplied with the updated set of nodes to find additional nodes. Repeatedly applying the inductive step spreads the characteristic from the initial root set throughout the graph to additional nodes, resulting in an overlay on the underlying graph of relationships.
Advantageously, the invention provides a technique for expanding the information that may be utilized to identify spam. That is, recursive linking to related hosts and IP addresses increases the opportunities to find taints associated with spam.
An embodiment of the present invention relates to a computer storage product with a computer readable storage medium having computer code thereon for performing various computer-implemented operations. The media and computer code may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well known and available to those having skill in the computer software arts. Examples of computer-readable media include, but are not limited to: magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs, DVDs and holographic devices; magneto-optical media; and hardware devices that are specially configured to store and execute program code, such as application-specific integrated circuits (“ASICs”), programmable logic devices (“PLDs”) and ROM and RAM devices. Examples of computer code include machine code, such as produced by a compiler, and files containing higher-level code that are executed by a computer using an interpreter. For example, an embodiment of the invention may be implemented using JAVA®, C++, or other object-oriented programming language and development tools. Another embodiment of the invention may be implemented in hardwired circuitry in place of, or in combination with, machine-executable software instructions.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that specific details are not required in order to practice the invention. Thus, the foregoing descriptions of specific embodiments of the invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed; obviously, many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, they thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the following claims and their equivalents define the scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
7836133 | Quinlan et al. | Nov 2010 | B2 |
7908328 | Hulten et al. | Mar 2011 | B1 |
8090940 | Fenton | Jan 2012 | B1 |
8260914 | Ranjan | Sep 2012 | B1 |
20020016824 | Leeds | Feb 2002 | A1 |
20040015601 | Whitson | Jan 2004 | A1 |
20050039017 | Delany | Feb 2005 | A1 |
20050091320 | Kirsch | Apr 2005 | A1 |
20050132060 | Mo et al. | Jun 2005 | A1 |
20050198173 | Evans | Sep 2005 | A1 |
20060004896 | Nelson et al. | Jan 2006 | A1 |
20060168006 | Shannon et al. | Jul 2006 | A1 |
20070011324 | Mehr | Jan 2007 | A1 |
20070027992 | Judge et al. | Feb 2007 | A1 |
20070204026 | Berger | Aug 2007 | A1 |
20070220607 | Sprosts | Sep 2007 | A1 |
20080052364 | Zhou | Feb 2008 | A1 |
20090164598 | Nelson et al. | Jun 2009 | A1 |
20090307313 | Wang et al. | Dec 2009 | A1 |
20100332601 | Walter et al. | Dec 2010 | A1 |
20110113109 | Levasseur et al. | May 2011 | A1 |
20110238765 | Wilson et al. | Sep 2011 | A1 |
20110271349 | Kaplan | Nov 2011 | A1 |
20110283357 | Pandrangi et al. | Nov 2011 | A1 |
20120226761 | Emigh et al. | Sep 2012 | A1 |
Number | Date | Country |
---|---|---|
2006048621 | May 2006 | WO |
2010151493 | Dec 2010 | WO |
Entry |
---|
International Search Report and Written Opinion issued to International Patent Application No. PCT/US14/35917, Sep. 25, 2014, 6 pgs. |
Oteo Mayayo, Carlota (Examiner), Extended European Search Report issued to European Patent Application No. 14791954.2, Dec. 12, 2016, 8 pages. |
Stray Penguin—Linux Memo—SPAMBlock unofficial manual, Internet Archive , Aug. 10, 2011, [searched on Jan. 17, 2017], <URL: http://web—archive—org/web/20110810163743/http://www.asahi-net.or.jp/˜aa4t-nngk/spamblock.html>. |
Number | Date | Country | |
---|---|---|---|
20140324985 A1 | Oct 2014 | US |