This disclosure relates to malware detection.
The prevalence and accessibility of computer networks require security measures to protect valuable information. An enterprise, for example, can implement such security measures by using multiple systems at the network edge of the enterprise, e.g., firewalls, gateway security agents, or software security systems in each computing device.
Internally distributed deployment of security solutions have processing inefficiencies. The same file may be inspected by many distributed security systems and malware detection software.
Malware detection software must be updated periodically on user's computing devices and gateway security systems. As new malware is found, new signatures and/or logic must be added. Distribution of changes in such software programs is expensive and time-consuming. Another issue is that for small/mobile computing devices such as phones, PDAs, and Laptops, malware detection programs consume considerable space and require considerable processing time.
Yet another problem is the number of devices on which malware detection programs must be updated. Typically, organizations have several thousand computing systems, several operating systems, and hardware platforms and malware products from different vendors.
One alternative applicable for enterprise users is to run malware detection programs on gateway systems such as integrated firewalls. In this case, the upgrades are applied only to the firewall systems. However, there is no direct way of knowing whether the gateway protection is working. For instance, a new malware will be not detected if it reached the user's computer before a corresponding signature is upgraded in the gateway.
Another alternative is the use of a hosted malware detection service where files are sent to a remote service for inspection. Although this permits the use of a centralized upgrade to malware programs, the data traffic to the hosted service point can consume valuable uplink bandwidth and can result in a speed bottleneck for the inspection of files. For this reason, hosted services are not used by end-users. In addition, there is the possibility of accidental information leakage when information is transmitted outside of an enterprise network. Documents that contain sensitive information must not be sent for external inspection.
The subject matter described in this specification is directed to malware detection. A simple scanning agent runs on a computing device to compute and send signatures of selected files to a malware detection service located on an external network to the computing device. The malware detection service identifies whether files are trusted, i.e., do not contain malware, or untrusted, i.e., likely to or containing malware, and reports this information back to the computing device. The computing device transitively builds a list of trusted files. When all files are trusted the computing device can be deemed trusted. Additions of new programs and data files are examined by the malware detection service using minimal data transfer. Typically very few bytes, e.g., 16 bytes, of signature information along with very few bytes, e.g., 4 bytes, of document length is sent instead of several megabytes of data per file. Only files that are changed since the last inspection in its signature, length or last modified date need to be sent.
In general, one aspect of the subject matter described in this specification can be embodied in systems that include a malware detection service external to network edges of at least one external system, where the malware detection service is configured to receive a request from a computer within the at least one external system, the request identifying a signature associated with content. The malware detection service is further configured to identify a status indicator of the content using the signature, and transmit the status indicator to the computer. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.
According to another aspect, the subject matter described in this specification can be embodied in systems that include an access agent located within the network edges of a system, where the access agent is configured to generate a signature for content residing within the network edges of the system, the signature generated using a hashing algorithm. The access agent is also configured to transmit the signature to a malware detection service located external to the network edges of the system, and receive a status indicator for the content from the malware detection service. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.
The subject matter described in this specification also includes other aspects. One or more of the following advantages can be realized by implementations of the subject matter described in this specification. The manageability of malware detection and prevention is enhanced, resulting in reduced processing time, upgrade costs, and information leakage.
The details of one or more embodiments of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will become apparent from the description, the drawings, and the claims.
Like reference numbers and designations in the various drawings indicate like elements.
The external systems 120, 130, 140, can, for example, include a firewall protecting an internal network that can include one or more enterprise servers The systems 120, 130, 140 may communicate with the WAN 101 through one or more network devices, such as a router, gateway, etc.
In some implementations, a client access agent (software) is included in one or more client computers 120, 130, and 140 within or comprising the external systems 120, 130, and 140. In other implementations the clients will not have their own access agent, rather another computer will run the access agent which will use the enterprise LAN file share system to access the client files and use the internet or other WAN to communicate with the MDS that performs malware detection. The client access agent facilitates security processing by providing hash values of files on a user computer to the malware detection service 110 for malware detection. Other security operations can also be facilitated by the access agent.
The systems described with respect to
A functional block diagram 200 of an example client access agent on a client computer is shown in
The signature of files on the client computer can be transmitted to the MDS for analysis by an MDS Request Processor 225. The transmission of a hash (or digest) instead of a whole file results in a significant reduction of transmission time, particularly for systems having a large number of files. For instance, in a digest, typically 16 bytes of information is transmitted to the MDS for each file. In a system having 20,000 modified files, this would amount to a total 400,000 bytes of data, which can be transferred to the MDS in seconds.
Upon receiving a response from the MDS that a file is trusted, untrusted, or unknown, a local (or enterprise) table of file signatures 250 can be updated by the MDS Request Processor 225. In particular, the table can be updated to reflect that the received status indicator is associated with a particular signature. For instance, a status indicator may be that a file is trusted or untrusted. The file can be indexed by its signature, e.g., MD5 value. If a response of unknown is returned by the MDS, the access agent can transmit the entire file to the MDS for inspection to determine whether the file is trustworthy. According to some implementations, a file having a different name may be trusted if its file size and hash match those of a file previously deemed as trusted.
The table of file signatures 250 permits the access agent to build a list of trusted files on the client computer. According to some implementations, the table of file signatures and their respective status indicators may be used by the MDS request processor 225 to identify whether programs were previously examined by the MDS and deemed trusted or untrusted such that a further request to the MDS is not required for those files. Thus, when the access agent has populated the local table of file signature 250, further transmissions to the MDS occur only if a file signature is changed or if new files are added.
A functional block diagram 300 of an example MDS 300 is shown in
The MDS 300 is operable to receive file content for inspection at a malware scanner 310. This can occur, for instance, when new file content is identified but has not yet been assigned as trusted or untrusted by the MDS 300. New file content can represent a new or updated file, such as a new file created by a client computer. The malware scanner 310 is operable to scan the file content to determine whether the content is trusted or untrusted.
The file content and file name are also received at a hash processor 305. The hash processor 305 executes the same hash as performed by hash processor 205 of the access agent 200, as described with respect to
The output of the hash processor 305 and malware-scanner 310 is inserted into a table of file signatures 350 together with a status indicator, for instance, trusted or untrusted. According to some implementations, the table of file signatures 350 can represent a global table for all files on client computers within a particular system. The table contains the signatures, e.g., MD5 values, for known good files (i.e., trusted files) and malware (i.e., untrusted files). According to some implementations, the MDS 300 can also maintain a second table (not illustrated) that includes a transient list of signatures of recently scanned good files that are sent to a specific client computing device. The second table can also contain signatures of files that the client computing device trusts using configured rules. Thus, both a global malware table or an enterprise-specific table can be maintained.
As shown in
In some implementations, when the AA request processor 320 does not find a matching hash signature in the global table 350, the AA request processor 320 can consult a second table that includes a transient list of signatures of recently scanned good files that are sent to a specific client computing device. For instance, if no information on the file “word.exe” is stored within the global table 350, but the client computing device determines the file to be trusted (e.g., ‘good’), then the client may assume that anything created by “word.exe” is good and corresponding signatures for those files may be stored locally at the client computing device. Thus, for instance, a file “abc.doc” created by the trusted “word.exe” and its signature is stored locally. In some implementations, locally stored signatures may not be shared with other networks. If the AA request processor 320 does not find a matching signature in either table, the processor 320 will transmit a response to the client computer that the content is unknown. If that occurs the access agent of the client computer may send the entire file content to the MDS for inspection.
Malware created to have a signature that matches that of trusted content could limit the utility of the MDS. For instance, malware could be generated having a random sequence of bytes which do not affect the malware (e.g., comments in scripts, NOOPs, and data bytes in executable programs, etc.) The random bits could be modified until the malware's signature matches one of the signatures of the known good programs.
In order to prevent the attack from succeeding, the access agent can prepend the file content with a random sequence of bytes. The random sequence of bytes may be generated, for instance, by the access agent, computer, or another component in the system. For instance, the random sequence can be randomly generated by MDS and communicated to access agent, which could also reduce the number of global tables required to be maintained. According to an example, if f1 and f2 are two files wherein f1 is a known good file and f2 is malware. If f2 was constructed by a malware creator such that the signature of f1 is the same as the signature of f5 (e.g., MD5(f1)=MD5(f2)), then a random sequence of bytes ‘r’ should be added such that the MD5 signature of r.f1 is not equal to the signature of r.f2 (e.g., MD5(r.f1) MD5(r.f2) where r.f1 denotes contents of f1 prepended by sequence r and similarly r.f2 denotes contents of f2 prepended by r). The random sequence of bytes may be changed periodically.
Stage 402 identifies content, and optionally, a file name and a file size. The content is identified for a determination whether the content is malware and thus should not be ‘trusted.’ According to some implementations, the access agent identifies content on a client computer on which the access agent resides. According to some implementations, the access agent identifies content on servers, computers, or other devices in an enterprise 120, 130, 145, and 155.
Stage 404 generates a signature using a hashing algorithm. In particular, a signature is generated by hashing the content, and optionally, the file name. According to some implementations, the signature can be generated by the hash processor 205 within the access agent. As an example, the signature can be generated by an MD5 algorithm.
Stage 406 determines whether a signature exists in a table local to the access agent. If the signature exists in the table, stage 408 uses the local table to identify if the content is trusted or untrusted. According to some implementations, this may be performed by the MDS request processor 225 of the access agent. If the signature fails to exist in the table, stage 410 transmits the signature to the MDS 300 for analysis, for instance, by an MDS Request Processor 225.
Stage 412 receives a response from the MDS 300 identifying the content as trusted, untrusted, or unknown. The response is received, for instance, at the access agent from an AA request processor 320.
If the content is identified as unknown at Stage 414, the content may optionally be transmitted to the MDS 300 at Stage 418, for instance, by the access agent. A hash processor 305 of the MDS 300 can receive the content at the MDS 300. In stage 420 a response is received from the MDS identifying the content as trusted or untrusted. The response is received from the MDS by the access agent. Alternatively, if the content is not unknown at Stage 414, the content is identified as trusted or untrusted, for instance, by the access agent.
Stage 502 identifies whether the content (e.g., file content) or a signature is received. According to some implementations, the determination is made by the MDS 300 in receipt of a transmission from an access agent.
If the content is received, Stage 506 identifies content is, and optionally, a file name and a file size. Next, Stage 508 generates a signature by hashing the content (and optionally the file name and/or file size). For instance, the hash processor 305 of the MDS 300 can generate a signature using a hash algorithm such as MDS. Stage 510 scans the content to determine whether the content is trusted or untrusted, and can identify the content as such. The malware scanner 310 within the MDS, for instance, can execute these functions. In some implementations, if the signature generated by hash processor 305 is already in a global table or a secondary table, the status indication from that table maybe be reported, and the scan of stage 510 may be omitted. After a signature is generated and the content is identified as trusted or untrusted, the signature and status indicator (i.e., trusted or untrusted) can be added to one or more tables. For instance, this information may be added to a global table or a secondary table as described above with reference to
If a signature is received, Stage 504 performs a lookup of the signature in one or more tables. For instance, as described with respect to
If at Stage 514 the signature is determined to exist in the table(s), Stage 516 identifies the content as trusted or trusted, for instance, based on a status indicator in the table. Stage 522 transmits an identification of the content as trusted or untrusted to the client computer. If at Stage 514 the signature is determined not to exist in the table(s), Stage 518 identifies the content as unknown and Stage 522 transmits an identification of the content as unknown to the client computer. The response is transmitted, for instance, by the AA request processor 320 and is received, for instance, at the access agent.
Embodiments of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures, disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Embodiments of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible program carrier for execution by, or to control the operation of, data processing apparatus. The tangible program carrier can be a propagated signal or a computer-readable medium. The propagated signal is an artificially generated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to suitable receiver apparatus for execution by a computer. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter affecting a machine-readable propagated signal, or a combination of one or more of them.
A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or another unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, subprograms, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
Additionally, the logic flows and structure block diagrams described in this patent document, which describe particular methods and/or corresponding acts in support of steps and corresponding functions in support of disclosed structural means, may also be utilized to implement corresponding software structures and algorithms, and equivalents thereof. The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices.
Computer readable media suitable for storing computer program instructions and data include all forms of non volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD ROM and DVD ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
To provide for interaction with a user, embodiments of the subject matter described in this specification can be implemented on a computer having a display device, e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input.
Embodiments of the subject matter described in this specification can be implemented in a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described is this specification, or any combination of one or more such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (“LAN”) and a wide area network (“WAN”), e.g., the Internet.
The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Particular embodiments of the subject matter described in this specification have been described. Other embodiments are within the scope of the following claims. For example, the actions recited in the claims can be performed in a different order and still achieve desirable results. As one example, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.
This written description sets forth the best mode of the invention and provides examples to describe the invention and to enable a person of ordinary skill in the art to make and use the invention. This written description does not limit the invention to the precise terms set forth. Thus, while the invention has been described in detail with reference to the examples set forth above, those of ordinary skill in the art may effect alterations, modifications and variations to the examples without departing from the scope of the invention.
The present patent/application is a continuation of U.S. patent application Ser. No. 12/185,484, filed Aug. 4, 2008, and entitled “CLOUD-BASED MALWARE DETECTION,” the contents of which are incorporated by reference herein.
Number | Date | Country | |
---|---|---|---|
Parent | 12185484 | Aug 2008 | US |
Child | 15856380 | US |