Enterprise threat detection (ETD) typically collects and stores a large amount/large sets of log data associated with various heterogeneous computing systems (often referred to as “big data”). The collected log data from source computing systems is extracted as events into an ETD system and analyzed/evaluated using forensic-type data analysis tools to identify suspicious behavior and to allow an appropriate response. Among the central functionalities of ETD is the use of patterns to evaluate extracted events. The patterns specify what event characteristics (such as types, numbers, etc.—for example, if a certain number of failed logon events for a particular user are observed in the system) cause an alert to be raise by the ETD system. However, for the same user, the same type of observation (for example, each time a pattern's criteria is met) can result in various alerts reporting a similar issue, which can result in a large number of false positive alerts. This increases the total cost of ownership (TCO) for the ETD system, as the same effort for closing each alert is required, even if the alert is a false positive.
The present disclosure describes methods and systems, including computer-implemented methods, computer program products, and computer systems for providing alerts based on entities in security information and event management (STEM) products.
In an implementation, an enterprise threat detection (ETD) pattern is executed against received log event data from one or more computing systems. Using the ETD pattern, an event threshold is determined to have been exceeded. Entities associated with an alert created based on the exceeded threshold are determined and, at runtime, a severity value is calculated for each determined entity associated with the alert. A selection is received of a determined entity on which to perform mitigation action activities. Mitigation action activities associated with the determined entity are written into an activity record data record. A mitigation action activity is closed on the determined entity and a determination performed that all mitigation action activities associated with all entities related to the created alert have been closed. The created alert is closed.
The above-described implementation is implementable using a computer-implemented method; a non-transitory, computer-readable medium storing computer-readable instructions to perform the computer-implemented method; and a computer-implemented system comprising a computer memory interoperably coupled with a hardware processor configured to perform the computer-implemented method/the instructions stored on the non-transitory, computer-readable medium.
The subject matter described in this specification can be implemented in particular implementations so as to realize one or more of the following advantages. First, alert processing in SIEM systems (or other systems in which data is analyzed according to certain characteristic and that have a goal to have persons checking and processing the outcome of this analysis) is modified and simplified. Instead of looking into single incidents created during the analysis, the view focuses on entities. Usually, any action taken by the person working on such incidents is performed on entities. With this change, the complete information for an entity is provided. The decision on which action to perform (for example, lock a user, change a user's authorization, shutdown a system, block an IP address at the firewall, etc.) can be taken by looking into an overview about all incidents around this entity. Second, an additional advantage is that the number of incidents is reduced. With single incidents, a similar root cause will create more incidents until the root cause is resolved. With the described methodology, focus is placed on an entity. If the same characteristic, etc. keeps causing incidents, it is seen at the entity level. A decision about an action to perform is taken once and it is no longer required to close all single incidents for an entity. Third, incidents caused by multiple entities can also be handled efficiently (for example, several users were involved, or a user and a computing system were involved). Using the described methodology, the same incident is associated and shown at both entities, allowing a more encompassing decision as to mitigating actions. An activity record keeps information associated with each particular entity. Once all entities of an overall higher-level entity are processed, an incident can be closed automatically. Other advantages will be apparent to those of ordinary skill in the art.
The details of one or more implementations of the subject matter of this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will become apparent from the description, the drawings, and the claims.
Like reference numbers and designations in the various drawings indicate like elements.
The following detailed description describes providing alerts based on entities in security information and event management (STEM) products and is presented to enable any person skilled in the art to make and use the disclosed subject matter in the context of one or more particular implementations. Various modifications to the disclosed implementations will be readily apparent to those of ordinary skill in the art, and described principles may be applied to other implementations and applications without departing from scope of the disclosure. Thus, the present disclosure is not intended to be limited to the described or illustrated implementations, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
Enterprise threat detection (ETD) typically collects and stores a large amount/large sets of log data associated with various heterogeneous computing systems (often referred to as “big data”). The collected log data from source computing systems is extracted as events into an ETD system and analyzed/evaluated using forensic-type data analysis tools to identify suspicious behavior and to allow an appropriate response. Among the central functionalities of ETD is the use of patterns to evaluate extracted events. The patterns specify what event characteristics (such as types, numbers, etc.—for example, if a certain number of failed logon events for a particular user are observed in the system) cause an alert to be raise by the ETD system. However, for the same user, the same type of observation (for example, each time a pattern's criteria is met) can result in various alerts reporting a similar issue, which can result in a large number of false positive alerts. This increases the total cost of ownership (TCO) for the ETD system, as the same effort for closing each alert is required, even if the alert is a false positive.
In current ETD systems, to execute patterns and generated alerts, the following configuration steps are typically performed at design time:
With the above-defined configuration, alert creation is chronological. If events possess one or more particular characteristics, an alert is created, and someone (for example, the Monitoring Agent) looks at the created alert to decide how to handle the created alert. A pattern execution will create an alert in case a filter results in sufficient events to exceed a given threshold. The alert is shown to a Monitoring Agent (for example, a person processing alerts or an automated algorithmic process) and the Monitoring Agent can start a workflow to manage the created alert. Some logic applies in order to prevent several alerts to be created for the same event selection. For example, if a pattern looks for a single event within a one-hour timeframe, but the pattern runs every ten minutes, then the single event could be seen up to six times (instead of ignored for the last five pattern executions).
To correct this example issue (and other ETD issues), a high-level methodology to accumulate information from pattern executions into entity data records, and show the accumulated information per entity:
As a result, new views are created, for example:
In the new methodology, alert processing reflects a more natural form of alert processing (that is, the Alert Monitor typically must also decide about what to do for a user, system, or other entity). Generated alerts are not shown chronologically, but instead as an up-to-date list of entities. In typical implementations, this change requires at least:
A decision is made as to which entity (for example, a user, a system, an IP address, and the like) should be processed by the Monitoring Agent. Patterns look for events with a certain characteristic are still executed, but when a certain pattern characteristic is met, no singular alert is raised, but instead the underlying entity (for example, a particular user, is enriched with information. More than one entity can also be enriched (for example, for a brute force attack: a hacker tries to intrude into a system landscape by attempting a brute force attack on several systems): In this case, all potential target systems can be enriched with the information (such as, “someone tried to get access by brute force”). However, the Monitoring Agent will no longer have an unstructured list of “brute force” alerts in its inbox. Instead, the Monitoring Agent's information can be similar to:
General pattern execution from current implantations is retained (for example, filtering of the data, defining of thresholds, groupings, execution frequency or mode). However, changes to current implementations include:
For auditing purposes, any actions of a Monitoring Agent are documented in the ETD system. However, instead of updating the status on the alert directly, a new Activity Record is written which refers to an entity on which the Monitoring Agent worked. The Activity Record contains a reference to all alerts that showed incidents for this entity. This means that information seen by the Monitoring Agent at the time when the entity is processed is visible for auditing purposes. Additionally, the Activity Record contains information on what mitigating actions the Monitoring Agent performed, and the processing status/disposition of the entity in question. After the Monitoring Agent has performed mitigating activity, since the entity-based alert contains information of all affected entities, the alert can be closed as soon as Monitoring Agent activity records show a final (for example, “CLOSED,” “COMPLETE,” etc.) status on all affected entities.
The pattern framework 104 processes the received log events 102 using a periodic job (for example, analyzing log events 102 against ETD patterns (not illustrated) accessible by the pattern framework 104 every one minute, three minutes, etc.). In some implementations, the pattern framework 104 can also be manually triggered or triggered based on the execution of other patterns (to cause additional patterns to be executed to perform additional analysis). In some implementations, if a threshold is exceeded while executing a particular pattern, an alert publishing component 108 creates an alert and writes the created alert into an alert 110 data store. In other implementations or in combination with the above described threshold-based patterns, pattern executions are also possible based on anomalies. For example, an anomaly pattern can compare current behavior of an entity with an average behavior of the same entity in the past. As one specific example, the anomaly pattern can be used to analyze how often a user performed a certain activity during a particular hour and compare the analysis results against an average number of similar activities during the same hour during a last twelve-week period of time. Such as a bank accountant needing to look into customer accounts and performing a certain activity. The accountant usually works on twenty accounts per hour. However, suddenly today from 2-3 pm, the accountant processed 200 accounts. This is ten times as many accounts as usually processed, and could indicate that the accountant is collecting personal/financial information for malicious purposes (such as, information disclosure about a certain group of people, credit card fraud, identity theft, etc.).
At 118, a Monitoring Agent 114 receives a list of prioritized entities associated with the created alert. A severity for each entity was calculated at 116 at runtime. For example, the calculated severity can be used to prioritize the entities in 118. The Monitoring Agent 114 selects an entity to work with (for example, the highest priority entity as displayed in a Graphical User Interface (GUI) list).
The Monitoring Agent 114 performs mitigating actions on the selected entity. An activity record 112 is generated for the actions of Monitoring Agent 114 to permit, for example, compliance monitoring and auditing.
In
The Monitoring Agent 114 performs mitigating actions on the selected entity. At 202, information on the Monitoring Agent 114, actions performed with respect to the selected entity, and other information is written to an activity record for the particular selected prioritized entity. As shown to
Component 206 permits the Monitoring Agent 114 or other user to retrieve auditing (or other) information related to activity records from the activity records 112 data store. For example, a regulatory auditor may wish to audit activities a particular Monitoring Agent 114 took with respect to a particular created alert associated with a user x. Monitoring Agent 114 could ascertain what happened, when, what actions were taken, what was the final dispensation of created alerts, and the like.
At 302, an ETD pattern is executed. In typical implementations, ETD patterns work as: for given filter criteria, a given timeframe (for example, “Last hour”), a given frequency (for example, “every three minutes”), a given grouping (for example, “per user and system”) and selection criteria (for example, a total number of events for filter & group criteria, or a number of distinct values for filter and group criteria), the ETD system counts whether the given threshold of events was exceeded. For example, whether there were more than ten failed logon events for the same user in the same system (here, one perspective of the above-described brute force example). Note, as described above, that other patterns (for example, anomaly patterns) can use statistical (or other analysis) methods, such as “user x logs onto system y three times a day over an average of twelve weeks; if the user x now logs onto system y ten times on a particular day, this deviates significantly from the statistic average and can be considered an anomaly, and an alert is raised. From 302, method 300 proceeds to 304.
At 304, if it is determined that the threshold was exceeded, method 300 proceeds to 306. If it is determined that a threshold is not exceeded, method 300 proceeds back to 302. Note that the threshold can be an absolute threshold in a regular pattern (such as “ten” in the preceding brute force example), or a relative threshold calculated by statistical methods (such as “three” as the average given above). Exceeding a threshold (absolute or relative) results in raising an ETD alert.
At 306, an alert is created. A Monitoring Agent (for example, a person processing alerts or an automated algorithmic process) analyzes the created alert. From 306, method 300 proceeds to 308.
At 308, alert information is accumulated for associated entities. Alerts contain information on affected entities. By evaluating the alerts, it is possible to determine all alerts in which user x, or system y, or another entity z, etc. are involved. All alerts are displayed along with an associated entity as a leading entry point. For user x, all information of alerts in which user x is involved is collected (and similarly for system y). Focusing on system y, as alerts can contain more than one entity type (for example, a user and a system), or several entities of the same type (for example, several users), such alerts will be shown associated with all relevant entities. For example, an alert raised for user x and system y will be shown both with the user x system y entities.
With respect to severity: different approaches can be considered. One aspect could be, for example, “more alerts for an entity=higher severity.” While currently ETD patterns are configured with a severity, in the described methodology, all alerts for an entity could be evaluated and an average severity calculated, a highest appearing severity from the patterns “wins” (for example, for user x, three alerts such as brute force attack with high severity, debug activity with medium severity, and user activity in development system with low severity occurred. The average severity would maybe be medium. The highest severity would be high), or some other severity determination method consistent with this disclosure. For example, calculation rules (not illustrated) could be defined to determine severity or a Monitoring Agent could determine severity based on a preference, guideline, etc. From 308, method 300 proceeds to 310.
At 310, the Monitoring Agent starts a mitigating action workflow on an entity or entities. In current ETD implementations, the Monitoring Agent reviews a list of alerts (for example on a GUI) that were generated by one or more patterns and decides which alert to start with. For example, the “picking” of an alert currently changes the status from “new” to “in process” (and the picked alert does not appear in a general list any longer) and processor information is associated with the alert. Once the Monitoring Agent has decided what mitigating action to perform on the alert, the Monitoring Agent changes the status and/or the processor of the alert. In current ETD implementations, activities on alerts are reported within the alert itself. Every alert has at least a status field and a processor field.
However, with the described methodology, the monitoring agent instead reviews a list of entities to decide on which entity to perform mitigating actions (for example, to lock user x or to shutdown system y) on first. For example, the list of entities could be generated by using a view (such as, “show me the current list of users for whom alerts exist” or “show me systems”/“show me<other entity>”) or by showing all entities in one list (where the list could list user x1, user x2, system y, IP address z, . . . , etc. in a list). From 310, method 300 proceeds to 312.
At 312, activity performed by the Monitoring Agent is reported on the entity (documented in the system in an activity record data record. Such a data record is needed, for example, for procedural, quality, legal, regulatory, compliance, and other reasons—where an auditor would want to be able to analyze what was done and for which reasons). In some implementations, Monitoring Agent activities can also be used to update the underlying alerts (created at 306). From 312, method 300 proceeds to 314.
At 314, the Monitoring Agent closes activity on the entity. At this point, the Monitoring Agent has analyzed the entity and performed all necessary mitigating steps. The entity should be in a state that is “correct” from security perspective (for example, for a user: Contains adequate authorization and validity, or maybe this user is supposed to be locked so the user can do no further harm, or a system's settings have been changed to increase overall system security, etc.). The entity can be removed from the work list. Until other incidents around the entity appear, no further action items are required for the entity. From 314, method 300 proceeds to 316.
At 316, a determination is made as to whether activities have been closed for all entities related to a raised alert. If it is determined that activities have not been closed for all entities related to a raised alert, method 300 proceeds back to 314. If it is determined that activities have been closed for all entities related to a raised alert, method 316 proceeds to 318. As an example, if all entities that were involved in an alert have been processed in 312 and 314, the underlying alert can be closed (typically automatically). If, for example, an alert was opened for users x1 and x2, and user x1 was processed, but user x2 has still not been processed, then the alert would remain open. Only after user x2 is processed, would all entities for this alert—users x1 and x2 be considered closed. If performed automatically, no human interaction is needed, and the closing can efficiently be performed by the ETD system.
At 318, the created alert is closed. In typical implementations, the alert is closed automatically. In some implementations, the alert can be closed manually (for example, a Monitoring Agent or other user wishes to directly update an alert). If an activity on an entity (such as in 310-314) is performed that automatically leads to closing an alert, an automatic process could find an alert that was already closed manually and consider this a valid state. After 318, method 300 stops.
The computer 402 can serve in a role as a client, network component, a server, a database or other persistency, or any other component (or a combination of roles) of a computer system for performing the subject matter described in the instant disclosure. The illustrated computer 402 is communicably coupled with a network 430 (for example, network 130). In some implementations, one or more components of the computer 402 may be configured to operate within environments, including cloud-computing-based, local, global, or other environment (or a combination of environments).
At a high level, the computer 402 is an electronic computing device operable to receive, transmit, process, store, or manage data and information associated with the described subject matter. According to some implementations, the computer 402 may also include or be communicably coupled with an application server, e-mail server, web server, caching server, streaming data server, or other server (or a combination of servers).
The computer 402 can receive requests over network 430 from a client application (for example, executing on another computer 402) and responding to the received requests by processing the said requests in an appropriate software application. In addition, requests may also be sent to the computer 402 from internal users (for example, from a command console or by other appropriate access method), external or third-parties, other automated applications, as well as any other appropriate entities, individuals, systems, or computers.
Each of the components of the computer 402 can communicate using a system bus 403. In some implementations, any or all of the components of the computer 402, both hardware or software (or a combination of hardware and software), may interface with each other or the interface 404 (or a combination of both) over the system bus 403 using an application programming interface (API) 412 or a service layer 413 (or a combination of the API 412 and service layer 413). The API 412 may include specifications for routines, data structures, and object classes. The API 412 may be either computer-language independent or dependent and refer to a complete interface, a single function, or even a set of APIs. The service layer 413 provides software services to the computer 402 or other components (whether or not illustrated) that are communicably coupled to the computer 402. The functionality of the computer 402 may be accessible for all service consumers using this service layer. Software services, such as those provided by the service layer 413, provide reusable, defined functionalities through a defined interface. For example, the interface may be software written in JAVA, C++, or other suitable language providing data in extensible markup language (XML) format or other suitable format. While illustrated as an integrated component of the computer 402, alternative implementations may illustrate the API 412 or the service layer 413 as stand-alone components in relation to other components of the computer 402 or other components (whether or not illustrated) that are communicably coupled to the computer 402. Moreover, any or all parts of the API 412 or the service layer 413 may be implemented as child or sub-modules of another software module, enterprise application, or hardware module without departing from the scope of this disclosure.
The computer 402 includes an interface 404. Although illustrated as a single interface 404 in
The computer 402 includes a processor 405. Although illustrated as a single processor 405 in
The computer 402 also includes a database 406 that can hold data for the computer 402 or other components (or a combination of both) that can be connected to the network 430 (whether illustrated or not). For example, database 406 can be an in-memory, conventional, or other type of database storing data consistent with this disclosure. In some implementations, database 406 can be a combination of two or more different database types (for example, a hybrid in-memory and conventional database) according to particular needs, desires, or particular implementations of the computer 402 and the described functionality. Although illustrated as a single database 406 in
The computer 402 also includes a memory 407 that can hold data for the computer 402 or other components (or a combination of both) that can be connected to the network 430 (whether illustrated or not). For example, memory 407 can be random access memory (RAM), read-only memory (ROM), optical, magnetic, and the like storing data consistent with this disclosure. In some implementations, memory 407 can be a combination of two or more different types of memory (for example, a combination of RAM and magnetic storage) according to particular needs, desires, or particular implementations of the computer 402 and the described functionality. Although illustrated as a single memory 407 in
The application 408 is an algorithmic software engine providing functionality according to particular needs, desires, or particular implementations of the computer 402, particularly with respect to functionality described in this disclosure. For example, application 408 can serve as one or more components, modules, applications, etc. Further, although illustrated as a single application 408, the application 408 may be implemented as multiple applications 407 on the computer 402. In addition, although illustrated as integral to the computer 402, in alternative implementations, the application 408 can be external to the computer 402.
There may be any number of computers 402 associated with, or external to, a computer system containing computer 402, each computer 402 communicating over network 430. Further, the term “client,” “user,” and other appropriate terminology may be used interchangeably as appropriate without departing from the scope of this disclosure. Moreover, this disclosure contemplates that many users may use one computer 402, or that one user may use multiple computers 402.
Described implementations of the subject matter can include one or more features, alone or in combination.
For example, in a first implementation, a computer-implemented method, comprising: executing an enterprise threat detection (ETD) pattern against received log event data from one or more computing systems; determining, using the ETD pattern, that an event threshold has been exceeded; determining entities associated with an alert created based on the exceeded threshold; calculating, at runtime, a severity value for each determined entity associated with the alert; receiving a selection of a determined entity on which to perform mitigation action activities; writing mitigation action activities associated with the determined entity into an activity record data record; closing a mitigation action activity on the determined entity; determining that all mitigation action activities associated with all entities related to the created alert have been closed; and closing the created alert.
The foregoing and other described implementations can each optionally include one or more of the following features:
A first feature, combinable with any of the following features, wherein the threshold is defined as an absolute value or determined relatively using statistical methods.
A second feature, combinable with any of the previous or following features, comprising writing the created alert into an alert data store.
A third feature, combinable with any of the previous or following features, wherein entities include at least one of a user or a computing system.
A fourth feature, combinable with any of the previous or following features, comprising initiating display of a list of the determined entities prioritized by the severity calculated for each determined entity.
A fifth feature, combinable with any of the previous or following features, comprising writing information about the latest activity data record associated with the determined entity to the alert stored in an alert data store.
A sixth feature, combinable with any of the previous or following features, wherein closing the created alert can be performed manually or automatically.
In a second implementation, a non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising: executing an enterprise threat detection (ETD) pattern against received log event data from one or more computing systems; determining, using the ETD pattern, that an event threshold has been exceeded; determining entities associated with an alert created based on the exceeded threshold; calculating, at runtime, a severity value for each determined entity associated with the alert; receiving a selection of a determined entity on which to perform mitigation action activities; writing mitigation action activities associated with the determined entity into an activity record data record; closing a mitigation action activity on the determined entity; determining that all mitigation action activities associated with all entities related to the created alert have been closed; and closing the created alert.
The foregoing and other described implementations can each optionally include one or more of the following features:
A first feature, combinable with any of the following features, wherein the threshold is defined as an absolute value or determined relatively using statistical methods.
A second feature, combinable with any of the previous or following features, further comprising one or more instructions to write the created alert into an alert data store.
A third feature, combinable with any of the previous or following features, wherein entities include at least one of a user or a computing system.
A fourth feature, combinable with any of the previous or following features, comprising one or more instructions to initiate display of a list of the determined entities prioritized by the severity calculated for each determined entity.
A fifth feature, combinable with any of the previous or following features, comprising one or more instructions to write information about the latest activity data record associated with the determined entity to the alert stored in an alert data store.
A sixth feature, combinable with any of the previous or following features, wherein closing the created alert can be performed manually or automatically.
In a third implementation, a computer-implemented system, comprising: a computer memory; and a hardware processor interoperably coupled with the computer memory and configured to perform operations comprising: executing an enterprise threat detection (ETD) pattern against received log event data from one or more computing systems; determining, using the ETD pattern, that an event threshold has been exceeded; determining entities associated with an alert created based on the exceeded threshold; calculating, at runtime, a severity value for each determined entity associated with the alert; receiving a selection of a determined entity on which to perform mitigation action activities; writing mitigation action activities associated with the determined entity into an activity record data record; closing a mitigation action activity on the determined entity; determining that all mitigation action activities associated with all entities related to the created alert have been closed; and closing the created alert.
The foregoing and other described implementations can each optionally include one or more of the following features:
A first feature, combinable with any of the following features, wherein the threshold is defined as an absolute value or determined relatively using statistical methods.
A second feature, combinable with any of the previous or following features, further configured to write the created alert into an alert data store.
A third feature, combinable with any of the previous or following features, wherein entities include at least one of a user or a computing system.
A fourth feature, combinable with any of the previous or following features, further configured to initiate display of a list of the determined entities prioritized by the severity calculated for each determined entity.
A fifth feature, combinable with any of the previous or following features, further configured to write information about the latest activity data record associated with the determined entity to the alert stored in an alert data store.
A sixth feature, combinable with any of the previous or following features, wherein closing the created alert can be performed manually or automatically.
Implementations of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification can be implemented as one or more computer programs, that is, one or more modules of computer program instructions encoded on a tangible, non-transitory, computer-readable computer-storage medium for execution by, or to control the operation of, data processing apparatus. Alternatively, or additionally, the program instructions can be encoded in/on an artificially generated propagated signal, for example, a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. The computer-storage medium can be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of computer-storage mediums.
The term “real-time,” “real time,” “realtime,” “real (fast) time (RFT),” “near(ly) real-time (NRT),” “quasi real-time,” or similar terms (as understood by one of ordinary skill in the art), means that an action and a response are temporally proximate such that an individual perceives the action and the response occurring substantially simultaneously. For example, the time difference for a response to display (or for an initiation of a display) of data following the individual's action to access the data may be less than 1 ms, less than 1 sec., less than 5 secs., etc. While the requested data need not be displayed (or initiated for display) instantaneously, it is displayed (or initiated for display) without any intentional delay, taking into account processing limitations of a described computing system and time required to, for example, gather, accurately measure, analyze, process, store, or transmit the data.
The terms “data processing apparatus,” “computer,” or “electronic computer device” (or equivalent as understood by one of ordinary skill in the art) refer to data processing hardware and encompass all kinds of apparatus, devices, and machines for processing data, including by way of example, a programmable processor, a computer, or multiple processors or computers. The apparatus can also be or further include special purpose logic circuitry, for example, a central processing unit (CPU), an FPGA (field programmable gate array), or an ASIC (application-specific integrated circuit). In some implementations, the data processing apparatus or special purpose logic circuitry (or a combination of the data processing apparatus or special purpose logic circuitry) may be hardware- or software-based (or a combination of both hardware- and software-based). The apparatus can optionally include code that creates an execution environment for computer programs, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of execution environments. The present disclosure contemplates the use of data processing apparatuses with or without conventional operating systems, for example LINUX, UNIX, WINDOWS, MAC OS, ANDROID, IOS, or any other suitable conventional operating system.
A computer program, which may also be referred to or described as a program, software, a software application, a module, a software module, a script, or code can be written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data, for example, one or more scripts stored in a markup language document, in a single file dedicated to the program in question, or in multiple coordinated files, for example, files that store one or more modules, sub-programs, or portions of code. A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network. While portions of the programs illustrated in the various figures are shown as individual modules that implement the various features and functionality through various objects, methods, or other processes, the programs may instead include a number of sub-modules, third-party services, components, libraries, and such, as appropriate. Conversely, the features and functionality of various components can be combined into single components as appropriate. Thresholds used to make computational determinations can be statically, dynamically, or both statically and dynamically determined.
The methods, processes, logic flows, etc. described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform functions by operating on input data and generating output. The methods, processes, logic flows, etc. can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, for example, a CPU, an FPGA, or an ASIC.
Computers suitable for the execution of a computer program can be based on general or special purpose microprocessors, both, or any other kind of CPU. Generally, a CPU will receive instructions and data from a read-only memory (ROM) or a random access memory (RAM), or both. The essential elements of a computer are a CPU, for performing or executing instructions, and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to, receive data from or transfer data to, or both, one or more mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, for example, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable storage device, for example, a universal serial bus (USB) flash drive, to name just a few.
Computer-readable media (transitory or non-transitory, as appropriate) suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, for example, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices; magnetic disks, for example, internal hard disks or removable disks; magneto-optical disks; and CD-ROM, DVD+/−R, DVD-RAM, and DVD-ROM disks. The memory may store various objects or data, including caches, classes, frameworks, applications, backup data, jobs, web pages, web page templates, database tables, repositories storing dynamic information, and any other appropriate information including any parameters, variables, algorithms, instructions, rules, constraints, or references thereto. Additionally, the memory may include any other appropriate data, such as logs, policies, security or access data, reporting files, as well as others. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
To provide for interaction with a user, implementations of the subject matter described in this specification can be implemented on a computer having a display device, for example, a CRT (cathode ray tube), LCD (liquid crystal display), LED (Light Emitting Diode), or plasma monitor, for displaying information to the user and a keyboard and a pointing device, for example, a mouse, trackball, or trackpad by which the user can provide input to the computer. Input may also be provided to the computer using a touchscreen, such as a tablet computer surface with pressure sensitivity, a multi-touch screen using capacitive or electric sensing, or other type of touchscreen. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, for example, visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input. In addition, a computer can interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.
The term “graphical user interface,” or “GUI,” may be used in the singular or the plural to describe one or more graphical user interfaces and each of the displays of a particular graphical user interface. Therefore, a GUI may represent any graphical user interface, including but not limited to, a web browser, a touch screen, or a command line interface (CLI) that processes information and efficiently presents the information results to the user. In general, a GUI may include a plurality of user interface (UI) elements, some or all associated with a web browser, such as interactive fields, pull-down lists, and buttons. These and other UI elements may be related to or represent the functions of the web browser.
Implementations of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, for example, as a data server, or that includes a middleware component, for example, an application server, or that includes a front-end component, for example, a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of wireline or wireless digital data communication (or a combination of data communication), for example, a communication network. Examples of communication networks include a local area network (LAN), a radio access network (RAN), a metropolitan area network (MAN), a wide area network (WAN), Worldwide Interoperability for Microwave Access (WIMAX), a wireless local area network (WLAN) using, for example, 802.11 a/b/g/n or 802.20 (or a combination of 802.11x and 802.20 or other protocols consistent with this disclosure), all or a portion of the Internet, or any other communication system or systems at one or more locations (or a combination of communication networks). The network may communicate with, for example, Internet Protocol (IP) packets, Frame Relay frames, Asynchronous Transfer Mode (ATM) cells, voice, video, data, or other suitable information (or a combination of communication types) between network addresses.
The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any invention or on the scope of what may be claimed, but rather as descriptions of features that may be specific to particular implementations of particular inventions. Certain features that are described in this specification in the context of separate implementations can also be implemented, in combination, in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations, separately, or in any suitable sub-combination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can, in some cases, be excised from the combination, and the claimed combination may be directed to a sub-combination or variation of a sub-combination.
Particular implementations of the subject matter have been described. Other implementations, alterations, and permutations of the described implementations are within the scope of the following claims as will be apparent to those skilled in the art. While operations are depicted in the drawings or claims in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed (some operations may be considered optional), to achieve desirable results. In certain circumstances, multitasking or parallel processing (or a combination of multitasking and parallel processing) may be advantageous and performed as deemed appropriate.
Moreover, the separation or integration of various system modules and components in the implementations described above should not be understood as requiring such separation or integration in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Accordingly, the above description of example implementations does not define or constrain this disclosure. Other changes, substitutions, and alterations are also possible without departing from the spirit and scope of this disclosure.
Furthermore, any claimed implementation below is considered to be applicable to at least a computer-implemented method; a non-transitory, computer-readable medium storing computer-readable instructions to perform the computer-implemented method; and a computer system comprising a computer memory interoperably coupled with a hardware processor configured to perform the computer-implemented method or the instructions stored on the non-transitory, computer-readable medium.
Number | Name | Date | Kind |
---|---|---|---|
5440726 | Fuchs | Aug 1995 | A |
5960170 | Chen | Sep 1999 | A |
6173418 | Fujino et al. | Jan 2001 | B1 |
6629106 | Narayanaswamy | Sep 2003 | B1 |
6779001 | Kanai et al. | Aug 2004 | B1 |
7376969 | Njemanze | May 2008 | B1 |
7380205 | Bezrukov et al. | May 2008 | B2 |
7441197 | Tschiegg et al. | Oct 2008 | B2 |
7457792 | Weigt et al. | Nov 2008 | B2 |
7457793 | Weigt et al. | Nov 2008 | B2 |
7457794 | Weigt et al. | Nov 2008 | B2 |
7545969 | Bennett | Jun 2009 | B2 |
7624092 | Lieske et al. | Nov 2009 | B2 |
7627544 | Chkodrov | Dec 2009 | B2 |
7756808 | Weigt et al. | Jul 2010 | B2 |
7756809 | Weigt et al. | Jul 2010 | B2 |
7761396 | Weigt et al. | Jul 2010 | B2 |
7783723 | Peng et al. | Aug 2010 | B2 |
7788718 | Fei | Aug 2010 | B1 |
7872982 | Atkins | Jan 2011 | B2 |
7908660 | Bahl | Mar 2011 | B2 |
7934257 | Kienzle | Apr 2011 | B1 |
7961633 | Shankar | Jun 2011 | B2 |
7971209 | Eberlein et al. | Jun 2011 | B2 |
8051034 | Mehta et al. | Nov 2011 | B2 |
8091117 | Williams | Jan 2012 | B2 |
8474047 | Adelstein | Jun 2013 | B2 |
8484726 | Sutton | Jul 2013 | B1 |
8554907 | Chen et al. | Oct 2013 | B1 |
8661103 | Mehta et al. | Feb 2014 | B2 |
8775671 | Rodeck et al. | Jul 2014 | B2 |
8892454 | Rabetge et al. | Nov 2014 | B2 |
8954602 | Seifert et al. | Feb 2015 | B2 |
8973147 | Pearcy | Mar 2015 | B2 |
9037678 | Mehta et al. | May 2015 | B2 |
9075633 | Nos | Jul 2015 | B2 |
9106697 | Capalik et al. | Aug 2015 | B2 |
9116906 | Nos et al. | Aug 2015 | B2 |
9148488 | Rabetge et al. | Sep 2015 | B2 |
9170951 | He | Oct 2015 | B1 |
9251011 | Meier et al. | Feb 2016 | B2 |
9262519 | Saurabh | Feb 2016 | B1 |
9304978 | Bezrukov et al. | Apr 2016 | B2 |
9313421 | Deshpande | Apr 2016 | B2 |
9336385 | Spencer | May 2016 | B1 |
9348665 | Storz et al. | May 2016 | B2 |
9383934 | Likacs | Jul 2016 | B1 |
9419989 | Harris | Aug 2016 | B2 |
9524389 | Roth | Dec 2016 | B1 |
9619984 | Donovan | Apr 2017 | B2 |
9690931 | Anantharaju et al. | Jun 2017 | B1 |
9779147 | Sherman et al. | Oct 2017 | B1 |
9779150 | Sherman | Oct 2017 | B1 |
9843596 | Averbuch | Dec 2017 | B1 |
9979741 | Fuhrman | May 2018 | B2 |
1000138 | Das et al. | Jun 2018 | A1 |
10079842 | Brandwine et al. | Sep 2018 | B1 |
1010237 | Seifert et al. | Oct 2018 | A1 |
10140447 | Rahaman et al. | Nov 2018 | B2 |
10148675 | Brandwine et al. | Dec 2018 | B1 |
20020070953 | Barg | Jun 2002 | A1 |
20030074471 | Anderson | Apr 2003 | A1 |
20030115484 | Mariconi et al. | Jun 2003 | A1 |
20030217137 | Roese | Nov 2003 | A1 |
20040015481 | Zinda | Jan 2004 | A1 |
20040044912 | Connary | Mar 2004 | A1 |
20040078490 | Anderson | Apr 2004 | A1 |
20040093513 | Cantrell | May 2004 | A1 |
20060037075 | Frattura | Feb 2006 | A1 |
20060059115 | Gulfleisch et al. | Mar 2006 | A1 |
20060065594 | Armstrong | Mar 2006 | A1 |
20060106847 | Eckardt et al. | May 2006 | A1 |
20060161816 | Gula et al. | Jul 2006 | A1 |
20060218140 | Whitney | Sep 2006 | A1 |
20060253907 | McConnell | Nov 2006 | A1 |
20070067438 | Goranson et al. | Mar 2007 | A1 |
20070073519 | Long | Mar 2007 | A1 |
20070100905 | Masters et al. | May 2007 | A1 |
20070115998 | McEligott | May 2007 | A1 |
20070136437 | Shankar et al. | Jun 2007 | A1 |
20070183389 | Clee | Aug 2007 | A1 |
20070186284 | McConnell | Aug 2007 | A1 |
20070266387 | Henmi | Nov 2007 | A1 |
20070283192 | Shevchenko | Dec 2007 | A1 |
20070300296 | Kudla | Dec 2007 | A1 |
20080033966 | Wahl | Feb 2008 | A1 |
20080034425 | Overcash et al. | Feb 2008 | A1 |
20080080384 | Atkins | Apr 2008 | A1 |
20080091681 | Dwivedi | Apr 2008 | A1 |
20080163085 | Subbu et al. | Jul 2008 | A1 |
20080288889 | Hunt et al. | Nov 2008 | A1 |
20080295173 | Tsvetanov | Nov 2008 | A1 |
20080320552 | Kumar | Dec 2008 | A1 |
20090044277 | Aaron et al. | Feb 2009 | A1 |
20090049518 | Roman | Feb 2009 | A1 |
20090288164 | Adelstein | Nov 2009 | A1 |
20090293046 | Cheriton | Nov 2009 | A1 |
20090300045 | Chaudhry et al. | Dec 2009 | A1 |
20090312026 | Parameswar | Dec 2009 | A1 |
20100011031 | Huang | Jan 2010 | A1 |
20100114832 | Lillibridge | May 2010 | A1 |
20100180325 | Golobay | Jul 2010 | A1 |
20110098928 | Hoffman et al. | Apr 2011 | A1 |
20110213741 | Shama | Sep 2011 | A1 |
20110277034 | Hanson | Nov 2011 | A1 |
20110320816 | Yao | Dec 2011 | A1 |
20120005542 | Petersen | Jan 2012 | A1 |
20120158653 | Shaffer et al. | Jun 2012 | A1 |
20120167161 | Kim et al. | Jun 2012 | A1 |
20120191660 | Hoog | Jul 2012 | A1 |
20120210434 | Curtis | Aug 2012 | A1 |
20120271748 | DiSalvo | Oct 2012 | A1 |
20120271790 | Lappas et al. | Oct 2012 | A1 |
20120317078 | Zhou et al. | Dec 2012 | A1 |
20130086023 | Tsukamoto et al. | Apr 2013 | A1 |
20130106830 | de Loera | May 2013 | A1 |
20130198840 | Drissi et al. | Aug 2013 | A1 |
20130212709 | Tucker | Aug 2013 | A1 |
20130262311 | Buhrmann | Oct 2013 | A1 |
20130298243 | Kumar et al. | Nov 2013 | A1 |
20130304665 | Rodeck et al. | Nov 2013 | A1 |
20130304666 | Rodeck et al. | Nov 2013 | A1 |
20130305369 | Karta | Nov 2013 | A1 |
20130326079 | Seifert et al. | Dec 2013 | A1 |
20130347111 | Karta | Dec 2013 | A1 |
20140047413 | Sheive et al. | Feb 2014 | A1 |
20140201836 | Amsler | Jul 2014 | A1 |
20140223283 | Hancock | Aug 2014 | A1 |
20140244623 | King | Aug 2014 | A1 |
20140317681 | Shende | Oct 2014 | A1 |
20150007325 | Eliseev | Jan 2015 | A1 |
20150067880 | Ward | Mar 2015 | A1 |
20150073868 | Garman | Mar 2015 | A1 |
20150106867 | Liang | Apr 2015 | A1 |
20150143521 | Eliseev | May 2015 | A1 |
20150154524 | Borodow | Jun 2015 | A1 |
20150180891 | Seward | Jun 2015 | A1 |
20150215329 | Singla | Jul 2015 | A1 |
20150237065 | Roytman | Aug 2015 | A1 |
20150264011 | Liang | Sep 2015 | A1 |
20150278371 | Anand | Oct 2015 | A1 |
20150281278 | Gooding | Oct 2015 | A1 |
20150310070 | Stefik et al. | Oct 2015 | A1 |
20150319185 | Kirti | Nov 2015 | A1 |
20150341389 | Kurakami | Nov 2015 | A1 |
20150347751 | Card et al. | Dec 2015 | A1 |
20150355957 | Steiner | Dec 2015 | A1 |
20150358344 | Mumcuoglu | Dec 2015 | A1 |
20150381646 | Lin | Dec 2015 | A1 |
20160057166 | Chesla | Feb 2016 | A1 |
20160057167 | Bach et al. | Feb 2016 | A1 |
20160092535 | Kuchibhotla et al. | Mar 2016 | A1 |
20160127391 | Kobres | May 2016 | A1 |
20160202893 | Mustonen et al. | Jul 2016 | A1 |
20160226905 | Baikalov et al. | Aug 2016 | A1 |
20160248798 | Cabrera et al. | Aug 2016 | A1 |
20160291982 | Mizrahi | Oct 2016 | A1 |
20160292061 | Marron | Oct 2016 | A1 |
20160337384 | Jansson | Nov 2016 | A1 |
20160359886 | Yadav et al. | Dec 2016 | A1 |
20160364315 | Lee | Dec 2016 | A1 |
20160364571 | Lee | Dec 2016 | A1 |
20160364740 | Parker | Dec 2016 | A1 |
20160373476 | Dell'anno et al. | Dec 2016 | A1 |
20160378978 | Singla | Dec 2016 | A1 |
20160381049 | Lakhani | Dec 2016 | A1 |
20170004005 | Elliott | Jan 2017 | A1 |
20170026400 | Adams et al. | Jan 2017 | A1 |
20170031002 | Newton et al. | Feb 2017 | A1 |
20170034023 | Nickolov | Feb 2017 | A1 |
20170070415 | Bell et al. | Mar 2017 | A1 |
20170091008 | Cherbakov | Mar 2017 | A1 |
20170093902 | Roundy | Mar 2017 | A1 |
20170148060 | Showers | May 2017 | A1 |
20170169217 | Rahaman | Jun 2017 | A1 |
20170251365 | Burchard | Aug 2017 | A1 |
20170270006 | Kankylas | Sep 2017 | A1 |
20170279837 | Dasgupta | Sep 2017 | A1 |
20170287179 | Tibshirani et al. | Oct 2017 | A1 |
20170302685 | Ladnai et al. | Oct 2017 | A1 |
20170308602 | Raghunathan et al. | Oct 2017 | A1 |
20170316026 | Kanthak et al. | Nov 2017 | A1 |
20170322993 | Brodt et al. | Nov 2017 | A1 |
20170324766 | Gonzalez | Nov 2017 | A1 |
20180027002 | Rodeck et al. | Jan 2018 | A1 |
20180027010 | Pritzkau et al. | Jan 2018 | A1 |
20180059876 | Peng et al. | Mar 2018 | A1 |
20180063167 | Rodeck | Mar 2018 | A1 |
20180091535 | Chrosziel | Mar 2018 | A1 |
20180091536 | Chrosziel et al. | Mar 2018 | A1 |
20180173872 | Lam et al. | Jun 2018 | A1 |
20180173873 | Hassforther et al. | Jun 2018 | A1 |
20180176234 | Kunz et al. | Jun 2018 | A1 |
20180176235 | Lam et al. | Jun 2018 | A1 |
20180176238 | Nos et al. | Jun 2018 | A1 |
20180234447 | Mueen | Aug 2018 | A1 |
20190005423 | Pritzkau et al. | Jan 2019 | A1 |
20190007435 | Pritzkau et al. | Jan 2019 | A1 |
Entry |
---|
Office Action in related U.S. Appl. No. 15/216,201 dated Mar. 7, 2018; 14 pages. |
Office Action in related U.S. Appl. No. 15/274,569 dated Apr. 16, 2018; 11 pages. |
Office Action in related U.S. Appl. No. 15/246,053 dated May 21, 2018; 14 pages. |
Office Action in related U.S. Appl. No. 15/380,379 dated Jul. 19, 2018; 9 pages. |
Office Action in related U.S. Appl. No. 15/274,693 dated Jul. 26, 2018; 14 pages. |
Office Action in related U.S. Appl. No. 15/383,771 dated Aug. 3, 2018; 12 pages. |
Schumacher, “An effective way to bring SAP Security Notes under control,” Virtual Forge GmbH, Feb. 2017, https://blog.virtualforge.com/en/an-effective-way-to-bring-sap-security-notes-under-control, 4 pages. |
U.S. Office Action in related U.S. Appl. No. 15/216,201 dated Jul. 20, 2018, 15 pages. |
U.S. Office Action in related U.S. Appl. No. 15/246,053 dated Sep. 24, 2018, 14 pages. |
U.S. Office Action in related U.S. Appl. No. 15/253,438 dated Sep. 19, 2018, 17 pages. |
U.S. Office Action in related U.S. Appl. No. 15/274,569 dated Nov. 14, 2018, 11 pages. |
U.S. Office Action in related U.S. Appl. No. 15/380,450 dated Aug. 27, 2018, 19 pages. |
U.S. Office Action in related U.S. Appl. No. 15/380,450 dated Nov. 2, 2018, 19 pages. |
U.S. Office Action in related U.S. Appl. No. 15/380,450 dated Jan. 23, 2019, 21 pages. |
U.S. Office Action in related U.S. Appl. No. 15/381,567 dated Nov. 2, 2018, 17 pages. |
U.S. Office Action in related U.S. Appl. No. 15/383,771 dated Jan. 23, 2019, 14 pages. |
U.S. Office Action in related U.S. Appl. No. 15/383,771 dated Jul. 5, 2019, 16 pages. |
Office Action issued in U.S. Appl. No. 15/216,046 dated Aug. 21, 2019, 23 pages. |
Final Office Action issued in U.S. Appl. No. 15/274,693 dated Feb. 11, 2019, 19 pages. |
Final Office Action issued in U.S. Appl. No. 15/381,567 dated May 22, 2019, 28 pages. |
Non-Final Office Action issued in U.S. Appl. No. 15/216,046 dated Apr. 29, 2019, 23 pages. |
Non-Final Office Action issued in U.S. Appl. No. 15/246,053 dated May 17, 2019, 28 pages. |
Non-Final Office Action issued in U.S. Appl. No. 15/274,569 dated Mar. 22, 2019, 11 pages. |
Non-Final Office Action issued in U.S. Appl. No. 15/639,863 dated Jun. 24, 2019, 37 pages. |
Office Action issued in U.S. Appl. No. 15/847,478, dated Aug. 6, 2019, 36 pages. |
Number | Date | Country | |
---|---|---|---|
20180157835 A1 | Jun 2018 | US |