Patent Grant
12021887
This application is related to U.S. Nonprovisional patent application Ser. No. 14/198,499, entitled “Security For Network Delivered Services,” filed on Mar. 5, 2014, issued as U.S. Pat. No. 9,398,102 on Jul. 19, 2016, which is incorporated by reference for all purposes;
This application is related to U.S. Nonprovisional patent application Ser. No. 14/835,640, entitled “Systems And Methods of Monitoring and Controlling Enterprise Information Stored on a Cloud Computing Service (CCS),” filed on Aug. 25, 2015, issued as U.S. Pat. No. 9,928,377 on Mar. 27, 2018, which is incorporated by reference for all purposes;
This application is related to U.S. Nonprovisional patent application Ser. No. 15/368,240, entitled “Systems and Methods of Enforcing Multi-Part Policies on Data-Deficient Transactions of Cloud Computing Services,” filed on Dec. 2, 2016, issued as U.S. Pat. No. 10,826,940 on Nov. 3, 2020, which is incorporated by reference for all purposes;
This application is related to U.S. Provisional Patent Application No. 62/488,703, entitled “Reducing Latency and Error in Security Enforcement by a Network Security System (NSS),” filed on Apr. 21, 2017, which is incorporated by reference for all purposes; and
This application is related to U.S. Provisional Patent Application No. 62/524,979, entitled “Aggregate Network Traffic Monitoring”, filed on Jun. 26, 2017, which is incorporated by reference for all purposes.
The technology disclosed relates to compact logging of network traffic events, and in particular, relates to using HTTP referer (or referrer) header field to accurately attribute subordinate HTTP URL requests to correct requesting base web pages in real time.
When a browser receives a unified resource locator (URL) request to load a base web page, it sends a Hypertext Transfer Protocol (HTTP) request to the web server for the base web page. As the HyperText Markup Language (HTML) is delivered, the browser parses it and looks for references to additional resources like images, scripts, CSS, and Flash. Every time the browser finds a new resource in the HTML, it sends a subordinate HTTP request to the web server.
Logging significant number of subordinate HTTP requests can be challenging and inefficient. An opportunity arises to compactly log subordinate HTTP requests by accurately attributing them to the correct requesting base web page in real time. Storage and computational efficiencies and improved user experience may result.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee. The color drawings also may be available in PAIR via the Supplemental Content tab.
In the drawings, like reference characters generally refer to like parts throughout the different views. Also, the drawings are not necessarily to scale, with an emphasis instead generally being placed upon illustrating the principles of the technology disclosed. In the following description, various implementations of the technology disclosed are described with reference to the following drawings, in which:
The following detailed description is made with reference to the figures. Sample implementations are described to illustrate the technology disclosed, not to limit its scope, which is defined by the claims. Those of ordinary skill in the art will recognize a variety of equivalent variations on the description that follows.
The discussion is organized as follows. First, an introduction describing some of the technical problems addressed by various implementations is presented. Then, a high-level description of one implementation is discussed at an architectural level. Next, the algorithms used by some implementations to provide compact logging are discussed. Lastly, more detailed architectures for implementing the system, together with management interfaces, data structures, and message sequence diagrams are discussed.
Introduction
Log entries for base web pages are noisy and difficult to read, because an average website makes 100 subordinate Hypertext Transfer Protocol (HTTP) requests which are 2128 kB in size and come from 18 different domains, according to the HTTP Archive. The subordinate HTTP requests are from objects on the base web page and nested within objects on the base web page. Ads, trackers, and analytic helpers are particularly uninteresting, in most log review activities.
Requests for base web pages and gross statistics about base web pages can be summarized with much less noise and distraction, if a logging activity can accurately attribute in real time, each subordinate HTTP unified resource locator (URL) request to the correct requesting base web page. This attribution is complicated by nesting of requests within requests within requests.
The technology disclosed works in real time, as base and subordinate HTTP URL requests are received, to attribute subordinate HTTP URL requests to base web pages. The main case uses the “referer” or “referrer” HTTP header field for attribution, directly and through a referer hierarchy to the base web page. A second case, which minimizes false generation of base web page log entries, involves small files, such as cascading style sheets (CSS) files, that often have a blank or no referer field.
Instead of separately logging subordinate HTTP URL requests, the technology disclosed accumulates statistics for groups of subordinate HTTP URL requests and attributes them to the appropriate base web page. When the base web page log item is generated, such as upon closing of a TCP connection, the statistics are persisted with the base web page log entry. Special handling of persistent connections is provided.
The technology disclosed applies to both HTTP data (e.g., HTTP transactions, requests, and/or events) and hypertext transfer protocol secure (HTTPS) data (e.g., HTTPS transactions, requests, and/or events) secured by secure sockets layer (SSL) or transport layer security (TLS).
System Overview
We describe a system and various implementations for compact logging of network traffic events. The system and processes are described with reference to
The network security system 130 is interposed between the devices 110 and 115 and the web services 140. It can be cloud-based or on-premise.
The interconnections of the elements of system 100 are now described. The public network(s) 125 couples the devices 110 and 115, the network security system 130, and the web services 140, all in communication with each other (indicated by solid double-arrowed lines). The actual communication path can be point-to-point over public and/or private networks. The communications can occur over a variety of networks, e.g., private networks, VPN, MPLS circuit, or Internet, and can use appropriate application programming interfaces (APIs) and data interchange formats, e.g., Representational State Transfer (REST), JavaScript Object Notation (JSON), Extensible Markup Language (XML), Simple Object Access Protocol (SOAP), Java Message Service (JMS), and/or Java Platform Module System. All of the communications can be encrypted. The communication is generally over a network such as the LAN (local area network), WAN (wide area network), telephone network (Public Switched Telephone Network (PSTN), Session Initiation Protocol (SIP), wireless network, point-to-point network, star network, token ring network, hub network, Internet, inclusive of the mobile Internet, via protocols such as EDGE, 3G, 4G LTE, Wi-Fi, and WiMAX. Additionally, a variety of authorization and authentication techniques, such as username/password, Open Authorization (OAuth), Kerberos, SecureID, digital certificates and more, can be used to secure the communications. Devices 110 and 115 can be desktop computers, laptops, tablet computers, mobile phones, or any other type of computing devices. The engines of system 100 such as the network security system 130 are implemented by software running on varying types of computing devices. Example devices are a workstation, a server, a computing cluster, a blade server, and a server farm.
Having described the elements of
Network Security System
When users of devices 110 and 115 attempt to access web services 140, the network security system 130 intermediates communications between the devices 110 and 115 and the web services 140. Of particular note is that requests, such as a web browser request for a URL of a web service, are routed atypically. Specifically, the endpoint routing client running on the devices 110 and 115 identifies the request and securely tunnels the request to the network security system 130 rather than to the web services 140. Among other things, the network security system 130 analyzes a user identity associated with the devices 110 and 115 and the applicable policy before routing the request to the web services 140. Notably, from the perspective of the web services 140, the request go back to the network security system 130, rather than directly to the devices 110 and 115. The network security system 130 can analyze the returned data, apply further policies in a user identity dependent fashion and then return the response from the web services 140 to the devices 110 and 115.
Compact Logger Client
System 100 also includes compact logger clients that perform the compact logging of network traffic events. Compact logging can occur at the client-side and/or at the server-side. In a client side implementation, the compact logger clients operate at the devices 110 and 115, such as compact logger clients 112 and 117. In a server side implementation, the compact logger clients operate at the network security system 130, such as compact logger client 208. The device running the compact logger client can be a same device from which the HTTP requests originated (e.g., compact logger clients 112 and 117). The device running the compact logger client can also be a campus-based routing appliance positioned to actively process the HTTP requests. The device running the compact logger client can be a cloud-based server (e.g., network security system 130) to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes the HTTP requests (e.g., compact logger client 208). The device running the compact logger client can also be a cloud-based server (e.g., network security system 130) to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by a bypass list (e.g., compact logger client 208). Instances of the compact logger client can run on both: (1) a same device from which the HTTP requests originated and (2) a cloud-based server to which an endpoint routing client, running on the same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by the bypass list.
Base and Subordinate URLs
A general view of how the compact logger client functions has been provided. The discussion now focuses on how the compact logger client detects base URLs, child URLs, and grandchild URLs, and selectively logs some of the URLs.
HTTP Referer Field
The technology disclosed uses the HTTP referer or referrer field to classify URLs as base URLs and subordinate URLs (e.g., child URLs and grandchild URLs). A referer (http—referer or referrer) refers to an HTTP header field that identifies the address of the web page (i.e., the universal resource identifier (URI), universal resource link (URL), or internationalized resource identifier (IRI)) that links to a resource being requested. When an HTTP header does not include a referer field, i.e., the referer field is NULL or blank, the technology disclosed determines that the HTTP header belongs to a base URL.
When an HTTP header includes a referer field and the referer field identifies a base URL, the technology disclosed determines that the HTTP header belongs to a child URL linked to the base URL. The child URL is one of the subordinate URLs for which subordinate HTTP requests for additional resources (e.g., images, scripts, CSS, and Flash) are made when loading the base web page. In some cases, the child URLs are hyperlinks located on the base web page; however subordinate URLs are the more common case.
When an HTTP header includes a referer field and the referer field identifies a child URL, the technology disclosed infers that the HTTP header belongs to a grandchild URL linked to the child URL. The grandchild URL is one of the subordinate URLs for which subordinate HTTP requests for additional resources (e.g., images, scripts, CSS, and Flash) are made when loading the child web page. In some cases, the grandchild URLs are hyperlinks located on the child web page; however subordinate URLs are the more common case.
Compact Logging
Having described classification of base and subordinate URLs based on the HTTP referer field, the discussion now turns to how the subordinate URLs are compactly logged under the base URL.
Compactly logging the four HTTP requests includes logging the child, grandchild, and great grandchild URLs under the corresponding base URL, as opposed to individually logging them. In one implementation, a single page event is logged for the four HTTP requests and the base page URL “https://www.box.com” is assigned to the page event.
The subordinate URLs are summarized. One example of summarization is counting the subordinate URLs and assigning the count to the corresponding base URL. Another example of summarization is logging the subordinate URLs in much less detail compared to the corresponding base URL. Yet another example of summarization is compressing the logs of the subordinate URLs.
Policy-Based Logging
In addition to selectively logging only the base URLs, the technology disclosed also logs URLs that violate an established policy. For instance, if a data loss prevention (DLP) policy calls for logging URLs of transactions that involve sensitive data, then such URLs, despite being subordinate URLs, are logged along with the corresponding base URLs. In another example, a subordinate URL that is identified as a malicious URL based on reference to a black list of malicious URLs is also logged in addition to the corresponding base URL. In yet another example, if a bandwidth monitoring policy calls for logging URLs of transactions that involve streaming media, then such URLs, despite being subordinate URLs, are logged along with the corresponding base URLs.
Management Interfaces
Having described the algorithms used for compact logging of network traffic events, the discussion now turns to examples management interfaces that graphically depict the logged events and alerts and summarized subordinate HTTP transactions. Example management interfaces 700A, 700B, and 700C are generated by the management plane 212.
Data Structures
Having described some example management interfaces used to depict logged events and alerts and summarized subordinate HTTP transactions, the discussion now turns to some of the data structures 800 used by the technology disclosed.
In some implementations, the subordinate URLs are also linked to the corresponding base URL in accordance with the hierarchy. For example, as shown in
The malicious log object is used to specially log malicious URLs emanating from the base URL. The malicious log object is linked to the base URL using the unique base URL ID.
Message Sequence Diagrams
Having described some of the data structures used by the technology disclosed, the discussion now turns to message sequence diagrams of
At message 909, the compact logger client 904 identifies at least one HTTP request with a blank or no referer header field as refering or referring to a first base URL. In response, at message 911, a first base page log object is initialized at the log database 906.
At message 913, based on specification of the first base URL in respective referer header fields, the compact logger client 904 identifies some of the HTTP requests as refered from the first base URL and counts the identified HTTP requests as child URLs. In response, at message 915, a first counter of the first base page log object is updated at the log database 906.
At message 917, based on specification of the child URLs in respective referer header fields, the compact logger client 904 further identifies some of the HTTP requests as refered from the child URLs and counts the identified HTTP requests as grandchild URLs. In response, at message 919, a second counter of the first base page log object is updated at the log database 906.
At message 923, the compact logger client 904 identifies a further HTTP request received at message 921 with a blank or no referer header field as refering to a second base URL of a second base page. In response, at message 925, a second base page log object is initialized at the log database 906.
At message 1013, the compact logger client 1004 looks up a URL included in the HTTP request in the black list 1006 to determine whether the URL is malicious. Black list 1006 is a database that maintains a list of malicious URLs. In response, at message 1015, the compact logger client 1004 receives a malicious classification of the URL.
At message 1017, the compact logger client 1004 initializes a malicious log object at the log database 1008. At message 1019, a first counter of the malicious log object is updated at the log database 1008 and a summary of the malicious log object is reported out for use in a further process.
In scenarios where the compact logger client 1004 receives a non-malicious classification of the URL, a base page log object is initialized or updated at the log database 1008, instead of a malicious log object being initialized or updated.
At message 1107, the compact logger client 1104 receives an HTTP request produced during processing of a base page by the browser 1102.
At message 1109, the compact logger client 1104 determines whether a URL included in the HTTP request is a base URL. The determination is made using the following heuristics—(1) whether a blank or no referer header field exists in the HTTP request, (2) whether a content-length size of the corresponding HTTP response is above a predetermined threshold (e.g., 35000 bytes), and (3) whether a content-type of the HTTP response is text/HTML.
In other implementations, the determination is made using the following heuristics— (1) whether a blank or no referer header field exists in the HTTP request and (2) whether a content-type of the HTTP response is text/HTML. In the illustrated implementation, all three heuristics are met. In other implementations, only a subset of the heuristics may be met for a “base URL” classification.
At message 1111, the compact logger client 1104 classifies the URL as a base URL. In response, at message 1113, a base page log object is initialized at the log database 1106.
At message 1211, the compact logger client 1204 initializes a base page log object for the HTTP request at the log database 1206 and updates a first counter of the base page log object based on counting the subordinate URLs.
At message 1213, the compact logger client 1204 determines or infers that the HTTP request establishes a long lived connection. In one implementation, a long lived connection is detected by monitoring a TCP connection and determining that the TCP connection has persisted for longer than a predetermined time period (e.g., 1 min, 5 mins, 15 mins, 20 mins).
In response, at message 1215, the compact logger client 1204 sets a timer on the long lived connection. The timer can be of any predetermined temporal threshold (e.g., 15 mins, 25 mins, 30 mins). In some implementations, the timer is initialized when an HTTP request is received by the compact logger client 1204 to determine whether the HTTP request is a long lived connection.
At message 1217, upon expiration of the timer, the compact logger client 1204 triggers an artificial connection end event, closes out counting of the subordinate URLs, persists the base page log object and the first counter, and starts a further counter for the base page.
At message 1219, the compact logger client 1204 restarts the timer and iterates over messages 1215 and 1217 until the long lived connection ends. End of the long lived connection is inferred when the compact logger client 1204 receives an authentic connection end event.
Accordingly, a count of the subordinate URLs is initialized when the timer starts and terminated when the timer expires. Consider a long lived connection for which the timer is started and expired multiple times. For such a long lived connection, the counting of subordinate URLs is also initialized and terminated multiple times. As a result, subordinate URLs identified during the life of the long lived connection are bucketed into temporal windows, with each window having the same length as the predetermined temporal threshold of the timer.
At message 1309, the compact logger client 1304 evaluates headers of the subordinate URL requests.
Based on the evaluation, at message 1311, the compact logger client 1304 identifies some of the subordinate URL requests as refered from the base web page, based on specification of a URL of the base web page in respective referer header fields of the subordinate URL requests.
At message 1313, logging of the identified subordinate URL requests is handled by counting the identified subordinate URL requests and logging the count in a log entry for the base web page at the log database 1306.
At message 1315, the compact logger client 1304 receives a TCP connection end event corresponding to the base web page. In response, at message 1317, the compact logger client 1304 closes out counting of the identified subordinate URL requests for the base web page and persists the log entry for the base web page and at least one counter at the log database 1306.
Computer System
User interface input devices 1422 can include a keyboard; pointing devices such as a mouse, trackball, touchpad, or graphics tablet; a scanner; a touch screen incorporated into the display; audio input devices such as voice recognition systems and microphones; and other types of input devices. In general, use of the term “input device” is intended to include all possible types of devices and ways to input information into computer system 1410.
User interface output devices 1420 can include a display subsystem, a printer, a fax machine, or non-visual displays such as audio output devices. The display subsystem can include a cathode ray tube (CRT), a flat-panel device such as a liquid crystal display (LCD), a projection device, or some other mechanism for creating a visible image. The display subsystem can also provide a non-visual display such as audio output devices. In general, use of the term “output device” is intended to include all possible types of devices and ways to output information from computer system 1410 to the user or to another machine or computer system.
Storage subsystem 1424 stores programming and data constructs that provide the functionality of some or all of the modules and methods described herein. These software modules are generally executed by processor 1414 alone or in combination with other processors.
Memory 1426 used in the storage subsystem can include a number of memories including a main random access memory (RAM) 1430 for storage of instructions and data during program execution and a read only memory (ROM) 1432 in which fixed instructions are stored. A file storage subsystem 1428 can provide persistent storage for program and data files, and can include a hard disk drive, a floppy disk drive along with associated removable media, a CD-ROM drive, an optical drive, or removable media cartridges. The modules implementing the functionality of certain implementations can be stored by file storage subsystem 1428 in the storage subsystem 1424, or in other machines accessible by the processor.
Bus subsystem 1412 provides a mechanism for letting the various components and subsystems of computer system 1410 communicate with each other as intended. Although bus subsystem 1412 is shown schematically as a single bus, alternative implementations of the bus subsystem can use multiple busses.
Computer system 1410 can be of varying types including a workstation, server, computing cluster, blade server, server farm, or any other data processing system or computing device. Due to the ever-changing nature of computers and networks, the description of computer system 1410 depicted in
Particular Implementations
We describe systems, methods, and articles of manufacture for compact logging of network traffic events. One or more features of an implementation can be combined with the base implementation. Implementations that are not mutually exclusive are taught to be combinable. One or more features of an implementation can be combined with other implementations. This disclosure periodically reminds the user of these options. Omission from some implementations of recitations that repeat these options should not be taken as limiting the combinations taught in the preceding sections—these recitations are hereby incorporated forward by reference into each of the following implementations.
A system implementation of the technology disclosed includes one or more processors coupled to the memory. The memory is loaded with computer instructions to compactly log network traffic events. The system includes a compact logger client running on a device that receives a plurality of hypertext transfer protocol (HTTP) requests produced during processing of a base page. The HTTP requests include a base unified resource locator (URL), child URLs, and grandchild URLs.
The system identifies at least one HTTP request with a blank or no referer header field as refering to the base URL. The system then initializes a first base page log object.
Based on specification of the base URL in respective referer header fields, the system also identifies some of the HTTP requests as refered from the base URL. The system then—(1) counts the identified HTTP requests as child URLs and (2) updates a first counter of the first base page log object.
Based on specification of one of the child URLs in respective referer header fields, the system further identifies some of the HTTP requests as refered from the child URLs. The system then— (1) counts the identified HTTP requests as grandchild URLs and (2) updates a second counter of the first base page log object.
The system identifies a further HTTP request with a blank or no referer header field as refering to a second base URL of a second base page. The system then— (1) reports out for use in a further process a summary of the first base page log object and (2) initializes a second base page log object.
This system implementation and other systems disclosed optionally include one or more of the following features. System can also include features described in connection with methods disclosed. In the interest of conciseness, alternative combinations of system features are not individually enumerated. Features applicable to systems, methods, and articles of manufacture are not repeated for each statutory class set of base features. The reader will understand how features identified in this section can readily be combined with base features in other statutory classes.
In yet another implementation of the technology disclosed, a base web page resulting from a short-lived TCP connection can be logged. A TCP connection that terminates immediately (or some time) after a base web page is loaded by a client (e.g., browser) can be considered a short-lived TCP connection. Once the base web page is loaded, the browser then parses the HTML of the web page and makes a plurality of downstream HTTP requests that invoke the URLs detected in the HTML. In an implementation, a timer can be applied to qualify only those downstream HTTP requests as being child web pages of the base web page: (1) which are invoked before the timer expires and (2) whose referer header fields refer to a base URL of the base web page. The timer can be initialized when the TCP connection terminates and can last for a predetermined time period (e.g., 3, 5, or 15 seconds). A counter of a base page log object of the base web page can be updated based on the number of qualified downstream HTTP requests, as determined by the two criteria discussed above.
The system can identify an HTTP request as a malicious URL by reference to a black list of malicious URLs. The system can then— (1) initialize a malicious log object, (2) update a first counter of the malicious log object, and (3) report out for use in a further process a summary of the malicious log object. The system can also respond to the malicious URL with at least a warning and by not invoking the malicious URL.
The system can identify an HTTP request as a sensitive URL by analyzing content (e.g., file or document) being transmitted via the HTTP request, i.e., content being uploaded or shared through the HTTP request and/or content being downloaded from the HTTP request. The system analyzes the “en route” or “in transit” content by using a combination of deep application programming interface inspection (DAPII), deep packet inspection (DPI), and/or log inspection to detect user activity and perform data loss prevention (DLP). The system implements the DLP by subjecting the content to content inspection techniques like language-aware data identifier inspection, document fingerprinting, file type detection, keyword search, pattern matching, proximity search, regular expression lookup, exact data matching, metadata extraction, and language-agnostic double-byte character inspection. For additional information about the DAPII, the DPI, and the log inspection, reference can be made to commonly owned U.S. patent application Ser. Nos. 14/198,499; 14/198,508; 14/835,640; 14/835,632; and 62/307,305; Cheng, Ithal, Narayanaswamy, and Malmskog. Cloud Security For Dummies, Netskope Special Edition. John Wiley & Sons, Inc. 2015; “Netskope Introspection” by Netskope, Inc.; “Data Loss Prevention and Monitoring in the Cloud” by Netskope, Inc.; “Cloud Data Loss Prevention Reference Architecture” by Netskope, Inc.; “The 5 Steps to Cloud Confidence” by Netskope, Inc.; “The Netskope Reactive Platform” by Netskope, Inc.; “The Netskope Advantage: Three “Must-Have” Requirements for Cloud Access Security Brokers” by Netskope, Inc.; “The 15 Critical NSS Use Cases” by Netskope, Inc.; “Netskope Reactive Cloud DLP” by Netskope, Inc.; “Repave the Cloud-Data Breach Collision Course” by Netskope, Inc.; and “Netskope Cloud Confidence Index™” by Netskope, Inc., which are incorporated by reference for all purposes as if fully set forth herein.
After the system identifies the HTTP request as a sensitive URL, the system can then— (1) initialize a sensitive log object, (2) update a first counter of the sensitive log object, and (3) report out for use in a further process a summary of the sensitive log object. The system can also respond to the sensitive URL by either blocking transmission (e.g., uploading, downloading, sharing) of the content, quarantining the content, providing coaching to the user who invoked the sensitive URL, and/or seeking justification from the user on why the user invoked the sensitive URL. In other implementations, the system can respond to the sensitive URL by specially logging the sensitive URL and its refering base web page, if any, in addition to any counting of the sensitive URL as refered or referred from the base web page.
The system can evaluate whether an HTTP request should be designated as the base URL based on at least— (1) a blank or no referer header field of the HTTP request, (2) a content-length size of corresponding HTTP response above a predetermined threshold, and (3) a text/HTML content-type of the HTTP response. Examples of predetermined thresholds are 30 kB, 35 kB, 100 kB, and 1000 kB.
The system can determine that an HTTP request establishes a long lived connection. The system can then set a timer on the long lived connection. Upon expiration of the timer, the system can— (1) initialize a third base page log object, (2) update a first counter of the third base page log object, and (3) report out for use in a further process a summary of the third base page log object.
In some implementations, after the timer has expired, a further HTTP request can be received during the long lived connection. The system can inspect the further HTTP request and determine whether it has a blank header field or a referer header field.
If the further HTTP request has a blank header field, the system can set a new timer on the long lived connection. Upon expiration of the new timer, the system can— (1) initialize a fourth base page log object, (2) update a first counter of the fourth base page log object, and (3) report out for use in a further process a summary of the fourth base page log object.
If the further HTTP request has a referer header field and the referer header field specifies, as the base URL, the previous HTTP request for which the third base page log object was initialized, the system can attribute statistics of the further HTTP request to the third base page log object. Statistic attribution can include identifying the further HTTP request as a child URL of the previous HTTP request, identifying child URLs of the further HTTP request as grandchild URLs of the previous HTTP request, and updating the first counter of the third base page log object accordingly.
The device running the compact logger client can be a same device from which the HTTP requests originated. The device running the compact logger client can also be a campus-based routing appliance positioned to actively process the HTTP requests.
The device running the compact logger client can be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes the HTTP requests. The device running the compact logger client can also be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by a bypass list.
Instances of the compact logger client can run on both: (1) a same device from which the HTTP requests originated and (2) a cloud-based server to which an endpoint routing client, running on the same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by the bypass list.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform functions of the system described above. Yet another implementation may include a computer-implemented method performing the functions of the system described above.
A computer-implemented method implementation of the technology disclosed includes compact logging of network traffic events. The computer-implemented method includes a compact logger client running on a device receiving a plurality of hypertext transfer protocol (HTTP) requests produced during processing of a base page. The HTTP requests include a base unified resource locator (URL), child URLs, and grandchild URLs.
The computer-implemented method includes identifying some of the HTTP requests as refered or referred from the base URL based on specification of the base URL in respective referer header fields. It further includes counting the identified HTTP requests as child URLs and updating a first counter of the first base page log object.
The computer-implemented method includes identifying some of the HTTP requests as refered from the child URLs based on specification of one of the child URLs in respective referer header fields. It further includes counting the identified HTTP requests as grandchild URLs and updating a second counter of the first base page log object.
The computer-implemented method includes identifying a further HTTP request with a blank or no referer header field as refering to a second base URL of a second base page. It further includes reporting out for use in a further process a summary of the first base page log object and initializing a second base page log object.
Each of the features discussed in this particular implementation section for the system implementations apply equally to this computer-implemented method implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform the computer-implemented method described above. Yet another implementation may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform the computer-implemented method described above.
Computer readable media (CRM) implementations of the technology disclosed include a non-transitory computer readable storage medium impressed with computer program instructions, when executed on a processor, implement the computer-implemented method described above.
Each of the features discussed in this particular implementation section for the system implementations apply equally to the CRM implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
Another system implementation of the technology disclosed includes one or more processors coupled to the memory. The memory is loaded with computer instructions to compactly log network traffic events. The system includes a compact logger client running on a device that receives a plurality of subordinate unified resource locator (URL) requests produced during loading a base web page.
The system evaluates headers of the subordinate URL requests and identifies some of the subordinate URL requests as refered or referred from the base web page based on specification of a URL of the base web page in respective referer header fields of the subordinate URL requests.
The system then handles logging of the identified subordinate URL requests as refered from the base web page by— (1) counting the identified subordinate URL requests and (2) logging the count in a log entry for the base web page.
This system implementation and other systems disclosed optionally include one or more of the following features. System can also include features described in connection with methods disclosed. In the interest of conciseness, alternative combinations of system features are not individually enumerated. Features applicable to systems, methods, and articles of manufacture are not repeated for each statutory class set of base features. The reader will understand how features identified in this section can readily be combined with base features in other statutory classes.
The plurality of subordinate URL requests can include more than 20, 50, 100, or 1000 subordinate URL requests.
The system can receive a transmission control protocol (TCP) connection end event corresponding to the base web page. The system can then— (1) close out counting of the identified subordinate URL requests for the base web page and (2) persist the log entry for the base web page and at least one counter.
The system can time out a persistent TCP connection corresponding to the base web page. The system can then— (1) trigger an artificial connection end event, (2) close out counting of the identified subordinate URL requests for the base web page, (3) persist the log entry for the base web page and at least one counter, and (4) start a further counter for the base web page.
The system can identify subordinate URL requests as refered or referred from the base web page based on at least— (1) a response content-length size below a predetermined threshold and (2) a response content-type other than text/HTML. Examples of predetermined thresholds are 35 kB, 50 kB, 80 kB, 200 kB, and 500 kB. The system can handle logging of the identified subordinate URL requests as refered from the base web page by— (1) counting the identified subordinate URL requests and (2) logging the count in a log entry for the base web page.
The system can identify subordinate URL requests as refered from the base web page based on at least a response content-type other than text/HTML. The system can handle logging of the identified subordinate URL requests as refered from the base web page by— (1) counting the identified subordinate URL requests and (2) logging the count in a log entry for the base web page.
The system can identify a URL request as a malicious URL by reference to a black list of malicious URLs. The system can then specially log the malicious URL and its refering base web page, if any, in addition to any counting of the malicious URL as refered from the base web page.
The device running the compact logger client can be a same device from which the HTTP requests originated. The device running the compact logger client can also be a campus-based routing appliance positioned to actively process the HTTP requests.
The device running the compact logger client can be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes the HTTP requests. The device running the compact logger client can also be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by a bypass list.
Instances of the compact logger client can run on both: (1) a same device from which the HTTP requests originated and (2) a cloud-based server to which an endpoint routing client, running on the same device from which the HTTP requests originated, routes selected HTTP requests that are not exempted by the bypass list.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform functions of the system described above. Yet another implementation may include a computer-implemented method performing the functions of the system described above.
Another computer-implemented method implementation of the technology disclosed includes compact logging of network traffic events. The computer-implemented method includes a compact logger client running on a device receiving a plurality of subordinate unified resource locator (URL) requests produced during loading a base web page.
The computer-implemented method then includes evaluating headers of the subordinate URL requests and identifying some of the subordinate URL requests as refered or referred from the base web page based on specification of a URL of the base web page in respective referer header fields of the subordinate URL requests.
The computer-implemented method further includes handling logging of the identified subordinate URL requests as refered from the base web page by— (1) counting the identified subordinate URL requests and (2) logging the count in a log entry for the base web page.
Each of the features discussed in this particular implementation section for the system implementations apply equally to this computer-implemented method implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform the computer-implemented method described above. Yet another implementation may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform the computer-implemented method described above.
Computer readable media (CRM) implementations of the technology disclosed include a non-transitory computer readable storage medium impressed with computer program instructions, when executed on a processor, implement the computer-implemented method described above.
Each of the features discussed in this particular implementation section for the system implementations apply equally to the CRM implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
Yet another system implementation of the technology disclosed includes one or more processors coupled to the memory. The memory is loaded with computer instructions to compactly log network traffic events. The system includes a compact logger client running on a device that receives a plurality of hypertext transfer protocol secure (abbreviated HTTPS) requests produced during processing of a base page. The HTTPS requests include a base unified resource locator (URL), child URLs, and grandchild URLs.
The HTTPS requests are secured by secure sockets layer (SSL) or transport layer security (TLS).
The system identifies at least one HTTPS request with a blank or no referer header field as refering to the base URL. The system then initializes a first base page log object.
Based on specification of the base URL in respective referer header fields, the system also identifies some of the HTTPS requests as refered from the base URL. The system then— (1) counts the identified HTTPS requests as child URLs and (2) updates a first counter of the first base page log object.
Based on specification of one of the child URLs in respective referer header fields, the system further identifies some of the HTTPS requests as refered from the child URLs. The system then—(1) counts the identified HTTPS requests as grandchild URLs and (2) updates a second counter of the first base page log object.
The system identifies a further HTTPS request with a blank or no referer header field as refering to a second base URL of a second base page. The system then—(1) reports out for use in a further process a summary of the first base page log object and (2) initializes a second base page log object.
This system implementation and other systems disclosed optionally include one or more of the following features. System can also include features described in connection with methods disclosed. In the interest of conciseness, alternative combinations of system features are not individually enumerated. Features applicable to systems, methods, and articles of manufacture are not repeated for each statutory class set of base features. The reader will understand how features identified in this section can readily be combined with base features in other statutory classes.
The system can identify an HTTPS request as a malicious URL by reference to a black list of malicious URLs. The system can then—(1) initialize a malicious log object, (2) update a first counter of the malicious log object, and (3) report out for use in a further process a summary of the malicious log object. The system can also respond to the malicious URL with at least a warning and by not invoking the malicious URL.
The system can identify an HTTPS request as a sensitive URL by analyzing content (e.g., file or document) being transmitted via the HTTPS request, i.e., content being uploaded or shared through the HTTPS request and/or content being downloaded from the HTTPS request. The system analyzes the “en route” or “in transit” content by using a combination of deep application programming interface inspection (DAPII), deep packet inspection (DPI), and/or log inspection to detect user activity and perform data loss prevention (DLP). The system implements the DLP by subjecting the content to content inspection techniques like language-aware data identifier inspection, document fingerprinting, file type detection, keyword search, pattern matching, proximity search, regular expression lookup, exact data matching, metadata extraction, and language-agnostic double-byte character inspection. For additional information about the DAPII, the DPI, and the log inspection, reference can be made to commonly owned U.S. patent application Ser. Nos. 14/198,499; 14/198,508; 14/835,640; 14/835,632; and 62/307,305; Cheng, Ithal, Narayanaswamy, and Malmskog. Cloud Security For Dummies, Netskope Special Edition. John Wiley & Sons, Inc. 2015; “Netskope Introspection” by Netskope, Inc.; “Data Loss Prevention and Monitoring in the Cloud” by Netskope, Inc.; “Cloud Data Loss Prevention Reference Architecture” by Netskope, Inc.; “The 5 Steps to Cloud Confidence” by Netskope, Inc.; “The Netskope Reactive Platform” by Netskope, Inc.; “The Netskope Advantage: Three “Must-Have” Requirements for Cloud Access Security Brokers” by Netskope, Inc.; “The 15 Critical NSS Use Cases” by Netskope, Inc.; “Netskope Reactive Cloud DLP” by Netskope, Inc.; “Repave the Cloud-Data Breach Collision Course” by Netskope, Inc.; and “Netskope Cloud Confidence Index™” by Netskope, Inc., which are incorporated by reference for all purposes as if fully set forth herein.
After the system identifies the HTTPS request as a sensitive URL, the system can then—(1) initialize a sensitive log object, (2) update a first counter of the sensitive log object, and (3) report out for use in a further process a summary of the sensitive log object. The system can also respond to the sensitive URL by either blocking transmission (e.g., uploading, downloading, sharing) of the content, quarantining the content, providing coaching to the user who invoked the sensitive URL, and/or seeking justification from the user on why the user invoked the sensitive URL. In other implementations, the system can respond to the sensitive URL by specially logging the sensitive URL and its refering base web page, if any, in addition to any counting of the sensitive URL as refered or referred from the base web page.
The system can evaluate whether an HTTPS request should be designated as the base URL based on at least—(1) a blank or no referer header field of the HTTPS request, (2) a content-length size of corresponding HTTPS response above a predetermined threshold, and (3) a text/HTML content-type of the HTTPS response. Examples of predetermined thresholds are 30 kB, 35 kB, 100 kB, and 1000 kB.
The system can determine that an HTTPS request establishes a long lived connection. The system can then set a timer on the long lived connection. Upon expiration of the timer, the system can—(1) initialize a third base page log object, (2) update a first counter of the third base page log object, and (3) report out for use in a further process a summary of the third base page log object.
In some implementations, after the timer has expired, a further HTTPS request can be received during the long lived connection. The system can inspect the further HTTPS request and determine whether it has a blank header field or a referer header field.
If the further HTTPS request has a blank header field, the system can set a new timer on the long lived connection. Upon expiration of the new timer, the system can—(1) initialize a fourth base page log object, (2) update a first counter of the fourth base page log object, and (3) report out for use in a further process a summary of the fourth base page log object.
If the further HTTPS request has a referer header field and the referer header field specifies, as the base URL, the previous HTTPS request for which the third base page log object was initialized, the system can attribute statistics of the further HTTPS request to the third base page log object. Statistic attribution can include identifying the further HTTPS request as a child URL of the previous HTTPS request, identifying child URLs of the further HTTPS request as grandchild URLs of the previous HTTPS request, and updating the first counter of the third base page log object accordingly.
The device running the compact logger client can be a same device from which the HTTPS requests originated. The device running the compact logger client can also be a campus-based routing appliance positioned to actively process the HTTPS requests.
The device running the compact logger client can be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTPS requests originated, routes the HTTPS requests. The device running the compact logger client can also be a cloud-based server to which an endpoint routing client, running on a same device from which the HTTPS requests originated, routes selected HTTPS requests that are not exempted by a bypass list.
Instances of the compact logger client can run on both: (1) a same device from which the HTTPS requests originated and (2) a cloud-based server to which an endpoint routing client, running on the same device from which the HTTPS requests originated, routes selected HTTPS requests that are not exempted by the bypass list.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform functions of the system described above. Yet another implementation may include a computer-implemented method performing the functions of the system described above.
A computer-implemented method implementation of the technology disclosed includes compact logging of network traffic events. The computer-implemented method includes a compact logger client running on a device receiving a plurality of hypertext transfer protocol secure (abbreviated HTTPS) requests produced during processing of a base page. The HTTPS requests include a base unified resource locator (URL), child URLs, and grandchild URLs.
The computer-implemented method includes identifying some of the HTTPS requests as refered or referred from the base URL based on specification of the base URL in respective referer header fields. It further includes counting the identified HTTPS requests as child URLs and updating a first counter of the first base page log object.
The computer-implemented method includes identifying some of the HTTPS requests as refered from the child URLs based on specification of one of the child URLs in respective referer header fields. It further includes counting the identified HTTPS requests as grandchild URLs and updating a second counter of the first base page log object.
The computer-implemented method includes identifying a further HTTPS request with a blank or no referer header field as refering to a second base URL of a second base page. It further includes reporting out for use in a further process a summary of the first base page log object and initializing a second base page log object.
The HTTPS requests are secured by secure sockets layer (SSL) or transport layer security (TLS).
Each of the features discussed in this particular implementation section for the system implementations apply equally to this computer-implemented method implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform the computer-implemented method described above. Yet another implementation may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform the computer-implemented method described above.
Computer readable media (CRM) implementations of the technology disclosed include a non-transitory computer readable storage medium impressed with computer program instructions, when executed on a processor, implement the computer-implemented method described above.
Each of the features discussed in this particular implementation section for the system implementations apply equally to the CRM implementation. As indicated above, all the system features are not repeated here and should be considered repeated by reference.
The technology disclosed can be implemented in the context of any computer-implemented system including a database system, a multi-tenant environment, or a relational database implementation like an Oracle™ compatible database implementation, an IBM DB2 Enterprise Server™ compatible relational database implementation, a MySQL™ or PostgreSQL™ compatible relational database implementation or a Microsoft SQL Server™ compatible relational database implementation or a NoSQL™ non-relational database implementation such as a Vampire™ compatible non-relational database implementation, an Apache Cassandra™ compatible non-relational database implementation, a BigTable™ compatible non-relational database implementation, and an HBase™ or DynamoDB™ compatible non-relational database implementation.
The technology disclosed can be implemented using different programming models like MapReduce™, bulk synchronous programming, MPI primitives, etc., or different scalable batch and stream management systems like Amazon Web Services (AWS)™, including Amazon Elasticsearch Service™ and Amazon Kinesis™, Apache Storm™, Apache Spark™, Apache Kafka™, Apache Flink™, Truviso™, IBM Info-Sphere™, Borealis™, and Yahoo! S4™.
Any data structures and code described or referenced above are stored according to many implementations on a computer-readable storage medium, which may be any device or medium that can store code and/or data for use by a computer system. This includes, but is not limited to, volatile memory, non-volatile memory, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), magnetic and optical storage devices such as disk drives, magnetic tape, CDs (compact discs), DVDs (digital versatile discs or digital video discs), or other media capable of storing computer-readable media now known or later developed.
The preceding description is presented to enable the making and use of the technology disclosed. Various modifications to the disclosed implementations will be apparent, and the general principles defined herein may be applied to other implementations and applications without departing from the spirit and scope of the technology disclosed. Thus, the technology disclosed is not intended to be limited to the implementations shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein. The scope of the technology disclosed is defined by the appended claims.
This application claims the benefit of and priority to U.S. patent application Ser. No. 17/093,539, entitled “COMPACT LOGGING FOR CLOUD AND WEB SECURITY,” filed Nov. 9, 2020, which is a continuation of U.S. patent application Ser. No. 16/044,326, entitled “COMPACT LOGGING OF NETWORK TRAFFIC EVENTS,” filed Jul. 24, 2018, and issued as U.S. Pat. No. 10,834,113 on Nov. 10, 2020, which claims the benefit of U.S. Provisional Patent Application No. 62/536,937, entitled “COMPACT LOGGING OF NETWORK TRAFFIC EVENTS,” filed Jul. 25, 2017, each of which are incorporated by reference in their entirety for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6574655 | Libert et al. | Jun 2003 | B1 |
| 7849502 | Bloch | Dec 2010 | B1 |
| 7849507 | Bloch | Dec 2010 | B1 |
| 8346580 | Nakfoor | Jan 2013 | B2 |
| 8464335 | Sinha et al. | Jun 2013 | B1 |
| 8782790 | Smith et al. | Jul 2014 | B1 |
| 8856869 | Brinskelle | Oct 2014 | B1 |
| 9058416 | Angeles | Jun 2015 | B2 |
| 9069992 | Vaikar et al. | Jun 2015 | B1 |
| 9185125 | Varsanyi | Nov 2015 | B2 |
| 9197628 | Hastings | Nov 2015 | B1 |
| 9241044 | Shribman | Jan 2016 | B2 |
| 9338137 | Fedko et al. | May 2016 | B1 |
| 9398102 | Narayanaswamy et al. | Jul 2016 | B2 |
| 9438488 | Joshi | Sep 2016 | B2 |
| 9460179 | Gunaratne et al. | Oct 2016 | B1 |
| 9485215 | Lee et al. | Nov 2016 | B2 |
| 9692725 | Venkatraman | Jun 2017 | B2 |
| 9912680 | Torres | Mar 2018 | B2 |
| 9917817 | Lad et al. | Mar 2018 | B1 |
| 10044729 | Astakhova et al. | Aug 2018 | B1 |
| 10243997 | Desai | Mar 2019 | B2 |
| 10291657 | Narayanaswamy et al. | May 2019 | B2 |
| 10616294 | Shribman | Apr 2020 | B2 |
| 10764313 | Mushtaq | Sep 2020 | B1 |
| 10979458 | Narayanaswamy et al. | Apr 2021 | B2 |
| 11019101 | Narayanaswamy et al. | May 2021 | B2 |
| 11089064 | Sarukkai et al. | Aug 2021 | B1 |
| 11403418 | Narayanaswamy et al. | Aug 2022 | B2 |
| 11425169 | Narayanaswamy et al. | Aug 2022 | B2 |
| 11451587 | Narayanaswamy et al. | Sep 2022 | B2 |
| 20040088423 | Miller et al. | May 2004 | A1 |
| 20050060535 | Bartas | Mar 2005 | A1 |
| 20070006293 | Balakrishnan et al. | Jan 2007 | A1 |
| 20070223481 | Sivakumar et al. | Sep 2007 | A1 |
| 20080127303 | Wrighton et al. | May 2008 | A1 |
| 20090013378 | Zhang et al. | Jan 2009 | A1 |
| 20090287734 | Borders | Nov 2009 | A1 |
| 20100088404 | Mani | Apr 2010 | A1 |
| 20100146269 | Baskaran | Jun 2010 | A1 |
| 20100175136 | Frumer et al. | Jul 2010 | A1 |
| 20100251369 | Grant | Sep 2010 | A1 |
| 20110125748 | Wood et al. | May 2011 | A1 |
| 20110137973 | Wei et al. | Jun 2011 | A1 |
| 20110138189 | Chou et al. | Jun 2011 | A1 |
| 20110321170 | Onodera et al. | Dec 2011 | A1 |
| 20130145483 | Dimuro et al. | Jun 2013 | A1 |
| 20140007182 | Qureshi et al. | Jan 2014 | A1 |
| 20140026182 | Pearl et al. | Jan 2014 | A1 |
| 20140053280 | Durazzo et al. | Feb 2014 | A1 |
| 20140136680 | Joshi | May 2014 | A1 |
| 20140173061 | Lipstone | Jun 2014 | A1 |
| 20140173062 | Lipstone | Jun 2014 | A1 |
| 20140201838 | Varsanyi | Jul 2014 | A1 |
| 20140259190 | Kiang et al. | Sep 2014 | A1 |
| 20140269279 | Ismail et al. | Sep 2014 | A1 |
| 20140317739 | Be'ery | Oct 2014 | A1 |
| 20140317740 | Be'ery | Oct 2014 | A1 |
| 20140344345 | Venkatraman | Nov 2014 | A1 |
| 20140344399 | Lipstone et al. | Nov 2014 | A1 |
| 20140344573 | Tsai et al. | Nov 2014 | A1 |
| 20150019870 | Patnala et al. | Jan 2015 | A1 |
| 20150135302 | Cohen et al. | May 2015 | A1 |
| 20150188933 | Zeitlin et al. | Jul 2015 | A1 |
| 20150205973 | Huh et al. | Jul 2015 | A1 |
| 20150281386 | Angeles | Oct 2015 | A1 |
| 20160105530 | Shribman | Apr 2016 | A1 |
| 20160248812 | Desai | Aug 2016 | A1 |
| 20160269467 | Lee et al. | Sep 2016 | A1 |
| 20160277374 | Reid et al. | Sep 2016 | A1 |
| 20160292445 | Lindemann | Oct 2016 | A1 |
| 20170063720 | Foskett et al. | Mar 2017 | A1 |
| 20170091482 | Sarin et al. | Mar 2017 | A1 |
| 20170201537 | Caldwell et al. | Jul 2017 | A1 |
| 20170251370 | Liljenstam et al. | Aug 2017 | A1 |
| 20190036871 | Lapidous et al. | Jan 2019 | A1 |
| 20190327268 | Goutal et al. | Oct 2019 | A1 |
| 20200311265 | Jones et al. | Oct 2020 | A1 |
| 20210099485 | Lancioni et al. | Apr 2021 | A1 |
| 20210144174 | N | May 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 111147490 | May 2020 | CN |
| 20130096618 | Aug 2013 | KR |
| Entry |
|---|
| Communication Pursuant to Article 94(3) EPC dated Jun. 15, 2023 issued in App. No. 19727564.7, 6 pages. |
| JP Application No. 2020-565464, First Office Action mailed May 9, 2023, 7 pages. |
| U.S. Appl. No. 15/936,269, Final Office Action, dated Mar. 20, 2023, 17 pages. |
| U.S. Appl. No. 15/936,269, Notice of Allowance, dated Sep. 15, 2023, 16 pages. |
| U.S. Appl. No. 17/080,740 Final Office Action mailed Feb. 9, 2023, 12 pages. |
| U.S. Appl. No. 17/080,740 Non-Final Office Action mailed May 3, 2023, 13 pages. |
| U.S. Appl. No. 17/080,740 Notice of Allowance mailed Aug. 11, 2023, 8 pages. |
| U.S. Appl. No. 17/157,947—Non-Final Office Action dated Mar. 15, 2023, 12 pages. |
| U.S. Appl. No. 17/189,200—Notice of Allowance dated Jul. 25, 2023, 16 pages. |
| U.S. Appl. No. 17/189,200—Notice of Allowance dated Mar. 30, 2023, 16 pages. |
| U.S. Appl. No. 17/227,074 Final Office Action mailed May 11, 2023, 19 pages. |
| U.S. Appl. No. 17/227,074 Non-Final Office Action dated Jan. 13, 2023, 18 pgs. |
| U.S. Appl. No. 17/227,074 Non-Final Office Action mailed May 11, 2023, 19 pages. |
| U.S. Appl. No. 17/227,074 Non-Final Office Action mailed Aug. 21, 2023, 12 pages. |
| U.S. Appl. No. 17/831,437, Non-Final Office Action mailed May 10, 2023, 27 pages. |
| U.S. Appl. No. 17/533,075 Non-Final Office Action mailed Jul. 6, 2023, 22 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20230262083 A1 | Aug 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62536937 | Jul 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17093539 | Nov 2020 | US |
| Child | 18306602 | US | |
| Parent | 16044326 | Jul 2018 | US |
| Child | 17093539 | US |
