Patent Grant
11930380
The present disclosure generally relates to networking systems and methods. More particularly, the present disclosure relates to intelligent monitoring systems and methods for cloud-based Wi-Fi.
Conventional Wi-Fi networks are deployed by users in their residences to provide network connectivity to various devices (e.g., mobile devices, tablets, televisions, Internet of Things (IoT) devices, laptops, media players, and the like). The users obtain network connectivity from their service provider, e.g., Multiple Systems Operators (MSOs), wireless providers, telecom providers, etc. From the service provider perspective, the network connectivity is conventionally seen to the gateway, i.e., cable modem, Digital Subscriber Loop (DSL) modem, wireless Access Point (AP), etc. Conventional Wi-Fi networks are added by the end-user, and there is no visibility into the operation of such networks by the service provider. Service providers and their customers are no longer viewing their network connectivity as ending at the gateway, such as the deployment of service provider applications (“apps”) on user devices. It is no longer acceptable for these service providers to troubleshoot network problems only to the gateway. Their customers expect a working network connection to the end-user device. Thus, there is a need to provide service providers with tools and techniques to view, monitor, and troubleshoot Wi-Fi networks.
As cloud-based Wi-Fi evolves, service providers now have visibility into the home. This visibility presents unique and competitive opportunities for service providers. Some pain points that service providers experience include knowing how to reduce time spent on issue resolution, limiting service calls and escalations, keeping end customers happy, prioritizing issue resolution, network update impact, and the like. These pain points lead to uncertainty about which customers are unhappy, at-risk, and why this lack of knowledge leads to a long and clumsy issue resolution process, leading to unaddressed or reactive support, which turns into customer churn (i.e., losing customers) and poor customer satisfaction ratings.
What is needed is to leverage the visibility into the home via cloud-based Wi-Fi systems to improve service provider performance across-the-board.
The present disclosure relates to intelligent monitoring systems and methods for cloud-based Wi-Fi. The present disclosure includes cloud-based Wi-Fi monitoring to alert, predict, and solve customer issues for service providers. That is, the present disclosure includes a framework or architecture to enable service providers to improve customer experience; provide end-to-end network visibility; proactively identify network issues; determine predictions related to customer churn; autonomously assist customers affected by network issues; eliminate customer calls, truck rolls (remote visits), and customer complaints; provide upsell opportunities for additional products and services to improve customer experience; and the like. A key aspect includes the detection and notification of an ISP outage, allowing customers and ISPs to receive notification and resolution more quickly.
In various embodiments, the present disclosure includes a method of steps, an apparatus configured to implement the steps, and a non-transitory computer-readable storage medium having computer readable code stored thereon for programming a computer to perform the steps. The steps include obtaining data, over the Internet, associated with a plurality of Wi-Fi networks each Wi-Fi network having one or more access points and each Wi-Fi network being associated with a customer of one or more service providers; aggregating and filtering the data; analyzing the aggregated and filtered data for the network condition of each of the plurality of customers of one or more service providers; and determining an internet service provider (ISP) outage based on a plurality of factors.
The data can include a combination of network-related data, hardware or device data, application-related data, third-party data, customer feedback data and customer support data. The analyzing can include utilizing a machine learning model associated with a use case of the one or more use cases. The steps can further include determining location of each of the plurality of Wi-Fi networks; and grouping the plurality of Wi-Fi networks based on corresponding locations. A use case of the one or more use cases can include detection of an outage, and wherein the alert for the outage is determined and distinguished between a power outage and a network outage. A use case of the one or more use cases can include detection of a power outage by detecting that multiple internet service providers are all having outages simultaneously in the same geographic region. The location of one or more of the plurality of Wi-Fi networks can be determined through multiple approaches including any of service address correlation, Internet Protocol (IP) address lookup, and location on a mobile device that is connected.
A use case of the one or more use cases can include customer call predictions utilizing a machine learning model that predicts a likelihood a customer will call in for customer support. A use case of the one or more use cases can include customer call predictions utilizing a machine learning model that predicts a likelihood a customer will call in for customer support and the one or more actions include an automatic notification to the customer prior to the call. A use case of the one or more use cases can include customer call predictions utilizing a machine learning model that predicts a likelihood a customer will call in for customer support, in which the machine learning model includes network performance related factors and non-network performance related factors. The one or more actions can include contacting a customer via at least one of email, push notification, text message, in app notification, or alert to a support agent. A use case of the one or more use cases can include customer churn predictions utilizing a machine learning model that predicts a likelihood a customer will cancel service.
A use case of the one or more use cases can include predicting a customer will provide a poor rating on a customer satisfaction survey. A use case of the one or more use cases can include detection of network issues, and wherein the one or more actions include one or more automated workflows to resolve the network issues. A use case of the one or more use cases can include detection of alarms for any of offline Wi-Fi networks, offline nodes in the Wi-Fi networks, unstable Wi-Fi networks, congestion or interference in the Wi-Fi, poor coverage in the Wi-Fi networks, poor Quality of Experience (QoE) in the Wi-Fi network, speed problems, and device connectivity and stability problems. A use case of the one or more use cases can include detection of alarms, and the alarms are expressed with multiple levels of severity or a numeric score indicating the severity.
The steps can further include presenting one or more dashboards based on the analyzing, and the dashboards can show a group of networks organized by region in which a size of the region can be selected. The steps can further include presenting one or more dashboards based on the analyzing, the dashboards allowing the selection of which locations to observe by one or more of white or black lists of customers, thresholds, new, repeat, likely to churn, important customers, new hardware, new service added, newly upgraded, service level including network speed, number of devices, and type devices in the network. The one or more actions can include a notification to a customer indicating a recommended network change.
The present disclosure is illustrated and described herein with reference to the various drawings, in which like reference numbers are used to denote like system components/method steps, as appropriate, and in which:
The present disclosure relates to intelligent monitoring systems and methods for cloud-based Wi-Fi. The present disclosure includes cloud-based Wi-Fi monitoring to alert, predict, and solve customer issues for service providers. That is, the present disclosure includes a framework or architecture to enable service providers to improve customer experience; provide end-to-end network visibility; proactively identify network issues; determine predictions related to customer churn; autonomously assist customers affected by network issues; eliminate customer calls, truck rolls (remote visits), and customer complaints; provide upsell opportunities for additional products and services to improve customer experience and the like. A key aspect includes the cloud control of the Wi-Fi providing a service provider visibility to the customer's end devices.
Also, the present disclosure relates to Network Operation Center (NOC) dashboard systems and methods for cloud-based Wi-Fi systems. The systems and methods provide network visualizations in a dashboard for a service provider to view Wi-Fi networks in a plurality of locations (e.g., millions of homes). The dashboard includes various metrics and displays thereof as well as settings and controls for cloud-based Wi-Fi network control. The NOC dashboard is a user interface, e.g., web-based, application-based, etc. connected to multiple Wi-Fi networks via the cloud. The NOC dashboard can be used by network operations, technical support personnel, etc. An objective of the NOC dashboard is to provide service providers visibility from their NOC to end user's client devices. That is, make Wi-Fi visible to service providers. Thus, the NOC dashboard can monitor and manage various Wi-Fi devices (access points, mesh devices, repeaters, etc.), providing Key Performance Indicators (KPIs) and visibility to each connected device.
The systems and methods enable a service provider to view Wi-Fi networks as a whole, assessing bulk properties such as average Wi-Fi data rates, % of homes with a given Wi-Fi data rate, % of homes with coverage problems, % of homes with interference issues, etc. Accordingly, the systems and methods allow the service provider to assess how well Wi-Fi is working in their network. For example, the systems and methods can guide the service providers to determine generally whether the Wi-Fi capability is adequate or whether there is a need to invest more into Wi-Fi systems.
The systems and methods enable a service provider to create groups of Wi-Fi networks, such as customers with different types of service, customers with different or the same types of gear in their home, customers who have been in contact with customer support, etc. These groups can then be analyzed for commonalities in terms of their Wi-Fi behavior. The dashboard can be used as an “upsell” or “churn prevention” tool, identifying those customers with poor Wi-Fi experience and identifying the most likely cause or remedy for the situation. The service provider can then attempt to upsell the customer to that solution or can upgrade the solution for free in order to prevent the customer from changing (churning) to a new provider due to a poor experience.
The dashboard can be used for customer support. If a customer calls, emails, texts, etc., a service representative can call up the customer's account live or off-line to help diagnose any problem. The extensive data provided in the dashboard allows support personnel to identify fixes such as a) moving where the APs are located, b) changing networking settings such as router vs. bridge mode, c) adding additional APs to the network, d) making adjustments to the clients in the home (settings, location, etc.), e) manually adjusting frequency channels or topologies (connections between APs), f) running diagnostic speed tests, g) checking the history of speed tests, interference levels, data rates, packet errors, etc., and the like.
Distributed Wi-Fi System
In a typical residential deployment, the distributed Wi-Fi system 10 can include between 3 to 12 access points or more in a home. A large number of access points 14 (which can also be referred to as nodes in the distributed Wi-Fi system 10) ensures that the distance between any access point 14 is always small, as is the distance to any Wi-Fi client device 16 needing Wi-Fi service. That is, an objective of the distributed Wi-Fi system 10 can be for distances between the access points 14 to be of similar size as distances between the Wi-Fi client devices 16 and the associated access point 14. Such small distances ensure that every corner of a consumer's home is well covered by Wi-Fi signals. It also ensures that any given hop in the distributed Wi-Fi system 10 is short and goes through few walls. This results in very strong signal strengths for each hop in the distributed Wi-Fi system 10, allowing the use of high data rates, and providing robust operation. Note, those skilled in the art will recognize the Wi-Fi client devices 16 can be mobile devices, tablets, computers, consumer electronics, home entertainment devices, televisions, IoT devices, or any network-enabled device. For external network connectivity, one or more of the access points 14 can be connected to a modem/router 18, which can be a cable modem, Digital Subscriber Loop (DSL) modem, or any device providing external network connectivity to the physical location associated with the distributed Wi-Fi system 10.
While providing excellent coverage, a large number of access points 14 (nodes) presents a coordination problem. Getting all the access points 14 configured correctly and communicating efficiently requires centralized control. This cloud 12 service can provide control via servers 20 that can be reached across the Internet and accessed remotely, such as through an application (“app”) running on a user device 22. The running of the distributed Wi-Fi system 10, therefore, becomes what is commonly known as a “cloud service.” The servers 20 are configured to receive measurement data, to analyze the measurement data, and to configure the access points 14 in the distributed Wi-Fi system 10 based thereon, through the cloud 12. The servers 20 can also be configured to determine which access point 14 each of the Wi-Fi client devices 16 connect (associate) with. That is, in an example aspect, the distributed Wi-Fi system 10 includes cloud-based control (with a cloud-based controller or cloud service in the cloud) to optimize, configure, and monitor the operation of the access points 14 and the Wi-Fi client devices 16. This cloud-based control is contrasted with a conventional operation that relies on a local configuration, such as by logging in locally to an access point. In the distributed Wi-Fi system 10, the control and optimization does not require local login to the access point 14, but rather the user device 22 (or a local Wi-Fi client device 16) communicating with the servers 20 in the cloud 12, such as via a disparate network (a different network than the distributed Wi-Fi system 10) (e.g., LTE, another Wi-Fi network, etc.).
The access points 14 can include both wireless links and wired links for connectivity. In the example of
Distributed Wi-Fi System Compared to Conventional Wi-Fi Systems
The distributed Wi-Fi system 10 solves the problem with the Wi-Fi mesh network 32 of requiring the same channel for all connections by using a different channel or band for the various hops (note, some hops may use the same channel/band, but it is not required), to prevent slowing down the Wi-Fi speed. For example, the distributed Wi-Fi system 10 can use different channels/bands between access points 14 and between the Wi-Fi client device 16 (e.g., Chs. X, Y, Z, A), and also, the distributed Wi-Fi system 10 does not necessarily use every access point 14, based on configuration and optimization by the cloud 12. The distributed Wi-Fi system 10 solves the problems of the single access point system 30 by providing multiple access points 14. The distributed Wi-Fi system 10 is not constrained to a star topology as in the Wi-Fi repeater network 33, which at most allows two wireless hops between the Wi-Fi client device 16 and a gateway. Also, the distributed Wi-Fi system 10 forms a tree topology where there is one path between the Wi-Fi client device 16 and the gateway, but which allows for multiple wireless hops, unlike the Wi-Fi repeater network 33.
Wi-Fi is a shared, simplex protocol meaning only one conversation between two devices can occur in the network at any given time, and if one device is talking the others need to be listening. By using different Wi-Fi channels, multiple simultaneous conversations can happen simultaneously in the distributed Wi-Fi system 10. By selecting different Wi-Fi channels between the access points 14, interference and congestion are avoided. The server 20 through the cloud 12 automatically configures the access points 14 in an optimized channel hop solution. The distributed Wi-Fi system 10 can choose routes and channels to support the ever-changing needs of consumers and their Wi-Fi client devices 16. The distributed Wi-Fi system 10 approach is to ensure Wi-Fi signals do not need to travel far—either for backhaul or client connectivity. Accordingly, the Wi-Fi signals remain strong and avoid interference by communicating on the same channel as in the Wi-Fi mesh network 32 or with Wi-Fi repeaters. In an example aspect, the servers 20 in the cloud 12 are configured to optimize channel selection for the best user experience.
Of note, the present disclosure for intelligent monitoring is not limited to the distributed Wi-Fi system 10 but contemplates any of the Wi-Fi networks 10, 30, 32, 33, with monitoring through the cloud 12. For example, different vendors can make access points 14, 34, mesh nodes 36, repeaters 38, etc. However, it is possible for unified control via the cloud using standardized techniques for communication with the cloud 12. One such example includes OpenSync, sponsored by the Applicant of the present disclosure and described at www.opensync.io/documentation. OpenSync is cloud-agnostic open-source software for the delivery, curation, and management of services for the modern home. That is, this provides standardization of the communication between devices and the cloud 12. OpenSync acts as silicon, Customer Premises Equipment (CPE), and cloud-agnostic connection between the in-home hardware devices and the cloud 12. This is used to collect measurements and statistics from the connected Wi-Fi client devices 16 and network management elements, and to enable customized connectivity services.
Cloud-Based Wi-Fi Management
Conventional Wi-Fi systems utilize local management, such as where a user on the Wi-Fi network connects to a designated address (e.g., 192.168.1.1, etc.). The distributed Wi-Fi system 10 is configured for cloud-based management via the servers 20 in the cloud 12. Also, the single access point system 30, the Wi-Fi mesh network 32, and the Wi-Fi repeater network 33 can support cloud-based management as described above. For example, the APs 34 and/or the mesh nodes 36 can be configured to communicate with the servers 20 in the cloud 12. This configuration can be through a software agent installed in each device or the like, e.g., OpenSync. As described herein, cloud-based management includes reporting of Wi-Fi related performance metrics to the cloud 12 as well as receiving Wi-Fi-related configuration parameters from the cloud 12. The systems and methods contemplate use with any Wi-Fi system (i.e., the distributed Wi-Fi system 10, the single access point system 30, the Wi-Fi mesh network 32, and the Wi-Fi repeater network 33, etc.), including systems that only support reporting of Wi-Fi related performance metrics (and not supporting cloud-based configuration).
The cloud 12 utilizes cloud computing systems and methods abstract away physical servers, storage, networking, etc. and instead offer these as on-demand and elastic resources. The National Institute of Standards and Technology (NIST) provides a concise and specific definition which states cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. Cloud computing differs from the classic client-server model by providing applications from a server that are executed and managed by a client's web browser or the like, with no installed client version of an application required. Centralization gives cloud service providers complete control over the versions of the browser-based and other applications provided to clients, which removes the need for version upgrades or license management on individual client computing devices. The phrase SaaS is sometimes used to describe application programs offered through cloud computing. A common shorthand for a provided cloud computing service (or even an aggregation of all existing cloud services) is “the cloud.”
Example Server Architecture
The processor 202 is a hardware device for executing software instructions. The processor 202 may be any custom made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the server 200, a semiconductor-based microprocessor (in the form of a microchip or chipset), or generally any device for executing software instructions. When the server 200 is in operation, the processor 202 is configured to execute software stored within the memory 210, to communicate data to and from the memory 210, and to generally control operations of the server 200 pursuant to the software instructions. The I/O interfaces 204 may be used to receive user input from and/or for providing system output to one or more devices or components. The user input may be provided via, for example, a keyboard, touchpad, and/or a mouse. System output may be provided via a display device and a printer (not shown). I/O interfaces 204 may include, for example, a serial port, a parallel port, a small computer system interface (SCSI), a serial ATA (SATA), a fibre channel, Infiniband, iSCSI, a PCI Express interface (PCI-x), an infrared (IR) interface, a radio frequency (RF) interface, and/or a universal serial bus (USB) interface.
The network interface 206 may be used to enable the server 200 to communicate on a network, such as the Internet. The network interface 206 may include, for example, an Ethernet card or adapter (e.g., 10BaseT, Fast Ethernet, Gigabit Ethernet, 10 GbE) or a wireless local area network (WLAN) card or adapter (e.g., 802.11a/b/g/n/ac). The network interface 206 may include address, control, and/or data connections to enable appropriate communications on the network. A data store 208 may be used to store data. The data store 208 may include any of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, and the like)), nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, and the like), and combinations thereof. Moreover, the data store 208 may incorporate electronic, magnetic, optical, and/or other types of storage media. In one example, the data store 208 may be located internal to the server 200, such as, for example, an internal hard drive connected to the local interface 212 in the server 200. Additionally, in another embodiment, the data store 208 may be located external to the server 200 such as, for example, an external hard drive connected to the I/O interfaces 204 (e.g., SCSI or USB connection). In a further embodiment, the data store 208 may be connected to the server 200 through a network, such as, for example, a network-attached file server.
The memory 210 may include any of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)), nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.), and combinations thereof. Moreover, the memory 210 may incorporate electronic, magnetic, optical, and/or other types of storage media. Note that the memory 210 may have a distributed architecture, where various components are situated remotely from one another but can be accessed by the processor 202. The software in memory 210 may include one or more software programs, each of which includes an ordered listing of executable instructions for implementing logical functions. The software in the memory 210 includes a suitable operating system (O/S) 214 and one or more programs 216. The operating system 214 essentially controls the execution of other computer programs, such as the one or more programs 216, and provides scheduling, input-output control, file and data management, memory management, and communication control and related services. The one or more programs 216 may be configured to implement the various processes, algorithms, methods, techniques, etc. described herein.
Example User Device Architecture
The processor 302 is a hardware device for executing software instructions. The processor 302 can be any custom made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the user device 300, a semiconductor-based microprocessor (in the form of a microchip or chipset), or generally any device for executing software instructions. When the user device 300 is in operation, the processor 302 is configured to execute software stored within the memory 310, to communicate data to and from the memory 310, and to generally control operations of the user device 300 pursuant to the software instructions. In an embodiment, the processor 302 may include a mobile optimized processor such as optimized for power consumption and mobile applications. The I/O interfaces 304 can be used to receive user input from and/or for providing system output. User input can be provided via, for example, a keypad, a touch screen, a scroll ball, a scroll bar, buttons, a barcode scanner, and the like. System output can be provided via a display device such as a liquid crystal display (LCD), touch screen, and the like. The I/O interfaces 304 can also include, for example, a serial port, a parallel port, a small computer system interface (SCSI), an infrared (IR) interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, and the like. The I/O interfaces 304 can include a graphical user interface (GUI) that enables a user to interact with the user device 300. Additionally, the I/O interfaces 304 may further include an imaging device, i.e., camera, video camera, etc.
The radio 306 enables wireless communication to an external access device or network. Any number of suitable wireless data communication protocols, techniques, or methodologies can be supported by the radio 306, including, without limitation: RF; IrDA (infrared); Bluetooth; ZigBee (and other variants of the IEEE 802.15 protocol); IEEE 802.11 (any variation); IEEE 802.16 (WiMAX or any other variation); Direct Sequence Spread Spectrum; Frequency Hopping Spread Spectrum; Long Term Evolution (LTE); cellular/wireless/cordless telecommunication protocols (e.g., 3G/4G/5G, etc.); wireless home network communication protocols; proprietary wireless data communication protocols such as variants of Wireless USB; and any other protocols for wireless communication. The data store 308 may be used to store data. The data store 308 may include any of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, and the like)), nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, and the like), and combinations thereof. Moreover, the data store 308 may incorporate electronic, magnetic, optical, and/or other types of storage media.
The memory 310 may include any of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)), nonvolatile memory elements (e.g., ROM, hard drive, etc.), and combinations thereof. Moreover, the memory 310 may incorporate electronic, magnetic, optical, and/or other types of storage media. Note that the memory 310 may have a distributed architecture, where various components are situated remotely from one another but can be accessed by the processor 302. The software in memory 310 can include one or more software programs, each of which includes an ordered listing of executable instructions for implementing logical functions. In the example of
Cloud-Based Network Operations Center (NOC) Process
The cloud-based NOC process 400 includes storing the Wi-Fi data in a secure manner (step 404). The Wi-Fi data can be stored in the data store 208. The secure manner includes encryption such that only the NOC can view the data. Further, the secure manner can include some or all of the Wi-Fi data being anonymized to remove user identifiable information, such as clients, etc. Further, a user in the cloud-based NOC process 400 can require authentication to be able to display metrics to ensure security.
The cloud-based NOC process 400 includes providing a dashboard to one or more users (step 408). For example, the server 20 can display the dashboard as a Graphical User Interface (GUI) to the user device 22 or the like. The dashboard can be displayed in a NOC or remotely to an authorized user. In an embodiment, the dashboard is presented as part of an application that implements the systems and methods. In another embodiment, the dashboard is presented in a browser, such as via HTTP/HTTPS.
The cloud-based NOC process 400 includes processing the Wi-Fi data to determine one or more metrics (step 408), displaying the one or more metrics in the dashboard (step 410), and updating the displaying based on one or more commands from a user (step 412). Specifically, the dashboard is interactive, allowing the user to see network-wide metrics down to individual networks or APs. Steps 408-412 include updates to the GUI based on user input and associated processing. The Wi-Fi data can include aggregated network-wide statistics used to derive network-wide metrics, and the user can drill down to groups or individual accounts.
The cloud-based NOC process 400 can be used to manage devices, networks, groups of devices, groups of networks, accounts, groups of accounts, etc. That is, the cloud-based NOC process 400 contemplates various groupings for management purposes. In practical applications, the cloud-based NOC process 400 can manage thousands to millions of devices, each in a corresponding network and associated with accounts. As described herein, a Wi-Fi network is made up of one or more devices (e.g., access points 14, 34, 36, 38). An account represents a user identification, which is the owner of a Wi-Fi network. Those skilled in the art will recognize various combinations are contemplated.
Wi-Fi Metrics in the Dashboard
The dashboard can be used to indicate the current state and history of the Wi-Fi network providing information such as how long each device has been connected, per node Graph, channel utilization, bandwidth usage, speed test history, alarms, channel utilization, a listing of disconnected devices, and the like.
The dashboard can also include a map display showing metrics related to the Wi-Fi systems being managed by the cloud-based NOC process 400. The map can be a geographic map that shows each Wi-Fi system (or groups) and location. A user can navigate the map, select an area, drill-down and select a single Wi-Fi system, or the like to update the other displays in the dashboard.
In an embodiment, the metrics for the cloud-based NOC process 400 can include Wi-Fi capacity, alarms, channel changes, band steering, channel change effectiveness, health statistics with bins, other parameters in bins, etc. The dashboard can by default display the metrics network-wide with the user being able to search/filter through various commands. Also, the user can define groups of Wi-Fi systems.
The dashboard and/or cloud-based NOC process 400 can raise alarms against devices, networks, groups of devices, groups of networks, accounts, groups of accounts, etc. The alarms can be based on the monitored data and raised when the monitored data exceeds thresholds (which may be configurable). The alarm can have a time constant—how long is it in the bad state, some amount of hysteresis and the alarm may include more different factors simultaneously.
The device tile 522 provides status information such as the device name (OVEN, which can be edited), network health (POOR in this example), connection statistics (Jul. 26, 2017, etc.), device statistics (e.g., ID number, Media Access Control (MAC) address, manufacturer/model, etc. Finally, the device tile 522 can include an alert section 524, which shows an alarm/alert for the poor health and the user can select snooze or ignore.
For the network health, the user can click on an INFO button to bring up a health tile 526, which lists relevant health-related statistics and a score. The network health is a mechanism for a user/administrator to determine the operational status of the access points 14, 34, 36, 38. The score for the network health can be a weighted combination of different factors, such as RSSI, RSSI Transmission Control Protocol (TCP), interference, Number of Spatial Streams (NSS), bandwidth, TCP, etc. The score is meant to provide a meaningful comparison and encompass network operational parameters as well as outside effects such as interference. In this example, the device (“OVEN”) uses a 5G channel for backhaul, e.g., on channel 40, to device “ENTRY” and a 2.4 G channel for clients. The score here is 1.38, which is indicative of poor health.
The topology time machine can also give reasons for the topology changes. Each optimization event that is triggered lists the reason that it is triggered, which can include: the onboarding of new access points, the manual trigger of optimization, statistics being reported by the access points changed enough to justify an optimization, an access point randomly disconnected or re-connected, etc. The topology time machine can also track channel changes, including ones being done to avoid interference, and track the effectiveness of the channel changes both as an overall network aggregated report and on an individual account basis. For example, the effectiveness of the channel changes can be defined as when a channel change successfully resulted in reduced interference, higher bandwidth, etc.
An operator can use the topology time machine to develop an understanding of best practices in Wi-Fi network deployment, Wi-Fi hardware configuration, etc. This expertise can be used to troubleshoot and optimize networks, build better hardware, etc.
In an embodiment, the NOC/dashboard can correlate the speed test to the topology time machine to alerts/alarms to develop an understanding of speed-related to conditions and topology. All of this data can be incorporated into machine learning algorithms to determine correlations to improve network performance and optimization.
NOC Dashboard
In an embodiment, information displayed in a NOC dashboard can include the following tabs account, network, advanced settings, optimizer, speed test, links, access point devices, client devices, etc. The Account tab displays basic profiling information relevant to a user. As described herein, a user is an owner of a Wi-Fi network under management by the NOC dashboard and the cloud-based NOC process 400. In the account tab, the username, email, application Operating System (OS) and version, location, creation date, etc. can be available. Following e-mail validation and onboarding, the access point devices seen by an onboarding process are visible. As described herein, onboarding is the process of bringing a Wi-Fi network under control of the NOC dashboard and the cloud-based NOC process 400. The onboarding can use a mobile device, application, and wireless protocol such as Bluetooth. The account tab enables the administrator to delete an account, assign a group to the account, modify the username and/or SSID, resend e-mail verification, etc.
The network tab displays details of current and historical structural Wi-Fi configurations. The current network state can be mapped in the network topology, channel diversity, and mobile topology. In order to view historical network states, the topology time machine can be used. The network tab can assist administrators in troubleshooting. In order to troubleshoot with system logs, a log pull can be submitted and accessed through the created link. In addition, the administrator can re-configure the network. This involves rebooting a location, claim/unclaiming an access point device, modifying the SSID, PSK (Password), and the band steering state.
The advanced settings tab displays current systemic Wi-Fi configurations. The advanced settings tab can also assist the administrator in troubleshooting. The administrator can use the tab to modify the network mode, Universal Plug and Play (UPnP), Domain Name System (DNS) Servers, Dynamic Host Configuration Protocol (DHCP) reservations, bridge versus router mode, and port forwarding settings.
The optimizer tab displays logs of optimization jobs performed for the location. Tapping on the different headers can provide insight into the KPI triggers and the purpose of the job. The optimizer tab can enable the administrator to push manual optimization triggers, and toggle the auto-optimization on/off. The speed test can trigger remote speed tests at individual access point devices and automated Internet Service Provider (ISP) speed tests on the system. In addition, it will allow the administrator to toggle the Automated ISP Speed Test on/off, along with providing a dashboard to view results.
The links tab provides a focus on the client links and the backhaul links. The tab can provide sorted information on the medium, band, and channel attributes of the links. The access point devices tab provides an overview of the location from the perspective of the access point devices. Sorted information on the number of devices connected, firmware versions, MAC, IP and connection date details can all be visible upon clicking show details. The access point devices tab assists the administrator in troubleshooting as well. Clicking on any access point will bring up controls that enable setting a Light Emitting Diode (LED) Mode to locate, rebooting an access point, or running speed tests on the access points. After results are updated to the cloud, the speed tests on the access points will move to the Speed Test tab mentioned above. The client devices tab provides an overview of the location from the perspective of devices. Clicking on any device will provide in-depth information such as connection type, IP and MAC addresses, RSSI values, bandwidth usage values over different periods of time.
Wi-Fi Network Control via a NOC
The one or more access point devices can include a plurality of devices such as the access points 14, and wherein the onboarding can include providing a unique identifier of a device and automatically associated all of the plurality of devices to the account based on the unique identifier. For example, the association can be in manufacturing, at the point of sale, etc. such as six access points 14 in a package and any one of the unique identifiers causes all six to be onboarded. The onboarding can include inputting one of serial numbers and Media Access Control (MAC) address for the one or more access point devices in the NOC dashboard.
The onboarding can include receiving an indication of an association between the account and the one or more access point devices from the Wi-Fi network. For example, the access point devices can be configured to communicate to the NOC dashboard once installed. Alternatively, the access point devices can be locally onboarded by a user with an application that communicates the association to the NOC dashboard. Further, the access point devices can be loaded with a control agent, either in manufacturing or during deployment, which communicates to the NOC dashboard.
Subsequent to the receiving, the process 580 can further include storing the data for the Wi-Fi network in a secure manner which is accessible only in the NOC dashboard based on user permission. Of note, the NOC dashboard can support thousands to millions of different Wi-Fi networks under management. As such, there is a need to ensure an administrator can only see authorized data. Also, the secure manner can include anonymizing the data so there is no correlation with the actual end-user. This is advantageous when the NOC dashboard manages multiple Wi-Fi networks for different service providers. The aggregate network-wide data is available, albeit in a secure manner.
The performing can include one or more of establishing or changing a Service Set Identifier (SSID) of the Wi-Fi network and establishing or changing a password for accessing the Wi-Fi network. The performing can include the setting of network parameters of the Wi-Fi network, including one or more of Domain Name System (DNS) settings, Universal Plug and Play (UPnP), Dynamic Host Configuration Protocol (DHCP) reservations, bridge versus router mode, and port forwarding settings. The performing can include causing a specific access point device to provide an indicator for locating by a local user.
For example, controls or actions that can be taken from the NOC dashboard can include, without limitation: the ability to control the operation of the LED, for example, blink it in order for a customer to locate it; claim access point devices; reboot multiple devices in a single location with a single click; redirect access point devices. Redirection refers to the ability to change which carrier (e.g., operator of the NOC dashboard) an Access Point is associated with. For example, an access point pod originally configured to contact the cloud at carrier A, and become part of carrier A's network may subsequently need to be configured to contact the cloud for carrier B so as to become part of carrier B's network. Other controls and actions can include, without limitation: unclaim while preserving (or not) pack IDs (this has to do with which home the access point devices are associated with); enable or disable optimizations, client steering, band steering; manual trigger of log pulls, e.g., a single click captures logs from all devices and moves it to a cloud server; setting of network parameters including DNS settings, DHCP reservations, bridge vs. router mode, port forwarding, UPnP settings; change account password; assign account into multiple groups; reboot individual access point devices or the entire network; freeze devices, with times, etc.
The display can provide graphs of one or more metrics associated with the Wi-Fi network. The display can provide aggregated network-wide statistics and alarms for the plurality of Wi-Fi networks. The display can provide network-wide statistics and alarms for the Wi-Fi network, wherein the network-wide statistics can include a graph of channels used in the Wi-Fi network. The Wi-Fi network can include a distributed Wi-Fi network, and wherein the network topology graphically illustrates client links and backhaul links between a plurality of access point devices.
The one or more tabs can display information related to the one or more access point devices and related to wireless links, wherein a health score is displayed for each of the one or more access point devices and the wireless links, and wherein the health score is a weighted combination of a plurality of factors. The one or more tabs can include a topology time machine, which graphically illustrates a topology of the Wi-Fi network and changes over a specified time period. The one or more operations can include optimization of the Wi-Fi network, and wherein the one or more tabs can include a status of the optimization, a history of optimizations, and statistics associated with the optimization.
In another embodiment, an apparatus executing a cloud-based Network Operations Control (NOC) dashboard for management of a Wi-Fi network of a plurality of Wi-Fi networks includes a network interface communicatively coupled to the plurality of Wi-Fi networks; a processor communicatively coupled to the network interface; and memory storing instructions that, when executed, cause the processor to, subsequent to creation of an account for a user of the Wi-Fi network, onboard one or more access point devices associated with the Wi-Fi network in the NOC dashboard; receive data associated with the Wi-Fi network from the one or more access points; provide a display associated with the Wi-Fi network based on the data, wherein the display includes a network topology and one or more tabs provide information related to operation of the Wi-Fi network; update the display based on one or more inputs received, wherein the display is updated in one or more of the network topology and the one or more tabs; and perform one or more operations via the NOC dashboard to one of manage, control, and troubleshoot the Wi-Fi network.
In a further embodiment, a non-transitory computer-readable storage medium includes computer-readable code stored thereon for programming a computer to perform the steps of, subsequent to creating an account for a user of the Wi-Fi network, onboarding one or more access point devices associated with the Wi-Fi network in the NOC dashboard; receiving data associated with the Wi-Fi network from the one or more access points; providing a display associated with the Wi-Fi network based on the data, wherein the display includes a network topology and one or more tabs providing information related to the operation of the Wi-Fi network; updating the display based on one or more inputs received, wherein the updating updates one or more of the network topology and the one or more tabs; and performing one or more operations via the NOC dashboard to one of manage, control, and troubleshoot the Wi-Fi network.
Cloud-Based Wi-Fi Monitoring System
In
The cloud-based Wi-Fi monitoring system 600 includes data ingestion of the inputs 602, and the processing (step 620) can perform data aggregation, filtering, and pattern matching (aggregation/grouping of users). The inputs 602 can include various types of information, as described below. The data aggregation can be based on Internet Service Provider (ISP) level, location level, device level (e.g., Wi-Fi client device 16), and node level (e.g., access point 14). The engine 604 is configured to perform prediction (step 612) modeling for the identification of specific issues, as described below. The outputs 608 can be proactive monitoring, actionable alerts, at-risk customer predictions, and autonomous resolution outreach. The autonomous resolution outreach can be autonomous workflows, including notifications and/or modification of network parameters, configurations, etc. Finally, the cloud-based Wi-Fi monitoring system 600 includes tracking of customer engagement. For example, it is possible to automatically check to see if a customer has opened a sent notification we sent them, and if they have taken the action recommended in the notification.
Input Data
The inputs 602 can include network-related data, application-related data, third-party data, customer support data, etc. A key point aspect of the cloud-based Wi-Fi monitoring system 600 is the sheer volume and types of inputs 602 that are available for analysis. As is described herein, the cloud-based Wi-Fi monitoring system 600 is configured to leverage all of the available data, from disparate sources, to obtain actionable insights. It can be seen that the cloud-based Wi-Fi monitoring system 600 provides a network operator an unfair advantage to the network activity insider their customer's home.
The network-related data relates to the operation of a Wi-Fi network of the one or more Wi-Fi networks monitored by the cloud-based Wi-Fi monitoring system 600. Again, the Wi-Fi network can be any of the distributed Wi-Fi system 10, the single access point system 30, the Wi-Fi mesh network 32, and the Wi-Fi repeater network 33. The network-related data can include, for example, application usage and Quality of Experience (QoE), Wi-Fi network metrics, data related to gateways and extenders, etc. The network-related data can also include reporting of Wi-Fi related performance metrics via a standardized technique, such as OpenSync.
The application-related data relates to the operation of specific applications on specific Wi-Fi client devices 16 in particular Wi-Fi networks. The application-related data can be aggregated and filtered over time. The application-related data includes types of applications, types of the Wi-Fi client devices 16, connectivity data, performance data, data usage, etc. The application-related data is used to understand the current and future needs of a Wi-Fi network.
The third-party data can include utility-related data, weather data, partner APIs, scheduled maintenance events by service providers, sports schedules, etc. The objective of the third-party data is to provide external data that is useful with respect to the operation of the Wi-Fi networks. Simple examples include a storm potentially causing a future service outage, utility work in the area causing a service outage, a major sporting event causing high-bandwidth usage, etc.
The customer support data relates to service calls from the users/owners of particular Wi-Fi networks. The customer support data can include service calls and associated information. The customer support data can also include statistics such as CIR, TRR, TTR, NPS, CSAT, etc. Call in Rate (CIR) relates to customer support calls. Truck Roll Rate (TRR) relates to escalations of customer support calls that convert into a technician visit to the customer site. Time to resolution (TTR) is the average time it takes customer service representatives to resolve a ticket opened by a customer. Net Promoter Score (NPS) is a tool for measuring customer loyalty based on their likelihood to recommend your product, service or company to friends and colleagues. Customer Satisfaction Score (CSAT) is a tool for measuring customer satisfaction at certain touchpoints, usually based on survey feedback.
Predictions
With all of the input 602, the cloud-based Wi-Fi monitoring system 600 includes the ML and Al engine 604 to perform various machine learning techniques to analyze the data. Those skilled in the art recognize there are various machine learning techniques known in the art, any of which are contemplated herein. Generally, machine learning operates by using a data set to train a machine learning model and then using a trained machine learning model to generate predictions based on input data. The goal of the predictions is to look at current data to make future predictions for the outputs 608.
The present disclosure describes several prediction use cases, and the cloud-based Wi-Fi monitoring system 600 can be configured to implement one or more of these use cases. The use cases include proactive monitoring, actionable alerts, at-risk customer predictions, autonomous workflow, etc. These use cases can be services, i.e., cloud services, offered through the cloud-based Wi-Fi monitoring system 600.
The proactive monitoring provides end-to-end visibility of a network operator's network. This can include a Graphical User Interface (GUI) dashboard that enables tracking of relevant metrics and controlling the network. A network operator would use proactive monitoring to view and manage their end customer's Wi-Fi networks.
The actionable alerts provide alerts when customized thresholds are breached. The alerts may include proactive notifications to customers.
The at-risk customer predictions relate to churn prediction from who (customers) and why (reasons). This enables a network operator to proactively know which customers are likely to call or are at risk of churning (i.e., canceling their service). The objective here is to perform some action before the customer reacts. An objective here is to identify customers more likely to call customer support due to key metrics, generate customer cohorts likely to call due to each alarm type, etc.
The autonomous workflow includes autonomous self-help for customers that are proactively initiated. The autonomous workflow can be triggered with recommended solutions to the most common customer issues.
With the proactive notifications, the at-risk customer predictions, and/or the autonomous workflow, an objective is to reduce customer support call volume—keeping customers happier, reducing churn, reducing operating costs, etc. The goal is to reduce or even eliminate customer support calls, truck rolls (on-site technician visits), and customer complaints. For example, using insights generated from trillions of data points to be proactive in resolving customer issues. This can turn customer support calls into calls out (or emails, text messages, push notifications, etc.).
Another of the outputs 608 can include a customized intelligence report for a network operator that provides insights such as when the network is offline, when there is high congestion, when the network is unstable when/where there is poor coverage, who is likely to call, etc. This can also include a comparative analysis to other network operators.
The cloud-based Wi-Fi monitoring system 600 is for proactively enhancing customer experience, proactively determine problems, proactively implement solutions, identify trends of issues across entire deployment, and proactively recommend new products and services.
Location-Based Aspects
In an embodiment, the cloud-based Wi-Fi monitoring system 600 includes location-based aspects in the monitoring. The location-based aspects include a determination of a specific location of each Wi-Fi network, clustering or grouping Wi-Fi networks based on their specific locations, segmenting the Wi-Fi networks by the network operator (ISP), and performing various monitoring and targeting based on the location.
First, each Wi-Fi network (i.e., the distributed Wi-Fi system 10, the single access point system 30, the Wi-Fi mesh network 32, or the Wi-Fi repeater network 33) has a specific location. The access points 14 in these networks can be referred to herein as nodes. The location can be determined from a user account with the network operator, i.e., service address. However, this information may not be readily available to the cloud-based Wi-Fi monitoring system 600. In an embodiment, the cloud-based Wi-Fi monitoring system 600 can use an Internet Protocol (IP) address of the modem/router 18 to determine the location of the associated Wi-Fi network. One such approach includes GeoIP, which can pinpoint a location based on the IP address and a database. Another approach to the location can include obtaining location information from mobile devices that are Wi-Fi client devices 16 in the Wi-Fi network, such as via Global Positioning Satellite (GPS). For example, the Wi-Fi client devices 16 as a mobile device or the like can execute an application (“app”) which can forward this information to the cloud 12 for the cloud-based Wi-Fi monitoring system 600. Of course, multiple approaches can be used together to verify the location.
The Wi-Fi networks monitored by the cloud-based Wi-Fi monitoring system 600 can be grouped together. One example approach to grouping can be via zip code. For example, the location of each Wi-Fi network can be translated into a zip code. Other clustering or grouping approaches are contemplated, e.g., city, region, etc. For example, the Wi-Fi networks can be clustered based on latitude and longitude, independent of the zip code, and can be segmented by internet service provider. In embodiments, the geographical groupings can be hierarchical descending from a larger region to a smaller region, such as country, state, city, zip code, and the like.
With the location of each Wi-Fi network and the data 602, the cloud-based Wi-Fi monitoring system 600 can proactively monitor for outages. In an embodiment, ISP outage can be detected in a geography by detecting the connection for the Wi-Fi networks in the geography to the cloud 12 is down. This can also include a check to distinguish between the Internet being down versus the cloud service going down; it is possible to query several sites, and if all are down, the Internet is down for this Wi-Fi network, but if some are up, the cloud 12 has failed.
The cloud-based Wi-Fi monitoring system 600 is also able to distinguish between a network outage and a power outage. Specifically, a network outage is determined when the cloud-based Wi-Fi monitoring system 600 detects multiple Wi-Fi networks from a same network operator are down in a geography, i.e., the network is out in the geography. On the contrary, a power outage is determined when the cloud-based Wi-Fi monitoring system 600 detects multiple Wi-Fi networks from multiple network operators are down in the geography.
Additionally, the cloud-based Wi-Fi monitoring system 600 can enable location-based targeting of ads and services to a given home—service independent—based on the location of the modem/router 18, can be applied across all services that come to the home.
Wi-Fi Metric-Based Alarms
The cloud-based Wi-Fi monitoring system 600 can provide a dashboard for various Wi-Fi metric-based alarms. The following describes various alarms as well as how they can be determined by the cloud-based Wi-Fi monitoring system 600.
For detecting an offline Wi-Fi network, the cloud-based Wi-Fi monitoring system 600 can raise this alarm based on a determination of interruption of delivery of the statistics from the Wi-Fi network to the cloud 12, missing heartbeat messages from the Wi-Fi network, and/or attempting to communicate with all nodes in the Wi-Fi network to determine all of the nodes are offline.
For detecting offline nodes in a Wi-Fi network, the cloud-based Wi-Fi monitoring system 600 can raise this alarm based on a determination of interruption of delivery of the statistics from a particular node the Wi-Fi network to the cloud 12, and/or based on hitting a threshold of delivery consistency specific to the device.
The cloud-based Wi-Fi monitoring system 600 can raise an unstable network alarm for a particular Wi-Fi network. An unstable network can be determined based on any of too many optimizations in a given time period, too many device reconnections, too many probes from Wi-Fi client devices 16, topology deviations, and nodes going offline.
The cloud-based Wi-Fi monitoring system 600 can raise high congestion/interference alarms. This can be determined from interference scores, neighbor interference judged separately from self-interference, a number of neighbor nodes, and collisions in the wireless layer.
The cloud-based Wi-Fi monitoring system 600 can raise a poor coverage alarm. The poor coverage can be based on low signal strength, factoring the percentage of time that Wi-Fi client devices 16 are at low signal strength and percentage of Wi-Fi client devices 16 that are in that state, and factoring the percentage of time the home (the entire Wi-Fi network) is in the poor coverage state.
The cloud-based Wi-Fi monitoring system 600 can raise a poor Quality of Experience (QoE) alarm. Poor QoE can be based on location wide QoE synthesized from the individual device QoEs throughout the home, and looking across multiple time periods to declare location wide QoE alarm.
The cloud-based Wi-Fi monitoring system 600 can raise speed-related alarms, such as based on speed tests, a comparison of the broadband speed (i.e., from the provider to the modem 18) relative to node speed, based on speed tests run within the home, etc. Speed can be used for the network operator for possible upsell of services.
The cloud-based Wi-Fi monitoring system 600 can raise device connectivity alarms, such as based on too many device reconnections and too frequent probes from devices. The cloud-based Wi-Fi monitoring system 600 can raise device stability alarms, such as based on Tx/Rx patterns for stability, the factors above for determining device connectivity stability, and device throughput performance.
The cloud-based Wi-Fi monitoring system 600 can include a dashboard for communication/thresholding of alarms. The alarms can be presented as binary (yes, no), as multi-level (red, yellow, green), as a continuous score, etc. Various thresholds can be set by assessing correlation to actual call in rate, the fraction of locations that fall into the alarm state, etc.
Call in Rate (CIR) Predictor and Buster
The predictor process 650 looks at network operation (step 652) and location alarm history (step 654) in the cloud 12, compared to customer pain thresholds 656, to provide customer outreach (step 658). The customer pain thresholds 656 are set for some or all of the alarms looking at the likelihood these would cause a customer to call.
The predictor process 650 can include correlating factors to CIR in a machine learning model. These can include the correlation of alarm conditions to CIR—coverage and congestion correlated to CIR and type of customer. The type of customer can be based on call frequency (repeat caller versus first-time caller), customers with many devices that are streaming or high bandwidth requiring devices, customers with more nodes, customers with many smart devices, customers with high Internet access speed, etc. The machine learning model can look at correlation over a specific time period—x days before calling in, x days after they have previously called, etc. That is, the predictor process 650 can look, for training data, at call events in the past and compare to the network operation at the time to determine a machine learning model to predict future calls.
The network topology can also be an input to the predictor process 650. Poor node placement can be determined based channel gain between nodes. There can also be external factors from the third-party data, e.g., weather, events (e.g., Super Bowl).
The machine learning model can look at anomaly detection for CIR, stability, etc. This can be relative to time of day, day of week, holiday events, etc., and can be applied to any metric or alarm or combination thereof.
The customer outreach can be automated including automated notifications. In embodiments, autonomous workflows are enabled that inform the end consumer about outages affecting the end consumer's user experience, scheduled maintenance of the ISP infrastructure, downtimes of the cloud based Wi-Fi network controllers, local Wi-Fi network topology and optimization issues, or any similar notifications to inform the end consumer about any local, regional and global issues potentially affecting the end consumer's service.
The objective of the predictor process 650 is to notify the customer before the customer calls customer support. By notifying the customer about issues affecting the customer's service, the CIRs are reduced as an informed customer is less likely to call in to the network operator. The cloud-based Wi-Fi monitoring system 600 can provide this as a service to network operators. Customers who are notified of problems will be less disgruntled and feel “in-the-loop” versus having to call the network operator to complain.
In an example, ISP speed management alerts can be used for detecting a temporary tier increase to customers/times that customers are likely to call and complain. Here, the ISPs can know which houses are under provisioned—speed they are getting is lower than what was promised.
Churn Predictor
The cloud-based Wi-Fi monitoring system 600 can also provide a machine learning model to predict churn, namely customers who are likely to cancel their service. The machine learning model can be trained with data labeled between customers who have canceled service, changed service, or maintained their service. Once trained, the machine learning model for churn can be run by the cloud-based Wi-Fi monitoring system 600 to detect/identify at-risk customers. Factors related to churn can include customer engagement, customer usage, Call in rates, Truck Roll Rates, mobile app usage patterns, NPS from the household, outages, poor performance, duration of time spent in the alarm state, frequency of alarms, severity of alarms, etc.
With the identification of customers at risk, the network operator can ensure their service is maintained, provide targeted offers, reach out, etc. The goal is to keep the customer.
NPS Score Predictor
NPS is a metric used to determine how likely a customer is to recommend a service or product. This can also be predicted by the cloud-based Wi-Fi monitoring system 600, using similar factors as with the churn. However, NPS is different from churn in that NPS is filled out only at certain times, period immediately preceding survey time are most important, and factor correlations for churn and NPS may be different.
Machine Learning Training
The various use cases described herein can each have their own machine learning model that is trained with relevant data. The models can learn in real-time as data is coming in, or learning in batch offline. The training data can include historical support tickets and the like.
Alert Management
The cloud-based Wi-Fi monitoring system 600 can provide alerts via batch processing periodically, real-time, via communication, using email, push notifications, text messages, in-app notifications, Ticket including third party support app (e.g., Zendesk), etc. Tickets can be generated automatically based on exceeding a threshold. Tickets may be home-specific, but the ticket might also be related to an aggregated issue and surfaced only to the ISP rather than to the individual. Also, ISP customer alerts different from end consumer alerts. That is, the cloud-based Wi-Fi monitoring system 600 can alert the network operator as well as the end customers of the network operators.
In an embodiment, the cloud-based Wi-Fi monitoring system 600 can manage the alerts based on the most effective method. That is, the cloud-based Wi-Fi monitoring system 600 can track engagement, the opening of emails, clicking on links/content of a message, action taken on a message, etc. The cloud-based Wi-Fi monitoring system 600 can further utilize customer feedback about whether the notification helped.
In another embodiment, the cloud-based Wi-Fi monitoring system 600 can be used by technical support when a customer calls in for support. The cloud-based Wi-Fi monitoring system 600 can provide a location-based history of alerts (in the NOC/service dashboard), a recommendation engine—rules-based recommendation engine based off conditions and alarms in network, and pre-filled out support tickets on the basis of alarms, which if the person calls are helpful and could be archived if the person does not call.
Resolution Approaches
For multi-access point networks, such as the distributed Wi-Fi system 10, one resolution approach can include moving node placement. The following describes recommendations that can be provided to customers, such as via the notifications shown in
Dashboards
The cloud-based Wi-Fi monitoring system 600 can include four types of dashboards, namely Monitor (
The monitor dashboard can include filtering by cohort for the map as well as the illustration of trends from time series. There can be a separate panel for each alarm type, and a user can cycle through them and bring them to the front. Each panel can include a hero stat of percentage in that alarm, and each has a map that shows the locations of the alarms. The bottom of each panel can include a chart to alert changes over time. A side panel can include CIR, trend analysis, Churn, and NPS can be added. The side panel can be consistent across all of the dashboard.
The dashboard can illustrate contextual performance to summarize trends that are important. This can be automatically generated and can bring in information that is outside of the dashboard, e.g., can give stats about only the locations that were recently onboarded. The hero states at the top of the dashboard illustrate the overall # of monitored homes and total # of homes in one kind of alarm or another. CIR and each alarm can have predicted extensions to the time graph (marked in a different color and marking). Another view can show the number of tickets (contacts) from customers associated with a particular alarm—these include both the tickets that are generated by us related to alarms, but also can be tickets that came from customer contact and were labeled.
The alert dashboard highlights sub-groups of all the information that was on the monitor dashboard. This can be provided based on the intelligent selection of events that are going on including grouping of geographically correlated offline devices; any time that alerts are grouped across cohorts—geography, time, new versus old customers, hardware, service type, etc. The graph is present, which represents cohort portion of the problem.
The predict dashboard focuses on the prediction of CIR, truck roll rate, churn, poor NPS scores, etc. The predict dashboard focuses on the time series of those with the extensions going forward. The predict dashboard can include an estimated calculation of money saved on a time series basis.
The solve dashboard includes tracking of generation, engagement, and resolution of customer self-help outbound contacts. The solve dashboard can include counts of the different types of contacts that were sent over the past x time. For each contact type (e.g., node placement versus outage), separate counting of engagement (opened email), and resolution (problem was fixed—alert went away). These are graphed with circular graphs indicating percent completion. A user can click on the circular graph and see a time-series graph of it—also shows a map of where those things are. The solve dashboard can include overall hero stats of outreach, engagement, resolution, potentially different levels of engagement—open, click, took action, and an ability to filter these by cohort.
There can also be dashboard control to maintain allow list and block list of customers to remove or prioritize in the dashboard, allow or block alerts, set thresholds, customer cohort selection including new, repeat, likely to churn, VIP, new HW, new service added, newly upgraded, service level (network speed), # devices, IoT devices, geography, etc.
A user can navigate through the maps by clicking on the map to navigate to a particular cluster of users with the given issue. There can be a whole map view, e.g., the entire U.S., and the map can be zoomed to a cluster as well as to one particular location.
Data behind the dashboards is downloadable or exportable and can be used to start a campaign.
Product Upsell
The cloud-based Wi-Fi monitoring system 600 can also be used for upsell recommendations, e.g., buying additional nodes, between hardware, etc. These factors can include other factors than just signal strength or node placement, e.g., # devices, # streaming devices, coverage, poor QoE, node placement alarms, poor alarm scores overall, and network speed tests, particularly relative to broadband speed.
One example of service upsell can be via a Wide Area Network (WAN) saturation alert that compares the ISP speed to the WAN port throughput. This can be a trigger for service upsell.
Network Quality Monitoring
In an embodiment, the cloud-based Wi-Fi monitoring system 600 can be used to track how well new software releases, or new types of hardware (Wi-Fi and broadband) are doing for customers—comparing across different cohorts and across time. This can include historical tracking, graphing to determine if releases are degrading network behavior and automatic thresholding of changes.
Call-Out Manager
As described above, the cloud-based Wi-Fi monitoring system 600 is configured to proactively monitor Wi-Fi systems and networks including distributed Wi-Fi systems with cloud-based control and management, issue alarms, predict customer dissatisfaction and call-ins, detect issues with end-user Quality of Experience and Quality of service, detect local Wi-Fi optimization issues, instability of the local Wi-Fi networks, and the like.
As noted above, the cloud-based Wi-Fi monitoring system 600 is configured to initiate customer outreach to proactively troubleshoot and resolve issues affecting the end-user. In embodiments, the cloud-based Wi-Fi monitoring system 600 is configured to initiate network wide troubleshooting workflows to resolve identified issues. The workflows are issued based on any of the issues, alarms, predictions, and the like, disclosed herein. In embodiments, workflows are issued based on a threshold or combination of thresholds being reached for any of the issues, alarms, predictions, and the like, disclosed herein.
In embodiments, the workflows include initiating customer outreach. Such outreach can be to a single end-user or to a group of end-users as part of a consumer outreach campaign to proactively resolve an issue affecting multiple end users. In embodiments, a GUI, such as a web interface or a mobile application, is provided by the cloud-based Wi-Fi monitoring system 600, which is configured to receive a selection of one or more workflows from an ISP representative, allowing the ISP to initiate the troubleshooting workflows. This GUI can be included in any of the dashboards disclosed herein or in a separate dashboard altogether. In some embodiments, the workflow initiation is Al driven and is performed by the ML and AI engine 604 of the cloud-based Wi-Fi monitoring system 600. In further embodiments, a combination of AI driven selection and ISP selection of the workflows is performed.
By initiating customer outreach, issues can be identified and resolved at the symptom stage before the user experience is affected thereby. By so doing, the current industry standard of reactive call-in-support is replaced by a proactive call-out-support paradigm that keeps the end-user informed and resolves issues before those issues become problematic for the end-user. For example, upon determining that an access point pod of an end-user's Wi-Fi network is poorly positioned relative to other access point pods of the end-user's Wi-Fi network, a workflow is initiated to contact the end-user to help the end-user reposition the access point pod to a more optimal location. In embodiments, this contact is performed by a representative of the ISP calling the end-user to resolve the detected issue of the poorly positioned access point pod. In some embodiments, as illustrated in
ISP Outage Detection
Determining whether a location being offline as a result of an internet service provider (ISP) outage vs the location being offline for other reasons allows service providers the ability to resolve issues more quickly, as well as gather information on different ISPs. The present disclosure provides the ability to determine, given that a location is offline, whether there is an ISP outage. In general, locations can be offline due to many reasons such as devices being disconnected intentionally. An ISP outage can be defined as a situation which effects multiple customers due to failure of some element of the ISPs infrastructure. A key component of this differentiation is looking for multiple customers who are all offline at the same time, in order to distinguish an ISP outage vs multiple customers devices being offline intentionally.
In embodiments, detecting groups of customers experiencing an outage can be done by identifying multiple customers from the same ISP who may be experiencing an outage in the same geographic area. In some embodiments, this geographic area may be based on zip code, city, state, and others of the like. Different levels of geographic area (zip code, city, state, etc.) may be necessary when there is too few a number of customers in a geographic area. For example, if a particular zip code only has a small number of customers, it can be difficult to differentiate an ISP outage from devices being put offline intentionally, thus making it necessary to expand the geographic area in question.
A declaration of an ISP outage may be based on a number of factors such as the number of networks offline. The absolute number of customers offline in a given geographic area as well as a percentage of locations in a given geographic area that went offline can be used to declare an ISP outage. In some embodiments, if this percentage of offline customers/networks is above a predetermined threshold then the determination may be an ISP outage. This threshold may be set by performing statistical analysis in which the probability of random locations/customers being offline for a random reason is used to determine the likelihood of the percentage of locations/customers being offline in a particular geographic location. This calculation can be done in each geographic location such as zip code, city, state, etc. The threshold for being declared an ISP outage may be set by considering the acceptable statistical rate of false alarms. The threshold may also be derived from a set of training data, in which known occurrences of ISP outages were recorded and the characteristics of such occurrences were observed.
By running the algorithm periodically (e.g. every five minutes) the network can be constantly evaluated and ISP outage occurrences can be quickly identified and resolved. In some embodiments, the results of the outage determination can be displayed on a map as to show the geographic locations in which an ISP outage may presently be. Advantageously, the present disclosure allows for automatic resolution if such an outage is detected and declared. Such resolution may include sending a notification such as a text message, push notification, or the like to individual customers. Additionally, notifications can be sent to the ISP for further identification and resolution procedures. A main feature of the present disclosure is the ability to differentiate a global outage (e.g. a power outage) from an ISP outage. One characteristic of a global outage is when multiple ISPs in the same area are experiencing outages and or other issues. In a scenario such as this, it may be determined as being a global outage and not considered an ISP specific outage. Such global outage conditions can be correlated to external conditions such as weather conditions and others of the like.
The present disclosure provides the ability to locate the geographic areas in which there may be an outage. With these geographic locations, specific network nodes can be identified as the cause of the outage and this information can be distributed to ISPs, providing critical information to ISPs. The location identification of homes is done by geographic IP information, wherein the identified location is often not the location of the individual home but the coordinates of the node. The addresses of individual homes may also be obtained by user subscription information, or other location methods of the like. The covered area is found and traced to the nearest node for a specific ISP which can be discovered from information obtained from the ISP or geographic IP information.
The ability to look across multiple ISPs is unique such that it makes it possible to distinguish between a global ISP outage and an ISP outage which may be specific to a single or group of ISPs, which is not possible for an ISP monitoring their own network. With the ability to look across multiple ISPs, it is possible to compare outage rates between CSPs and inform the ISPs of these results. The results can be compared to web sites which use reporting from customers, social media, and other resources of the like.
Information obtained from the process 700 may be stored. The stored information can contain outage data related to multiple ISPs, which can be used to compare outage rates between ISPs and individual nodes.
It will be appreciated that some embodiments described herein may include one or more generic or specialized processors (“one or more processors”) such as microprocessors; Central Processing Units (CPUs); Digital Signal Processors (DSPs): customized processors such as Network Processors (NPs) or Network Processing Units (NPUs), Graphics Processing Units (GPUs), or the like; Field Programmable Gate Arrays (FPGAs); and the like along with unique stored program instructions (including both software and firmware) for control thereof to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the methods and/or systems described herein. Alternatively, some or all functions may be implemented by a state machine that has no stored program instructions, or in one or more Application-Specific Integrated Circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic or circuitry. Of course, a combination of the aforementioned approaches may be used. For some of the embodiments described herein, a corresponding device in hardware and optionally with software, firmware, and a combination thereof can be referred to as “circuitry configured or adapted to,” “logic configured or adapted to,” etc. perform a set of operations, steps, methods, processes, algorithms, functions, techniques, etc. on digital and/or analog signals as described herein for the various embodiments.
Moreover, some embodiments may include a non-transitory computer-readable storage medium having computer readable code stored thereon for programming a computer, server, appliance, device, processor, circuit, etc. each of which may include a processor to perform functions as described and claimed herein. Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), Flash memory, and the like. When stored in the non-transitory computer-readable medium, software can include instructions executable by a processor or device (e.g., any type of programmable circuitry or logic) that, in response to such execution, cause a processor or the device to perform a set of operations, steps, methods, processes, algorithms, functions, techniques, etc. as described herein for the various embodiments.
Although the present disclosure has been illustrated and described herein with reference to preferred embodiments and specific examples thereof, it will be readily apparent to those of ordinary skill in the art that other embodiments and examples may perform similar functions and/or achieve like results. All such equivalent embodiments and examples are within the spirit and scope of the present disclosure, are contemplated thereby, and are intended to be covered by the following claims.
The present disclosure is a continuation-in-part of U.S. patent application Ser. No. 17/071,015, filed Oct. 15, 2020, and entitled “Intelligent monitoring systems and methods for cloud-based Wi-Fi,” which is a continuation-in-part U.S. patent application Ser. No. 16/897,371, filed Jun. 10, 2020, and entitled “Network operation center dashboard for cloud-based Wi-Fi systems,” which is a continuation of U.S. patent application Ser. No. 15/782,912, filed Oct. 13, 2017 (now U.S. Pat. No. 10,687,227 which issued on Jun. 16, 2020), and entitled “Network operation center dashboard for cloud-based Wi-Fi systems,” the contents of which are incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 10051494 | Rengarajan et al. | Aug 2018 | B2 |
| 10341193 | Rengarajan et al. | Jul 2019 | B2 |
| 10470082 | Rengarajan et al. | Nov 2019 | B2 |
| 10554482 | Rengarajan et al. | Feb 2020 | B2 |
| 10554733 | Edara et al. | Feb 2020 | B2 |
| 10687227 | Rusackas et al. | Jun 2020 | B2 |
| 10708126 | Singla et al. | Jul 2020 | B2 |
| 20080151843 | Valmikam et al. | Jun 2008 | A1 |
| 20100161673 | Kandanala et al. | Jun 2010 | A1 |
| 20120157089 | Yang et al. | Jun 2012 | A1 |
| 20120259965 | Tsuzuki et al. | Oct 2012 | A1 |
| 20140328190 | Martin et al. | Nov 2014 | A1 |
| 20150327272 | Fink et al. | Nov 2015 | A1 |
| 20150341797 | Madan et al. | Nov 2015 | A1 |
| 20150382208 | Elliott et al. | Dec 2015 | A1 |
| 20160043962 | Kim et al. | Feb 2016 | A1 |
| 20160254968 | Ebtekar et al. | Sep 2016 | A1 |
| 20170272965 | Kumar et al. | Sep 2017 | A1 |
| 20180324607 | Rengarajan et al. | Nov 2018 | A1 |
| 20190200244 | Polepalli | Jun 2019 | A1 |
| 20190342795 | McFarland et al. | Nov 2019 | A1 |
| 20200160176 | Mehrasa et al. | May 2020 | A1 |
| Entry |
|---|
| Feb. 14, 2019, International Search Report for International Application No. PCT/US2018/055263. |
| Feb. 23, 2022, European Search Report for European Application No. EP 21 20 2948. |
| Number | Date | Country | |
|---|---|---|---|
| 20220217550 A1 | Jul 2022 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15782912 | Oct 2017 | US |
| Child | 16897371 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17071015 | Oct 2020 | US |
| Child | 17700782 | US | |
| Parent | 16897371 | Jun 2020 | US |
| Child | 17071015 | US |
