ENSURING QUALTIY OF EXPERIENCE FOR EXTENDED REALITY DEVICES OVER WIFI RADIO ACCESS NETWORKS

Information

  • Patent Application
  • 20240129950
  • Publication Number
    20240129950
  • Date Filed
    October 12, 2022
    a year ago
  • Date Published
    April 18, 2024
    14 days ago
Abstract
Methods, systems, and a non-transitory computer storage media storing computer-useable instructions are provided to ensure quality of experience (QoE) for extended reality (XR) devices over WiFi networks. A WiFi connectivity device receives a pairing request from an XR device. The pairing request contains an XR identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for data rate and bandwidth assignment. A negotiating agent, which can reside in the XR device or the WiFi connectivity device, negotiates a channel selection for the XR device. The channel selection negotiated is based on the XR identifier. After negotiation is complete, the XR device pairs with the WiFi connectivity device and receives scheduled transmissions on the negotiated channel.
Description
BACKGROUND

Extended reality (XR) devices are becoming increasingly common. XR devices can include cameras, microphones, and sensors that are used to incorporate information about a user's environment into the XR devices. XR devices can be found in the form of goggles or glasses worn by users that incorporate projectors, screens, cameras, microphones and other devices. User environment information can be used in gaming applications, for example, to prevent users from crashing into furniture during a game. XR devices can also be used as mobile computing platforms and need to connect to a network, such as a 5G or 6G network. XR devices can also connect to WiFi and through a router connect to a network. XR devices may also connect to a network through a user equipment (UE), such as a cell phone, which is acting as a hotspot for WiFi connectivity. When connected to the network or to a WiFi router XR devices need low latency in order to operate successfully and efficiently to ensure both operation and user satisfaction. When using a router devices, including XR devices, pair with the router. Pairing identifies the device to the WiFi hotspot that in turn provides the WiFi network identification to the XR device. XR devices need high priority and low latency service, something that many WiFi networks offer on a first come first served basis. First come first served may not always work for XR devices as the necessary low latency service may not be available. As one example, internet browsing, receives the same QCI or quality of service (QoS) as extremely low latency services such as augmented reality (AR), virtual reality (VR) or gaming.


SUMMARY

A high-level overview of various aspects of the present technology is provided in this section to introduce a selection of concepts that are further described below in the detailed description section of this disclosure. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in isolation to determine the scope of the claimed subject matter.


According to aspects herein, methods and systems for ensuring quality of experience (QoE) for extended reality (XR) devices is provided. The method begins when a pairing request is received from an XR device. The pairing request includes an XR identifier for the XR device that indicates one or more service needs of the XR device and identifies a priority of the XR device for data rate and bandwidth assignment. A negotiating agent negotiates a channel selection for the XR device based on the XR identifier. Once negotiation is complete, the XR device is paired with the network, router or user equipment (UE) that is acting as a WiFi hotspot. Transmissions to the XR device are made using the negotiated channel selection.


In a further embodiment, a system for ensuring quality of experience (QoE) for extended reality (XR) devices is provided. The system includes a WiFi connectivity device having one or more antennas for receiving pairing requests from at least one extended reality (XR) device and for transmitting to at least one XR device, and a processor, the processor configured to receiving a pairing request from at least one XR device. The pairing request from the at least one XR device includes an XR identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment. A negotiating agent negotiates at least one channel selection for the at least one XR device. After negotiations are complete, the at least one XR device is paired with a network. The pairing is with the WiFi connectivity device, which can be a router or a UE acting as a WiFi hotspot. After pairing, transmissions to the at least one XR device are scheduled using the at least one negotiated channel selection.


An additional embodiment provides a non-transitory computer storage media storing computer-useable instructions that, when executed by one or more processors cause the processors to transmit a pairing request from an extended reality (XR) device to a WiFi connectivity device. The pairing request includes an extended reality (XR) identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment. The WiFi connectivity device may be a router or a WiFi hotspot, such as a UE, acting as a hotspot. Once the pairing request is received by the WiFi connectivity device, a negotiating agent negotiates a channel selection for transmissions to the XR device. After negotiations conclude, the XR device is paired with the WiFi connectivity device. After pairing the XR device receives scheduled transmissions on the negotiated channel selection.





BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Implementations of the present disclosure are described in detail below with reference to the attached drawing figures, wherein:



FIG. 1 depicts a diagram of an exemplary network environment in which implementations of the present disclosure may be employed, in accordance with aspects herein;



FIG. 2 depicts a cellular network and WiFi network suitable for use in implementations of the present disclosure, in accordance with aspects herein;



FIG. 3 depicts a range of extended reality (XR) scenes suitable for use in implementations of the present disclosure, in accordance with aspects herein;



FIG. 4 depicts an extended reality (XR) system in which implementations of the present disclosure may be employed, in accordance with aspects herein;



FIG. 5 is a flow diagram of an exemplary method for ensuring quality of experience (QoE) for extended reality (XR) devices over WiFi networks, in which aspects of the present disclosure may be employed, in accordance with aspects herein; and



FIG. 6 depicts an exemplary computing device suitable for use in implementations of the present disclosure, in accordance with aspects herein.





DETAILED DESCRIPTION

The subject matter of embodiments of the invention is described with specificity herein to meet statutory requirements. However, the description itself is not intended to limit the scope of this patent. Rather, the inventors have contemplated that the claimed subject matter might be embodied in other ways, to include different steps or combinations of steps similar to the ones described in this document, in conjunction with other present or future technologies. Moreover, although the terms “step” and/or “block” may be used herein to connote different elements of methods employed, the terms should not be interpreted as implying any particular order among or between various steps herein disclosed unless and except when the order of individual steps is explicitly described.


Throughout this disclosure, several acronyms and shorthand notations are employed to aid the understanding of certain concepts pertaining to the associated system and services. These acronyms and shorthand notations are intended to help provide an easy methodology of communicating the ideas expressed herein and are not meant to limit the scope of embodiments described in the present disclosure. The following is a list of these acronyms:

    • 3G Third-Generation Wireless Technology
    • 4G Fourth-Generation Cellular Communication
    • System
    • 5G Fifth-Generation Cellular Communication System
    • 6G Sixth-Generation Cellular Communication System
    • AI Artificial Intelligence
    • CD-ROM Compact Disk Read Only Memory
    • CDMA Code Division Multiple Access
    • eNodeB Evolved Node B
    • GIS Geographic/Geographical/Geospatial Information System
    • gNodeB Next Generation Node B
    • GPRS General Packet Radio Service
    • GSM Global System for Mobile communications
    • iDEN Integrated Digital Enhanced Network
    • DVD Digital Versatile Discs
    • EEPROM Electrically Erasable Programmable Read Only Memory
    • LED Light Emitting Diode
    • LTE Long Term Evolution
    • MIMO Multiple Input Multiple Output
    • MD Mobile Device
    • ML Machine Learning
    • PC Personal Computer
    • PCS Personal Communications Service
    • PDA Personal Digital Assistant
    • PDSCH Physical Downlink Shared Channel
    • PHICH Physical Hybrid ARQ Indicator Channel
    • PUCCH Physical Uplink Control Channel
    • PUSCH Physical Uplink Shared Channel
    • RAM Random Access Memory
    • RET Remote Electrical Tilt
    • RF Radio-Frequency
    • RFI Radio-Frequency Interference
    • R/N Relay Node
    • RNR Reverse Noise Rise
    • ROM Read Only Memory
    • RSRP Reference Transmission Receive Power
    • RSRQ Reference Transmission Receive Quality
    • RSSI Received Transmission Strength Indicator
    • SINR Transmission-to-Interference-Plus-Noise Ratio
    • SNR Transmission-to-noise ratio
    • SON Self-Organizing Networks
    • TDMA Time Division Multiple Access
    • TXRU Transceiver (or Transceiver Unit)
    • UE User Equipment
    • UMTS Universal Mobile Telecommunications Systems
    • WCD Wireless Communication Device (interchangeable with UE)


Further, various technical terms are used throughout this description. An illustrative resource that fleshes out various aspects of these terms can be found in Newton's Telecom Dictionary, 25th Edition (2009).


Embodiments of the present technology may be embodied as, among other things, a method, system, or computer-program product. Accordingly, the embodiments may take the form of a hardware embodiment, or an embodiment combining software and hardware. An embodiment takes the form of a computer-program product that includes computer-useable instructions embodied on one or more computer-readable media.


Computer-readable media include both volatile and nonvolatile media, removable and nonremovable media, and contemplate media readable by a database, a switch, and various other network devices. Network switches, routers, and related components are conventional in nature, as are means of communicating with the same. By way of example, and not limitation, computer-readable media comprise computer-storage media and communications media.


Computer-storage media, or machine-readable media, include media implemented in any method or technology for storing information. Examples of stored information include computer-useable instructions, data structures, program modules, and other data representations. Computer-storage media include, but are not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile discs (DVD), holographic media or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disk storage, and other magnetic storage devices. These memory components can store data momentarily, temporarily, or permanently.


Communications media typically store computer-useable instructions—including data structures and program modules—in a modulated data signal. The term “modulated data signal” refers to a propagated signal that has one or more of its characteristics set or changed to encode information in the signal. Communications media include any information-delivery media. By way of example but not limitation, communications media include wired media, such as a wired network or direct-wired connection, and wireless media such as acoustic, infrared, radio, microwave, spread-spectrum, and other wireless media technologies. Combinations of the above are included within the scope of computer-readable media.


By way of background, a traditional telecommunications network employs a plurality of base stations (i.e., nodes, cell sites, cell towers) to provide network coverage. The base stations are employed to broadcast and transmit transmissions to user devices of the telecommunications network. An base station may be considered to be a portion of a base station that may comprise an antenna, a radio, and/or a controller. In aspects, a base station is defined by its ability to communicate with a user equipment (UE), such as a wireless communication device (WCD), according to a single protocol (e.g., 3G, 4G, LTE, 5G, or 6G, and the like); however, in other aspects, a single base station may communicate with a UE according to multiple protocols. As used herein, a base station may comprise one base station or more than one base station. Factors that can affect the telecommunications transmission include, e.g., location and size of the base stations, and frequency of the transmission, among other factors. The base stations are employed to broadcast and transmit transmissions to user devices of the telecommunications network. Traditionally, the base station establishes uplink (or downlink) transmission with a mobile handset over a single frequency that is exclusive to that particular uplink connection (e.g., an LTE connection with an EnodeB or a 5G connection with a gNodeB). In this regard, typically only one active uplink connection can occur per frequency. The base station may include one or more sectors served by individual transmitting/receiving components associated with the base station (e.g., antenna arrays controlled by an EnodeB). These transmitting/receiving components together form a multi-sector broadcast arc for communication with mobile handsets linked to the base station.


As used herein, “base station” is one or more transmitters or receivers or a combination of transmitters and receivers, including the accessory equipment, necessary at one location for providing a service involving the transmission, emission, and/or reception of radio waves for one or more specific telecommunication purposes to a mobile station (e.g., a UE), wherein the base station is not intended to be used while in motion in the provision of the service. The term/abbreviation UE (also referenced herein as a user device or wireless communications device (WCD)) can include any device employed by an end-user to communicate with a telecommunications network, such as a wireless telecommunications network. A UE can include a mobile device, a mobile broadband adapter, or any other communications device employed to communicate with the wireless telecommunications network. A UE, as one of ordinary skill in the art may appreciate, generally includes one or more antennas coupled to a radio for exchanging (e.g., transmitting and receiving) transmissions with a nearby base station. A UE may be, in an embodiment, similar to device 600 described herein with respect to FIG. 6.


As used herein, UE (also referenced herein as a user device or a wireless communication device) can include any device employed by an end-user to communicate with a wireless telecommunications network. A UE can include a mobile device, a mobile broadband adapter, a fixed location or temporarily fixed location device, or any other communications device employed to communicate with the wireless telecommunications network. For an illustrative example, a UE can include cell phones, smartphones, tablets, laptops, small cell network devices (such as micro cell, pico cell, femto cell, or similar devices), and so forth. Further, a UE can include a sensor or set of sensors coupled with any other communications device employed to communicate with the wireless telecommunications network; such as, but not limited to, a camera, a weather sensor (such as a rain gage, pressure sensor, thermometer, hygrometer, and so on), a motion detector, or any other sensor or combination of sensors. A UE, as one of ordinary skill in the art may appreciate, generally includes one or more antennas coupled to a radio for exchanging (e.g., transmitting and receiving) transmissions with a nearby base station.


In aspects, a UE provides UE data including location and channel quality information to the wireless communication network via the base station. Location information may be based on a current or last known position utilizing GPS or other satellite location services, terrestrial triangulation, an base station's physical location, or any other means of obtaining coarse or fine location information. Channel quality information may indicate a realized uplink and/or downlink transmission data rate, observed signal-to-interference-plus-noise ratio (SINR) and/or signal strength at the user device, or throughput of the connection. Channel quality information may be provided via, for example, an uplink pilot time slot, downlink pilot time slot, sounding reference signal, channel quality indicator (CQI), rank indicator, precoding matrix indicator, or some combination thereof. Channel quality information may be determined to be satisfactory or unsatisfactory, for example, based on exceeding or being less than a threshold. Location and channel quality information may take into account the user device capability, such as the number of antennas and the type of receiver used for detection. Processing of location and channel quality information may be done locally, at the base station or at the individual antenna array of the base station. In other aspects, the processing of said information may be done remotely.


A service state of the UEs may include, for example, an in-service state when a UE is in-network (i.e., using services of a primary provider to which the UE is subscribed to, otherwise referred to as a home network carrier), or when the UE is roaming (i.e., using services of a secondary provider providing coverage to the particular geographic location of the UE that has agreements in place with the primary provider of the UE). The service state of the UE may also include, for example, an emergency only state when the UE is out-of-network and there are no agreements in place between the primary provider of the UE and the secondary provider providing coverage to the current geographic location of the UE. Finally, the service state of the UE may also include, for example, an out of service state when there are no service providers at the particular geographic location of the UE.


The UE data may be collected at predetermined time intervals measured in milliseconds, seconds, minutes, hours, or days. Alternatively, the UE data may be collected continuously. The UE data may be stored at a storage device of the UE, and may be retrievable by the UE's primary provider as needed and/or the UE data may be stored in a cloud based storage database and may be retrievable by the UE's primary provider as needed. When the UE data is stored in the cloud based storage database, the data may be stored in association with a data identifier mapping the UE data back to the UE, or alternatively, the UE data may be collected without an identifier for anonymity.


Aspects of the present disclosure provide a way to distinguish the XR device from other devices on the WiFi network with different latency needs. An XR identifier is sent by the XR device during the pairing process and a WiFi negotiating agent assists in authenticating a frequency which can be used by the XR device once connected to the WiFi network. The negotiation may use dynamic steering and less congested carriers across the WiFi radio access network.


In accordance with a first aspect of the present disclosure a method for ensuring quality of experience (QoE) for an extended reality (XR) device over a WiFi network is provided. The method begins when a pairing request is received from an XR device. The pairing request contains an XR identifier for the XR device that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment. A channel selection is then negotiated by a negotiating agent for the XR device. After negotiation is complete, the XR device is paired with a network or a WiFi device providing access to the network. The device providing access may be a router or a UE acting as a hotspot. After pairing, transmissions to the XR device are made using the negotiated channel selection.


A second aspect of the present disclosure provides a system for ensuring quality of experience (QoE) for an extended reality (XR) device over a WiFi network is provided. The system includes a WiFi connectivity device that has one or more antennas for receiving pairing requests from at least one XR device and also for transmitting data to the at least one XR device, and a processor, The processor is configured to receive a pairing request from at least one XR device. The pairing request contains an XR device identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for data rate and bandwidth assignment. A negotiating agent then negotiates at least one channel selection for the at least one XR device. After negotiations conclude, at least one XR device is paired with the WiFi connectivity device. Transmissions are then scheduled to the at least one XR device using the negotiated channel selection.


Another aspect of the present disclosure is directed to a non-transitory computer storage media storing computer-useable instructions that, when used by one or more processors, cause the processors to transmit a pairing request to from an extended reality (XR) device to a WiFi connectivity device. The pairing request includes an XR identifier for an XR device that indicates one or more service needs of the XR device and identifies a priority of the XR device for data rate and bandwidth assignment. A negotiating agent negotiates a channel selection for the XR device based on the XR identifier. After negotiation concludes the XR device pairs with the WiFi connectivity device. Once pairing is complete the XR device receives scheduled transmissions on the negotiated channel selection.



FIG. 1 illustrates an example of a network environment 100 suitable for use in implementing embodiments of the present disclosure. The network environment 100 is but one example of a suitable network environment and is not intended to suggest any limitation as to the scope of use or functionality of the disclosure. Neither should the network environment 100 be interpreted as having any dependency or requirement to any one or combination of components illustrated.


Network environment 100 includes extended reality (XR) devices 102, 104, and 110, user equipment (UE) devices 106 and 108, base station 114 (which may be a cell site or the like), router 130, and one or more communication channels 112 and 144. The communication channels 112 and 144 can communicate over frequency bands assigned to the carrier. In network environment 100, XR devices may take on multiple forms, such as cameras, microphones, sensors, googles, and glasses, to name a few, and UE devices may take on a variety of forms, such as a personal computer (PC), a user device, a smart phone, a smart watch, a laptop computer, a mobile phone, a mobile device, a tablet computer, a wearable computer, a personal digital assistant (PDA), a server, a CD player, an MP3 player, a global positioning system (GPS) device, a video player, a handheld communications device, a workstation, a router, a hotspot, and any combination of these delineated devices, or any other device (such as the computing device (600) that communicates via wireless communications with the base station 114 in order to interact with a public or private network.


In some aspects, each of the XRs 102, 104, and 110, router 130 and UEs 106 and 108, may correspond to computing device 600 in FIG. 6. Thus, an XR device, router, or a UE can include, for example, a display(s), a power source(s) (e.g., a battery), a data store(s), a speaker(s), memory, a buffer(s), a radio(s) and the like. In some implementations, for example, an XR devices such as 102, 104, and 110, router 130, as well as the UEs 106 and 108 comprise a wireless or mobile device with which a wireless telecommunication network(s) can be utilized for communication (e.g., voice and/or data communication). In this regard, the user device can be any mobile computing device that communicates by way of a wireless network, for example, a 3G, 4G, 5G, LTE, CDMA, or any other type of network.


In some cases, XR devices 102, 104, and 110, router 103, as well as UEs 106 and 108 in network environment 100 can optionally utilize one or more communication channels 112 and 144 to communicate with other computing devices (e.g., a mobile device(s), a server(s), a personal computer(s), etc.) through base station 114. Base station 114 may be a gNodeB in a 5G or 6G network. Some devices, such as XR device 110 may communicate with the network through a WiFi network using router 130.


The network environment 100 may be comprised of a telecommunications network(s), or a portion thereof. A telecommunications network might include an array of devices or components (e.g., one or more base stations), some of which are not shown. Those devices or components may form network environments similar to what is shown in FIG. 1, and may also perform methods in accordance with the present disclosure. Components such as terminals, links, and nodes (as well as other components) can provide connectivity in various implementations. Network environment 100 can include multiple networks, as well as being a network of networks, but is shown in more simple form so as to not obscure other aspects of the present disclosure.


The one or more communication channels 112 and 144 can be part of a telecommunication network that connects subscribers to their immediate telecommunications service provider (i.e., home network carrier). In some instances, the one or more communication channels 112 and 144 can be associated with a telecommunications provider that provides services (e.g., 3G network, 4G network, LTE network, 5G network, and the like) to extended reality devices such as XR devices 102, 104, and 110, router 130, and user devices, such as UEs 106 and 108. For example, the one or more communication channels may provide voice, SMS, and/or data services to XRs 102, 104, and 110, router 130, as well as to UEs 106 and 108, or corresponding users that are registered or subscribed to utilize the services provided by the telecommunications service provider. Some devices, such as XR device 110 connect to router 130 and receive telecommunications services through router 130. The one or more communication channels 112 and 144 can comprise, for example, a 1× circuit voice, a 3G network (e.g., CDMA, CDMA2000, WCDMA, GSM, UMTS), a 4G network (WiMAX, LTE, HSDPA), or a 5G network or a 6G network.


In some implementations, base station 114 is configured to communicate with a XR device such as 102, 104, and 110, router 130, as well as with a UE, such as UEs 106 and 108, that are located within the geographic area, or cell, covered by radio antennas of base station 114. Base station 114 may include one or more base stations, base transmitter stations, radios, antennas, antenna arrays, power amplifiers, transmitters/receivers, digital signal processors, control electronics, GPS equipment, and the like. In particular, base station 114 may selectively communicate with the user devices using dynamic beamforming.


The router 130 provides device connectivity to the wireless network to devices, including UEs and XR devices through pairing with those devices. Pairing is the process where a WiFi device obtains the service set identifier (SSID) and the name of the WiFi network. In place of the router 130 the role can be provided by a UE or similar device acting as a WiFi hotspot. When connected to the hotspot or router 130 the paired device obtains internet protocol (IP) based communications from the network through the router 130 or hotspot.


As shown, base station 114 is in communication with a router 130 and at least a network database 120 via a backhaul channel 116. As the XR devices 102, 104, and 110, router 130 and UEs 106 and 108 collect individual status data, the status data can be automatically communicated by each of the XR devices 102, 104, and 110, router 130 and the UEs 106 and 108 to the base station 114. Base station 114 may store the data communicated by the XR devices 102, 104, and 110, router 130, and the data communicated by the UEs 106 and 108 at a network database 120. Status data for XR device 110 may be communicated to base station 114 through router 130. Alternatively, the base station 114 may automatically retrieve the status data from the XR devices 102,104, and 110, router 130, and the UEs 106 and 108, and router 130 and similarly store the data in the network database 120. The data may be communicated or retrieved and stored periodically within a predetermined time interval which may be in seconds, minutes, hours, days, months, years, and the like. With the incoming of new data, the network database 120 may be refreshed with the new data every time, or within a predetermined time threshold so as to keep the status data stored in the network database 120 current. For example, the data may be received at or retrieved by the base station 114 every 10 minutes and the data stored at the network database 120 may be kept current for 30 days, which means that status data that is older than 30 days would be replaced by newer status data at 10 minute intervals. As described above, the status data collected by the XR devices 102, 104, and 110, router 130, and the UEs 106 and 108 can include, for example, service state status, the respective UE's current geographic location, a current time, a strength of the wireless signal, available networks, and the like.


The router 130 comprises a memory 132 and a negotiating agent 134. All determinations, calculations, and data further generated by the negotiating agent 134 may be stored at the memory 132 and also at the data store 140. Although the router 130 is shown as a single component comprising the memory 132 and the negotiating agent 134, it is also contemplated that each of the memory 132 and the negotiating agent 134 may reside at different locations, be its own separate entity, and the like, within the home network carrier system.


The router 130 is configured to retrieve signal information, XR device information, UE device information, latency information, including quality of service (QoS) information, and metrics from the base station 114 or one of the XR devices, such as XR device 110. XR device information can include an XR device identifier, QoS/QoS identifier (QCI) information, and latency requirements. The QCI is a pointer to a set of QoS characteristics such as priority level, packet delay or packet error rate, or similar characteristics. XR and UE device information can include a device identifier and data usage information. The negotiating agent 134 can observe and track data usage and latency requirements for XR device 110. The negotiating agent 134 can be located in a central office or other centralized location for a virtualized radio access network, or may be located at router 130 or XR device 110. The base station 114 may be a gNodeB that interfaces with the negotiating agent 134. The negotiating agent 134 determines what data services are prioritized for delivery to the XR devices 102 and 104 as well as to the UEs 106, 108, and 110.


A WiFi network is an internet connection through router 130 that is shared with multiple devices, including XR devices and UEs in a home or business. The router 130 may be connected to an internet modem to provide internet protocol (IP) services to the connected devices. The router 130 acts as a hub to broadcast the internet signal to all WiFi enabled devices within range of the network coverage area.



FIG. 2 depicts a cellular network suitable for use in implementations of the present disclosure, in accordance with aspects herein. For example, as shown in FIG. 2, each geographic area in the plurality of geographic areas may have a hexagonal shape such as hexagon representing a geographic area 200 having cells 212, 214, 216, 218, 220, 222, 224, each including base station or base station 114, backhaul channel 116, antenna for sending and receiving signals over communication channels 112, and network database 120. The size of the geographic area 200 may be predetermined based on a level of granularity, detail, and/or accuracy desired for the determinations/calculations done by the systems, computerized methods, and computer-storage media. A plurality of XRs, UEs, and routers may be located within each geographic area collecting XR, UE, and router data within the geographic area at a given time. For example, as shown in FIG. 2, XR devices 202 and 204, and UEs 206 and 208, and router 210, may be located within geographic area 200 collecting XR, UE, and router data that is useable by the network, in accordance with aspects herein. XR devices 202 and 204, and UEs 206 and 208, and router 210 can move within the cell currently occupying, such as cell 212 and can move to other cells such as adjoining cells 214, 216, 218, 220, 222 and 224.



FIG. 3 depicts a range of extended reality (XR) scenes suitable for use in implementations of the present disclosure, in accordance with aspects herein. Extended reality is an umbrella term that includes augmented reality, virtual reality, and mixed reality. XR can cover depictions that are completely real and range to completely computer-generated images. The universe of realities 300, includes reality 302, augmented reality 304, augmented virtuality 306, and virtuality 310. Reality 302 is what we see around us every day and in video depictions. Augmented reality 304 is a real-world environment with objects that are enhanced by computer-generated perceptual information. Some objects in augmented reality 304 may be entirely computer-generated yet appear within a real-world environment. Augmented virtuality 306 is a virtual environment that is enhanced with added real world elements. In contrast to augmented reality 304 where the base environment is a real world environment, the base environment in augmented virtuality is a virtual environment. Virtuality 308 is an entirely virtual environment. A XR device user may interact with any type of environment illustrated in FIG. 3.



FIG. 4 depicts an extended reality (XR) system, in which implementations of the present disclosure may be employed, in accordance with aspects herein. An extended reality ecosystem 400 includes an application or task 402 that interfaces with an extended reality system 404. The application or task 402 includes a user wearing or interacting with an XR device 406. The XR device 406 sends an interaction 408 to the XR system 404. The interaction 408 may be data, a gesture, a selection, or other indication of the user's action consistent with the inputs accepted by the XR device 406. The interaction 408 is sent to the input devices and sensors 410 within the XR system 404.


The input devices and sensors 410 send the data 412 to the hardware 414. The data 412 may be commands, data, voice, or other action consistent with the XR device 406 used by the user. Hardware 414 can also receive cloud data 418 from a cloud 416. The cloud data 418 can be additional data or information needed to render a scene or other element in the XR system 404. The cloud data 418 and the data 412 from the input devices and sensors 410 are input to the rendering engine 420. Rendering engine 420 generates a scene or other XR device compatible output based on the data 412, cloud data 418, and the operations performed on the data 412 and cloud data 418 by the algorithms and data module 422. The algorithms and data module 422 generates output data 424 that is provided to the output devices 426. The output devices 426 provide feedback 428 to the XR device 406. The feedback 428 may be visual, as in a change or adjustment of a scene, an addition, such as an added character, or may be a text, or other feedback to the user of XR device 406. Other feedback can also include haptic feedback.


Problems, including packet loss, can occur when a low latency device, such as an XR device does not receive the necessary low latency bearer. QCI and QoS do not differentiate between types of data services. As a result, internet browsing can receive the same QCI or QoS as a low latency device, such as an XR device. The XR device also has no knowledge of the latency available from the radio network.


Quality of experience (QoE) is also an important consideration for XR devices. QoE can comprise non-technical aspects that directly affect a viewer's perception. QoS describes a network's ability to provide service from a technical point of view. QoE can include: service integrity defines by throughput, delay, jitter, and data loss. In addition, QoE can include: security services, such as authentication, authorization, integrity, and confidentiality.


The XR device cannot obtain the latency available from the network. The information is not available on the current 5G protocol stack including the physical layer (PHY) layer, the medium access control (MAC) layer. The port control protocol (PCP) also does not provide radio network latency information. These challenges arise when a device requests a quality of service for an application or network flow that is not part of the mobile network Evolved Packet Core (EPC). The network needs to distinguish between XR devices and non-XR devices, both of which may be using Enhanced Mobile Broadband (EMBB). EMBB is a service category in a 5G network that provides a minimum level for data transfer rates. In EMBB the bit rate is not guaranteed and real time data transfer is not provided.


WiFi also poses challenges on top of those discussed above. Smartphones may be used as a WiFi router to carry the traffic of XR devices and applications. WiFi does not provide a good mechanism for handling low latency traffic, such as that generated by XR devices. When an XR device pairs with a WiFi router the WiFi network needs to dedicate a special WiFi frequency to support the XR device and XR applications while still meeting the QoS and QoE for the XR device.


The WiFi device, such as router 130 in FIG. 1 or a UE acting as a WiFi hotspot, sends a service set identifier (SSID) to devices seeking to connect to the WiFi network. The WiFi network needs to differentiate the XR devices for QoS and QoE purposes. The first come first served approach most WiFi routers or hotspots take does not meet the needs of XR devices. In addition, the frequency hopping used in many networks does not provide the best carriers or the least congestion.


Aspects discussed herein provide dynamic steering and less congested carrier across the WiFi radio access network. Dynamic steering uses software-defined networking to configure a user's connection on the fly based on the application being used. Using dynamic steering allows a network operator to change the user plane location of an existing subscriber session to meet the requirements of different applications, including XR applications and devices.


Further aspects provide ways to provide a router knowledge of the XR devices. This knowledge of the XR device can be provided in every frame, both uplink and downlink. A bit or header field can be added in the uplink from the XR device and is used by the router to identify the low latency requirements of the XR device.


When an XR device seeks to connect to WiFi through router 130 or smartphone acting as a hotspot, a WiFi negotiation agent acts between the XR device and the router 130. The router 130 uses the XR identifier received to during the pairing process to identify the XR device. The router 130 then negotiates channel selection for the XR device. The negotiation agent can negotiate a dedicated frequency for the XR device on a shared channel on the WiFi network. The dedicated channel may be assigned by orthogonal frequency division multiple access (OFDMA) and can be based on uplink or downlink signaling. The negotiation agent can negotiate for both the XR device and the WiFi network and may reside in both locations.


As the WiFi network changes, with some devices leaving and new devices joining, different channels may become available for the XR device. Dynamic channel selection implemented by the router 130 allows for the channel assigned to the XR device to change as needed when signal conditions change or deteriorate, or on a periodic basis. This dynamic channel selection can ensure that the XR device receives the QoE a user expects. This may be implemented over-the-top, where a media service is delivered to the router 130 via the Internet.


On the downlink, the scheduler of the base station uses the bit or header field to prioritize data flows to the XR device. The base station can implement a separate network queue for the core and inform the core of the low latency requirements. The 5G core establishes secure and reliable network connectivity and provides access to the services available while handling a wide variety of essential functions, including connectivity and mobility management, authentication and authorization, subscriber data management and policy management, among others. 5G core network functions can be software-based and provided as cloud services.


The bit or header field can be incorporated into the connection identifier of the XR device or the cell radio network temporary identifier (C-RNTI). The C-RNTI is used to identify a particular device, such as a UE or XR device. The C-RNTI is assigned by the base station, which assigns different values to the UEs and XR devices. The C-RNTI also identifies the radio resource connection (RRC) and is also used for scheduling. RRC is a signaling protocol that is used between a 5G network and an XR device or a UE. Including the bit or header field in the C-RNTI differentiates the XR devices from UEs that may be using the same base station.


The base station uses the C-RNTI to allocate uplink grants, downlink assignments, and physical downlink control channel (PDCCH) orders, among others. The XR identifier can be included in the PDCCH channel for downlink transmission or can be included in the physical uplink control channel (PUCCH). The base station uses the C-RNTI to differentiate uplink transmissions of a UE or XR device from other similar devices. Incorporating the XR identifier, which can be a bit or header field, in the 16 bits of the C-RNTI also ensures that the XR device is differentiated during handovers.


During handover from one base station to another base station the C-RNTI is provided by the first base station to the second base station. The base station transfers the XR context from the first base station to the second base station. This enables buffering of user data until the connection is established on the second base station. The first base station can include information on the context and send it to the second base station. Contextual information can include information that the incoming device is an XR device with low latency needs and high priority over other traffic.


The connection identifier of the XR device can also be provided over the physical layer during signaling, either in the PDCCH or the PUCCH. The base station examines the data arriving for the connection in question, here, the XR device connection, and schedules data for that connection ahead of other non-XR device downlink transmissions. The base station knows the arriving data is high priority XR traffic. This ensures that the XR device receives data in a low latency connection.



FIG. 5 is a flow diagram of an exemplary method for ensuring quality of experience (QoE) for extended reality (XR) devices over WiFi networks, in which aspects of the present disclosure may be employed, in accordance with aspects herein. The method 500 begins in step 502 with receiving a paring request from an XR device, the pairing request containing an XR identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for data rate and bandwidth assignment. The pairing request can be received by a WiFi router, such as router 130 shown in FIG. 1. The pairing request can also be received by a UE acting as a WiFi hotspot. Once the pairing request has been received the method continues with step 504 with negotiating, by a negotiating agent, a channel selection for the XR device based on the XR identifier. The negotiating can be performed by the negotiating agent 134 shown in FIG. 1 as part of router 130. Alternatively, the negotiating agent can reside in the XR device or the UE acting as a WiFi hotspot.


Once the negotiation has concluded the method continues with step 506 pairing a network with the XR device. The XR device may be paired with a router or a UE acting as a WiFi hotspot. After pairing is complete the method continues in step 508 with scheduling transmissions for the XR device using the negotiated channel selection. The negotiated channel selection may be a dedicated frequency when the XR device is using a shared channel. The channel selection may be changed if the signal conditions change and the XR device may be assigned a less congested channel.



FIG. 6 depicts an exemplary computing device suitable for use in implementations of the present disclosure, in accordance with aspects herein. With continued reference to FIG. 6, computing device 600 includes bus 602 that directly or indirectly couples the following devices: memory 604, one or more processors 606, one or more presentation components 608, input/output (I/O) ports 612, I/O components 610, radio 616, transmitter 618, and power supply 614. Bus 602 represents what may be one or more busses (such as an address bus, data bus, or combination thereof). Although the devices of FIG. 6 are shown with lines for the sake of clarity, in reality, delineating various components is not so clear, and metaphorically, the lines would more accurately be grey and fuzzy. For example, one may consider a presentation component such as a display device to be one of I/O components 610. Also, processors, such as one or more processors 606, have memory. The present disclosure hereof recognizes that such is the nature of the art, and reiterates that FIG. 6 is merely illustrative of an exemplary computing environment that can be used in connection with one or more implementations of the present disclosure. Distinction is not made between such categories as “workstation,” “server,” “laptop,” “handheld device,” etc., as all are contemplated within the scope of FIG. 6 and refer to “computer” or “computing device.”


The implementations of the present disclosure may be described in the general context of computer code or machine-useable instructions, including computer-executable instructions such as program components, being executed by a computer or other machine, such as a personal data assistant or other handheld device. Generally, program components, including routines, programs, objects, components, data structures, and the like, refer to code that performs particular tasks or implements particular abstract data types. Implementations of the present disclosure may be practiced in a variety of system configurations, including handheld devices, consumer electronics, general-purpose computers, specialty computing devices, etc. Implementations of the present disclosure may also be practiced in distributed computing environments where tasks are performed by remote-processing devices that are linked through a communications network.


Computing device 600 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by computing device 600 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Computer storage media does not comprise a propagated data signal.


Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer-readable media.


Memory 604 includes computer-storage media in the form of volatile and/or nonvolatile memory. Memory 604 may be removable, nonremovable, or a combination thereof. Exemplary memory includes solid-state memory, hard drives, optical-disc drives, etc. Computing device 600 includes one or more processors 606 that read data from various entities such as bus 602, memory 604 or I/O components 610. One or more presentation components 608 present data indications to a person or other device, including the goggles of an XR device. Exemplary one or more presentation components 608 include a display device, speaker, printing component, vibrating component, etc. I/O ports 612 allow computing device 600 to be logically coupled to other devices including I/O components 610, some of which may be built into computing device 600. Illustrative I/O components 610 include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, etc.


The radio 616 represents one or more radios that facilitate communication with a wireless telecommunications network. While a single radio 616 is shown in FIG. 6, it is contemplated that there may be more than one radio 616 coupled to the bus 602. In aspects, the radio 616 utilizes a transmitter 618 to communicate with the wireless telecommunications network. It is expressly conceived that a computing device with more than one radio 616 could facilitate communication with the wireless telecommunications network via both the first transmitter 618 and an additional transmitters (e.g. a second transmitter). Illustrative wireless telecommunications technologies include CDMA, GPRS, TDMA, GSM, and the like. The radio 616 may additionally or alternatively facilitate other types of wireless communications including Wi-Fi, WiMAX, LTE, 3G, 4G, LTE, 5G, NR, VoLTE, or other VoIP communications. As can be appreciated, in various embodiments, radio 616 can be configured to support multiple technologies and/or multiple radios can be utilized to support multiple technologies. A wireless telecommunications network might include an array of devices, which are not shown so as to not obscure more relevant aspects of the invention. Components such as a base station, a communications tower, or even base stations (as well as other components) can provide wireless connectivity in some embodiments.


Many different arrangements of the various components depicted, as well as components not shown, are possible without departing from the scope of the claims below. Embodiments of our technology have been described with the intent to be illustrative rather than restrictive. Alternative embodiments will become apparent to readers of this disclosure after and because of reading it. Alternative means of implementing the aforementioned can be completed without departing from the scope of the claims below. Certain features and subcombinations are of utility and may be employed without reference to other features and subcombinations and are contemplated within the scope of the claims.

Claims
  • 1. A method for ensuring quality of experience (QoE) for extended reality (XR) devices over WiFi networks, comprising: receiving a pairing request from an XR device, the pairing request comprising an XR identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment;negotiating, by a negotiating agent, a channel selection for the XR device based on the XR identifier;pairing a network with the XR device; andscheduling transmissions to the XR device using the negotiated channel selection.
  • 2. The method of claim 1, wherein the channel selection provides a dedicated frequency for the XR device.
  • 3. The method of claim 2, wherein the dedicated frequency is assigned by orthogonal frequency division multiple access (OFDMA).
  • 4. The method of claim 1, wherein the channel selection is based on uplink or downlink signaling.
  • 5. The method of claim 2, wherein the dedicated frequency is a frequency on a shared channel.
  • 6. The method of claim 1, further comprising: assigning a new channel or frequency to the XR device.
  • 7. The method of claim 6, wherein the new channel or frequency is assigned to the XR device when signal conditions change.
  • 8. The method of claim 6, wherein the new channel or frequency is assigned to the XR device on a periodic basis.
  • 9. The method of claim 7, wherein the new channel or frequency is selected based on congestion in the network.
  • 10. A system for ensuring quality of experience (QoE) for extended reality (XR) devices over WiFi networks, comprising: a WiFi connectivity device having one or more antennas for receiving pairing requests from at least one XR device and transmitting data to the at least one XR device; anda processor, the processor configured to:receive a pairing request from the at least one XR device, the pairing request comprising an XR identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment;negotiating, by a negotiating agent, at least one channel selection for the at least one XR device;pairing the WiFi connectivity device with the at least one XR device; andscheduling transmissions to the at least one XR device using the at least one negotiated channel selection.
  • 11. The system of claim 10, wherein the WiFi connectivity device is a router.
  • 12. The system of claim 10, wherein the WiFi connectivity device is a user equipment (UE).
  • 13. The system of claim 12, wherein the UE acts as a WiFi hotspot.
  • 14. The system of claim 10, wherein the channel selection provides at least one dedicated frequency for the at least one XR device.
  • 15. The system of claim 14, wherein the at least one dedicated frequency is assigned by orthogonal frequency division multiple access (OFDMA).
  • 16. The system of claim 10, further comprising: N or frequency to the at least one XR device.
  • 17. The system of claim 16, wherein the at least one new channel or frequency is assigned to the at least one XR device on a periodic basis.
  • 18. The system of claim 16, wherein the at least one new channel or frequency is selected based on congestion in the network.
  • 19. A non-transitory computer storage media storing computer-useable instructions that, when used by one or more processors, cause the processors to: transmit a pairing request from an extended reality (XR) device to a WiFi connectivity device, the pairing request comprising an (XR) identifier that indicates one or more service needs of the XR device and identifies a priority of the XR device for the data rate and bandwidth assignment;negotiate, by a negotiating agent, a channel selection based on the XR identifier;pair the XR device with the WiFi connectivity device; andreceive scheduled transmissions on the negotiated channel selection.
  • 20. The non-transitory computer storage media of claim 19, wherein the negotiated channel is a dedicated frequency.