Patent Application
20240236190
An example embodiment relates generally to immersive content consumption, and, more particularly, to techniques for providing quality of service management during immersive content consumption.
An increasing amount of video content is captured and delivered for a variety of different applications. For example, video content may be delivered via streaming, such as for Extended Reality (XR) services, such as Virtual Reality (VR) applications, Augmented Reality (AR) applications, and/or other types of applications. The video content that is captured and delivered may be expansive and may provide a panoramic view. In this regard, a streaming service may offer multiple representations of the same subpicture or tile by storing tiles at different qualities by varying video parameters like resolution, compression, and/or framerate. The download of new XR content can be triggered by head and user movements, and/or the need to download a subsequent portion of a three-dimensional (3D) video. Once all tiles in the FoV are downloaded, they can be rendered to generate the 3D representation that is displayed to the user.
Viewport-dependent streaming for XR services is typically implemented based on adaptive streaming schemes which can be based on network status, pose, and/or Six Degrees of Freedom (6DoF) information to adjust the quality to the available bitrate and user field of view (FoV). However, errors in the positions and angles can occur. While these errors can be corrected by the XR application assuming that sufficient information has been transmitted by the server, the server must transmit a large amount of high-quality information to compensate the errors and thus, the efficiency of the bitrate adaptation algorithm is negatively affected by the magnitude of the errors. In some cases, a wrong representation of a 3D image and/or video can be corrected at the receiver. For example, small rotational errors can be corrected by Asynchronous Time Warp (ATW), which transforms pre-rendered images stored in the buffer based on the very latest pose/6DoF tracking information before displaying the corrected image to the user. However, ATW cannot compensate position errors or large rotational errors without seriously affecting the user's Quality of Experience (QoE). This requires the transmission of tiles with higher quality. The amount of extra-information that must be transmitted to compensate position and angle errors depends on the magnitude of the error. Therefore, there exists a relationship between the magnitude of 6DoF errors and the extra bandwidth needed to compensate such errors.
A method, apparatus, and computer program product are disclosed for providing quality of service management during immersive content consumption. In one embodiment, the method, apparatus and computer program product are configured to determine and cause transmission of enhanced QoS information to provide a guaranteed bitrate for a client device. In this regard, user position and rotation and errors in the position and angles of rotation are utilized for determination as to the treatment of a flow of packets generated by, for example, XR and Cloud Gaming (CG) applications. By incorporating error information into the determination of QoS information, a more accurate reservation and scheduling of network and radio resources is achieved, leading to reduced consumption of network bandwidth and processing resources.
In an embodiment, a method is provided. The method includes receiving a first request comprising a positioning error set. The method also includes determining, based at least on the first request, an enhanced quality of service (QoS) indicator representing a QoS for a client device associated with the positioning error set. The method also includes causing transmission of a first response comprising configuration data related to a QoS flow for the client device, the configuration data being based at least on the enhanced QoS indicator.
In some embodiments of the method, the first request comprising the positioning error set is received from the client device or a network function associated with the client device.
In some embodiments of the method, determining the enhanced QoS indicator further comprises determining one or more of a bandwidth, a guaranteed bit rate (GBR), a maximum bit rate (MBR), and one or more QoS characteristics for the client device based at least on the positioning error set.
In some embodiments of the method, the configuration data related to the QoS flow comprises one or more of one or more QoS rules and one or more QoS parameters for the QoS flow. In some embodiments of the method, the first request comprises a PDU session create request or a PDU session update request. In some embodiments of the method, the first response comprises a PDU session create response or a PDU session update response.
In some embodiments of the method, determining the enhanced QoS indicator includes determining a maximum displacement value and an angle of rotation value based at least on the positioning error set. In some embodiments of the method, determining the enhanced QoS indicator also includes applying a transformation to the maximum displacement value and the angle of rotation value to determine a first field of view representation. In some embodiments of the method, determining the enhanced QoS indicator also includes generating a point list by applying a plurality of displacements to a second field of view representation. In some embodiments of the method, determining the enhanced QoS indicator also includes, based at least on the point list, determining a volume of a convex hull of points in the point list. In some embodiments of the method, determining the enhanced QoS indicator also includes determining an information ratio based at least on a volume of the first field of view representation and the volume of the convex hull. In some embodiments of the method, determining the enhanced QoS indicator also includes determining a guaranteed bitrate based at least on the information ratio.
In another embodiment, an apparatus is provided. The apparatus includes at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to receive a first request comprising a positioning error set. The at least one memory and the computer program code are also configured to, with the at least one processor, cause the apparatus to determine, based at least on the first request, an enhanced quality of service (QoS) indicator representing a QoS for a client device associated with the positioning error set. The at least one memory and the computer program code are also configured to, with the at least one processor, cause the apparatus to cause transmission of a first response comprising configuration data related to a QoS flow for the client device, the configuration data being based at least on the enhanced QoS indicator.
In some embodiments of the apparatus, the first request comprising the positioning error set is received from the client device or a network function associated with the client device. In some embodiments of the apparatus, the at least one memory and the computer program code configured to determine the enhanced QoS indicator are further configured to with the at least one processor, cause the apparatus to determine one or more of a bandwidth, a guaranteed bit rate (GBR), a maximum bit rate (MBR), and one or more QoS characteristics for the client device based at least on the positioning error set.
In some embodiments of the apparatus, the configuration data related to the QoS flow comprises one or more of one or more QoS rules and one or more QoS parameters for the QoS flow. In some embodiments of the apparatus, the first request comprises a PDU session create request or a PDU session update request. In some embodiments of the apparatus, the first response comprises a PDU session create response or a PDU session update response.
In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to determine a maximum displacement value and an angle of rotation value based at least on the positioning error set. In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to apply a transformation to the maximum displacement value and the angle of rotation value to determine a first field of view representation. In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to generate a point list by applying a plurality of displacements to a second field of view representation.
In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to, based at least on the point list, determine a volume of a convex hull of points in the point list. In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to determine an information ratio based at least on a volume of the first field of view representation and the volume of the convex hull. In some embodiments of the apparatus, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine the enhanced QoS indicator are further configured to, with the at least one processor, cause the apparatus to determine a guaranteed bitrate based at least on the information ratio.
In another embodiment, a computer program product is provided that includes a non-transitory computer readable storage medium having program code portions stored thereon, with the program code portions configured, upon execution, to receive a first request comprising a positioning error set The program code portions are also configured, upon execution, to determine, based at least on the first request, an enhanced quality of service (QoS) indicator representing a QoS for a client device associated with the positioning error set. The program code portions are also configured, upon execution, to cause transmission of a first response comprising configuration data related to a QoS flow for the client device, the configuration data being based at least on the enhanced QoS indicator.
In some embodiments of the computer program product, the first request comprising the positioning error set is received from the client device or a network function associated with the client device.
In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to determine one or more of a bandwidth, a guaranteed bit rate (GBR), a maximum bit rate (MBR), and one or more QoS characteristics for the client device based at least on the positioning error set.
In some embodiments of the computer program product, the configuration data related to the QoS flow comprises one or more of one or more QoS rules and one or more QoS parameters for the QoS flow. In some embodiments of the computer program product, the first request comprises a PDU session create request or a PDU session update request. In some embodiments of the computer program product, the first response comprises a PDU session create response or a PDU session update response.
In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to determine a maximum displacement value and an angle of rotation value based at least on the positioning error set. In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to apply a transformation to the maximum displacement value and the angle of rotation value to determine a first field of view representation. In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to generate a point list by applying a plurality of displacements to a second field of view representation. In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to, based at least on the point list, determine a volume of a convex hull of points in the point list. In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to determine an information ratio based at least on a volume of the first field of view representation and the volume of the convex hull. In some embodiments of the computer program product, the program code portions configured, upon execution, to determine the enhanced QoS indicator are further configured to, upon execution, to determine a guaranteed bitrate based at least on the information ratio.
In another embodiment, an apparatus is provided that includes means for receiving a first request comprising a positioning error set. The apparatus also includes means for determining, based at least on the first request, an enhanced quality of service (QoS) indicator representing a QoS for a client device associated with the positioning error set. The apparatus also includes means for causing transmission of a first response comprising configuration data related to a QoS flow for the client device, the configuration data being based at least on the enhanced QoS indicator.
In some embodiments of the apparatus, the first request comprising the positioning error set is received from the client device or a network function associated with the client device.
In some embodiments of the apparatus, the means for determining the enhanced QoS indicator further comprise means for determining one or more of a bandwidth, a guaranteed bit rate (GBR), a maximum bit rate (MBR), and one or more QoS characteristics for the client device based at least on the positioning error set.
In some embodiments of the apparatus, the configuration data related to the QoS flow comprises one or more of one or more QoS rules and one or more QoS parameters for the QoS flow. In some embodiments of the apparatus, the first request comprises a PDU session create request or a PDU session update request. In some embodiments of the apparatus, the first response comprises a PDU session create response or a PDU session update response.
In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for determining a maximum displacement value and an angle of rotation value based at least on the positioning error set. In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for means for applying a transformation to the maximum displacement value and the angle of rotation value to determine a first field of view representation. In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for means for generating a point list by applying a plurality of displacements to a second field of view representation. In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for means for, based at least on the point list, determining a volume of a convex hull of points in the point list. In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for means for determining an information ratio based at least on a volume of the first field of view representation and the volume of the convex hull. In some embodiments of the apparatus, the means for determining the enhanced QoS indicator comprises means for means for determining a guaranteed bitrate based at least on the information ratio.
In another embodiment, a method is provided. The method includes determining a positioning error set, the positioning error set comprising a plurality of values representing a position and rotation of a user. The method also includes causing transmission of a session request, the session request comprising the positioning error set, wherein causing transmission of the session request initiates a reservation of bandwidth for a client device based at least on the positioning error set.
In some embodiments of the method, determining the positioning error set and causing transmission of the session request is performed by the client device or a network function associated with the client device. In some embodiments of the method, the session request comprises a Packet Data Unit (PDU) Session Establishment Request or a PDU Session Modification Request. In some embodiments of the method, the positioning error set comprises a set of maximum deviations for coordinates defining the position and angles defining the rotation of the user.
In another embodiment, an apparatus is provided that includes at least one processor and at least one memory including computer program code, with the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to determine a positioning error set, the positioning error set comprising a plurality of values representing a position and rotation of a user. The at least one memory and the computer program code are also configured to, with the at least one processor, cause the apparatus to cause transmission of a session request, the session request comprising the positioning error set, wherein causing transmission of the session request initiates a reservation of bandwidth for the client device based at least on the positioning error set.
In some embodiments of the apparatus, determining the positioning error set and causing transmission of the session request is performed by the client device or a network function associated with the client device. In some embodiments of the apparatus, the session request comprises a Packet Data Unit (PDU) Session Establishment Request or a PDU Session Modification Request. In some embodiments of the apparatus, the positioning error set comprises a set of maximum deviations for coordinates defining the position and angles defining the rotation of the user.
In another embodiment, a computer program product is provided that includes a non-transitory computer readable storage medium having program code portions stored thereon, the program code portions configured, upon execution, to determine a positioning error set, the positioning error set comprising a plurality of values representing a position and rotation of a user. The program code portions are also configured, upon execution, to cause transmission of a session request, the session request comprising the positioning error set, wherein causing transmission of the session request initiates a reservation of bandwidth for the client device based at least on the positioning error set.
In some embodiments of the computer program product, determining the positioning error set and causing transmission of the session request is performed by the client device or a network function associated with the client device. In some embodiments of the computer program product, the session request comprises a Packet Data Unit (PDU) Session Establishment Request or a PDU Session Modification Request.
In some embodiments of the computer program product, the positioning error set comprises a set of maximum deviations for coordinates defining the position and angles defining the rotation of the user.
In another embodiment, an apparatus is provided that includes means for determining a positioning error set, the positioning error set comprising a plurality of values representing a position and rotation of a user. The apparatus also includes means for causing transmission of a session request, the session request comprising the positioning error set, wherein causing transmission of the session request initiates a reservation of bandwidth for the client device based at least on the positioning error set.
In some embodiments of the apparatus, determining the positioning error set and causing transmission of the session request is performed by the client device or a network function associated with the client device. In some embodiments of the apparatus, the session request comprises a Packet Data Unit (PDU) Session Establishment Request or a PDU Session Modification Request. In some embodiments of the apparatus, the positioning error set comprises a set of maximum deviations for coordinates defining the position and angles defining the rotation of the user.
Having thus described certain example embodiments of the present disclosure in general terms, reference will hereinafter be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
Some embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments of the invention are shown. Indeed, various embodiments of the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like reference numerals refer to like elements throughout. As used herein, the terms “data,” “content,” “information,” and similar terms may be used interchangeably to refer to data capable of being transmitted, received and/or stored in accordance with embodiments of the present invention. Thus, use of any such terms should not be taken to limit the spirit and scope of embodiments of the present invention.
Additionally, as used herein, the term ‘circuitry’ refers to (a) hardware-only circuit implementations (e.g., implementations in analog circuitry and/or digital circuitry); (b) combinations of circuits and computer program product(s) comprising software and/or firmware instructions stored on one or more computer readable memories that work together to cause an apparatus to perform one or more functions described herein; and (c) circuits, such as, for example, a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation even if the software or firmware is not physically present. This definition of ‘circuitry’ applies to all uses of this term herein, including in any claims. As a further example, as used herein, the term ‘circuitry’ also includes an implementation comprising one or more processors and/or portion(s) thereof and accompanying software and/or firmware. As another example, the term ‘circuitry’ as used herein also includes, for example, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or a similar integrated circuit in a server, a cellular network device, other network device (such as a core network apparatus), field programmable gate array, and/or other computing device. Additionally, as used herein, the term ‘module’ refers to hardware or a combination of hardware and software in which the execution of the software directs operation of the hardware.
As described above, viewport-dependent streaming XR services (e.g., VR, AR, etc.) are typically implemented based on adaptive streaming schemes based on network status and pose/6DoF information to adjust the quality to the available bitrate and user FoV. In particular, in some examples of viewport dependent streaming, an omnidirectional 3D scene with respect to an anchor point (e.g., the position of the user observing the content) is spatially divided into independent subpictures or tiles as illustrated in
To minimize the bitrate of the downloaded 3D video stream, an XR client in a user device (herein referred to as “user equipment” (UE)) may request tiles at different qualities according to their position in the user FoV. Tiles in the narrow, mid and far peripheral FoV are downloaded at decreasing quality as illustrated in
Given the specific characteristics of XR services, the Third Generation Partnership Project (3GPP) defines Quality of Service (QoS) parameters and characteristics for these services. The Fifth Generation (5G) QoS model as defined in 3GPP TS 23.501 is based on QoS Flows, where the QoS Flow is the finest granularity of QoS differentiation in a Protocol Data Unit (PDU) session. A QoS Flow Identifier (ID) (QFI) is used to identify a QoS Flow in a 5G system. Each QoS Flow is assigned a certain 5QI (5G QoS Identifier) that maps to QoS characteristics. The 5G QoS model supports both QoS Flows that require guaranteed flow bit rate (GBR QoS Flows) and QoS Flows that do not require guaranteed flow bit rate (Non-GBR QoS Flows). User Plane traffic with the same QFI and 5QI within a PDU Session receives the same traffic forwarding treatment from a scheduler. The QFI is carried in an encapsulation header (e.g., a General Packet Radio Service Tunnelling Protocol (GTP-U) header) on N3 (and N9), e.g., without any changes to the e2e packet header.
In the 3GPP Specification (herein incorporated by reference), particularly TS 23.501, the 5G QoS characteristics that are defined for each 5QI include Resource Type (e.g., GBR, Delay Critical GBR or Non-GBR), Priority Level, Packet Delay Budget (PDB) (e.g., including Core Network Packet Delay Budget), Packet Error Rate (PER), Averaging Window (e.g., for GBR and Delay Critical GBR Resource Types), and Maximum Data Burst Volume (MDBV) (e.g., for Delay Critical GBR Resource Types).
These characteristics describe the packet forwarding treatment that a QoS Flow receives edge-to-edge between a UE and the User Plane Function (UPF). Standardized 5QI values are specified in the Table 5.7.4-1 of Section 5.7.4 in TS 23.501 for services that are assumed to be frequently used and thus benefit from optimized signalling by using standardized QoS characteristics. For example, AR services have the dedicated 5QI number 80, which defines a Packet Delay Budget (PDB) of 10 milliseconds (ms) (with 2 to 5 ms dedicated only for the radio interface), and a Packet Error Rate of 10-6. Real Time Gaming services have the dedicated 5QI number 3, that defines a Packet Delay Budget (PDB) of 50 ms, a Packet Error Rate of 10-3, and averaging window of 5000 ms.
In this regard, 5QI characteristics (e.g., PDB, PER, MDBV) are all standardized for a certain 5QI value. However, as described above, XR applications integrate adaptive streaming algorithms that optimize the bitrate of the XR session using network statistics and viewport information, which depends on the pose/6DoF information (e.g., position and angles of rotation) estimated by the UE and/or the network. Position and angle errors affect the QoE since only XR content within the FoV is sent to the UE with different qualities (e.g., latency, resolution, compression) according to the distance from the center of gaze. Errors in the positions and angles can be corrected by the XR application, assuming that sufficient information has been transmitted by the server. In this regard, the server must transmit a large amount of high-quality information to compensate the error, and the efficiency of the bitrate adaptation algorithm is negatively affected by the magnitude of the error.
As described above, a wrong representation of the 3D image/video can be corrected at the receiver. For example, small rotational errors (pitch, yaw and roll) can be corrected by Asynchronous Time Warp (ATW), which transforms pre-rendered images stored in the buffer based on the most recent pose/6DoF tracking information before displaying the corrected image to the user. However, ATW cannot compensate position errors or large rotational errors without seriously affecting the users QoE. This requires the transmission of tiles with higher quality. The amount of extra information that must be transmitted to compensate for position and angle errors depends on the magnitude of the error. Therefore, there exists a relationship between the magnitude of 6DoF errors and the extra-bandwidth needed to compensate such an error.
Similar to the PER, which affects the achievable data rate due to maximum Modulation and Coding Scheme (MCS) selected by the Link Adaptation (LA), maximum 6DoF errors need to be provided to the network in order to modify the forwarding behavior of forwarded elements. Therefore, XR services require 5QI characteristics to reflect the 6DoF precision (deviation/error for both positions and angles of rotation) that are not captured by current 5QI specifications. For example, the admission control algorithm may consider the extra bandwidth needed to compensate the maximum 6DoF error to decide whether to admit an XR connection. Similarly, a scheduling algorithm could reserve more bandwidth for XR connections according to the magnitude of the 6DoF error.
In general, a QoS Flow is the finest granularity to differentiate traffic forwarding treatment (e.g., scheduling). A QoS Flow may be a GBR QoS Flow or a Non-GBR QoS Flow. A QoS Flow may be identified by a QoS Flow ID (QFI), which can be dynamically assigned or equal to the 5QI. A QoS Flow also supports reflective QoS.
A QoS Flow is characterized by a QoS profile, which can include a 5G QoS Identifier (5QI), an Allocation and Retention Priority (ARP), as well as 5G QoS characteristics (described above) associated with each 5QI scalar, e.g., Resource Type, Priority Level, Packet Delay Budget, Packet Error Rate, Averaging Window, and Maximum Data Burst Volume. A QoS profile for a GBR QoS Flow can also include Guaranteed/Max Flow Bit Rate (GFBR/MFBR) upload/download (UL/DL), Notification Control, and Maximum Packet Loss Rate UL/DL. A QoS profile for a Non-GBR QoS Flow may also include a Reflective QoS Attribute (RQA). In addition to a QoS profile, a QoS Flow can also be characterized by one or more QoS rules and one or more Service Data Flow (SDF) templates.
Embodiments herein improve the QoS framework by defining quality indicators, parameters, and characteristics to model the sensitivity of XR services to errors in position and angles of rotation, herein referred to as 6DoF error(s). The 6DoF error defines the maximum error for the position and angles of rotation of the user FoV, and embodiments herein utilize characteristics such as PDB, PER, and Guaranteed Bandwidth/Bit Rate as functions of the 6DoF error. In this regard, the 6DoF error is used by the network, in some embodiments, to determine enhanced QoS parameters for an XR service such as guaranteed bandwidth to be reserved for GBR services.
Referring now to
The wireless network 400 may include user equipment (UE), such as one or more client devices, e.g., client devices 404 (examples of which include but are not limited to a head-mounted display, camera, omnidirectional video device, virtual reality system, augmented reality system, video playback device and/or the like), configured to wirelessly couple (e.g., via an air interface) to a radio access network (RAN) being served by a wireless access point, such as a base station 106, wireless local area network access point, home base station, and/or other type of wireless access point. While certain embodiments described herein relate to 5G networks, it is to be appreciated that networks other than 5G networks may be used.
The wireless network 400 may further include a core network 402, which may include a core access and mobility management function (AMF). The AMF may be used for various network tasks such as registration management, connection management, reachability management, mobility management, and/or other various functions relating to security and access management and authorization. The network 100 and/or core network may further include features such as a session management function (SMF) module. The SMF module may be used for various responsibilities such as, but not limited to, creating, updating, and/or removing Protocol Data Unit (PDU) sessions and managing session context with the User Plane Function (UPF) of the network. The SMF may also use the non-access stratum (NAS), a functional layer used to manage the establishment of communication sessions and to maintain continuous communications with UE, in order to inform the user device of changes in QoS parameters which the RAN may be currently fulfilling.
In some embodiments, the network 100 and/or the core network may include devices having functions supporting a home public land mobile network (HPLMN) and corresponding functions for “home” wireless local area network (WLAN) access, offloading, and/or non-3GPP access. These devices may include a unified data management (UDM) module, a unified data repository, an over-the-air function (OTAF) module, and/or other non-illustrated features such as a home policy control function (PCF), a home network slice selection function (NSSF), an authentication server function (AUSF), an application function (AF), a home user plane function (H-UPF), and a data network (DN) 406.
According to various embodiments, the wireless network 400 may be configured according to an architecture for providing for panoramic video streaming. For example, the system 400 may be configured to provide for immersive video streaming and techniques to support a wide variety of XR applications including VR and AR applications.
One example of an apparatus 500 that may be configured to function as the client device 404, a Session Management Function (SMF), a core access and mobility management function (AMF), an Application Function (AF), and/or another network entity is depicted in
The apparatus 500 may, in some embodiments, be embodied in various computing devices as described above. However, in some embodiments, the apparatus may be embodied as a chip or chip set. In other words, the apparatus may comprise one or more physical packages (e.g., chips) including materials, components and/or wires on a structural assembly (e.g., a baseboard). The structural assembly may provide physical strength, conservation of size, and/or limitation of electrical interaction for component circuitry included thereon. The apparatus may therefore, in some cases, be configured to implement an embodiment of the present invention on a single chip or as a single “system on a chip.” As such, in some cases, a chip or chipset may constitute means for performing one or more operations for providing the functionalities described herein.
The processing circuitry 52 may be embodied in a number of different ways. For example, the processing circuitry may be embodied as one or more of various hardware processing means such as a coprocessor, a microprocessor, a controller, a digital signal processor (DSP), a processing element with or without an accompanying DSP, or various other circuitry including integrated circuits such as, for example, an ASIC (application specific integrated circuit), an FPGA (field programmable gate array), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like. As such, in some embodiments, the processing circuitry may include one or more processing cores configured to perform independently. A multi-core processing circuitry may enable multiprocessing within a single physical package. Additionally, or alternatively, the processing circuitry may include one or more processors configured in tandem via the bus to enable independent execution of instructions, pipelining and/or multithreading.
In an example embodiment, the processing circuitry 52 may be configured to execute instructions stored in the memory device 54 or otherwise accessible to the processing circuitry. Alternatively, or additionally, the processing circuitry may be configured to execute hard coded functionality. As such, whether configured by hardware or software methods, or by a combination thereof, the processing circuitry may represent an entity (e.g., physically embodied in circuitry) capable of performing operations according to an embodiment of the present disclosure while configured accordingly. Thus, for example, when the processing circuitry is embodied as an ASIC, FPGA or the like, the processing circuitry may be specifically configured hardware for conducting the operations described herein. Alternatively, as another example, when the processing circuitry is embodied as an executor of instructions, the instructions may specifically configure the processor to perform the algorithms and/or operations described herein when the instructions are executed. However, in some cases, the processing circuitry may be a processor of a specific device (e.g., an image or video processing system) configured to employ an embodiment of the present invention by further configuration of the processing circuitry by instructions for performing the algorithms and/or operations described herein. The processing circuitry may include, among other things, a clock, an arithmetic logic unit (ALU) and logic gates configured to support operation of the processing circuitry.
The communication interface 56 may be any means such as a device or circuitry embodied in either hardware or a combination of hardware and software that is configured to receive and/or transmit data, including media content in the form of video or image files, one or more audio tracks or the like. In this regard, the communication interface may include, for example, an antenna (or multiple antennas) and supporting hardware and/or software for enabling communications with a wireless communication network. Additionally, or alternatively, the communication interface may include the circuitry for interacting with the antenna(s) to cause transmission of signals via the antenna(s) or to handle receipt of signals received via the antenna(s). In some environments, the communication interface may alternatively or also support wired communication. As such, for example, the communication interface may include a communication modem and/or other hardware/software for supporting communication via cable, digital subscriber line (DSL), universal serial bus (USB) or other mechanisms.
It is to be understood that signaling between the source device 402 and the client device 404 may be carried out over any protocol at any layer of the International Organization for Standardization (ISO) Open Systems Interconnection (OSI) protocol stack (e.g., Session Description Protocol (SDP), Session Initiation Protocol (SIP), Real Time Streaming Protocol (RTSP), Real-Time Transport Protocol (RTP), Real-Time Transport Control Protocol (RTCP), Moving Pictures Experts Group Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (MPEG DASH) and the like). It is to be understood that reference to ‘downloading’ and ‘streaming’ data herein, while perhaps implemented through different transport protocol mechanisms, relate to similar functional concepts in this context.
Embodiments herein provide determination of enhanced QoS parameters (e.g., guaranteed bandwidth) of an XR service as a function of 6DoF errors. In this regard, maximum 6DoF errors may be defined as characteristics of a QoS Profile defined for a QoS Flow that maps an XR service. In some embodiments, 6DoF errors may be defined as relative or absolute errors with respect to any coordinate reference system and can be independently defined for position (e.g., horizontal, vertical) and angles (e.g., yaw, pitch, roll). The 6DoF errors may then be communicated to one or more network entities in order to modify forwarding behavior, such as, for example, reserving additional capacity for guaranteed bitrate (GBR) services. Several methods are described below, which include a method to compute enhanced QoS (eQoS) parameters as a function of 6DoF errors, as well as additional methods to communicate the eQoS parameters, which may be initiated by UE or a network entity after a PDU session is established.
The 6DoF error (also herein referred to as a positioning error set) may consist of a set of maximum deviations for coordinates defining a position and the angles defining a rotation of a user (e.g., a user using client device 404). Coordinates and angles and their maximum errors may be defined in a coordinate reference system. In some embodiments, a coordinate reference system may be used that is centered at the real user position with orientation in the direction of the user view. Therefore, the origin represents the real user position and null angles represent the center and main direction of the real user FoV. In some embodiments, other systems such as the Geographical Reference System (GRS) may be used assuming that there exists a transformation from the two reference systems. The FoV may be represented as a cone with an apex/vertex at the user position, a base radius equal to half the horizontal FoV, and a height equal to the maximum working distance. The FoV may also be represented, in some embodiments, as a pyramid, cylindric or more complex polyhedron.
In some embodiments, a Euclidean distance may be determined to the define the maximum horizontal and vertical errors of the position, while absolute values may be used to define the maximum errors for the rotation angles (e.g., yaw, pitch, and roll).
Returning to
In this regard, a portion of FOVO must be neglected in the computation of the guaranteed bandwidth/bitrate for each possible FOVE placement obtained by placing its vertex at any point within the sphere representing the maximum displacement e (e.g., the circle in the x,y projection illustrated in
In this regard, the method shown in
Additional enhancements may be utilized in some embodiments to speed up the determination. For example, if the space around the user's FoV is uniform, only a portion of all possible displacements and angles may be considered. Due to symmetry, the overlapping volume when FOVE is displaced by −e (e.g., E=(XO−e, yO, zO)) and rotated on the yaw axis by ψ=ε is equal to the overlapping volume with positive displacement e and rotation on yaw axis ψ=−ε. Therefore, only half of the sphere centered at O with radius e may be considered to compute the volume of the convex hull and double it to determine an estimation of the overall non-overlapping volume covered by all possible displacements due to the 6DoF errors.
To illustrate, as shown in
In some embodiments, the additional information to be sent to cover the 6DoF error may depend also on the elements and objects contained in the virtual space, since portions or even entire objects may disappear or appear when a rotation and/or displacement is applied to the user FoV. For example, in
While the 6DoF error can be used to change QoS parameters of the XR QoS Flow such as the guaranteed bitrate, the dependency between 6DoF error and QoS parameters is bidirectional. In this regard, QoS parameters like latency/Packet Delay Budget (PDB) and Packet Error Rate (PER) may also affect the 6DoF error. For example, a high PER may limit the maximum transmission rate in bad radio conditions. Therefore, a high PER can limit the maximum 6DoF error, since the additional used bandwidth to send the extra information used to compensate the 6DoF error might not be guaranteed in certain radio and network conditions.
6DoF error may be defined and indicated in several manners. In some embodiments, the 6DoF may comprise a definition of a maximum deviation for each coordinate from the real user position and the maximum rotational angle from the real user FoV direction. This requires the definition of six (6) real values, including one value for each of the three coordinate axes (e.g., values for x, y, and z) and one angle (e.g., a degrees measurement) for each of the three rotational axes (e.g., values for yaw, pitch, and roll). Additional representations/definitions may consider relationships and constraints among the coordinates and rotational angles. For example, the positioning error in the 6DoF error can be represented by considering maximum horizontal and vertical distances. If a same value for horizontal and vertical positioning error is used, the points representing the displacement from the real user position on the surface of a sphere centered at the real user position may be binded. Similarly, a single value for the rotational angles may be used, thus requiring only two values for the definition of the 6DoF error (e.g., a distance for the displacement error and an angle for the rotation error). Units of measure for the 6DoF error may be meters for positioning errors and degrees or radians for rotational angles. Further optimizations may consider the discretization of position and rotation errors (e.g., Low, Medium, High) to reduce the amount of information needed for their representation.
The 6DoF error may be included as part of a 5QI description, or, in some embodiments, the 6DoF error may be an additional parameter that is used to calculate the QoS configuration to be applied to a specific PDU session. The 5QI that contains or is calculated based on the 6DoF error may be referred to herein as an “enhanced QoS indicator.”
In circumstances in which the enhanced QoS Indicator comprises the 6DoF error, then it will have, on top of the already defined QoS characteristics (TS 23.501-Section 5.7.4), an indication of the 6DoF error. In this regard, the Table 5.7.4-1 of TS 23.501-Section 5.7.4 may include one additional column labeled as, for example, “6DoF Error.”
In some embodiments, the reservation of guaranteed bitrate/bandwidth as a function of the 6DoF errors may be performed by either the UE or a network entity (e.g., an SMF). The additional bandwidth reservation may be performed using enhancements of a session initiation procedure (e.g., a PDU Session Establishment) or, in some embodiments, enhancements of the session modification procedure (e.g., a PDU Session Modification), described below.
As shown, the operations begin by the UE (e.g., client device 404) causing transmission of a PDU session establishment request. Briefly turning to
At operation 1002, the apparatus 500 includes means, such as the processor, communication interface, and/or the like, for causing transmission of a session request, the session request comprising the positioning error set, wherein causing transmission of the session request initiates a reservation of bandwidth for the client device based at least on the positioning error set. In other words, once a positioning error set (e.g., the 6DoF error) is determined at the client device, the client device may include information associated with the 6DoF error within a session request, such as a PDU session establishment request, or, in some embodiments, a PDU session modification request (e.g., once a PDU session has already been established).
Returning to the signal diagram of
As shown, at operation 2 of
Briefly turning to
Returning to
At operation 5 of
At operation 6 of
At operation 7 of
At operation 9 of
At operation 10 of
At operation 11 of
At operation 13 of
At operation 17 of
As described above, the UE-initiated reservation of additional bandwidth as a function of 6DoF errors can be based on Rel. 16 TS 23.502 or on any other session modification procedure. This modification procedure may be occur in a circumstance in which the network allocated the default QoS indicator to the UE without following the operations described in
At operation 1 of
At operation 3 of
At operation 4 of
At operation 5 of
At operation 6 of
At operation 7 of
At operation 8 of
At operation 9 of
At operation 10 of
At operation 11 of
At operation 14 of
At operation 15 of
At operation 16 of
At operation 18 of
At operation 19 of
At operation 20 of
In some embodiments, a network-initiated (e.g., by an Application Function (AF)) reservation of additional bandwidth as a function of 6DoF errors may be performed (e.g., based on Rel. 16 TS 23.502 or on any upcoming session modification procedure). In this regard, the QoS Indicators may be initially allocated using the procedures described in
In this regard, in some embodiments, the AF may influence the UE, such as by transmitting AF requests that target a particular UE by a UE address. These AF requests may be routed (e.g., by the AF or by the Network Exposure Function (NEF)) to an individual PCF using the Binding Support Function (BSF). In other embodiments, the AF requests (e.g., described in clause 5.6.7 of TS 23.501) may target a group of UEs, or any UE accessing a combination of a Data Network Name (DNN) and Single-Network Slice Selection Assistance Information (S-NSSAI), or target an individual UE by a General Public Subscription Identifier (GPSI).
AF requests targeting an individual UE by a UE address are handled are shown in an example representation in
At operation 1 of
At operation 2 of
At operation 3 of
In some embodiments, if the UE address is not known, the operations detailed in
At operation 3 of
At operation 4 of
At operation 6 of
At operation 7 of
To evaluate, an FoV is modeled as a pyramid with an octagonal base (approximation of the semi-cone) and the 6DoF error using two parameters, e (a maximum relative positioning error expressed as percentage of the radius of the semi-cone representing the FoV which provides a bound for the maximum horizontal and vertical displacements of the FoV apex) and ε, a maximum angle of rotation on each axis of the FoV expressed in degrees.
The algorithm disclosed above in reference to
In various simulations performed, the maximum distance e is varied from 5% to 30% of the FoV radius and the maximum rotation angle E is varied from 5 to 30 degrees. The angle of view is set to 90 degrees according to the head-mounted device (Oculus Quest 2). It should be noted that the 180-degrees view can be obtained considering the combination of two FoVs captured by two cameras. However, the information ratio can be computed considering only one camera.
The two cones 40 illustrated in
Results of the information ratio as a function of the relative positioning error e and the angle of rotation E are illustrated in
The results show the benefit of utilizing the 6DoF error, as it enables a more accurate reservation and scheduling of network and radio resources. Note that additional information can be considered in order to improve eQoS parameters like the guaranteed bandwidth. For example, the direction where the user is moving can be used to consider positioning errors only in the direction of the user movements, thus reducing the guaranteed bandwidth by half.
Accordingly, blocks of the flowcharts support combinations of means for performing the specified functions and combinations of operations for performing the specified functions for performing the specified functions. It will also be understood that one or more blocks of the flowchart, and combinations of blocks in the flowcharts, can be implemented by special purpose hardware-based computer systems which perform the specified functions, or combinations of special purpose hardware and computer instructions.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims.
Moreover, although the foregoing descriptions and the associated drawings describe example embodiments in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
This application claims the benefit of U.S. Provisional Application No. 63/150,343, filed Feb. 17, 2021. The entire contents of all of the above applications are incorporated herein by reference.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2022/051975 | 1/28/2022 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20240137419 A1 | Apr 2024 | US |
| Number | Date | Country | |
|---|---|---|---|
| 63150343 | Feb 2021 | US |
