rfc9817v5.txt   rfc9817.txt 
skipping to change at line 497 skipping to change at line 497
fog computing for local information processing, the edge for fog computing for local information processing, the edge for
aggregation, and the cloud for image processing. aggregation, and the cloud for image processing.
XR stands to benefit significantly from computing capabilities in the XR stands to benefit significantly from computing capabilities in the
network. For example, XR applications can offload intensive network. For example, XR applications can offload intensive
processing tasks to edge servers, considerably reducing latency when processing tasks to edge servers, considerably reducing latency when
compared to cloud-based applications and enhancing the overall user compared to cloud-based applications and enhancing the overall user
experience. More importantly, COIN can enable collaborative XR experience. More importantly, COIN can enable collaborative XR
experiences, where multiple users interact in the same virtual space experiences, where multiple users interact in the same virtual space
in real time, regardless of their physical locations, by allowing in real time, regardless of their physical locations, by allowing
resource discovery and re-rerouting of XR streams. While not a resource discovery and re-routing of XR streams. While not a feature
feature of most XR implementations, this capability opens up new of most XR implementations, this capability opens up new
possibilities for remote collaboration, training, and entertainment. possibilities for remote collaboration, training, and entertainment.
Furthermore, COIN can support dynamic content delivery, allowing XR Furthermore, COIN can support dynamic content delivery, allowing XR
applications to seamlessly adapt to changing environments and user applications to seamlessly adapt to changing environments and user
interactions. Hence, the integration of computing capabilities into interactions. Hence, the integration of computing capabilities into
the network architecture enhances the scalability, flexibility, and the network architecture enhances the scalability, flexibility, and
performance of XR applications by supplying telemetry and advanced performance of XR applications by supplying telemetry and advanced
stream management, paving the way for more immersive and interactive stream management, paving the way for more immersive and interactive
experiences. experiences.
Indeed, XR applications require real-time interactivity for immersive Indeed, XR applications require real-time interactivity for immersive
skipping to change at line 526 skipping to change at line 526
3.2.2. Characterization 3.2.2. Characterization
As mentioned above, XR experiences, especially those involving As mentioned above, XR experiences, especially those involving
collaboration, are difficult to deliver with a client-server cloud- collaboration, are difficult to deliver with a client-server cloud-
based solution. This is because they require a combination of based solution. This is because they require a combination of
multistream aggregation, low delays and delay variations, means to multistream aggregation, low delays and delay variations, means to
recover from losses, and optimized caching and rendering as close as recover from losses, and optimized caching and rendering as close as
possible to the user at the network edge. Hence, implementing such possible to the user at the network edge. Hence, implementing such
XR solutions necessitates substantial computational power and minimal XR solutions necessitates substantial computational power and minimal
latency, which, for now, has spurred the development of better latency, which, for now, has spurred the development of better
headsets not networked or distributed solutions as factors like headsets, rather than spurring networked or distributed solutions, as
distance from cloud servers and limited bandwidth can still factors like distance from cloud servers and limited bandwidth can
significantly lower application responsiveness. Furthermore, when XR still significantly lower application responsiveness. Furthermore,
deals with sensitive information, XR applications must also provide a when XR deals with sensitive information, XR applications must also
secure environment and ensure user privacy, which represent provide a secure environment and ensure user privacy, which represent
additional burdens for delay-sensitive applications. Additionally, additional burdens for delay-sensitive applications. Additionally,
the sheer amount of data needed for and generated by XR applications, the sheer amount of data needed for and generated by XR applications,
such as video holography, put them squarely in the realm of data- such as video holography, put them squarely in the realm of data-
driven applications that can use recent trend analysis and driven applications that can use recent trend analysis and
mechanisms, as well as machine learning, in order to find the optimal mechanisms, as well as machine learning, in order to find the optimal
caching and processing solution and ideally reduce the size of the caching and processing solution and ideally reduce the size of the
data that needs transiting through the network. Other mechanisms, data that needs transiting through the network. Other mechanisms,
such as data filtering and reduction, and functional distribution and such as data filtering and reduction, and functional distribution and
partitioning, are also needed to accommodate the low delay needs for partitioning, are also needed to accommodate the low delay needs for
the same applications. the same applications.
skipping to change at line 593 skipping to change at line 593
The XR field has profited from extensive research in the past years The XR field has profited from extensive research in the past years
in gaming, machine learning, network telemetry, high resolution in gaming, machine learning, network telemetry, high resolution
imaging, smart cities, and the Internet of Things (IoT). imaging, smart cities, and the Internet of Things (IoT).
Information-Centric Networking (ICN) (and related) approaches that Information-Centric Networking (ICN) (and related) approaches that
combine, publish, subscribe, and distribute storage are also very combine, publish, subscribe, and distribute storage are also very
suited for the multisource-multidestination applications of XR. New suited for the multisource-multidestination applications of XR. New
AR and VR headsets and glasses have continued to evolve towards AR and VR headsets and glasses have continued to evolve towards
autonomy with local computation capabilities, increasingly performing autonomy with local computation capabilities, increasingly performing
much of the processing that is needed to render and augment the local much of the processing that is needed to render and augment the local
images. Mechanisms aimed at enhancing the computational and storage images. Mechanisms aimed at enhancing the computational and storage
capacities of mobile devices could also improve XR capabilities as capacities of mobile devices could also improve XR capabilities, as
they include the discovery of available servers within the they include discovering available servers within the environment and
environment and using them opportunistically to enhance the using them opportunistically to enhance the performance of
performance of interactive applications and distributed file systems. interactive applications and distributed file systems.
While there is still no specific COIN research in AR and VR, the need While there is still no specific COIN research in AR and VR, the need
for network support is important to offload some of the computations for network support is important to offload some of the computations
related to movement, multiuser interactions, and networked related to movement, multiuser interactions, and networked
applications, notably in gaming but also in health [NetworkedVR]. applications, notably in gaming but also in health [NetworkedVR].
This new approach to networked AR and VR is exemplified in [eCAR] by This new approach to networked AR and VR is exemplified in [eCAR] by
using synchronized messaging at the edge to share the information using synchronized messaging at the edge to share the information
that all users need to interact. In [CompNet2021] and that all users need to interact. In [CompNet2021] and
[WirelessNet2024], the offloading uses Artificial Intelligence (AI) [WirelessNet2024], the offloading uses Artificial Intelligence (AI)
to assign the 5G resources necessary for the real-time interactions, to assign the 5G resources necessary for the real-time interactions,
skipping to change at line 623 skipping to change at line 623
In summary, some XR solutions exist, and headsets continue to evolve In summary, some XR solutions exist, and headsets continue to evolve
to what is now claimed to be spatial computing. Additionally, with to what is now claimed to be spatial computing. Additionally, with
recent work on the metaverse, the number of publications related to recent work on the metaverse, the number of publications related to
XR has skyrocketed. However, in terms of networking, which is the XR has skyrocketed. However, in terms of networking, which is the
focus of this document, current deployments do not take advantage of focus of this document, current deployments do not take advantage of
network capabilities. The information is rendered and displayed network capabilities. The information is rendered and displayed
based on the local processing but does not readily discover the other based on the local processing but does not readily discover the other
elements in the vicinity or in the network that could improve its elements in the vicinity or in the network that could improve its
performance either locally, at the edge, or in the cloud. Yet, there performance either locally, at the edge, or in the cloud. Yet, there
are still very few interactive and immersive media applications over are still very few interactive and immersive media applications over
networks that allow for federating systems capabilities. networks that allow for the federation of systems capabilities.
3.2.4. Opportunities 3.2.4. Opportunities
While delay is inherently related to information transmission, if we While delay is inherently related to information transmission, if we
continue the analogy of the computer board to highlight some of the continue the analogy of the computer board to highlight some of the
COIN capabilities in terms of computation and storage but also COIN capabilities in terms of computation and storage but also
allocation of resources, there are some opportunities that XR could allocation of resources, there are some opportunities that XR could
take advantage of: take advantage of:
* Round trip time: 20 ms is usually cited as an upper limit for XR * Round trip time: 20 ms is usually cited as an upper limit for XR
skipping to change at line 672 skipping to change at line 672
* RQ 3.2.1: Can current PNDs provide the speed required for * RQ 3.2.1: Can current PNDs provide the speed required for
executing complex filtering operations, including metadata executing complex filtering operations, including metadata
analysis for complex and dynamic scene rendering? analysis for complex and dynamic scene rendering?
* RQ 3.2.2: Where should PNDs equipped with these operations be * RQ 3.2.2: Where should PNDs equipped with these operations be
located for optimal performance gains? located for optimal performance gains?
* RQ 3.2.3: Can the use of distributed AI algorithms across both * RQ 3.2.3: Can the use of distributed AI algorithms across both
data center and edge computers be leveraged for creating optimal data center and edge computers be leveraged for creating optimal
function allocation and the creation of semi-permanent datasets function allocation? Can the creation of semi-permanent datasets
and analytics for usage trending and flow management resulting in and analytics for usage trending and flow management result in
better localization of XR functions? better localization of XR functions?
* RQ 3.2.4: Can COIN improve the dynamic distribution of control, * RQ 3.2.4: Can COIN improve the dynamic distribution of control,
forwarding, and storage resources and related usage models in XR, forwarding, and storage resources and related usage models in XR,
such as to integrate local and fog caching with cloud-based pre- such as to integrate local and fog caching with cloud-based pre-
rendering, thus jointly optimizing COIN and higher layer protocols rendering? Could this jointly optimize COIN and higher layer
to reduce latency and, more generally, manage the quality of XR protocols to reduce latency and, more generally, manage the
sessions (e.g., through reduced in-network congestion and improved quality of XR sessions (e.g., through reduced in-network
flow delivery by determining how to prioritize XR data)? congestion and improved flow delivery by determining how to
prioritize XR data)?
* RQ 3.2.5: Can COIN provide the necessary infrastructure for the * RQ 3.2.5: Can COIN provide the necessary infrastructure for the
use of interactive XR everywhere? Particularly, how can a COIN use of interactive XR everywhere? Particularly, how can a COIN
system enable the joint collaboration across all segments of the system enable the joint collaboration across all segments of the
network (fog, edge, core, and cloud) to support functional network (fog, edge, core, and cloud) to support functional
decompositions, including using edge resources without the need decompositions, including using edge resources without the need
for a (remote) cloud connection? for a (remote) cloud connection?
* RQ 3.2.6: How can COIN systems provide multistream efficient * RQ 3.2.6: How can COIN systems provide multistream efficient
transmission and stream combining at the edge, including the transmission and stream combining at the edge, including the
 End of changes. 6 change blocks. 
18 lines changed or deleted 19 lines changed or added

This html diff was produced by rfcdiff 1.48.