Innovating Multi-user Volumetric Video Streaming through Cross-layer Design

Abstract

Although existing work has demonstrated the feasibility of streaming volumetric content to a single user, there exist many appealing applications (e.g., classroom education and collaborative design) that involve multiple users who watch the same volumetric content simultaneously. In this paper, we first perform a scaling experiment to demonstrate the challenges of streaming high-quality volumetric videos to multiple users and reveal the viewport-similarity opportunity that we can leverage to effectively optimize the network resource utilization using multicast over mmWave. We then develop a holistic research agenda for improving the performance and quality of experience for multi-user volumetric video streaming on commodity devices. Our proposed research includes joint viewport prediction and blockage mitigation for multiple users, multicast grouping based on viewport similarity, customized mmWave beam design for efficient multicast, and mmWave-aware multi-user video rate adaptation. Finally, we discuss the open challenges of building a practical system with the proposed research roadmap.