论文标题
FRAS:联合强化学习授权自适应点云视频流
FRAS: Federated Reinforcement Learning empowered Adaptive Point Cloud Video Streaming
论文作者
论文摘要
由于高编码/解码的复杂性,高视频比特率和低延迟需求,因此Point Cloud视频传输是具有挑战性的。 Consequently, conventional adaptive streaming methodologies often find themselves unsatisfactory to meet the requirements in threefold: 1) current algorithms reuse existing quality of experience (QoE) definitions while overlooking the unique features of point cloud video thus failing to provide optimal user experience, 2) most deep learning approaches require long-span data collections to learn sufficiently varied network conditions and result in long training periods and capacity occupation, 3) cloud training approaches pose privacy risks由用户报告的服务使用和网络条件泄漏引起的。 为了克服局限性,我们提出了FRA,这是我们所知的第一个联合加强学习框架,以供自适应点云视频流。我们定义了一个新的QoE模型,该模型将Point Cloud视频的独特功能考虑到了。每个客户都使用增强学习(RL)来训练视频质量选择,以便在多个约束下优化用户的QOE。然后,将联合学习框架与RL算法集成在一起,以通过隐私保护提高培训性能。使用真实点云视频和网络迹线的大量模拟揭示了所提出的方案比基线方案的优越性。我们还实施了一个原型,该原型通过现实世界测试来证明FRAS的性能。
Point cloud video transmission is challenging due to high encoding/decoding complexity, high video bitrate, and low latency requirement. Consequently, conventional adaptive streaming methodologies often find themselves unsatisfactory to meet the requirements in threefold: 1) current algorithms reuse existing quality of experience (QoE) definitions while overlooking the unique features of point cloud video thus failing to provide optimal user experience, 2) most deep learning approaches require long-span data collections to learn sufficiently varied network conditions and result in long training periods and capacity occupation, 3) cloud training approaches pose privacy risks caused by leakage of user reported service usage and networking conditions. To overcome the limitations, we present FRAS, the first federated reinforcement learning framework, to the best of our knowledge, for adaptive point cloud video streaming. We define a new QoE model which takes the unique features of point cloud video into account. Each client uses reinforcement learning (RL) to train video quality selection with the objective of optimizing the user's QoE under multiple constraints. Then, a federated learning framework is integrated with the RL algorithm to enhance training performance with privacy preservation. Extensive simulations using real point cloud videos and network traces reveal the superiority of the proposed scheme over baseline schemes. We also implement a prototype that demonstrates the performance of FRAS via real-world tests.