论文标题

FOVR:通过带宽受限的无线网络基于注意力的VR流

FoVR: Attention-based VR Streaming through Bandwidth-limited Wireless Networks

论文作者

Yang, Songzhou, He, Yuan, Zheng, Xiaolong

论文摘要

消费者虚拟现实(VR)已被广泛用于娱乐和医学等各个应用领域。尽管具有出色的沉浸式经验,但可以在不受限制的移动设备上实现高质量的VR仍然是一项极具挑战性的任务。 VR流媒体流的高带宽需求通常是一个传统的无线连接,这会影响用户体验,进而限制VR在实践中的可用性。在本文中,我们提出了通过带宽受限无线网络的FOVR,基于注意力的分层VR流。 FOVR的设计源于人类视野是层次结构的见解,因此可以将视野中的不同领域(FOV)带有不同品质的VR含量。通过利用VR设备的凝视跟踪能力,FOVR能够准确预测用户的注意力,以便可以适当地安排层次VR的流数。通过这种方式,FOVR大大降低了带宽成本和计算成本,同时保持高质量的用户体验。我们在商业VR设备上实施FOVR,并在各种情况下评估其性能。实验结果表明,与原始VR流和最新方法相比,FOVR分别将带宽成本降低了88.9%和76.2%。

Consumer Virtual Reality (VR) has been widely used in various application areas, such as entertainment and medicine. In spite of the superb immersion experience, to enable high-quality VR on untethered mobile devices remains an extremely challenging task. The high bandwidth demands of VR streaming generally overburden a conventional wireless connection, which affects the user experience and in turn limits the usability of VR in practice. In this paper, we propose FoVR, attention-based hierarchical VR streaming through bandwidth-limited wireless networks. The design of FoVR stems from the insight that human's vision is hierarchical, so that different areas in the field of view (FoV) can be served with VR content of different qualities. By exploiting the gaze tracking capacity of the VR devices, FoVR is able to accurately predict the user's attention so that the streaming of hierarchical VR can be appropriately scheduled. In this way, FoVR significantly reduces the bandwidth cost and computing cost while keeping high quality of user experience. We implement FoVR on a commercial VR device and evaluate its performance in various scenarios. The experiment results show that FoVR reduces the bandwidth cost by 88.9% and 76.2%, respectively compared to the original VR streaming and the state-of-the-art approach.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源