论文标题
使用基于头部运动的手势进行无触摸打字
Touchless Typing Using Head Movement-based Gestures
论文作者
论文摘要
在本文中，我们提出了一种新颖的无触摸打字界面，该界面使用屏幕上的Qwerty键盘和智能手机相机。键盘分为九个颜色编码的簇。用户将头向簇移动，其中包含他们想要输入的字母。前面的智能手机摄像头记录了头部运动。基于双向GRU的模型使用了富含头姿势特征的预训练的嵌入的模型将记录转化为群集序列。该模型的准确度分别在2234个用户收集的2234个视频序列的数据集中，分别达到了96.78％和86.81％。
In this paper, we propose a novel touchless typing interface that makes use of an on-screen QWERTY keyboard and a smartphone camera. The keyboard was divided into nine color-coded clusters. The user moved their head toward clusters, which contained the letters that they wanted to type. A front-facing smartphone camera recorded the head movements. A bidirectional GRU based model which used pre-trained embedding rich in head pose features was employed to translate the recordings into cluster sequences. The model achieved an accuracy of 96.78% and 86.81% under intra- and inter-user scenarios, respectively, over a dataset of 2234 video sequences collected from 22 users.
