论文标题
在基于语音的人机互动中的沟通失败下理解混乱和情感状态
Towards Understanding Confusion and Affective States Under Communication Failures in Voice-Based Human-Machine Interaction
论文作者
论文摘要
我们提出了一系列研究，以了解基于语音的人机相互作用期间用户的情感状态。重点放在通信错误或失败的情况下。特别是，我们有兴趣了解与其他情感状态有关的“混乱”。研究由两种类型的任务组成：（1）与基于语音的虚拟代理的通信有关：与机器交谈并了解机器所说的内容，（2）与参与者解决难题和谜语的非通信，解决问题的任务，但被要求口头解释机器的答案。我们收集了参与者情感状态的视听数据和自我报告。我们报告了两项研究的结果和分析收集的数据。根据注释者的观察对第一项研究进行了分析，并根据自我报告分析了第二项研究。
We present a series of two studies conducted to understand user's affective states during voice-based human-machine interactions. Emphasis is placed on the cases of communication errors or failures. In particular, we are interested in understanding "confusion" in relation with other affective states. The studies consist of two types of tasks: (1) related to communication with a voice-based virtual agent: speaking to the machine and understanding what the machine says, (2) non-communication related, problem-solving tasks where the participants solve puzzles and riddles but are asked to verbally explain the answers to the machine. We collected audio-visual data and self-reports of affective states of the participants. We report results of two studies and analysis of the collected data. The first study was analyzed based on the annotator's observation, and the second study was analyzed based on the self-report.
