论文标题

在自闭症谱系障碍的背景下,用于机器人辅助治疗的个性化机器人行为建模

Personalised Robot Behaviour Modelling for Robot-Assisted Therapy in the Context of Autism Spectrum Disorder

论文作者

Stolarz, Michał, Mitrevski, Alex, Wasil, Mohammad, Plöger, Paul G.

论文摘要

在针对自闭症谱系障碍患者的机器人辅助治疗中,如果必须手动控制机器人,则在治疗过程中的治疗师工作量会增加。为了允许治疗师专注于与人的互动,机器人应该更加自主,即它应该能够解释该人的状态并根据其行为不断适应其行为。在本文中,我们开发了一个个性化的机器人行为模型,该模型可以在活动期间的机器人决策过程中使用。该行为模型是在从真实交互数据中学到的用户模型的帮助下训练的。我们将Q学习用于此任务,因此结果表明该策略需要约10,000个迭代才能收敛。因此,我们调查了改善收敛速度的政策转移;我们表明这是一个可行的解决方案,但是不适当的初始政策可能会导致最终的最终回报。

In robot-assisted therapy for individuals with Autism Spectrum Disorder, the workload of therapists during a therapeutic session is increased if they have to control the robot manually. To allow therapists to focus on the interaction with the person instead, the robot should be more autonomous, namely it should be able to interpret the person's state and continuously adapt its actions according to their behaviour. In this paper, we develop a personalised robot behaviour model that can be used in the robot decision-making process during an activity; this behaviour model is trained with the help of a user model that has been learned from real interaction data. We use Q-learning for this task, such that the results demonstrate that the policy requires about 10,000 iterations to converge. We thus investigate policy transfer for improving the convergence speed; we show that this is a feasible solution, but an inappropriate initial policy can lead to a suboptimal final return.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源