论文标题

对复杂任务的限制空间优化和强化学习

Constrained-Space Optimization and Reinforcement Learning for Complex Tasks

论文作者

Tsai, Ya-Yen, Xiao, Bo, Johns, Edward, Yang, Guang-Zhong

论文摘要

从演示中学习越来越多地用于将操作员的操纵技巧传输到机器人。在实践中,重要的是要迎合有限的数据和不完美的人类示范以及潜在的安全限制。本文介绍了用于管理复杂任务的限制空间优化和强化学习方案。通过在受约束空间内的互动中,培训了加固学习代理,以根据定义的奖励功能优化操纵技能。在学习之后,最佳政策源自训练有素的强化学习者,然后实施它来指导机器人执行与专家演示相似的任务。通过机器人的缝合任务验证了所提出的方法的有效性,这表明,学识渊博的政策在联合运动和最终效果轨迹的平稳性以及整体任务完成时间方面优于专家的演示。

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints. This paper presents a constrained-space optimization and reinforcement learning scheme for managing complex tasks. Through interactions within the constrained space, the reinforcement learning agent is trained to optimize the manipulation skills according to a defined reward function. After learning, the optimal policy is derived from the well-trained reinforcement learning agent, which is then implemented to guide the robot to conduct tasks that are similar to the experts' demonstrations. The effectiveness of the proposed method is verified with a robotic suturing task, demonstrating that the learned policy outperformed the experts' demonstrations in terms of the smoothness of the joint motion and end-effector trajectories, as well as the overall task completion time.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源