论文标题

过程控制的深度加强学习:初学者的底漆

Deep Reinforcement Learning for Process Control: A Primer for Beginners

论文作者

Spielberg, Steven, Tulsyan, Aditya, Lawrence, Nathan P., Loewen, Philip D, Gopaluni, R. Bhushan

论文摘要

基于高级模型的控制器在过程行业中已建立。但是,这样的控制器需要定期维护以保持可接受的性能。在绩效降解时,连续监视控制器性能并启动补救模型重新识别程序是一种常见的做法。这样的程序通常是复杂且资源密集的,它们通常会对正常操作造成昂贵的中断。在本文中,我们利用了强化学习和深度学习方面的最新发展,以开发一种新型的自适应,无模型的控制器,用于一般离散时间过程。我们建议的DRL控制器是一个基于数据的控制器,它仅通过与过程进行交互来实时学习控制策略。通过许多模拟证明了DRL控制器的有效性和好处。

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously and to initiate a remedial model re-identification procedure in the event of performance degradation. Such procedures are typically complicated and resource-intensive, and they often cause costly interruptions to normal operations. In this paper, we exploit recent developments in reinforcement learning and deep learning to develop a novel adaptive, model-free controller for general discrete-time processes. The DRL controller we propose is a data-based controller that learns the control policy in real time by merely interacting with the process. The effectiveness and benefits of the DRL controller are demonstrated through many simulations.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源