Abstract
In recent years, deep reinforcement learning has emerged as a technique tosolve closed-loop flow control problems. Employing simulation-basedenvironments in reinforcement learning enables a priori end-to-end optimizationof the control system, provides a virtual testbed for safety-critical controlapplications, and allows to gain a deep understanding of the controlmechanisms. While reinforcement learning has been applied successfully in anumber of rather simple flow control benchmarks, a major bottleneck towardreal-world applications is the high computational cost and turnaround time offlow simulations. In this contribution, we demonstrate the benefits ofmodel-based reinforcement learning for flow control applications. Specifically,we optimize the policy by alternating between trajectories sampled from flowsimulations and trajectories sampled from an ensemble of environment models.The model-based learning reduces the overall training time by up to $85\%$ forthe fluidic pinball test case. Even larger savings are expected for moredemanding flow simulations.