Reinforcement learning based control of dynamical systems
Aug 1, 2020
In this project we employ novel AI techniques from reinforcement learning, sequence modelling and dimensionality reduction to learn complex controllers efficiently.

Michiel Straat
Postdoctoral Research Group Leader “Life-long Machine Learning for Physical Systems”
My research interests include Machine Learning for Physical Systems and the theory of Neural Networks.
Publications
Control of Rayleigh-Bénard Convection: Effectiveness of Reinforcement Learning in the Turbulent Regime
We build a robust reinforcement learning agent to control Rayleigh-Bénard Convection in turbulent conditions and compare against …
Solving Turbulent Rayleigh-Bénard Convection using Fourier Neural Operators
We train Fourier Neural Operator (FNO) surrogate models for Rayleigh-B’enard Convection (RBC), a model for convection processes …
Koopman-Based Surrogate Modelling of Turbulent Rayleigh-Bénard Convection
We build a linear dynamical model for complex fluid flows using a Machine Learning architecture based on Koopman theory.
Talks
Solving Turbulent Rayleigh-Bénard Convection using Fourier Neural Operators
I present our publication on the use of Fourier Neural Operator models as surrogates for convection dynamics.
Apr 25, 2025 2:40 PM
European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning - ESANN 2025
Solving Turbulent Rayleigh-Bénard Convection using Fourier Neural Operators
In this talk I present our work on harnessing zero-shot superresolution surrogate models FNO for convection.
Jan 21, 2025 12:00 AM
Applications of Intelligent Systems (APPIS), Las Palmas de Gran Canaria, January 2025
Koopman-based Modeling of Rayleigh-Bénard Convection
In this talk I will present our recent work on Koopman-based surrogate modeling of Rayleigh-Bénard Convection.
Jan 22, 2024 12:00 AM
Applicaitons of Intelligent Systems (APPIS), Las Palmas de Gran Canaria, January 2024