AI summary · arXiv: 2205.12699v1 · physics.flu-dyn

DRLinFluids -- An open-source python platform of coupling Deep Reinforcement Learning and OpenFOAM

Qiulei Wang, Lei Yan, Gang Hu, Chao Li, Yiqing Xiao, Hao Xiong, Jean Rabault, Bernd R. Noack
Original paper Submitted to arXiv on 25 May. 2022 License: CC BY 4.0

How to read this summary? Illustrated guide

The essentials

  • DRLinFluids is an open-source python platform that combines Deep Reinforcement Learning (DRL) with fluid mechanics applications.
  • DRL has been proven effective in optimizing decision-making in complex and high-dimensional problems.
  • The platform allows an agent to learn a feedback policy to maximize cumulative reward by interacting with an environment.
  • DRLinFluids is specifically designed for flow control and optimization problems in fluid mechanics.
  • OpenFOAM, a popular Navier-Stokes solver, is used for the simulations.
  • Tensorforce or Tianshou are employed as versatile DRL packages.
  • The reliability and efficiency of DRLinFluids are demonstrated through two wake stabilization benchmark problems.
  • DRLinFluids significantly reduces the application effort of DRL in fluid mechanics, accelerating academic and industrial applications.
  • Future work possibilities for refining and expanding DRLinFluids are highlighted.
  • DRLinFluids seamlessly integrates Deep Reinforcement Learning with OpenFOAM for fluid mechanics applications.
  • It is flexible, scalable, and user-friendly, making it valuable for researchers and practitioners in the field.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: DRLinFluids Deep Reinforcement Learning OpenFOAM Flow Control Optimization

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
This study presents DRLinFluids, an open-source python platform that combines Deep Reinforcement Learning (DRL) with fluid mechanics applications. DRL has been shown to be effective in optimizing decision-making in complex and high-dimensional problems. In this platform, an agent learns a feedback policy to maximize a cumulative reward by interacting with an environment. This setup is analogous to control theory, where the cumulative reward corresponds to the cost function, the agent acts as the actuator, the environment represents measured signals, and the learned policy functions as the feedback law. Developing a numerical simulation plant with DRL for fluid mechanics can be challenging and time consuming. To address this issue, DRLinFluids is introduced as a novel python platform specifically designed for flow control and optimization problems in fluid mechanics. The simulations utilize OpenFOAM, a popular Navier-Stokes solver widely used in industry and academia. Additionally, Tensorforce or Tianshou are employed as versatile DRL packages. The reliability and efficiency of DRLinFluids are demonstrated through two wake stabilization benchmark problems. By significantly reducing the application effort of DRL in fluid mechanics, this platform is expected to accelerate academic and industrial applications. The study also highlights future work possibilities for further refining and expanding DRLinFluids. In conclusion, this study introduces DRLinFluids as an open-source python platform that seamlessly integrates Deep Reinforcement Learning with OpenFOAM for fluid mechanics applications. Its flexibility, scalability, and user-friendly nature make it a valuable tool for researchers and practitioners in the field. The successful validation of two case studies showcases its potential impact on optimizing flow control strategies in various real-world scenarios.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide
Journal club Premium+ Slides to present it

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Close
    Machine learning accelerated computational fluid dynamics
    Dmitrii Kochkov, Jamie A. Smith, Ayya Alieva et al. · 2021 · Fluid Dynamics · AI summary available
    Abstract

    Numerical simulation of fluids plays an essential role in modeling many physical phenomena, such as weather, climate, aerodynamics and plasma physics. Fluids are well described by the Navier-Stokes equations, but solving these equations at scale remains daunting, limited by the computational cost of resolving the smallest spatiotemporal features. This leads to unfavorable trade-offs between accuracy and tractability. Here we use end-to-end deep learning to improve approximations inside computational fluid dynamics for modeling two-dimensional turbulent flows. For both direct numerical simulation of turbulence and large eddy simulation, our results are as accurate as baseline solvers with 8-1…

  2. Close
    Deep-reinforcement-learning-based separation control in a two-dimensional airfoil
    Xavier Garcia, Arnau Miró, Pol Suárez et al. · 2025 · Fluid Dynamics · AI summary available
    Abstract

    The aim of this study is to discover new active-flow-control (AFC) techniques for separation mitigation in a two-dimensional NACA 0012 airfoil at a Reynolds number of 3000. To find these AFC strategies, a framework consisting of a deep-reinforcement-learning (DRL) agent has been used to determine the action strategies to apply to the flow. The actions involve blowing and suction through jets at the airfoil surface. The flow is simulated with the numerical code Alya, which is a low-dissipation finite-element code, on a high-performance computing system. Various control strategies obtained through DRL led to 43.9% drag reduction, while others yielded an increase in aerodynamic efficiency of 58…

  3. Related
    NeurIPS 2024 ML4CFD Competition: Harnessing Machine Learning for Computational Fluid Dynamics in Airfoil Design
    Mouadh Yagoubi, David Danan, Milad Leyli-abadi et al. · 2024 · Fluid Dynamics · AI summary available
    Abstract

    The integration of machine learning (ML) techniques for addressing intricate physics problems is increasingly recognized as a promising avenue for expediting simulations. However, assessing ML-derived physical models poses a significant challenge for their adoption within industrial contexts. This competition is designed to promote the development of innovative ML approaches for tackling physical challenges, leveraging our recently introduced unified evaluation framework known as Learning Industrial Physical Simulations (LIPS). Building upon the preliminary edition held from November 2023 to March 2024, this iteration centers on a task fundamental to a well-established physical application: …

  4. Related
    Fluid Intelligence: A Forward Look on AI Foundation Models in Computational Fluid Dynamics
    Neil Ashton, Johannes Brandstetter, Siddhartha Mishra · 2025 · Fluid Dynamics · AI summary available
    Abstract

    Driven by the advancement of GPUs and AI, the field of Computational Fluid Dynamics (CFD) is undergoing significant transformations. This paper bridges the gap between the machine learning and CFD communities by deconstructing industrial-scale CFD simulations into their core components. Our main contribution is to propose the first scaling law that incorporates CFD inputs for both data generation and model training to outline the unique challenges of developing and deploying these next-generation AI models for complex fluid dynamics problems. Using our new scaling law, we establish quantitative estimates for the large-scale limit, distinguishing between regimes where the cost of data generat…

  5. Related
    Enhancing Computational Fluid Dynamics with Machine Learning
    Ricardo Vinuesa, Steven L. Brunton · 2021 · Fluid Dynamics · AI summary available
    Abstract

    Machine learning is rapidly becoming a core technology for scientific computing, with numerous opportunities to advance the field of computational fluid dynamics. In this Perspective, we highlight some of the areas of highest potential impact, including to accelerate direct numerical simulations, to improve turbulence closure modeling, and to develop enhanced reduced-order models. We also discuss emerging areas of machine learning that are promising for computational fluid dynamics, as well as some potential limitations that should be taken into account.

  6. Related
    Physics-informed neural networks (PINNs) for fluid mechanics: A review
    Shengze Cai, Zhiping Mao, Zhicheng Wang et al. · 2021 · Fluid Dynamics · AI summary available
    Abstract

    Despite the significant progress over the last 50 years in simulating flow problems using numerical discretization of the Navier-Stokes equations (NSE), we still cannot incorporate seamlessly noisy data into existing algorithms, mesh-generation is complex, and we cannot tackle high-dimensional problems governed by parametrized NSE. Moreover, solving inverse flow problems is often prohibitively expensive and requires complex and expensive formulations and new computer codes. Here, we review flow physics-informed learning, integrating seamlessly data and mathematical models, and implementing them using physics-informed neural networks (PINNs). We demonstrate the effectiveness of PINNs for inve…

  7. Related
    Wall Modeling of Turbulent Flows with Various Pressure Gradients Using Multi-Agent Reinforcement Learning
    Di Zhou, H. Jane Bae · 2023 · Fluid Dynamics · AI summary available
    Abstract

    We propose a framework for developing wall models for large-eddy simulation that is able to capture pressure-gradient effects using multi-agent reinforcement learning. Within this framework, the distributed reinforcement learning agents receive off-wall environmental states including pressure gradient and turbulence strain rate, ensuring adaptability to a wide range of flows characterized by pressure-gradient effects and separations. Based on these states, the agents determine an action to adjust the wall eddy viscosity, and consequently the wall-shear stress. The model training is in-situ with wall-modeled large-eddy simulation grid resolutions and does not rely on the instantaneous velocit…

  8. Related
    Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D
    Nils Wandel, Michael Weinmann, Reinhard Klein · 2020 · Fluid Dynamics · Not summarized yet
    Abstract

    Physically plausible fluid simulations play an important role in modern computer graphics and engineering. However, in order to achieve real-time performance, computational speed needs to be traded-off with physical accuracy. Surrogate fluid models based on neural networks have the potential to achieve both, fast fluid simulations and high physical accuracy. However, these approaches rely on massive amounts of training data, require complex pipelines for training and inference or do not generalize to new fluid domains. In this work, we present significant extensions to a recently proposed deep learning framework, which addresses the aforementioned challenges in 2D. We go from 2D to 3D and pr…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.