Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

REinforcement TWInning SysTems: from collaborative digital twins to model-based reinforcement learning

Project description

Reinforcement twinning for a lab-scale prototype optimisation

Digital twins could transform engineering by creating virtual replicas of systems that learn from data. However, this concept is still evolving and needs better integration of machine learning with existing knowledge. The ERC-funded RE-TWIST project aims to design a framework for digital twinning that combines the training of a digital twin with a controlling agent to facilitate mutual learning. The agent will use reinforcement twinning (RT), focusing on lab-scale prototypes that address global challenges, including optimising wind turbines, drone propellers, sloshing tanks, and cryogenic liquid storage. Efficient management of these technologies is crucial for renewable energy and the viability of green fuels such as liquid hydrogen.

Objective

"The concept of digital twins promises to revolutionize engineering by offering new avenues for optimization, control, and predictive maintenance. Digital twins seek to virtually replicate systems using models that continuously ""learn"" from data, automatizing data collection, validation, and refinement and becoming ""self-learning"" models. However, this concept is not yet established in engineering and requires significant developments in integrating machine learning with traditional ""domain-specific"" knowledge. The Re-Twist project tackles this challenge with two objectives. The first objective is to develop a new framework that puts fundamental principles at the core of digital twinning and combines the training of a digital twin with the training of a controlling agent in ways that allow one to learn from the other. The agent learns by trial and error, as in reinforcement learning, while interacting with the system and using the digital twin as a playground. I call this novel framework Reinforcement Twinning (RT). The second objective is to develop RT on lab-scale prototypes of systems at the centre of global challenges. These are the optimal operation of wind turbines, drone propellers, sloshing tanks, and cryogenic liquid storage. Wind turbines drive the fastest-growing renewable energy sector; drones have the potential to revolutionize monitoring, inspection, rescue missions, swift delivery of medical supplies and more. The optimal management of cryogenic tanks, controlling the dynamics of sloshing and the thermodynamics of boil-off, will be essential to the economic viability of green fuels such as liquid hydrogen. This project is ""high risk"" because it endeavours to establish a new discipline at the intersection of machine learning and energy engineering. It promises ""high gains"" by aiming to experimentally validate twinning systems that could significantly impact society."

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2024-STG

See all projects funded under this call

Host institution

VON KARMAN INSTITUTE FOR FLUID DYNAMICS
Net EU contribution
€ 771 250,00
Address
Waterloose Steenweg, 72
1640 Sint-Genesius-Rode
Belgium
SME
Yes
Region
Vlaams Gewest Prov. Vlaams-Brabant Arr. Halle-Vilvoorde
Activity type
Research Organisations
Links
Total cost
€ 771 250,00

Beneficiaries (2)