AI for REAL-world NETwork operation

Informations projet

AI4REALNET

N° de convention de subvention: 101119527

DOI

10.3030/101119527

Date de signature de la CE 29 Juin 2023

Date de début 1 Octobre 2023

Date de fin 31 Mars 2027

Financé au titre de

• Digital, Industry and Space

Coût total

€ 3 999 976,25

Contribution de l’UE

€ 3 999 976,25

Coordonné par

INESC TEC - INSTITUTO DE ENGENHARIADE SISTEMAS E COMPUTADORES, TECNOLOGIA E CIENCIA
Portugal

Periodic Reporting for period 2 - AI4REALNET (AI for REAL-world NETwork operation)

Période du rapport: 2024-10-01 au 2025-09-30

Résumé du contexte et des objectifs généraux du projet

AI4REALNET addresses AI-based solutions for critical systems—electricity, railway, and air traffic control—traditionally operated by humans but increasingly requiring AI to complement human decision-making. These systems face growing uncertainty (e.g. weather, demand), complex sequential decisions, and challenges in managing higher automation while maintaining human oversight. The project envisions a balanced coexistence of human control and AI automation across three levels: (a) full human control, (b) human–AI co-learning, and (c) trustworthy full AI-based control. Its goals are: (1) to develop next-generation decision-making methods using supervised and reinforcement learning for trustworthy, resilient, and secure human–AI control; and (2) to foster AI algorithm validation using open digital environments simulating realistic operational and human decision-making scenarios.

Travail effectué depuis le début du projet jusqu’à la fin de la période considérée dans le rapport et principaux résultats atteints jusqu’à présent

WP1 – Conceptual and Framework Development

The project consolidated the conceptual foundations of human–AI decision-making in safety-critical systems, creating a hypervision tool that supports operators through AI recommendations, contextual visualisations, and KPIs (robustness, transparency, explainability, usability). Upgraded digital environments—Grid2Op, FLATLAND, and BlueSky—now include new scenarios and KPIs, enabling realistic cross-domain testing. The framework was demonstrated in power grid, railway, and air traffic management (ATM), showing adaptability. Interoperability connectors link the framework to agents from WPs 2–3, enabling real-time KPI exchange and AI recommendations.

WP2 – Knowledge-Assisted AI and Transparency

Three knowledge-assisted AI approaches were developed, including hierarchical and distributed reinforcement learning (RL) agents for the power grid and railway domains. These integrate human knowledge, decomposition methods, and graph neural networks to enhance scalability and robustness. Key advances include imitation learning agents for transparent decision-making, GNNs for improved failure prediction, and “what-if” visual tools for operator understanding. Progress in Explainable AI (XAI), safety, and human–machine interaction improved AI trustworthiness. Community engagement was promoted through open-source releases and workshops.

WP3 – Human-Centred and Autonomous AI

WP3 developed human-centred, uncertainty-aware, and multi-objective AI systems. A flexible agent-as-a-service platform enables simulation rollouts and KPI computation. Research advanced epistemic uncertainty estimation (evidential networks, conformal prediction) and multi-objective RL, including a SoftGNN imitation learning agent for preference-based decision-making. Human–AI co-learning was enhanced through adjustable autonomy, inverse reinforcement learning, and interactive evolutionary optimisation (CMA-ES) for airspace sectorisation, offering transparency and control. Multi-agent architectures now enable cooperative negotiation under human supervision, defining the role of the human “director”.

WP4 – Evaluation and Validation

WP4 defined a comprehensive evaluation framework (Deliverable D4.1 “Evaluation and Test Protocols”) comprising 62 KPIs and 12 scenarios for assessing AI reliability, adaptability, and efficiency. Domain-specific perturbation agents simulate cyberattacks and failures to test robustness and resilience. Human-centred evaluation covers trust, usability, and collaboration, with protocols to assess workload, trust, and user experience via the InteractiveAI platform.

Progrès au-delà de l’état des connaissances et impact potentiel prévu (y compris l’impact socio-économique et les conséquences sociétales plus larges du projet jusqu’à présent)

AI4REALNET established a novel hypervision tool integrating AI assistance, contextual visualisation, and trust-oriented KPIs. It generalises across power grid, railway, and ATM, and is extendable to other critical infrastructures. Enhanced simulation environments now support human-in-the-loop testing, while standardised APIs enable plug-and-play interoperability and bi-directional co-learning between humans and AI.

WP2 introduced hybrid models combining domain knowledge and data-driven learning for generalisation and transparency. Physics-informed neural networks, adaptive action-space reduction, and hybrid RL–decision-tree frameworks improved interpretability. Distributed and hierarchical RL with graph-based coordination enhanced scalability. A soft-label imitation learning agent outperformed deep RL baselines, ensuring explainability and safety.

WP3 achieved uncertainty quantification and multi-objective optimisation advances, supporting risk-aware, trustworthy AI. Interactive evolutionary algorithms and preference-based learning promoted transparency and operator control, while multi-agent negotiation architectures introduced cooperative autonomy with human oversight.

WP4’s validation framework integrates technical, ethical, and socio-technical dimensions. It establishes new metrics for scalability, robustness, and human–AI augmentation. Resilience is quantified through recovery metrics after perturbations, complementing the AI Act’s concept of robustness. Human-centred metrics assess co-learning, autonomy, and long-term impacts, ensuring AI augments human capability.

AI4REALNET logo (color)

AI4REALNET concept