SAFE AND EXPLAINABLE CRITICAL EMBEDDED SYSTEMS BASED ON AI

Projektinformationen

SAFEXPLAIN

ID Finanzhilfevereinbarung: 101069595

DOI

10.3030/101069595

Projekt abgeschlossen

EK-Unterschriftsdatum 13 Juni 2022

Startdatum 1 Oktober 2022

Enddatum 30 September 2025

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 3 891 875,00

EU-Beitrag

€ 3 891 875,00

Koordiniert durch

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (13)

DL safety architectural patterns and platform

Provides a consolidated analysis of recurrent AI/DL-safety problems and the definition of a set of DL-safety patterns based on the standards and ongoing initiatives studied in T2.1/T2.2, and tailored to the safe DL execution platform.

Case study stubbing and early assessment of case study porting

Reports the specifications and the necessary stubbing made in each case study and an assessment on the impact it might have on the behaviour of the application. It also covers a status report on case study porting

Communication and Dissemination Plan

Description of the communication and dissemination strategy, the activities to be undertaken to achieve this, and KPIs to monitor progress. Dissemination results will be reported in the periodic and final reports.

Initial communication and dissemination report

Communication, dissemination and knowledge transfer activities until month 12 including the open communities and development environments where SAFEXPLAIN results will be disseminated.

Requirements, Success Criteria and platforms

Report capturing the case study and FUSA standards requirements, the success criteria set for each milestone of the project, FUSA principles to consider in SAFEXPLAIN, and choices about the platform and the software stack

Exploitation Plan

Description of the exploitation strategy, the activities to be undertaken to achieve this, and KPIs to monitor progress. Exploitation results and an updated exploitation plan will be provided in the periodic and final reports.

Gender and Equality Committee Report

Document capturing the gender aspects during the project lifetime with the involvement of all partners. Updates to this report in m24 and m36

Interim Plattform Technologies Report

This report captures the advancements done in T4.1-T4.4 by MS2. It will provide an assessment of the degree of completion in each of these tasks, and baseline technology where to integrate the case studies.

Project management plan and quality guidelines

Document that defines the main project procedures (contractual framework, project governance, project monitoring, internal communication, etc.) as well as the standards and quality procedures to be used throughout the project. This handbook will also include a section on Gender Equality guidelines for monitoring and management measures and cohesion activities with the PPP on AI, Data and Robotics and the CSA HORIZON CL4-2021-HUMAN-01-02.

Specificability, explainability, traceability, and robustness proof-of-concept and argumentation

Reports on (i) proposed AI specifications in correspondence with D2.1, (ii) Trustworthy and explainable AI architecture for dependable DL components and (iii) online safety supervision architecture. Also, it reports early specificability, explainability, traceability, and robustness arguments and requirements

Interim report on DL components and libraries

Reports on the progress done on the implementation of the DL components and the usage of the framework to train the neural networks. It also covers the report on the low-level optimization libraries for the selected accelerators

Initial exploitation report

Updated analysis of the exploitation context, business opportunities and exploitable results identifications, based on the requirements gathered at year 1 (m12).

Safety lifecycle considerations

It establishes the initial selected safety techniques and restrictions to be addressed by WP3 and WP4 in: (i) DL-software specification, design and implementation (T2.1), and (ii) DL-software V&V (T2.2).

Veröffentlichungen

Conference proceedings (12)

Safety-Relevant AI-Based System Robustification with Neural Network Ensembles

Autoren: Aldomà Coll, Adrià; Brando Guillaumes, Axel; Cazorla Almeida, Francisco Javier; Abella Ferrer, Jaume
Veröffentlicht in: 2024 IEEE 30th International Symposium on On-Line Testing and Robust System Design (IOLTS), 2024, ISBN 979-8-3503-7055-3
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/IOLTS60994.2024.10616095

AI-FSM: Towards Functional Safety Management for Artificial Intelligence-based Critical Systems

Autoren: Javier Fernández, Irune Agirre, Jon Perez-Cerrolaza, Lorea Belategi, Ana Adell, Carlo Donzella, Jaume Abella
Veröffentlicht in: CARS@EDCC2024 Workshop - Critical Automotive applications: Robustness & Safety, 2024
Herausgeber: EDCC

Leveraging image-based transformations to mitigate adversarial attacks in AI-based safety-critical systems

Autoren: Marti Carlo, Axel Brando, Jaume Abella
Veröffentlicht in: 2025 IEEE 31th International Symposium on On-line Testing and Robust System Design (IOLTS), 2025, ISBN 979-8-3315-3334-2
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)

Retrospective Uncertainties for Deep Models using Vine Copulas

Autoren: Tagasovska, Natasa; Ozdemir, Firat; Brando Guillaumes, Axel
Veröffentlicht in: Proceedings of Machine Learning Research, 2023, ISSN 2640-3498
Herausgeber: MLResearchPress
DOI: 10.48550/arxiv.2302.12606

Managing Sources of Uncertainty in Utilizing AI in Development and Deployment of Safety-Critical Autonomous Systems

Autoren: Robert Lowe, Maria Ulan, Thanh Hai Bui, Ana Adell, Jokin Labaien, Axel Brando
Veröffentlicht in: 2025 IEEE 22nd International Conference on Software Architecture Companion (ICSA-C), 2025, ISSN 2768-4288
Herausgeber: IEEE
DOI: 10.1109/ICSA-C65153.2025.00079

SAFEXPLAIN: Safe and Explainable Critical Embedded Systems Based on AI

Autoren: Jaume Abella; Jon Perez; Cristofer Englund; Bahram Zonooz; Gabriele Giordana; Carlo Donzella; Francisco J. Cazorla; Enrico Mezzetti; Isabel Serra; Axel Brando; Irune Agirre; Fernando Eizaguirre; Thanh Hai Bui; Elahe Arani; Fahad Sarfraz; Ajay Balasubramaniam; Ahmed Badar; Ilaria Bloise; Lorenzo Feruglio; Ilaria Cinelli; Davide Brighenti; Davide Cunial
Veröffentlicht in: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2023, ISSN 1558-1101
Herausgeber: IEEE
DOI: 10.23919/date56975.2023.10137128

Detecting Low-Density Mixtures in High-Quantile Tails for pWCET Estimation

Autoren: Blau Manau, Sergi Vilardell, Isabel Serra, Enrico Mezzetti, Jaume Abella, and Francisco J. Cazorla
Veröffentlicht in: 37th Euromicro Conference on Real-Time Systems (ECRTS 2025), Ausgabe 335, 2025
Herausgeber: Schloss Dagstuhl – Leibniz-Zentrum für Informatik
DOI: 10.4230/LIPICS.ECRTS.2025.20

Probabilistic Timing Estimates in Scenarios Under Testing Constraints

Autoren: Sergi Vilardell; Francesco Rossi; Gabriele Giordana; Isabel Serra; Enrico Mezzetti; Jaume Abella; Francisco J. Cazorla
Veröffentlicht in: Proceedings of the 40th ACM/SIGAPP Symposium on Applied Computing, 2025, ISBN 979-8-4007-0629-5
Herausgeber: Association for Computing Machinery (ACM)

Semantic diverse DMR and TMR for high-integrity AI-based function efficiency

Autoren: Marti Caro, Axel, Brando, Jaume Abella
Veröffentlicht in: ACM transactions on cyber-physical systems, Ausgabe 9, 2025, ISSN 2378-9638
Herausgeber: Association for Computing Machinery (ACM)

Software-Only Semantic Diverse Redundancy for High-Integrity AI-Based Functionalities

Autoren: Martí Caro, Axel Brando, Jaume Abella.
Veröffentlicht in: ERTS2024, 2024
Herausgeber: ERTS

Differentiating Adversial Attacks from Natural Sensory Anomalies in Object Detection

Autoren: Robert Lowe, Maria Ulan, Thanh Bui, Gabriele Giordana, Tobia Giani, Francesco Rossi
Veröffentlicht in: European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases 2025, 2025
Herausgeber: Springer Communications in Computer and Information Science
DOI: 10.5281/ZENODO.17037385

Standardizing the Probabilistic Sources of Uncertainty for the sake of Safety Deep Learning

Autoren: Brando, Axel; Serra, Isabel; Mezzetti, Enrico; Cazorla Almeida, Francisco Javier; Abella Ferrer, Jaume
Veröffentlicht in: Proceedings of the Workshop on Artificial Intelligence Safety 2023 (SafeAI 2023) co-located with the Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023), 2023, ISSN 1613-0073
Herausgeber: CEUR Workshop Proceedings

Peer reviewed articles (1)

Computer

Autoren: Axel Brando; Isabel Serra; Enrico Mezzetti; Francisco J. Cazorla; Jon Perez-Cerrolaza; Jaume Abella
Veröffentlicht in: Computer, 2023, ISSN 0018-9162
Herausgeber: IEEE
DOI: 10.1109/mc.2023.3236523