Skip to main content
EnglishEN
pdf-header

SAFE AND EXPLAINABLE CRITICAL EMBEDDED SYSTEMS BASED ON AI

Project description

DEENESFRITPL

Making AI explainable and traceable for critical autonomous systems

The artificial intelligence (AI) needed for complex autonomous tasks like self-driving cars depends on deep learning techniques. However, safety requirements mean that such techniques must also be explainable and traceable. The EU-funded SAFEXPLAIN project plans to solve this issue by creating new explainable deep learning solutions with end-to-end traceability that comply with functional safety requirements for critical autonomous AI-based systems while preserving high performance. Project work will include novel approaches to explain whether predictions can be trusted, and new strategies to prove correct operations. The project consists of a collaboration between three eminent European research centres and will conduct three case studies in the automotive, space and railway sectors.

Objective

Deep Learning (DL) techniques are key for most future advanced software functions in Critical Autonomous AI-based Systems (CAIS) in cars, trains and satellites. Hence, those CAIS industries depend on their ability to design, implement, qualify, and certify DL-based software products under bounded effort/cost.
There is a fundamental gap between Functional Safety (FUSA) requirements of CAIS and the nature of DL solutions needed to satisfy those requirements. The lack of transparency (mainly explainability and traceability), and the data-dependent and stochastic nature of DL software clash against the need for deterministic, verifiable and pass/fail test-based software solutions for CAIS.
SAFEXPLAIN tackles this challenge by providing a novel and flexible approach to allow the certification – hence adoption – of DL-based solutions in CAIS by (1) architecting transparent DL solutions that allow explaining why they satisfy FUSA requirements, with end-to-end traceability, with specific approaches to explain whether predictions can be trusted, and with strategies to reach (and prove) correct operation, in accordance with certification standards. SAFEXPLAIN will also (2) devise alternative and increasingly complex FUSA design safety patterns for different DL usage levels (i.e. with varying safety requirements) that will allow using DL in any CAIS functionality, for varying levels of criticality and fault tolerance.
SAFEXPLAIN brings together a highly skilled and complementary consortium to successfully tackle this endeavor including 3 research centers, RISE (AI expertise), IKR (FUSA expertise), and BSC (platform expertise); and 3 CAIS case studies, automotive (NAV), space (AIKO), and railway (IKR). SAFEXPLAIN DL-based solutions are assessed in an industrial toolset (EXI). Finally, to prove that transparency levels are fully compliant with FUSA, solutions are reviewed by internal certification experts (EXI), and external ones subcontracted for an independent assessment.

Fields of science

Programme(s)

Topic(s)

Call for proposal

HORIZON-CL4-2021-HUMAN-01

See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Coordinator

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Net EU contribution
€ 809 375,00
Address
Calle jordi girona 31
08034 Barcelona
Spain

See on map
Region
Este Cataluña Barcelona
Activity type
Research Organisations
Links
Other funding
€ 0,00

Participants (5)

Share this page

Download

Last update: 10 March 2023
Record number: 240141

My Booklet

Permalink: /project/id/101069595

European Union, 2023