Skip to main content
European Commission logo print header

Cybersecurity for AI-Augmented Systems

Project description

Artificial intelligence meets cybersecurity

As artificial intelligence (AI) becomes omnipresent, even integrated within secure software development, the safety of digital infrastructures requires new technologies and new methodologies, as highlighted in the EU Strategic Plan 2021-2024. To achieve this goal, the EU-funded Sec4AI4Sec project will develop advanced security-by-design testing and assurance techniques tailored for AI-augmented systems. These systems can democratise security expertise, enabling intelligent, automated secure coding and testing while simultaneously lowering development costs and improving software quality. However, they also introduce unique security challenges, particularly concerning fairness and explainability. Sec4AI4Sec is at the forefront of the move to tackle these challenges with a comprehensive approach, embodying the vision of better security for AI and better AI for security.

Objective

With AI-enhanced components being deployed everywhere, including the very toolchains used for secure software development, the traditional security focus on software and hardware assets can no longer guarantee “secure services, processes and products, [and] digital infrastructures” in the EU Strategic Plan 2021-2024.
Sec4AI4Sec wants to develop security-by-design testing and assurance techniques for AI-augmented systems, their software and AI assets. AI-augment systems provide an opportunity to democratize security expertise and give access to intelligent, automated secure coding and testing, by enabling novel capabilities, lowering development costs and increasing software quality (AI4Sec). They are also a risk: AI-augmented systems are vulnerable to new security technical threats specific to AI-based software, in particular where matters of fairness or explainability are important (Sec4AI). Sec4AI4Sec addresses these challenges to the fullest extent: “AI for better security, security for better AI.”
The Sec4AI4Sec project will address these two facets of AI to achieve a deep scientific, economic and technological impact, while contributing to addressing key societal issues. It will validate its approach on three key scenarios of the EU Digital Compass towards Digital Sovereignty: 5G core virtualization, Autonomy for safety systems in aviation and security and Quality for 3rd party software assessment and certification.
Sec4AI4Sec assembled a team with 5 leading Universities (Amsterdam, Cagliari, Hamburg, Lugano, Trento), 2 innovative SMEs (FrontEndART, Pluribus One), 3 Large Enterprises (Airbus, SAP, Thales) and 1 Center for digital innovation (Cefriel). The project will generate a set of innovative techniques and open-source tools, new methodologies for secure design and certification of AI-augmented systems, as well as reference benchmarks that can be used to standardize the assessment of research results in the secure software research community.

Coordinator

UNIVERSITA DEGLI STUDI DI TRENTO
Net EU contribution
€ 612 793,75
Address
VIA CALEPINA 14
38122 Trento
Italy

See on map

Region
Nord-Est Provincia Autonoma di Trento Trento
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 612 793,75

Participants (10)

Partners (1)