European Lighthouse on Secure and Safe AI

Project Information

ELSA

Grant agreement ID: 101070617

DOI

10.3030/101070617

EC signature date 23 June 2022

Start date 1 September 2022

End date 31 August 2026

Funded under

• Digital, Industry and Space

Total cost

€ 7 434 058,75

EU contribution

€ 7 434 058,50

Coordinated by

CISPA - HELMHOLTZ-ZENTRUM FUR INFORMATIONSSICHERHEIT GGMBH
Germany

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Data sets, microdata, etc (1)

Benchmark Datasets

Six datasets and corresponding metrics will be defined, corresponding to the use cases.

Documents, reports (7)

Report on Privacy and Infrastructures Grand Challenge and Benchmarking Metrics

This report will summarise the results of Task 2.1.

Use Case Analysis Report

Detailed analysis of the six use cases, leading to specifications and requirements to be used as input to WP1-3.

Report on Technical Robustness and Safety Grand Challenge and Benchmarking Metrics

This report will summarise the results of Task 1.1.

Publish Strategic Research Agenda

Publish Strategic Research Agenda.

Report on Human-in-the-Loop Decision Making Grand Challenge

This report will summarise the results of Task 3.1.

Report on Network and Communication Activities 1

Report on Network and Communication activities 1.

Use Cases Activity Report 1

Summary of progress on the implementation of demonstrators and benchmarks for each of the six use cases.

Websites, patent fillings, videos etc. (1)

Visual Identity, Style and Communication Guidelines

Visual identity, style and communication guidelines.

Publications

Peer reviewed articles (26)

Towards algorithms and models that we can trust: A theoretical perspective

Author(s): Luca Oneto, Sandro Ridella, Davide Anguita
Published in: Neurocomputing, Issue 592, 2024, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/J.NEUCOM.2024.127798

Adversarial pruning: A survey and benchmark of pruning methods for adversarial robustness

Author(s): Giorgio Piras, Maura Pintor, Ambra Demontis, Battista Biggio, Giorgio Giacinto, Fabio Roli
Published in: Pattern Recognition, Issue 168, 2025, ISSN 0031-3203
Publisher: Elsevier BV
DOI: 10.1016/J.PATCOG.2025.111788

Informed Machine Learning: Excess risk and generalization

Author(s): Luca Oneto, Sandro Ridella, Davide Anguita
Published in: Neurocomputing, Issue 646, 2025, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/J.NEUCOM.2025.130521

Secml-Malware: Pentesting Windows Malware Classifiers with Adversarial Exemples in Python

Author(s): Luca Demetrio, Battista Biggio
Published in: SSRN Electronic Journal, 2022, ISSN 1556-5068
Publisher: Elsevier BV
DOI: 10.2139/SSRN.4066509

Foundation Models and Fine-Tuning: A Benchmark for Out of Distribution Detection

Author(s): Francesco Cappio Borlino, Lorenzo Lu, Tatiana Tommasi
Published in: IEEE Access, Issue 12, 2025, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3409587

Mask2Anomaly: Mask Transformer for Universal Open-Set Segmentation

Author(s): Shyam Nandan Rai, Fabio Cermelli, Barbara Caputo, Carlo Masone
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 46, 2024, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TPAMI.2024.3419055

Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning

Author(s): Antonio Emanuele Cinà, Kathrin Grosse, Ambra Demontis, Sebastiano Vascon, Werner Zellinger, Bernhard A. Moser, Alina Oprea, Battista Biggio, Marcello Pelillo, Fabio Roli
Published in: ACM Computing Surveys, 2023, ISSN 0360-0300
Publisher: Association for Computing Machinery
DOI: 10.1145/3585385

Modeling Brain Aging With Explainable Triamese ViT: Towards Deeper Insights Into Autism Disorder

Author(s): Zhaonian Zhang, Vaneet Aggarwal, Plamen Angelov, Richard Jiang
Published in: IEEE Journal of Biomedical and Health Informatics, Issue 29, 2025, ISSN 2168-2194
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/JBHI.2025.3574366

Learning to mask and permute visual tokens for Vision Transformer pre-training

Author(s): Lorenzo Baraldi, Roberto Amoroso, Marcella Cornia, Lorenzo Baraldi, Andrea Pilzer, Rita Cucchiara
Published in: Computer Vision and Image Understanding, Issue 252, 2025, ISSN 1077-3142
Publisher: Elsevier BV
DOI: 10.1016/J.CVIU.2025.104294

IDEAL: Interpretable-by-Design ALgorithms for learning from foundation feature spaces

Author(s): Plamen Angelov, Dmitry Kangin, Ziyang Zhang
Published in: Neurocomputing, Issue 626, 2025, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/J.NEUCOM.2025.129464

Neuron Activation Pattern and Applications

Author(s): Z. Jiang, P. Angelov, D. Kangin, …
Published in: Tech Rxiv, IEEE, 2024, ISSN 0000-0000
Publisher: Tech Rxiv, IEEE
DOI: 10.36227/TECHRXIV.170421894.45150592

Dispelling the Digital Enchantment: how can we move beyond its destructive influence and reclaim our right to an open future?

Author(s): Karen Yeung
Published in: Prometheus, 2023, ISSN 1470-1030
Publisher: Pluto Journals
DOI: 10.13169/prometheus.39.1.0008

Delve Into Neural Activations: Toward Understanding Dying Neurons

Author(s): Ziping Jiang, Yunpeng Wang, Chang-Tsun Li, Plamen Angelov, Richard Jiang
Published in: IEEE Transactions on Artificial Intelligence, Issue 4, 2024, ISSN 2691-4581
Publisher: IEEE
DOI: 10.1109/TAI.2022.3180272

Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning

Author(s): Antonio Emanuele Cinà, Kathrin Grosse, Ambra Demontis, Sebastiano Vascon, Werner Zellinger, Bernhard A. Moser, Alina Oprea, Battista Biggio, Marcello Pelillo, Fabio Roli
Published in: ACM Computing Surveys, Issue 55, 2025, ISSN 0360-0300
Publisher: Association for Computing Machinery (ACM)
DOI: 10.1145/3585385

From ‘wild west’ to ‘responsible’ AI testing ‘in-the-wild’: lessons from live facial recognition testing by law enforcement authorities in Europe

Author(s): Karen Yeung, Wenlong Li
Published in: Data & Policy, Issue 7, 2025, ISSN 2632-3249
Publisher: Cambridge University Press (CUP)
DOI: 10.1017/DAP.2025.10019

Building machines that learn and think with people

Author(s): Katherine M. Collins, Ilia Sucholutsky, Umang Bhatt, Kartik Chandra, Lionel Wong, Mina Lee, Cedegao E. Zhang, Tan Zhi-Xuan, Mark Ho, Vikash Mansinghka, Adrian Weller, Joshua B. Tenenbaum, Thomas L. Griffiths
Published in: Nature Human Behaviour, Issue 8, 2024, ISSN 2397-3374
Publisher: Springer Science and Business Media LLC
DOI: 10.1038/S41562-024-01991-9

Fairness Meets Cross-Domain Learning: A Benchmark of Models and Metrics

Author(s): Leonardo Iurada; Silvia Bucci; Timothy M. Hospedales; Tatiana Tommasi
Published in: IEEE Access, 2024, ISSN 2169-3536
Publisher: IEEE
DOI: 10.1109/ACCESS.2024.3383841

Investigating over-parameterized randomized graph networks

Author(s): Giovanni Donghi, Luca Pasa, Luca Oneto, Claudio Gallicchio, Alessio Micheli, Davide Anguita, Alessandro Sperduti, Nicolò Navarin
Published in: Neurocomputing, Issue 606, 2024, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/J.NEUCOM.2024.128281

Towards Robust Metrics for Concept Representation Evaluation

Author(s): Mateo Espinosa Zarlenga, Pietro Barbiero, Zohreh Shams, Dmitry Kazhdan, Umang Bhatt, Adrian Weller, Mateja Jamnik
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 37, 2023, ISSN 2374-3468
Publisher: Association for the Advancement of Artificial Intelligence (AAAI)
DOI: 10.1609/AAAI.V37I10.26392

Robustness-Congruent Adversarial Training for Secure Machine Learning Model Updates

Author(s): Daniele Angioni, Luca Demetrio, Maura Pintor, Luca Oneto, Davide Anguita, Battista Biggio, Fabio Roli
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 47, 2025, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TPAMI.2025.3573237

Advancing Personalized Federated Learning: Group Privacy, Fairness, and Beyond

Author(s): Filippo Galli, Kangsoo Jung, Sayan Biswas, Catuscia Palamidessi, Tommaso Cucinotta
Published in: Springer Nature Computer Science, 2023, ISSN 2661-8907
Publisher: Springer Nature
DOI: 10.1007/s42979-023-02292-0

Nebula: Self-Attention for Dynamic Malware Analysis

Author(s): Dmitrijs Trizna, Luca Demetrio, Battista Biggio, Fabio Roli
Published in: IEEE Transactions on Information Forensics and Security, Issue 19, 2025, ISSN 1556-6013
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TIFS.2024.3409083

ModSec-AdvLearn: Countering Adversarial SQL Injections With Robust Machine Learning

Author(s): Giuseppe Floris, Christian Scano, Biagio Montaruli, Luca Demetrio, Andrea Valenza, Luca Compagna, Davide Ariu, Luca Piras, Davide Balzarotti, Battista Biggio
Published in: IEEE Transactions on Information Forensics and Security, Issue 20, 2025, ISSN 1556-6013
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TIFS.2025.3583234

AttackBench: Evaluating Gradient-based Attacks for Adversarial Examples

Author(s): Antonio Emanuele Cinà, Jérôme Rony, Maura Pintor, Luca Demetrio, Ambra Demontis, Battista Biggio, Ismail Ben Ayed, Fabio Roli
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 39, 2025, ISSN 2374-3468
Publisher: Association for the Advancement of Artificial Intelligence (AAAI)
DOI: 10.1609/AAAI.V39I3.32263

Hierarchical multimodal transformers for Multipage DocVQA

Author(s): Rubèn Tito, Dimosthenis Karatzas, Ernest Valveny
Published in: Pattern Recognition, Issue 144, 2023, ISSN 0031-3203
Publisher: Elsevier BV
DOI: 10.1016/J.PATCOG.2023.109834

Runtime Backdoor Detection for Federated Learning via Representational Dissimilarity Analysis

Author(s): Xiyue Zhang, Xiaoyong Xue, Xiaoning Du, Xiaofei Xie, Yang Liu, Meng Sun
Published in: IEEE Transactions on Dependable and Secure Computing, Issue 22, 2025, ISSN 1545-5971
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TDSC.2025.3550330

Conference proceedings (54)

Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generation

Author(s): Luca Barsellotti, Roberto Amoroso, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara
Published in: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Publisher: IEEE
DOI: 10.1109/CVPR52733.2024.00354

Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networks

Author(s): Mark Niklas Müller, Marc Fischer, Robin Staab, Martin Vechev
Published in: PLDI'23 (Proceedings of the ACM on Programming Languages), 2023, ISSN 2475-1421
Publisher: """Association for Computing Machinery New York, NY, United States"""
DOI: 10.1145/3591252

Multitask Learning with No Regret: From Improved Confidence Bounds to Active Learning

Author(s): Pier Giuseppe Sessa, Pierre Laforgue, Nicolò Cesa-Bianchi, Andreas Krause
Published in: Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 2023
Publisher: Advances in Neural Information Processing Systems 36 (NeurIPS 2023)

Is Mamba Capable of In-Context Learning?

Author(s): Riccardo Grazzi, Julien Niklas Siems, Simon Schrodi, Thomas Brox, Frank Hutter
Published in: Sumbitted to AutoML24 Conference, 2024
Publisher: Paper under double-blind review
DOI: 10.48550/arXiv.2402.03170

Harms from Increasingly Agentic Algorithmic Systems

Author(s): Alan Chan, Rebecca Salganik, Alva Markelius, Chris Pang, Nitarshan Rajkumar, Dmitrii Krasheninnikov, Lauro Langosco, Zhonghao He, Yawen Duan, Micah Carroll, Michelle Lin, Alex Mayhew, Katherine Collins, Maryam Molamohammadi, John Burden, Wanru Zhao, Shalaleh Rismani, Konstantinos Voudouris, Umang Bhatt, Adrian Weller, David Krueger, Tegan Maharaj
Published in: 2023 ACM Conference on Fairness Accountability and Transparency, 2025
Publisher: ACM
DOI: 10.1145/3593013.3594033

Improving Fairness via Intrinsic Plasticity in Echo State Networks

Author(s): Ceni, A. and Bacciu, D. and De Caro, V. and Gallicchio, C. and Oneto, L.
Published in: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), 2023, ISBN 978-2-87587-088-9
Publisher: ESANN
DOI: 10.14428/esann/2023.ES2023-90

Unsupervised Domain Adaptation within Deep Foundation Latent Spaces

Author(s): P. Angelov, D. Kangin
Published in: ICLR Workshop on Mathematical and Empirical understanding of FM, 2024
Publisher: ICLR Workshop on Mathematical and Empirical understanding of FM

FAST: Boosting Uncertainty-based Test Prioritization Methods for Neural Networks via Feature Selection (CWZS24)

Author(s): Jialuo Chen, Jingyi Wang, Xiyue Zhang, Youcheng Sun, Marta Kwiatkowska, Jiming Chen, Peng Cheng
Published in: 39th IEEE/ACM International Conference on Automated Software Engineering (ASE 2024)., 2024
Publisher: IEEE
DOI: 10.48550/ARXIV.2409.09130

DRCFS: Doubly Robust Causal Feature Selection

Author(s): Francesco Quinzan, Ashkan Soleymani, Patrick Jaillet, Cristian R. Rojas, Stefan Bauer
Published in: ICML 2023: Fortieth International Conference on Machine Learning, 2023
Publisher: JMLR.org
DOI: 10.48550/arXiv.2306.07024

Data Drift in Android Malware Detection

Author(s): Luca Minnei, Hicham Eddoubi, Angelo Sotgiu, Maura Pintor, Ambra Demontis, Battista Biggio
Published in: 2024 International Conference on Machine Learning and Cybernetics (ICMLC), 2025
Publisher: IEEE
DOI: 10.1109/ICMLC63072.2024.10935015

"""Reliability in Semantic Segmentation: Can We Use Synthetic Data? """

Author(s): Thibaut Loiseau, Tuan-Hung Vu, Mickael Chen, Patrick Pérez, Matthieu Cord
Published in: European Conference on Computer Vision (ECCV) 2024, 2024
Publisher: European Conference on Computer Vision (ECCV) 2024
DOI: 10.48550/ARXIV.2312.09231

Fuzzy Detectors Against Adversarial Attacks

Author(s): Y. Li, P. Angelov, N. Suri
Published in: IEEE Symposium Series on Computational Intelligence, 2023
Publisher: IEEE Symposium Series on Computational Intelligence

EarthMatch: Iterative Coregistration for Fine-grained Localization of Astronaut Photography

Author(s): Gabriele Berton, Gabriele Goletto, Gabriele Trivigno, Alex Stoken, Barbara Caputo, Carlo Masone
Published in: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2024
Publisher: IEEE
DOI: 10.1109/CVPRW63382.2024.00430

Poster: Protection against Source Inference Attacks in Federated Learning using Unary Encoding and Shuffling

Author(s): Andreas Athanasiou, Kangsoo Jung, Catuscia Palamidessi
Published in: Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security, 2025
Publisher: ACM
DOI: 10.1145/3658644.3691411

Cybersecurity and AI: The PRALab Research Experience

Author(s): Maura Pintor, Giulia Orrù, Davide Maiorca, Ambra Demontis, Luca Demetrio, Gian Luca Marcialis, Battista Biggio, Fabio Roli
Published in: 3rd National Conference on Artificial Intelligence, 2023
Publisher: National Conference on Artificial Intelligence

A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasets

Author(s): Ossi Räisä, Antti Honkela
Published in: AISTATS 2025, 2025
Publisher: AISTATS 2025
DOI: 10.48550/ARXIV.2402.03985

Adapt to Scarcity: Few-Shot Deepfake Detection via Low-Rank Adaptation

Author(s): Silvia Cappelletti, Lorenzo Baraldi, Federico Cocchi, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara
Published in: Lecture Notes in Computer Science, Pattern Recognition, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-78305-0_8

Expressivity of ReLU-Networks under Convex Relaxations

Author(s): Maximilian Baader, Mark Niklas Müller, Yuhao Mao, Martin Vechev
Published in: ICLR'24, 2023
Publisher: ICLR
DOI: 10.48550/arXiv.2311.04015

Adversarial Causal Bayesian Optimization

Author(s): S. Sussex, P. G. Sessa, A. Makarova, A. Krause
Published in: International Conference on Learning Representations (ICLR), 2023
Publisher: ICLR
DOI: 10.48550/arXiv.2307.16625

STEP - Towards Structured Scene-Text Spotting

Author(s): Sergi Garcia-Bordils, Dimosthenis Karatzas, Marçal Rusiñol
Published in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024, ISSN 2309-02356
Publisher: IEEE Xplore
DOI: 10.1109/WACV57701.2024.00093

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Author(s): Edoardo Debenedetti; Javier Rando; Daniel Paleka; Fineas Silaghi; Dragos Albastroiu; Niv Cohen; Yuval Lemberg; Reshmi Ghosh; Rui Wen; Ahmed Salem; Giovanni Cherubin;
Published in: 2024
Publisher: NeurIPS
DOI: 10.48550/ARXIV.2406.07954

Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning

Author(s): Leonardo Iurada, Marco Ciccone, Tatiana Tommasi
Published in: IEEE CVPR 2024, 2024
Publisher: IEEE CVPR 2024

Noise-Aware Differentially Private Variational Inference

Author(s): Talal Alrawajfeh, Joonas Jälkö, Antti Honkela
Published in: AISTATS 2025, 2025
Publisher: AISTATS 2025
DOI: 10.48550/ARXIV.2410.19371

Mitigating Unfair Regression in Machine Learning Model Updates

Author(s): Irene Buselli, Anna Pallarès López, Eduard Martín Jiménez, Davide Anguita, Fabio Roli, Luca Oneto
Published in: 2024 International Conference on Machine Learning and Applications (ICMLA), 2025
Publisher: IEEE
DOI: 10.1109/ICMLA61862.2024.00289

A Simple Recipe for Language-guided Domain Generalized Segmentation

Author(s): Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
Published in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024, 2024, ISSN 2311-17922
Publisher: IEEE/CVF
DOI: 10.48550/arXiv.2311.17922

Vision-Based Landing Guidance Through Tracking and Orientation Estimation

Author(s): João P. K. Ferreira, João P. Pinto, Júlia Moura, Yi Li, Cristiano L. Castro, Plamen Angelov
Published in: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
Publisher: IEEE
DOI: 10.1109/WACV61041.2025.00937

Synthcap: Augmenting transformers with synthetic data for image captioning

Author(s): Caffagni, D., Barraco, M., Cornia, M., Baraldi, L., Cucchiara, R
Published in: International Conference on Image Analysis and Processing (ICIAP), 2023
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-43148-7_10

Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates

Author(s): Riccardo Grazzi; Saverio Salzo; Massimiliano Pontil
Published in: Journal Of Machine Learning Research, 2024, ISSN 2403-11687
Publisher: Journal Of Machine Learning Research
DOI: 10.48550/arXiv.2403.11687

FLoRA: Sample-Efficient Preference-based RL via Low-Rank Style Adaptation of Reward Functions

Author(s): Daniel Marta, Simon Holk, Miguel Vasco, Jens Lundell, Timon Homberger, Finn Busch, Olov Andersson, Danica Kragic, Iolanda Leite
Published in: 2025 International Conference on Robotics and Automation, 2025
Publisher: IEEE

Cooperative online learning with feedback graphs

Author(s): Nicolò Cesa-Bianchi, Tommaso Cesari, and Riccardo Della Vecchia
Published in: Transactions on Machine Learning Research (06/2024), 2024
Publisher: Transactions on Machine Learning Research (06/2024)

Certifiers Make Neural Networks Vulnerable to Availability Attacks

Author(s): Tobias Lorenz, Marta Kwiatkowska, Mario Fritz
Published in: Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security, 2025
Publisher: ACM
DOI: 10.1145/3605764.3623917

Imitation or Innovation? Translating Features of Expressive Motion from Humans to Robots

Author(s): Benedikte Wallace, Marieke van Otterdijk, Yuchong Zhang, Nona Rajabi, Diego Marin-Bucio, Danica Kragic, Jim Torresen
Published in: Proceedings of the 12th International Conference on Human-Agent Interaction, 2025
Publisher: ACM
DOI: 10.1145/3687272.3688302

Mitigating Robustness Bias: Theoretical Results and Empirical Evidences

Author(s): Franco, D. and Oneto, L. and Anguita, D.
Published in: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), 2023, ISBN 978-2-87587-088-9
Publisher: ESANN
DOI: 10.14428/esann/2023.ES2023-30

Lecture Notes in Computer Science

Author(s): Xiyue Zhang, Benjie Wang, Marta Kwiatkowska
Published in: TACAS 2024, 30th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, 2024, ISSN 0302-9743
Publisher: Springer
DOI: 10.48550/arXiv.2305.03686

Text-DIAE: A Self-Supervised Degradation Invariant Autoencoder for Text Recognition and Document Enhancement

Author(s): Mohamed Ali Souibgui, Sanket Biswas, Andres Mafla, Ali Furkan Biten, Alicia Fornés, Yousri Kessentini, Josep Lladós, Lluis Gomez, Dimosthenis Karatzas
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 37, 2023, ISSN 2374-3468
Publisher: Association for the Advancement of Artificial Intelligence (AAAI)
DOI: 10.1609/AAAI.V37I2.25328

Make Me a BNN: A Simple Strategy for Estimating Bayesian Uncertainty from Pre-trained Models

Author(s): Gianni Franchi, Olivier Laurent, Maxence Leguéry, Andrei Bursuc, Andrea Pilzer, Angela Yao
Published in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024, 2024, ISSN 2312-15297
Publisher: IEEE/CVF
DOI: 10.48550/arXiv.2312.15297

Human-centered AI Technologies in Human-robot Interaction for Social Settings

Author(s): Yuchong Zhang, Khaled Kassem, Zhengya Gong, Fan Mo, Yong Ma, Emma Kirjavainen, Jonna Häkkilä
Published in: Proceedings of the International Conference on Mobile and Ubiquitous Multimedia, 2025
Publisher: ACM
DOI: 10.1145/3701571.3701610

ModSec-Learn: Boosting ModSecurity with Machine Learning

Author(s): Christian Scano, Giuseppe Floris, Biagio Montaruli, Luca Demetrio, Andrea Valenza, Luca Compagna, Davide Ariu, Luca Piras, Davide Balzarotti, Battista Biggio
Published in: Lecture Notes in Networks and Systems, Distributed Computing and Artificial Intelligence, Special Sessions I, 21st International Conference, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76459-2_3

Transient-Fault-Aware Design and Training to Enhance DNNs Reliability with Zero-Overhead

Author(s): Niccolò Cavagnero; Fernando Dos Santos; Marco Ciccone; Giuseppe Averta; Tatiana Tommasi; Paolo Rech
Published in: 2022 IEEE 28th International Symposium on On-Line Testing and Robust System Design (IOLTS), 2022
Publisher: IOLTS
DOI: 10.1109/IOLTS56730.2022.9897813

LFPD: Local-Feature-Powered Defense Against Adaptive Backdoor Attacks

Author(s): Wei Guo, Ambra Demontis, Maura Plntor, Patrick P.K. Chan, Battista Biggio
Published in: 2024 International Conference on Machine Learning and Cybernetics (ICMLC), 2025
Publisher: IEEE
DOI: 10.1109/ICMLC63072.2024.10935153

Distributionally Robust Model-based Reinforcement Learning with Large State Spaces

Author(s): S.S. Ramesh, P. G. Sessa, Y. Hu, A. Krause, I. Bogunovic
Published in: International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Publisher: AISTATS
DOI: 10.48550/arXiv.2309.02236

3DOS: Towards 3D Open Set Learning - Benchmarking and Understanding Semantic Novelty Detection on Point Clouds

Author(s): Antonio Alliegro, Francesco Cappio Borlino, Tatiana Tommasi
Published in: Advances in Neural Information Processing Systems 35 (NeurIPS 2022) Datasets and Benchmarks Track, 2022, ISBN 9781713871088
Publisher: NeurIPS 2022

Hyperparameters in Score-Based Membership Inference Attacks

Author(s): Gauri Pradhan, Joonas Jälkö, Marlon Tobaben, Antti Honkela
Published in: SaTML 2025, 2025
Publisher: SaTML 2025
DOI: 10.48550/ARXIV.2502.06374

The BRAVO Semantic Segmentation Challenge Results in UNCV2024

Author(s): Tuan-Hung Vu, Eduardo Valle, Andrei Bursuc, Tommie Kerssies, Daan de Geus, Gijs Dubbelman, Long Qian, Bingke Zhu, Yingying Chen, Ming Tang, Jinqiao Wang, Tomáš Vojíř, Jan Šochman, Jiří Matas, Michael Smith, Frank Ferrie, Shamik Basu, Christos Sakaridis, L
Published in: European Conference on Computer Vision (ECCV) 2024, 2024
Publisher: European Conference on Computer Vision (ECCV) 2024
DOI: 10.48550/ARXIV.2409.15107

TransferBench: Benchmarking Ensemble-based Black-box Transfer Attacks

Author(s): Brau, Fabio; Pintor, Maura; Cinà, Antonio Emanuele; Mura, Raffaele; Scionis, Luca; Oneto, Luca; Roli, Fabio; Biggio,Battista
Published in: The Thirty-ninth Annual Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2025
Publisher: OpenReview.net

Learning Counterfactually Invariant Predictors

Author(s): Francesco Quinzan, Cecilia Casolo, Krikamol Muandet, Yucen Luo, Niki Kilbertus
Published in: 2nd Workshop on Formal Verification of Machine Learning (WFVML 2023), 2023, ISSN 2207-09768
Publisher: arXiv
DOI: 10.48550/arXiv.2207.09768

Fairness Without Demographic Data: A Survey of Approaches

Author(s): Carolyn Ashurst, Adrian Weller
Published in: Equity and Access in Algorithms, Mechanisms, and Optimization, 2025
Publisher: ACM
DOI: 10.1145/3617694.3623234

Fair Empirical Risk Minimization Revised

Author(s): Franco, D. and Oneto, L. and Anguita, D.
Published in: International Work-Conference on Artificial and Natural Neural Networks (IWANN), 2023, ISBN 978-3-031-43084-8
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-43085-5_3

Will You Participate? Exploring the Potential of Robotics Competitions on Human-centric Topics

Author(s): Yuchong Zhang, Miguel Vasco, Mårten Björkman, Danica Kragic
Published in: International Conference on Human-Computer Interaction (HCII) 2024, 2024
Publisher: Springer
DOI: 10.48550/ARXIV.2403.18616

Edge Implementation of Unsupervised Self-evolving Vision Classifier

Author(s): P. Angelov, A. Aghasanli
Published in: IEEE International Conference on Evolving and Adaptive Intelligent Systems 2024, 2024
Publisher: IEEE International Conference on Evolving and Adaptive Intelligent Systems 2024
DOI: 10.1109/EAIS58494.2024.10570024

Human Uncertainty in Concept-Based AI Systems

Author(s): Katherine Maeve Collins ,Matthew Barker, Mateo Espinosa Zarlenga, Naveen Raman, Umang Bhatt, Mateja Jamnik, Ilia Sucholutsky ,Adrian Weller , Krishnamurthy Dvijotham
Published in: Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, 2023
Publisher: AIES
DOI: 10.1145/3600211.3604692

Automated Classification of Model Errors on ImageNet

Author(s): Momchil Peychev, Mark Niklas Müller, Marc Fischer, Martin Vechev
Published in: NeurIPS'23, 2023
Publisher: NeurIPS
DOI: 10.48550/arXiv.2401.02430

Media Coverage of Predictive Policing: Bias, Police Engagement, and the Future of Transparency

Author(s): Harry Camilleri, Carolyn Ashurst, Nithya Jaisankar, Adrian Weller, Miri Zilka
Published in: Equity and Access in Algorithms, Mechanisms, and Optimization, 2025
Publisher: ACM
DOI: 10.1145/3617694.3623249

DocILE Benchmark for Document Information Localization and Extraction

Author(s): Štěpán Šimsa, Milan Šulc, Michal Uřičář, Yash Patel, Ahmed Hamdi, Matěj Kocián, Matyáš Skalický, Jiří Matas, Antoine Doucet, Mickaël Coustaty, Dimosthenis Karatzas
Published in: Document Analysis and Recognition - ICDAR 2023. ICDAR 2023. Lecture Notes in Computer Science, 2023, ISBN 978-3-031-41678-1
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-41679-8_9

Book chapters (2)

Self-supervised Representation Learning for Adversarial Attack Detection

Author(s): Yi Li, Plamen Angelov, Neeraj Suri
Published in: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73027-6_14

Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities

Author(s): Lorenzo Baraldi, Federico Cocchi, Marcella Cornia, Lorenzo Baraldi, Alessandro Nicolosi, Rita Cucchiara
Published in: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73036-8_12

Other (6)

DPVIm: Differentially Private Variational Inference Improved

Author(s): Joonas Jälkö, Lukas Prediger, Antti Honkela, Samuel Kaski
Published in: TMLR 9/2023, 2023
Publisher: TMLR 9/2023

On Neuron Activation Pattern and Applications

Author(s): Ziping Jiang, Plamen Angelov, Dmitry Kangin, Zhaonian Zhang, Richard Jiang
Published in: 2024
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.36227/TECHRXIV.170421894.45150592/V1

Living-off-The-Land Reverse-Shell Detection by Informed Data Augmentation

Author(s): Trizna, D., Demetrio, L., Biggio, B., & Roli, F.
Published in: 2024, ISSN 2402-18329
Publisher: ArXiv
DOI: 10.48550/arXiv.2402.18329

σ-zero: Gradient-based Optimization of ℓ0-norm Adversarial Examples

Author(s): Cinà, A.E., Villani, F., Pintor, M., Schönherr, L., Biggio, B., Pelillo, M.,
Published in: 2024, ISSN 2402-01879
Publisher: ArXiv
DOI: 10.48550/arXiv.2402.01879

The European Union's AI Act: beyond motherhood and apple pie?

Author(s): Nathalie A. Smuha, Karen Yeung
Published in: 2024
Publisher: Elsevier BV
DOI: 10.2139/SSRN.4874852

STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers

Author(s): Daqian Shao, Lukas Fesser, Marta Kwiatkowska
Published in: Technical report, paper under submission, 2023
Publisher: N/A
DOI: 10.48550/arXiv.2401.05338

Thesis and dissertations (1)

Exploring the role of Text in Visual Question Answering on Natural Scenes and Documents

Author(s): Ruben Perez Tito
Published in: 2023, ISBN 978-84-124793-5-5
Publisher: Ediciones Gráficas Rey