FOUNDATIONS FOR CONTINUOUS ENGINEERING OF TRUSTWORTHY AUTONOMY

Deliverables

Documents, reports (3)

Report: Systematic and coverage-driven testing of learning components

Report Systematic and coveragedriven testing of learning components ULIV

Report: Provable safe reinforcement learning

Report Provable safe reinforcement learning TUG

Dissemination Action Plan including project corporate identity

Dissemination Action Plan including project corporate identity UGA

Websites, patent fillings, videos etc. (2)

Dissemination set (poster, leaflet, Kakemono) and Website

Dissemination set poster leaflet Kakemono and Website UGA

Project mini-video

Project minivideo UGA

Other (1)

Project newsletter 1

Project newsletter 1 LUP

Publications

Conference proceedings (30)

How does Weight Correlation Affect the Generalisation Ability of Deep Neural Networks

Author(s): Jin, Gaojie; Yi, Xinping; Zhang, Liang; Zhang, Lijun; Schewe, Sven; Huang, Xiaowei
Published in: 34th Conference on Neural Information Processing Systems (NeurIPS 2020), 1, 2020
Publisher: Neural Information Processing Systems

Safe, Deterministic Trajectory Planning for Unstructured and Partially Occluded Environments

Author(s): Sebastian vom Dorff, Maximilian Kneissl, Martin Franzle
Published in: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), 2021, Page(s) 969-975, ISBN 978-1-7281-9142-3
Publisher: IEEE
DOI: 10.1109/itsc48978.2021.9565022

Continuous Safety Verification of Neural Networks

Author(s): Chih-Hong Cheng, Rongjie Yan
Published in: 2021 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2021, Page(s) 1478-1483, ISBN 978-3-9819263-5-4
Publisher: IEEE
DOI: 10.23919/date51398.2021.9473994

Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applications

Author(s): Wenjie Ruan; Xinping Yi; Xiaowei Huang
Published in: CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, 2021 Proceeding, 2021, ISBN 978-1-4503-8446-9
Publisher: ACM
DOI: 10.1145/3459637.3482029

Detecting Operational Adversarial Examples for Reliable Deep Learning

Author(s): Zhao, Xingyu; Huang, Wei; Schewe, Sven; Dong, Yi; Huang, Xiaowei; IEEE,
Published in: 51ST ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS - SUPPLEMENTAL VOL (DSN 2021), 1, 2021, ISBN 978-1-6654-3566-6
Publisher: IEEE
DOI: 10.1109/dsn-s52858.2021.00013

Runtime Verification for FMI-Based Co-simulation

Author(s): Anastasios Temperekidis, Nikolaos Kekatos, and Panagiotis Katsaros
Published in: Runtime Verification. RV 2022. Lecture Notes in Computer Science, vol 13498, 2022
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-17196-3_19

Enhancing Adversarial Training with Second-Order Statistics of Weights

Author(s): Gaojie Jin, Xinping Yi, Liang Zhang, Lijun Zhang, Sven Schewe, Xiaowei Huang
Published in: CVPR 2022 - 2022 Conference on Computer Vision and Pattern Recognition, 2022
Publisher: IEEE

Strategies for MDP Bisimilarity Equivalence and Inequivalence

Author(s): Stefan Kiefer, Qiyi Tang
Published in: Concur 2022 - 33RD INTERNATIONAL CONFERENCE ON CONCURRENCY THEORY, 2022, Page(s) 32:1--32:22, ISBN 978-3-95977-246-4
Publisher: Schloss Dagstuhl – Leibniz-Zentrum für Informatik
DOI: 10.4230/lipics.concur.2022.32

BayLIME: Bayesian Local Interpretable Model-Agnostic Explanations

Author(s): Xingyu Zhao, Xiaowei Huang, et. Al.
Published in: UAI2021 Proceedings of Machine Learning Research (PMLR), Zhao, X.,Huang, W, Huang, X., Robu, V., and Flynn, D. (2021). BayLime: Bayesian local interpretable model-agnostic explanations. UAI2021., 2021
Publisher: AAAI press

Hidden 1-Counter Markov Models and How to Learn Them

Author(s): Mehmet Kurucan, Mete Ozbaltan, Sven Schewe, Dominik Wojtczak
Published in: IJCAI 2022 - 31st International Joint Conference on Artificial Intelligence, 2022, Page(s) 4857-4863
Publisher: International Joint Conferences on Artificial Intelligence Organization
DOI: 10.24963/ijcai.2022/673

Reliable Multimodal Trajectory Prediction via Error Aligned Uncertainty Optimization

Author(s): Neslihan Kose Cihangir, Ranganath Krishnan, Akash Dhamasia, Omesh Tickoo, Michael Paulitsch
Published in: SAIAD 2022 - 4th Workshop Safe Artificial Intelligence for Automated Driving, 2023
Publisher: Springer
DOI: 10.48550/arxiv.2212.04812

Real-time Nonlinear MPC Strategy with Full Vehicle Validation for Autonomous Driving

Author(s): Jean Pierre Allamaa, Petr Listov, Herman Van der Auweraer, Colin Jones, Tong Duy Son
Published in: American Control Conference (ACC) 2022, 2021
Publisher: IEEE

Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving

Author(s): Flavia Sofia Acerbo, Mohsen Alirezaei, Herman Van der Auweraer, Tong Duy Son.
Published in: 24th IEEE International Conference on Intelligent Transportation - ITSC2021, 2021
Publisher: IEEE

Safety Metrics for Semantic Segmentation in Autonomous Driving

Author(s): Chih-Hong Cheng, Alois Knoll, Hsuan-Cheng Liao
Published in: 2021 IEEE International Conference on Artificial Intelligence Testing (AITest), 2021, Page(s) 57-64, ISBN 978-1-6654-3481-2
Publisher: IEEE
DOI: 10.1109/aitest52744.2021.00021

On Neural Network Equivalence Checking using SMT Solvers

Author(s): Charis Eleftheriadis, Nikolaos Kekatos, Panagiotis Katsaros, and Stavros Tripakis
Published in: Formal Modeling and Analysis of Timed Systems. FORMATS 2022. Lecture Notes in Computer Science, 2022
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-15839-1_14

TEMPEST - Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments

Author(s): Stefan Pranger; Bettina Könighofer; Lukas Posch; Roderick Bloem
Published in: ATVA 2021, 1, 2021, ISBN 978-3-030-88884-8
Publisher: Springer
DOI: 10.1007/978-3-030-88885-5_15

Monitoring Object Detection Abnormalities via Data-Label and Post-Algorithm Abstractions

Author(s): Chen, Yuhang; Cheng, Chih-Hong; Yan, Jun; Yan, Rongjie
Published in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021), 2021
Publisher: IEEE

Provably-Robust Runtime Monitoring of Neuron Activation Patterns

Author(s): Chih-Hong Cheng
Published in: 2021 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2021, Page(s) 1310-1313, ISBN 978-3-9819263-5-4
Publisher: IEEE
DOI: 10.23919/date51398.2021.9473957

Safety and reliability of deep learning - (brief overview)

Author(s): Xiaowei Huang
Published in: Proceedings of the 1st International Workshop on Verification of Autonomous & Robotic Systems, 2021, Page(s) 1-2, ISBN 9781450384445
Publisher: ACM
DOI: 10.1145/3459086.3459636

Model-Free Reinforcement Learning for Lexicographic ω-Regular Objectives

Author(s): Ernst Moritz Hahn, Mateo Perez, Sven Schewe, Fabio Somenzi, Ashutosh Trivedi, and Dominik Wojtczak
Published in: 24th International Symposium, FM 2021, 2021, ISBN 978-3-030-90870-6
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-90870-6_8

Testing Autonomous Systems with Believed Equivalence Refinement

Author(s): Chih-Hong Cheng, Rongjie Yan
Published in: 2021 IEEE International Conference on Artificial Intelligence Testing (AITest), 2021, Page(s) 49-56, ISBN 978-1-6654-3481-2
Publisher: IEEE
DOI: 10.1109/aitest52744.2021.00020

Assessing the reliability of deep learning classifiers through robustness evaluation and operational profiles

Author(s): Zhao, X., Huang, W., Banks, A., Cox, V., Flynn, D., Schewe, S., and Huang, X.
Published in: AISafety’21 Workshop at IJCAI’21, 2021
Publisher: CEUR

Information-flow Interfaces

Author(s): Ezio Bartocci, Thomas Ferrère, Thomas A. Henzinger, Dejan Nickovic & Ana Oliveira da Costa
Published in: Fundamental Approaches to Software Engineering. FASE 2022. Lecture Notes in Computer Science, vol 13241., 2022, ISBN 978-3-030-99428-0
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-99429-7_1

Search-Based Testing of Reinforcement Learning

Author(s): Martin Tappler, Filip Cano Cordoba, Bernhard Aichernig, Bettina Könighofer
Published in: Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence (IJCAI 2022) Main Track., Thirty-First Conference, 23-29 July 2022, 2022, Page(s) 503-510, ISBN 978-1-956792-00-3
Publisher: ijcai.org
DOI: 10.24963/ijcai.2022/72

A Hierarchical HAZOP-Like Safety Analysis for Learning-Enable Systems

Author(s): Yi Qi, Philippa Ryan, Wei Huang, Xingyu Zhao and Xiaowei Huang
Published in: AISafety 2022 workshop at IJCAI2022, 2022
Publisher: CEUR Workshop Proceedings
DOI: 10.48550/arxiv.2206.10216

Hardware Faults that Matter: Understanding and Estimating the Safety Impact of Hardware Faults on Object Detection DNNs

Author(s): Syed Qutub, Florian Geissler, Yang Peng, Ralf Gräfe, Michael Paulitsch, Gereon Hinz, and Alois Knoll
Published in: Safecomp 2022, 41st, 2022, Page(s) 298-318, ISBN 978-3-031-14835-4
Publisher: Springer
DOI: 10.1007/978-3-031-14835-4_20

DeepSTL - From English Requirements to Signal Temporal Logic

Author(s): Jie He, Ezio Bartocci, Dejan Nickovic and Radu Grosu
Published in: ICSE '22: Proceedings of the 44th International Conference on Software Engineering, 2022, Page(s) 610–622
Publisher: ACM Digital Library
DOI: 10.1145/3510003.3510171

Mining Shape Expressions with ShapeIt

Author(s): Ezio Bartocci, Jyotirmoy Deshmukh, Cristinel Mateis, Eleonora Nesterini, Dejan Nickovic, and Xin Qin
Published in: 19th International Conference on Software Engineering and Formal Methods (SEFM'21), 2021
Publisher: Springer
DOI: 10.5281/zenodo.5597000

Sampling of Shape Expressions with ShapEx

Author(s): Nicolas Basset; Thao Dang; Felix Gigler; Cristinel Mateis; Dejan Nickovic
Published in: ACM Digital Library, 2021
Publisher: ACM
DOI: 10.5281/zenodo.5550069

EPMC Gets Knowledge in Multi-Agent Systems

Author(s): Chen Fu, Ernst Moritz Hahn, Yong Li, Sven Schewe, Meng Sun, Andrea Turrini, and Lijun Zhang
Published in: VMCAI 2022 - 23rd International Conference on Verification, Model Checking, and Abstract Interpretation, volume 13182, 2022, Page(s) pages: 93-107, ISBN 978-3-030-94583-1
Publisher: Springer
DOI: 10.1007/978-3-030-94583-1_5

Peer reviewed articles (4)

Survey on mining signal temporal logic specifications

Author(s): Ezio Bartocci; Cristinel Mateis; Eleonora Nesterini; Dejan Nickovic
Published in: Information and Computation journal, 08905401, 2022, ISSN 0890-5401
Publisher: Academic Press
DOI: 10.1016/j.ic.2022.104957

Embedding and Extraction of Knowledge in Tree Ensemble Classifiers

Author(s): Xingyu Zhao, Xiaowei Huang
Published in: Machine Learning journal, 2021, ISSN 1573-0565
Publisher: Springer
DOI: 10.1007/s10994-021-06068-6

Semantic Modeling and Analysis of Natural Language System Requirements

Author(s): Konstantinos Mokos, Theodoros Nestoridis, Panagiotis Katsaros, Nick Bassiliades
Published in: IEEE Access Journal, 21693536, 2022, Page(s) 84094-84119, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3197281

Coverage-Guided Testing for Recurrent Neural Networks

Author(s): Wei Huang, Youcheng Sun, Xingyu Zhao, James Sharp, Wenjie Ruan, Jie Meng, Xiaowei Huang
Published in: IEEE Transactions on Reliability, 2021, Page(s) 1-16, ISSN 0018-9529
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tr.2021.3080664

Other (5)

Robustness Verification for Attention Networks using Mixed Integer Programming

Author(s): Hsuan-Cheng Liao, Chih-Hong Cheng, Maximilian Kneissl, Alois Knoll
Published in: 2022
Publisher: Arxiv
DOI: 10.48550/arxiv.2202.03932

Virtual Reality Assisted Human Perception in ADAS Development: a Munich 3D Model Study

Author(s): Felix Bognar, Oster Markus, Herman Van der Auweraer, Tong Duy Son
Published in: 2022
Publisher: Arxiv
DOI: 10.48550/arxiv.2208.07208

Towards Trustworthy Camera-Based Sensing and Perception Systems

Author(s): Christian Berghoff, Jona Böddinghaus, Vasilios Danos, Gabrielle Davelaar, Thomas Doms, Heiko Ehrich, Alexandru Forrai, Radu Grosu, Ronan Hamon, Henrik Junklewitz, Matthias Neu, Simon Romanski, Wojciech Samek, Dirk Schlesinger, Jan-Eve Stavesand, Sebastian Steinbach, Arndt von Twickel, Robert Walter, Johannes Weissenböck, Markus Wenzel, Thomas Wiegand
Published in: Whitepaper | May 2022. Towards Auditable AI Systems. From Principles to Practice. Based on the 2nd international Workshop “Towards Auditable AI Systems”, October 26th 2021, Fraunhofer Forum Digitale Technologien, Berlin, organized by the Federal Office for Information Security Germany, the TÜV-Verband and the Fraunhofer HHI, 2022
Publisher: Bundesamt für Sicherheit in der Informationstechnik, Fraunhofer-Institut für Nachrichtentechnik, TÜV-Verband e. V.

Dependability Analysis of Deep Reinforcement Learning based Robotics and Autonomous Systems

Author(s): Dong, Yi; Zhao, Xingyu; Huang, Xiaowei
Published in: 2, 2021
Publisher: ArXiv
DOI: 10.48550/arxiv.2109.06523

Deciding What is Good-for-MDPs

Author(s): Sven Schewe, Qiyi Tang and Tansholpan Zhanabekova
Published in: 2022
Publisher: Arxiv
DOI: 10.48550/arxiv.2202.07629