Meaning and Understanding in Human-centric AI

Informations projet

MUHAI

N° de convention de subvention: 951846

DOI

10.3030/951846

Projet clôturé

Date de signature de la CE 12 Juin 2020

Date de début 1 Octobre 2020

Date de fin 31 Mars 2025

Financé au titre de

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Coût total

€ 3 996 032,50

Contribution de l’UE

€ 3 996 032,50

Coordonné par

UNIVERSITAET BREMEN
Germany

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (1)

Book Publication

A book to be ready at the end project containing the main results of the MUHAI project, written in a way that is accessible to a wide audience.

Open Research Data Pilot (1)

Library of CANVAS services

A set of services in the CANVAS toolkit that can be used by other scientists to buildproactive analytical tools and observatories that use a deeper understanding of the meaning of structured data and texts.

Demonstrators, pilots, prototypes (1)

Multilingual Grammar Architecture

Opensource software library for developing multilingual models of constructional language processing with predefined base models for English M12 French M24 Italian and Spanish M36 and German and Dutch M48

Data sets, microdata, etc (1)

Recipe execution benchmark

Release of the benchmark on recipe execution to the community, including a detailed task description, annotated training and test data, and a standardised evaluation procedure.

Publications

Conference proceedings (39)

Conceptual Shadows: Visualizing Concept-specific Dimensions of Meaning in Word Embeddings with Self Organizing Maps

Auteurs: Laura Spillner, Robert Porzel, Robin Nolte and Rainer Malaka
Publié dans: Proceedings of the Joint Ontology Workshops, 2023
Éditeur: CEUR-WS
DOI: 10.5281/zenodo.16616596

On Formalizing Narratives

Auteurs: Robert Porzel
Publié dans: Proceedings of the JOWO – Ontology Workshops, Numéro Vol 2969, 2021
Éditeur: CEUR Workshop Proceedings

OKG: A Knowledge Graph for Fine-grained Understanding of Social Media Discourse on Inequality

Auteurs: Inès Blin, Lise Stork, Laura Spillner, Carlo Santagiustina
Publié dans: Proceedings of the 12th Knowledge Capture Conference 2023, 2024, Page(s) 166-174
Éditeur: ACM
DOI: 10.1145/3587259.3627557

Foundational Models for Manipulation Activity Parsing

Auteurs: Beßler, D., Porzel, R., Pomarlan, M., Beetz, M.
Publié dans: Springer Proceedings in Business and Economics, Numéro Jung, T., tom Dieck, M.C., Correia Loureiro, S.M. (eds) Extended Reality and Metaverse. XR 2022, 2023, Page(s) 115–121, ISBN 978-3-031-25389-8
Éditeur: Springer
DOI: 10.1007/978-3-031-25390-4_10

Hybrid Procedural Semantics for Visual Dialogue: An Interactive Web Demonstration

Auteurs: Lara Verheyen, Jérôme Botoko Ekila, Jens Nevens, Paul Van Eecke and Katrien Beuls
Publié dans: Proceedings of the Workshop on Semantic Techniques for Narrative-Based Understanding co-located with 31st International Joint Conference on Artificial Intelligence and the 25th European Conference on Artificial Intelligence (IJCAI-ECAI 2022), Numéro Vol-3322, 2022, Page(s) 48-52, ISSN 1613-0073
Éditeur: ceur-ws.org

Finding Uncommon Ground: A Human-Centered Model for Extrospective Explanations

Auteurs: Laura Spillner, Nima Zargham, Mihai Pomarlan, Robert Porzel and Rainer Malaka
Publié dans: Proceedings of the 2023 IJCAI workshop on Explainable Artificial Intelligence (XAI), 2023
Éditeur: IJCAI

Decentralised Emergence of Robust and Adaptive Linguistic Conventions in Populations of Autonomous Agents Grounded in Continuous Worlds

Auteurs: Jens Nevens, Robin de Haes, Rachel Ringe, Mihai Pomarlan, Robert Porzel, Katrien Beuls, Paul van Eecke
Publié dans: Proc. of the 23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2024), 2024
Éditeur: AAMAS 2024
DOI: 10.5555/3635637.3663096

Building a French Revolution Narrative from Wikidata

Auteurs: Inès Blin
Publié dans: Proceedings of the Workshop on Semantic Techniques for Narrative-Based Understanding, Numéro IJCAI-ECAI 2022, Vienna, July 24, 2022, 2022, Page(s) Vol. 3322, pgs. 1-5, ISSN 1613-0073
Éditeur: ceur-ws.org
DOI: 10.5281/zenodo.16615820

Talk to Me on My Level – Linguistic Alignment for Chatbots

Auteurs: Spillner, Laura and Wenig, Nina
Publié dans: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction, 2021, Page(s) 1–12, ISBN 978-1-4503-8328-8
Éditeur: Association for Computing Machinery
DOI: 10.1145/3447526.3472050

Fluid Construction Grammar: State of the Art and Future Outlook

Auteurs: Katrien Beuls and Paul Van Eecke
Publié dans: Proceedings of the First International Workshop on Construction Grammars and NLP (CxGs+NLP, GURT/SyntaxFest 2023), 2023, Page(s) 41-50
Éditeur: Association for Computational Linguistics

Towards a Task-based Metric for Measuring Trust in Autonomous Robots for Everyday Activities.

Auteurs: Ringe, Rachel and Porzel, Robert
Publié dans: Proceedings of the CHI TRAIT Workshop on Trust and Reliance in AI-Assisted Tasks, Hamburg, Germany,, 2023
Éditeur: CHI TRAIT

Building Narrative Structures from Knowledge Graphs

Auteurs: Inès Blin
Publié dans: European Semantic Web Conference. Lecture Notes in Computer Science., Numéro vol 13384, 2022, Page(s) pp 234–251, ISBN 978-3-031-11609-4
Éditeur: Springer
DOI: 10.1007/978-3-031-11609-4_38

Semantic Data Retrieval and Integration for Supporting Artworks Interpretation Through Integrative Narrative Networks

Auteurs: Sofia Baroncini, Luc Steels, and Remi van Trijp
Publié dans: Proceedings of the International Workshop on Semantic Web and Ontology Design for Cultural Heritage co-located with the International Semantic Web Conference 2023, 2023
Éditeur: CEUR-WS
DOI: 10.5281/zenodo.16614808

METAMORPH - A Metamodeling Approach for Robot Morphology

Auteurs: Rachel Ringe, Robin Nolte, Nima Zargham, Robert Porzel, Rainer Malaka
Publié dans: 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2025, Page(s) 627-636
Éditeur: IEEE
DOI: 10.1109/hri61500.2025.10973806

Neuro-Symbolic Procedural Semantics for Reasoning-Intensive Visual Dialogue Tasks

Auteurs: Lara Verheyen, Jérôme Botoko Ekila, Jens Nevens, Paul Van Eecke and Katrien Beuls
Publié dans: Frontiers in Artificial Intelligence and Applications, Volume 372: ECAI 2023, Numéro Vol. 372, 2023, Page(s) 2419 - 2426
Éditeur: IOS Press
DOI: 10.3233/faia230544

An Experiment in Measuring Understanding

Auteurs: Luc Steels, Lara Verheyen and Remi van Trijp
Publié dans: Proceedings of the Workshop on Semantic Techniques for Narrative-Based Understanding, Numéro Vol. 3322, 2022, Page(s) 36-42, ISSN 1613-0073
Éditeur: ceur-ws.org
DOI: 10.5281/zenodo.16616181

Enabling Social Demography Research using Semantic Technologies

Auteurs: Lise Stork, Richard L. Zijdeman, Ilaria Tiddi & Annette ten Teije
Publié dans: ESWC 2024, 2024
Éditeur: Springer

Using Referential Language Games for Task-oriented Ontology Alignment

Auteurs: Nikolaos Kondylidis
Publié dans: Lecture Notes in Computer Science, Springer, Cham., Numéro vol 13384, The Semantic Web: ESWC 2022 Satellite Events. ESWC 2022, 2022, ISBN 978-3-031-11608-7
Éditeur: Springer, Cham
DOI: 10.1007/978-3-031-11609-4_39

Dynamic Action Selection Using Image Schema-Based Reasoning for Robots

Auteurs: Maria Hedblom, Mihai Pomarlan, Robert Porzel, Rainer Malaka, Michael Beetz
Publié dans: Proceedings of the JOWO – Ontology Workshops, Numéro Vol 2969, 2021
Éditeur: CEUR Workshop Proceedings
DOI: 10.5281/zenodo.16612715

Narrativizing Knowledge Graphs

Auteurs: Porzel, R.; Pomarlan, M.; Spillner, L.; Bateman, J.; Mildner, T.; Santagiustina, C.
Publié dans: Joint Proceedings of the 3th International Workshop on Artificial Intelligence Technologies for Legal Documents (AI4LEGAL 2022) and the 1st International Workshop on Knowledge Graph Summarization (KGSum 2022) co-located with the 21st International Semantic Web Conference (ISWC 2022), Numéro Vol. 3257, 2022, Page(s) 100-111
Éditeur: CEUR Workshop Proceedings

Bot Appétit! Exploring how Robot Morphology Shapes Perceived Affordances via a Mise en Place Scenario in a VR Kitchen

Auteurs: Rachel Ringe, Leandra Thiele, Mihai Pomarlan, Nima Zargham, Robin Nolte, Lars Hurrelbrink, Rainer Malaka
Publié dans: Proceedings of the 2025 34th IEEE International Conference on Robot and Human Interactive Communication (ROMAN), 2025
Éditeur: IEEE
DOI: 10.48550/arxiv.2507.19082

Identifying Centres of Interest in Paintings Using Alignment and Edge Detection

Auteurs: Sinem Aslan, Luc Steels
Publié dans: Alberto Del Bimbo, Rita Cucchiara, Stan Sclaroff, Giovanni Maria Farinella, Tao Mei, Marco Bertini, Hugo Jair Escalante and Roberto Vezzani (eds.). Pattern Recognition. ICPR International Workshops and Challenges., 2021, Page(s) 589–603, ISBN 978-3-030-68796-0
Éditeur: Springer, Cham
DOI: 10.1007/978-3-030-68796-0_42

Filling Constructions: Applying Construction Grammar in the Kitchen

Auteurs: Vanja Sophie Cangalovic, Robert Porzel and John A Bateman
Publié dans: Proceedings of the 11th International Conference on Construction Grammar - ICCG11, 2021
Éditeur: muhai.org

The Candide Model: How Narratives Emerge Where Observations Meet Beliefs

Auteurs: Paul Van Eecke, Lara Verheyen, Tom Willaert, Katrien Beuls
Publié dans: ACL's 5th Workshop on Narrative Understanding, Numéro Proceedings of the ACL's 5th Workshop on Narrative Understanding, 2023, Page(s) 48-57
Éditeur: ACL Association for Computational Linguistics
DOI: 10.18653/v1/2023.wnu-1.7

We'll give you what you want: An Ontological Model of User Preferences

Auteurs: Mona Abdel-Keream, Daniel Beßler, Ayden Janssen, Sascha Jongebloed, Robin Nolte, Mihai Pomarlan and Robert Porzel
Publié dans: Proceedings of the Robotics Workshop at the IEEE RO-MAN Conference, 2023
Éditeur: IEEE RO-MAN
DOI: 10.48550/arxiv.2310.18929

A Benchmark for Recipe Understanding in Artificial Agents

Auteurs: Jens Nevens, Robin de Haes, Rachel Ringe, Mihai Pomarlan, Robert Porzel, Katrien Beuls, and Paul van Eecke
Publié dans: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), 2024, Page(s) 22-42
Éditeur: ELRA and ICCL

Language Acquisition through Intention Reading and Pattern Finding

Auteurs: Jens Nevens, Jonas Doumen, Paul Van Eecke and Katrien Beuls
Publié dans: Proceedings of the 29th International Conference on Computational Linguistics, 2022, Page(s) 15-25
Éditeur: International Committee on Computational Linguistics

Personal dynamic memories are necessary to deal with meaning and understanding in human-centric AI

Auteurs: Luc Steels
Publié dans: Proceedings of the First International Workshop on New Foundations for Human-Centered AI (NeHuAI) co-located with 24th European Conference on Artificial Intelligence (ECAI 2020), Numéro Vol. 2659, 2020, Page(s) 11-16
Éditeur: CEUR Workshop Proceedings

My, my, how can I resist you? Examining User Reactions to Bogus Explanations of AI Prediction

Auteurs: Laura Spillner, Rachel Ringe, Robert Porzel, Rainer Malaka
Publié dans: Proceedings of the Workshop on Ethics and Trust in Human-AI Collaboration: Socio-Technical Approaches (ETHAICS 2023), 2023
Éditeur: CEUR-WS
DOI: 10.5281/zenodo.16615044

Explainable Drug Repurposing in Context via Deep Reinforcement Learning

Auteurs: Lise Stork, Ilaria tiddi, Annette ten Teije, René Spijker
Publié dans: Proceedings of the Extended Semantic Web conference, Numéro The Semantic Web. ESWC 2023. Lecture notes in computer science. Vol. 13870, 2023, ISBN 978-3-031-33454-2
Éditeur: Springer Cham
DOI: 10.1007/978-3-031-33455-9_1

Category Aware Explainable Conversational Recommendation

Auteurs: Nikolaos Kondylidis, Jie Zou and Evangelos Kanoulas
Publié dans: MICROS Workshop at ECIR 2021, 2021
Éditeur: arxiv.org
DOI: 10.48550/arxiv.2103.08733

Streamlining Formal Construction Grammar

Auteurs: Vanja Sophie Cangalovic, Robert Porzel and John A Bateman
Publié dans: Proceedings of the 11th International Conference on Construction Grammar - ICCG11, 2021
Éditeur: muhai.org

The Wilhelm Tell Dataset of Affordance Demonstrations

Auteurs: Rachel Ringe, Mihai Pomarlan, Nikolaos Tsiogkas, Stefano De Giorgis, Maria Hedblom, Rainer Malaka
Publié dans: 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2025, Page(s) 1078-1082
Éditeur: IEEE
DOI: 10.1109/hri61500.2025.10973984

Examining the Effects of Human-Likeness of Avatars on Emotion Perception and Emotion Elicitation

Auteurs: Shiyao Zhang, Omar Faruk, Robert Porzel, Dennis Küster, Tanja Schultz, Hui Liu
Publié dans: 2024 International Conference on Activity and Behavior Computing (ABC), 2024, Page(s) 1-12
Éditeur: IEEE
DOI: 10.1109/abc61795.2024.10652090

Establishing Shared Query Understanding in an Open Multi-Agent System

Auteurs: Nikolaos Kondylidis, Ilaria Tiddi, Annette ten Teije
Publié dans: Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, 2023, Page(s) 281-289, ISBN 978-1-4503-9432-1
Éditeur: AAMAS '23
DOI: 10.5555/3545946.3598649

Narrative Objects

Auteurs: Mihai Pomarlan, Robert Porzel
Publié dans: Proceedings of the Workshop on Semantic Techniques for Narrative-Based Understanding co-located with 31st International Joint Conference on Artificial Intelligence and the 25th European Conference on Artificial Intelligence (IJCAI-ECAI 2022), Numéro Vol-3322, 2022, Page(s) 6-10, ISSN 1613-0073
Éditeur: ceur-ws.org

Modelling Language Acquisition through Syntactico-Semantic Pattern Finding

Auteurs: Jonas Doumen, Katrien Beuls, Paul Van Eecke
Publié dans: Findings of the Association for Computational Linguistics: EACL 2023, 2023, Page(s) 1347–1357
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-eacl.99

HASI: A Model for Human-Agent Speech Interaction. a

Auteurs: Nima Zargham, Vino Avanesi, Thomas Mildner, Kamyar Javanmardi, Robert Porzel, Rainer Malaka
Publié dans: CUI '24: Proceedings of the 6th ACM Conference on Conversational User Interfaces, 2024, Page(s) 1-8
Éditeur: CUI '24
DOI: 10.1145/3640794.366588

Panta Rhei: Curiosity-Driven Exploration to Learn the Image-Schematic Affordances of Pouring Liquids.

Auteurs: Maria Hedblom, Mihai Pomarlan and Robert Porzel.
Publié dans: Proceedings of the 29th Irish Conference on Artificial Intelligence and Cognitive Science., Numéro Vol 3105, 2021, Page(s) 106-117
Éditeur: CEUR Workshop Proceedings

Book chapters (11)

From Narrative Economics to Economists’ Narratives

Auteurs: Carlo Santagiustina
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Construction grammar and artificial intelligence

Auteurs: Katrien Beuls, Paul Van Eecke
Publié dans: The Cambridge Handbook of Construction Grammar, 2025
Éditeur: Cambridge University Press
DOI: 10.48550/arxiv.2309.00135

Pragmatics of Narration with Language

Auteurs: Anna Morbiato
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Narratives in social neuroscience

Auteurs: Oscar Vilarroya
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Cognitive Foundations of Human-Centric AI

Auteurs: Steels, Luc
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol. 1, 2022, Page(s) 152, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Hanging Around: Cognitive Inspired Reasoning for Reactive Robotics

Auteurs: Mihai Pomarlan, Stefano De Giorgis, Rachel Ringe, Maria M. Hedblom, Nikolaos Tsiogkas
Publié dans: Frontiers in Artificial Intelligence and Applications, Formal Ontology in Information Systems, 2024
Éditeur: IOS Press
DOI: 10.3233/faia241288

Narrative Art Interpretation

Auteurs: Luc Steels
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Clinical Narratives for Causal Understanding in Medicine

Auteurs: Lise Stork, Ilaria Tiddi, Annette tenTeije
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Structured Representations for Narratives

Auteurs: Inès Blin, Annette ten Teije, Frank van Harmelen, Ilaria Tiddi
Publié dans: Lecture Notes in Computer Science, Knowledge Engineering and Knowledge Management, 2024, Page(s) 133-154
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-77792-9_9

Narratives in Historical Sciences

Auteurs: Remi van Trijp, In`es Blin
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol.1, 2023, ISBN 979-12-810-8700-2
Éditeur: Venice International University

Towards an Ontology for Robot Introspection and Metacognition

Auteurs: Robin Nolte, Mihai Pomarlan, Daniel Bessler, Robert Porzel, Rainer Malaka, John A. Bateman
Publié dans: Frontiers in Artificial Intelligence and Applications, Formal Ontology in Information Systems, 2023
Éditeur: IOS Press
DOI: 10.3233/faia231137

Monographic books (4)

Aqua Granda Una memoria collettiva digitale / Aqua Granda A digital community memory

Auteurs: Steels, Luc; Sartoris, Costanza
Publié dans: Numéro 1, 2021
Éditeur: Science Gallery Venice
DOI: 10.5281/zenodo.4739304

Narrative-based Understanding of Everyday Activities: A Cookbook.

Auteurs: Steels, Luc; Porzel, Robert
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol. 2, 2024
Éditeur: Venice International University
DOI: 10.5281/zenodo.14199174

Foundations for Meaning and Understanding in Human-centric AI

Auteurs: Steels, Luc (ed.)
Publié dans: 2022, ISBN 979-12-810-8700-2
Éditeur: Venice International University
DOI: 10.5281/zenodo.6666820

Narrative-based Understanding of Society

Auteurs: Steels, Luc; van Harmelen, Frank
Publié dans: Foundations for Meaning and Unserstanding in Human-centric AI, Numéro Vol. 3, 2025
Éditeur: Venice International University
DOI: 10.5281/zenodo.15093258

Peer reviewed articles (8)

Humans Learn Language from Situated Communicative Interactions. What about Machines?

Auteurs: Katrien Beuls, Paul Van Eecke
Publié dans: Computational Linguistics, 2024, Page(s) 1-34, ISSN 0891-2017
Éditeur: MIT Press
DOI: 10.1162/coli_a_00534

FCG Editor: An innovative environment for engineering large-scale construction grammars

Auteurs: Remi van Trijp, Katrien Beuls, Paul Van Eecke
Publié dans: PLOS ONE, Numéro 17(6), 2022, Page(s) e0269708, ISSN 1932-6203
Éditeur: Public Library of Science
DOI: 10.1371/journal.pone.0269708

The Computational Learning of Construction Grammars: State of the Art and Prospective Roadmap

Auteurs: Jonas Doumen, Veronica Juliana Schmalz, Katrien Beuls, Paul Van Eecke
Publié dans: Constructions and Frames, 2025, ISSN 1876-1941
Éditeur: John Benjiamins
DOI: 10.48550/arxiv.2407.07606

Neural heuristics for scaling constructional language processing

Auteurs: Van Eecke, P., Nevens, J., & Beuls, K.
Publié dans: Journal of Language Modelling, Numéro Vol.10 No.2, 2022, Page(s) 287-314, ISSN 2299-856X
Éditeur: Institute of Computer Science Polish Academy of Science Warsaw
DOI: 10.15398/jlm.v10i2.318

Language games meet multi-agent reinforcement learning: A case study for the naming game

Auteurs: Van Eecke, P., Beuls, K., Botoko Ekila, J., & Rădulescu, R.
Publié dans: Journal of Language Evolution, Numéro Volume 7, Numéro 2, 2022, Page(s) 213–223, ISSN 2058-458X
Éditeur: Oxford University Press
DOI: 10.1093/jole/lzad001

Deep Understanding of Everyday Activity Commands for Household Robots

Auteurs: Sebastian Höffner, Robert Porzel, Maria M. Hedblom, Mihai Pomarlan, Vanja Sophie Cangalovic, Johannes Pfau, John A. Bateman and Rainer Malaka
Publié dans: Semantic Web Journal: Special Numéro on Semantic Web for Industrial Engineering: Research and Applications., Numéro (2022) 1–0, 2022, Page(s) 1-15, ISSN 1570-0844
Éditeur: IOS Press
DOI: 10.17605/osf.io/nm86g

Construction grammar and procedural semantics for human-interpretable grounded language processing

Auteurs: Liesbet De Vos, Jens Nevens, Paul Van Eecke, Katrien Beuls
Publié dans: Linguistics Vanguard, Numéro 10, 2024, Page(s) 565-574, ISSN 2199-174X
Éditeur: De Gruyter Mouton
DOI: 10.1515/lingvan-2022-0054

Modelling constructivist language acquisition through syntactico-semantic pattern finding

Auteurs: Jonas Doumen, Katrien Beuls, Paul Van Eecke
Publié dans: Royal Society Open Science, Numéro 11, 2024, ISSN 2054-5703
Éditeur: The Royal Society
DOI: 10.1098/rsos.231998