Distributed dynamic REpresentations for diAlogue Management

Información del proyecto

DREAM

Identificador del acuerdo de subvención: 819455

DOI

10.3030/819455

Proyecto cerrado

Fecha de la firma de la CE 12 Febrero 2019

Fecha de inicio 1 Septiembre 2019

Fecha de finalización 31 Mayo 2025

Financiado con arreglo a

• EXCELLENT SCIENCE - European Research Council (ERC)

Coste total

€ 2 000 000,00

Aportación de la UE

€ 2 000 000,00

Coordinado por

UNIVERSITEIT VAN AMSTERDAM
Netherlands

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Open Research Data Pilot (1)

Data Management Plan

The Data Management Plan will specify: - what kind of data will be generated and collected, - where and how it will be stored, and - who will have access to it and under what licence.

Publicaciones

Conference proceedings (40)

Linguistic and Gestural Coordination: Do Learners Converge in Collaborative Dialogue?

Autores: Arabella Sinclair, Bertrand Schneider
Publicado en: Proceedings of the 14th International Conference on Educational Data Mining, 2021, ISBN 978-1-7336736-2-4
Editor: EDM

Describing Images Fast and Slow: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes

Autores: Ece Takmaz, Sandro Pezzelle, Raquel Fernández
Publicado en: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), 2024
Editor: Association for Computational Linguistics

Detecting Age-Related Linguistic Patterns in Dialogue: Toward Adaptive Conversational Systems

Autores: Lennert Jansen, Arabella Sinclair, Margot J. Goot, Raquel Fernández, Sandro Pezzelle
Publicado en: Proceedings of the Eighth Italian Conference on Computational Linguistics, 2021
Editor: Italian Association for Computational Linguistics

Be Different to Be Better! A Benchmark to Leverage the Complementarity of Language and Vision

Autores: Sandro Pezzelle, Claudio Greco, Greta Gandolfi, Eleonora Gualdoni, Raffaella Bernardi
Publicado en: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Página(s) 2751-2767
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.248

Towards Pragmatic Production Strategies for Natural Language Generation Tasks

Autores: Mario Giulianelli
Publicado en: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 7978-7984
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.544

Stop Measuring Calibration When Humans Disagree

Autores: Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernandez
Publicado en: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 1892-1915
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.124

GROOViST: A Metric for Grounding Objects in Visual Storytelling

Autores: Aditya Surikuchi, Sandro Pezzelle, Raquel Fernández
Publicado en: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 3331-3339
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.202

I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue

Autores: Esam Ghaleb, Bulat Khaertdinov, Asli Ozyurek, Raquel Fernández
Publicado en: Findings of the Association for Computational Linguistics: ACL 2025, 2025
Editor: Association for Computational Linguistics

Analysing Human Strategies of Information Transmission as a Function of Discourse Context

Autores: Mario Giulianelli, Raquel Fernández
Publicado en: Proceedings of the 25th Conference on Computational Natural Language Learning, 2021
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.50

Experiential Semantic Information and Brain Alignment: Are Multimodal Models Better than Language Models?

Autores: Anna Bavaresco, Raquel Fernández
Publicado en: Proceedings of the 29th Conference on Computational Natural Language Learning (CoNLL), 2025
Editor: Association for Computational Linguistics

Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change

Autores: Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova
Publicado en: Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change, 2022, Página(s) 54-67
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.lchange-1.6

Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue

Autores: Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella Sinclair
Publicado en: Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL), 2023, Página(s) 254-273
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.conll-1.18

LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Autores: Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, Andre Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Surikuchi, Ece Takmaz, Alberto Testoni
Publicado en: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2025
Editor: Association for Computational Linguistics

Grounded and Ungrounded Referring Expressions in Human Dialogues: Language Mirrors Different Grounding Conditions

Autores: Eleonora Gualdoni, Raffaella Bernardi, Sandro Pezzelle, Raquel Fernández
Publicado en: Proceedings of the 7th Italian Conference on Computational Linguistics, 2020
Editor: CEUR Workshop Proceedings

AnaLog: Testing Analytical and Deductive Logic Learnability in Language Models

Autores: Samuel Ryb, Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Publicado en: Proceedings of the 11th Joint Conference on Lexical and Computational Semantics, 2022, Página(s) 55-68
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.starsem-1.5

Analysing cross-speaker convergence through the lens of automatically detected shared linguistic constructions

Autores: Ghaleb, E.; Rasenberg, M.; Pouw, W.; Toni, I.; Holler, J.; Özyürek, A.; Fernandez, R.
Publicado en: Proceedings of the 46th Annual Meeting of the Cognitive Science Society (CogSci 2024), 2024
Editor: Cognitive Science Society

Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts

Autores: Ece Takmaz, Mario Giulianelli, Sandro Pezzelle, Arabella Sinclair, Raquel Fernández
Publicado en: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Página(s) 4350-4368
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.353

Information Value: Measuring Utterance Predictability as Distance from Plausible Alternatives

Autores: Mario Giulianelli, Sarenne Wallbridge, Raquel Fernández
Publicado en: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 5633-5653
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.343

Is Information Density Uniform in Task-Oriented Dialogues?

Autores: Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Publicado en: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.emnlp-main.652

Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind

Autores: Ece Takmaz, Nicolo’ Brandizzi, Mario Giulianelli, Sandro Pezzelle, Raquel Fernandez
Publicado en: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Página(s) 4198-4217
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-acl.258

Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions

Autores: Ghaleb, Esam; Rasenberg, Marlou; Pouw, Wim; Toni, Ivan; Holler, Judith; Ozyurek, Asli; Fernandez, Raquel
Publicado en: Proceedings of the Annual Meeting of the Cognitive Science Society, 2024
Editor: Cognitive Science Society

Probing Cross-Modal Representations in Multi-Step Relational Reasoning

Autores: Iuliia Parfenova, Desmond Elliott, Raquel Fernández, Sandro Pezzelle
Publicado en: Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021), 2021
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.repl4nlp-1.16

Grammatical Profiling for Semantic Change Detection

Autores: Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova
Publicado en: 2021
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.33

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation

Autores: Esam Ghaleb, Bulat Khaertdinov, Marlou Rasenberg, Wim Pouw, Judith Holler, Aslı Özyürek, & Raquel Fernández
Publicado en: ICMI '24: Proceedings of the 26th International Conference on Multimodal Interaction, 2024
Editor: Association for Computing Machinery

Construction Coordination in First and Second Language Acquisition

Autores: Sinclair, A.J.; Fernández, R.
Publicado en: Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers, 2021
Editor: SEMDIAL

Don’t Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models

Autores: Anna Bavaresco, Alberto Testoni, Raquel Fernández
Publicado en: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024
Editor: Association for Computational Linguistics

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation

Autores: Esam Ghaleb, Bulat Khaertdinov, Wim Pouw, Marlou Rasenberg, Judith Holler, Asli Ozyurek, Raquel Fernandez
Publicado en: International Conference on Multimodel Interaction, 2025, Página(s) 274-283
Editor: ACM
DOI: 10.1145/3678957.3685707

The BLA Benchmark: Investigating Basic Language Abilities of Pre-Trained Multimodal Models

Autores: Xinyi Chen, Raquel Fernández, Sandro Pezzelle
Publicado en: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 5817-5830
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.356

Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Models

Autores: Jirui Qi, Raquel Fernández, Arianna Bisazza
Publicado en: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 10650-10666
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.658

Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions

Autores: Alberto Testoni, Raquel Fernández
Publicado en: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), 2024
Editor: Association for Computational Linguistics

Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis

Autores: Mario Giulianelli, Iris Luden, Raquel Fernandez, Andrey Kutuzov
Publicado en: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023, Página(s) 3130-3148
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-long.176

Team DMG at CMCL 2022 Shared Task: Transformer Adapters for the Multi- and Cross-Lingual Prediction of Human Reading Behavior

Autores: Ece Takmaz
Publicado en: Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, 2022, Página(s) 136-144
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.cmcl-1.16

Construction Repetition Reduces Information Rate in Dialogue

Autores: Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Publicado en: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2024, Página(s) 665-682
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.aacl-main.51

Controllable Text Generation for All Ages: Evaluating a Plug-and-Play Approach to Age-Adapted Dialogue

Autores: Lennert Jansen, Štěpán Lars Laichter, Arabella Sinclair, Margot van der Goot, Raquel Fernandez, Sandro Pezzelle
Publicado en: Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM), 2023, Página(s) 172-188
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.gem-1.14

Analysing Lexical Semantic Change with Contextualised Word Representations

Autores: Mario Giulianelli, Marco Del Tredici, Raquel Fernández
Publicado en: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Página(s) 3960-3973
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.365

Less Descriptive yet Discriminative: Quantifying the Properties of Multimodal Referring Utterances via CLIP

Autores: Ece Takmaz, Sandro Pezzelle, Raquel Fernández
Publicado en: Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, 2022, Página(s) 36-42
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2022.cmcl-1.4

What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability

Autores: Mario Giulianelli, Joris Baan, Wilker Aziz, Raquel Fernández, Barbara Plank
Publicado en: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Página(s) 14349-14371
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.887

Naming, Describing, and Quantifying Visual Objects in Humans and LLMs

Autores: Alberto Testoni, Juell Sprott, Sandro Pezzelle
Publicado en: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024
Editor: Association for Computational Linguistics

Construction coordination in first and second language acquisition

Autores: Arabella Sinclair, Raquel Fernández
Publicado en: Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue, 2021
Editor: SemDial

Generating Image Descriptions via Sequential Cross-Modal Alignment Guided by Human Gaze

Autores: Ece Takmaz, Sandro Pezzelle, Lisa Beinborn, Raquel Fernández
Publicado en: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Página(s) 4664-4677
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.377

Peer reviewed articles (8)

Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations

Autores: Arabella Sinclair, Jaap Jumelet, Willem Zuidema, Raquel Fernández
Publicado en: Transactions of the Association for Computational Linguistics, Edición 10, 2022, Página(s) 1031-1050, ISSN 2307-387X
Editor: MIT Press
DOI: 10.1162/tacl_a_00504

Linguistic issues behind visual question answering

Autores: Raffaella Bernardi, Sandro Pezzelle
Publicado en: Language and Linguistics Compass, 2021, ISSN 1749-818X
Editor: Blackwell
DOI: 10.1111/lnc3.12417

Alignment of code switching varies with proficiency in second language learning dialogue

Autores: Arabella J. Sinclair, Raquel Fernández
Publicado en: System, Edición 113, 2024, Página(s) 102952, ISSN 0346-251X
Editor: Pergamon Press Ltd.
DOI: 10.1016/j.system.2022.102952

The Efficiency of Question‐Asking Strategies in a Real‐World Visual Search Task

Autores: Alberto Testoni, Raffaella Bernardi, Azzurra Ruggeri
Publicado en: Cognitive Science, Edición 47, 2024, ISSN 0364-0213
Editor: Lawrence Erlbaum Associates Inc.
DOI: 10.1111/cogs.13396

Semantic Adaptation to the Interpretation of Gradable Adjectives via Active Linguistic Interaction

Autores: Sandro Pezzelle, Raquel Fernández
Publicado en: Cognitive Science, Edición 47, 2023, ISSN 0364-0213
Editor: Lawrence Erlbaum Associates Inc.
DOI: 10.1111/cogs.13248

A taxonomy and review of generalization research in NLP

Autores: Hupkes, Dieuwke; Giulianelli, Mario; Dankers, Verna; Artetxe, Mikel; Elazar, Yanai; Pimentel, Tiago; Christodoulopoulos, Christos; Lasri, Karim; Saphra, Naomi; Sinclair, Arabella; Ulmer, Dennis Thomas; Schottmann, Florian; Batsuren, Khuyagbaatar; Sun, Kaiser; Sinha, Koustouv; Khalatbari, Leila; Ryskina, Maria; Cotterell, Ryan; Jin, Zhijing
Publicado en: Nature Machine Intelligence, 2023, Página(s) 1161–1174, ISSN 2522-5839
Editor: Springer Nature

Beyond Perplexity: Examining Temporal Generalization in Large Language Models via Definition Generation

Autores: Iris Luden, Mario Giulianelli, Raquel Fernández
Publicado en: Computational Linguistics in the Netherlands Journal, 2024, ISSN 2211-4009
Editor: CLIN/OJS

Word Representation Learning in Multimodal Pre-Trained Transformers: An Intrinsic Evaluation

Autores: Sandro Pezzelle, Ece Takmaz, Raquel Fernández
Publicado en: Transactions of the Association for Computational Linguistics, 2021, ISSN 2307-387X
Editor: Association for Computational Linguistics
DOI: 10.1162/tacl_a_00443

Book chapters (1)

Grounded and Ungrounded Referring Expressions in Human Dialogues: Language Mirrors Different Grounding Conditions

Autores: Eleonora Gualdoni, Raffaella Bernardi, Raquel Fernández, Sandro Pezzelle
Publicado en: Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020, 2025, Página(s) 223-229
Editor: Accademia University Press
DOI: 10.4000/books.aaccademia.8600

Thesis and dissertations (2)

Neural models of language use

Autores: Giulianelli, M.
Publicado en: 2023
Editor: University of Amsterdam

Visual and linguistic processes in deep neural networks

Autores: Takmaz, E.K.
Publicado en: 2024
Editor: University of Amsterdam

Other (3)

Modelling Multimodal Integration in Human Concept Processing with Vision-Language Models.

Autores: Anna Bavaresco, Marianne Heer Kloots, Sandro Pezzelle, & Raquel Fernández
Publicado en: 2025
Editor: Arxiv

Incremental Alternative Sampling as a Lens into the Temporal and Representational Resolution of Linguistic Prediction.

Autores: Mario Giulianelli, Sarenne Wallbridge, Ryan Cotterell, & Raquel Fernández
Publicado en: 2025
Editor: PsyArXiv

RACQUET: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs.

Autores: Alberto Testoni, Barbara Plank, & Raquel Fernández
Publicado en: 2025
Editor: Arxiv