Distributed dynamic REpresentations for diAlogue Management

Informacje na temat projektu

DREAM

Identyfikator umowy o grant: 819455

DOI

10.3030/819455

Projekt został zamknięty

Data podpisania przez KE 12 Lutego 2019

Data rozpoczęcia 1 Września 2019

Data zakończenia 31 Maja 2025

Finansowanie w ramach

• EXCELLENT SCIENCE - European Research Council (ERC)

Koszt całkowity

€ 2 000 000,00

Wkład UE

€ 2 000 000,00

Koordynowany przez

UNIVERSITEIT VAN AMSTERDAM
Netherlands

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Open Research Data Pilot (1)

Data Management Plan

The Data Management Plan will specify: - what kind of data will be generated and collected, - where and how it will be stored, and - who will have access to it and under what licence.

Publikacje

Conference proceedings (34)

Linguistic and Gestural Coordination: Do Learners Converge in Collaborative Dialogue?

Autorzy: Arabella Sinclair, Bertrand Schneider
Opublikowane w: Proceedings of the 14th International Conference on Educational Data Mining, 2021, ISBN 978-1-7336736-2-4
Wydawca: EDM

Describing Images Fast and Slow: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes

Autorzy: Ece Takmaz, Sandro Pezzelle, Raquel Fernández
Opublikowane w: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), 2024
Wydawca: Association for Computational Linguistics

Detecting Age-Related Linguistic Patterns in Dialogue: Toward Adaptive Conversational Systems

Autorzy: Lennert Jansen, Arabella Sinclair, Margot J. Goot, Raquel Fernández, Sandro Pezzelle
Opublikowane w: Proceedings of the Eighth Italian Conference on Computational Linguistics, 2021
Wydawca: Italian Association for Computational Linguistics

Be Different to Be Better! A Benchmark to Leverage the Complementarity of Language and Vision

Autorzy: Sandro Pezzelle, Claudio Greco, Greta Gandolfi, Eleonora Gualdoni, Raffaella Bernardi
Opublikowane w: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Strona(/y) 2751-2767
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.248

Towards Pragmatic Production Strategies for Natural Language Generation Tasks

Autorzy: Mario Giulianelli
Opublikowane w: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2023, Strona(/y) 7978-7984
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.544

Stop Measuring Calibration When Humans Disagree

Autorzy: Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernandez
Opublikowane w: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2023, Strona(/y) 1892-1915
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.124

GROOViST: A Metric for Grounding Objects in Visual Storytelling

Autorzy: Aditya Surikuchi, Sandro Pezzelle, Raquel Fernández
Opublikowane w: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Strona(/y) 3331-3339
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.202

I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue

Autorzy: Esam Ghaleb, Bulat Khaertdinov, Asli Ozyurek, Raquel Fernández
Opublikowane w: Findings of the Association for Computational Linguistics: ACL 2025, 2025
Wydawca: Association for Computational Linguistics

Analysing Human Strategies of Information Transmission as a Function of Discourse Context

Autorzy: Mario Giulianelli, Raquel Fernández
Opublikowane w: Proceedings of the 25th Conference on Computational Natural Language Learning, 2021
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.50

Experiential Semantic Information and Brain Alignment: Are Multimodal Models Better than Language Models?

Autorzy: Anna Bavaresco, Raquel Fernández
Opublikowane w: Proceedings of the 29th Conference on Computational Natural Language Learning (CoNLL), 2025
Wydawca: Association for Computational Linguistics

Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change

Autorzy: Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova
Opublikowane w: Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change, 2022, Strona(/y) 54-67
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.lchange-1.6

Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue

Autorzy: Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella Sinclair
Opublikowane w: Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL), 2023, Strona(/y) 254-273
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.conll-1.18

LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Autorzy: Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, Andre Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Surikuchi, Ece Takmaz, Alberto Testoni
Opublikowane w: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2025
Wydawca: Association for Computational Linguistics

Grounded and Ungrounded Referring Expressions in Human Dialogues: Language Mirrors Different Grounding Conditions

Autorzy: Eleonora Gualdoni, Raffaella Bernardi, Sandro Pezzelle, Raquel Fernández
Opublikowane w: Proceedings of the 7th Italian Conference on Computational Linguistics, 2020
Wydawca: CEUR Workshop Proceedings

AnaLog: Testing Analytical and Deductive Logic Learnability in Language Models

Autorzy: Samuel Ryb, Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Opublikowane w: Proceedings of the 11th Joint Conference on Lexical and Computational Semantics, 2022, Strona(/y) 55-68
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.starsem-1.5

Analysing cross-speaker convergence through the lens of automatically detected shared linguistic constructions

Autorzy: Ghaleb, E.; Rasenberg, M.; Pouw, W.; Toni, I.; Holler, J.; Özyürek, A.; Fernandez, R.
Opublikowane w: Proceedings of the 46th Annual Meeting of the Cognitive Science Society (CogSci 2024), 2024
Wydawca: Cognitive Science Society

Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts

Autorzy: Ece Takmaz, Mario Giulianelli, Sandro Pezzelle, Arabella Sinclair, Raquel Fernández
Opublikowane w: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Strona(/y) 4350-4368
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.353

Is Information Density Uniform in Task-Oriented Dialogues?

Autorzy: Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Opublikowane w: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2021.emnlp-main.652

Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind

Autorzy: Ece Takmaz, Nicolo’ Brandizzi, Mario Giulianelli, Sandro Pezzelle, Raquel Fernandez
Opublikowane w: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Strona(/y) 4198-4217
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-acl.258

Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions

Autorzy: Ghaleb, Esam; Rasenberg, Marlou; Pouw, Wim; Toni, Ivan; Holler, Judith; Ozyurek, Asli; Fernandez, Raquel
Opublikowane w: Proceedings of the Annual Meeting of the Cognitive Science Society, 2024
Wydawca: Cognitive Science Society

Probing Cross-Modal Representations in Multi-Step Relational Reasoning

Autorzy: Iuliia Parfenova, Desmond Elliott, Raquel Fernández, Sandro Pezzelle
Opublikowane w: Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021), 2021
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2021.repl4nlp-1.16

Grammatical Profiling for Semantic Change Detection

Autorzy: Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova
Opublikowane w: 2021
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.33

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation

Autorzy: Esam Ghaleb, Bulat Khaertdinov, Marlou Rasenberg, Wim Pouw, Judith Holler, Aslı Özyürek, & Raquel Fernández
Opublikowane w: ICMI '24: Proceedings of the 26th International Conference on Multimodal Interaction, 2024
Wydawca: Association for Computing Machinery

Construction Coordination in First and Second Language Acquisition

Autorzy: Sinclair, A.J.; Fernández, R.
Opublikowane w: Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers, 2021
Wydawca: SEMDIAL

Don’t Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models

Autorzy: Anna Bavaresco, Alberto Testoni, Raquel Fernández
Opublikowane w: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024
Wydawca: Association for Computational Linguistics

Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions

Autorzy: Alberto Testoni, Raquel Fernández
Opublikowane w: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), 2024
Wydawca: Association for Computational Linguistics

Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis

Autorzy: Mario Giulianelli, Iris Luden, Raquel Fernandez, Andrey Kutuzov
Opublikowane w: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023, Strona(/y) 3130-3148
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-long.176

Construction Repetition Reduces Information Rate in Dialogue

Autorzy: Mario Giulianelli, Arabella Sinclair, Raquel Fernández
Opublikowane w: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2024, Strona(/y) 665-682
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.aacl-main.51

Controllable Text Generation for All Ages: Evaluating a Plug-and-Play Approach to Age-Adapted Dialogue

Autorzy: Lennert Jansen, Štěpán Lars Laichter, Arabella Sinclair, Margot van der Goot, Raquel Fernandez, Sandro Pezzelle
Opublikowane w: Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM), 2023, Strona(/y) 172-188
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2022.gem-1.14

Analysing Lexical Semantic Change with Contextualised Word Representations

Autorzy: Mario Giulianelli, Marco Del Tredici, Raquel Fernández
Opublikowane w: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Strona(/y) 3960-3973
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.365

What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability

Autorzy: Mario Giulianelli, Joris Baan, Wilker Aziz, Raquel Fernández, Barbara Plank
Opublikowane w: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Strona(/y) 14349-14371
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.887

Naming, Describing, and Quantifying Visual Objects in Humans and LLMs

Autorzy: Alberto Testoni, Juell Sprott, Sandro Pezzelle
Opublikowane w: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024
Wydawca: Association for Computational Linguistics

Construction coordination in first and second language acquisition

Autorzy: Arabella Sinclair, Raquel Fernández
Opublikowane w: Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue, 2021
Wydawca: SemDial

Generating Image Descriptions via Sequential Cross-Modal Alignment Guided by Human Gaze

Autorzy: Ece Takmaz, Sandro Pezzelle, Lisa Beinborn, Raquel Fernández
Opublikowane w: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Strona(/y) 4664-4677
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.377

Peer reviewed articles (8)

Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations

Autorzy: Arabella Sinclair, Jaap Jumelet, Willem Zuidema, Raquel Fernández
Opublikowane w: Transactions of the Association for Computational Linguistics, Numer 10, 2022, Strona(/y) 1031-1050, ISSN 2307-387X
Wydawca: MIT Press
DOI: 10.1162/tacl_a_00504

Linguistic issues behind visual question answering

Autorzy: Raffaella Bernardi, Sandro Pezzelle
Opublikowane w: Language and Linguistics Compass, 2021, ISSN 1749-818X
Wydawca: Blackwell
DOI: 10.1111/lnc3.12417

Alignment of code switching varies with proficiency in second language learning dialogue

Autorzy: Arabella J. Sinclair, Raquel Fernández
Opublikowane w: System, Numer 113, 2024, Strona(/y) 102952, ISSN 0346-251X
Wydawca: Pergamon Press Ltd.
DOI: 10.1016/j.system.2022.102952

The Efficiency of Question‐Asking Strategies in a Real‐World Visual Search Task

Autorzy: Alberto Testoni, Raffaella Bernardi, Azzurra Ruggeri
Opublikowane w: Cognitive Science, Numer 47, 2024, ISSN 0364-0213
Wydawca: Lawrence Erlbaum Associates Inc.
DOI: 10.1111/cogs.13396

Semantic Adaptation to the Interpretation of Gradable Adjectives via Active Linguistic Interaction

Autorzy: Sandro Pezzelle, Raquel Fernández
Opublikowane w: Cognitive Science, Numer 47, 2023, ISSN 0364-0213
Wydawca: Lawrence Erlbaum Associates Inc.
DOI: 10.1111/cogs.13248

A taxonomy and review of generalization research in NLP

Autorzy: Hupkes, Dieuwke; Giulianelli, Mario; Dankers, Verna; Artetxe, Mikel; Elazar, Yanai; Pimentel, Tiago; Christodoulopoulos, Christos; Lasri, Karim; Saphra, Naomi; Sinclair, Arabella; Ulmer, Dennis Thomas; Schottmann, Florian; Batsuren, Khuyagbaatar; Sun, Kaiser; Sinha, Koustouv; Khalatbari, Leila; Ryskina, Maria; Cotterell, Ryan; Jin, Zhijing
Opublikowane w: Nature Machine Intelligence, 2023, Strona(/y) 1161–1174, ISSN 2522-5839
Wydawca: Springer Nature

Beyond Perplexity: Examining Temporal Generalization in Large Language Models via Definition Generation

Autorzy: Iris Luden, Mario Giulianelli, Raquel Fernández
Opublikowane w: Computational Linguistics in the Netherlands Journal, 2024, ISSN 2211-4009
Wydawca: CLIN/OJS

Word Representation Learning in Multimodal Pre-Trained Transformers: An Intrinsic Evaluation

Autorzy: Sandro Pezzelle, Ece Takmaz, Raquel Fernández
Opublikowane w: Transactions of the Association for Computational Linguistics, 2021, ISSN 2307-387X
Wydawca: Association for Computational Linguistics
DOI: 10.1162/tacl_a_00443

Book chapters (1)

Grounded and Ungrounded Referring Expressions in Human Dialogues: Language Mirrors Different Grounding Conditions

Autorzy: Eleonora Gualdoni, Raffaella Bernardi, Raquel Fernández, Sandro Pezzelle
Opublikowane w: Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020, 2025, Strona(/y) 223-229
Wydawca: Accademia University Press
DOI: 10.4000/books.aaccademia.8600

Thesis and dissertations (2)

Neural models of language use

Autorzy: Giulianelli, M.
Opublikowane w: 2023
Wydawca: University of Amsterdam

Visual and linguistic processes in deep neural networks

Autorzy: Takmaz, E.K.
Opublikowane w: 2024
Wydawca: University of Amsterdam

Other (3)

Modelling Multimodal Integration in Human Concept Processing with Vision-Language Models.

Autorzy: Anna Bavaresco, Marianne Heer Kloots, Sandro Pezzelle, & Raquel Fernández
Opublikowane w: 2025
Wydawca: Arxiv

Incremental Alternative Sampling as a Lens into the Temporal and Representational Resolution of Linguistic Prediction.

Autorzy: Mario Giulianelli, Sarenne Wallbridge, Ryan Cotterell, & Raquel Fernández
Opublikowane w: 2025
Wydawca: PsyArXiv

RACQUET: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs.

Autorzy: Alberto Testoni, Barbara Plank, & Raquel Fernández
Opublikowane w: 2025
Wydawca: Arxiv