Autonomous Linguistic Emergence in neural Networks

Informacje na temat projektu

ALiEN

Identyfikator umowy o grant: 101019291

DOI

10.3030/101019291

Data podpisania przez KE 26 Maja 2021

Data rozpoczęcia 1 Stycznia 2022

Data zakończenia 31 Grudnia 2026

Finansowanie w ramach

• EXCELLENT SCIENCE - European Research Council (ERC)

Koszt całkowity

€ 2 489 541,00

Wkład UE

€ 2 489 541,00

Koordynowany przez

UNIVERSIDAD POMPEU FABRA
Spain

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Publikacje

Conference proceedings (19)

The emergence of numerical representations in communicating artificial agents

Autorzy: Daniela Mihai, Lucas Weber, Francesca Franzon
Opublikowane w: Proceedings of Evolang XVI, 2026, Strona(/y) 308-315
Wydawca: The Evolution of Language Conferences

Cross-domain image captioning with discriminative finetuning.

Autorzy: R. Dessì, M. Bevilacqua, E. Gualdoni, N. Rakotonirina, F. Franzon, M. Baroni
Opublikowane w: Proceedings of CVPR 2023 (IEEE/CVF Conference on Computer Vision and Pattern Recognition), 2023, Strona(/y) 6935-6944
Wydawca: Computer Vision Foundation

Towards hate speech detection in low-resource languages: Comparing ASR to acoustic word embeddings on Wolof and Swahili

Autorzy: Jacobs, C., Rakotonirina, N.C., Chimoto, E.A., Bassett, B.A., Kamper, H.
Opublikowane w: Proc. INTERSPEECH 2023, 2023
Wydawca: ISCA
DOI: 10.21437/interspeech.2023-421

On the Correspondence between Compositionality and Imitation in Emergent Neural Communication

Autorzy: E. Cheng, M. Rita, T. Poibeau
Opublikowane w: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Strona(/y) 12432–12447
Wydawca: ACL

Referential communication in heterogeneous communities of pre-trained visual deep networks.

Autorzy: M. Mahaut, F. Franzon, R. Dessì, M. Baroni
Opublikowane w: Proc. of the 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023), 2023, Strona(/y) 2619-2621
Wydawca: International Foundation for Autonomous Agents and Multiagent Systems

Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models

Autorzy: Iuri Macocco, Nora Graichen, Gemma Boleda, Marco Baroni
Opublikowane w: Proceedings of the 8th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, 2025, Strona(/y) 109-136
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2025.blackboxnlp-1.6

Geometric Signatures of Compositionality Across a Language Model’s Lifetime

Autorzy: Jin Hwa Lee, Thomas Jiralerspong, Lei Yu, Yoshua Bengio, Emily Cheng
Opublikowane w: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025, Strona(/y) 5292-5320
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2025.acl-long.265

Communication breakdown: On the low mutual intelligibility between human and neural captioning

Autorzy: R. Dessì, E. Gualdoni, F. Franzon, G. Boleda, M. Baroni
Opublikowane w: Proceedings of EMNLP 2022 (Conference on Empirical Methods in Natural Language Processing), 2022, Strona(/y) 7998-8007
Wydawca: ACL

Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators

Autorzy: Matéo Mahaut, Laura Aina, Paula Czarnowska, Momchil Hardalov, Thomas Müller, Lluis Marquez
Opublikowane w: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024, Strona(/y) 4554-4570
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.250

Evil twins are not that evil: Qualitative insights into machine-generated prompts

Autorzy: Nathanaël Carraz Rakotonirina, Corentin Kervadec, Francesca Franzon, Marco Baroni
Opublikowane w: Proceedings of the 8th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, 2025, Strona(/y) 48-68
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2025.blackboxnlp-1.3

Bridging information-theoretic and geometric compression in language models

Autorzy: Cheng, Emily; Kervadec, Corentin; Baroni, Marco
Opublikowane w: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023
Wydawca: Association for Computational Linguistics

MemoryPrompt: A light wrapper to improve context tracking in pre-trained language models

Autorzy: Rakotonirina, Nathanael; Baroni, Marco
Opublikowane w: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), 2024
Wydawca: Association for Computational Linguistics

Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Models

Autorzy: Richard Antonello, Emily Cheng
Opublikowane w: Proceedings of UniReps@NeurIPS 2024, 2024
Wydawca: OpenReview/Online

Prediction Hubs are Context-Informed Frequent Tokens in LLMs

Autorzy: Beatrix Miranda Ginn Nielsen, Iuri Macocco, Marco Baroni
Opublikowane w: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025, Strona(/y) 23715-23745
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2025.acl-long.1156

Unnatural language processing: How do language models handle machine-generated prompts?

Autorzy: Kervadec, Corentin; Franzon, Francesca; Baroni, Marco
Opublikowane w: Findings of EMNLP, 2023
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-emnlp.959

From Tools to Teammates: Evaluating LLMs in Multi-Session Coding Interactions

Autorzy: Nathanaël Carraz Rakotonirina, Mohammed Hamdy, Jon Ander Campos, Lucas Weber, Alberto Testoni, Marzieh Fadaee, Sandro Pezzelle, Marco Del Tredici
Opublikowane w: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025, Strona(/y) 19609-19642
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2025.acl-long.964

Correct, Concise and Complete: Multi-stage Training For Adaptive Reasoning

Autorzy: Nathanaël Carraz Rakotonirina, Ren Pang, Neha Anna John, Michael Bohlke-Schneider, Momchil Hardalov
Opublikowane w: Findings of the Association for Computational Linguistics: ACL 2026, 2026, Strona(/y) 12798-12810
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2026.findings-acl.622

Can discrete information extraction prompts generalize across language models?

Autorzy: N. Rakotonirina, R. Dessì, F. Petroni, S. Riedel, M. Baroni
Opublikowane w: Proceedings of ICLR 2023 (International Conference on Learning Representations), 2023
Wydawca: ICLR

Emergence of a high-dimensional abstraction phase in language transformers

Autorzy: Emily Cheng, Diego Doimo, Corentin Kervadec, Iuri Macocco, Jade Yu, Alessandro Laio and Marco Baroni
Opublikowane w: Proceedings of ICLR 2025, 2025
Wydawca: ICLR

Peer reviewed articles (2)

LiSeCo: Linear Semantic Control for Language Generation

Autorzy: Emily Cheng, Carmen Amo Alonso
Opublikowane w: Transactions of Machine Learning Research, 2026, ISSN 2835-8856
Wydawca: Journal of Machine Learning Research Inc

Referential communication in heterogeneous communities of pre-trained visual deep networks

Autorzy: Mateo Mahaut, Francesca Franzon, Roberto Dessi, Marco Baroni
Opublikowane w: Transactions on Machine Learning Research, 2025, ISSN 2835-8856
Wydawca: Journal of Machine Learning Research Inc