Adaptive Tokenization and Memory in Foundation Models for Efficient and Long-Horizon AI

Project Information

AToM-FM

Grant agreement ID: 101222956

DOI

10.3030/101222956

EC signature date 4 September 2025

Start date 1 November 2025

End date 31 October 2030

Funded under

• European Research Council (ERC)

Total cost

€ 1 499 453,00

EU contribution

€ 1 499 453,00

Coordinated by

THE UNIVERSITY OF EDINBURGH
United Kingdom

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Data Management Plan (1)

Data Management Plan

Release of data management plan

Publications

Conference proceedings (5)

Can Vision-Language Models Predict Future States? Bootstrapping World Models from Inverse Dynamics

Author(s): Yifu Qiu, Yftah Ziser, Anna Korhonen, Shay B. Cohen, Edoardo M. Ponti
Published in: Proceedings of the 65th Annual Meeting of the Association for Computational Linguistics, 2026
Publisher: Association for Computational Linguistics

Neurosymbolic Diffusion Models

Author(s): Emile van Krieken, Pasquale Minervini, Edoardo M. Ponti, Antonio Vergari
Published in: The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025
Publisher: Curran Associates

Universal Cross-Tokenizer Distillation via Approximate Likelihood Matching

Author(s): Benjamin Minixhofer, Ivan Vulić, Edoardo Ponti
Published in: The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025
Publisher: Curran Associates

The sparse frontier: Sparse attention trade-offs in Transformer LLMs

Author(s): Piotr Nawrot, Robert Li, Renjie Huang, Sebastian Ruder, Kelly Marchisio, Edoardo M. Ponti
Published in: Proceedings of the 65th Annual Meeting of the Association for Computational Linguistics, 2026
Publisher: Association for Computational Linguistics

Inference-Time Hyper-Scaling with KV Cache Compression

Author(s): Adrian Łańcucki ~Adrian_Łańcucki1 , Konrad Staniszewski, Piotr Nawrot, Edoardo M. Ponti
Published in: The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025
Publisher: Curran Associates