Federated foundational models for embodied perception

Información del proyecto

FRONTIER

Identificador del acuerdo de subvención: 101097822

DOI

10.3030/101097822

Fecha de la firma de la CE 11 Mayo 2023

Fecha de inicio 1 Enero 2024

Fecha de finalización 31 Diciembre 2028

Financiado con arreglo a

• European Research Council (ERC)

Coste total

€ 2 499 825,00

Aportación de la UE

€ 2 499 825,00

Coordinado por

CESKE VYSOKE UCENI TECHNICKE V PRAZE
Czechia

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Publicaciones

Peer reviewed articles (6)

GJK++: Leveraging Acceleration Methods for Faster Collision Detection

Autores: Louis Montaut, Quentin Le Lidec, Vladimir Petrik, Josef Sivic, Justin Carpentier
Publicado en: IEEE Transactions on Robotics, Edición 40, 2024, ISSN 1552-3098
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TRO.2024.3386370

Temporally Consistent Object 6D Pose Estimation for Robot Control

Autores: Kateryna Zorina, Vojtech Priban, Mederic Fourmy, Josef Sivic, Vladimir Petrik
Publicado en: IEEE Robotics and Automation Letters, Edición 10, 2025, ISSN 2377-3766
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2024.3502052

CoVAMPnet: Comparative Markov State Analysis for Studying Effects of Drug Candidates on Disordered Biomolecules

Autores: Sérgio M. Marques; Petr Kouba; Anthony Legrand; Jiri Sedlar; Lucas Disson; Joan Planas-Iglesias; Zainab Sanusi; Antonin Kunka; Jiri Damborsky; Tomas Pajdla; Zbynek Prokop; Stanislav Mazurenko; Josef Sivic; David Bednar
Publicado en: JACS Au, Edición 4, 2024, ISSN 2691-3704
Editor: American Chemical Society (ACS Publications)
DOI: 10.1101/2023.01.06.523007

Self-supervised learning of molecular representations from millions of tandem mass spectra using DreaMS

Autores: Roman Bushuiev; Anton Bushuiev; Raman Samusevich; Corinna Brungs; Josef Sivic; Tomáš Pluskal
Publicado en: Nature Biotechnology, Edición 44, 2026, ISSN 1546-1696
Editor: Springer Nature
DOI: 10.26434/CHEMRXIV-2023-KSS3R-V4

Multi-Task Learning of Object States and State-Modifying Actions From Web Videos

Autores: Tomáš Souček, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev, Josef Sivic
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 46, 2024, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.48550/ARXIV.2211.13500

FocalPose++: Focal Length and Object Pose Estimation via Render and Compare

Autores: Martin Cífka, Georgy Ponimatkin, Yann Labbé, Bryan Russell, Mathieu Aubry, Vladimir Petrik, Josef Sivic
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 47, 2025, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.48550/ARXIV.2312.02985

Conference proceedings (12)

One Protein Is All You Need

Autores: Anton Bushuiev, Roman Bushuiev, Olga Pimenova, Nikola Zadorozhny, Raman Samusevich, Elisabet Manaskova, Rachel Seongeun Kim, Hannes Stärk, Jiri Sedlar, Martin Steinegger, Tomáš Pluskal, Josef Sivic
Publicado en: International Conference on Learning Representations (ICLR), 2026
Editor: OpenReview / ICLR Foundation
DOI: 10.48550/ARXIV.2411.02109

Learning to Engineer Protein Flexibility

Autores: Petr Kouba, Joan Planas-Iglesias, Jiri Damborsky, Jiri Sedlar, Stanislav Mazurenko, Josef Sivic
Publicado en: International Conference on Learning Representations (ICLR), 2025
Editor: OpenReview / ICLR Foundation
DOI: 10.48550/ARXIV.2412.18275

AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment

Autores: Anna Šárová Mikeštíková, Mederic Fourmy, Martin Cífka, Josef Sivic, Vladimír Petrík
Publicado en: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR, 2026
Editor: IEEE / Computer Vision Foundation
DOI: 10.48550/ARXIV.2512.20538

Learning to Design Protein–Protein Interactions with Enhanced Generalization

Autores: Anton Bushuiev, Roman Bushuiev, Petr Kouba, Anatolii Filkin, Marketa Gabrielova, Michal Gabriel, Jiri Sedlar, Tomas Pluskal, Jiri Damborsky, Stanislav Mazurenko, Josef Sivic
Publicado en: International Conference on Learning Representations (ICLR), 2024
Editor: OpenReview / ICLR Foundation
DOI: 10.48550/ARXIV.2310.18515

GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos

Autores: Tomáš Souček, Dima Damen, Michael Wray, Ivan Laptev, Josef Sivic
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Editor: IEEE
DOI: 10.48550/ARXIV.2312.07322

MassSpecGym: A benchmark for the discovery and identification of molecules

Autores: Bushuiev, Roman; Bushuiev, Anton; de Jonge, Niek F.; Young, Adamo; Kretschmer, Fleming; Samusevich, Raman; Heirman, Janne; Wang, Fei; Zhang, Luke; Dührkop, Kai; Ludwig, Marcus; Haupt, Nils A.; Kalia, Apurva; Brungs, Corinna; Schmid, Robin; Greiner, Russell; Wang, Bo; Wishart, David S.; Liu, Li Ping; Rousu, Juho; Bittremieux, Wout; Rost, Hannes; Mak, Tytus D.; Hassoun, Soha; Huber, Florian; van der Hooft, Justin J.J.; Stravs, Michael A.; Böcker, Sebastian; Sivic, Josef; Pluskal, Tomáš
Publicado en: Conference on Neural Information Processing Systems (NeurIPS), Datasets & Benchmarks Track, 2024
Editor: Neural Information Processing Systems Foundation, Inc. (NeurIPS)
DOI: 10.48550/ARXIV.2410.23326

Generalization Beyond Benchmarks: Evaluating Learnable Protein–Ligand Scoring Functions on Unseen Targets

Autores: Jakub Kopko, David Graber, Saltuk Mustafa Eyrilmez, Stanislav Mazurenko, David Bednar, Jiri Sedlar, Josef Sivic
Publicado en: AI for Scientific Discovery Workshop, NeurIPS, 2025
Editor: arXiv (Cornell University)
DOI: 10.48550/ARXIV.2512.05386

De Novo Generation of Functional Terpene Synthases Using TpsGP

Autores: Hamsini Ramanathan, Roman Bushuiev, Matouš Soldát, Jiří Kohout, Téo Hebra, Joshua David Smith, Josef Sivic, Tomáš Pluskal
Publicado en: NeurIPS 2025 AI for Science Workshop and Machine Learning for Structural Biology (MLSB) Workshop 2025, 2025
Editor: OpenReview / NeurIPS workshops
DOI: 10.48550/ARXIV.2512.08772

Large-scale Pre-training for Grounded Video Caption Generation

Autores: Evangelos Kazakos, Cordelia Schmid, Josef Sivic
Publicado en: IEEE/CVF International Conference on Computer Vision (ICCV), 2025
Editor: IEEE / Computer Vision Foundatio
DOI: 10.48550/ARXIV.2503.10781

ShowHowTo: Generating Scene-Conditioned Step-by-Step Visual Instructions

Autores: Tomás Soucek; Prajwal Gatti; Michael Wray; Ivan Laptev; Dima Damen; Josef Sivic
Publicado en: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025
DOI: 10.48550/ARXIV.2412.01987

Revealing data leakage in protein interaction benchmarks

Autores: Anton Bushuiev; Roman Bushuiev; Jirí Sedlár; Tomás Pluskal; Jirí Damborský; Stanislav Mazurenko; Josef Sivic
Publicado en: GEM Workshop at International Conference on Learning Representations (ICLR), 2024
Editor: OpenReview / ICLR Foundation
DOI: 10.48550/ARXIV.2404.10457

6D Object Pose Tracking in Internet Videos for Robotic Manipulation

Autores: Georgy Ponimatkin, Martin Cífka, Tomáš Souček, Mederic Fourmy, Yann Labbé, Vladimír Petrík, Josef Sivic
Publicado en: International Conference on Learning Representations (ICLR), 2025
Editor: OpenReview / ICLR Foundation
DOI: 10.48550/ARXIV.2503.10307