Objective
For improving the capabilities of general-purpose AI models and for extending their applicability to domains where the temporal dimension – among several others – is of importance, we will target the development of the next generation of Multimodal Space-Time Foundation Models (MSTFMs). These will combine spatio-temporal understanding, which is important even for modalities such as the visual one that have already been introduced in large generative models, with the effective management of new time-relevant modalities that are yet to be supported in foundation models, such as industrial time series data, remote sensing data and health-related measurements. Real and synthetic data, to mitigate data scarcity, will be leveraged for training general-purpose MSTFMs and for further adapting them for specific downstream tasks. Real data used for training will include data directly provided by members of the consortium as well as data from relevant European Data Spaces, while complementary synthetic data will be generated by exploiting existing generative AI capabilities as well as new ones developed in the project. European HPC infrastructure is directly included in the consortium to ensure the availability of the necessary computing resources.
Programme(s)
Funding Scheme
HORIZON-RIA - HORIZON Research and Innovation ActionsCoordinator
57001 Thermi Thessaloniki
Greece
See on map
Participants (29)
72074 Tuebingen
See on map
52428 Julich
See on map
1012WX Amsterdam
See on map
5612 AE Eindhoven
See on map
38122 Trento
See on map
08193 Cerdanyola del Valles
See on map
1000 Ljubljana
See on map
3720 232 Oliveira De Azemeis
See on map
The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.
08034 Barcelona
See on map
02101 Espoo
See on map
40033 Casalecchio Di Reno Bo
See on map
80539 MUNCHEN
See on map
46010 Valencia
See on map
41121 Modena
See on map
02150 Espoo
See on map
03690 San Vicente Del Raspeig/San Vicent
See on map
720 76 TUBINGEN
See on map
160 00 Praha
See on map
66123 Saarbrucken
See on map
3000 Leuven
See on map
94160 SAINT-MANDE
See on map
The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.
94000 CRETEIL
See on map
150 00 PRAHA
See on map
The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.
08005 BARCELONA
See on map
The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.
13500 PUERTOLLANO
See on map
Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure.
OX11 0RL HARWELL OXFORD OXFORDSHIRE
See on map
Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure.
28760 Tres Cantos (Madrid)
See on map
08029 Barcelona
See on map
1043 Bruxelles / Brussel
See on map
Partners (2)
Partner organisations contribute to the implementation of the action, but do not sign the Grant Agreement.
1015 Lausanne
See on map
Partner organisations contribute to the implementation of the action, but do not sign the Grant Agreement.
8092 Zuerich
See on map