Project description DEENESFRITPL Advanced memory system could bring exascale computing closer to reality The EU-funded IO-SEA project plans to provide a novel data management and storage platform for exascale computing based on object stores, hierarchical storage management and on-demand provisioning of storage services. The platform will efficiently make use of storage tiers, including non-volatile memory express (NVMe) and non-volatile random-access memory (NVRAM), all the way down to tape-based technologies. Use of ephemeral data nodes and data accessors should allow users to flexibly operate the system using various well-known data access paradigms. These ephemeral resources will eliminate the problem of treating storage resources and system components as static. The newly developed data management methods could be applied to data-intensive applications over exascale platforms. Show the project objective Hide the project objective Objective IO-SEA aims to provide a novel data management and storage platform for exascale computing based on hierarchical storage management (HSM) and on-demand provisioning of storage services. The platform will efficiently make use of storage tiers spanning NVMe and NVRAM at the top all the way down to tape-based technologies. System requirements are driven by data intensive use-cases, in a very strict co-design approach. The concept of ephemeral data nodes and data accessors is introduced that allow users to flexibly operate the system, using various well-known data access paradigms, such as POSIX namespaces, S3/Swift Interfaces, MPI-IO and other data formats and protocols. These ephemeral resources eliminate the problem of treating storage resources as static and unchanging system components – which is not a tenable proposition for data intensive exascale environments. The methods and techniques are applicable to exascale class data intensive applications and workflows that need to be deployed in highly heterogeneous computing environments.Critical aspects of intelligent data placement are considered for extreme volumes of data. This ensures that the right resources among the storage tiers are used and accessed by data nodes as close as possible to compute nodes – optimising performance, cost, and energy at extreme scale. Advanced IO instrumentation and monitoring features will be developed to that effect leveraging the latest advancements in AI and machine learning to systematically analyse the telemetry records to make smart decisions on data placement. These ideas coupled with in-storage-computation remove unnecessary data movements within the system.The IO-SEA project (EuroHPC-2019-1 topic b) has connections to the DEEP-SEA (topic d) and RED-SEA (topic c) project. It leverages technologies developed by the SAGE, SAGE2 and NextGEN-IO projects, and strengthens the TLR of the developed products and technologies. Fields of science engineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringcomputer hardwaresupercomputers Keywords Data Processing exascale HPC Object Store Hierarchical Storage Management HSM Data Placement performance optimization energy efficiency optimization Programme(s) H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT) Main Programme H2020-EU.2.1.1.2. - Next generation computing: Advanced and secure computing systems and technologies, including cloud computing Topic(s) EuroHPC-01-2019 - Extreme scale computing and data driven technologies Call for proposal H2020-JTI-EuroHPC-2019-1 See other projects for this call Funding Scheme RIA - Research and Innovation action Coordinator COMMISSARIAT A L ENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES Net EU contribution € 683 381,25 Address Rue leblanc 25 75015 Paris France See on map Region Ile-de-France Ile-de-France Paris Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 683 381,25 Participants (10) Sort alphabetically Sort by Net EU contribution Expand all Collapse all BULL SAS France Net EU contribution € 768 006,25 Address Rue jean jaures 68 78340 Les clayes sous bois See on map Region Ile-de-France Ile-de-France Yvelines Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 768 006,25 FORSCHUNGSZENTRUM JULICH GMBH Germany Net EU contribution € 553 815,00 Address Wilhelm johnen strasse 52428 Julich See on map Region Nordrhein-Westfalen Köln Düren Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 553 815,00 Third-party Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure. PARTEC AG Germany Net EU contribution € 201 967,50 Address Possartstr 20 81679 Munchen See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Bayern Oberbayern München, Kreisfreie Stadt Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 201 967,50 EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS United Kingdom Net EU contribution € 420 156,25 Address Shinfield park RG2 9AX Reading See on map Region South East (England) Berkshire, Buckinghamshire and Oxfordshire Berkshire Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 420 156,25 SEAGATE SYSTEMS UK LIMITED United Kingdom Net EU contribution € 521 875,00 Address Langstone road PO9 1SA Havant See on map Region South East (England) Hampshire and Isle of Wight South Hampshire Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 521 875,00 NATIONAL UNIVERSITY OF IRELAND GALWAY Ireland Net EU contribution € 171 625,00 Address University road H91 Galway See on map Region Ireland Northern and Western West Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 171 625,00 VSB - TECHNICAL UNIVERSITY OF OSTRAVA Czechia Net EU contribution € 216 875,00 Address 17 listopadu 2172/15 708 00 Ostrava poruba See on map Region Česko Moravskoslezsko Moravskoslezský kraj Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 216 875,00 KUNGLIGA TEKNISKA HOEGSKOLAN Sweden Net EU contribution € 164 605,00 Address Brinellvagen 8 100 44 Stockholm See on map Region Östra Sverige Stockholm Stockholms län Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 164 605,00 Masarykova univerzita Czechia Net EU contribution € 64 375,00 Address Zerotinovo namesti 9 601 77 Brno See on map Region Česko Jihovýchod Jihomoravský kraj Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 64 375,00 JOHANNES GUTENBERG-UNIVERSITAT MAINZ Germany Net EU contribution € 231 295,00 Address Saarstrasse 21 55122 Mainz See on map Region Rheinland-Pfalz Rheinhessen-Pfalz Mainz, Kreisfreie Stadt Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 231 295,00