Objective
Worldwide data volumes are exploding and islands of storage remote from compute will not scale. We will demonstrate the first instance of intelligent data storage, uniting data processing and storage as two sides of the same rich computational model. This will enable sophisticated, intention-aware data processing to be integrated within a storage systems infrastructure, combined with the potential for Exabyte scale deployment in future generations of extreme scale HPC systems.
Enabling only the salient data to flow in and out of compute nodes, from a sea of devices spanning next generation solid state to low performance disc we enable a vision of a new model of highly efficient and effective HPC and Big Data demonstrated through the SAGE project.
Objectives
- Provide a next-generation multi-tiered object-based data storage system (hardware and enabling software) supporting future-generation multi-tier persistent storage media supporting integral computational capability, within a hierarchy.
- Significantly improve overall scientific output through advancements in systemic data access performance and drastically reduced data movements.
- Provides a roadmap of technologies supporting data access for both Exascale/Exabyte and High Performance Data Analytics.
- Provide programming models, access methods and support tools validating their usability, including ‘Big-Data’ access and analysis methods
- Co-Designing and validating on a smaller representative system with earth sciences, meteorology, clean energy, and physics communities
- Projecting suitability for extreme scaling through simulation based on evaluation results.
Call Alignment: We address storage data access with optimised systems for converged Big Data and HPC use, in a co-design process with scientific partners and applications from many domains. System effectiveness and power efficiency are dramatically improved through minimized data transfer, with extreme scaling and resilience.
Fields of science
Programme(s)
Call for proposal
H2020-FETHPC-2014
See other projects for this call
Funding Scheme
RIA - Research and Innovation action
Coordinator
PO9 1SA Havant
United Kingdom
See on map
Participants (10)
Participation ended
CV34 6UW Warwick
See on map
78340 Les Clayes Sous Bois
See on map
OX14 3DB Abingdon
See on map
75015 Paris 15
See on map
67663 Kaiserslautern
See on map
0X11 0DE Didcot
See on map
52428 Julich
See on map
100 44 Stockholm
See on map
SN2 1FL Swindon
See on map
CB1 9NJ Cambridge
See on map