Objective
Worldwide data volumes are exploding and islands of storage remote from compute will not scale. We will demonstrate the first instance of intelligent data storage, uniting data processing and storage as two sides of the same rich computational model. This will enable sophisticated, intention-aware data processing to be integrated within a storage systems infrastructure, combined with the potential for Exabyte scale deployment in future generations of extreme scale HPC systems.
Enabling only the salient data to flow in and out of compute nodes, from a sea of devices spanning next generation solid state to low performance disc we enable a vision of a new model of highly efficient and effective HPC and Big Data demonstrated through the SAGE project.
Objectives
- Provide a next-generation multi-tiered object-based data storage system (hardware and enabling software) supporting future-generation multi-tier persistent storage media supporting integral computational capability, within a hierarchy.
- Significantly improve overall scientific output through advancements in systemic data access performance and drastically reduced data movements.
- Provides a roadmap of technologies supporting data access for both Exascale/Exabyte and High Performance Data Analytics.
- Provide programming models, access methods and support tools validating their usability, including ‘Big-Data’ access and analysis methods
- Co-Designing and validating on a smaller representative system with earth sciences, meteorology, clean energy, and physics communities
- Projecting suitability for extreme scaling through simulation based on evaluation results.
Call Alignment: We address storage data access with optimised systems for converged Big Data and HPC use, in a co-design process with scientific partners and applications from many domains. System effectiveness and power efficiency are dramatically improved through minimized data transfer, with extreme scaling and resilience.
Fields of science
- natural sciencescomputer and information sciencesdata sciencedata analysis
- natural sciencesearth and related environmental sciences
- natural sciencescomputer and information sciencesdata sciencedata processing
- engineering and technologyenvironmental engineeringenergy and fuelsrenewable energy
- natural sciencescomputer and information sciencesdata sciencebig data
Programme(s)
Call for proposal
H2020-FETHPC-2014
See other projects for this call
Funding Scheme
RIA - Research and Innovation actionCoordinator
PO9 1SA Havant
United Kingdom
Participants (10)
Participation ended
CV34 6UW Warwick
78340 Les Clayes Sous Bois
OX14 3DB Abingdon
75015 Paris 15
67663 Kaiserslautern
0X11 0DE Didcot
52428 Julich
100 44 Stockholm
SN2 1FL Swindon
CB1 9NJ Cambridge