Six European HPC application teams participated in DEEP-EST providing a total of 15 codes:
• NMBU: Neuroscience: NEST, Arbor, Elephant
• NCSA: Molecular dynamics: GROMACS
• Astron: Radio astronomy: (FPGA and GPU) Imager, GPU Correlator
• KULeuven: Space weather: xPic, GMM, DLMOS
• UoI: Data analytics in Earth science: NextDBSCANN, NextSVM, deep learning frameworks
• CERN: High energy physics: CMS Reconstruction, CMS classification
These applications contributed to DEEP-EST both through co-design and validation of the HW and SW developed in the project, and are now themselves in a much better position to exploit the performance provided by Exascale modular/heterogeneous supercomputers. With these codes and synthetic benchmarks, the DEEP-EST prototype has been modelled and regularly benchmarked to evaluate and measure its performance, scheduling, scaling characteristics, and energy efficiency.
The DEEP-EST HW prototype consists of three compute modules: Cluster Module (CM), Extreme Scale Booster (ESB) and Data Analytics Module (DAM). These are complemented by two service modules: Scalable Storage Service Module (SSSM), and AllFlash Storage Module (AFSM). The construction of the DEEP-EST prototype, and its ESB module in particular, involved a number of technology innovations. The DEEP-EST prototype has become a leading-edge system with production quality features, when considering its size, performance, power efficiency, and overall quality. In fact, it is operated and used for project partners and external users as a production system.
The lower layers of the DEEP-EST SW-stack (e.g. network bridging or ressource management) have been adapted to provide best support for the underlying HW, while hiding these modifications from the end user. The DCDB and Wintermute frameworks from BADW-LRZ make the collection of a wide variety of system-monitoring information accessible to users and operators through Grafana. The programming environment abstracts the MSA HW complexity behind the interfaces and parallel programming paradigms that have become de-facto standard in HPC: MPI and OpenMP, in the specific implementations ParaStation MPI and OmpSs-2. MPI and OpenMP are complemented by parallel programming tools for acceleration devices, and frameworks for machine learning and deep learning applications. Resiliency and IO functionality has been implemented in the FTI library, and BeeGFS and SIONlib, respectively.
Exploitation: The DEEP-EST consortium has advanced the development of key European technologies, which can now be exploited by the respective partners:
• Megware: energy efficient integration, amplified portfolio with new accelerated node designs.
• EXTOLL, by its Fabri³ integrated fabric switch, can acquire strategic customers to realize its next-gen network chip. The network attached technologies NAM and GCE will be exploited as Fabri³-attached or as standalone products.
• ParTec: brings the new features into future versions of ParaStation Modulo, for which ParTec offers commercial support.
• FHG-ITWM with its spin-off ThinkParQ offer commercial support for BeeGFS and its new features.
• BSC: improved OmpSs-2 (promoting them in the OpenMP standardization committee) plus Extrae/Paraver/Dimemas performance analysis and modelling tools, and scheduling models.
• BADW-LRZ: system monitoring tool DBDC used on ts Tier-0 and Tier-1 systems.
• JUELICH: Open Source JUBE benchmarking environment and SIONlib I/O concentrator library.
• Application developers (NMBU, KU Leuven, Astron, UoI, CERN, and NCSA) exploit their improved codes to advance science in their respective research fields.
Dissemination: Scientific results have been published in 42 open access articles and events, including several training events. The website is the main hub of project content, and social media channels (Twitter, LinkedIn, Facebook) have increased attention to the project events and materials. Recently a new Podcast channel on SoundCloud has been added. DEEP EST supports in particular initiatives that foster diversity in HPC. An Early Access Program opened the DEEP-EST prototype and its SW to the wider HPC community. The DEEP-EST dissemination and communication strategy will continue in the soon starting DEEP-SEA project.
