All pilots workflows are integrated on the ACROSS software stack, the functional and technical Objectives are completed specifically
Foundation and co-design of energy efficient and HPC/BD/AI cross-stack platform: finak version of ACROSS software stack ha been delivered and validate including the the workflows deployment
Validation of ACROSS platform through industrial applications and fostering societal applications adoption: Validation was performed including KPI analysis
Ensuring ACROSS platform interoperability, adaptability and security: The final version of the ACROSS software stack (we remark again here that, the ACROSS platform refers to the instantiation of the software stack on a given infrastructure, considering all the constraints brought by the specific infrastructure -e.g. the inability to install certain components, the specific management policies for computing resources, etc.) have been demonstrated
AERONAUTICS: the two Aeronautics use-cases have been fully developed according to the plan with good results achieving the goals fixed at the beginning of the ACROSS project.
WEATHER AND CLIMATE: Enhancing global numerical weather prediction by means of hardware acceleration, low-latency exploitation of climate simulations, and enabling HPDA on large datasets has been reached
ENERGY AND CARBON SEQUESTRATION: we have achieved further improvements in the areas of performance, I/O and scalability to reach the project goal, as indicated by the KPI-3.1 and KPI-3.2. Furthermore, substantial advances in GPU acceleration have been made beyond the project goals.
Co-designing HW/SW integration in strict collaboration with pilots, for creating exascale-ready services and ensuring compliance with the future EPI initiative: the activities targeting the exploitation of hardware acceleration technologies and the tight integration of all the software components (from the higher-level of the orchestration stack to the low-level, domain specific libraries and frameworks, to the libraries and tools enabling the use of hardware accelerators) have been carried out
Building a platform supporting the execution of large-scale HPC simulations along with exploitation of Big Data and deep learning techniques and with seamless exploitation of hardware heterogeneity: he ACROSS software stack has been implemented. This activity was complemented by the co-design and development of an advanced execution infrastructure (HPC cluster) incorporating a wide range of computing and acceleration technologies (including FPGAs and GPUs), along with their respective software libraries and frameworks
Efficient execution of mixed HPC/BD/DL workflows through hardware accelerators, productivity maximization using ad-hoc low-level libraries, and improving overall energy efficiency: The high degree of modularity given by the co-designed ACROSS software stack makes possible its instantiation on different computing infrastructures, without compromising resource management policies that are put in place by system administrators of the infrastructures
Optimizing workflow execution through the development of improved orchestration and workflow management strategies: the development and integration of the key orchestration components reached a maturity milestone, which allowed to enable the deterministic execution of workflows and the (fine-grain) efficient exploitation of the node compute resources
Enhancing HPC performance for data stream processing, using in-situ/in-transit techniques, in support of extreme-scale applications: The in-situ post-processing introduced in global-scale NWP has been successfully demonstrated as part of WP6 activities. The technology has been adopted in other large-scale projects (i.e. Destination Earth) and is currently assessed for inclusion in operational forecasts.
Publications in journals, conferences, and workshops; 29 accepted (1 edited-book, 1 book chapter, 9 journal papers, 6 conference papers, 5 posters, 1 PhD Thesis & 6 Workshops), 8 under review and two for submission.
A comprehensive list of pilots’ objectives and related KPIs has been evaluated and achieved.
outcomes of the validation path for the different pilots’ achievements, related to Software and adopted methodologies, were finally achieved.
