"1.- Adaptation of BSC profiling technology. During his appointment at Argonne National Laboratory (ANL), the candidate developed EVOP, an open source profiler based on the Valgrind instrumentation framework and a memory object distributor for this purpose. To overcome this tool’s large profiling overhead (which limited its practical use to analyse a few main loop iterations) and accuracy limitations (due to the use of a cache simulator), the fellow combined those techniques into BSC’s Extrae, based on sampling of hardware counters.
2.- Investigation on metrics. After extensive research including a variety of metrics, the current heterogeneous memory advisor (hmem_advisor) component of the developed ecosystem features is equipped with 3 different algorithms and 2 different metrics deemed appropriate in different use cases. Algorithms comprise a precise 0/1 knapsack, a greedy approach, and a top-% algorithm, whereas metrics include ""misses"" and ""latencies"". To adapt to the brand-new Persistent Memory technology, store information has been incorporated across all algorithms and metrics with respect to previous approaches based on the MCDRAM memory subsystem of the Intel KNL platform.
3.- Transparent runtime system. The FLEXMALLOC runtime allocator interposer has been developed in collaboration with Intel as part of the ECO-H-MEM framework. This piece of software intercepts allocation calls and places them in the most appropriate memory subsystem as deemed by the hmem_advisor component. The key of this component is its very low runtime overhead on linking allocation calls upon unmodified binaries with the output of the hmem_advisor from an offline analysis pass. This low overhead comes from a novel idea which is pending publication.
4.- Integration with Intel's software stack. The developed ecosystem is made of 4 pieces: BSC's Extrae profiling tool, BSC's hmem_advisor (derived from ANL's dmem_advisor), BSC's hmem_visualizer, and Intel's FLEXMALLOC (developed explicitly for the ECO-H-MEM framework). Intel's VTune may be used as a replacement for Extrae.
The main paper resulting from this project is about to be submitted for publication and Intel is deeply involved and showing strong interest on adopting the developments of the project. A PRACE Advanced Centre Training (PATC) course is already at its second edition at BSC, and the 1st edition of the HMEM workshop, co-organized by the fellow and Intel, will be co-located with ICS 2020, a top-tier conference. The fellow has given several talks in this topic, some of them sponsored by Intel. After the developed ecosystem undergoes final refinements, there is plan for a joint software release under Open Source license, which should happen in the next coming weeks. Follow-up and spin-off project proposals are already submitted for consideration."
