CORDIS
EU research results

CORDIS

English EN
Exploiting big data and machine learning techniques for LHC experiments

Exploiting big data and machine learning techniques for LHC experiments

Objective

Large international scientific collaborations will face in the near future unprecedented computing and data challenges. The analysis of multi-PetaByte datasets at CMS, ATLAS, LHCb and Alice, the four experiments at the Large Hadron Collider (LHC), requires a global federated infrastructure of distributed computing resources. The HL-LHC, the High Luminosity upgrade of the LHC, is expected to deliver 100 times more data than the LHC, with corresponding increase of event sizes, volumes and complexity. Modern techniques for big data analytics and machine learning (ML) are needed to cope with such unprecedented data stream. Critical areas that will strongly benefit from ML are data analysis, detector operation including calibration and monitoring, and computing operations. Aim of this project is to provide the LHC community with the necessary tools to deploy ML solutions through the use of open cloud technologies such as the INDIGO-DataCloud services. Heterogeneous technologies (systems based on multi-cores, GPUs, ...) and opportunistic resources will be integrated. The developed tools will be experiment-independent to promote the exchange of common solutions among the various LHC experiments. The benefits of such an approach will be demonstrated in a real world use case, the optimization of the computing operations for the CMS experiment. In addition, once available, the tools to deploy ML as a service can be easily transferred to other scientific domains that have the need to treat large data streams.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

ISTITUTO NAZIONALE DI FISICA NUCLEARE

Address

Via Enrico Fermi 40
00044 Frascati

Italy

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 180 277,20

Project information

Grant agreement ID: 799062

Status

Ongoing project

  • Start date

    2 July 2018

  • End date

    1 July 2020

Funded under:

H2020-EU.1.3.2.

  • Overall budget:

    € 180 277,20

  • EU contribution

    € 180 277,20

Coordinated by:

ISTITUTO NAZIONALE DI FISICA NUCLEARE

Italy