Description du projet
Des mégadonnées pour tous: abandonner les exigences des serveurs et adopter facilement le nuage
Le développement de logiciels pour des applications basées dans le nuage est complexe, et leur déploiement dans le nuage peut l’être davantage. L’informatique «sans serveur» aborde ce problème, alors que l’exécution du code est gérée par le fournisseur de nuage afin que les programmeurs ne s’occupent plus de la gestion et de la maintenance des serveurs. Le projet CloudButton, financé par l’UE, a créé Lithops, une plateforme d’analyse des données sans serveur à plusieurs nuages et libre d’accès qui rendra les mégadonnées plus accessibles aux programmeurs de tous niveaux. Le projet facilite aussi la migration des applications actuelles riches en données des domaines de l’informatique de haute performance, de l’analyse des données et de l’apprentissage automatique vers le nuage.
Objectif
This project is inspired by the following sentence from a professor of computer graphics at UC Berkeley : “Why is there no cloud button?” He outlined how his students simply wish they could easily “push a button” and have their code – existing, optimized, single-machine code – running on the cloud.
The main goal is to create CloudButton: a Serverless Data Analytics Platform. CloudButton will “democratize big data” by overly simplifying the overall life cycle and programming model thanks to serverless technologies. To demonstrate the impact of the project, we target two settings with large data volumes: bioinformatics (genomics, metabolomics) and geospatial data (LiDAR, satellital).
To achieve these ambitious objectives, CloudButton defines the following goals:
1. High Performance Serverless Run-time: We will create the first FaaS compute run-time for Big Data analytics leveraging Apache OpenWhisk. The proposed serverless big data analytics platform will be based on a mature open source code base (Apache OpenWhisk) augmented with Apache Open Whisk Composer.
2. Mutable Shared Data Middleware for Serverless Computing: We will create Distributed Mutable Data Structures leveraging RedHat Infinispan In-Memory Data Grid. Our middleware will provide language-level constructs for data persistence, dependability and concurrency control to serverless functions.
3. CloudButton Toolkit: Serverless Data Analytics Platform: The toolkit will implement on top of [1] and [2] the Serverless Cloud Programming Abstractions that can express a wide range of existing data-intensive applications with minimal changes. We will develop new tools and methodologies to port existing data-intensive applications from the HPC, data analytics and machine learning domains to the CloudButton toolkit.
Champ scientifique
- natural sciencescomputer and information sciencesinternet
- natural sciencescomputer and information sciencesdata sciencebig data
- natural sciencescomputer and information sciencessoftwaresoftware development
- natural sciencescomputer and information sciencesartificial intelligencemachine learning
- natural sciencescomputer and information sciencessoftwaresoftware applications
Programme(s)
Régime de financement
RIA - Research and Innovation actionCoordinateur
43003 Tarragona
Espagne