PrEstoCloud - Proactive Cloud Resources Management at the Edge for Efficient Real-Time Big Data Processing

Projektinformationen

PrEstoCloud

ID Finanzhilfevereinbarung: 732339

DOI

10.3030/732339

Projekt abgeschlossen

EK-Unterschriftsdatum 1 November 2016

Startdatum 1 Januar 2017

Enddatum 31 Dezember 2019

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 4 256 502,50

EU-Beitrag

€ 4 256 502,00

Koordiniert durch

SOFTWARE AG
Germany

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Other (29)

PrEstoCloud Security Enforcement Mechanism - Iteration 1

Research and development of appropriate microservices for enforcing security at the PrEstoCloud platform.

Autonomic Data-Intensive Application Manager - Iteration 2

This deliverable will provide the application manager with the meta-scheduling capabilities for big data processes

Spatiotemporal Processing Capabilities - Iteration 2

This deliverable will report on the second iteration of the spatio-temporal processing mechanism with enhanced ad-hoc autonomous computing capabilities in order to cope with poor network coverage situations.

Mobile Context Analyser - Iteration 1

This deliverable will report on the first iteration of the context model and the inferencing engine for analysing contextual information derived from any resources at the extreme edge of the network.

Mobile Offloading Processing Microservice - Iteration 1

This deliverable will report on the first iteration of the Mobile Offloading Processing microservice that will follow the instructions of the Autonomic Resources Manager for finding appropriate mobile devices and efficiently offloading processing nodes from the RTPN.

Placement algorithms and implementation - Iteration 2

This deliverable provides the algorithms and implementation of the placement and scheduling over the cloud infrastructure extended to the extreme edge of the network.

Integrated PrEstoCloud platform & installation manual - Iteration 3

This version will be a release (without report) of the final version of the PrEstoCloud platform, based on findings and improvements considered after the 2nd pilots’ evaluation (WP6).

Inter-site Network Virtualization Orchestrator - Iteration 1

This deliverable will report on the first iteration of the orchestrator mechanism for managing the inter-site network virtualization.

Fog Deployment and Monitoring Services - Iteration 2

This deliverable will provide the implementation of the monitoring services for the Fog/Cloud infrastructure.

PrEstoCloud Security Enforcement Mechanism - Iteration 2

Research and development of appropriate microservices for enforcing security at the PrEstoCloud platform.

Mobile Context Analyser - Iteration 2

This deliverable will report on the second iteration of the context model and the inferencing engine for analysing contextual information derived from any resources at the extreme edge of the network.

Autonomic Data-Intensive Application Manager - Iteration 1

This deliverable will provide the application manager with the meta-scheduling capabilities for big data processes

Fog Deployment and Monitoring Services - Iteration 1

This deliverable will provide the implementation of the monitoring services for the Fog/Cloud infrastructure.

Workload predictor - Iteration 2

Algorithms and mechanisms for cloud workload prediction adapted to PrEstoCloud based data-intensive processing applications.

Mobile Offloading Processing Microservice - Iteration 2

This deliverable will report on the second iteration of the Mobile Offloading Processing microservice that will follow the instructions of the Autonomic Resources Manager for finding appropriate mobile devices and efficiently offloading processing nodes from the RTPN.

Placement algorithms and implementation - Iteration 1

This deliverable provides the algorithms and implementation of the placement and scheduling over the cloud infrastructure extended to the extreme edge of the network.

Inter-site Network Virtualization Orchestrator - Iteration 2

This deliverable will report on the second iteration of the orchestrator mechanism for managing the inter-site network virtualization.

Workload predictor - Iteration 1

Algorithms and mechanisms for cloud workload prediction adapted to PrEstoCloud based data-intensive processing applications.

Resources Adaptation & Data-intensive Application Recommenders - Iteration 2

This deliverable will report on the two PrEstoCloud recommenders in the second iteration. It includes the research and development of two microservices: i) the first one is able to recommend at the appropriate time, the necessary adaptations of the RTPN, ii) the second one will assist in the appropriate fragmentation of data-intensive applications into smaller parts that can be efficiently deployed over network resources.

Integrated PrEstoCloud platform & installation manual - Iteration 2

This version will include a fully functional prototype and description of the PrEstoCloud platform.

PrEstoCloud Situation Detection Mechanism - Iteration 2

Research and development of a situation detection mechanism that recognizes interesting situations that might lead to resources adaptation recommendations or data-intensive application reconfiguration or redeployments. The first version of this deliverable also includes a report on the meta-model that captures all the important aspects for enhancing with situation awareness the PrEstoCloud platform.

Autonomic Resource Manager - Iteration 2

This deliverable will provide a demonstrating prototype of the cloud /fog resource manager which will be given in the second iteration

Autonomic Resource Manager - Iteration 1

This deliverable will provide a demonstrating prototype of the cloud /fog resource manager which will be given in the iteration

Communication Broker - Iteration 1

This deliverable will include the deployment of enterprise service bus that will support the basic publish/subscribe functionalities. In addition, it will provide the necessary adapters for plugging into the PrEstoCloud platform the Big Data streams of the project’s pilots.

Communication Broker - Iteration 2

This deliverable will include the deployment of enterprise service bus that will support the basic publish/subscribe functionalities. In addition, it will provide the necessary adapters for plugging into the PrEstoCloud platform the Big Data streams of the project’s pilots.

PrEstoCloud Situation Detection Mechanism - Iteration 1

Research and development of a situation detection mechanism that recognizes interesting situations that might lead to resources adaptation recommendations or data-intensive application reconfiguration or redeployments. The first version of this deliverable also includes a report on the meta-model that captures all the important aspects for enhancing with situation awareness the PrEstoCloud platform.

Integrated PrEstoCloud platform & installation manual - Iteration 1

This version will include a description of the implementation and integration undertaken along with a detailed definition of the prototypical system and the installation manual

Spatiotemporal Processing Capabilities - Iteration 1

This deliverable will report on the first iteration of the spatio-temporal processing mechanism with enhanced ad-hoc autonomous computing capabilities in order to cope with poor network coverage situations.

Resources Adaptation & Data-intensive Application Recommenders - Iteration 1

This deliverable will report on the two PrEstoCloud recommenders in the first iteration. It includes the research and development of two microservices: i) the first one is able to recommend at the appropriate time, the necessary adaptations of the RTPN, ii) the second one will assist in the appropriate fragmentation of data-intensive applications into smaller parts that can be efficiently deployed over network resources.

Documents, reports (20)

PrEstoCloud Conceptual Architecture

This deliverable gives a bird’s view on the general architecture of the system and should lay a foundation for the integration. Each component will be described through its functional and non-functional requirements.

Architecture of the PrEstoCloud platform

Gathering of all components to take part of the integrated system. Design of the system architecture. Refinement of requirements based on the technology developed in the first year of the project.

PrEstoCloud showcase - Iteration 2

This 2nd version will present promotion material, demonstration workflows, and the fully functional PrEstoCloud showcase ready to be demo-able to the public.

Training Report - Iteration 1

This deliverable includes a report on training activities along with the training material the PrEstoCloud consortium will produce.

PrEstoCloud Whitepaper

White paper analysing the pilot results and defining the roadmap for the successive industrialisation of the pilots.

Dissemination and Standardisation Plan and actions - Iteration 2

This deliverable describes the dissemination policy of the project, defining the target audience, the methodology and approach of our dissemination. Report on the dissemination activities, including applied dissemination methodology and examples of achieved scientific publications. Moreover, this document will discuss adoption and contributions to standardisation activities.

Assessment of the PrEstoCloud integrated platform - Iteration 1

This version of this deliverable will include the assessment results of extensive performance testing.

Communication Roadmap & Activities Report - Iteration 1

This iteration of this deliverable will report on the expected project outputs and communication activities and will prepare the project’s website, short reports, press releases, whitepapers and flyers.

Communication Roadmap & Activities Report - Iteration 2

This iteration will report on the accomplished communication activities.

Requirements for the PrEstoCloud Platform

This deliverable will collect initial requirements for PrEstoCloud platform in terms of functionality, interfaces (hardware and software) and information flow. Well-established methodologies for system requirements capturing and description will be used to minimise risks from the wide scope of the PrEstoCloud platform.

Dissemination and Standardisation Plan and actions - Iteration 1

This deliverable describes the dissemination policy of the project, defining the target audience, the methodology and approach of our dissemination. Report on the dissemination activities, including applied dissemination methodology and examples of achieved scientific publications. Moreover, this document will discuss adoption and contributions to standardisation activities.

Report on scientific and technological state-of-the-art analysis

This deliverable will report on the current related work in all the relevant research areas of PrEstoCloud project. Additionally, it will provide description of the pre-existing tools available within the consortium or open-source and repository available for the rest of the project partners.

Communication Roadmap & Activities Report - Iteration 3

This iteration will report on the accomplished communication activities.

Dissemination and Standardisation Plan and actions - Iteration 3

This deliverable describes the dissemination policy of the project, defining the target audience, the methodology and approach of our dissemination. Report on the dissemination activities, including applied dissemination methodology and examples of achieved scientific publications. Moreover, this document will discuss adoption and contributions to standardisation activities.

Training Report - Iteration 2

This deliverable includes a report on training activities along with the training material the PrEstoCloud consortium will produce.

Assessment of the PrEstoCloud integrated platform - Iteration 2

This 2nd evaluation contains results testing usability and performance testing using real Big-Data streams.

PrEstoCloud showcase - Iteration 1

This 1st version will contain a specification of the PrEstoCloud industry showcase including design of promotion material and requirements for software needed to run the showcase.

PrEstoCloud Semantic model

This deliverable will describe a semantic model that will allow Big Data application developers to annotate their code with respect to data-intensive application fragmentation and deployment.

Format and procedures for plugging in real-time data streams

This deliverable will provide format, procedures and adaptors for plugging Big Data streams to the PrEstoCloud platform.

Project KPI Report

Within the first 4 months of the project, a set of Key Performance Indicators (KPIs) will be developed and agreed with the Project Officer.

Open Research Data Pilot (3)

Data Management Plan Update 1

first update of the data management plan as preparation of m18 review

Initial Data Management Plan

This deliverable will clarify which of data will be made openly available.

Data Management Plan Update 2

final update of the data management plan as preparation of m36 review

Veröffentlichungen

Conference proceedings (18)

Seamless Task Offloading on Multi-Clouds and Edge Resources: an Experiment

Autoren: Tsagkaropoulos, Andreas; Verginadis, Giannis; Apostolou, Dimitris; Mentzas, Gregoris
Veröffentlicht in: 8th International Conference on Information, Intelligence, Systems and Applications IISA 2017, 28-30 August 2017, Ausgabe 2, 2017
Herausgeber: IEEE
DOI: 10.5281/zenodo.1133312

Wide Area Video Surveillane Based on Edge and Fog Computing Concept

Autoren: Kioumourtzis, George; Skitsas, Michael; Zotos, N; Sideris, A
Veröffentlicht in: 8th International Conference on Information, Intelligence, Systems & Applications (IISA), Ausgabe 1, 2017
Herausgeber: IEEE
DOI: 10.5281/zenodo.1138596

A data-driven approach for multivariate contextualized anomaly detection: industry use case

Autoren: Stojanovic, Nenad; Dinic, Marko; Stojanovic, Ljiljana
Veröffentlicht in: 2017 IEEE International Conference on Big Data, Ausgabe 3, 2017
Herausgeber: IEEE
DOI: 10.5281/zenodo.1159124

PrEstoCloud: Proactive Cloud Resources Management at the Edge for Efficient Real-Time Big Data Processing

Autoren: Verginadis, Yiannis; Alshabani, Iyad; Mentzas, Gregoris; Stojanovic, Nenad
Veröffentlicht in: 7th International Conference on Cloud Computing and Services Science (CLOSER 2017), 24-26 April 2017, Ausgabe 3, 2017
Herausgeber: SciTePress
DOI: 10.5281/zenodo.1133307

Towards non-intrusive measurements of available bandwidth for multi-cloud applications

Autoren: Alessio Pagliari; Quentin Jacquemart; Guillaume Urvoy-Keller
Veröffentlicht in: ACM Internet Measurement Conference 2017, Nov 1-3, London, UK, 2017
Herausgeber: ACM

Trustable virtual machine scheduling in a cloud

Autoren: Fabien Hermenier, Ludovic Henrio
Veröffentlicht in: Proceedings of the 2017 Symposium on Cloud Computing - SoCC '17, 2017, Seite(n) 15-26, ISBN 9781-450350280
Herausgeber: ACM Press
DOI: 10.1145/3127479.3128608

SEaMLESS - a SErvice migration cLoud architecture for energy saving and memory releaSing capabilities

Autoren: D. Lopez Pacheco, Q. Jacquemart, A. Segalini, M. Rifai, M. Dione, G. Urvoy-Keller
Veröffentlicht in: Proceedings of the 2017 Symposium on Cloud Computing - SoCC '17, 2017, Seite(n) 645-645, ISBN 9781-450350280
Herausgeber: ACM Press
DOI: 10.1145/3127479.3128604

Towards Massive Consolidation in Data Centers with SEaMLESS

Autoren: Andrea Segalini; Dino Lopez Pacheco; Quentin Jacquemart; Myriana Rifai; Guillaume Urvoy-Keller; and Marcos Dione
Veröffentlicht in: 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2018), 2018
Herausgeber: IEEE/ACM

Quality of Experience Estimation for WebRTC-based Video Streaming

Autoren: Yevgeniya Sulema ; Noam Amram ; Oleksii Aleshchenko ; Olena Sivak
Veröffentlicht in: European Wireless 2018; 24th European Wireless Conference, 2018
Herausgeber: IEEE

Real-Time Data-Intensive Telematics Functionalities at the Extreme Edge of the Network: Experience with the PrEstoCloud Project

Autoren: Salman Taherizadeh, Blaz Novak, Marija Komatar, Marko Grobelnik
Veröffentlicht in: 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), 2018, Seite(n) 522-527, ISBN 978-1-5386-2666-5
Herausgeber: IEEE
DOI: 10.1109/COMPSAC.2018.10288

PrEstoCloud: Proactive Cloud Resources Management at the Edge for Efficient Real-Time Big Data Processing

Autoren: Salman Taherizadeh, Blaz Novak, Sebastjan Vagaja, Marija Komatar and Marko Grobelnik
Veröffentlicht in: KDD 2018 Project Showcase Track, 2018
Herausgeber: n/a

Towards Massive Consolidation in Data Centers with SEaMLESS

Autoren: Andrea Segalini, Dino Lopez Pacheco, Quentin Jacquemart
Veröffentlicht in: 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2018, Seite(n) 233-242, ISBN 978-1-5386-5815-4
Herausgeber: IEEE
DOI: 10.1109/ccgrid.2018.00038

A Situation Detection Mechanism for Pervasive Computing Infrastructures

Autoren: Dimitris Apostolou; Nikos Papageorgiou; Yiannis Verginadis; Andreas Tsagkaropoulos; Gregoris Mentzas
Veröffentlicht in: 2018 9th International Conference on Information, Intelligence, Systems and Applications (IISA), Ausgabe 5, 2018, Seite(n) 1-8
Herausgeber: IEEE
DOI: 10.5281/zenodo.2359273

Inferring the Deployment of Top Domains over Public Clouds using DNS Data

Autoren: Jacquemart, Quentin; Pigout, Clément; Urvoy-Keller, Guillaume
Veröffentlicht in: Traffic Measurement and Analysis Conference (TMA), Ausgabe 1, 2019
Herausgeber: IEEE

Adaptive Edge and Fog Computing Paradigm for Wide Area Video and Audio Surveillance

Autoren: Ioannis Ledakis; Thanassis Bouras; George Kioumourtzis; Michalis Skitsas
Veröffentlicht in: 9th International Conference on Information, Intelligence, Systems and Applications (IISA), Ausgabe 5, 2018
Herausgeber: IEEE
DOI: 10.5281/zenodo.2359818

On the Cost of Acking in Data Stream Processing Systems

Autoren: Alessio Pagliari, Fabrice Huet, Guillaume Urvoy-Keller
Veröffentlicht in: 2019 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2019, Seite(n) 331-340, ISBN 978-1-7281-0912-1
Herausgeber: IEEE
DOI: 10.1109/CCGRID.2019.00047

Challenges and Research Directions in Big Data-driven Cloud Adaptivity

Autoren: Tsagkaropoulos, Andreas; Papageorgiou, Nikos; Apostolou, Dimitris; Verginadis, Yiannis; Mentzas, Gregoris
Veröffentlicht in: Proceedings of the 8th International Conference on Cloud Computing and Services Science, Ausgabe 3, 2018
Herausgeber: SCITEPRESS
DOI: 10.5281/zenodo.1309530

Measuring the Amazon Web Services (AWS) WAN Infrastructure

Autoren: Jacquemart, Quentin; Vitali, Alessandro,; Urvoy-Keller, Guillaume
Veröffentlicht in: https://hal.archives-ouvertes.fr/hal-02128052, Ausgabe 2, 2019
Herausgeber: hal.archives-ouvertes

Peer reviewed articles (3)

Dynamic Multi-level Auto-scaling Rules for Containerized Applications

Autoren: Salman Taherizadeh, Vlado Stankovski
Veröffentlicht in: The Computer Journal, 2018, ISSN 0010-4620
Herausgeber: Oxford University Press
DOI: 10.1093/comjnl/bxy043

Fog Context Analytics

Autoren: Nikos Papageorgiou; Yiannis Verginadis; Dimitris Apostolou; Gregoris Mentzas
Veröffentlicht in: IEEE Instrumentation and Measurement, 2019, ISSN 1094-6969
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.5281/zenodo.3559694

A Capillary Computing Architecture for Dynamic Internet of Things: Orchestration of Microservices from Edge Devices to Fog and Cloud Providers

Autoren: Salman Taherizadeh, Vlado Stankovski, Marko Grobelnik
Veröffentlicht in: Sensors, Ausgabe 18/9, 2018, Seite(n) 2938, ISSN 1424-8220
Herausgeber: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s18092938

Other (1)

PrEstoCloud - Proactive Cloud Resources Management at the Edge for efficient Real-time Big Data Processing“

Autoren: Harald Schoening, Software AG
Veröffentlicht in: SummerSoc 2017, Ausgabe 1, 2017
Herausgeber: SummerSoc 2017
DOI: 10.5281/zenodo.1323698

Book chapters (1)

Situation Detection on the Edge

Autoren: Nikos Papageorgiou, Dimitris Apostolou, Yiannis Verginadis, Andreas Tsagkaropoulos, Gregoris Mentzas
Veröffentlicht in: Web, Artificial Intelligence and Network Applications - Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Ausgabe 927, 2019, Seite(n) 985-995, ISBN 978-3-030-15034-1
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-030-15035-8_97