Skip to main content

Evidence Based Big Data Benchmarking to Improve Business Performance

Deliverables

DataBench Architecture

DataBench Architecture will describe the DataBench Toolbox architecture.

Evaluation of business performance

Evaluation of business performance will present the results of the evaluation of business process performance based on evidence from data collection activities.

Initial Evaluation of DataBench Metrics

Initial Evaluation of DataBench Metrics will present an initial set of indicators that will allow to structure the metrics and data collections according to different characteristics and provide a landscape prototype.

Assessment of technical usability, relevance, scale and complexity

The Assessment of technical usability, relevance, scale and complexity Deliverable will provide initial assessment of technical usability, relevance, scalability and complexity of Big-Data tasks.

Final report on methodology for evaluation of industrial analytic projects scenarios

Final report on methodology for evaluation of industrial analytic projects scenarios will provide the results and assessment of Big-Data projects according to the DataBench methodology and a description of how to use the methodologies for industrial evaluation analytics.

Preliminary Benchmarks of European and industrial significance

Preliminary Benchmarks of European and industrial significance will provide a first assessment of the value and economic relevance of the EU industry sectors using and developing BDT technologies and of the industrial significance of the performance parameters measured by the BDT benchmarks.

Dissemination and Liaison plan

This Deliverable will provide a detailed schedule of the communication and dissemination activities planned, their targets and the communication channels, as well as the Liaison plan to establish working relationship with the ICT 15 and 15 projects and other relevant projects/communities.

Data collection plan

Data collection plan will present a detailed plan of data collection activities, industries and projects considered, information sources and data collection methodologies.

Analytic modelling relationships between metrics, data and project methodologies

This descriptive document and related native format schematic materials will provide the mapping between metrics, data characteristics and methodologies. Every metric and dataset used within benchmarking will be associated with tasks and problems and initial set of complexity and scalability indicators will be identified.

Industry Requirements with benchmark metrics and KPIs

This Deliverable will document the collected industrial requirements of European significance with mappings to related vertical and horizontal benchmark metrics and KPIs.

Release Version of DataBench Toolbox including visualization and search components

Release Version of DataBench Toolbox including visualization and search components will present the specification of the release version of DataBench Toolbox. The focus will be on the components defined in the layered architecture of the platform emphasizing on the visual components.

Project Fiche

General description of the project, partners and plan for public dissemination.

Dissemination and Liaison report period 1

This Deliverable will describe the results of the dissemination and liaison activities in the first 18 months of the project and will provide an update of these activities planned for period 2. It will contain record of all events, dissemination materials, scientific papers and links to web based content.

Dissemination and Liaison report period 2

This Deliverable will describe the results of the dissemination and liaison activities in the second 18 month period of the project and will provide an overview of major achievements during the project. It will contain record of all events, dissemination materials, scientific papers and links to web based content.

Analysis of actual and emerging needs of industrial users and use case mapping

Analysis of actual and emerging needs of industrial users and use case mapping will report the results of the analysis of the actual and emerging needs of industrial users of BD, based on IDC data and an ad-hoc survey of pioneer industrial users (running pilot cases in the ICT14 and ICT 15 H2020 projects) and other users.

DataBench Toolbox - Beta including end-to-end-scenario tool

DataBench Toolbox - Beta including end-to-end-scenario tool (M24) will present the specification about beta version of DataBench Toolbox. The focus will be on the implementation of the back-end of the DataBench Toolbox and associated tools.

DataBench Toolbox – Alpha including support for reusing of existing benchmarks

DataBench Toolbox – Alpha including support for reusing of existing benchmarks will present the specification about alpha version of DataBench Toolbox. The focus will be on the components that will allow the reuse of existing benchmarks resources in the platform.

Project Web Portal and Dissemination Materials

Project Web Portal and Dissemination Materials Will launch the project online presence and website and provide the dissemination materials kit.

Data collection results

Data collection results will describe the results of data collection activities presenting the data that will be used to work with and validate the DataBench methodology.

Searching for OpenAIRE data...

Publications

Building the DataBench Workflow and Architecture

Author(s): Todor Ivanov, Timo Eichhorn, Arne Jørgen Berre, Tomás Pariente Lobo, Ivan Martinez Rodriguez, Ricardo Ruiz Saiz, Barbara Pernici, Chiara Francalanci
Published in: Benchmarking, Measuring, and Optimizing - Second BenchCouncil International Symposium, Bench 2019, Denver, CO, USA, November 14–16, 2019, Revised Selected Papers, Issue 12093, 2020, Page(s) 165-171
DOI: 10.1007/978-3-030-49556-5_17

Analytics Benchmarks

Author(s): Todor Ivanov, Roberto V. Zicari
Published in: Encyclopedia of Big Data Technologies, Issue 10 March 2018, 2018, Page(s) 1-10
DOI: 10.1007/978-3-319-63962-8_113-1

KPIs of BDA Business Impacts in Manufacturing

Author(s): Gabriella Cattaneo, Sergio Gusmeroli
Published in: Big Data Challenges in Smart Manufacturing Industry V. 2020, Issue July 2020, 2020, Page(s) 8

CoreBigBench - Benchmarking big data core operations

Author(s): Todor Ivanov, Ahmad Ghazal, Alain Crolotte, Pekka Kostamaa, Yoseph Ghazal
Published in: Proceedings of the workshop on Testing Database Systems, 2020, Page(s) 1-6
DOI: 10.1145/3395032.3395324

Tutorial on Benchmarking Big Data Analytics Systems

Author(s): Todor Ivanov, Rekha Singhal
Published in: Companion of the ACM/SPEC International Conference on Performance Engineering, 2020, Page(s) 50-53
DOI: 10.1145/3375555.3383121

Relating Big Data Business and Technical Performance Indicators

Author(s): Pernici, Barbara; Francalanci, Chiara; Geronazzo, Angela; Lucia, Polidori; Stefano, Ray; Leonardo, Riva; Arne Jørgen Berre,; Todor, Ivanov
Published in: XV Conference of the Italian Chapter of AIS, Issue 2018, 2018

Adding Velocity to BigBench

Author(s): Todor Ivanov, Patrick Bedué, Ahmad Ghazal, Roberto V. Zicari
Published in: Proceedings of the Workshop on Testing Database Systems - DBTest'18, Issue 15 June 2018, 2018, Page(s) 1-6
DOI: 10.1145/3209950.3209956

Exploratory Analysis of Spark Structured Streaming

Author(s): Todor Ivanov, Jason Taafe
Published in: Companion of the 2018 ACM/SPEC International Conference on Performance Engineering - ICPE '18, Issue 2018, 2018, Page(s) 141-146
DOI: 10.1145/3185768.3186360

ABench - Big Data Architecture Stack Benchmark

Author(s): Todor Ivanov, Rekha Singhal
Published in: Companion of the 2018 ACM/SPEC International Conference on Performance Engineering - ICPE '18, Issue 2018, 2018, Page(s) 13-16
DOI: 10.1145/3185768.3186300