Sustainable Data Lakes for Extreme-Scale Analytics

Información del proyecto

SmartDataLake

Identificador del acuerdo de subvención: 825041

DOI

10.3030/825041

Proyecto cerrado

Fecha de la firma de la CE 24 Octubre 2018

Fecha de inicio 1 Enero 2019

Fecha de finalización 31 Diciembre 2021

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coste total

€ 3 945 450,00

Aportación de la UE

€ 3 945 450,00

Coordinado por

ATHINA-EREVNITIKO KENTRO KAINOTOMIAS STIS TECHNOLOGIES TIS PLIROFORIAS, TON EPIKOINONION KAI TIS GNOSIS
Greece

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Other (5)

Initial version of the HIN mining engine

Prototype implementation of the HIN mining library, including functionalities for similarity search and browsing, entity resolution and entity ranking.

Initial version of the visual analytics engine

First prototype of the visual analytics layer, including basic functionalities for interactive visual analytics over spatial, temporal and network data.

Final version of the visual analytics engine

Final prototype of the visual analytics engine including all functionalities for HIN exploration and analysis via scalable and interactive visualizations

Final version of the HIN mining engine

Final prototype of the Heterogeneous Information Network mining library

Query engine over virtualized data

Includes the query planning and execution operators for natively supporting queries over virtualized, heterogeneous data.

Documents, reports (9)

Final evaluation report

Final overall report and assessment of the SmartDataLake system including the feedback from the pilot testing and validation

Interactive visual analytics model

Model specification driving the interactive visualizations for HIN exploration, analysis and mining, including the visual interfaces and interactions for feature space exploration, model selection and parameter tuning.

System architecture

The initial architecture of the SmartDataLake platform, its individual components, and their interfaces.

Automated storage tiering

Cost model and algorithms for analytics over cold storage and for automated data placement in different storage tiers

Monitoring and assessing changes in evolving HINs

Techniques and algorithms for monitoring the temporal evolution of HINs and detecting and assessing the impact of changes

Similarity search, entity resolution and ranking

Includes the attribute-based and link-based similarity measures, techniques and algorithms for search and browsing over multi-typed entities and relations, as well as the algorithms for entity resolution and ranking.

Scalable visualization techniques for spatial, temporal and graph data

Techniques and algorithms for efficient and scalable visualizations of spatiotemporal data and information networks

Data synopses for approximate analytics

Algorithms for approximate query answering and analytics based on adaptive data synopses.

Link prediction and community detection in HINs

Algorithms for predicting new relations and discovering entity groups and communities combining attributebased and linkbased features

Publicaciones

Conference proceedings (27)

GGDs : Graph Generating Dependencies

Autores: Shimomura, Larissa C.; Fletcher, George; Yakovets, Nikolay
Publicado en: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2020, Página(s) 2217-2220
Editor: ACM
DOI: 10.1145/3340531.3412149

Link Prediction in Bibliographic Networks

Autores: Chronis, Pantelis, Skoutas, Dimitrios, Athanasiou, Spiros, & Skiadopoulos, Spiros
Publicado en: 1st International Workshop on Assessing Impact and Merit in Science (AIMinScience), 2020
Editor: Springer
DOI: 10.1007/978-3-030-55814-7_28

Accelerating Complex Analytics using Speculation

Autores: Panagiotis Sioulas, Viktor Sanca, Ioannis Mytilinis, Anastasia Ailamaki
Publicado en: International Conference on Innovative Data Systems Research (CIDR), 2021
Editor: www.cidrdb.org

Speculative Execution of Similarity Queries: Real-Time Parameter Optimization through Visual Exploration

Autores: Thilo Spinner, Udo Schlegel, Martin Schall, Fabian Sperrle, Rita Sevastjanova, Beatrice Gobbo, Julius Rauscher, Mennatallah El-Assady, Daniel A. Keim
Publicado en: 1st International Workshop on Data Analytics and Machine Learning Made Simple, 2021
Editor: CEUR Workshop Proceedings (CEUR-WS.org)

Twin Subsequence Search in Time Series

Autores: Georgios Chatzigeorgakidis, Dimitrios Skoutas, Kostas Patroumpas, Themis Palpanas, Spiros Athanasiou, Spiros Skiadopoulos
Publicado en: 24th International Conference on Extending Database Technology (EDBT), 2021, Página(s) 475-480
Editor: OpenProceedings.org

Hardware-Conscious Sliding Window Aggregation on GPUs

Autores: Georgios Michas, Periklis Chrysogelos, Ioannis Mytilinis, Anastasia Ailamaki
Publicado en: International Workshop on Data Management on New Hardware (DaMoN), 2021, Página(s) 13:1-13:5
Editor: ACM
DOI: 10.1145/3465998.3466014

A Visual Explorer for Geolocated Time Series

Autores: Chatzigeorgakidis, Georgios, Patroumpas, Kostas, Skoutas, Dimitrios, & Athanasiou, Spiros
Publicado en: 28th International Conference on Advances in Geographic Information Systems (SIGSPATIAL), 2020, Página(s) 413-416
Editor: ACM
DOI: 10.1145/3397536.3422345

Boosting Efficiency of External Pipelines by Blurring Application Boundaries

Autores: Anna Herlihy, Periklis Chrysogelos, Anastasia Ailamaki
Publicado en: International Conference on Innovative Data Systems Research (CIDR), 2022
Editor: CIDR

VeTo-web: A Recommendation Tool for the Expansion of Sets of Scholars

Autores: Serafeim Chatzopoulos, Thanasis Vergoulis, Theodore Dalamagas, & Christos Tryfonopoulos
Publicado en: ACM/IEEE Joint Conference on Digital Libraries, 2021
Editor: IEEE
DOI: 10.5281/zenodo.5548163

Easy Spark

Autores: Ylaise van den Wildenberg, Wouter W. L. Nuijten, Odysseas Papapetrou
Publicado en: 1st International Workshop on Data Analytics and Machine Learning Made Simple, 2021
Editor: CEUR-WS.org

SciNeM: A Scalable Data Science Tool for Heterogeneous Network Mining

Autores: Serafeim Chatzopoulos, Thanasis Vergoulis, Panagiotis Deligiannis, Dimitrios Skoutas, Theodore Dalamagas, Christos Tryfonopoulos
Publicado en: 24th International Conference on Extending Database Technology (EDBT), 2021, Página(s) 654-657
Editor: OpenProceedings.org

Multi-Attribute Similarity Search for Interactive Data Exploration

Autores: Kostas Patroumpas, Alexandros Zeakis, Dimitrios Skoutas, Roberto Santoro
Publicado en: 1st International Workshop on Data Analytics and Machine Learning Made Simple, 2021
Editor: CEUR Workshop Proceedings (CEUR-WS.org)

SPHINX: A System for Metapath-based Entity Exploration in Heterogeneous Information Networks

Autores: Serafeim Chatzopoulos; Kostas Patroumpas; Alexandros Zeakis; Thanasis Vergoulis; Dimitrios Skoutas
Publicado en: International Conference on Very Large Data Bases (VLDB), 2020, Página(s) 2913-2916
Editor: VLDB Endowment
DOI: 10.14778/3415478.3415507

Towards Proximity Graph Auto-configuration: An Approach Based on Meta-learning

Autores: Rafael Seidi Oyamada, Larissa Shimomura, Sylvio Barbon Junior, Daniel Kaster
Publicado en: European Conference on Advances in Databases and Information Systems (ADBIS), 2020, Página(s) 93-107
Editor: Springer

Storage Management in Smart Data Lake

Autores: Haoqiong Bian, Bikash Chandra, Ioannis Mytilinis, Anastasia Ailamaki
Publicado en: 1st International Workshop on Data Analytics and Machine Learning Made Simple, 2021
Editor: CEUR Workshop Proceedings (CEUR-WS.org)

A Parallel and Distributed Approach for Diversified Top-k Best Region Search

Autores: Hamid Shahrivari; Matthaios Olma; Odysseas Papapetrou; Dimitrios Skoutas; Anastasia Ailamaki
Publicado en: Proceedings of the 23rd International Conference on Extending Database Technology (EDBT), 2020, Página(s) 265-276
Editor: OpenProceedings
DOI: 10.5441/002/edbt.2020.24

Local Similarity Search on Geolocated Time Series Using Hybrid Indexing

Autores: Georgios Chatzigeorgakidis, Dimitrios Skoutas, Kostas Patroumpas, Themis Palpanas, Spiros Athanasiou, Spiros Skiadopoulos
Publicado en: Proceedings of the 27th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, 2019, Página(s) 179-188, ISBN 9781-450369091
Editor: ACM
DOI: 10.1145/3347146.3359349

Scalable temporal clique enumeration

Autores: Kaijie Zhu, George Fletcher, Nikolay Yakovets, Odysseas Papapetrou, Yuqing Wu
Publicado en: Proceedings of the 16th International Symposium on Spatial and Temporal Databases, 2019, Página(s) 120-129, ISBN 9781-450362801
Editor: ACM
DOI: 10.1145/3340964.3340987

Local Pair and Bundle Discovery over Co-Evolving Time Series

Autores: Georgios Chatzigeorgakidis, Dimitrios Skoutas, Kostas Patroumpas, Themis Palpanas, Spiros Athanasiou, Spiros Skiadopoulos
Publicado en: Proceedings of the 16th International Symposium on Spatial and Temporal Databases, 2019, Página(s) 160-169, ISBN 9781-450362801
Editor: ACM
DOI: 10.1145/3340964.3340982

Automatic Clustering by Detecting Significant Density Dips in Multiple Dimensions

Autores: Pantelis Chronis, Spiros Athanasiou, Spiros Skiadopoulos
Publicado en: 2019 IEEE International Conference on Data Mining (ICDM), 2019, Página(s) 91-100, ISBN 978-1-7281-4604-1
Editor: IEEE
DOI: 10.1109/icdm.2019.00019

Taster: Self-Tuning, Elastic and Online Approximate Query Processing

Autores: Matthaios Olma, Odysseas Papapetrou, Raja Appuswamy, Anastasia Ailamaki
Publicado en: 2019 IEEE 35th International Conference on Data Engineering (ICDE), 2019, Página(s) 482-493, ISBN 978-1-5386-7474-1
Editor: IEEE
DOI: 10.1109/icde.2019.00050

GPU-accelerated data management under the test of time

Autores: Aunn Raza; Periklis Chrysogelos; Panagiotis Sioulas; Vladimir Indjic; Angelos Christos Anadiotis; Anastasia Ailamaki
Publicado en: Conference on Innovative Data Systems Research (CIDR), Edición 1, 2020
Editor: www.cidrdb.org
DOI: 10.5281/zenodo.3827490

Similarity search over enriched geospatial data

Autores: Kostas Patroumpas, Dimitrios Skoutas
Publicado en: Proceedings of the Sixth International ACM SIGMOD Workshop on Managing and Mining Enriched Geo-Spatial Data, 2020, Página(s) 1-6, ISBN 9781-450380355
Editor: ACM
DOI: 10.1145/3403896.3403967

JedAI3: beyond batch, blocking-based Entity Resolution

Autores: George Papadakis; Leonidas Tsekouras; Manos Thanos; Nikiforos Pittaras; Giovanni Simonini; Dimitrios Skoutas; Paul Isaris; George Giannakopoulos; Themis Palpanas; Manolis Koubarakis
Publicado en: Proceedings of the 23rd International Conference on Extending Database Technology (EDBT), 2020, Página(s) 603-606
Editor: OpenProceedings
DOI: 10.5441/002/edbt.2020.74

Adaptive HTAP through Elastic Resource Scheduling

Autores: Aunn Raza, Periklis Chrysogelos, Angelos Christos Anadiotis, Anastasia Ailamaki
Publicado en: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, 2020, Página(s) 2043-2054, ISBN 9781-450367356
Editor: ACM
DOI: 10.1145/3318464.3389783

Discovering Mixture-Based Best Regions of Arbitrary Shapes

Autores: Skoutas, Dimitrios, Sacharidis, Dimitris, & Patroumpas, Kostas
Publicado en: 29th International Conference on Advances in Geographic Information Systems (SIGSPATIAL), 2021, Página(s) 468-479
Editor: ACM
DOI: 10.1145/3474717.3484215

A system design for elastically scaling transaction processing engines in virtualized servers

Autores: Angelos-Christos G. Anadiotis, Raja Appuswamy, Anastasia Ailamaki, Ilan Bronshtein, Hillel Avni, David Dominguez-Sal, Shay Goikhman, Eliezer Levy
Publicado en: Proceedings of the VLDB Endowment, 2020, Página(s) 3085-3098
Editor: VLDB Endowment
DOI: 10.14778/3415478.3415536

Peer reviewed articles (7)

The Unmet Data Visualization Needs of Decision Makers within Organizations

Autores: Evanthia Dimara, Harry Zhang, Melanie Tory, Steven Franconeri
Publicado en: IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers

explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning

Autores: Thilo Spinner, Udo Schlegel, Hanna Schafer, Mennatallah El-Assady
Publicado en: IEEE Transactions on Visualization and Computer Graphics, 2019, Página(s) 1-1, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TVCG.2019.2934629

Visual Exploration of Geolocated Time Series with Hybrid Indexing

Autores: Georgios Chatzigeorgakidis, Kostas Patroumpas, Dimitrios Skoutas, Spiros Athanasiou, Spiros Skiadopoulos
Publicado en: Big Data Research, Edición 15, 2019, Página(s) 12-28, ISSN 2214-5796
Editor: Elsevier Inc.
DOI: 10.1016/j.bdr.2019.02.001

Uncertainty-Aware Principal Component Analysis

Autores: Jochen Gortler, Thilo Spinner, Dirk Streeb, Daniel Weiskopf, Oliver Deussen
Publicado en: IEEE Transactions on Visualization and Computer Graphics, Edición 26/1, 2020, Página(s) 822-831, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2019.2934812

Blocking and Filtering Techniques for Entity Resolution

Autores: George Papadakis, Dimitrios Skoutas, Emmanouil Thanos, Themis Palpanas
Publicado en: ACM Computing Surveys, Edición 53/2, 2020, Página(s) 1-42, ISSN 0360-0300
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3377455

v‐plots: Designing Hybrid Charts for the Comparative Analysis of Data Distributions

Autores: Michael Blumenschein, Luka J. Debbeler, Nadine C. Lages, Britta Renner, Daniel A. Keim, Mennatallah El‐Assady
Publicado en: Computer Graphics Forum, Edición 39/3, 2020, Página(s) 565-577, ISSN 0167-7055
Editor: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14002

VeTo+: improved expert set expansion in academia

Autores: Serafeim Chatzopoulos, Thanasis Vergoulis, Theodore Dalamagas, Christos Tryfonopoulos
Publicado en: International Journal of Digital Libraries (IJDL), 2021, ISSN 1432-5012
Editor: Springer Verlag