Charting a New Horizon of Big and Fast Data Analysis through Integrated Algorithm Design

Project Information

BigFastData

Grant agreement ID: 725561

DOI

10.3030/725561

Project closed

EC signature date 15 June 2017

Start date 1 September 2017

End date 31 December 2023

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 2 472 752,00

EU contribution

€ 2 472 752,00

Coordinated by

ECOLE POLYTECHNIQUE
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Peer reviewed articles (6)

Optimization for active learning-based interactive database exploration

Author(s): Enhui Huang, Liping Peng, Luciano Di Palma, Ahmed Abdelkafi, Anna Liu, Yanlei Diao
Published in: Proceedings of the VLDB Endowment, Issue 12(1), 2018, Page(s) pp 71–84, ISSN 2150-8097
Publisher: VLDB Endowment
DOI: 10.14778/3275536.3275542

An analysis of query-agnostic sampling for interactive data exploration

Author(s): Wenzhao Liu, Yanlei Diao, Anna Liu
Published in: Communications in Statistics - Theory and Methods, Issue 47 (16), 2018, Page(s) pp. 3820-3837, ISSN 0361-0926
Publisher: Marcel Dekker Inc.
DOI: 10.1080/03610926.2017.1363231

Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series.

Author(s): Vincent Jacob, Fei Song, Arnaud Stiegler, Bijan Rad, Yanlei Diao, Nesime Tatbul.
Published in: Proceedings of VLDB Endowment (PVLDB), Issue 14(11), 2021, Page(s) 2613-2626, ISSN 2150-8097
Publisher: VLDB Endowment
DOI: 10.14778/3476249.3476307

Fine-grained modeling and optimization for intelligent resource management in big data processing

Author(s): Lyu, Chenghao; Fan, Qi; Song, Fei; Sinha, Arnab; Diao, Yanlei; Chen, Wei; Ma, Li; Feng, Yihui; Li, Yaliang; Zeng, Kai; Zhou, Jingren
Published in: Proceedings of the VLDB Endowment, Issue 15(11), 2022, Page(s) 3098-3111, ISSN 2150-8097
Publisher: VLDB Endowment
DOI: 10.14778/3551793.3551855

Efficient Version Space Algorithms for Human-in-the-loop Model Development

Author(s): Luciano Di Palma, Yanlei Diao, Anna Liu
Published in: ACM Transactions on Knowledge Discovery from Data, Issue 18(3), 2024, Page(s) pp 1–49, ISSN 1556-4681
Publisher: Special Interest Group on Computer Graphics, Association for Computing Machinery
DOI: 10.1145/3637443

Efficient and robust active learning methods for interactive database exploration

Author(s): Enhui Huang, Yanlei Diao, Anna Liu, Lipeng Peng, Luciano Di Palma
Published in: The VLDB Journal, Issue 32(5), 2023, Page(s) 1-26, ISSN 0949-877X
Publisher: Springer
DOI: 10.1007/s00778-023-00816-x

Conference proceedings (9)

Spade: A Modular Framework for Analytical Exploration of RDF Graphs

Author(s): Yanlei Diao, Pawel Guzewicz, Ioana Manolescu, Mirjana Mazuran
Published in: Proceedings of the VLDB Endowment, Issue 12(12), 2019, Page(s) pp 1926–1929, ISSN 2150-8097
Publisher: VLDB Endowment
DOI: 10.14778/3352063.3352101

A Demonstration of the Exathlon Benchmarking Platform for Explainable Anomaly Detection.

Author(s): Vincent Jacob, Fei Song, Arnaud Stiegler, Bijan Rad, Yanlei Diao, Nesime Tatbul.
Published in: Proceedings of VLDB Endowment (PVLDB), Issue 14(12), 2021, Page(s) 2827-2830
Publisher: PVLDB
DOI: 10.14778/3476311.3476355

Efficient Exploration of Interesting Aggregates in RDF Graphs.

Author(s): Yanlei Diao, Pawel Guzewicz, Ioana Manolescu, Mirjana Mazuran
Published in: Proceedings of the ACM SIGMOD Conference (SIGMOD), 2021, Page(s) 392-404
Publisher: ACM
DOI: 10.1145/3448016.3457307

"A Factorized Version Space Algorithm for ""Human-In-the-Loop"" Data Exploration"

Author(s): Luciano Di Palma, Yanlei Diao, Anna Liu
Published in: 2019 IEEE International Conference on Data Mining (ICDM), 2019, Page(s) pp 1018-1023
Publisher: IEEE
DOI: 10.1109/icdm.2019.00117

Anomaly Detection and Explanation Discovery on Event Streams

Author(s): Fei Song, Boyao Zhou, Quan Sun, Wang Sun, Shiwen Xia, Yanlei Diao
Published in: Proceedings of the International Workshop on Real-Time Business Intelligence and Analytics - BIRTE '18, 2018, Page(s) 1-5, ISBN 9781-450366076
Publisher: ACM Press
DOI: 10.1145/3242153.3242158

EXAD: A System for Explainable Anomaly Detection on Big Data Traces

Author(s): Fei Song, Yanlei Diao, Jesse Read, Arnaud Stiegler, Albert Bifet
Published in: 2018 IEEE International Conference on Data Mining Workshops (ICDMW), 2018, Page(s) 1435-1440, ISBN 978-1-5386-9288-2
Publisher: IEEE
DOI: 10.1109/icdmw.2018.00204

UDAO: A Next-Generation Unified Data Analytics Optimizer.

Author(s): Khaled Zaouk, Fei Song, Chenghao Lyu, Arnab Sinha, Yanlei Diao, Prashant J. Shenoy
Published in: Proceedings of Very Large Databases, Issue 12(12), 2019, Page(s) 1934-1937
Publisher: VLDB Endowment

Spark-based Cloud Data Analytics using Multi-Objective Optimization.

Author(s): Fei Song, Khaled Zaouk, Chenghao Lyu, Arnab Sinha, Qi Fan, Yanlei Diao, Prashant J. Shenoy
Published in: Proceedings of the 37th IEEE International Conference on Data Engineering (ICDE), 2021
Publisher: IEEE

Explainable anomaly detection on high-dimensional time series data.

Author(s): Bijan Rad, Fei Song, Vincent Jacob, Yanlei Diao.
Published in: Proceedings of the 15th ACM Intl. Conf. on Distributed and Event-based Systems (DEBS)., 2021, Page(s) 2-14
Publisher: ACM

Other (3)

AIDEme: An active learning based system for interactive exploration of large datasets

Author(s): Enhui Huang, Luciano Di Palma, Laurent Cetinsoy, Yanlei Diao, Anna Liu
Published in: NeurIPS 2019, 2019
Publisher: Neural Information Processing Systems Foundation, Inc.

Neural-based Modeling for Performance Tuning of Spark Data Analytics.

Author(s): Khaled Zaouk, Fei Song, Chenghao Lyu, Yanlei Diao.
Published in: Arxiv, 2021
Publisher: Arxiv.org

A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning

Author(s): Chenghao Lyu, Qi Fan, Philippe Guyard, Yanlei Diao
Published in: Arxiv, 2024, Page(s) 1-18
Publisher: Arxiv.rog