Project description
Cloud-based system for cost-efficient, simpler data analytics
Funded by the European Research Council, the CODAC project aims to transform large-scale data analytics in the cloud into a commodity. To do so, it will design and develop an open and inexpensive analytical database system for the cloud. The system will mainly consist of a smart control component, a fully efficient and scalable query processing engine, and a data lake storage abstraction. The component will automatically and transparently choose and manage the cheapest hardware for the particular workload and ease migration to other cloud vendors. The engine will take advantage of modern cloud hardware, while the data lake will allow for cost-effective storage.
Objective
The goal of this project is to commoditize large-scale data analytics in the cloud, which means (a) to reduce query processing cost to close to what the available hardware is theoretically capable of and (b) to prevent vendor lock-in by making it easy to move data between different clouds and systems. To achieve this, we will design and develop an open and cost-efficient analytical database system for the cloud called CODAC.
The CODAC system consists of three main components: First, an intelligent control component that automatically and transparently selects and manages the cheapest hardware instances for the given workload and makes migration to other (e.g. European) cloud vendors possible. Second, a highly-efficient and scalable query processing engine that is capable of fully exploiting modern cloud hardware. Third, a data lake storage abstraction based on open data formats that enables cheap storage as well as modularity and interoperability across different data systems. The resulting system therefore has the potential for making large-scale data analytics both cheaper and easier, boosting data-driven instruct and science.
Fields of science
Programme(s)
- HORIZON.1.1 - European Research Council (ERC) Main Programme
Topic(s)
Funding Scheme
HORIZON-ERC - HORIZON ERC GrantsHost institution
80333 Muenchen
Germany