CORDIS
EU research results

CORDIS

English EN
INtelligeNt ApplicatiOns oVer Large ScAle DaTa StrEams

INtelligeNt ApplicatiOns oVer Large ScAle DaTa StrEams

Objective

Large scale data analytics is the key research domain for future data driven applications as numerous of devices produce huge volumes of data in the form of streams. Analytics services can offer the necessary basis for building intelligent decision making mechanisms to support novel applications. Due to the huge volumes of data, analytics should be based on efficient schemes for querying large scale data partitions. Partitions contain only a piece of data and a dedicated processor manages the incoming queries. The management of continuous queries over data streams is a challenging research issue requiring intelligent methods to derive the final outcome (i.e., query response) in limited time with maximum performance. The management process of continuous queries involves their assignment to specific processors and the processing of the derived responses. We focus on a group of query controllers serving the incoming queries and, thus, becoming the connection of big data systems with the real world. INNOVATE proposes solutions for the management of the controllers behavior. We propose an intelligent decision making process for each controller in three axes: (i) top-down, by realizing a mechanism that assigns queries to the underlying processors; (ii) bottom-up, by proposing decision making mechanisms for returning responses to users/applications on top of early results; (iii) horizontal, by proposing optimization schemes for queries management. We adopt a pool of learning schemes and an ensemble learning model dealing with how and on which processors each query should be assigned. We also propose specific schemes for combining processors responses. Intelligent and optimization techniques are adopted for the controllers group management. Machine learning, Computational Intelligence and optimization are the key adopted technologies that, when combined, provide efficient solutions to a challenging problem like the support of intelligent analytics over big data streams.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSITY OF GLASGOW

Address

University Avenue
G12 8qq Glasgow

United Kingdom

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 195 454,80

Project information

Grant agreement ID: 745829

Status

Ongoing project

  • Start date

    1 April 2018

  • End date

    31 March 2020

Funded under:

H2020-EU.1.3.2.

  • Overall budget:

    € 195 454,80

  • EU contribution

    € 195 454,80

Coordinated by:

UNIVERSITY OF GLASGOW

United Kingdom