Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Elastic and transparent scaling for stream processing applications

Objective

Stream processing applications process high-volume, continuous feeds from live data sources, employ data-in-motion analytics to analyze these feeds, and produce near real-time results with low latency. With the explosion in the amount of data available as live feeds, stream computing has found wide applications in areas ranging from telecommunications to health-care to cyber-security. The high volume of the data to be processed, the velocity at which the results need to be produced, and the variety of the data sources involved make stream processing applications unique and challenging. One of the major limitations of existing stream processing middleware is their inability to take advantage of parallelism opportunities that exist in stream processing applications, in order to scale in the presence of additional resources and workload. This often requires manual intervention by the application developers to specify what is 'safe' to parallelize and/or how much parallelization is 'profitable'. Yet another challenge is to dynamically adapt to the changes in workload and resource availability. We propose system-level techniques that address these challenges via 'transparent' and 'elastic' scaling. The transparent nature of the scaling means that the application developers do not need to specify what parts of the application is safe to parallelize, and instead this information will be derived through automatic analysis.The elastic nature of the scaling means that the level of parallelism is dynamically adjusted as resource and workload availability changes. Furthermore, in the presence of multiple kinds of parallelism as well as multiple instances of application segments that can benefit from these, we propose techniques to effectively manage resources in order to maximize application performance.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP7-PEOPLE-2012-CIG
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

MC-CIG - Support for training and career development of researcher (CIG)

Coordinator

BILKENT UNIVERSITESI VAKIF
EU contribution
€ 100 000,00
Address
ESKISEHIR YOLU 8 KM
06800 BILKENT ANKARA
Türkiye

See on map

Region
Batı Anadolu Ankara Ankara
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data
My booklet 0 0