Skip to main content

Scalable Autonomic Streaming Middleware for Real-time Processing of Massive Data Flows

Project description

Service and Software Architectures, Infrastructures and Engineering
Want to process all credit card transactions in Europe in real time? No luck, today's computers cannot do it. Unless, of course, you use technology from STREAM project.

A growing number of applications require the ability to analyze massive amounts of streaming data in real time. A few examples: stock market data processing, anti-spam and anti-virus filters for e-mail, network security systems for incoming IP traffic in organisation-wide networks, automatic trading, fraud detection for cellular telephony to analyze and correlate phone calls, fraud detection for credit cards, and e-services for verifying the respect of service level agreements.

Typically, such applications require strong analysis and processing capabilities, i.e. data mining, to discover facts of interest.

Data analysis happens today on clusters of workstations using specialized middleware and applications.


Although solutions for real-time processing of information flows already exist, current platforms and infrastructures face three main limitations:

(a) scalability: the number of processing nodes is upwards limited 

(b) autonomy: support from IT experts is needed to keep the system working over the time

(c) performance: some problems cannot be managed, because the raw amount of data to be processed is too large.


STREAM aims at scaling system size by an order of magnitude, to 100s of nodes, achieving real-time processing of information flows, and providing unsupervised and autonomous operation. This will allow for much broader deployment of such products and services to new areas that need to manipulate large information flows in a cost-effective manner, and in particular, the Telecom, Financial, and E-services sectors.

Call for proposal

FP7-ICT-2007-1
See other projects for this call

Coordinator Contact

Ricardo Jimenez-Peris (Prof.)

Coordinator

UNIVERSIDAD POLITECNICA DE MADRID
Address
Calle Ramiro De Maeztu 7 Edificio Rectorado
28040 Madrid
Spain

See on map

Activity type
Higher or Secondary Education Establishments
EU contribution
€ 494 365

Participants (6)

TECHNISCHE UNIVERSITAET DRESDEN
Germany
EU contribution
€ 399 300
Address
Helmholtzstrasse 10
01069 Dresden

See on map

Activity type
Higher or Secondary Education Establishments
TELEFONICA INVESTIGACION Y DESARROLLO SA
Spain
EU contribution
€ 398 009
Address
Ronda De La Comunicacion S/n Distrito C Edificio Oeste I
28050 Madrid

See on map

Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
TELEFONICA SOLUCIONES DE INFORMATICA Y COMUNICACIONES DE ESPANA SA

Participation ended

Spain
EU contribution
€ 10 042
Address
Ronda De La Comunicacion S/n Edificio Norte 2
28050 Madrid

See on map

Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
IDRYMA TECHNOLOGIAS KAI EREVNAS
Greece
EU contribution
€ 485 002
Address
N Plastira Str 100
70013 Irakleio

See on map

Activity type
Research Organisations
EXODUS ANONYMOS ETAIREIA PLIROFORIKIS
Greece
EU contribution
€ 415 159
Address
Estias 1 & Mesogeion 73-75
11526 Athina

See on map

Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
EPSILON S.R.L.
Italy
EU contribution
€ 407 720
Address
Via Carlo Poerio 89 A
80121 Napoli

See on map

Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)