Skip to main content

Scalable Autonomic Streaming Middleware for Real-time Processing of Massive Data Flows

Project description

Service and Software Architectures, Infrastructures and Engineering Want to process all credit card transactions in Europe in real time? No luck, today's computers cannot do it. Unless, of course, you use technology from STREAM project.

A growing number of applications require the ability to analyze massive amounts of streaming data in real time. A few examples: stock market data processing, anti-spam and anti-virus filters for e-mail, network security systems for incoming IP traffic in organisation-wide networks, automatic trading, fraud detection for cellular telephony to analyze and correlate phone calls, fraud detection for credit cards, and e-services for verifying the respect of service level agreements.

Typically, such applications require strong analysis and processing capabilities, i.e., data mining, to discover facts of interest.

Data analysis happens today on clusters of workstations using specialized middleware and applications.


Although solutions for real-time processing of information flows already exist, current platforms and infrastructures face three main limitations:

(a) scalability: the number of processing nodes is upwards limited 

(b) autonomy: support from IT experts is needed to keep the system working over the time

(c) performance: some problems cannot be managed, because the raw amount of data to be processed is too large.


STREAM aims at scaling system size by an order of magnitude, to 100s of nodes, achieving real-time processing of information flows, and providing unsupervised and autonomous operation. This will allow for much broader deployment of such products and services to new areas that need to manipulate large information flows in a cost-effective manner, and in particular, the Telecom, Financial, and E-services sectors.

Field of science

  • /social sciences/economics and business/business and management/commerce
  • /natural sciences/computer and information sciences/computer security/network security
  • /social sciences/political science/government systems/e-governance
  • /social sciences/sociology/governance/public services
  • /natural sciences/computer and information sciences/data science/data processing
  • /natural sciences/computer and information sciences/data science/data analysis
  • /natural sciences/computer and information sciences/data science/data mining

Call for proposal

FP7-ICT-2007-1
See other projects for this call

Funding Scheme

CP - Collaborative project (generic)

Coordinator Contact

Ricardo Jimenez-Peris (Prof.)

Coordinator

UNIVERSIDAD POLITECNICA DE MADRID
Address
Calle Ramiro De Maeztu 7 Edificio Rectorado
28040 Madrid
Spain
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 494 365
Administrative Contact
Gonzalo Leon (Prof.)

Participants (6)

TECHNISCHE UNIVERSITAET DRESDEN
Germany
EU contribution
€ 399 300
Address
Helmholtzstrasse 10
01069 Dresden
Activity type
Higher or Secondary Education Establishments
Administrative Contact
Christin Jung (Ms.)
TELEFONICA INVESTIGACION Y DESARROLLO SA
Spain
EU contribution
€ 398 009
Address
Ronda De La Comunicacion S/n Distrito C Edificio Oeste I
28050 Madrid
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative Contact
Luis López de Ayala Hidalgo (Mr.)
TELEFONICA SOLUCIONES DE INFORMATICA Y COMUNICACIONES DE ESPANA SA

Participation ended

Spain
EU contribution
€ 10 042
Address
Ronda De La Comunicacion S/n Edificio Norte 2
28050 Madrid
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative Contact
Francisco Javier Enríquez de Salamanca Müller (Mr.)
IDRYMA TECHNOLOGIAS KAI EREVNAS
Greece
EU contribution
€ 485 002
Address
N Plastira Str 100
70013 Irakleio
Activity type
Research Organisations
Administrative Contact
Zinovia Papatheodorou (Mrs.)
EXODUS ANONYMOS ETAIREIA PLIROFORIKIS
Greece
EU contribution
€ 415 159
Address
Estias 1 & Mesogeion 73-75
11526 Athina
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative Contact
Anastasia Garbi (Ms)
EPSILON S.R.L.
Italy
EU contribution
€ 407 720
Address
Via Carlo Poerio 89 A
80121 Napoli
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative Contact
Danilo De Mari (Mr)