Skip to main content

Multimedia Authoring and Management using your Eyes and Mind

Objective

Loss of the voluntary muscular control while preserving cognitive functions is a common symptom of neuromuscular disorders leading to a variety of functional deficits, including the ability to operate software tools that require the use of conventional interfaces like mouse, key-board, or touch-screens. As a result, the affected individuals are marginalized and unable to keep up with the rest of the society in a digitized world. MAMEM's goal is to integrate these people back into society by increasing their potential for communication and exchange in leisure (e.g. social networks) and non-leisure context (e.g. workplace). In this direction, MAMEM delivers the technology to enable interface channels that can be controlled through eye-movements and mental commands. This is accomplished by extending the core API of current operating systems with advanced function calls, appropriate for accessing the signals captured by an eye-tracker, an EEG-recorder and bio-measurement sensors. Then, pattern recognition and tracking algorithms are employed to jointly translate these signals into meaningful control and enable a set of novel paradigms for multimodal interaction. These paradigms will allow for low- (e.g. move a mouse), meso- (e.g. tick a box) and high-level (e.g. select n-out-of-m items) control of interface applications through eyes and mind. A set of persuasive design principles together with profiles modeling the users (dis-)abilities will be also employed for designing adapted interfaces for disabled. MAMEM will engage three different cohorts of disabled (i.e. Parkinson's disease, muscular disorders, and tetraplegia) that will be asked to test a set of prototype applications dealing with multimedia authoring and management. MAMEM's final objective is to assess the impact of this technology in making these people more socially integrated by, for instance, becoming more active in sharing content through social networks and communicating with their friends and family

Call for proposal

H2020-ICT-2014-1
See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Coordinator

ETHNIKO KENTRO EREVNAS KAI TECHNOLOGIKIS ANAPTYXIS
Address
Charilaou Thermi Road 6 Km
57001 Thermi Thessaloniki
Greece
Activity type
Research Organisations
EU contribution
€ 606 167,51

Participants (7)

UNIVERSITAET KOBLENZ-LANDAU
Germany
EU contribution
€ 487 782,50
Address
Rhabanusstrasse 3
55118 Mainz
Activity type
Higher or Secondary Education Establishments
EB NEURO SPA
Italy
EU contribution
€ 365 250
Address
Via Pietro Fanfani 97/A
50127 Firenze
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
SENSOMOTORIC INSTRUMENTS GESELLSCHAFT FUR INNOVATIVE SENSORIK MBH
Germany
EU contribution
€ 227 625
Address
Warthestrasse 21
14513 Teltow
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
TECHNISCHE UNIVERSITEIT EINDHOVEN
Netherlands
EU contribution
€ 311 875
Address
Groene Loper 3
5612 AE Eindhoven
Activity type
Higher or Secondary Education Establishments
MDA ELLAS SOMATEIO GIA TI FRONTIDATON ATOMON ME NEVROMYIKES PATHISEIS
Greece
EU contribution
€ 191 687,49
Address
Elpidos 6
10434 Athina
Activity type
Other
ARISTOTELIO PANEPISTIMIO THESSALONIKIS
Greece
EU contribution
€ 169 375
Address
Kedea Building, Tritis Septemvriou, Aristotle Univ Campus
54636 Thessaloniki
Activity type
Higher or Secondary Education Establishments
MEDICAL RESEARCH INFRASTRUCTURE DEVELOPMENT AND HEALTH SERVICES FUND BY THE SHEBA MEDICAL CENTER
Israel
EU contribution
€ 344 612,50
Address
Tel Hashomer Sheba Medical Center
52621 Ramat Gan
Activity type
Research Organisations