European Commission logo
français français
CORDIS - Résultats de la recherche de l’UE
CORDIS

Multimedia Authoring and Management using your Eyes and Mind

Livrables

D3.2 Multi-modal interaction with meso and high level control paradigms

Prototypes of multi-modal algorithms for meso-level and high-level control combining eye-tracking, EEG and bio-measurements. These algorithms will also become part of the Interaction SDK.

D2.3 - Final integration and optimization of multi-modal sensors

Delivery of the final version of MAMEM’s sensor installation that compared to D2.2 will be further fine-tuned and adapted to the user’s specific disabilities, incorporating the results of the first pilot studies conducted in WP6.

D4.3 – Initial implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the first version of MAMEM’s middleware and interaction SDK that incorporates the first-phase results of WP2 and WP3.

D2.2 - Initial integration and optimization of multi-modal sensors

Delivery of the initial version of MAMEM’s sensor installation, integrating and optimizing the three sensor modalities (eye-tracker, EEG recording system and bio-measurements).

D4.4 – Final implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the final version of MAMEM’s middleware and interaction SDK that incorporates the second-phase results of WP2 and WP3. The technical validation and verification tests of the updated algorithms are also included in this deliverable.

D3.3 Final implementation for the control paradigms of multi-modal interaction

Delivery of the final version of the MAMEM’s algorithms for multi-modal interaction that compared to D3.2 will also incorporate the results of the first-stage experiments conducted in WP6.

D5.2 – Initial design and implementation of the prototype interface applications

This deliverable will incorporate the mock-ups for the design, as well as an initial implementation for the prototype interface applications that will be used during the pilot studies. The prototypes of interface applications will be evaluated on effectiveness (lab studies in changing relevant user behavior and/ or attitudes). This deliverable will also encompass a description of the training cycles (of interface use) necessary for optimizing user acceptation and behaviour change.

D5.3 – Final design and implementation of the prototype interface applications

This deliverable will incorporate the final implementation of the prototype interface applications for managing and authoring multimedia content through the user’s eyes and mind. Compared to D5.2 the emphasis will be more on the development side and the integration with existing tools for managing, creating and sharing multimedia content. Moreover, the results of the first stage pilot trials will be also taken into consideration for improving the interface design.

D8.1 – Project Communication Kit

Initial project publicity material consisting of the project web-site, poster, leaflet and factsheet, as well as the project’s social media accounts (i.e. Twitter, LinkedIn and Facebook).

D1.4 - Data management plan

This deliverable will determine the strategy by which the research data generated by the project will be made open for maximizing their re-use.

D5.1b Update of D5.1 based on the revised requirements of the first-phase pilot trials

This is an update of the D5.1 based on the revised requirements that will result from the first-phase pilot trials.

D5.1 – Report on persuasive design principles, user models and profiles

This deliverable will incorporate a description of the most effective set of principles to derive a specific motivator for the behaviour or attitude change targets, incorporating social inclusion, increasing trust, and diminishing reactance effects. It will also describe MAMEM’s end-users on relevant characteristics as (dis-)abilities, interaction behavior, emotions, intentions, social abilities, extend to which training is needed, and social network, and sensitivity to persuasive strategies. The profiles for the different personas will be also part of this deliverable.

D6.2: Definition of pilot trials with the participation of patients

The report will describe detailed methods for conducting pilot studies with the participation of patients.

D7.1 – Methodology for measuring social integration

This deliverable will report on the results of our literature review about the existing methodologies for quantifying and monitoring social integration. Moreover, by employing the selected methodology for the cases of MAMEM this deliverable will also incorporate the complete portfolio of indicators for assessing the achieved impact on social integration.

D8.5 – Exploitation status report and updated plan

Report summarizing the status of the exploitation activities, the resulting paths for generating revenue and the activities that will be carried out to make the project results sustainable after its completion.

D4.1 Report on the middleware architecture and technical requirements

Description of the designed architecture and specifications including the technologies, the programming environment and the range of functionalities that will be adopted in the implementation of MAMEM’s middleware and SDK.

D6.1: Clinical requirements for the MAMEM platform for each of the patient cohort

The report will describe: (1) The special physical requirements for actual wearing and operation of the platform for each cohort of subjects; (2) Definitions of user interface software requirements, such as menus, screen buttons etc. (3) analyses of questionnaires and focus groups. This report will also include the ethical approvals obtained from the corresponding committees in Greece and Israel.

D6.5: Final report on pilot trials with the participation of patients

The report will describe: (1) Three sets of comprehensive results and analysis of experiments conducted in three clinical sites (2) Recommendations on future clinical use of the platform in terms of additional cohorts of subjects, additional disabilities and additional targets of use.

D7.3 – Study about the connection of natural interfaces and multimedia with the social integration of people with disabilities

This deliverable will accumulate and critically analyze the evidence that will be collected during the course of the project. Analysis will be performed with respect to bringing disabled people back to the society by means of managing and authoring multimedia content through natural human-computer interfaces.

D6.4: Interim report on pilot experiments based on half the subjects, including updated clinical requirements and definitions of clinical trials

The report will describe: (1) Three sets of results and analyses of experiments conducted in three clinical sites (2) Recommendations for modifications of methods for the second set of pilot studies with the participation of patients (3) recommendations for trials related to WP7 (Monitoring social inclusion).

D8.4 – Impact assessment and updated dissemination plan

Report summarizing the project dissemination activities, assessing their impact and suggesting potential corrections to the adopted dissemination strategy.

Publications

Assessing the usability of gaze-adapted Interface against conventional eye-based input emulation

Auteurs: Kumar, Chandan; Menges, Raphael; Staab, Steffen
Publié dans: Numéro 1, 2017
Éditeur: IEEE CBMS
DOI: 10.5281/zenodo.583405

Chromium based Framework to include Gaze Interaction in Web Browser

Auteurs: Kumar, Chandan; Menges, Raphael; Müller, Daniel; Staab, Steffen
Publié dans: Numéro 1, 2017
Éditeur: Proceedings of the 26th International Conference Companion on World Wide Web
DOI: 10.5281/zenodo.583340

Using tailoring to increase the effectiveness of a persuasive game-based training for novel technologies

Auteurs: Fountoukidou, S.; Ham, J.R.C.; Midden, C.J.H.; Matzat, U.
Publié dans: CEUR Workshop Proceedings, 1833, 91 - 96, Numéro 1, 2017
Éditeur: CEUR
DOI: 10.5281/zenodo.583436

Analyzing the Impact of Cognitive Load in Evaluating Gaze-Based Typing

Auteurs: Korok Sengupta, Jun Sun, Raphael Menges, Chandan Kumar, Steffen Staab
Publié dans: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), 2017, Page(s) 787-792, ISBN 978-1-5386-1710-6
Éditeur: IEEE
DOI: 10.1109/CBMS.2017.134

Enhanced representation of web pages for usability analysis with eye tracking

Auteurs: Raphael Menges, Hanadi Tamimi, Chandan Kumar, Tina Walber, Christoph Schaefer, Steffen Staab
Publié dans: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications - ETRA '18, 2018, Page(s) 1-9, ISBN 9781-450357067
Éditeur: ACM Press
DOI: 10.1145/3204493.3204535

eyeGUI - A Novel Framework for Eye-Controlled User Interfaces

Auteurs: Raphael Menges, Chandan Kumar, Korok Sengupta, Steffen Staab
Publié dans: Proceedings of the 9th Nordic Conference on Human-Computer Interaction - NordiCHI '16, 2016, Page(s) 1-6, ISBN 9781-450347631
Éditeur: ACM Press
DOI: 10.1145/2971485.2996756

An Error Aware SSVEP-based BCI

Auteurs: Kalaganis, Fotis; Chatzilari, Elisavet; Georgiadis, Kostas; Nikolopoulos, Spiros; Laskaris, Nikos; Kompatsiaris, Yiannis
Publié dans: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numéro 2, 2017, ISSN 2372-9198
Éditeur: IEEE
DOI: 10.5281/zenodo.583386

GazeTheKey - Interactive Keys to Integrate Word Predictions for Gaze-based Text Entry

Auteurs: Korok Sengupta, Raphael Menges, Chandan Kumar, Steffen Staab
Publié dans: Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion - IUI '17 Companion, 2017, Page(s) 121-124, ISBN 9781-450348935
Éditeur: ACM Press
DOI: 10.1145/3030024.3038259

Detection of Mental Task Related Activity in NIRS-BCI systems Using Dirichlet Energy over Graphs

Auteurs: Petrantonakis, Panagiotis; Kompatsiaris, Ioannis
Publié dans: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18, Numéro 1, 2018
Éditeur: IEEE
DOI: 10.5281/zenodo.1294001

Usability Heuristics for Eye-controlled User Interface

Auteurs: Sengupta, Korok; Kumar, Chandan; Staab, Steffen
Publié dans: COGAIN Symposium: Communication by Gaze Interaction, Numéro 2, 2017
Éditeur: COGAIN Symposium
DOI: 10.5281/zenodo.820917

Hands-Free Web Browsing: Enriching the User Experience with Gaze and Voice Modality

Auteurs: Sengupta, Korok; Ke, Min; Menges, Raphael; Kumar, Chandan; Staab, Steffen
Publié dans: ACM Symposium on Eye Tracking Research and Applications (ETRA 18), Numéro 1, 2018
Éditeur: ACM
DOI: 10.5281/zenodo.1293980

Steady state visual evoked potential detection using Subclass Marginal Fisher Analysis

Auteurs: Anastasios Maronidis, Vangelis P. Oikonomou, Spiros Nikolopoulos, Ioannis Kompatsiaris
Publié dans: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Page(s) 37-41, ISBN 978-1-5090-4603-4
Éditeur: IEEE
DOI: 10.1109/NER.2017.8008286

Sparse Kernel Machines for motor imagery EEG classification

Auteurs: Oikonomou, Vangelis; Nikolopoulos, Spiros; Petrantonakis, Panagiotis; Kompatsiarios, Ioannis
Publié dans: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18), Numéro 1, 2018
Éditeur: IEEE
DOI: 10.5281/zenodo.1294000

Sparse Bayesian Learning for Multiclass Classification with application to SSVEP- BCI

Auteurs: Oikonomou, Vangelis P.; Liaros, Giorgos; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Publié dans: 8th International IEEE/EMBS Conference on Neural Engineering (NER), Numéro 2, 2017, ISSN 1948-3554
Éditeur: IEEE
DOI: 10.5281/zenodo.583431

A comparison study on EEG signal processing techniques using motor imagery EEG data

Auteurs: Oikonomou, Vangelis P.; Georgiadis, Kostas; Liaros, George; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Publié dans: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numéro 2, 2017, ISSN 2372-9198
Éditeur: IEEE
DOI: 10.5281/zenodo.583387

GazeTheWeb - A Gaze-Controlled Web Browser

Auteurs: Raphael Menges, Chandan Kumar, Daniel Müller, Korok Sengupta
Publié dans: Proceedings of the 14th Web for All Conference on The Future of Accessible Work - W4A '17, 2017, Page(s) 1-2, ISBN 9781-450349000
Éditeur: ACM Press
DOI: 10.1145/3058555.3058582

Sparse Bayesian Learning for subject independent classification with application to SSVEP-BCI

Auteurs: Vangelis P. Oikonomou, Anastasios Maronidis, George Liaros, Spiros Nikolopoulos, Ioannis Kompatsiaris
Publié dans: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Page(s) 600-604, ISBN 978-1-5090-4603-4
Éditeur: IEEE
DOI: 10.1109/NER.2017.8008423

Combining the Benefits of CCA and SVMs for SSVEP-based BCIs in Real-world Conditions

Auteurs: Elisavet Chatzilari, Georgios Liarios, Kostas Georgiadis, Spiros Nikolopoulos, Yiannis Kompatsiaris
Publié dans: Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care - MMHealth '17, 2017, Page(s) 3-10, ISBN 9781-450355049
Éditeur: ACM Press
DOI: 10.1145/3132635.3132636

A Collaborative Representation Approach to Detecting Error-Related Potentials in SSVEP-BCIs

Auteurs: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Nikos A. Laskaris, Yiannis Kompatsiaris
Publié dans: Proceedings of the on Thematic Workshops of ACM Multimedia 2017 - Thematic Workshops '17, 2017, Page(s) 262-270, ISBN 9781-450354165
Éditeur: ACM Press
DOI: 10.1145/3126686.3129334

Computer uses and difficulties in Parkinson’s disease

Auteurs: Z. Katsarou, M. Plotnik, G. Zeilig, A. Gottlieb, R. Kizony, S. Bostantjopoulou
Publié dans: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders, 2016
Éditeur: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders

Computer use aspects in patients with motor disabilities

Auteurs: Bostantjopoulou, Sevasti; Plotnick, Meir; Zeilig, Gabi; Gottlieb, Amihai; Kizony, Amihai; Chlomissiou, Sissy; Nichogiannopoulou, Ariana; Katsarou, Zoe
Publié dans: 2nd Congress of the European Academy of Neurology (EAN'2016), 2016
Éditeur: 2nd Congress of the European Academy of Neurology (EAN'2016)

MAMEM – A novel computer brain interface platform for enhancing social interaction of people with disabilities – Clinical requirements resulting from focus groups and literature survey

Auteurs: Zeilig, Gabi; Gottlieb, Amihai; Kizony, Rachel; Katsarou, Zoe; Bostantzopoulou, Sevasti; Nichgiannopoulou, Ariana; Chlomissiou, Sissy; Plotnik, Meir
Publié dans: 20th European Congress of Physical and Rehabilitation Medicine, 2016
Éditeur: 20th European Congress of Physical and Rehabilitation Medicine

Parkinson’s disease impact on computer use. A patients’ and caregivers perspective

Auteurs: Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Rachael Kizony, Sevasti Bostantjopoulou-Kambouroglou
Publié dans: The American Academy of Neurology 69th Annual Meeting, 2017
Éditeur: Neurology

Clinical Research Example – MAMEM – Multimedia Authoring and Management Using Your Eyes and Mind

Auteurs: Dr. Meir PLOTNIK, Mr. Amihai GOTTLIEB, Dr. Rachel KIZONY, Dr. Zoe KATSAROU, Dr. Sevasti BOSTANTZOPOULOU, Ms. Ariana NICHOGIANNOPOULOU, Ms. Sissy CHLOMISSIOU, Dr. Gabi ZEILIG,
Publié dans: Rehab science and technology update (RSTU), 2016
Éditeur: Rehab science and technology update (RSTU)

The importance of using computers in populations with Parkinson’s disease and spinal cord injury: a patients’ and caregivers’ perspective

Auteurs: Meir Plotnik, Zoe Katsarou, Amihai Gotlieb, Adam Grinberg, Rachel Kizony, Gabi Zeilig, Sevasti Bostantjopoulou-Kambouroglou
Publié dans: SfN’s 47th annual meeting in Neuroscience, 2017
Éditeur: SfN’s 47th annual meeting in Neuroscience

Finding Kairos: The Influence of Context-Based Timing on Compliance with Well-Being Triggers

Auteurs: Jaap Ham, Jef van Schendel, Saskia Koldijk, Evangelia Demerouti
Publié dans: Symbiotic 2016, 2017, Page(s) 89-101
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-57753-1_8

Using personalized persuasive strategies to increase acceptance and use of HCI technology

Auteurs: Sofia Fountoukidou, Jaap Ham, Peter Ruijten, and Uwe Matzat
Publié dans: Adjunct Proceedings of the 11th International Conference on Persuasive Technology, 2016
Éditeur: Adjunct Proceedings of the 11th International Conference on Persuasive Technology

Using an Artificial Agent as a Behavior Model to Promote Assistive Technology Acceptance

Auteurs: Sofia Fountoukidou, Jaap Ham, Uwe Matzat, Cees Midden
Publié dans: PERSUASIVE 2018, 2018, Page(s) 285-296
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-78978-1_24

Schau genau! A Gaze-Controlled 3D Game for Entertainment and Education

Auteurs: Menges, Raphael and Kumar, Chandan and Wechselberger, Ulrich and Schaefer, Christoph and Walber, Tina and Staab, Steffen
Publié dans: COGAIN Symposium, 2017
Éditeur: COGAIN Symposium

Ambiguous Agents: The Influence of Consistency of an Artificial Agent’s Social Cues on Emotion Recognition, Recall, and Persuasiveness

Auteurs: Peter A. M. Ruijten, Cees J. H. Midden, Jaap Ham
Publié dans: International Journal of Human–Computer Interaction, Numéro 32/9, 2016, Page(s) 734-744, ISSN 1044-7318
Éditeur: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10447318.2016.1193350

EEG-Based Brain–Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21st Century

Auteurs: Ioulietta Lazarou, Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Ioannis Kompatsiaris, Magda Tsolaki
Publié dans: Frontiers in Human Neuroscience, Numéro 12, 2018, ISSN 1662-5161
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fnhum.2018.00014

A multimodal dataset for authoring and editing multimedia content: The MAMEM project

Auteurs: Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Kostas Georgiadis, Fotis Kalaganis, Georgios Liaros, Ioulietta Lazarou, Katerina Adam, Anastasios Papazoglou-Chalikias, Elisavet Chatzilari, Vangelis P. Oikonomou, Chandan Kumar, Raphael Menges, Steffen Staab, Daniel Müller, Korok Sengupta, Sevasti Bostantjopoulou, Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Racheli Kizoni, Sofia Foun
Publié dans: Data in Brief, Numéro 15, 2017, Page(s) 1048-1056, ISSN 2352-3409
Éditeur: Elsevier BV
DOI: 10.1016/j.dib.2017.10.072

Eye-Controlled Interfaces for Multimedia Interaction

Auteurs: Chandan Kumar, Raphael Menges, Steffen Staab
Publié dans: IEEE MultiMedia, Numéro 23/4, 2016, Page(s) 6-13, ISSN 1070-986X
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2016.52

The influence of social cues in persuasive social robots on psychological reactance and compliance

Auteurs: Ghazali, Aimi Shazwani; Ham, Jaap; Barakova, Emilia; Markopoulos, Panos
Publié dans: International Journal of Human–Computer Interaction, Numéro 1, 2018, ISSN 1044-7318
Éditeur: Lawrence Erlbaum Associates Inc.
DOI: 10.5281/zenodo.1294005

Discriminative codewaves: a symbolic dynamics approach to SSVEP recognition for asynchronous BCI

Auteurs: K Georgiadis, N Laskaris, S Nikolopoulos, I Kompatsiaris
Publié dans: Journal of Neural Engineering, Numéro 15/2, 2018, Page(s) 026008, ISSN 1741-2560
Éditeur: Institute of Physics Publishing
DOI: 10.1088/1741-2552/aa904c

Effects of Robot Facial Characteristics and Gender in Persuasive Human-Robot Interaction

Auteurs: Aimi S. Ghazali, Jaap Ham, Emilia I. Barakova, Panos Markopoulos
Publié dans: Frontiers in Robotics and AI, Numéro 5, 2018, ISSN 2296-9144
Éditeur: Frontiers in Robotics and AI
DOI: 10.3389/frobt.2018.00073

An error-aware gaze-based keyboard by means of a hybrid BCI system

Auteurs: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Ioannis Kompatsiaris, Nikos A. Laskaris
Publié dans: Scientific Reports, Numéro 8/1, 2018, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-018-31425-2

Single-Trial NIRS Data Classification for Brain–Computer Interfaces Using Graph Signal Processing

Auteurs: Panagiotis C. Petrantonakis, Ioannis Kompatsiaris
Publié dans: IEEE Transactions on Neural Systems and Rehabilitation Engineering, Numéro 26/9, 2018, Page(s) 1700-1709, ISSN 1534-4320
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TNSRE.2018.2860629

Comparative evaluation of state-of-the-art algorithms for SSVEP-based BCIs

Auteurs: Oikonomou, Vangelis P.; Liaros, Georgios; Georgiadis, Kostantinos; Chatzilari, Elisavet; Adam, Katerina; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Publié dans: Numéro 1, 2016
Éditeur: arxiv

The MAMEM Project - A dataset for multimodal human-computer interaction using biosignals and eye tracking information

Auteurs: Nikolopoulos,Spiros; Georgiadis, Kostas; Kalaganis, Fotis; Liaros, Georgios; Lazarou, Ioulietta; Adam, Katerina; Papazoglou-Chalikias Anastasios; Chatzilari, Elisavet; Oikonomou, P. Vangelis; Petrantonakis, C. Panagiotis; Kompatsiaris, I.; Kumar, Chandan; Menges, Raphael; Staab, Steffen; Müller, Daniel; Sengupta, Korok; Bostantjopoulou, Sevasti; Katsarou, Zoe; Zeilig, Gabi; Plotnin, Meir; Gottlie
Publié dans: 2017
Éditeur: zenodo
DOI: 10.5281/zenodo.834154

Recherche de données OpenAIRE...

Une erreur s’est produite lors de la recherche de données OpenAIRE

Aucun résultat disponible