European Commission logo
italiano italiano
CORDIS - Risultati della ricerca dell’UE
CORDIS

Multimedia Authoring and Management using your Eyes and Mind

Risultati finali

D3.2 Multi-modal interaction with meso and high level control paradigms

Prototypes of multi-modal algorithms for meso-level and high-level control combining eye-tracking, EEG and bio-measurements. These algorithms will also become part of the Interaction SDK.

D2.3 - Final integration and optimization of multi-modal sensors

Delivery of the final version of MAMEM’s sensor installation that compared to D2.2 will be further fine-tuned and adapted to the user’s specific disabilities, incorporating the results of the first pilot studies conducted in WP6.

D4.3 – Initial implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the first version of MAMEM’s middleware and interaction SDK that incorporates the first-phase results of WP2 and WP3.

D2.2 - Initial integration and optimization of multi-modal sensors

Delivery of the initial version of MAMEM’s sensor installation, integrating and optimizing the three sensor modalities (eye-tracker, EEG recording system and bio-measurements).

D4.4 – Final implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the final version of MAMEM’s middleware and interaction SDK that incorporates the second-phase results of WP2 and WP3. The technical validation and verification tests of the updated algorithms are also included in this deliverable.

D3.3 Final implementation for the control paradigms of multi-modal interaction

Delivery of the final version of the MAMEM’s algorithms for multi-modal interaction that compared to D3.2 will also incorporate the results of the first-stage experiments conducted in WP6.

D5.2 – Initial design and implementation of the prototype interface applications

This deliverable will incorporate the mock-ups for the design, as well as an initial implementation for the prototype interface applications that will be used during the pilot studies. The prototypes of interface applications will be evaluated on effectiveness (lab studies in changing relevant user behavior and/ or attitudes). This deliverable will also encompass a description of the training cycles (of interface use) necessary for optimizing user acceptation and behaviour change.

D5.3 – Final design and implementation of the prototype interface applications

This deliverable will incorporate the final implementation of the prototype interface applications for managing and authoring multimedia content through the user’s eyes and mind. Compared to D5.2 the emphasis will be more on the development side and the integration with existing tools for managing, creating and sharing multimedia content. Moreover, the results of the first stage pilot trials will be also taken into consideration for improving the interface design.

D8.1 – Project Communication Kit

Initial project publicity material consisting of the project web-site, poster, leaflet and factsheet, as well as the project’s social media accounts (i.e. Twitter, LinkedIn and Facebook).

D1.4 - Data management plan

This deliverable will determine the strategy by which the research data generated by the project will be made open for maximizing their re-use.

D5.1b Update of D5.1 based on the revised requirements of the first-phase pilot trials

This is an update of the D5.1 based on the revised requirements that will result from the first-phase pilot trials.

D5.1 – Report on persuasive design principles, user models and profiles

This deliverable will incorporate a description of the most effective set of principles to derive a specific motivator for the behaviour or attitude change targets, incorporating social inclusion, increasing trust, and diminishing reactance effects. It will also describe MAMEM’s end-users on relevant characteristics as (dis-)abilities, interaction behavior, emotions, intentions, social abilities, extend to which training is needed, and social network, and sensitivity to persuasive strategies. The profiles for the different personas will be also part of this deliverable.

D6.2: Definition of pilot trials with the participation of patients

The report will describe detailed methods for conducting pilot studies with the participation of patients.

D7.1 – Methodology for measuring social integration

This deliverable will report on the results of our literature review about the existing methodologies for quantifying and monitoring social integration. Moreover, by employing the selected methodology for the cases of MAMEM this deliverable will also incorporate the complete portfolio of indicators for assessing the achieved impact on social integration.

D8.5 – Exploitation status report and updated plan

Report summarizing the status of the exploitation activities, the resulting paths for generating revenue and the activities that will be carried out to make the project results sustainable after its completion.

D4.1 Report on the middleware architecture and technical requirements

Description of the designed architecture and specifications including the technologies, the programming environment and the range of functionalities that will be adopted in the implementation of MAMEM’s middleware and SDK.

D6.1: Clinical requirements for the MAMEM platform for each of the patient cohort

The report will describe: (1) The special physical requirements for actual wearing and operation of the platform for each cohort of subjects; (2) Definitions of user interface software requirements, such as menus, screen buttons etc. (3) analyses of questionnaires and focus groups. This report will also include the ethical approvals obtained from the corresponding committees in Greece and Israel.

D6.5: Final report on pilot trials with the participation of patients

The report will describe: (1) Three sets of comprehensive results and analysis of experiments conducted in three clinical sites (2) Recommendations on future clinical use of the platform in terms of additional cohorts of subjects, additional disabilities and additional targets of use.

D7.3 – Study about the connection of natural interfaces and multimedia with the social integration of people with disabilities

This deliverable will accumulate and critically analyze the evidence that will be collected during the course of the project. Analysis will be performed with respect to bringing disabled people back to the society by means of managing and authoring multimedia content through natural human-computer interfaces.

D6.4: Interim report on pilot experiments based on half the subjects, including updated clinical requirements and definitions of clinical trials

The report will describe: (1) Three sets of results and analyses of experiments conducted in three clinical sites (2) Recommendations for modifications of methods for the second set of pilot studies with the participation of patients (3) recommendations for trials related to WP7 (Monitoring social inclusion).

D8.4 – Impact assessment and updated dissemination plan

Report summarizing the project dissemination activities, assessing their impact and suggesting potential corrections to the adopted dissemination strategy.

Pubblicazioni

Assessing the usability of gaze-adapted Interface against conventional eye-based input emulation

Autori: Kumar, Chandan; Menges, Raphael; Staab, Steffen
Pubblicato in: Numero 1, 2017
Editore: IEEE CBMS
DOI: 10.5281/zenodo.583405

Chromium based Framework to include Gaze Interaction in Web Browser

Autori: Kumar, Chandan; Menges, Raphael; Müller, Daniel; Staab, Steffen
Pubblicato in: Numero 1, 2017
Editore: Proceedings of the 26th International Conference Companion on World Wide Web
DOI: 10.5281/zenodo.583340

Using tailoring to increase the effectiveness of a persuasive game-based training for novel technologies

Autori: Fountoukidou, S.; Ham, J.R.C.; Midden, C.J.H.; Matzat, U.
Pubblicato in: CEUR Workshop Proceedings, 1833, 91 - 96, Numero 1, 2017
Editore: CEUR
DOI: 10.5281/zenodo.583436

Analyzing the Impact of Cognitive Load in Evaluating Gaze-Based Typing

Autori: Korok Sengupta, Jun Sun, Raphael Menges, Chandan Kumar, Steffen Staab
Pubblicato in: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), 2017, Pagina/e 787-792, ISBN 978-1-5386-1710-6
Editore: IEEE
DOI: 10.1109/CBMS.2017.134

Enhanced representation of web pages for usability analysis with eye tracking

Autori: Raphael Menges, Hanadi Tamimi, Chandan Kumar, Tina Walber, Christoph Schaefer, Steffen Staab
Pubblicato in: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications - ETRA '18, 2018, Pagina/e 1-9, ISBN 9781-450357067
Editore: ACM Press
DOI: 10.1145/3204493.3204535

eyeGUI - A Novel Framework for Eye-Controlled User Interfaces

Autori: Raphael Menges, Chandan Kumar, Korok Sengupta, Steffen Staab
Pubblicato in: Proceedings of the 9th Nordic Conference on Human-Computer Interaction - NordiCHI '16, 2016, Pagina/e 1-6, ISBN 9781-450347631
Editore: ACM Press
DOI: 10.1145/2971485.2996756

An Error Aware SSVEP-based BCI

Autori: Kalaganis, Fotis; Chatzilari, Elisavet; Georgiadis, Kostas; Nikolopoulos, Spiros; Laskaris, Nikos; Kompatsiaris, Yiannis
Pubblicato in: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numero 2, 2017, ISSN 2372-9198
Editore: IEEE
DOI: 10.5281/zenodo.583386

GazeTheKey - Interactive Keys to Integrate Word Predictions for Gaze-based Text Entry

Autori: Korok Sengupta, Raphael Menges, Chandan Kumar, Steffen Staab
Pubblicato in: Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion - IUI '17 Companion, 2017, Pagina/e 121-124, ISBN 9781-450348935
Editore: ACM Press
DOI: 10.1145/3030024.3038259

Detection of Mental Task Related Activity in NIRS-BCI systems Using Dirichlet Energy over Graphs

Autori: Petrantonakis, Panagiotis; Kompatsiaris, Ioannis
Pubblicato in: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18, Numero 1, 2018
Editore: IEEE
DOI: 10.5281/zenodo.1294001

Usability Heuristics for Eye-controlled User Interface

Autori: Sengupta, Korok; Kumar, Chandan; Staab, Steffen
Pubblicato in: COGAIN Symposium: Communication by Gaze Interaction, Numero 2, 2017
Editore: COGAIN Symposium
DOI: 10.5281/zenodo.820917

Hands-Free Web Browsing: Enriching the User Experience with Gaze and Voice Modality

Autori: Sengupta, Korok; Ke, Min; Menges, Raphael; Kumar, Chandan; Staab, Steffen
Pubblicato in: ACM Symposium on Eye Tracking Research and Applications (ETRA 18), Numero 1, 2018
Editore: ACM
DOI: 10.5281/zenodo.1293980

Steady state visual evoked potential detection using Subclass Marginal Fisher Analysis

Autori: Anastasios Maronidis, Vangelis P. Oikonomou, Spiros Nikolopoulos, Ioannis Kompatsiaris
Pubblicato in: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Pagina/e 37-41, ISBN 978-1-5090-4603-4
Editore: IEEE
DOI: 10.1109/NER.2017.8008286

Sparse Kernel Machines for motor imagery EEG classification

Autori: Oikonomou, Vangelis; Nikolopoulos, Spiros; Petrantonakis, Panagiotis; Kompatsiarios, Ioannis
Pubblicato in: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18), Numero 1, 2018
Editore: IEEE
DOI: 10.5281/zenodo.1294000

Sparse Bayesian Learning for Multiclass Classification with application to SSVEP- BCI

Autori: Oikonomou, Vangelis P.; Liaros, Giorgos; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Pubblicato in: 8th International IEEE/EMBS Conference on Neural Engineering (NER), Numero 2, 2017, ISSN 1948-3554
Editore: IEEE
DOI: 10.5281/zenodo.583431

A comparison study on EEG signal processing techniques using motor imagery EEG data

Autori: Oikonomou, Vangelis P.; Georgiadis, Kostas; Liaros, George; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Pubblicato in: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numero 2, 2017, ISSN 2372-9198
Editore: IEEE
DOI: 10.5281/zenodo.583387

GazeTheWeb - A Gaze-Controlled Web Browser

Autori: Raphael Menges, Chandan Kumar, Daniel Müller, Korok Sengupta
Pubblicato in: Proceedings of the 14th Web for All Conference on The Future of Accessible Work - W4A '17, 2017, Pagina/e 1-2, ISBN 9781-450349000
Editore: ACM Press
DOI: 10.1145/3058555.3058582

Sparse Bayesian Learning for subject independent classification with application to SSVEP-BCI

Autori: Vangelis P. Oikonomou, Anastasios Maronidis, George Liaros, Spiros Nikolopoulos, Ioannis Kompatsiaris
Pubblicato in: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Pagina/e 600-604, ISBN 978-1-5090-4603-4
Editore: IEEE
DOI: 10.1109/NER.2017.8008423

Combining the Benefits of CCA and SVMs for SSVEP-based BCIs in Real-world Conditions

Autori: Elisavet Chatzilari, Georgios Liarios, Kostas Georgiadis, Spiros Nikolopoulos, Yiannis Kompatsiaris
Pubblicato in: Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care - MMHealth '17, 2017, Pagina/e 3-10, ISBN 9781-450355049
Editore: ACM Press
DOI: 10.1145/3132635.3132636

A Collaborative Representation Approach to Detecting Error-Related Potentials in SSVEP-BCIs

Autori: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Nikos A. Laskaris, Yiannis Kompatsiaris
Pubblicato in: Proceedings of the on Thematic Workshops of ACM Multimedia 2017 - Thematic Workshops '17, 2017, Pagina/e 262-270, ISBN 9781-450354165
Editore: ACM Press
DOI: 10.1145/3126686.3129334

Computer uses and difficulties in Parkinson’s disease

Autori: Z. Katsarou, M. Plotnik, G. Zeilig, A. Gottlieb, R. Kizony, S. Bostantjopoulou
Pubblicato in: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders, 2016
Editore: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders

Computer use aspects in patients with motor disabilities

Autori: Bostantjopoulou, Sevasti; Plotnick, Meir; Zeilig, Gabi; Gottlieb, Amihai; Kizony, Amihai; Chlomissiou, Sissy; Nichogiannopoulou, Ariana; Katsarou, Zoe
Pubblicato in: 2nd Congress of the European Academy of Neurology (EAN'2016), 2016
Editore: 2nd Congress of the European Academy of Neurology (EAN'2016)

MAMEM – A novel computer brain interface platform for enhancing social interaction of people with disabilities – Clinical requirements resulting from focus groups and literature survey

Autori: Zeilig, Gabi; Gottlieb, Amihai; Kizony, Rachel; Katsarou, Zoe; Bostantzopoulou, Sevasti; Nichgiannopoulou, Ariana; Chlomissiou, Sissy; Plotnik, Meir
Pubblicato in: 20th European Congress of Physical and Rehabilitation Medicine, 2016
Editore: 20th European Congress of Physical and Rehabilitation Medicine

Parkinson’s disease impact on computer use. A patients’ and caregivers perspective

Autori: Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Rachael Kizony, Sevasti Bostantjopoulou-Kambouroglou
Pubblicato in: The American Academy of Neurology 69th Annual Meeting, 2017
Editore: Neurology

Clinical Research Example – MAMEM – Multimedia Authoring and Management Using Your Eyes and Mind

Autori: Dr. Meir PLOTNIK, Mr. Amihai GOTTLIEB, Dr. Rachel KIZONY, Dr. Zoe KATSAROU, Dr. Sevasti BOSTANTZOPOULOU, Ms. Ariana NICHOGIANNOPOULOU, Ms. Sissy CHLOMISSIOU, Dr. Gabi ZEILIG,
Pubblicato in: Rehab science and technology update (RSTU), 2016
Editore: Rehab science and technology update (RSTU)

The importance of using computers in populations with Parkinson’s disease and spinal cord injury: a patients’ and caregivers’ perspective

Autori: Meir Plotnik, Zoe Katsarou, Amihai Gotlieb, Adam Grinberg, Rachel Kizony, Gabi Zeilig, Sevasti Bostantjopoulou-Kambouroglou
Pubblicato in: SfN’s 47th annual meeting in Neuroscience, 2017
Editore: SfN’s 47th annual meeting in Neuroscience

Finding Kairos: The Influence of Context-Based Timing on Compliance with Well-Being Triggers

Autori: Jaap Ham, Jef van Schendel, Saskia Koldijk, Evangelia Demerouti
Pubblicato in: Symbiotic 2016, 2017, Pagina/e 89-101
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-57753-1_8

Using personalized persuasive strategies to increase acceptance and use of HCI technology

Autori: Sofia Fountoukidou, Jaap Ham, Peter Ruijten, and Uwe Matzat
Pubblicato in: Adjunct Proceedings of the 11th International Conference on Persuasive Technology, 2016
Editore: Adjunct Proceedings of the 11th International Conference on Persuasive Technology

Using an Artificial Agent as a Behavior Model to Promote Assistive Technology Acceptance

Autori: Sofia Fountoukidou, Jaap Ham, Uwe Matzat, Cees Midden
Pubblicato in: PERSUASIVE 2018, 2018, Pagina/e 285-296
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-78978-1_24

Schau genau! A Gaze-Controlled 3D Game for Entertainment and Education

Autori: Menges, Raphael and Kumar, Chandan and Wechselberger, Ulrich and Schaefer, Christoph and Walber, Tina and Staab, Steffen
Pubblicato in: COGAIN Symposium, 2017
Editore: COGAIN Symposium

Ambiguous Agents: The Influence of Consistency of an Artificial Agent’s Social Cues on Emotion Recognition, Recall, and Persuasiveness

Autori: Peter A. M. Ruijten, Cees J. H. Midden, Jaap Ham
Pubblicato in: International Journal of Human–Computer Interaction, Numero 32/9, 2016, Pagina/e 734-744, ISSN 1044-7318
Editore: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10447318.2016.1193350

EEG-Based Brain–Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21st Century

Autori: Ioulietta Lazarou, Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Ioannis Kompatsiaris, Magda Tsolaki
Pubblicato in: Frontiers in Human Neuroscience, Numero 12, 2018, ISSN 1662-5161
Editore: Frontiers Research Foundation
DOI: 10.3389/fnhum.2018.00014

A multimodal dataset for authoring and editing multimedia content: The MAMEM project

Autori: Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Kostas Georgiadis, Fotis Kalaganis, Georgios Liaros, Ioulietta Lazarou, Katerina Adam, Anastasios Papazoglou-Chalikias, Elisavet Chatzilari, Vangelis P. Oikonomou, Chandan Kumar, Raphael Menges, Steffen Staab, Daniel Müller, Korok Sengupta, Sevasti Bostantjopoulou, Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Racheli Kizoni, Sofia Foun
Pubblicato in: Data in Brief, Numero 15, 2017, Pagina/e 1048-1056, ISSN 2352-3409
Editore: Elsevier BV
DOI: 10.1016/j.dib.2017.10.072

Eye-Controlled Interfaces for Multimedia Interaction

Autori: Chandan Kumar, Raphael Menges, Steffen Staab
Pubblicato in: IEEE MultiMedia, Numero 23/4, 2016, Pagina/e 6-13, ISSN 1070-986X
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2016.52

The influence of social cues in persuasive social robots on psychological reactance and compliance

Autori: Ghazali, Aimi Shazwani; Ham, Jaap; Barakova, Emilia; Markopoulos, Panos
Pubblicato in: International Journal of Human–Computer Interaction, Numero 1, 2018, ISSN 1044-7318
Editore: Lawrence Erlbaum Associates Inc.
DOI: 10.5281/zenodo.1294005

Discriminative codewaves: a symbolic dynamics approach to SSVEP recognition for asynchronous BCI

Autori: K Georgiadis, N Laskaris, S Nikolopoulos, I Kompatsiaris
Pubblicato in: Journal of Neural Engineering, Numero 15/2, 2018, Pagina/e 026008, ISSN 1741-2560
Editore: Institute of Physics Publishing
DOI: 10.1088/1741-2552/aa904c

Effects of Robot Facial Characteristics and Gender in Persuasive Human-Robot Interaction

Autori: Aimi S. Ghazali, Jaap Ham, Emilia I. Barakova, Panos Markopoulos
Pubblicato in: Frontiers in Robotics and AI, Numero 5, 2018, ISSN 2296-9144
Editore: Frontiers in Robotics and AI
DOI: 10.3389/frobt.2018.00073

An error-aware gaze-based keyboard by means of a hybrid BCI system

Autori: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Ioannis Kompatsiaris, Nikos A. Laskaris
Pubblicato in: Scientific Reports, Numero 8/1, 2018, ISSN 2045-2322
Editore: Nature Publishing Group
DOI: 10.1038/s41598-018-31425-2

Single-Trial NIRS Data Classification for Brain–Computer Interfaces Using Graph Signal Processing

Autori: Panagiotis C. Petrantonakis, Ioannis Kompatsiaris
Pubblicato in: IEEE Transactions on Neural Systems and Rehabilitation Engineering, Numero 26/9, 2018, Pagina/e 1700-1709, ISSN 1534-4320
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TNSRE.2018.2860629

Comparative evaluation of state-of-the-art algorithms for SSVEP-based BCIs

Autori: Oikonomou, Vangelis P.; Liaros, Georgios; Georgiadis, Kostantinos; Chatzilari, Elisavet; Adam, Katerina; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Pubblicato in: Numero 1, 2016
Editore: arxiv

The MAMEM Project - A dataset for multimodal human-computer interaction using biosignals and eye tracking information

Autori: Nikolopoulos,Spiros; Georgiadis, Kostas; Kalaganis, Fotis; Liaros, Georgios; Lazarou, Ioulietta; Adam, Katerina; Papazoglou-Chalikias Anastasios; Chatzilari, Elisavet; Oikonomou, P. Vangelis; Petrantonakis, C. Panagiotis; Kompatsiaris, I.; Kumar, Chandan; Menges, Raphael; Staab, Steffen; Müller, Daniel; Sengupta, Korok; Bostantjopoulou, Sevasti; Katsarou, Zoe; Zeilig, Gabi; Plotnin, Meir; Gottlie
Pubblicato in: 2017
Editore: zenodo
DOI: 10.5281/zenodo.834154

È in corso la ricerca di dati su OpenAIRE...

Si è verificato un errore durante la ricerca dei dati su OpenAIRE

Nessun risultato disponibile