European Commission logo
polski polski
CORDIS - Wyniki badań wspieranych przez UE
CORDIS

Multimedia Authoring and Management using your Eyes and Mind

Rezultaty

D3.2 Multi-modal interaction with meso and high level control paradigms

Prototypes of multi-modal algorithms for meso-level and high-level control combining eye-tracking, EEG and bio-measurements. These algorithms will also become part of the Interaction SDK.

D2.3 - Final integration and optimization of multi-modal sensors

Delivery of the final version of MAMEM’s sensor installation that compared to D2.2 will be further fine-tuned and adapted to the user’s specific disabilities, incorporating the results of the first pilot studies conducted in WP6.

D4.3 – Initial implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the first version of MAMEM’s middleware and interaction SDK that incorporates the first-phase results of WP2 and WP3.

D2.2 - Initial integration and optimization of multi-modal sensors

Delivery of the initial version of MAMEM’s sensor installation, integrating and optimizing the three sensor modalities (eye-tracker, EEG recording system and bio-measurements).

D4.4 – Final implementation of MAMEM’s middleware and interaction SDK

Delivery of the software (together with its documentation) implementing the final version of MAMEM’s middleware and interaction SDK that incorporates the second-phase results of WP2 and WP3. The technical validation and verification tests of the updated algorithms are also included in this deliverable.

D3.3 Final implementation for the control paradigms of multi-modal interaction

Delivery of the final version of the MAMEM’s algorithms for multi-modal interaction that compared to D3.2 will also incorporate the results of the first-stage experiments conducted in WP6.

D5.2 – Initial design and implementation of the prototype interface applications

This deliverable will incorporate the mock-ups for the design, as well as an initial implementation for the prototype interface applications that will be used during the pilot studies. The prototypes of interface applications will be evaluated on effectiveness (lab studies in changing relevant user behavior and/ or attitudes). This deliverable will also encompass a description of the training cycles (of interface use) necessary for optimizing user acceptation and behaviour change.

D5.3 – Final design and implementation of the prototype interface applications

This deliverable will incorporate the final implementation of the prototype interface applications for managing and authoring multimedia content through the user’s eyes and mind. Compared to D5.2 the emphasis will be more on the development side and the integration with existing tools for managing, creating and sharing multimedia content. Moreover, the results of the first stage pilot trials will be also taken into consideration for improving the interface design.

D8.1 – Project Communication Kit

Initial project publicity material consisting of the project web-site, poster, leaflet and factsheet, as well as the project’s social media accounts (i.e. Twitter, LinkedIn and Facebook).

D1.4 - Data management plan

This deliverable will determine the strategy by which the research data generated by the project will be made open for maximizing their re-use.

D5.1b Update of D5.1 based on the revised requirements of the first-phase pilot trials

This is an update of the D5.1 based on the revised requirements that will result from the first-phase pilot trials.

D5.1 – Report on persuasive design principles, user models and profiles

This deliverable will incorporate a description of the most effective set of principles to derive a specific motivator for the behaviour or attitude change targets, incorporating social inclusion, increasing trust, and diminishing reactance effects. It will also describe MAMEM’s end-users on relevant characteristics as (dis-)abilities, interaction behavior, emotions, intentions, social abilities, extend to which training is needed, and social network, and sensitivity to persuasive strategies. The profiles for the different personas will be also part of this deliverable.

D6.2: Definition of pilot trials with the participation of patients

The report will describe detailed methods for conducting pilot studies with the participation of patients.

D7.1 – Methodology for measuring social integration

This deliverable will report on the results of our literature review about the existing methodologies for quantifying and monitoring social integration. Moreover, by employing the selected methodology for the cases of MAMEM this deliverable will also incorporate the complete portfolio of indicators for assessing the achieved impact on social integration.

D8.5 – Exploitation status report and updated plan

Report summarizing the status of the exploitation activities, the resulting paths for generating revenue and the activities that will be carried out to make the project results sustainable after its completion.

D4.1 Report on the middleware architecture and technical requirements

Description of the designed architecture and specifications including the technologies, the programming environment and the range of functionalities that will be adopted in the implementation of MAMEM’s middleware and SDK.

D6.1: Clinical requirements for the MAMEM platform for each of the patient cohort

The report will describe: (1) The special physical requirements for actual wearing and operation of the platform for each cohort of subjects; (2) Definitions of user interface software requirements, such as menus, screen buttons etc. (3) analyses of questionnaires and focus groups. This report will also include the ethical approvals obtained from the corresponding committees in Greece and Israel.

D6.5: Final report on pilot trials with the participation of patients

The report will describe: (1) Three sets of comprehensive results and analysis of experiments conducted in three clinical sites (2) Recommendations on future clinical use of the platform in terms of additional cohorts of subjects, additional disabilities and additional targets of use.

D7.3 – Study about the connection of natural interfaces and multimedia with the social integration of people with disabilities

This deliverable will accumulate and critically analyze the evidence that will be collected during the course of the project. Analysis will be performed with respect to bringing disabled people back to the society by means of managing and authoring multimedia content through natural human-computer interfaces.

D6.4: Interim report on pilot experiments based on half the subjects, including updated clinical requirements and definitions of clinical trials

The report will describe: (1) Three sets of results and analyses of experiments conducted in three clinical sites (2) Recommendations for modifications of methods for the second set of pilot studies with the participation of patients (3) recommendations for trials related to WP7 (Monitoring social inclusion).

D8.4 – Impact assessment and updated dissemination plan

Report summarizing the project dissemination activities, assessing their impact and suggesting potential corrections to the adopted dissemination strategy.

Publikacje

Assessing the usability of gaze-adapted Interface against conventional eye-based input emulation

Autorzy: Kumar, Chandan; Menges, Raphael; Staab, Steffen
Opublikowane w: Numer 1, 2017
Wydawca: IEEE CBMS
DOI: 10.5281/zenodo.583405

Chromium based Framework to include Gaze Interaction in Web Browser

Autorzy: Kumar, Chandan; Menges, Raphael; Müller, Daniel; Staab, Steffen
Opublikowane w: Numer 1, 2017
Wydawca: Proceedings of the 26th International Conference Companion on World Wide Web
DOI: 10.5281/zenodo.583340

Using tailoring to increase the effectiveness of a persuasive game-based training for novel technologies

Autorzy: Fountoukidou, S.; Ham, J.R.C.; Midden, C.J.H.; Matzat, U.
Opublikowane w: CEUR Workshop Proceedings, 1833, 91 - 96, Numer 1, 2017
Wydawca: CEUR
DOI: 10.5281/zenodo.583436

Analyzing the Impact of Cognitive Load in Evaluating Gaze-Based Typing

Autorzy: Korok Sengupta, Jun Sun, Raphael Menges, Chandan Kumar, Steffen Staab
Opublikowane w: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), 2017, Strona(/y) 787-792, ISBN 978-1-5386-1710-6
Wydawca: IEEE
DOI: 10.1109/CBMS.2017.134

Enhanced representation of web pages for usability analysis with eye tracking

Autorzy: Raphael Menges, Hanadi Tamimi, Chandan Kumar, Tina Walber, Christoph Schaefer, Steffen Staab
Opublikowane w: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications - ETRA '18, 2018, Strona(/y) 1-9, ISBN 9781-450357067
Wydawca: ACM Press
DOI: 10.1145/3204493.3204535

eyeGUI - A Novel Framework for Eye-Controlled User Interfaces

Autorzy: Raphael Menges, Chandan Kumar, Korok Sengupta, Steffen Staab
Opublikowane w: Proceedings of the 9th Nordic Conference on Human-Computer Interaction - NordiCHI '16, 2016, Strona(/y) 1-6, ISBN 9781-450347631
Wydawca: ACM Press
DOI: 10.1145/2971485.2996756

An Error Aware SSVEP-based BCI

Autorzy: Kalaganis, Fotis; Chatzilari, Elisavet; Georgiadis, Kostas; Nikolopoulos, Spiros; Laskaris, Nikos; Kompatsiaris, Yiannis
Opublikowane w: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numer 2, 2017, ISSN 2372-9198
Wydawca: IEEE
DOI: 10.5281/zenodo.583386

GazeTheKey - Interactive Keys to Integrate Word Predictions for Gaze-based Text Entry

Autorzy: Korok Sengupta, Raphael Menges, Chandan Kumar, Steffen Staab
Opublikowane w: Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion - IUI '17 Companion, 2017, Strona(/y) 121-124, ISBN 9781-450348935
Wydawca: ACM Press
DOI: 10.1145/3030024.3038259

Detection of Mental Task Related Activity in NIRS-BCI systems Using Dirichlet Energy over Graphs

Autorzy: Petrantonakis, Panagiotis; Kompatsiaris, Ioannis
Opublikowane w: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18, Numer 1, 2018
Wydawca: IEEE
DOI: 10.5281/zenodo.1294001

Usability Heuristics for Eye-controlled User Interface

Autorzy: Sengupta, Korok; Kumar, Chandan; Staab, Steffen
Opublikowane w: COGAIN Symposium: Communication by Gaze Interaction, Numer 2, 2017
Wydawca: COGAIN Symposium
DOI: 10.5281/zenodo.820917

Hands-Free Web Browsing: Enriching the User Experience with Gaze and Voice Modality

Autorzy: Sengupta, Korok; Ke, Min; Menges, Raphael; Kumar, Chandan; Staab, Steffen
Opublikowane w: ACM Symposium on Eye Tracking Research and Applications (ETRA 18), Numer 1, 2018
Wydawca: ACM
DOI: 10.5281/zenodo.1293980

Steady state visual evoked potential detection using Subclass Marginal Fisher Analysis

Autorzy: Anastasios Maronidis, Vangelis P. Oikonomou, Spiros Nikolopoulos, Ioannis Kompatsiaris
Opublikowane w: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Strona(/y) 37-41, ISBN 978-1-5090-4603-4
Wydawca: IEEE
DOI: 10.1109/NER.2017.8008286

Sparse Kernel Machines for motor imagery EEG classification

Autorzy: Oikonomou, Vangelis; Nikolopoulos, Spiros; Petrantonakis, Panagiotis; Kompatsiarios, Ioannis
Opublikowane w: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'18), Numer 1, 2018
Wydawca: IEEE
DOI: 10.5281/zenodo.1294000

Sparse Bayesian Learning for Multiclass Classification with application to SSVEP- BCI

Autorzy: Oikonomou, Vangelis P.; Liaros, Giorgos; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Opublikowane w: 8th International IEEE/EMBS Conference on Neural Engineering (NER), Numer 2, 2017, ISSN 1948-3554
Wydawca: IEEE
DOI: 10.5281/zenodo.583431

A comparison study on EEG signal processing techniques using motor imagery EEG data

Autorzy: Oikonomou, Vangelis P.; Georgiadis, Kostas; Liaros, George; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Opublikowane w: IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Numer 2, 2017, ISSN 2372-9198
Wydawca: IEEE
DOI: 10.5281/zenodo.583387

GazeTheWeb - A Gaze-Controlled Web Browser

Autorzy: Raphael Menges, Chandan Kumar, Daniel Müller, Korok Sengupta
Opublikowane w: Proceedings of the 14th Web for All Conference on The Future of Accessible Work - W4A '17, 2017, Strona(/y) 1-2, ISBN 9781-450349000
Wydawca: ACM Press
DOI: 10.1145/3058555.3058582

Sparse Bayesian Learning for subject independent classification with application to SSVEP-BCI

Autorzy: Vangelis P. Oikonomou, Anastasios Maronidis, George Liaros, Spiros Nikolopoulos, Ioannis Kompatsiaris
Opublikowane w: 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 2017, Strona(/y) 600-604, ISBN 978-1-5090-4603-4
Wydawca: IEEE
DOI: 10.1109/NER.2017.8008423

Combining the Benefits of CCA and SVMs for SSVEP-based BCIs in Real-world Conditions

Autorzy: Elisavet Chatzilari, Georgios Liarios, Kostas Georgiadis, Spiros Nikolopoulos, Yiannis Kompatsiaris
Opublikowane w: Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care - MMHealth '17, 2017, Strona(/y) 3-10, ISBN 9781-450355049
Wydawca: ACM Press
DOI: 10.1145/3132635.3132636

A Collaborative Representation Approach to Detecting Error-Related Potentials in SSVEP-BCIs

Autorzy: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Nikos A. Laskaris, Yiannis Kompatsiaris
Opublikowane w: Proceedings of the on Thematic Workshops of ACM Multimedia 2017 - Thematic Workshops '17, 2017, Strona(/y) 262-270, ISBN 9781-450354165
Wydawca: ACM Press
DOI: 10.1145/3126686.3129334

Computer uses and difficulties in Parkinson’s disease

Autorzy: Z. Katsarou, M. Plotnik, G. Zeilig, A. Gottlieb, R. Kizony, S. Bostantjopoulou
Opublikowane w: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders, 2016
Wydawca: The MDS 20th International Congress of Parkinson's Disease and Movement Disorders

Computer use aspects in patients with motor disabilities

Autorzy: Bostantjopoulou, Sevasti; Plotnick, Meir; Zeilig, Gabi; Gottlieb, Amihai; Kizony, Amihai; Chlomissiou, Sissy; Nichogiannopoulou, Ariana; Katsarou, Zoe
Opublikowane w: 2nd Congress of the European Academy of Neurology (EAN'2016), 2016
Wydawca: 2nd Congress of the European Academy of Neurology (EAN'2016)

MAMEM – A novel computer brain interface platform for enhancing social interaction of people with disabilities – Clinical requirements resulting from focus groups and literature survey

Autorzy: Zeilig, Gabi; Gottlieb, Amihai; Kizony, Rachel; Katsarou, Zoe; Bostantzopoulou, Sevasti; Nichgiannopoulou, Ariana; Chlomissiou, Sissy; Plotnik, Meir
Opublikowane w: 20th European Congress of Physical and Rehabilitation Medicine, 2016
Wydawca: 20th European Congress of Physical and Rehabilitation Medicine

Parkinson’s disease impact on computer use. A patients’ and caregivers perspective

Autorzy: Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Rachael Kizony, Sevasti Bostantjopoulou-Kambouroglou
Opublikowane w: The American Academy of Neurology 69th Annual Meeting, 2017
Wydawca: Neurology

Clinical Research Example – MAMEM – Multimedia Authoring and Management Using Your Eyes and Mind

Autorzy: Dr. Meir PLOTNIK, Mr. Amihai GOTTLIEB, Dr. Rachel KIZONY, Dr. Zoe KATSAROU, Dr. Sevasti BOSTANTZOPOULOU, Ms. Ariana NICHOGIANNOPOULOU, Ms. Sissy CHLOMISSIOU, Dr. Gabi ZEILIG,
Opublikowane w: Rehab science and technology update (RSTU), 2016
Wydawca: Rehab science and technology update (RSTU)

The importance of using computers in populations with Parkinson’s disease and spinal cord injury: a patients’ and caregivers’ perspective

Autorzy: Meir Plotnik, Zoe Katsarou, Amihai Gotlieb, Adam Grinberg, Rachel Kizony, Gabi Zeilig, Sevasti Bostantjopoulou-Kambouroglou
Opublikowane w: SfN’s 47th annual meeting in Neuroscience, 2017
Wydawca: SfN’s 47th annual meeting in Neuroscience

Finding Kairos: The Influence of Context-Based Timing on Compliance with Well-Being Triggers

Autorzy: Jaap Ham, Jef van Schendel, Saskia Koldijk, Evangelia Demerouti
Opublikowane w: Symbiotic 2016, 2017, Strona(/y) 89-101
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-319-57753-1_8

Using personalized persuasive strategies to increase acceptance and use of HCI technology

Autorzy: Sofia Fountoukidou, Jaap Ham, Peter Ruijten, and Uwe Matzat
Opublikowane w: Adjunct Proceedings of the 11th International Conference on Persuasive Technology, 2016
Wydawca: Adjunct Proceedings of the 11th International Conference on Persuasive Technology

Using an Artificial Agent as a Behavior Model to Promote Assistive Technology Acceptance

Autorzy: Sofia Fountoukidou, Jaap Ham, Uwe Matzat, Cees Midden
Opublikowane w: PERSUASIVE 2018, 2018, Strona(/y) 285-296
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-319-78978-1_24

Schau genau! A Gaze-Controlled 3D Game for Entertainment and Education

Autorzy: Menges, Raphael and Kumar, Chandan and Wechselberger, Ulrich and Schaefer, Christoph and Walber, Tina and Staab, Steffen
Opublikowane w: COGAIN Symposium, 2017
Wydawca: COGAIN Symposium

Ambiguous Agents: The Influence of Consistency of an Artificial Agent’s Social Cues on Emotion Recognition, Recall, and Persuasiveness

Autorzy: Peter A. M. Ruijten, Cees J. H. Midden, Jaap Ham
Opublikowane w: International Journal of Human–Computer Interaction, Numer 32/9, 2016, Strona(/y) 734-744, ISSN 1044-7318
Wydawca: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10447318.2016.1193350

EEG-Based Brain–Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21st Century

Autorzy: Ioulietta Lazarou, Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Ioannis Kompatsiaris, Magda Tsolaki
Opublikowane w: Frontiers in Human Neuroscience, Numer 12, 2018, ISSN 1662-5161
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fnhum.2018.00014

A multimodal dataset for authoring and editing multimedia content: The MAMEM project

Autorzy: Spiros Nikolopoulos, Panagiotis C. Petrantonakis, Kostas Georgiadis, Fotis Kalaganis, Georgios Liaros, Ioulietta Lazarou, Katerina Adam, Anastasios Papazoglou-Chalikias, Elisavet Chatzilari, Vangelis P. Oikonomou, Chandan Kumar, Raphael Menges, Steffen Staab, Daniel Müller, Korok Sengupta, Sevasti Bostantjopoulou, Zoe Katsarou, Gabi Zeilig, Meir Plotnik, Amihai Gotlieb, Racheli Kizoni, Sofia Foun
Opublikowane w: Data in Brief, Numer 15, 2017, Strona(/y) 1048-1056, ISSN 2352-3409
Wydawca: Elsevier BV
DOI: 10.1016/j.dib.2017.10.072

Eye-Controlled Interfaces for Multimedia Interaction

Autorzy: Chandan Kumar, Raphael Menges, Steffen Staab
Opublikowane w: IEEE MultiMedia, Numer 23/4, 2016, Strona(/y) 6-13, ISSN 1070-986X
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/MMUL.2016.52

The influence of social cues in persuasive social robots on psychological reactance and compliance

Autorzy: Ghazali, Aimi Shazwani; Ham, Jaap; Barakova, Emilia; Markopoulos, Panos
Opublikowane w: International Journal of Human–Computer Interaction, Numer 1, 2018, ISSN 1044-7318
Wydawca: Lawrence Erlbaum Associates Inc.
DOI: 10.5281/zenodo.1294005

Discriminative codewaves: a symbolic dynamics approach to SSVEP recognition for asynchronous BCI

Autorzy: K Georgiadis, N Laskaris, S Nikolopoulos, I Kompatsiaris
Opublikowane w: Journal of Neural Engineering, Numer 15/2, 2018, Strona(/y) 026008, ISSN 1741-2560
Wydawca: Institute of Physics Publishing
DOI: 10.1088/1741-2552/aa904c

Effects of Robot Facial Characteristics and Gender in Persuasive Human-Robot Interaction

Autorzy: Aimi S. Ghazali, Jaap Ham, Emilia I. Barakova, Panos Markopoulos
Opublikowane w: Frontiers in Robotics and AI, Numer 5, 2018, ISSN 2296-9144
Wydawca: Frontiers in Robotics and AI
DOI: 10.3389/frobt.2018.00073

An error-aware gaze-based keyboard by means of a hybrid BCI system

Autorzy: Fotis P. Kalaganis, Elisavet Chatzilari, Spiros Nikolopoulos, Ioannis Kompatsiaris, Nikos A. Laskaris
Opublikowane w: Scientific Reports, Numer 8/1, 2018, ISSN 2045-2322
Wydawca: Nature Publishing Group
DOI: 10.1038/s41598-018-31425-2

Single-Trial NIRS Data Classification for Brain–Computer Interfaces Using Graph Signal Processing

Autorzy: Panagiotis C. Petrantonakis, Ioannis Kompatsiaris
Opublikowane w: IEEE Transactions on Neural Systems and Rehabilitation Engineering, Numer 26/9, 2018, Strona(/y) 1700-1709, ISSN 1534-4320
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TNSRE.2018.2860629

Comparative evaluation of state-of-the-art algorithms for SSVEP-based BCIs

Autorzy: Oikonomou, Vangelis P.; Liaros, Georgios; Georgiadis, Kostantinos; Chatzilari, Elisavet; Adam, Katerina; Nikolopoulos, Spiros; Kompatsiaris, Ioannis
Opublikowane w: Numer 1, 2016
Wydawca: arxiv

The MAMEM Project - A dataset for multimodal human-computer interaction using biosignals and eye tracking information

Autorzy: Nikolopoulos,Spiros; Georgiadis, Kostas; Kalaganis, Fotis; Liaros, Georgios; Lazarou, Ioulietta; Adam, Katerina; Papazoglou-Chalikias Anastasios; Chatzilari, Elisavet; Oikonomou, P. Vangelis; Petrantonakis, C. Panagiotis; Kompatsiaris, I.; Kumar, Chandan; Menges, Raphael; Staab, Steffen; Müller, Daniel; Sengupta, Korok; Bostantjopoulou, Sevasti; Katsarou, Zoe; Zeilig, Gabi; Plotnin, Meir; Gottlie
Opublikowane w: 2017
Wydawca: zenodo
DOI: 10.5281/zenodo.834154

Wyszukiwanie danych OpenAIRE...

Podczas wyszukiwania danych OpenAIRE wystąpił błąd

Brak wyników