Skip to main content

Council of Coaches

Deliverables

Report on Y1 dissemination activities and Phase2 planning

This report includes the Phase1 activities for dissemination, coordination with stakeholders and other initiatives and the planning for the activities in the Phase2.

Report on user and stakehlolder needs and expectations

Report on the results from the initial user and stakeholder engagement process in T2.2.

Final Demonstration Results

This deliverable describes the outcomes of the Council of Coaches final demonstration study. This deliverable describes the usefulness and effectiveness of the coaching provided through the virtual council meetings and mobile companion app. Data with medical relevance from this trial will be used for further clinical grade experimentation.

Evaluation of the Holistic Behaviour Analysis Framework

This report will describe the results of the functional assessment of the Holistic Behaviour Analysis framework.

System architecture and design of APIs

This deliverable describes the overall integrated technical architecture of the server and clients (home and mobile) systems as well as provides high level definitions of the APIs used to communicate between the various modules. The overall architecture deliverable is based on the requirement documents from the technical modules in WP3, WP4, WP5 and WP6.

First virtual coach design and model

In this deliverable we will report on the development of the design and creation of the virtual coach and its dialoguing capacities in dyads and in groups.

Methods for evaluation the Dialogue and Argumentation Framework

A set of scenarios and associated (shared) knowledge bases that will form the input to the evaluation of the dialogue component in T5.4 and ultimately generate D5.6.

Evaluation results of first functional prototype and updated requirements

This deliverable includes the evaluation setup and protocols, description of the execution, and outcomes of the evaluation of the first functional prototype delivered in M9. Most importantly it contains recommendations for developing the second functional prototype.

Dialogue and Argumentation Framework Design

On M6 of the project, the four main technology components (Shared Knowledge Base (WP3), Behaviour Analysis Framework (WP4), Dialogue Framework (WP5) and HCI Design (WP6)) will deliver initial specifications and design. This deliverable defines the initial Dialogue Framework component design and requirements.

Final report on dissemination activities

This report includes the Phase1 activities for dissemination, coordination with stakeholders and other initiatives and the planning for the activities in the Phase2.

Final Prototype description and evaluations of the virtual coaches platform (includes software documentation)

This deliverable will describe the final prototype of the virtual coach dialogue platform where virtual coaches are interacting autonomously with the elderly, integrated in the technical prototype delivered by T6.3 in M27.

Training material

On-line training resources (e.g., webinars) and relevant material

Initial coaching actions and content

An initial version of the document describing concrete coaching actions (advise, arguments, and story-based actions to convey knowledge about behaviour change and health related issues) that will be delivered to support the first Functional Prototype of the Council of Coaches (T7.2) and will be updated throughout the project, resulting in D3.4: Final coaching actions and content.

Innovation Management Guidelines

The deliverable will describe the Innovation Management Plan and the continuous process of identifying innovation potentials and bringing them to the exploitation tasks of the project. The Annexes of the deliverable will include templates that will be used throughout the project duration for creating the innovation management table with information for each exploitable deliverable, such as: IPR, SWOT analysis, target user/market, marketing & execution plan, dissemination level, assigned partner, required resources and KPIs/metrics.

Requirements and Conepts for Interaction Mobile and Web

On M6 of the project, the four main technology components (Shared Knowledge Base (WP3), Behaviour Analysis Framework (WP4), Dialogue Framework (WP5) and HCI Design (WP6)) will deliver initial specifications and design. This deliverable defines the initial Human-Computer Interaction component design and requirements.

State-of-the-art, requirement analysis and initial specification of the Holistic Behaviour Analysis Framework

On M6 of the project, the four main technology components (Shared Knowledge Base (WP3), Holistic Behaviour Analysis Framework (WP4), Dialogue Framework (WP5) and HCI Design (WP6)) will deliver initial specifications and design. This deliverable defines the initial Behaviour Analysis Framework component design and requirements.

Methods for inferring short-term behaviour from multimodal sensor data

This document will describe the methods developed for the inference of short-term behaviours based on the automatic processing of physical and virtual sensor data.

Report on Y2 dissemination activities and Phase3 planning

This report includes the Phase1 activities for dissemination, coordination with stakeholders and other initiatives and the planning for the activities in the Phase2.

Initial user requirements

This document describes the initial overall user requirements for the Council of Coaches platform and HCI interfaces obtained through the initial user engagement process in T2.3.

First Periodic Report

First Periodic Report of COUCH

Final virtual coach design and model

In this deliverable we will report on the final models of turn-taking management, engagement and virtual coaches’ style.

Demonstration protocol, Ethical Approval

In this deliverable the demonstration protocol, inclusion- / exclusion criteria, recruitment procedures and demonstration outcomes will be defined. All plans necessary for the deployment of the final demonstration trial will be contained in this deliverable. The Protocol will be approved before implementation by the competent Institutional Review Boards / Ethical Committees of the participating institutions.

Evaluation of the Dialogue and Argumentation Framework

This will report on the outcomes of entirely autonomous dialogues between virtual agents representing the individual coaches. The aim is to show that the specified dialogue games and framework is, when played by software agents, capable of producing favourable outcomes without necessarily requiring human intervention.

Initial user interface design for Home UI and Mobile UI

This deliverable will describe the design and development of the initial user interfaces integrated with the first functional prototype delivered by T7.2 in M9.

Methods for detecting behaviour changes from short-term behaviour information

This document will describe the methods developed for the detection, assessment and explanation of user’s behaviour changes from the automatic analysis of long-term behaviour information.

Evaluation results of second functional prototype and updated requirements

This deliverable includes the evaluation setup and protocols, description of the execution, and outcomes of the evaluation of the second functional prototype delivered in M15. Most importantly it contains recommendations for developing the third functional prototype.

The COUCH RRI Vision

Internal guidelines/strategy for how the principles of RRI will be implemented throughout the project, based on an internal workshop organized in M5 and presenting intermediate results of T2.1.

Quality, Risk and IPR Management Procedures

Contains the main guidelines on the quality management/control procedures to be applied in the project, along with relevant risk management procedures and methodologies.

Dissemination plans and material

This deliverable describes the strategy and dissemination activities of the project. The deliverable will present a timetable with all expected campaigns (online and offline and includes the project logo, leaflets, posters and a banding manual for the dissemination activities of the project.

Definition of tailored coaching strategies

This deliverable will document the final output of T3.1 and contains a literature based definition of a coaching model and derived strategies for coaching on the domains of physical-, cognitive-, mental-, and social wellbeing, as well as condition specific strategies, building on the initial coaching strategies documented in D3.1.

Design of dialogue game

Formal dialogue game specifications that describe the systems developed in T5.1. This deliverable forms the theoretical basis for the computational models developed in T5.3 and delivered in D5.3.

Final coaching actions and content

The definition of the content to be delivered by the virtual coaches developed in the project is an ongoing process that will be heavily influenced by the user engagement process throughout the project. This deliverable is an ongoing documentation that serves as input to WP4 and will be finalized towards the end of the project’s development phase.

First Prototype description and evaluations of the virtual coaches platform (includes software documentation)

This deliverable will describe the creation of the first prototype of the virtual coach dialogue platform where virtual coaches’ behaviours are scripted, and integrated into the second functional prototype (M15).

Initial knowledge base design and coaching strategies

On M6 of the project, the four main technology components (Shared Knowledge Base (WP3), Behaviour Analysis Framework (WP4), Dialogue Framework (WP5) and HCI Design (WP6)) will deliver initial specifications and design. This deliverable defines the initial Shared Knowledge Base component design and requirements as well as an initial draft on the work on defining tailored coaching strategies.

Methods for inferring long-term behaviours from short-term behaviour information

This deliverable will describe the methods developed for the inference of long-term behaviours based on the intelligent aggregation and fusion of short-term behaviour information.

COUCH Participatory Innovation Process

Report on the approach, results and lessons learned from the COUCH participatory innovation process, marking the end of T2.1.

Report on ethical, social and legal considerations and implications

Report outlining the ethical, social, medical, and legal issues identified, and how this has been taken into account in the design process.

Methods and tools for moving from dialogue game to updating individual and shared knowledge bases

This deliverable will consist of DGDL descriptions that implement the theoretical dialogue game specifications from D5.1. Executing these descriptions in the Dialogue Game Execution platform provides formal dialogue actions that will be translated into communicative acts for use in WP6.

Evaluation results of third functional prototype and updated requirements

This deliverable includes the evaluation setup and protocols, description of the execution, and outcomes of the evaluation of the third functional prototype delivered in M21. It contains final recommendations for the technical prototype.

Final Periodic Report

Final Periodic Report of COUCH

Third functional prototype

The last milestones for the functional prototype will be used to test acceptance and usability of more advanced features (agent animations and behaviours, interaction concepts) (T7.2).

Behaviour change detection analysis prototype

Software component implementing the developed behaviour detection methods.

Second functional prototype

A second functional prototype will be delivered focused on delivering a more real and smooth user experience, including a major update to the contents (dialogue possibilities) delivered (T7.2).

Design of computatinal model based on theoretical and abstract model

This deliverable will consist of DGDL descriptions that implement the theoretical dialogue game specifications from D5.3. These descriptions will initially be used in the evaluation in T4.3 before being deployed in the overall system.

Initial functional prototype

An early low-fidelity prototype of the system, using Wizard-of-Oz methodologies to compensate for functionalities that are still under development is required to kick-start the process of gathering targeted user input (T7.2).

Short-term behaviour analysis prototype

Software component implementing the developed short-term behaviour inference methods.

Long-term behaviours analysis prototype

Software component implementing the developed long-term behaviour inference methods.

Shared Knowledge Base component

Software component running on the server side that is used for collection and retrieval of all relevant knowledge needed by the virtual coaches to direct their coaching actions will be delivered in M27.

Final Council of Coaches Technical Prototype

The final Technical Prototype will include all the innovations developed in WP3, WP4, WP5 and WP6, connecting Shared Knowledge Base (WP3), Holistic Sensing Framework (WP4) with autonomous Dialogue Framework (WP5) and Embodied Conversational Agents (WP6) to deliver a fully working system to be used in the final demonstration of T7.4.

COUCH Workshop

The workshop will take place in Brussels and will address the medical and research communities, as well as policy-makers and the private sector (pharmaceuticals, vendors, etc.). The deliverable will also include proceedings and media.

Project website

This deliverable is the project website with a twofold strategy: a) to raise awareness of the project activities and b) to serve as collaboration tool with intranet possibilities for the consortium members.

Data Management Plan

Describes the data management life cycle for the data to be collected, processed and/or generated according to the template provided by the EC.

Searching for OpenAIRE data...

Publications

Human Behaviour Analysis through Smartphones

Author(s): Kostas Konsolakis, Hermie Hermens, Claudia Villalonga, Miriam Vollenbroek-Hutten, Oresti Banos
Published in: Proceedings, Issue 2/19, 2018, Page(s) 1243, ISSN 2504-3900
DOI: 10.3390/proceedings2191243

A Dialogue Game for Multi-Party Goal-Setting in Health Coaching

Author(s): Mark Snaith, Dominic de Franco, Tessa Beinema, Harm op den Akker, Alison Pease
Published in: Frontiers in Artificial Intelligence and Applications, Volume 305: Computational Models of Argument, 2018, Page(s) 337-344, ISSN 1946-2166
DOI: 10.3233/978-1-61499-906-5-337

Automating the Production of Communicative Gestures in Embodied Characters

Author(s): Brian Ravenet, Catherine Pelachaud, Chloé Clavel, Stacy Marsella
Published in: Frontiers in Psychology, Issue 9, 2018, ISSN 1664-1078
DOI: 10.3389/fpsyg.2018.01144

MobileCogniTracker

Author(s): Jan Wohlfahrt-Laymann, Hermie Hermens, Claudia Villalonga, Miriam Vollenbroek-Hutten, Oresti Banos
Published in: Journal of Ambient Intelligence and Humanized Computing, 2018, ISSN 1868-5137
DOI: 10.1007/s12652-018-0827-y

Smart Sensing Technologies for Personalised e-Coaching

Author(s): Oresti Banos, Hermie Hermens, Christopher Nugent, Hector Pomares
Published in: Sensors, Issue 18/6, 2018, Page(s) 1751, ISSN 1424-8220
DOI: 10.3390/s18061751

Who Do You Prefer? The Effect of Age, Gender and Role on Users’ First Impressions of Embodied Conversational Agents in eHealth

Author(s): Silke ter Stal, Monique Tabak, Harm op den Akker, Tessa Beinema, Hermie Hermens
Published in: International Journal of Human–Computer Interaction, Issue 36/9, 2020, Page(s) 881-892, ISSN 1044-7318
DOI: 10.1080/10447318.2019.1699744

A Novel Framework for the Holistic Monitoring and Analysis of Human Behaviour

Author(s): Kostas Konsolakis, Hermie Hermens, Oresti Banos
Published in: Proceedings, Issue 31/1, 2019, Page(s) 43, ISSN 2504-3900
DOI: 10.3390/proceedings2019031043

Design Features of Embodied Conversational Agents in eHealth: a Literature Review

Author(s): Silke ter Stal, Lean Leonie Kramer, Monique Tabak, Harm op den Akker, Hermie Hermens
Published in: International Journal of Human-Computer Studies, Issue 138, 2020, Page(s) 102409, ISSN 1071-5819
DOI: 10.1016/j.ijhcs.2020.102409

User Experience and Potential Health Effects of a Conversational Agent-Based Electronic Health Intervention: Protocol for an Observational Cohort Study

Author(s): Marian Z M Hurmuz, Stephanie M Jansen-Kosterink, Harm op den Akker, Hermie J Hermens
Published in: JMIR Research Protocols, Issue 9/4, 2020, Page(s) e16641, ISSN 1929-0748
DOI: 10.2196/16641

Is Two Better than One? - Effects of Multiple Agents on User Persuasion

Author(s): Reshmashree B. Kantharaju, Dominic De Franco, Alison Pease, Catherine Pelachaud
Published in: Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA '18, 2018, Page(s) 255-262
DOI: 10.1145/3267851.3267890

Context in designing and evaluating usability in eHealth technology for older adults

Author(s): Marijke Broekhuis
Published in: Proceedings of the NordiCHI2018 Doctoral Consortium, 2018
DOI: 10.13140/rg.2.2.21094.45128

Designing and Developing Lifelike, Engaging Lifestyle Coaching Agents and Scenarios for Multiparty Coaching Interaction

Author(s): Gerwin Huizing, Randy Klaassen, Dirk Heylen
Published in: Proceedings of the Workshop on Intelligent Conversation Agents for Home and Geriatric Care Applications (ICA-HoGeCa2018), 2018

Creating an Artificial Coaching Engine for Multi-domain Conversational Coaches in eHealth Applications

Author(s): Tessa Beinema, Harm op den Akker, Hermie Hermens
Published in: Proceedings of the Workshop on Intelligent Conversation Agents for Home and Geriatric Care Applications (ICA-HoGeCa2018), 2018

Towards Developing a Model to Handle Multiparty Conversations for Healthcare Agents

Author(s): Reshmashree Bangalore Kantharaju, Catherine Pelachaud
Published in: Proceedings of the Workshop on Intelligent Conversation Agents for Home and Geriatric Care Applications (ICA-HoGeCa2018), 2017

Council of Coaches - A Novel Holistic Behavior Change Coaching Approach

Author(s): Harm op den Akker, Rieks op den Akker, Tessa Beinema, Oresti Banos, Dirk Heylen, Björn Bedsted, Alison Pease, Catherine Pelachaud, Vicente Traver Salcedo, Sofoklis Kyriazakos, Hermie Hermens
Published in: Proceedings of the 4th International Conference on Information and Communication Technologies for Ageing Well and e-Health, 2018, Page(s) 219-226
DOI: 10.5220/0006787702190226

Measuring Persuasiveness in Behaviour Change Support Systems

Author(s): Dominic De Franco, Alison Pease, Mark Snaith
Published in: roceedings of the Sixth International Workshop on Behavior Change Support Systems (BCSS 2018), 2018, Page(s) 41-47

Enabling remote assessment of cognitive behaviour through mobile experience sampling

Author(s): Jan Wohlfahrt-Laymann, Hermie Hermens, Claudia Villalonga, Miriam Vollenbroek-Hutten, Oresti Banos
Published in: 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), 2018, Page(s) 794-799
DOI: 10.1109/percomw.2018.8480310

Gesture Class Prediction by Recurrent Neural Network and Attention Mechanism

Author(s): Fajrian Yunus, Chloé Clavel, Catherine Pelachaud
Published in: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents, 2019, Page(s) 233-235
DOI: 10.1145/3308532.3329458

Automatic Recognition of Affective Laughter in Spontaneous Dyadic Interactions from Audiovisual Signals

Author(s): Reshmashree B. Kantharaju, Fabien Ringeval, Laurent Besacier
Published in: Proceedings of the 2018 on International Conference on Multimodal Interaction - ICMI '18, 2018, Page(s) 220-228
DOI: 10.1145/3242969.3243012

Integrating Argumentation with Social Conversation between Multiple Virtual Coaches

Author(s): Reshmashree B. Kantharaju, Alison Pease, Dennis Reidsma, Catherine Pelachaud, Mark Snaith, Merijn Bruijnes, Randy Klaassen, Tessa Beinema, Gerwin Huizing, Donatella Simonetti, Dirk Heylen, Harm op den Akker
Published in: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents, 2019, Page(s) 203-205
DOI: 10.1145/3308532.3329450

Multimodal Analysis of Cohesion in Multi-party Interactions

Author(s): Reshmashree Bangalore Kantharaju, Caroline Langlet, Mukesh Barange, Chloé Clavel and Catherine Pelachaud
Published in: Proceedings of The 12th Language Resources and Evaluation Conference, 2020, Page(s) 498-507

Generation of Multi-Party Dialogues among Embodied Conversational Agents to Promote Active Living and Healthy Diet for Subjects Suffering from Type 2 Diabetes

Author(s): Kuthethur Das, Tessa Beinema, Harm Akker, Hermie Hermens
Published in: Proceedings of the 5th International Conference on Information and Communication Technologies for Ageing Well and e-Health, 2019, Page(s) 297-304
DOI: 10.5220/0007750602970304

How to conduct a summative evaluation of eHealth applications: the Council of Coaches case study

Author(s): Marian Hurmuz, Stephanie Jansen-Kosterink, Harm op den Akker
Published in: Supporting Health by Technology (HealthByTech 2020) - Abstract Book, Issue 11/06/2020, 2020, Page(s) 88-89
DOI: 10.13140/rg.2.2.30937.95848

What to discuss? Automatic topic selection for embodied conversational health coaches

Author(s): Tessa Beinema, Harm op den Akker, Lex van Velsen, Hermie Hermens
Published in: Supporting Health by Technology (HealthByTech 2020) - Abstract Book, Issue 11/06/2020, 2020, Page(s) 14
DOI: 10.13140/rg.2.2.29260.23688