Advancing intuitive human-machine interaction with human-like social capabilities for education in schools

Deliverables

IPR evaluation of ANIMATAS results 5 UPMC IPR manager industrial partner Evaluation of patentable innovations IPR and confidentiality in accordance with the CA sensitization of participants to IPR issues

Report on Transferable Skills workshops attended

This report will contain details of the the Transferable Skills Workshops: TW1 Methods from experimental psychology (M7), TSW2 Developing technologies in educational settings (M13),TSW3 Employability skills and conducting research in industry (M20), TSW4 Entrepreneurship, innovation and exploitation (M29)

Mid-term report of robot’s embodiment and behaviour, their model and their impact

Description of models and experimental set-ups for agent and robot embodiment studies from (i) perceptual and (ii) generative standpoints

Validation by experimental tests of social learning mechanisms

Report on evaluations models allowing robots and virtual characters to learn new skills from humans in educational settings

Report on ANIMATAS final workshop

The final workshop report will serve to summarize at the end the achievements of ANIMATAS and to discuss the road ahead

Mid-term report on social learning mechanisms

Description of theoretical and experimental frameworks for allowing robots and virtual characters to learn new skills from humans in educational settings

Validation by experimental tests of the robot's personalised behaviour

Report on the evaluation of models allowing robots and virtual characters to adapt to users behaviors and preferences

Validation by experimental tests of robot's embodiment and behaviour

Report on the evaluation of models for robots and agents embodiment studies from i perceptual and ii generative standpoints

Overall recruitment of ESRs

Completed recruitment and start of all the ESR Fellow's individual research projects

Report on Technical workshops attended

This report will contain details of the the Transferable Skills Workshops TW1 Summer school on computational social sciences for social robots and embodied virtual characters M10 TW2 Virtual characters for computer games M17 TW3 Ethics in humanmachine interaction M29 TW4 Building industryguided showcases of the ANIMATAS research IMT M33

Consortium Agreement

Preparation and signature of the Consortium Agreement

Third Year Progress Report

Report on the overall progress of the project for the third year of implementation

Mid-term report on adaptation mechanisms and user models

Description of theoretical and experimental frameworks for allowing robots and virtual characters to adapt to users behaviors and preferences

Progress report - first year

Report on the overall progress of the project for the first year of implementation.

Plan for the Exploitation and Dissemination of Result

The plan will define a strategy for exploitation mainly through secondments where the industry beneficiaries and partners will have a close working knowledge of the ESRs and their project and will participate I shaping them, thus reinforcing the potential for further exploitation that will be established through the support of the Lutech technology transfer office of UPMC. The plan will also define strategy of dissemination of the results in the academic sector, the educational community, the media and the policy makers and will outline of the dissemination methods: web-site, e-newsletter and social media

Personal Career development plans

Individual career development plans prepared for each one of the recruited fellows. This plan will include a detailed set of proposed research, training and dissemination activities. Attention will be paid to the quality of the joint research training programme, with provision for supervision and mentoring arrangements and career guidance. Each document must be signed by both ESR and their Supervisor.

Publications

Explainable Agency by Revealing Suboptimality in Child-Robot Learning Scenarios

Author(s): Silvia Tulli; Marta Couto; Miguel Vasco; Elmira Yadollahi; Francisco S. Melo; Ana Paiva
Published in: Springer post-proceedings Lecture Notes in Artificial Intelligence, 2020
Publisher: Springer
DOI: 10.1007/978-3-030-62056-1_3

Influence of virtual agent politeness behaviors on how users join small conversational groups

Author(s): Sahba Zojaji; Christopher Peters; Catherine Pelachaud
Published in: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents, 2020, Page(s) 1-8
Publisher: ACM Digital Library
DOI: 10.1145/3383652.3423917

The importance of fillers for text representations of speech transcripts

Author(s): Tanvi Dinkar; Pierre Colombo; Matthieu Labeau; Chloé Clavel
Published in: EMNLP (1), Issue 10, 2020
Publisher: Association for comutational linguistics
DOI: 10.18653/v1/2020.emnlp-main.641

Questioning Wizard of Oz: Effects of Revealing the Wizard behind the Robot

Author(s): Jawairia Nasir, Philippe Oppliger, Barbara Bruno, Pierre Dillenbourg
Published in: 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022
Publisher: IEEE

Understanding Children’s Trust Development through Repeated Interactions with a Virtual Social Robot

Author(s): Natalia Calvo-Barajas, Ginevra Castellano
Published in: 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022
Publisher: IEEE
DOI: 10.1109/ro-man53752.2022.9900537

Cozmonaots: Designing an autonomous learning task with social and educational robots

Author(s): Rebecca Stower, Arvid Kappas
Published in: Interaction Design and Children (IDC ’21),, 2021
Publisher: ACM
DOI: 10.1145/3459990.3465210

Integrating an Observer in Interactive Reinforcement Learning to Learn Legible Trajectories

Author(s): Manuel Bied, Mohamed Chetouani
Published in: 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020, Page(s) 760-767, ISBN 978-1-7281-6075-7
Publisher: IEEE
DOI: 10.1109/ro-man47096.2020.9223338

Cooperation between Independent Reinforcement Learners under Wealth Inequality and Collective Risks.

Author(s): Ramona Merhej, Fernando-P. Santos, Francisco S. Melo, Francisco C. Santos
Published in: AAMAS '21: 20th International Conference on Autonomous Agents and Multiagent Systems, 2021
Publisher: IFAAMAS

A Robot by Any Other Frame: Framing and Behaviour Influence Mind Perception in Virtual but not Real-World Environments

Author(s): Sebastian Wallkotter, Rebecca Stower, Arvid Kappas, Ginevra Castellano
Published in: Proceedings of the 2020 ACM/IEEE international conference on human-robot interaction, 2020, Page(s) 609-618
Publisher: Association for Computing Machinery

SLOT-V: Supervised Learning of Observer Models for Legible Robot Motion Planning in Manipulation.

Author(s): Sebastian Wallkotter, Mohamed Chetouani, Ginevra Castellano
Published in: 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022
Publisher: IEEE
DOI: 10.1109/ro-man53752.2022.9900568

"""""Oh no, my instructions were wrong!"" An Exploratory Pilot Towards Children’s Trust in Social Robots"""

Author(s): Rebecca Stower, Arvid Kappas
Published in: 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020, Page(s) 641-646
Publisher: IEEE
DOI: 10.1109/ro-man47096.2020.9223495

The effects of robot’s facial expressions on children’s first impressions of trustworthiness

Author(s): Natalia Calvo-Barajas, Giulia Perugia, Ginevra Castellano
Published in: Proceedings of the 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Issue SN 1944-9437, August 31 – September 4, 2020, 2020, Page(s) 165-171
Publisher: IEEE Press
DOI: 10.1109/ro-man47096.2020.9223456

How confident are you? Exploring the role of fillers in the automatic prediction of a speaker’s confidence

Author(s): Tanvi Dinkar; Ioana Vasilescu; Catherine Pelachaud; Chloé Clavel
Published in: ICASSP, Issue 4, 2020, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9054374

Does What Users Say Match What They Do? Comparing Self-Reported Attitudes and Behaviours towards a Social Robot

Author(s): Rebecca Stower, Karen Tatarian, Damien Rudaz, Marine Chamoux, Mohamed Chetouani, Arvid Kappas
Published in: 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022
Publisher: IEEE

Efficacy of a ‘Misconceiving’ Robot to Improve Computational Thinking in a Collaborative Problem Solving Activity: A Pilot Study

Author(s): Utku Norman, Alexandra Chin, Barbara Bruno, Pierre Dillenbourg
Published in: 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022, Page(s) 1413–1420
Publisher: IEEE
DOI: 10.1109/ro-man53752.2022.9900775

Explainability in Autonomous Pedagogical Agents

Author(s): Silvia Tulli
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 23743468, 2020, Page(s) 13738-13739, ISSN 2374-3468
Publisher: AAAI Press
DOI: 10.1609/aaai.v34i10.7141

Exploring the Difference between Solving and Teaching in Sensorimotor Tasks

Author(s): Manuel Bied; Mohamed Chetouani
Published in: HRI '20: ACM/IEEE International Conference on Human-Robot Interaction, 2020
Publisher: ACM Digital Library
DOI: 10.1145/3371382.3378284

What Teachers Need for Orchestrating Robotic Classrooms

Author(s): Sina Shahmoradi, Aditi Kothiyal, Jennifer K. Olsen, Barbara Bruno, Pierre Dillenbourg
Published in: European Conference on Technology Enhanced Learning (EC-TEL), Issue LNCS 12315, 2020, Page(s) 87-101, ISBN 978-3-030-57717-9
Publisher: Springer

Reward Seeking or Loss Aversion?: Impact of Regulatory Focus Theory on Emotional Induction in Children and Their Behavior Towards a Social Robot

Author(s): Maha Elgarf, Natalia Calvo-Barajas, Ana Paiva, Ginevra Castellano, and Christopher Peter
Published in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), 2021
Publisher: Association for Computing Machinery
DOI: 10.1145/3411764.3445486

Robots for Learning - R4L - Inclusive Learning

Author(s): Wafa Johal, James Kennedy, Vicky Charisi, Hae Won Park, Ginevra Castellano, Pierre Dillenbourg
Published in: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction - HRI '18, 2018, Page(s) 397-398, ISBN 9781-450356152
Publisher: ACM Press
DOI: 10.1145/3173386.3173567

The near future of children's robotics

Author(s): Vicky Charisi, Alyssa M. Alcorn, James Kennedy, Wafa Johal, Paul Baxter, Chronis Kynigos
Published in: Proceedings of the 17th ACM Conference on Interaction Design and Children - IDC '18, 2018, Page(s) 720-727, ISBN 9781-450351522
Publisher: ACM Press
DOI: 10.1145/3202185.3205868

Towards Virtual Agents for Supporting Appropriate Small Group Behaviors in Educational Contexts

Author(s): Sahba Zojaji, Christopher Peters
Published in: 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), 2019, Page(s) 1-2, ISBN 978-1-7281-4540-2
Publisher: IEEE
DOI: 10.1109/vs-games.2019.8864528

Towards an Adaptive Regulation Scaffolding through Role-based Strategies

Author(s): Sooraj Krishna, Catherine Pelachaud, Arvid Kappas
Published in: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents - IVA '19, 2019, Page(s) 264-267, ISBN 9781-450366724
Publisher: ACM Press
DOI: 10.1145/3308532.3329412

Learning By Collaborative Teaching: An Engaging Multi-Party CoWriter Activity

Author(s): Laila El Hamamsy, Wafa Johal, Thibault Asselborn, Jauwairia Nasir, Pierre Dillenbourg
Published in: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2019, Page(s) 1-8, ISBN 978-1-7281-2622-7
Publisher: IEEE
DOI: 10.1109/ro-man46459.2019.8956358

Rock Your Story - Effects of Adapting Personality Behavior through Body Movement on Story Recall

Author(s): Maha Elgarf, Christopher Peters
Published in: Proceedings of the 7th International Conference on Human-Agent Interaction - HAI '19, 2019, Page(s) 241-243, ISBN 9781-450369220
Publisher: ACM Press
DOI: 10.1145/3349537.3352779

Robot Analytics: What Do Human-Robot Interaction Traces Tell Us About Learning?

Author(s): Jauwairia Nasir, Utku Norman, Wafa Johal, Jennifer K. Olsen, Sina Shahmoradi, Pierre Dillenbourg
Published in: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2019, Page(s) 1-7, ISBN 978-1-7281-2622-7
Publisher: IEEE
DOI: 10.1109/ro-man46459.2019.8956465

Effect of Agents’ Transparency on Teamwork

Author(s): Silvia Tulli, Filipa Correia, Samuel Mascarenhas, Samuel Gomes, Francisco S. Melo, Ana Paiva
Published in: 1st International Workshop on EXplainable TRansparent Autonomous Agents and Multi-Agent Systems at International Conference on Autonomous Agents and Multiagent Systems, AAMAS (2019), 2019
Publisher: AAMAS
DOI: 10.1007/978-3-030-30391-4_2

For The Record - A Public Goods Game For Exploring Human-Robot Collaboration

Author(s): Correia, Filipa and Mascarenhas, Samuel and Gomes, Samuel and Tulli, Silvia and Santos, Fernando P. and Santos, Francisco C. and Prada, Rui and Melo, Francisco S. and Paiva, Ana
Published in: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019, Page(s) 2351–2353
Publisher: International Foundation for Autonomous Agents and Multiagent Systems

MobiAxis: An Embodied Learning Task for Teaching Multiplication with a Social Robot

Author(s): K. Tatarian, S. Wallkotter, S. Buyukgoz, R. Stower, and M. Chetouani
Published in: Robots for Learning : R4L – Building Interaction for Classroom Robots Workshop at the 28th IEEE International Conference on Robot & Human Interactive Communication (Ro-Man 2019)., 2019
Publisher: Robots for Learning : R4L – Building Interaction for Classroom Robots Workshop

The Role of Trust and Social Behaviours in Children's Learning from Social Robots

Author(s): Rebecca Stower
Published in: 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2019, Page(s) 1-5, ISBN 978-1-7281-3891-6
Publisher: IEEE
DOI: 10.1109/aciiw.2019.8925269

FRACTOS - Learning to be a Better Learner by Building Fractions

Author(s): Sooraj Krishna, Catherine Pelachaud, Arvid Kappas
Published in: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020, Page(s) 314-316, ISBN 9781-450370578
Publisher: ACM
DOI: 10.1145/3371382.3378318

CardBot - Towards an affordable humanoid robot platform for Wizard of Oz Studies in HRI

Author(s): Sooraj Krishna, Catherine Pelachaud
Published in: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020, Page(s) 73-73, ISBN 9781-450370578
Publisher: ACM
DOI: 10.1145/3371382.3378203

"""And then what happens?"" Promoting Children’s Verbal Creativity Using a Robot"

Author(s): Maha Elgarf, Natalia Calvo-Barajas, Patricia Alves-Oliveira, Giulia Perugia, Ginevra Castellano, Christopher Peters, Ana Paiva
Published in: International Conference on Human-Robot Interaction (HRI 2022), 2022, Page(s) 71-79
Publisher: ACM/IEEE
DOI: 10.5555/3523760.3523774

Is There 'ONE way' of Learning? A Data-driven Approach

Author(s): Jauwairia Nasir; Barbara Bruno; Pierre Dillenbourg
Published in: 22nd ACM International Conference on Multimodal Interaction (ICMI) - Companion publication, Issue 6, 2020
Publisher: ACM Digital Library
DOI: 10.1145/3395035.3425200

Can a Social Robot Be Persuasive Without Losing Children's Trust?

Author(s): Natalia Calvo; Maha Elgarf; Giulia Perugia; Christopher Peters; Ginevra Castellano
Published in: HRI (Companion), Issue 5, 2020
Publisher: ACM Digital Library
DOI: 10.1145/3371382.3378272

Once Upon a Story

Author(s): Elgarf, Maha; Skantze, Gabriel; Peters, Christopher
Published in: Proceedings of the 21th ACM International Conference on Intelligent Virtual Agents, Issue 7, 2021
Publisher: Association for Computing Machinery
DOI: 10.1145/3472306.3478359

The Effects of Motivational Strategies and Goal Attainment on Children’s Trust in a Virtual Social Robot: A Pilot Study

Author(s): Natalia Calvo-Barajas, Giulia Perugia, Ginevra Castellano
Published in: Interaction Design and Children, Issue IDC’21, June 24, 2021, 2021, Page(s) 537-541, ISBN 9781450384520
Publisher: Association for Computing Machinery
DOI: 10.1145/3459990.3465202

When Positive Perception of the Robot Has No Effect on Learning

Author(s): Jauwairia Nasir*, Utku Norman*, Barbara Bruno, Pierre Dillenbourg
Published in: 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020
Publisher: IEEE

Temporal pathways to learning: How learning emerges in an open-ended collaborative activity

Author(s): Jauwairia Nasir, Mortadha Abderrahim, Aditi Kothiyal, Pierre Dillenbourg
Published in: Computers and Education: Artificial Intelligence, Issue Vol 3, 2022, ISSN 2666-920X
Publisher: Oxford Elsevier Ltd.
DOI: 10.1016/j.caeai.2022.100093

How does Modality Matter? Investigating the Synthesis and Effects of Multi-modal Robot Behavior on Social Intelligence

Author(s): Karen Tatarian; Rebecca Stower; Damien Rudaz; Marine Chamoux; Arvid Kappas; Mohamed Chetouani
Published in: International Journal of Social Robotics, Issue 18754791, 2021, ISSN 1875-4791
Publisher: Springer Verlag
DOI: 10.1007/s12369-021-00839-w

Many are the ways to learn identifying multi-modal behavioral profiles of collaborative learning in constructivist activities

Author(s): Jauwairia Nasir, Aditi Kothiyal, Barbara Bruno, Pierre Dillenbourg
Published in: International Journal of Computer-Supported Collaborative Learning, Issue 16, 2021, Page(s) 485–523, ISSN 1556-1607
Publisher: Springer Verlag
DOI: 10.1007/s11412-021-09358-2

Explainable Embodied Agents Through Social Cues: A Review

Author(s): Sebastian Wallkotter, Silvia Tulli, Ginevra Castellano, Ana Paiva, Mohamed Chetouani
Published in: ACM Transactions on Human-Robot Interaction, Issue 10 (3), 2021, ISSN 2573-9522
Publisher: Association for Computing Machinery
DOI: 10.1145/3457188

What if Social Robots Look for Productive Engagement?

Author(s): Jauwairia Nasir, Barbara Bruno, Mohamed Chetouani, Pierre Dillenbourg
Published in: International Journal of Social Robotics, Issue 14, 2022, Page(s) 55-71, ISSN 1875-4791
Publisher: Springer Verlag
DOI: 10.1007/s12369-021-00766-w

Studying Alignment in a Collaborative Learning Activity via Automatic Methods: The Link Between What We Say and Do

Author(s): Utku Norman, Tanvi Dinkar, Barbara Bruno, Chloé Clavel
Published in: Dialogue and Discourse, Issue Vol 13, n02, 2022, ISSN 2152-9620
Publisher: D&D
DOI: 10.5210/dad.2022.201

A Meta-analysis on Children’s Trust in Social Robots

Author(s): Rebecca Stower; Natalia Calvo-Barajas; Ginevra Castellano; Arvid Kappas
Published in: Springer, Issue 5, 2021, ISSN 2193-1801
Publisher: Springer Science and Business Media Deutschland GmbH
DOI: 10.1007/s12369-020-00736-8

Towards Transparent Robot Learning Through TDRL-Based Emotional Expressions

Author(s): Joost Broekens; Mohamed Chetouani
Published in: IEEE Transactions on Affective Computing, Issue 3, 2021, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/taffc.2019.2893348

Engagement in Human-Agent Interaction: An Overview

Author(s): Catharine Oertel, Ginevra Castellano, Mohamed Chetouani, Jauwairia Nasir, Mohammad Obaid, Catherine Pelachaud, Christopher Peters
Published in: Frontiers in Robotics and AI, Issue 7, 2020, ISSN 2296-9144
Publisher: Frontiers
DOI: 10.3389/frobt.2020.00092

Robots for Learning

Author(s): Wafa Johal, Ginevra Castellano, Fumihide Tanaka, Sandra Okita
Published in: International Journal of Social Robotics, Issue 10/3, 2018, Page(s) 293-294, ISSN 1875-4791
Publisher: Springer Verlag
DOI: 10.1007/s12369-018-0481-8

Automating the Production of Communicative Gestures in Embodied Characters

Author(s): Brian Ravenet, Catherine Pelachaud, Chloé Clavel, Stacy Marsella
Published in: Frontiers in Psychology, Issue 9, 2018, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2018.01144

Applying IDC theory to education in the Alps region: a response to Chan et al.’s contribution

Author(s): Pierre Dillenbourg, Kevin Gonyop Kim, Jauwairia Nasir, Shuqing Teresa Yeo, Jennifer K. Olsen
Published in: Research and Practice in Technology Enhanced Learning, Issue 14/1, 2019, ISSN 1793-7078
Publisher: SpringerOpen
DOI: 10.1186/s41039-019-0111-6

Two ways to make your robot proactive: Reasoning about human intentions or reasoning about possible futures

Author(s): Sera Buyukgoz, Jasmin Grosinger, Mohamed Chetouani, Alessandro Soffiotti
Published in: Frontiers in Robotics and AI, Issue Vol 9, 2022, ISSN 2296-9144
Publisher: Frontiers in Robotics and AI
DOI: 10.3389/frobt.2022.929267

Exploring Behavioral Creativity of a Proactive Robot

Author(s): Sera Buyukgoz, Amit Kumar Pandey, Marine Chamoux, Mohamed Chetouani
Published in: Frontiers in Robotics and AI, Issue Vol 8, 2021, ISSN 2296-9144
Publisher: Frontiers in Robotics and AI
DOI: 10.3389/frobt.2021.694177

Hurry Up, We Need to Find the Key! How Regulatory Focus Design Affects Children’s Trust in a Social Robot

Author(s): Natalia Calvo-Barajas; Maha Elgarf; Giulia Perugia; Ana Paiva; Christopher Peters; Ginevra Castellano
Published in: Frontiers in Robotics and AI, Issue 4, 2021, ISSN 2296-9144
Publisher: Frontiers in Robotics and IA
DOI: 10.3389/frobt.2021.652035

Orchestration of Robotic Activities in Classrooms: Challenges and Opportunities

Author(s): Sina Shahmoradi, Jennifer K. Olsen, Stian Haklev, Wafa Johal, Utku Norman, Jauwairia Nasir, Pierre Dillenbourg
Published in: Transforming Learning with Meaningful Technologies - 14th European Conference on Technology Enhanced Learning, EC-TEL 2019, Delft, The Netherlands, September 16–19, 2019, Proceedings, Issue 11722, 2019, Page(s) 640-644, ISBN 978-3-030-29735-0
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-29736-7_57

Deliverables

Publications

Download Download the content of the page