Deliverables Documents, reports (14) Reactive Agent and Touch Enabling Reactive Agent and Touch Enabling R PU M30 will describe the results of the reactive character animation system and presents the design and evaluation of the hapticenabled interaction techniques Agent Social Interpretation Enabling Agent Social Interpretation Enabling R PU M24 will demonstrate the fully integrated social sensing system with multimodal interpretation components We will evaluate the final social interpretation components in terms of recognition quality and the effect of transfer learning and context consideration Non-verbal Agent Behaviour Enabling Nonverbal Agent Behaviour Enabling R PU M24 will present a causal model to predict correct interpersonal agent behaviour based on analysis of the human interlocutor This includes prediction of fitting behaviour as well as correct timings Interim Report on Non-verbal Agent Behaviour Enabling Interim Report on Non-verbal Agent Behaviour Enabling (R, PU, M12) will concretely define the positive interpersonal behavioural traits to be shown by the virtual agent and analyse the causal relation between user behaviour and expected agent behaviour for a positive interpersonal experience. Ad-hoc BulletProof Statements Adhoc BulletProof Statements R PU M24 At least a bulletproofbased protocol for one of the relevant required statement including full implementation Revised report on Modular Architecture, protocols and APIs Revised report on modular architecture, protocols and APIs (R, PU, M12) A report revising the architecture, protocols and APIs after the initial research cycle. Project Handbook and Quality Plan Project Handbook and Quality Plan (R, PU, M3) contains general operational information including contact details, reporting processes, communication protocols, document templates and numbering methods, logos et cetera. Quality plan elements include information about technical quality control, risk logs and the procedures for risk monitoring, decision-making and conflict resolution. Agent-to-agent interaction protocol D57 Context Sensitive Agent Adaption Enabling Context Sensitive Agent Adaption Enabling R PU M30 will present a socially aware reinforcement learning approach which enables an unobtrusive adaption of interpersonal agent behaviour to user preferences by using social interpretation as reward Interim Report on Reactive Behaviour and Haptic Techniques Interim Report on Reactive Behaviour and Haptic Techniques (R, PU, M15) will show progress on the reactive character animation system as well as the preliminary development and evaluation of haptic-enabled interaction techniques. Experimental Production Scenario Results Experimental Production Scenario Results R PU M36 A report on the findings based on the experimental productions from beginning to end technical creative coordination details with a postmortem section specifying all the lessons learned bestpractices carried out in the experimental production Data and final report of the User Group chaired by Dr Otte final evaluation reports of public audiences and creative professionals Documentation includes a written report and visual material a short film Prototype Evaluation Results Prototype Evaluation Results R PU M36 with results of all prototype evaluation tasks for PRESENT Interim Report on Agent Social Interpretation Enabling Interim Report on Agent Social Interpretation Enabling (R, PU, M12) will present prototypical recognition components for the interpretation of social behaviour of the agent’s human counterpart. Therefore, we evaluate appropriate machine learning models, assess the needed amount training data as well as acquisition plans and show a first integration in the agent’s social sensing system. Final Dissemination Report Final Dissemination Report R PU M36 Report on dissemination activities for Years 13 and plans for further dissemination of results with links to the academic publications produced in the course of the project Demonstrators, pilots, prototypes (3) Real-time Agent Creation Demonstration Real-time Agent Creation Demonstration (DEM, PU, M12) virtual agent shaded and ray-traced in real time. Interim Visual Facial Animation Demonstration Interim Visual Facial Animation Demonstration (DEM, PU, M15) Demonstration of facial animation of the character rig driven by offline performance data and an initial version of the facial animation engine. Interim Body Animation Visual Synthesis Demonstration Interim Body Animation Visual Synthesis Demonstration (DEM, PU, M18) Demonstration of prototype software component to animate and puppeteer an agent; interim demonstration will be based on same data used for training as well as data outside of training envelop to validate the model and the boundaries. Websites, patent fillings, videos etc. (1) Project Website Project Website (DEC, PU, M6). A multimedia website with public deliverables and information. Open Research Data Pilot (1) Data Management Plan Data Management Plan (R, PU, M6) will report on the data plan strategy for the proposal. The plan will address data that can be made available for open research and accessibility. Publications Conference proceedings (20) Pianobot: An Adaptive Robotic Piano Tutor Author(s): Hannes Ritschel, Andreas Seiderer, Elisabeth Andre Published in: Workshop on Exploring Creative Content in Social Robotics at HRI 2020, 2020 Publisher: - A Prototypical Network Approach for Evaluating Generated Emotional Speech Author(s): Alice Baird, Silvan Mertes, Manuel Milling, Lukas Stappen, Thomas Wiest, Elisabeth Andre, Bjorn W. Schuller Published in: INTERSPEECH'21, 2021 Publisher: Proc. Interspeech DOI: 10.21437/interspeech.2021-1123 FIRA - Portable Realtime Rig Deformation Author(s): Manne Öhrström, Leo Hills, Theodore Jones Published in: DigiPro '21: The Digital Production Symposium, 2021 Publisher: Association for Computing Machinery DOI: 10.1145/3469095.3469277 An Evolutionary-based Generative Approach for Audio Data Augmentation Author(s): Silvan Mertes, Alice Baird, Dominik Schiller, Bjorn W. Schuller, Elisabeth Andre Published in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), 2020, Page(s) 1-6, ISBN 978-1-7281-9320-5 Publisher: IEEE DOI: 10.1109/mmsp48831.2020.9287156 Generalized Microscropic Crowd Simulation using Costs in Velocity Space Author(s): Wouter van Toll; Fabien Grzeskowiak; Axel Lopez Gandia; Javad Amirian; Florian Berton; Julien Bruneau; Beatriz Cabrero Daniel; Alberto Jovane; Julien Pettré Published in: i3D 2020 - ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 2020 Publisher: Association for Computing Machinery DOI: 10.1145/3384382.3384532 Implementing Parallel and Independent Movements for a Social Robot's Affective Expressions Author(s): Hannes Ritschel; Thomas Kiderle; Elisabeth André Published in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021 Publisher: IEEE DOI: 10.1109/aciiw52867.2021.9666341 Topology-aware Camera Control for Real-time Applications Author(s): Alberto Jovane, Amaury Louarn, Marc Christie Published in: Motion, Interaction and Games, 2020, Page(s) 1-10, ISBN 9781450381710 Publisher: ACM DOI: 10.1145/3424636.3426892 Multimodal Joke Presentation for Social Robots based on Natural-Language Generation and Nonverbal Behaviors Author(s): Hannes Ritschel,Thomas Kiderle, Klaus Weber, Elisabeth Andre Published in: Second Workshop on Natural Language Generation for Human–Robot Interaction at HRI 2020, 2020 Publisher: - On the Potential of Voice Conversion for Virtual Agents Author(s): Silvan Mertes,Thomas Kiderle, Ruben Schalgowski, Florian Lingenfelser, Elisabeth André Published in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021 Publisher: IEEE Analysis by Synthesis: Using an expressive TTS Model as Feature Extractor for Paralinguistic Speech Classification Author(s): Dominik Schiller1, Silvan Mertes1, Pol van Rijn, Elisabeth Andre Published in: INTERSPEECH'21, 2021 Publisher: Proc. Inerspeech DOI: 10.21437/interspeech.2021-1587 A trust module for the interaction with virtual characters Author(s): Luca Boldrin; Vanesa Daza; Roberto De Prisco; Sergi Rovira; Saverio Sivo Published in: International Conference on Systems and Informatics (ICSAI), 2022 Publisher: IEEE DOI: 10.1109/icsai53574.2021.9664176 VoiceMe: Personalized voice generation in TTS Author(s): Pol van Rijn, Silvan Mertes, Dominik Schiller, Piotr Dura, Hubert Siuzdak, Peter M. C. Harrison, Elisabeth André, Nori Jacoby Published in: Interspeech'22, 2022 Publisher: Proc. Inerspeech DOI: 10.48550/arxiv.2203.15379 Exploring emotional prototypes in a high dimensional TTS latent space Author(s): Pol van Rijn; Silvan Mertes; Dominik Schiller; Peter M. C. Harrison; Pauline Larrouy-Maestri; Elisabeth André; Nori Jacoby Published in: INTERSPEECH'21, Issue 1, 2021 Publisher: Proc. Interspeech DOI: 10.48550/arxiv.2105.01891 Socially-Aware Personality Adaptation Author(s): Thomas Kiderle; Hannes Ritschel; Kathrin Janowski; Silvan Mertes; Florian Lingenfelser; Elisabeth Andre Published in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021 Publisher: IEEE DOI: 10.1109/aciiw52867.2021.9666197 A Viewpoint-Driven Approach for Bodily Nonverbal Communication Author(s): Pierre Raimbaud; Alberto Jovane; Katja Zibrek; Claudio Pacchierotti; Marc Christie; Ludovic Hoyet; Julien Pettré; Anne-Hélène Olivier Published in: IVA '21: Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents, 2021 Publisher: Association for Computing Machinery DOI: 10.1145/3472306.3478351 A trust module for the interaction with virtual characters Author(s): Boldrin L, Daza V, De Prisco R, Rovira S, Sivo S. Published in: ICSAI 2021, 7th International Conference on Systems and Informatics, 2022 Publisher: IEEE Continuous Emotions: Exploring Label Interpolation in Conditional Generative Adversarial Networks for Face Generation Author(s): Silvan Mertes ; Florian Lingenfelser ; Thomas Kiderle ; Michael Dietz ; Lama Diab and Elisabeth André Published in: Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - DeLTA, 2021 Publisher: SciTePress DOI: 10.5220/0010549401320139 Generalized Microscropic Crowd Simulation using Costs in Velocity Space Author(s): Wouter van Toll, Fabien Grzeskowiak, Axel López, Javad Amirian, Florian Berton; Julien Bruneau; Beatriz Cabrero Daniel; Alberto Jovane; Julien Pettré Published in: I3D ’20 - ACM SIGGRAPH Symposium on Interactive 3d Graphics and Gamers, 2020 Publisher: Association for Computing Machinery A Perceptually-Validated Metric for Crowd TrajectoryQuality Evaluation Author(s): BEATRIZ CABRERO DANIEL RICARDO MARQUES LUDOVIC HOYET JULIEN PETTRÉ JOSEP BLAT Published in: Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2021 Publisher: Association for Computing Machinery DOI: 10.1145/3480136 Reactive Virtual Agents: A Viewpoint-Driven Approach for Bodily Nonverbal Communication Author(s): Pierre Raimbaud; Alberto Jovane; Katja Zibrek; Claudio Pacchierotti; Marc Christie; Ludovic Hoyet; Julien Pettré; Anne-Hélène Olivier Published in: IVA '21: Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents, 2021 Publisher: ACM Digital Library Peer reviewed articles (6) ZPiE: Zero-Knowledge Proofs in Embedded Systems Author(s): Xavier Salleras; Vanesa Daza Published in: Mathematics, 2021, ISSN 2227-7390 Publisher: MDPI DOI: 10.3390/math9202569 Crowd Navigation in VR: exploring haptic rendering of collisions Author(s): Florian Berton, Fabien Grzeskowiak, Alexandre Bonneau, Alberto Jovane, Marco Aggravi, Ludovic Hoyet, Anne-Helene Olivier, Claudio Pacchierotti, Julien Pettre Published in: IEEE Transactions on Visualization and Computer Graphics, 2020, Page(s) 1-1, ISSN 1077-2626 Publisher: Institute of Electrical and Electronics Engineers DOI: 10.1109/tvcg.2020.3041341 FORT: Right-proving and Attribute-blinding Self-sovereign Authentication Author(s): Vanesa Daza; Sergi Rovira Cisterna; Xavier Salleras Published in: Mathematics, Issue 1, 2022, ISSN 2227-7390 Publisher: MDPI DOI: 10.48550/arxiv.2202.09136 New privacy practices for blockchain software Author(s): Marta Belles-Munoz; Jordi Baylina; Vanesa Daza; Jose L. Muñoz Published in: IEEE Software, 2022, ISSN 0740-7459 Publisher: Institute of Electrical and Electronics Engineers DOI: 10.1109/ms.2021.3086718 Interaction Fields: Intuitive Sketch‐based Steering Behaviors for Crowd Simulation Author(s): A. Colas; W. Toll; K. Zibrek; L. Hoyet; A.‐H. Olivier; J. Pettré Published in: Computer Graphics Forum, 2020, ISSN 0000-0000 Publisher: Wiley DOI: 10.1111/cgf.14491 The Effect of Gender and Attractiveness of Motion on Proximity in Virtual Reality Author(s): Katja Zibrek, Benjamin Niay, Anne-Hélène Olivier, Ludovic Hoyet, Julien Pettre, Rachel McDonnell Published in: ACM Transactions on Applied Perception, Issue 17/4, 2020, Page(s) 1-15, ISSN 1544-3558 Publisher: Association for Computing Machinary, Inc. DOI: 10.1145/3419985 Book chapters (2) Updateable Inner Product Argument with Logarithmic Verifier and Applications Author(s): Vanesa Daza, Carla Ràfols, Alexandros Zacharakis Published in: Public-Key Cryptography – PKC 2020 - 23rd IACR International Conference on Practice and Theory of Public-Key Cryptography, Edinburgh, UK, May 4–7, 2020, Proceedings, Part I, Issue 12110, 2020, Page(s) 527-557, ISBN 978-3-030-45373-2 Publisher: Springer International Publishing DOI: 10.1007/978-3-030-45374-9_18 Multimodal Joke Generation and Paralinguistic Personalization for a Socially-Aware Robot Author(s): Hannes Ritschel, Thomas Kiderle, Klaus Weber, Florian Lingenfelser, Tobias Baur, Elisabeth André Published in: Advances in Practical Applications of Agents, Multi-Agent Systems, and Trustworthiness. The PAAMS Collection - 18th International Conference, PAAMS 2020, L'Aquila, Italy, October 7–9, 2020, Proceedings, Issue 12092, 2020, Page(s) 278-290, ISBN 978-3-030-49777-4 Publisher: Springer International Publishing DOI: 10.1007/978-3-030-49778-1_22 Other (2) Embedded emotions - a data driven approach to learn transferable feature representations from raw speech input for emotion recognition Author(s): Schiller, Dominik; Mertes, Silvan; André, Elisabeth Published in: Audio and Speech Processing, Issue 1, 2020 Publisher: arXiv DOI: 10.48550/arxiv.2009.14523 Intercategorical Label Interpolation for Emotional Face Generation with Conditional Generative Adversarial Networks Author(s): Silvan Mertes, Dominik Schiller, Florian Lingenfelser, Thomas Kiderle, Valentin Kroner, Lama Diab, Elisabeth André Published in: 2022 Publisher: arXiv Searching for OpenAIRE data... There was an error trying to search data from OpenAIRE No results available