Skip to main content

Photoreal REaltime Sentient ENTity

Deliverables

Real-time Agent Creation Demonstration

Real-time Agent Creation Demonstration (DEM, PU, M12) virtual agent shaded and ray-traced in real time.

Interim Visual Facial Animation Demonstration

Interim Visual Facial Animation Demonstration (DEM, PU, M15) Demonstration of facial animation of the character rig driven by offline performance data and an initial version of the facial animation engine.

Interim Body Animation Visual Synthesis Demonstration

Interim Body Animation Visual Synthesis Demonstration (DEM, PU, M18) Demonstration of prototype software component to animate and puppeteer an agent; interim demonstration will be based on same data used for training as well as data outside of training envelop to validate the model and the boundaries.

Project Website

Project Website (DEC, PU, M6). A multimedia website with public deliverables and information.

Interim Report on Non-verbal Agent Behaviour Enabling

Interim Report on Non-verbal Agent Behaviour Enabling (R, PU, M12) will concretely define the positive interpersonal behavioural traits to be shown by the virtual agent and analyse the causal relation between user behaviour and expected agent behaviour for a positive interpersonal experience.

Revised report on Modular Architecture, protocols and APIs

Revised report on modular architecture, protocols and APIs (R, PU, M12) A report revising the architecture, protocols and APIs after the initial research cycle.

Project Handbook and Quality Plan

Project Handbook and Quality Plan (R, PU, M3) contains general operational information including contact details, reporting processes, communication protocols, document templates and numbering methods, logos et cetera. Quality plan elements include information about technical quality control, risk logs and the procedures for risk monitoring, decision-making and conflict resolution.

Interim Report on Reactive Behaviour and Haptic Techniques

Interim Report on Reactive Behaviour and Haptic Techniques (R, PU, M15) will show progress on the reactive character animation system as well as the preliminary development and evaluation of haptic-enabled interaction techniques.

Interim Report on Agent Social Interpretation Enabling

Interim Report on Agent Social Interpretation Enabling (R, PU, M12) will present prototypical recognition components for the interpretation of social behaviour of the agent’s human counterpart. Therefore, we evaluate appropriate machine learning models, assess the needed amount training data as well as acquisition plans and show a first integration in the agent’s social sensing system.

Data Management Plan

Data Management Plan (R, PU, M6) will report on the data plan strategy for the proposal. The plan will address data that can be made available for open research and accessibility.

Publications

Pianobot: An Adaptive Robotic Piano Tutor

Author(s): Hannes Ritschel, Andreas Seiderer, Elisabeth Andre
Published in: Workshop on Exploring Creative Content in Social Robotics at HRI 2020, 2020

An Evolutionary-based Generative Approach for Audio Data Augmentation

Author(s): Silvan Mertes, Alice Baird, Dominik Schiller, Bjorn W. Schuller, Elisabeth Andre
Published in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), 2020, Page(s) 1-6
DOI: 10.1109/mmsp48831.2020.9287156

Topology-aware Camera Control for Real-time Applications

Author(s): Alberto Jovane, Amaury Louarn, Marc Christie
Published in: Motion, Interaction and Games, 2020, Page(s) 1-10
DOI: 10.1145/3424636.3426892

Multimodal Joke Presentation for Social Robots based on Natural-Language Generation and Nonverbal Behaviors

Author(s): Hannes Ritschel,Thomas Kiderle, Klaus Weber, Elisabeth Andre
Published in: Second Workshop on Natural Language Generation for Human–Robot Interaction at HRI 2020, 2020

Updateable Inner Product Argument with Logarithmic Verifier and Applications

Author(s): Vanesa Daza, Carla Ràfols, Alexandros Zacharakis
Published in: Public-Key Cryptography – PKC 2020 - 23rd IACR International Conference on Practice and Theory of Public-Key Cryptography, Edinburgh, UK, May 4–7, 2020, Proceedings, Part I, Issue 12110, 2020, Page(s) 527-557
DOI: 10.1007/978-3-030-45374-9_18

Multimodal Joke Generation and Paralinguistic Personalization for a Socially-Aware Robot

Author(s): Hannes Ritschel, Thomas Kiderle, Klaus Weber, Florian Lingenfelser, Tobias Baur, Elisabeth André
Published in: Advances in Practical Applications of Agents, Multi-Agent Systems, and Trustworthiness. The PAAMS Collection - 18th International Conference, PAAMS 2020, L'Aquila, Italy, October 7–9, 2020, Proceedings, Issue 12092, 2020, Page(s) 278-290
DOI: 10.1007/978-3-030-49778-1_22

Crowd Navigation in VR: exploring haptic rendering of collisions

Author(s): Florian Berton, Fabien Grzeskowiak, Alexandre Bonneau, Alberto Jovane, Marco Aggravi, Ludovic Hoyet, Anne-Helene Olivier, Claudio Pacchierotti, Julien Pettre
Published in: IEEE Transactions on Visualization and Computer Graphics, 2020, Page(s) 1-1, ISSN 1077-2626
DOI: 10.1109/tvcg.2020.3041341

The Effect of Gender and Attractiveness of Motion on Proximity in Virtual Reality

Author(s): Katja Zibrek, Benjamin Niay, Anne-Hélène Olivier, Ludovic Hoyet, Julien Pettre, Rachel McDonnell
Published in: ACM Transactions on Applied Perception, Issue 17/4, 2020, Page(s) 1-15, ISSN 1544-3558
DOI: 10.1145/3419985