Skip to main content
Weiter zur Homepage der Europäischen Kommission (öffnet in neuem Fenster)
Deutsch Deutsch
CORDIS - Forschungsergebnisse der EU
CORDIS

Photoreal REaltime Sentient ENTity

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Protocols and APIs implementation (öffnet in neuem Fenster)

Protocols and APIs implementation (OTHER, PU, M24) will consist of the software implementation of the protocols and APIs carried out in WP5T3 together with the corresponding documentation for developers to integrate with the sentient agent.

Reactive Agent and Touch Enabling (öffnet in neuem Fenster)

Reactive Agent and Touch Enabling R PU M30 will describe the results of the reactive character animation system and presents the design and evaluation of the hapticenabled interaction techniques

Agent Social Interpretation Enabling (öffnet in neuem Fenster)

Agent Social Interpretation Enabling R PU M24 will demonstrate the fully integrated social sensing system with multimodal interpretation components We will evaluate the final social interpretation components in terms of recognition quality and the effect of transfer learning and context consideration

Non-verbal Agent Behaviour Enabling (öffnet in neuem Fenster)

Nonverbal Agent Behaviour Enabling R PU M24 will present a causal model to predict correct interpersonal agent behaviour based on analysis of the human interlocutor This includes prediction of fitting behaviour as well as correct timings

Interim Report on Non-verbal Agent Behaviour Enabling (öffnet in neuem Fenster)

Interim Report on Non-verbal Agent Behaviour Enabling (R, PU, M12) will concretely define the positive interpersonal behavioural traits to be shown by the virtual agent and analyse the causal relation between user behaviour and expected agent behaviour for a positive interpersonal experience.

Ad-hoc BulletProof Statements (öffnet in neuem Fenster)

Adhoc BulletProof Statements R PU M24 At least a bulletproofbased protocol for one of the relevant required statement including full implementation

Revised report on Modular Architecture, protocols and APIs (öffnet in neuem Fenster)

Revised report on modular architecture, protocols and APIs (R, PU, M12) A report revising the architecture, protocols and APIs after the initial research cycle.

Project Handbook and Quality Plan (öffnet in neuem Fenster)

Project Handbook and Quality Plan (R, PU, M3) contains general operational information including contact details, reporting processes, communication protocols, document templates and numbering methods, logos et cetera. Quality plan elements include information about technical quality control, risk logs and the procedures for risk monitoring, decision-making and conflict resolution.

Agent-to-agent interaction protocol (öffnet in neuem Fenster)

D57

Context Sensitive Agent Adaption Enabling (öffnet in neuem Fenster)

Context Sensitive Agent Adaption Enabling R PU M30 will present a socially aware reinforcement learning approach which enables an unobtrusive adaption of interpersonal agent behaviour to user preferences by using social interpretation as reward

Interim Report on Reactive Behaviour and Haptic Techniques (öffnet in neuem Fenster)

Interim Report on Reactive Behaviour and Haptic Techniques (R, PU, M15) will show progress on the reactive character animation system as well as the preliminary development and evaluation of haptic-enabled interaction techniques.

Experimental Production Scenario Results (öffnet in neuem Fenster)

Experimental Production Scenario Results R PU M36 A report on the findings based on the experimental productions from beginning to end technical creative coordination details with a postmortem section specifying all the lessons learned bestpractices carried out in the experimental production Data and final report of the User Group chaired by Dr Otte final evaluation reports of public audiences and creative professionals Documentation includes a written report and visual material a short film

Prototype Evaluation Results (öffnet in neuem Fenster)

Prototype Evaluation Results R PU M36 with results of all prototype evaluation tasks for PRESENT

Interim Report on Agent Social Interpretation Enabling (öffnet in neuem Fenster)

Interim Report on Agent Social Interpretation Enabling (R, PU, M12) will present prototypical recognition components for the interpretation of social behaviour of the agent’s human counterpart. Therefore, we evaluate appropriate machine learning models, assess the needed amount training data as well as acquisition plans and show a first integration in the agent’s social sensing system.

Final Dissemination Report (öffnet in neuem Fenster)

Final Dissemination Report R PU M36 Report on dissemination activities for Years 13 and plans for further dissemination of results with links to the academic publications produced in the course of the project

Real-time Agent Creation Demonstration (öffnet in neuem Fenster)

Real-time Agent Creation Demonstration (DEM, PU, M12) virtual agent shaded and ray-traced in real time.

Fast Renderer Demonstration (öffnet in neuem Fenster)

Fast Renderer Demonstration (DEM, PU, M24) Demonstration of future generation renderer and cutting-edge interactions made feasible.

Agent Integration Demonstration (öffnet in neuem Fenster)

Agent Integration Demonstration (DEM, PU, M36) demonstrates the fully integrated sentient agent, consisting of parallel execution of dialogue management, socially sound non-verbal behaviour as well as reactive and haptic feedback. It defines the final protocol for communication of generated behaviour recommendations to the visual agent.Agent Integration Demonstration (DEM, PU, M36) demonstrates the fully integrated sentient agent, consisting of parallel execution of dialogue management, socially sound non-verbal behaviour as well as reactive and haptic feedback. It defines the final protocol for communication of generated behaviour recommendations to the visual agent.

Interim Visual Facial Animation Demonstration (öffnet in neuem Fenster)

Interim Visual Facial Animation Demonstration (DEM, PU, M15) Demonstration of facial animation of the character rig driven by offline performance data and an initial version of the facial animation engine.

Background Agent Environment Creation Demonstration (öffnet in neuem Fenster)

Background Agent Environment Creation Demonstration (DEM, PU, M24) Game Engine background render and composite demonstration.

Agent Behavioural Synthesis Demonstration (öffnet in neuem Fenster)

Agent Behavioural Synthesis Demonstration (DEM, PU, M30) final software prototype that can animate and puppeteer an avatar based on an input API emotional demands, stylisations and animation transfer.

Final Showcase Demonstration (öffnet in neuem Fenster)

Final Showcase Demonstration (DEM, PU, M33). Final showcase demonstration at key industry event.

Interim Body Animation Visual Synthesis Demonstration (öffnet in neuem Fenster)

Interim Body Animation Visual Synthesis Demonstration (DEM, PU, M18) Demonstration of prototype software component to animate and puppeteer an agent; interim demonstration will be based on same data used for training as well as data outside of training envelop to validate the model and the boundaries.

Virtual Character Player Demonstration (öffnet in neuem Fenster)

Virtual Character Player Demonstration (DEM, PU, M30) final demonstration version of the single GPU real-time high-quality interactive character player showing integration based on open APIs.

Interactive Facial Animation DemonstrationInteractive Facial Animation Demonstration (öffnet in neuem Fenster)

Interactive Facial Animation Demonstration (DEM, PU, M30) Demonstration of the facial animation software driven by interactive cues, combined with body animation and rendered in real time.

Project Website (öffnet in neuem Fenster)

Project Website (DEC, PU, M6). A multimedia website with public deliverables and information.

Data Management Plan (öffnet in neuem Fenster)

Data Management Plan (R, PU, M6) will report on the data plan strategy for the proposal. The plan will address data that can be made available for open research and accessibility.

Veröffentlichungen

Pianobot: An Adaptive Robotic Piano Tutor

Autoren: Hannes Ritschel, Andreas Seiderer, Elisabeth Andre
Veröffentlicht in: Workshop on Exploring Creative Content in Social Robotics at HRI 2020, 2020
Herausgeber: -

A Prototypical Network Approach for Evaluating Generated Emotional Speech (öffnet in neuem Fenster)

Autoren: Alice Baird, Silvan Mertes, Manuel Milling, Lukas Stappen, Thomas Wiest, Elisabeth Andre, Bjorn W. Schuller
Veröffentlicht in: INTERSPEECH'21, 2021
Herausgeber: Proc. Interspeech
DOI: 10.21437/interspeech.2021-1123

FIRA - Portable Realtime Rig Deformation (öffnet in neuem Fenster)

Autoren: Manne Öhrström, Leo Hills, Theodore Jones
Veröffentlicht in: DigiPro '21: The Digital Production Symposium, 2021
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3469095.3469277

An Evolutionary-based Generative Approach for Audio Data Augmentation (öffnet in neuem Fenster)

Autoren: Silvan Mertes, Alice Baird, Dominik Schiller, Bjorn W. Schuller, Elisabeth Andre
Veröffentlicht in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), 2020, Seite(n) 1-6, ISBN 978-1-7281-9320-5
Herausgeber: IEEE
DOI: 10.1109/mmsp48831.2020.9287156

Implementing Parallel and Independent Movements for a Social Robot's Affective Expressions (öffnet in neuem Fenster)

Autoren: Hannes Ritschel; Thomas Kiderle; Elisabeth André
Veröffentlicht in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021
Herausgeber: IEEE
DOI: 10.1109/aciiw52867.2021.9666341

Topology-aware Camera Control for Real-time Applications (öffnet in neuem Fenster)

Autoren: Alberto Jovane, Amaury Louarn, Marc Christie
Veröffentlicht in: Motion, Interaction and Games, 2020, Seite(n) 1-10, ISBN 9781450381710
Herausgeber: ACM
DOI: 10.1145/3424636.3426892

Multimodal Joke Presentation for Social Robots based on Natural-Language Generation and Nonverbal Behaviors

Autoren: Hannes Ritschel,Thomas Kiderle, Klaus Weber, Elisabeth Andre
Veröffentlicht in: Second Workshop on Natural Language Generation for Human–Robot Interaction at HRI 2020, 2020
Herausgeber: -

On the Potential of Voice Conversion for Virtual Agents

Autoren: Silvan Mertes,Thomas Kiderle, Ruben Schalgowski, Florian Lingenfelser, Elisabeth André
Veröffentlicht in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021
Herausgeber: IEEE

Analysis by Synthesis: Using an expressive TTS Model as Feature Extractor for Paralinguistic Speech Classification (öffnet in neuem Fenster)

Autoren: Dominik Schiller1, Silvan Mertes1, Pol van Rijn, Elisabeth Andre
Veröffentlicht in: INTERSPEECH'21, 2021
Herausgeber: Proc. Inerspeech
DOI: 10.21437/interspeech.2021-1587

VoiceMe: Personalized voice generation in TTS (öffnet in neuem Fenster)

Autoren: Pol van Rijn, Silvan Mertes, Dominik Schiller, Piotr Dura, Hubert Siuzdak, Peter M. C. Harrison, Elisabeth André, Nori Jacoby
Veröffentlicht in: Interspeech'22, 2022
Herausgeber: Proc. Inerspeech
DOI: 10.48550/arxiv.2203.15379

Exploring emotional prototypes in a high dimensional TTS latent space (öffnet in neuem Fenster)

Autoren: Pol van Rijn; Silvan Mertes; Dominik Schiller; Peter M. C. Harrison; Pauline Larrouy-Maestri; Elisabeth André; Nori Jacoby
Veröffentlicht in: INTERSPEECH'21, Ausgabe 1, 2021
Herausgeber: Proc. Interspeech
DOI: 10.48550/arxiv.2105.01891

Socially-Aware Personality Adaptation (öffnet in neuem Fenster)

Autoren: Thomas Kiderle; Hannes Ritschel; Kathrin Janowski; Silvan Mertes; Florian Lingenfelser; Elisabeth Andre
Veröffentlicht in: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 2021
Herausgeber: IEEE
DOI: 10.1109/aciiw52867.2021.9666197

A Viewpoint-Driven Approach for Bodily Nonverbal Communication (öffnet in neuem Fenster)

Autoren: Pierre Raimbaud; Alberto Jovane; Katja Zibrek; Claudio Pacchierotti; Marc Christie; Ludovic Hoyet; Julien Pettré; Anne-Hélène Olivier
Veröffentlicht in: IVA '21: Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents, 2021
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3472306.3478351

A trust module for the interaction with virtual characters

Autoren: Boldrin L, Daza V, De Prisco R, Rovira S, Sivo S.
Veröffentlicht in: ICSAI 2021, 7th International Conference on Systems and Informatics, 2022
Herausgeber: IEEE

Continuous Emotions: Exploring Label Interpolation in Conditional Generative Adversarial Networks for Face Generation (öffnet in neuem Fenster)

Autoren: Silvan Mertes ; Florian Lingenfelser ; Thomas Kiderle ; Michael Dietz ; Lama Diab and Elisabeth André
Veröffentlicht in: Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - DeLTA, 2021
Herausgeber: SciTePress
DOI: 10.5220/0010549401320139

Generalized Microscropic Crowd Simulation using Costs in Velocity Space

Autoren: Wouter van Toll, Fabien Grzeskowiak, Axel López, Javad Amirian, Florian Berton; Julien Bruneau; Beatriz Cabrero Daniel; Alberto Jovane; Julien Pettré
Veröffentlicht in: I3D ’20 - ACM SIGGRAPH Symposium on Interactive 3d Graphics and Gamers, 2020
Herausgeber: Association for Computing Machinery

A Perceptually-Validated Metric for Crowd TrajectoryQuality Evaluation (öffnet in neuem Fenster)

Autoren: BEATRIZ CABRERO DANIEL RICARDO MARQUES LUDOVIC HOYET JULIEN PETTRÉ JOSEP BLAT
Veröffentlicht in: Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2021
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3480136

Reactive Virtual Agents: A Viewpoint-Driven Approach for Bodily Nonverbal Communication

Autoren: Pierre Raimbaud; Alberto Jovane; Katja Zibrek; Claudio Pacchierotti; Marc Christie; Ludovic Hoyet; Julien Pettré; Anne-Hélène Olivier
Veröffentlicht in: IVA '21: Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents, 2021
Herausgeber: ACM Digital Library

ZPiE: Zero-Knowledge Proofs in Embedded Systems (öffnet in neuem Fenster)

Autoren: Xavier Salleras; Vanesa Daza
Veröffentlicht in: Mathematics, 2021, ISSN 2227-7390
Herausgeber: MDPI
DOI: 10.3390/math9202569

Crowd Navigation in VR: exploring haptic rendering of collisions (öffnet in neuem Fenster)

Autoren: Florian Berton, Fabien Grzeskowiak, Alexandre Bonneau, Alberto Jovane, Marco Aggravi, Ludovic Hoyet, Anne-Helene Olivier, Claudio Pacchierotti, Julien Pettre
Veröffentlicht in: IEEE Transactions on Visualization and Computer Graphics, 2020, Seite(n) 1-1, ISSN 1077-2626
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3041341

FORT: Right-proving and Attribute-blinding Self-sovereign Authentication (öffnet in neuem Fenster)

Autoren: Vanesa Daza; Sergi Rovira Cisterna; Xavier Salleras
Veröffentlicht in: Mathematics, Ausgabe 1, 2022, ISSN 2227-7390
Herausgeber: MDPI
DOI: 10.48550/arxiv.2202.09136

New privacy practices for blockchain software (öffnet in neuem Fenster)

Autoren: Marta Belles-Munoz; Jordi Baylina; Vanesa Daza; Jose L. Muñoz
Veröffentlicht in: IEEE Software, 2022, ISSN 0740-7459
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ms.2021.3086718

Interaction Fields: Intuitive Sketch‐based Steering Behaviors for Crowd Simulation (öffnet in neuem Fenster)

Autoren: A. Colas; W. Toll; K. Zibrek; L. Hoyet; A.‐H. Olivier; J. Pettré
Veröffentlicht in: Computer Graphics Forum, 2020, ISSN 0000-0000
Herausgeber: Wiley
DOI: 10.1111/cgf.14491

The Effect of Gender and Attractiveness of Motion on Proximity in Virtual Reality (öffnet in neuem Fenster)

Autoren: Katja Zibrek, Benjamin Niay, Anne-Hélène Olivier, Ludovic Hoyet, Julien Pettre, Rachel McDonnell
Veröffentlicht in: ACM Transactions on Applied Perception, Ausgabe 17/4, 2020, Seite(n) 1-15, ISSN 1544-3558
Herausgeber: Association for Computing Machinary, Inc.
DOI: 10.1145/3419985

Updateable Inner Product Argument with Logarithmic Verifier and Applications (öffnet in neuem Fenster)

Autoren: Vanesa Daza, Carla Ràfols, Alexandros Zacharakis
Veröffentlicht in: Public-Key Cryptography – PKC 2020 - 23rd IACR International Conference on Practice and Theory of Public-Key Cryptography, Edinburgh, UK, May 4–7, 2020, Proceedings, Part I, Ausgabe 12110, 2020, Seite(n) 527-557, ISBN 978-3-030-45373-2
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-030-45374-9_18

Multimodal Joke Generation and Paralinguistic Personalization for a Socially-Aware Robot (öffnet in neuem Fenster)

Autoren: Hannes Ritschel, Thomas Kiderle, Klaus Weber, Florian Lingenfelser, Tobias Baur, Elisabeth André
Veröffentlicht in: Advances in Practical Applications of Agents, Multi-Agent Systems, and Trustworthiness. The PAAMS Collection - 18th International Conference, PAAMS 2020, L'Aquila, Italy, October 7–9, 2020, Proceedings, Ausgabe 12092, 2020, Seite(n) 278-290, ISBN 978-3-030-49777-4
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-030-49778-1_22

Embedded emotions - a data driven approach to learn transferable feature representations from raw speech input for emotion recognition (öffnet in neuem Fenster)

Autoren: Schiller, Dominik; Mertes, Silvan; André, Elisabeth
Veröffentlicht in: Audio and Speech Processing, Ausgabe 1, 2020
Herausgeber: arXiv
DOI: 10.48550/arxiv.2009.14523

Intercategorical Label Interpolation for Emotional Face Generation with Conditional Generative Adversarial Networks

Autoren: Silvan Mertes, Dominik Schiller, Florian Lingenfelser, Thomas Kiderle, Valentin Kroner, Lama Diab, Elisabeth André
Veröffentlicht in: 2022
Herausgeber: arXiv

Suche nach OpenAIRE-Daten ...

Bei der Suche nach OpenAIRE-Daten ist ein Fehler aufgetreten

Es liegen keine Ergebnisse vor

Mein Booklet 0 0