Innovative Volumetric Capture and Editing Tools for Ubiquitous Storytelling

Leistungen

D4.4 Creative XR Productions and Evaluation Report 2

We will perform final experimental XR productions to evaluate the final achievements of the INVICTUS project

D1.1 Report on architecture for volumetric motion capture, tracking, and database generation

Workpackage 1 addresses the development of algorithms necessary to create interactive representations of volumetric content This deliverable specifies the architecture of software components for the processing pipeline This includes algorithms for geometry reconstruction temporal registration automatic rigging animation and hybrid content creation

D3.1 Collaborative VR scene editing tool

Report on the implemented features of the Collaborative VR scene editing tool typically Scene Layout Lighting and cinematography

D5.1 First Plan for the Exploitation and Dissemination of the Results

A detailed report presenting a first plan for the dissemination and exploitation of the results within a the different scientific communities and b the targeted industries specified within the INVICTUS project ie VFX CG and animation and interactive industries

D5.3 Final Plan for the Exploitation and Dissemination of the Results

A final report presenting a detailed plan for the dissemination of the results within a the different scientific communities and b the targeted industries specified within the project ie VFX CG and animation and interactive industries In addition to that the report will contain a strategy for commercializing the knowledge that was generated within the project in alignment with the exploitation plan driven by the Innovation Board and will include a the management of IPR issues b ownership of the results and c licencing of the scientific outcomes

D5.2 Communication material to promote the project's results

A report presenting the communication material prepared for promoting the projects results including a projects website design and content description b official project templates c enewsletters d social media channels e press releases e project film content 35 minutes long subcontracted

D4.3 Creative XR Productions and Evaluation Report 1

We will carry a first experimental XR production to evaluate the first iteration of the achievements of the INVICTUS project

D1.2 First software package for animatable volumetric video generation

This deliverables provides first software components for the creation of interactive volumetric content together with a description of implemented algorithms THis includes modules for reconstruction registration and animation With these components first demonstration of volumetric video that can be animated and modified will be showcased

D4.2 Evaluation Plan

We will have two XR productions to evaluate the achievements of this project This document is the Evaluation Plan of those XR productions We will make sure to design the best scenario to cover all the achievement off the different work packages

D2.3 First Motion adaptation and style transfer

This first demonstrator will display the implementation of morphology-and-style character adaptation applied to volumetric motion-captured data. Typically we will show how characteristics of the motions need to be adapted to match the morphology and style of the given character (e.g. heaviness, strength, “cartoon animation style” motions, etc.).

D3.3 Volumetric spatio-temporal avatar manipulators

Demonstration of dedicated features for re-animating volumetric motion captured data by extending spatio-temporal animators to specifics of volumetric motion.

D2.6 Final Motion adaptation and style transfer

This final demonstrator will display the implementation of morphology-and-style character adaptation applied to volumetric motion-captured data. Typically we will show how characteristics of the motions need to be adapted to match the morphology and style of the given character (e.g. heaviness, strength, “cartoon animation style” motions, etc.).

Veröffentlichungen

Preserving Memories of Contemporary Witnesses Using Volumetric Video

Autoren: Oliver Schreer, Markus Worchel, Rodrigo Diaz, Sylvain Renault, Wieland Morgenstern, Ingo Feldmann, Marcus Zepp, Anna Hilsmann, Peter Eisert
Veröffentlicht in: Journal of Interactive Media, Ausgabe Volume 21 Ausgabe 1, 2022, Seite(n) 71-82, ISSN 2196-6826
Herausgeber: Oldenbourg Wissenschaftsverlag
DOI: 10.1515/icom-2022-0015

Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation

Autoren: A. Zimmer, A. Hilsmann, W. Morgenstern, P. Eisert
Veröffentlicht in: Comp. Visual Media, Ausgabe 9, 2022, Seite(n) 123–139, ISSN 2096-0662
Herausgeber: Tsinghua University Press and Springer
DOI: 10.48550/arxiv.2202.03074

Study on Automatic 3D Facial Caricaturization: from Rules to Deep Learning

Autoren: Nicolas Olivier, Glenn Kerbiriou, Ferran Argelaguet, Quentin Avril, Fabien Danieau, Philippe Guillotel, Ludovic Hoyet and Franck Multon
Veröffentlicht in: Frontiers in Virtual Reality, 2022, ISSN 2673-4192
Herausgeber: Frontiers in Virtual Reality
DOI: 10.3389/frvir.2021.785104

Example-Based Facial Animation of Virtual Reality Avatars using Auto-Regressive Neural Networks

Autoren: Wolfgang Paier, Anna Hilsmann, Peter Eisert
Veröffentlicht in: IEEE Computer Graphics and Applications, 2021, Seite(n) 1-1, ISSN 0272-1716
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mcg.2021.3068035

FaceTuneGAN: Face Autoencoder for Convolutional Expression Transfer Using Neural Generative Adversarial Networks

Autoren: N. Olivier, K. Baert, F. Danieau, F. Multon, Q. Avril
Veröffentlicht in: Computers & Graphics Volume, Ausgabe 110, 2022, Seite(n) Pages 69-85, ISSN 0097-8493
Herausgeber: Pergamon Press Ltd.
DOI: 10.48550/arxiv.2112.00532

Neural Face Models for Example-Based Visual Speech Synthesis

Autoren: Wolfgang Paier, Anna Hilsmann, Peter Eisert
Veröffentlicht in: European Conference on Visual Media Production, 2020, Seite(n) 1-10, ISBN 9781450381987
Herausgeber: ACM
DOI: 10.1145/3429341.3429356

Temporal Shape Transfer Network for 3D Human Motion

Autoren: J. Regateiro and E. Boyer
Veröffentlicht in: International Conference on 3D Vision (3DV), 2022
Herausgeber: 3DV2022

Smart Motion Trails for Animating in VR

Autoren: J-B. Bordier, A. Mirabile, R. Courant, M. Christie
Veröffentlicht in: IEEE Conference on AIVR 2022, 2022, ISBN 978-1-6654-5725-5
Herausgeber: IEEE

Recovering Fine Details for Neural Implicit Surface Reconstruction

Autoren: D. Chen, P. Zhang, I. Feldmann, O. Schreer, P. Eisert
Veröffentlicht in: IEEE/CVF Winter Conference on Applications of Computer Vision, 2023
Herausgeber: IEEE
DOI: 10.48550/arxiv.2211.11320

Model-Based Deep Portrait Relighting

Autoren: F. Schreiber, A. Hilsmann, P. Eisert
Veröffentlicht in: European Conference on Visual Media Production, 2022
Herausgeber: ACM
DOI: 10.1145/3565516.3565526

Detailed Eye Region Capture and Animation

Autoren: G. Kerbiriou, M. Marchal, Q. Avril
Veröffentlicht in: CM SIGGRAPH / Eurographics Symposium on Computer Animation 2022, Ausgabe Volume 41 (2022), Number 8, 2022
Herausgeber: The Eurographics Association and John Wiley & Sons Ltd.
DOI: 10.1111/cgf.14642

Neural Human Deformation Transfer

Autoren: Basset, Jean; Boukhayma, Adnane; Wuhrer, Stefanie; Multon, Franck; Boyer, Edmond
Veröffentlicht in: 3DV 2021 - 9th International Conference on 3D Vision, Dec 2021, London (on line event), United Kingdom., 2021, Seite(n) pp.1-12
Herausgeber: IEEE
DOI: 10.1109/3dv53792.2021.00064

Multi-View Mesh Reconstruction with Neural Deferred Shading

Autoren: M. Worchel, R. Diaz, W. Hu, O. Schreer, I. Feldmann, P. Eisert
Veröffentlicht in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, ISBN 978-1-6654-6946-3
Herausgeber: IEEE
DOI: 10.1109/cvpr52688.2022.00609

Measuring the benefits of VR animation tools over traditional interfaces

Autoren: Jean-Baptiste Bordier, Anthony Mirabile, Robin Courant, Marc Christie
Veröffentlicht in: ACM Motion in Games, 2022
Herausgeber: ACM Motion in Games

Volograms & V-SENSE Volumetric Video Dataset

Autoren: Pagés, Rafael; Amplianitis, Konstantinos; Ondrej, Jan; Zerman, Emin; Aljosa Smolic
Veröffentlicht in: 2022
Herausgeber: ResearchGate
DOI: 10.13140/rg.2.2.24235.31529/1

Leistungen

Veröffentlichungen

Diese Seite teilen

Herunterladen