Skip to main content
European Commission logo
English English
CORDIS - EU research results
CORDIS

Innovative Volumetric Capture and Editing Tools for Ubiquitous Storytelling

Deliverables

D4.4 Creative XR Productions and Evaluation Report 2

We will perform final experimental XR productions to evaluate the final achievements of the INVICTUS project

D1.1 Report on architecture for volumetric motion capture, tracking, and database generation

Workpackage 1 addresses the development of algorithms necessary to create interactive representations of volumetric content This deliverable specifies the architecture of software components for the processing pipeline This includes algorithms for geometry reconstruction temporal registration automatic rigging animation and hybrid content creation

D3.1 Collaborative VR scene editing tool

Report on the implemented features of the Collaborative VR scene editing tool typically Scene Layout Lighting and cinematography

D5.1 First Plan for the Exploitation and Dissemination of the Results

A detailed report presenting a first plan for the dissemination and exploitation of the results within a the different scientific communities and b the targeted industries specified within the INVICTUS project ie VFX CG and animation and interactive industries

D5.3 Final Plan for the Exploitation and Dissemination of the Results

A final report presenting a detailed plan for the dissemination of the results within a the different scientific communities and b the targeted industries specified within the project ie VFX CG and animation and interactive industries In addition to that the report will contain a strategy for commercializing the knowledge that was generated within the project in alignment with the exploitation plan driven by the Innovation Board and will include a the management of IPR issues b ownership of the results and c licencing of the scientific outcomes

D5.2 Communication material to promote the project's results

A report presenting the communication material prepared for promoting the projects results including a projects website design and content description b official project templates c enewsletters d social media channels e press releases e project film content 35 minutes long subcontracted

D4.3 Creative XR Productions and Evaluation Report 1

We will carry a first experimental XR production to evaluate the first iteration of the achievements of the INVICTUS project

D1.2 First software package for animatable volumetric video generation

This deliverables provides first software components for the creation of interactive volumetric content together with a description of implemented algorithms THis includes modules for reconstruction registration and animation With these components first demonstration of volumetric video that can be animated and modified will be showcased

D4.2 Evaluation Plan

We will have two XR productions to evaluate the achievements of this project This document is the Evaluation Plan of those XR productions We will make sure to design the best scenario to cover all the achievement off the different work packages

D2.3 First Motion adaptation and style transfer

This first demonstrator will display the implementation of morphology-and-style character adaptation applied to volumetric motion-captured data. Typically we will show how characteristics of the motions need to be adapted to match the morphology and style of the given character (e.g. heaviness, strength, “cartoon animation style” motions, etc.).

D3.3 Volumetric spatio-temporal avatar manipulators

Demonstration of dedicated features for re-animating volumetric motion captured data by extending spatio-temporal animators to specifics of volumetric motion.

D2.6 Final Motion adaptation and style transfer

This final demonstrator will display the implementation of morphology-and-style character adaptation applied to volumetric motion-captured data. Typically we will show how characteristics of the motions need to be adapted to match the morphology and style of the given character (e.g. heaviness, strength, “cartoon animation style” motions, etc.).

Publications

Preserving Memories of Contemporary Witnesses Using Volumetric Video

Author(s): Oliver Schreer, Markus Worchel, Rodrigo Diaz, Sylvain Renault, Wieland Morgenstern, Ingo Feldmann, Marcus Zepp, Anna Hilsmann, Peter Eisert
Published in: Journal of Interactive Media, Issue Volume 21 Issue 1, 2022, Page(s) 71-82, ISSN 2196-6826
Publisher: Oldenbourg Wissenschaftsverlag
DOI: 10.1515/icom-2022-0015

Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation

Author(s): A. Zimmer, A. Hilsmann, W. Morgenstern, P. Eisert
Published in: Comp. Visual Media, Issue 9, 2022, Page(s) 123–139, ISSN 2096-0662
Publisher: Tsinghua University Press and Springer
DOI: 10.48550/arxiv.2202.03074

Study on Automatic 3D Facial Caricaturization: from Rules to Deep Learning

Author(s): Nicolas Olivier, Glenn Kerbiriou, Ferran Argelaguet, Quentin Avril, Fabien Danieau, Philippe Guillotel, Ludovic Hoyet and Franck Multon
Published in: Frontiers in Virtual Reality, 2022, ISSN 2673-4192
Publisher: Frontiers in Virtual Reality
DOI: 10.3389/frvir.2021.785104

Example-Based Facial Animation of Virtual Reality Avatars using Auto-Regressive Neural Networks

Author(s): Wolfgang Paier, Anna Hilsmann, Peter Eisert
Published in: IEEE Computer Graphics and Applications, 2021, Page(s) 1-1, ISSN 0272-1716
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mcg.2021.3068035

FaceTuneGAN: Face Autoencoder for Convolutional Expression Transfer Using Neural Generative Adversarial Networks

Author(s): N. Olivier, K. Baert, F. Danieau, F. Multon, Q. Avril
Published in: Computers & Graphics Volume, Issue 110, 2022, Page(s) Pages 69-85, ISSN 0097-8493
Publisher: Pergamon Press Ltd.
DOI: 10.48550/arxiv.2112.00532

Neural Face Models for Example-Based Visual Speech Synthesis

Author(s): Wolfgang Paier, Anna Hilsmann, Peter Eisert
Published in: European Conference on Visual Media Production, 2020, Page(s) 1-10, ISBN 9781450381987
Publisher: ACM
DOI: 10.1145/3429341.3429356

Temporal Shape Transfer Network for 3D Human Motion

Author(s): J. Regateiro and E. Boyer
Published in: International Conference on 3D Vision (3DV), 2022
Publisher: 3DV2022

Smart Motion Trails for Animating in VR

Author(s): J-B. Bordier, A. Mirabile, R. Courant, M. Christie
Published in: IEEE Conference on AIVR 2022, 2022, ISBN 978-1-6654-5725-5
Publisher: IEEE

Recovering Fine Details for Neural Implicit Surface Reconstruction

Author(s): D. Chen, P. Zhang, I. Feldmann, O. Schreer, P. Eisert
Published in: IEEE/CVF Winter Conference on Applications of Computer Vision, 2023
Publisher: IEEE
DOI: 10.48550/arxiv.2211.11320

Model-Based Deep Portrait Relighting

Author(s): F. Schreiber, A. Hilsmann, P. Eisert
Published in: European Conference on Visual Media Production, 2022
Publisher: ACM
DOI: 10.1145/3565516.3565526

Detailed Eye Region Capture and Animation

Author(s): G. Kerbiriou, M. Marchal, Q. Avril
Published in: CM SIGGRAPH / Eurographics Symposium on Computer Animation 2022, Issue Volume 41 (2022), Number 8, 2022
Publisher: The Eurographics Association and John Wiley & Sons Ltd.
DOI: 10.1111/cgf.14642

Neural Human Deformation Transfer

Author(s): Basset, Jean; Boukhayma, Adnane; Wuhrer, Stefanie; Multon, Franck; Boyer, Edmond
Published in: 3DV 2021 - 9th International Conference on 3D Vision, Dec 2021, London (on line event), United Kingdom., 2021, Page(s) pp.1-12
Publisher: IEEE
DOI: 10.1109/3dv53792.2021.00064

Multi-View Mesh Reconstruction with Neural Deferred Shading

Author(s): M. Worchel, R. Diaz, W. Hu, O. Schreer, I. Feldmann, P. Eisert
Published in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, ISBN 978-1-6654-6946-3
Publisher: IEEE
DOI: 10.1109/cvpr52688.2022.00609

Measuring the benefits of VR animation tools over traditional interfaces

Author(s): Jean-Baptiste Bordier, Anthony Mirabile, Robin Courant, Marc Christie
Published in: ACM Motion in Games, 2022
Publisher: ACM Motion in Games

Volograms & V-SENSE Volumetric Video Dataset

Author(s): Pagés, Rafael; Amplianitis, Konstantinos; Ondrej, Jan; Zerman, Emin; Aljosa Smolic
Published in: 2022
Publisher: ResearchGate
DOI: 10.13140/rg.2.2.24235.31529/1

Searching for OpenAIRE data...

There was an error trying to search data from OpenAIRE

No results available