Creating Lively Interactive Populated Environments

Informazioni relative al progetto

CLIPE

ID dell’accordo di sovvenzione: 860768

DOI

10.3030/860768

Progetto chiuso

Data della firma CE 4 Settembre 2019

Data di avvio 1 Marzo 2020

Data di completamento 31 Agosto 2024

Finanziato da

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Costo totale

€ 4 009 882,68

Contributo UE

€ 4 009 882,68

Coordinato da

UNIVERSITY OF CYPRUS
Cyprus

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (27)

Report on programming by demonstration methods. Initial demonstration.

Report on programming by demonstration methods Initial demonstration

Report on a subset of statistical body models available for VR/interactivity
Material and report from Networking Event No.1

Material and report from Networking Event No1

Material and report from Training Workshop No.4

Presentations, photos, videos, attendance lists and short evaluation report following the completion of the Training Workshop No.4

Material and report from Training Workshop No.2

Presentations, videos, photos, attendance lists and short evaluation report following the completion of Training Workshop No.2

Material and report Training Workshop No.1

Presentations photos videos attendance sheets short evaluation report after the Training Workshop No1 is completed

Report/publication on evaluation of groups and crowds
Report/publication on evaluation of individuals

Reportpublication on evaluation of individuals

Report on autonomous and adaptive communication behaviours
Report on methods for inserting virtual crowds into a real environment
Report on methods for authoring crowds (usability, control, interactivity and style)

Report on methods for authoring crowds usability control interactivity and style

Initial report on creating procedural cities with semantics
Report/publication on Evaluation studies for all WP5 ESRs

Final report/publication of ESR8

Report on algorithmic trade-offs for real-time crowd animation synthesis

Report on algorithmic tradeoffs for realtime crowd animation synthesis

Report on initial scenarios for stylising and physiology drive animations

A report with the initial scenarios for stylising and physiology drive animations will be available by M19

Report on methods to describe and generate virtual crowds using textual descriptions
Progress report on procedural simulation of crowd behaviour
Report on initial statistical models based on captures of face/hands/body

An initial report on initial statistical models based on captures of facehandsbody will be available by M20

Report on attention-driven model of interaction. Initial implementation.

Report on attentiondriven model of interaction Initial implementation

Report on crowd taxonomies and its relations with the VE
Material and report from Training Workshop No.3

Presentations, photos, videos, attendance lists and short evaluation report following the completion of Training Workshop No.3

Report/publication on evaluation of small groups
Report on preliminary adaptive/motion retargeting animation toolsets
Report on seamless integration of large crowds of virtual characters with real environments

Report on perception of virtual crowds in Mixed Reality

Report on experimental results from studies on trust formation
Material and report from Final CLIPE Conference (Workshop 5)

Presentations, photos, videos, attendance lists and short evaluation report following the completion of Workshop 5.

Report on social group formation in virtual environments

Websites, patent fillings, videos etc. (1)

CLIPE website and dedicated social media, partners' social media

Project website dedicated social media pages partners social media pages posting relevant articles and news concerning CLIPE throughout the project duration

Other (3)

Final promotional video for CLIPE and videos from each ESR

Final promotional video of CLIPE and videos from each ESR.

Presentations of research work in scientific conferences/seminars

Presentations of scientific papers in research/academic conferences and seminars

Newsletters, articles and presence in online and traditional media

Data sets, microdata, etc (1)

Publication on an initial integrated statistical model for whole body animation

Pubblicazioni

Other (7)

Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization

Autori: Liu, Weiyang; Qiu, Zeju; Feng, Yao; Xiu, Yuliang; Xue, Yuxuan; Yu, Longhui; Feng, Haiwen; Liu, Zhen; Heo, Juyeon; Peng, Songyou; Wen, Yandong; Black, Michael J.; Weller, Adrian; Schölkopf, Bernhard
Pubblicato in: arXiv, Numero 27, 2024
Editore: arXiv
DOI: 10.48550/arxiv.2311.06243

Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

Autori: Chhatre, Kiran; Daněček, Radek; Athanasiou, Nikos; Becherini, Giorgio; Peters, Christopher; Black, Michael J.; Bolkart, Timo
Pubblicato in: arxiv, Numero 18, 2023
Editore: arxiv
DOI: 10.48550/arxiv.2312.04466

P2C: A Paths-to-Crowds Framework to Parameterize Behaviors

Autori: Marilena Lemonari, Andreas Panayiotou, Nuria Pelechano, Theodoros Kyriakou, Yiorgos Chrysanthou, Andreas Aristidou, Panayiotis Charalambous
Pubblicato in: TechRxiv, 2024
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.36227/techrxiv.170654693.38725484/v1

PuzzleAvatar: Assembling 3D Avatars from Personal Albums

Autori: Xiu, Y., Ye, Y., Liu, Z., Tzionas, D. and Black, M.J.
Pubblicato in: 2024
Editore: arXiv
DOI: 10.48550/arxiv.2405.14869

Stable Video Portraits

Autori: Ostrek, M. and Thies, J
Pubblicato in: Computer Vision and Pattern Recognition, 2024
Editore: arXiv
DOI: 10.48550/arxiv.2409.18083

Do you read me? (E)motion Legibility of Virtual Reality Character Representations.

Autori: Brandstatter, Klara; Congdon, Benjamin; Steed, Anthony
Pubblicato in: 2024
Editore: University College London
DOI: 10.5522/04/26356180.v1

Ghost on the Shell: An Expressive Representation of General 3D Shapes

Autori: Liu, Zhen; Feng, Yao; Xiu, Yuliang; Liu, Weiyang; Paull, Liam; Black, Michael J.; Schölkopf, Bernhard
Pubblicato in: Numero 25, 2024
Editore: arXiv
DOI: 10.48550/arxiv.2310.15168

Conference proceedings (29)

Dialogues For One: Single-User Content Creation Using Immersive Record and Replay

Autori: Klara Brandstätter, Anthony Steed
Pubblicato in: 29th ACM Symposium on Virtual Reality Software and Technology, 2023, Pagina/e 1-11
Editore: ACM
DOI: 10.1145/3611659.3615695

ECON: Explicit Clothed humans Optimized via Normal integration

Autori: Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black
Pubblicato in: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Editore: IEEE
DOI: 10.1109/cvpr52729.2023.00057

High-Fidelity Clothed Avatar Reconstruction from a Single Image

Autori: Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei
Pubblicato in: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, Pagina/e 8662-8672
Editore: IEEE
DOI: 10.1109/cvpr52729.2023.00837

LexiCrowd: A Learning Paradigm towards Text to Behaviour Parameters for Crowds.

Autori: Lemonari, M., Andreou, N., Pelechano, N., Charalambous, P. and Chrysanthou, Y.,
Pubblicato in: The Eurographics Association, 2024
Editore: The Eurographics Association
DOI: 10.2312/cl.20241049

Tech: Text-guided reconstruction of lifelike clothed humans

Autori: Huang, Y., Yi, H., Xiu, Y., Liao, T., Tang, J., Cai, D. and Thies, J.
Pubblicato in: 2024
Editore: IEEE
DOI: 10.48550/arxiv.2308.08545

Social Crowd Simulation: Improving Realism with Social Rules and Gaze Behavior

Autori: Reiya Itatani, Nuria Pelechano
Pubblicato in: The 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games, 2024, Pagina/e 1-11
Editore: ACM
DOI: 10.1145/3677388.3696337

Soft Walks: Real-Time, Two-Ways Interaction between a Character and Loose Grounds

Autori: Chloé Paliard, Eduardo Alvarado, Damien Rohmer, Marie-Paule Cani
Pubblicato in: Eurographics Short Paper, 2021, ISBN 978-3-03868-133-5
Editore: The Eurographics Association
DOI: 10.2312/egs.20211019

Immersive Record and Replay for Lively Virtual Environments

Autori: Klara Brandstätter
Pubblicato in: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Pagina/e 979-980
Editore: IEEE
DOI: 10.1109/vrw58643.2023.00332

Synthesizing Environment-Specific People in Photographs

Autori: Ostrek, M., O'Sullivan, C., Black, M., and Thies, J.
Pubblicato in: Springer Cham, 2024
Editore: Springer
DOI: 10.48550/arxiv.2312.14579

Collaborative VR: Solving Riddles in the Concept of Escape Rooms

Autori: Ioannou, A., Lemonari, M., Liarokapis, F. and Aristidou, A.,
Pubblicato in: IMET (pp. 1-9)., 2023
Editore: IMET
DOI: 10.2312/imet.20231247

Is Immersive Virtual Reality in K-12 Education Ready for Primetime? Challenges, Possibilities, and Considerations

Autori: Christos Gkoumas, Lisa Izzouzi
Pubblicato in: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Pagina/e 541-544
Editore: IEEE
DOI: 10.1109/vrw58643.2023.00119

Exploring the Role of Expected Collision Feedback in Crowded Virtual Environments

Autori: Haoran Yun, Jose Luis Ponton, Alejandro Beacco, Carlos Andujar, Nuria Pelechano
Pubblicato in: 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2024, Pagina/e 472-481
Editore: IEEE
DOI: 10.1109/vr58804.2024.00068

ShapeVerse: Physics-based Characters with Varied Body Shapes.

Autori: Vyas, B. and O’Sullivan, C.
Pubblicato in: 2024
Editore: The Eurographics Association
DOI: 10.2312/egp.20241042

Animation Fidelity in Self-Avatars: Impact on User Performance and Sense of Agency

Autori: Haoran Yun, Jose Luis Ponton, Carlos Andujar, Nuria Pelechano
Pubblicato in: 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2023
Editore: IEEE
DOI: 10.1109/vr55154.2023.00044

EMOCA: Emotion Driven Monocular Face Capture and Animation

Autori: Radek Danecek, Michael Black, Timo Bolkart
Pubblicato in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, Pagina/e 20279-20290
Editore: IEEE
DOI: 10.1109/cvpr52688.2022.01967

Soft Walks: Real-Time, Two-Ways Interaction between a Character and Loose Grounds

Autori: Paliard, C., Alvarado, E., Rohmer, D. and Cani, M.P.
Pubblicato in: 2021
Editore: Eurographics
DOI: 10.48550/arxiv.2104.10898

A new framework for the evaluation of locomotive motion datasets through motion matching techniques

Autori: Vicenzo Abichequer Sangalli, Ludovic Hoyet, Marc Christie, Julien Pettré
Pubblicato in: Proceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games, 2024, Pagina/e 1-10
Editore: ACM
DOI: 10.1145/3561975.3562951

DART: Articulated Hand Model with Diverse Accessories and Rich Textures

Autori: Gao, Daiheng; Xiu, Yuliang; Li, Kailin; Yang, Lixin; Wang, Feng; Zhang, Peng; Zhang, Bang; Lu, Cewu; Tan, Ping
Pubblicato in: Numero 8, 2022
Editore: NeurIPS
DOI: 10.48550/arxiv.2210.07650

Exploring the Perception of Center of Mass changes for VR Avatars

Autori: Vyas, B., Hoyet, L. and O'Sullivan, C.
Pubblicato in: 2023
Editore: Eurographics
DOI: 10.2312/egve.20231316

TADA! Text to Animatable Digital Avatars

Autori: Tingting Liao, Hongwei Yi, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, Michael J. Black
Pubblicato in: 2024 International Conference on 3D Vision (3DV), 2024, Pagina/e 1508-1519
Editore: IEEE
DOI: 10.1109/3dv62453.2024.00150

ICON: Implicit Clothed humans Obtained from Normals

Autori: Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black
Pubblicato in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, Pagina/e 13286-13296
Editore: IEEE
DOI: 10.1109/cvpr52688.2022.01294

Pose representations for deep skeletal animation

Autori: Andreou, N., Aristidou, A., & Chrysanthou, Y.
Pubblicato in: Computer Graphics Forum (Vol. 41, No. 8, pp. 155-167), 2021
Editore: arxiv
DOI: 10.48550/arxiv.2111.13907

Extending the Open Source Social Virtual Reality Ecosystem to the Browser in Ubiq

Autori: Sebastian Friston, Ben Congdon, Nels Numan, Klara BrandstäTter, Lisa Izzouzi, Felix Thiel, Jingyi Zhang, Daniele Giunchi, David Swapp, Anthony Steed
Pubblicato in: The 28th International ACM Conference on 3D Web Technology, 2023, Pagina/e 1-9
Editore: ACM
DOI: 10.1145/3611314.3615903

CCP: Configurable Crowd Profiles

Autori: Andreas Panayiotou, Theodoros Kyriakou, Marilena Lemonari, Yiorgos Chrysanthou, Panayiotis Charalambous
Pubblicato in: Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings, 2022, Pagina/e 1-10
Editore: ACM
DOI: 10.1145/3528233.3530712

User Motion Accentuation in Social Pointing Scenario

Autori: Ruoxi Guo, Lisa Izzouzi, Anthony Steed
Pubblicato in: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Pagina/e 575-576
Editore: IEEE
DOI: 10.1109/vrw58643.2023.00130

D-if: Uncertainty-aware human digitization via implicit distribution field.

Autori: Yang, X., Luo, Y., Xiu, Y., Wang, W., Xu, H. and Fan, Z.
Pubblicato in: 2023
Editore: IEEE
DOI: 10.48550/arxiv.2308.08857

Behavioral Landmarks: Inferring Interactions from Data.

Autori: Lemonari, M., Charalambous, P., Panayiotou, A., Chrysanthou, Y. and Pettré, J., 2024.
Pubblicato in: 2024
Editore: The Eurographics Association
DOI: 10.2312/egp.20241039

Evaluation of Media-Based Social Interactions in Virtual Environments

Autori: Lisa Izzouzi, Anthony Steed, Ifat Yasin
Pubblicato in: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences, 2023, Pagina/e 419-422
Editore: ACM
DOI: 10.1145/3573381.3596501

Emotional Speech-Driven Animation with Content-Emotion Disentanglement

Autori: Radek Daněček, Kiran Chhatre, Shashank Tripathi, Yandong Wen, Michael Black, Timo Bolkart
Pubblicato in: SIGGRAPH Asia 2023 Conference Papers, 2024, Pagina/e 1-13
Editore: ACM
DOI: 10.1145/3610548.3618183

Peer reviewed articles (13)

Lessons learnt running distributed and remote mixed reality experiments

Autori: Anthony Steed, Daniel Archer, Klara Brandstätter, Ben J. Congdon, Sebastian Friston, Priya Ganapathi, Daniele Giunchi, Lisa Izzouzi, Gun Woo (Warren) Park, David Swapp, Felix J. Thiel
Pubblicato in: Frontiers in Computer Science, Numero 4, 2023, ISSN 2624-9898
Editore: Frontiers in Computer Science
DOI: 10.3389/fcomp.2022.966319

TRAIL: Simulating the impact of human locomotion on natural landscapes

Autori: Eduardo Alvarado, Oscar Argudo, Damien Rohmer, Marie-Paule Cani, Nuria Pelechano
Pubblicato in: The Visual Computer, Numero 40, 2024, Pagina/e 5029-5041, ISSN 0178-2789
Editore: Springer Verlag
DOI: 10.1007/s00371-024-03506-z

Pose Representations for Deep Skeletal Animation

Autori: N. Andreou, A. Aristidou, Y. Chrysanthou
Pubblicato in: Computer Graphics Forum, Numero 41, 2023, Pagina/e 155-167, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14632

Simulating real-life scenarios to better understand the spread of diseases under different contexts

Autori: Rafael Blanco, Gustavo Patow, Nuria Pelechano
Pubblicato in: Scientific Reports, Numero 14, 2024, ISSN 2045-2322
Editore: Nature Publishing Group
DOI: 10.1038/s41598-024-52903-w

Combining Motion Matching and Orientation Prediction to Animate Avatars for Consumer‐Grade VR Devices

Autori: J. L. Ponton, H. Yun, C. Andujar, N. Pelechano
Pubblicato in: Computer Graphics Forum, Numero 41, 2023, Pagina/e 107-118, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14628

Authoring Virtual Crowds: A Survey

Autori: Marilena Lemonari, Rafael Blanco, Panayiotis Charalambous, Nuria Pelechano, Marios Avraamides, Julien Pettré, Yiorgos Chrysanthou
Pubblicato in: Computer Graphics Forum, Numero 41, 2024, Pagina/e 677-701, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14506

SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data

Autori: Jose Luis Ponton, Haoran Yun, Andreas Aristidou, Carlos Andujar, Nuria Pelechano
Pubblicato in: ACM Transactions on Graphics, Numero 43, 2023, Pagina/e 1-14, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3625264

Generating Upper‐Body Motion for Real‐Time Characters Making their Way through Dynamic Environments

Autori: Eduardo Alvarado, Damien Rohmer, Marie‐Paule Cani
Pubblicato in: Computer Graphics Forum, Numero 41, 2024, Pagina/e 169-181, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14633

A Survey on Reinforcement Learning Methods in Character Animation

Autori: Ariel Kwiatkowski, Eduardo Alvarado, Vicky Kalogeiton, C. Karen Liu, Julien Pettré, Michiel van de Panne, Marie‐Paule Cani
Pubblicato in: Computer Graphics Forum, Numero 41, 2024, Pagina/e 613-639, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14504

The One-Man-Crowd: Single User Generation of Crowd Motions Using Virtual Reality

Autori: Tairan, Yin/Inria, Univ Rennes, CNRS, IRISA, France; Ludovic Hoyet/Inria, Univ Rennes, CNRS, IRISA, France; Marc Christie/ Inria, Univ Rennes, CNRS, IRISA, France; Marie-Paule Cani/Ecole Polytechnique, CNRS (LIX), IP Paris, France; Julien Pettré/Inria, Univ Rennes, CNRS, IRISA, France
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics/28/5/2245-2255, 2021, ISSN 1941-0506
Editore: IEEE
DOI: 10.1109/tvcg.2022.3150507

Ubiq-exp: A toolkit to build and run remote and distributed mixed reality experiments

Autori: Anthony Steed, Lisa Izzouzi, Klara Brandstätter, Sebastian Friston, Ben Congdon, Otto Olkkonen, Daniele Giunchi, Nels Numan, David Swapp
Pubblicato in: Frontiers in Virtual Reality, Numero 3, 2022, ISSN 2673-4192
Editore: Frontiers in Virtual Reality
DOI: 10.3389/frvir.2022.912078

With or Without You: Effect of Contextual and Responsive Crowds on VR-based Crowd Motion Capture

Autori: Tairan Yin, Ludovic Hoyet, Marc Christie, Marie-Paule Cani, Julien Pettré
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, Numero 30, 2024, Pagina/e 2785-2795, ISSN 1077-2626
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2024.3372038

Real-Time Locomotion on Soft Grounds With Dynamic Footprints

Autori: Eduardo Alvarado, Chloé Paliard, Damien Rohmer, Marie-Paule Cani
Pubblicato in: Frontiers in Virtual Reality, 2022, ISSN 2673-4192
Editore: Frontiers
DOI: 10.3389/frvir.2022.801856