Creating Lively Interactive Populated Environments

Informacje na temat projektu

CLIPE

Identyfikator umowy o grant: 860768

DOI

10.3030/860768

Projekt został zamknięty

Data podpisania przez KE 4 Września 2019

Data rozpoczęcia 1 Marca 2020

Data zakończenia 31 Sierpnia 2024

Finansowanie w ramach

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Koszt całkowity

€ 4 009 882,68

Wkład UE

€ 4 009 882,68

Koordynowany przez

UNIVERSITY OF CYPRUS
Cyprus

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (27)

Report on programming by demonstration methods. Initial demonstration.

Report on programming by demonstration methods Initial demonstration

Report on a subset of statistical body models available for VR/interactivity
Material and report from Networking Event No.1

Material and report from Networking Event No1

Material and report from Training Workshop No.4

Presentations, photos, videos, attendance lists and short evaluation report following the completion of the Training Workshop No.4

Material and report from Training Workshop No.2

Presentations, videos, photos, attendance lists and short evaluation report following the completion of Training Workshop No.2

Material and report Training Workshop No.1

Presentations photos videos attendance sheets short evaluation report after the Training Workshop No1 is completed

Report/publication on evaluation of groups and crowds
Report/publication on evaluation of individuals

Reportpublication on evaluation of individuals

Report on autonomous and adaptive communication behaviours
Report on methods for inserting virtual crowds into a real environment
Report on methods for authoring crowds (usability, control, interactivity and style)

Report on methods for authoring crowds usability control interactivity and style

Initial report on creating procedural cities with semantics
Report/publication on Evaluation studies for all WP5 ESRs

Final report/publication of ESR8

Report on algorithmic trade-offs for real-time crowd animation synthesis

Report on algorithmic tradeoffs for realtime crowd animation synthesis

Report on initial scenarios for stylising and physiology drive animations

A report with the initial scenarios for stylising and physiology drive animations will be available by M19

Report on methods to describe and generate virtual crowds using textual descriptions
Progress report on procedural simulation of crowd behaviour
Report on initial statistical models based on captures of face/hands/body

An initial report on initial statistical models based on captures of facehandsbody will be available by M20

Report on attention-driven model of interaction. Initial implementation.

Report on attentiondriven model of interaction Initial implementation

Report on crowd taxonomies and its relations with the VE
Material and report from Training Workshop No.3

Presentations, photos, videos, attendance lists and short evaluation report following the completion of Training Workshop No.3

Report/publication on evaluation of small groups
Report on preliminary adaptive/motion retargeting animation toolsets
Report on seamless integration of large crowds of virtual characters with real environments

Report on perception of virtual crowds in Mixed Reality

Report on experimental results from studies on trust formation
Material and report from Final CLIPE Conference (Workshop 5)

Presentations, photos, videos, attendance lists and short evaluation report following the completion of Workshop 5.

Report on social group formation in virtual environments

Websites, patent fillings, videos etc. (1)

CLIPE website and dedicated social media, partners' social media

Project website dedicated social media pages partners social media pages posting relevant articles and news concerning CLIPE throughout the project duration

Other (3)

Final promotional video for CLIPE and videos from each ESR

Final promotional video of CLIPE and videos from each ESR.

Presentations of research work in scientific conferences/seminars

Presentations of scientific papers in research/academic conferences and seminars

Newsletters, articles and presence in online and traditional media

Data sets, microdata, etc (1)

Publication on an initial integrated statistical model for whole body animation

Publikacje

Other (7)

Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization

Autorzy: Liu, Weiyang; Qiu, Zeju; Feng, Yao; Xiu, Yuliang; Xue, Yuxuan; Yu, Longhui; Feng, Haiwen; Liu, Zhen; Heo, Juyeon; Peng, Songyou; Wen, Yandong; Black, Michael J.; Weller, Adrian; Schölkopf, Bernhard
Opublikowane w: arXiv, Numer 27, 2024
Wydawca: arXiv
DOI: 10.48550/arxiv.2311.06243

Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

Autorzy: Chhatre, Kiran; Daněček, Radek; Athanasiou, Nikos; Becherini, Giorgio; Peters, Christopher; Black, Michael J.; Bolkart, Timo
Opublikowane w: arxiv, Numer 18, 2023
Wydawca: arxiv
DOI: 10.48550/arxiv.2312.04466

P2C: A Paths-to-Crowds Framework to Parameterize Behaviors

Autorzy: Marilena Lemonari, Andreas Panayiotou, Nuria Pelechano, Theodoros Kyriakou, Yiorgos Chrysanthou, Andreas Aristidou, Panayiotis Charalambous
Opublikowane w: TechRxiv, 2024
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.36227/techrxiv.170654693.38725484/v1

PuzzleAvatar: Assembling 3D Avatars from Personal Albums

Autorzy: Xiu, Y., Ye, Y., Liu, Z., Tzionas, D. and Black, M.J.
Opublikowane w: 2024
Wydawca: arXiv
DOI: 10.48550/arxiv.2405.14869

Stable Video Portraits

Autorzy: Ostrek, M. and Thies, J
Opublikowane w: Computer Vision and Pattern Recognition, 2024
Wydawca: arXiv
DOI: 10.48550/arxiv.2409.18083

Do you read me? (E)motion Legibility of Virtual Reality Character Representations.

Autorzy: Brandstatter, Klara; Congdon, Benjamin; Steed, Anthony
Opublikowane w: 2024
Wydawca: University College London
DOI: 10.5522/04/26356180.v1

Ghost on the Shell: An Expressive Representation of General 3D Shapes

Autorzy: Liu, Zhen; Feng, Yao; Xiu, Yuliang; Liu, Weiyang; Paull, Liam; Black, Michael J.; Schölkopf, Bernhard
Opublikowane w: Numer 25, 2024
Wydawca: arXiv
DOI: 10.48550/arxiv.2310.15168

Conference proceedings (29)

Dialogues For One: Single-User Content Creation Using Immersive Record and Replay

Autorzy: Klara Brandstätter, Anthony Steed
Opublikowane w: 29th ACM Symposium on Virtual Reality Software and Technology, 2023, Strona(/y) 1-11
Wydawca: ACM
DOI: 10.1145/3611659.3615695

ECON: Explicit Clothed humans Optimized via Normal integration

Autorzy: Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black
Opublikowane w: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Wydawca: IEEE
DOI: 10.1109/cvpr52729.2023.00057

High-Fidelity Clothed Avatar Reconstruction from a Single Image

Autorzy: Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei
Opublikowane w: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, Strona(/y) 8662-8672
Wydawca: IEEE
DOI: 10.1109/cvpr52729.2023.00837

LexiCrowd: A Learning Paradigm towards Text to Behaviour Parameters for Crowds.

Autorzy: Lemonari, M., Andreou, N., Pelechano, N., Charalambous, P. and Chrysanthou, Y.,
Opublikowane w: The Eurographics Association, 2024
Wydawca: The Eurographics Association
DOI: 10.2312/cl.20241049

Tech: Text-guided reconstruction of lifelike clothed humans

Autorzy: Huang, Y., Yi, H., Xiu, Y., Liao, T., Tang, J., Cai, D. and Thies, J.
Opublikowane w: 2024
Wydawca: IEEE
DOI: 10.48550/arxiv.2308.08545

Social Crowd Simulation: Improving Realism with Social Rules and Gaze Behavior

Autorzy: Reiya Itatani, Nuria Pelechano
Opublikowane w: The 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games, 2024, Strona(/y) 1-11
Wydawca: ACM
DOI: 10.1145/3677388.3696337

Soft Walks: Real-Time, Two-Ways Interaction between a Character and Loose Grounds

Autorzy: Chloé Paliard, Eduardo Alvarado, Damien Rohmer, Marie-Paule Cani
Opublikowane w: Eurographics Short Paper, 2021, ISBN 978-3-03868-133-5
Wydawca: The Eurographics Association
DOI: 10.2312/egs.20211019

Immersive Record and Replay for Lively Virtual Environments

Autorzy: Klara Brandstätter
Opublikowane w: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Strona(/y) 979-980
Wydawca: IEEE
DOI: 10.1109/vrw58643.2023.00332

Synthesizing Environment-Specific People in Photographs

Autorzy: Ostrek, M., O'Sullivan, C., Black, M., and Thies, J.
Opublikowane w: Springer Cham, 2024
Wydawca: Springer
DOI: 10.48550/arxiv.2312.14579

Collaborative VR: Solving Riddles in the Concept of Escape Rooms

Autorzy: Ioannou, A., Lemonari, M., Liarokapis, F. and Aristidou, A.,
Opublikowane w: IMET (pp. 1-9)., 2023
Wydawca: IMET
DOI: 10.2312/imet.20231247

Is Immersive Virtual Reality in K-12 Education Ready for Primetime? Challenges, Possibilities, and Considerations

Autorzy: Christos Gkoumas, Lisa Izzouzi
Opublikowane w: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Strona(/y) 541-544
Wydawca: IEEE
DOI: 10.1109/vrw58643.2023.00119

Exploring the Role of Expected Collision Feedback in Crowded Virtual Environments

Autorzy: Haoran Yun, Jose Luis Ponton, Alejandro Beacco, Carlos Andujar, Nuria Pelechano
Opublikowane w: 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2024, Strona(/y) 472-481
Wydawca: IEEE
DOI: 10.1109/vr58804.2024.00068

ShapeVerse: Physics-based Characters with Varied Body Shapes.

Autorzy: Vyas, B. and O’Sullivan, C.
Opublikowane w: 2024
Wydawca: The Eurographics Association
DOI: 10.2312/egp.20241042

Animation Fidelity in Self-Avatars: Impact on User Performance and Sense of Agency

Autorzy: Haoran Yun, Jose Luis Ponton, Carlos Andujar, Nuria Pelechano
Opublikowane w: 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2023
Wydawca: IEEE
DOI: 10.1109/vr55154.2023.00044

EMOCA: Emotion Driven Monocular Face Capture and Animation

Autorzy: Radek Danecek, Michael Black, Timo Bolkart
Opublikowane w: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, Strona(/y) 20279-20290
Wydawca: IEEE
DOI: 10.1109/cvpr52688.2022.01967

Soft Walks: Real-Time, Two-Ways Interaction between a Character and Loose Grounds

Autorzy: Paliard, C., Alvarado, E., Rohmer, D. and Cani, M.P.
Opublikowane w: 2021
Wydawca: Eurographics
DOI: 10.48550/arxiv.2104.10898

A new framework for the evaluation of locomotive motion datasets through motion matching techniques

Autorzy: Vicenzo Abichequer Sangalli, Ludovic Hoyet, Marc Christie, Julien Pettré
Opublikowane w: Proceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games, 2024, Strona(/y) 1-10
Wydawca: ACM
DOI: 10.1145/3561975.3562951

DART: Articulated Hand Model with Diverse Accessories and Rich Textures

Autorzy: Gao, Daiheng; Xiu, Yuliang; Li, Kailin; Yang, Lixin; Wang, Feng; Zhang, Peng; Zhang, Bang; Lu, Cewu; Tan, Ping
Opublikowane w: Numer 8, 2022
Wydawca: NeurIPS
DOI: 10.48550/arxiv.2210.07650

Exploring the Perception of Center of Mass changes for VR Avatars

Autorzy: Vyas, B., Hoyet, L. and O'Sullivan, C.
Opublikowane w: 2023
Wydawca: Eurographics
DOI: 10.2312/egve.20231316

TADA! Text to Animatable Digital Avatars

Autorzy: Tingting Liao, Hongwei Yi, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, Michael J. Black
Opublikowane w: 2024 International Conference on 3D Vision (3DV), 2024, Strona(/y) 1508-1519
Wydawca: IEEE
DOI: 10.1109/3dv62453.2024.00150

ICON: Implicit Clothed humans Obtained from Normals

Autorzy: Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black
Opublikowane w: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, Strona(/y) 13286-13296
Wydawca: IEEE
DOI: 10.1109/cvpr52688.2022.01294

Pose representations for deep skeletal animation

Autorzy: Andreou, N., Aristidou, A., & Chrysanthou, Y.
Opublikowane w: Computer Graphics Forum (Vol. 41, No. 8, pp. 155-167), 2021
Wydawca: arxiv
DOI: 10.48550/arxiv.2111.13907

Extending the Open Source Social Virtual Reality Ecosystem to the Browser in Ubiq

Autorzy: Sebastian Friston, Ben Congdon, Nels Numan, Klara BrandstäTter, Lisa Izzouzi, Felix Thiel, Jingyi Zhang, Daniele Giunchi, David Swapp, Anthony Steed
Opublikowane w: The 28th International ACM Conference on 3D Web Technology, 2023, Strona(/y) 1-9
Wydawca: ACM
DOI: 10.1145/3611314.3615903

CCP: Configurable Crowd Profiles

Autorzy: Andreas Panayiotou, Theodoros Kyriakou, Marilena Lemonari, Yiorgos Chrysanthou, Panayiotis Charalambous
Opublikowane w: Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings, 2022, Strona(/y) 1-10
Wydawca: ACM
DOI: 10.1145/3528233.3530712

User Motion Accentuation in Social Pointing Scenario

Autorzy: Ruoxi Guo, Lisa Izzouzi, Anthony Steed
Opublikowane w: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, Strona(/y) 575-576
Wydawca: IEEE
DOI: 10.1109/vrw58643.2023.00130

D-if: Uncertainty-aware human digitization via implicit distribution field.

Autorzy: Yang, X., Luo, Y., Xiu, Y., Wang, W., Xu, H. and Fan, Z.
Opublikowane w: 2023
Wydawca: IEEE
DOI: 10.48550/arxiv.2308.08857

Behavioral Landmarks: Inferring Interactions from Data.

Autorzy: Lemonari, M., Charalambous, P., Panayiotou, A., Chrysanthou, Y. and Pettré, J., 2024.
Opublikowane w: 2024
Wydawca: The Eurographics Association
DOI: 10.2312/egp.20241039

Evaluation of Media-Based Social Interactions in Virtual Environments

Autorzy: Lisa Izzouzi, Anthony Steed, Ifat Yasin
Opublikowane w: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences, 2023, Strona(/y) 419-422
Wydawca: ACM
DOI: 10.1145/3573381.3596501

Emotional Speech-Driven Animation with Content-Emotion Disentanglement

Autorzy: Radek Daněček, Kiran Chhatre, Shashank Tripathi, Yandong Wen, Michael Black, Timo Bolkart
Opublikowane w: SIGGRAPH Asia 2023 Conference Papers, 2024, Strona(/y) 1-13
Wydawca: ACM
DOI: 10.1145/3610548.3618183

Peer reviewed articles (13)

Lessons learnt running distributed and remote mixed reality experiments

Autorzy: Anthony Steed, Daniel Archer, Klara Brandstätter, Ben J. Congdon, Sebastian Friston, Priya Ganapathi, Daniele Giunchi, Lisa Izzouzi, Gun Woo (Warren) Park, David Swapp, Felix J. Thiel
Opublikowane w: Frontiers in Computer Science, Numer 4, 2023, ISSN 2624-9898
Wydawca: Frontiers in Computer Science
DOI: 10.3389/fcomp.2022.966319

TRAIL: Simulating the impact of human locomotion on natural landscapes

Autorzy: Eduardo Alvarado, Oscar Argudo, Damien Rohmer, Marie-Paule Cani, Nuria Pelechano
Opublikowane w: The Visual Computer, Numer 40, 2024, Strona(/y) 5029-5041, ISSN 0178-2789
Wydawca: Springer Verlag
DOI: 10.1007/s00371-024-03506-z

Pose Representations for Deep Skeletal Animation

Autorzy: N. Andreou, A. Aristidou, Y. Chrysanthou
Opublikowane w: Computer Graphics Forum, Numer 41, 2023, Strona(/y) 155-167, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14632

Simulating real-life scenarios to better understand the spread of diseases under different contexts

Autorzy: Rafael Blanco, Gustavo Patow, Nuria Pelechano
Opublikowane w: Scientific Reports, Numer 14, 2024, ISSN 2045-2322
Wydawca: Nature Publishing Group
DOI: 10.1038/s41598-024-52903-w

Combining Motion Matching and Orientation Prediction to Animate Avatars for Consumer‐Grade VR Devices

Autorzy: J. L. Ponton, H. Yun, C. Andujar, N. Pelechano
Opublikowane w: Computer Graphics Forum, Numer 41, 2023, Strona(/y) 107-118, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14628

Authoring Virtual Crowds: A Survey

Autorzy: Marilena Lemonari, Rafael Blanco, Panayiotis Charalambous, Nuria Pelechano, Marios Avraamides, Julien Pettré, Yiorgos Chrysanthou
Opublikowane w: Computer Graphics Forum, Numer 41, 2024, Strona(/y) 677-701, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14506

SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data

Autorzy: Jose Luis Ponton, Haoran Yun, Andreas Aristidou, Carlos Andujar, Nuria Pelechano
Opublikowane w: ACM Transactions on Graphics, Numer 43, 2023, Strona(/y) 1-14, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3625264

Generating Upper‐Body Motion for Real‐Time Characters Making their Way through Dynamic Environments

Autorzy: Eduardo Alvarado, Damien Rohmer, Marie‐Paule Cani
Opublikowane w: Computer Graphics Forum, Numer 41, 2024, Strona(/y) 169-181, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14633

A Survey on Reinforcement Learning Methods in Character Animation

Autorzy: Ariel Kwiatkowski, Eduardo Alvarado, Vicky Kalogeiton, C. Karen Liu, Julien Pettré, Michiel van de Panne, Marie‐Paule Cani
Opublikowane w: Computer Graphics Forum, Numer 41, 2024, Strona(/y) 613-639, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14504

The One-Man-Crowd: Single User Generation of Crowd Motions Using Virtual Reality

Autorzy: Tairan, Yin/Inria, Univ Rennes, CNRS, IRISA, France; Ludovic Hoyet/Inria, Univ Rennes, CNRS, IRISA, France; Marc Christie/ Inria, Univ Rennes, CNRS, IRISA, France; Marie-Paule Cani/Ecole Polytechnique, CNRS (LIX), IP Paris, France; Julien Pettré/Inria, Univ Rennes, CNRS, IRISA, France
Opublikowane w: IEEE Transactions on Visualization and Computer Graphics/28/5/2245-2255, 2021, ISSN 1941-0506
Wydawca: IEEE
DOI: 10.1109/tvcg.2022.3150507

Ubiq-exp: A toolkit to build and run remote and distributed mixed reality experiments

Autorzy: Anthony Steed, Lisa Izzouzi, Klara Brandstätter, Sebastian Friston, Ben Congdon, Otto Olkkonen, Daniele Giunchi, Nels Numan, David Swapp
Opublikowane w: Frontiers in Virtual Reality, Numer 3, 2022, ISSN 2673-4192
Wydawca: Frontiers in Virtual Reality
DOI: 10.3389/frvir.2022.912078

With or Without You: Effect of Contextual and Responsive Crowds on VR-based Crowd Motion Capture

Autorzy: Tairan Yin, Ludovic Hoyet, Marc Christie, Marie-Paule Cani, Julien Pettré
Opublikowane w: IEEE Transactions on Visualization and Computer Graphics, Numer 30, 2024, Strona(/y) 2785-2795, ISSN 1077-2626
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2024.3372038

Real-Time Locomotion on Soft Grounds With Dynamic Footprints

Autorzy: Eduardo Alvarado, Chloé Paliard, Damien Rohmer, Marie-Paule Cani
Opublikowane w: Frontiers in Virtual Reality, 2022, ISSN 2673-4192
Wydawca: Frontiers
DOI: 10.3389/frvir.2022.801856