CAROUSEL+

Informazioni relative al progetto

CAROUSEL

ID dell’accordo di sovvenzione: 101017779

DOI

10.3030/101017779

Progetto chiuso

Data della firma CE 3 Dicembre 2020

Data di avvio 1 Gennaio 2021

Data di completamento 31 Dicembre 2024

Finanziato da

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Costo totale

€ 3 675 521,25

Contributo UE

€ 3 675 520,00

Coordinato da

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Germany

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (4)

Cross-project collaboration plan

Crossproject collaboration plan M6M12M30M48 This deliverable will be coordinated with the other relevant project Concrete crossproject collaboration activities will be reported in the subsequent reporting periods

Stakeholder reports

Stakeholder reports will be provided at M18 Updates on M33 and M44 Last deliverable is anticipated in order to be taken into account in the Innovation Transfer plan

Dissemination and Communication plan

Dissemination and Communication plan M4 and revisions at each cycle M21 and M36

Market observatory report

Market observatory report comprising estimations of availability and costing of current and future XR devices and systems M18 Updates on M33 and M44 Last deliverable is anticipated in order to be taken into account in the Innovation Transfer plan

Websites, patent fillings, videos etc. (1)

Project Website, basic collaterals, and logo

Project Website basic collaterals and logo M4

Pubblicazioni

Conference proceedings (25)

Embodied online dance learning objectives of CAROUSEL+

Autori: Kenny Mitchell, Babis Koniaris, Monica Tamariz, Jessie Kennedy, Noshaba Cheema,
Pubblicato in: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Numero 2021, 2021
Editore: IEEE
DOI: 10.1109/vrw52623.2021.00062

Emotional Voice Puppetry

Autori: Ye Pan, Ruisi Zhang, Shengran Cheng, Shuai Tan, Yu Ding, Kenny Mitchell, Xubo Yang
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, Numero 2023, 2023, Pagina/e 2527 - 2535, ISSN 1077-2626
Editore: IEEE Transactions on Visualization and Computer Graphics
DOI: 10.1109/tvcg.2023.3247101

Vibing Together: Dance Experiences in Social Virtual Reality

Autori: Roosa Piitulainen; Perttu Hämäläinen; Elisa D Mekler
Pubblicato in: CHI Conference on Human Factors in Computing Systems, Numero 2022, 2021
Editore: ACM
DOI: 10.1145/3491102.3501828

Text-Based Motion Synthesis with a Hierarchical Two-Stream RNN

Autori: Anindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt, Philipp Slusallek
Pubblicato in: Special Interest Group on Computer Graphics and Interactive Techniques Conference Posters, Numero 2021, 2021, Pagina/e 1-2
Editore: ACM
DOI: 10.1145/3450618.3469163

Duet: VR Pair Dancing with Partner Movement Manipulation

Autori: Markus Laattala, Perttu Hämäläinen
Pubblicato in: Companion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play, Numero 2024, 2024, Pagina/e 306-311
Editore: ACM
DOI: 10.1145/3665463.3678838

Synthesis of Compositional Animations from Textual Descriptions. 2021

Autori: Anindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt, Philipp Slusallek.
Pubblicato in: 2021 International Conference on Computer Vision (ICCV)., Numero 2021, 2021, Pagina/e p 1376-1386
Editore: IEEE
DOI: 10.48550/arxiv.2103.14675

Generating Real-time Detailed Ground Visualisations from Sparse Aerial Point Clouds

Autori: Murray, A., Mitchell, S., Bradley, A., Waite, E., Ross, C., Jamrozy, J., & Mitchell, K.
Pubblicato in: ACM SIGGRAPH European Conference on Visual Media Production Industry Papre, Numero 2022, 2022
Editore: ACM Siggraph

Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments

Autori: Llogari Casas, Kenny Mitchell, Monica Tamariz, Samantha Hannah, David Sinclair, Babis Koniaris, and Jessie Kennedy
Pubblicato in: CHI24 Hybrid WorkshopGenerative AI in User-Generated Content, Numero 2024, 2024
Editore: ACM SIGCHI

Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study

Autori: Perttu Hämäläinen, Mikke Tavast, Anton Kunnari
Pubblicato in: CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Numero 2023, 2023
Editore: Association for Computing Machinery CHI
DOI: 10.1145/3544548.3580688

Modeling the “Gorilla Arm” Effect with Reinforcement Learning

Autori: Noshaba Cheema, Laura A Frey Law, Kourosh Naderi, Jaakko Lehtinen, Perttu Hamalainen, Philipp Slusallek
Pubblicato in: 2021 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) Poster., Numero 2021, 2021
Editore: ACM

Toward Fatigue Modeling for Locomotion Tasks.

Autori: Rui Xu*, Noshaba Cheema*, Erik Herrmann, Perttu Hamalainen, Philipp Slusallek
Pubblicato in: 2021 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) Poster., 2021
Editore: ACM

DeFT-Net: Dual-Window Extended Frequency Transformer for Rhythmic Motion Prediction

Autori: Ademola, Adeyemi; Sinclair, David; Koniaris, Babis; Hannah, Samantha; Mitchell, Kenny
Pubblicato in: Computer Graphics & Visual Computing (CGVC) 2024, Numero 2024, 2024
Editore: eg.org

MoodFlow: Orchestrating Conversations with Emotionally Intelligent Avatars in Mixed Reality

Autori: Llogari Casas, Samantha Hannah, Kenny Mitchell
Pubblicato in: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Numero 2024, 2024, Pagina/e 86-89, ISBN 979-8-3503-7450-6
Editore: IEEE
DOI: 10.1109/vrw62533.2024.00021

Intermediated Reality with an AI 3D Printed Character

Autori: Llogari Casas, Kenny MItchell
Pubblicato in: ACM SIGGRAPH 2023 Real Time LIve!, Numero 2023, 2023
Editore: ACM SIGGRAPH
DOI: 10.1145/3588430.3597251

Evaluating User Experiences in Mixed Reality.

Autori: Dmitry Alexandrovsky, Susanne Putze, Valentin Schwind, Elisa D. Mekler, Jan David Smeddinck, Denise Kahl, Antonio Krüger, Rainer Malaka.
Pubblicato in: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Numero 2021, 2021
Editore: ACM
DOI: 10.1145/3411763.3441337

Discovering Fatigued Movements for Virtual Character Animation

Autori: Noshaba Cheema,Rui Xu,Nam Hee Kim,Perttu Hämäläinen,Vladislav Golyanik, Marc Habermann, Christian Theobalt, Philipp Slusallek
Pubblicato in: SIGGRAPH ASIA 2023 Conference papers, Numero 2023, 2023
Editore: SIGGRAPH ASIA 2023
DOI: 10.1145/3610548.3618176

WAVE: Anticipatory Movement Visualization for VR Dancing

Autori: Markus Laattala, Roosa Piitulainen, Nadia M. Ady, Monica Tamariz, Perttu Hämäläinen
Pubblicato in: Proceedings of the CHI Conference on Human Factors in Computing Systems, Numero 2024, 2024, Pagina/e 1-9
Editore: ACM
DOI: 10.1145/3613904.3642145

“I Feel My Abs”: Exploring Non-standing VR Locomotion

Autori: Reetu Kontio, Markus Laattala, Robin Welsch, Perttu Hämäläinen
Pubblicato in: Proceedings of the ACM on Human-Computer Interaction, Numero 2023, 2023, Pagina/e 1282–1307
Editore: ACM CHI
DOI: 10.1145/3611069

Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics

Autori: Y. Pan, R. Zhang, J. Wang, Y. Ding, K. Mitchell
Pubblicato in: Proceedings of the 31st ACM International Conference on Multimedia, Numero 2023, 2023, Pagina/e 6851–6859
Editore: ACM Multimedia
DOI: 10.1145/3581783.3613803

Auditory Occlusion Based on the Human Body in the Direct Sound Path: Measured and Perceivable Effects

Autori: Steven McSeveney, Monica Tamariz, Iain McGregor, Babis Koniaris, Kenny Mitchell
Pubblicato in: Audio Mostly 2024 - Explorations in Sonic Cultures, Numero 2024, 2024, Pagina/e 130-143
Editore: ACM
DOI: 10.1145/3678299.3678312

DanceMark: An Open Telemetry Framework for Latency-Sensitive Real-Time Networked Immersive Experiences

Autori: Babis Koniaris, David Sinclair, Kenny Mitchell
Pubblicato in: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2024, Pagina/e 462-463
Editore: IEEE
DOI: 10.1109/vrw62533.2024.00091

MienCap: Performance-based Facial Animation with Live Mood Dynamics

Autori: Ye Pan; Ruisi Zhang; Jingying Wang; Nengfu Chen; Yilin Qiu; Yu Ding; Kenny Mitchell
Pubblicato in: Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE Conference on, Numero 2022, 2022, ISBN 978-1-6654-8402-2
Editore: IEEE
DOI: 10.1109/vrw55335.2022.00178

DanceGraph: A Complementary Architecture for Synchronous Dancing Online

Autori: David Sinclair, Adeyemi Ademola, Babis Koniaris, Kenny Mitchell
Pubblicato in: CASA 2023, Numero 2023, 2023
Editore: CASA

Whole Volume Light Scattering in Homogeneous Finite Media

Autori: Zdravko Velinov, Kenny Mitchell
Pubblicato in: 2022 IEEE Transactions on Visualization and Computer Graphics [TVCG], Numero 2022, 2022
Editore: IEEE
DOI: 10.1109/tvcg.2021.3135764

Structured Teaching Prompt Articulation for Generative-AI Role Embodiment with Augmented Mirror Video Displays

Autori: Llogari Casas, Kenny Mitchell
Pubblicato in: Proceedings of the 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, Numero 2024, 2025, Pagina/e 1-7
Editore: ACM
DOI: 10.1145/3703619.3706049

Non-peer reviewed articles (3)

Editorial: Games Futures I.

Autori: S. Deterding, K. Mitchell, R. Kowert, B. King
Pubblicato in: ACM Games Research and Practice, Numero 2023, 2023, ISSN 2832-5516
Editore: ACM Games
DOI: 10.1145/3585394

Editorial: Games May Host the First Rightful AI Citizens

Autori: Kenny Mitchell
Pubblicato in: ACM GAMES, Numero 2023, 2023, ISSN 2832-5516
Editore: ACM Games
DOI: 10.1145/3606834

Inaugural Editorial: A Lighthouse for Games and Playable Media

Autori: Sebastian Deterding, Kenny Mitchell, Rachel Kowert, Brad King
Pubblicato in: ACM Games Research and Practice, Numero 2023, 2023, ISSN 2832-5516
Editore: ACM Games Research and Practice
DOI: 10.1145/3585393

Peer reviewed articles (4)

NeFT-Net: N-window extended frequency transformer for rhythmic motion prediction

Autori: Adeyemi Ademola, David Sinclair, Babis Koniaris, Samantha Hannah, Kenny Mitchell
Pubblicato in: Computers & Graphics, Numero 129, 2025, Pagina/e 104244, ISSN 0097-8493
Editore: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2025.104244

Expressive Talking Avatars

Autori: Ye Pan, Shuai Tan, Shengran Cheng, Qunfen Lin, Zijiao Zeng, Kenny Mitchell
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, Numero 30, 2024, Pagina/e 2538-2548, ISSN 1077-2626
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2024.3372047

Foreword to the Special Section on the Reality-Virtuality Continuum and its Applications (RVCA)

Autori: Mashhuda Glencrossa, Kenny Mitchell, Billinghurst Mark, Ye Pan
Pubblicato in: ACM Computer & Graphics, Numero Vol 97, 2021, Pagina/e A3-A4, ISSN 2577-6193
Editore: ACM
DOI: 10.1016/j.cag.2021.05.007

Improving VIP viewer gaze estimation and engagement using adaptive dynamic anamorphosis

Autori: Ye Pan, Kenny Mitchell
Pubblicato in: International Journal of Human-Computer Studies, Numero Vol 147, 2022, ISSN 1071-5819
Editore: Academic Press
DOI: 10.1016/j.ijhcs.2020.102563

Other (5)

Moe-Phobia: Effect of Users' Gender on Perceived Sexuality and Likability Toward Manga-Like Virtual Agents

Autori: Tetsuya Matsu, Kenny Mitchell (ed)
Pubblicato in: Frontiers in Psychology, Numero 9 May 2022, 2022
Editore: Frontiers in sychology
DOI: 10.3389/fpsyg.2022.752748

Rudimentary Examples of Composing with Generative AI for Immersive Applications

Autori: Llogari Casas, Alex Bradley, Kenny Mitchell
Pubblicato in: ACM SIGGRAPH Asia Birds of a Feather BOF, Numero 2024, 2024
Editore: ACM SIGGRAPH Asia
DOI: 10.5281/zenodo.16411913

X-IRL risks Identifying privacy and security risks in inter-reality attacks and interactions

Autori: Mashhuda Glencross, Kenny Mitchell, Jasim Happa, Anthony Steed, Noelle Martin, Moya Kate Baldry
Pubblicato in: IEEE Workshop on X-IRL Risks, Numero 2022, 2022
Editore: IEEE

Expressive Avatar Interactions for Safe Social and Interactive Online Dancing Experiences

Autori: Alexandra Schmuklermann, Carmen Mac Williams, Pieter van der Linden, Noshaba Cheema, Kenny Mitchell
Pubblicato in: DEVCOM Developer Conference, Numero 2024, 2024, Pagina/e https://www.instagram.com/reel/C-3KgI2IHqv/
Editore: Kolnmesse
DOI: 10.5281/zenodo.16411704

Frontiers Workshop: Expressive Avatar Interactions in Online Co-Experiences

Autori: Mubbasir Kapadia, Victor Zordan, Ian Sachs, Vivek Virma, Sean Palmer, Tom Sonacki, Anindita Ghosh, Markus Laattala, Kenny Mitchell
Pubblicato in: ACM SIGGRAPH Frontiers, Numero 2023, 2023
Editore: ACM SIGGRAPH

Book chapters (1)

REMOS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions

Autori: Anindita Ghosh, Rishabh Dabral, Vladislav Golyanik, Christian Theobalt, Philipp Slusallek
Pubblicato in: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, Numero 2024, 2024, Pagina/e 418-437
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-72764-1_24

Diritti di proprietà intellettuale

Patent (3)

AUGMENTED REALITY METHODS AND SYSTEMS

Numero candidatura/pubblicazione: 20 707781
Data: 2020-02-14
Candidato/i: EDINBURGH NAPIER UNIVERSITY

SYNCHRONOUS PATTERNED MOTION AVATARS

Numero candidatura/pubblicazione: 20 24064444
Data: 2024-05-24
Candidato/i: EDINBURGH NAPIER UNIVERSITY

AUGMENTED REALITY METHODS AND SYSTEMS

Numero candidatura/pubblicazione: 20 707781
Data: 2020-02-14
Candidato/i: EDINBURGH NAPIER UNIVERSITY