CAROUSEL+

Información del proyecto

CAROUSEL

Identificador del acuerdo de subvención: 101017779

DOI

10.3030/101017779

Proyecto cerrado

Fecha de la firma de la CE 3 Diciembre 2020

Fecha de inicio 1 Enero 2021

Fecha de finalización 31 Diciembre 2024

Financiado con arreglo a

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Coste total

€ 3 675 521,25

Aportación de la UE

€ 3 675 520,00

Coordinado por

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (4)

Cross-project collaboration plan

Crossproject collaboration plan M6M12M30M48 This deliverable will be coordinated with the other relevant project Concrete crossproject collaboration activities will be reported in the subsequent reporting periods

Stakeholder reports

Stakeholder reports will be provided at M18 Updates on M33 and M44 Last deliverable is anticipated in order to be taken into account in the Innovation Transfer plan

Dissemination and Communication plan

Dissemination and Communication plan M4 and revisions at each cycle M21 and M36

Market observatory report

Market observatory report comprising estimations of availability and costing of current and future XR devices and systems M18 Updates on M33 and M44 Last deliverable is anticipated in order to be taken into account in the Innovation Transfer plan

Websites, patent fillings, videos etc. (1)

Project Website, basic collaterals, and logo

Project Website basic collaterals and logo M4

Publicaciones

Conference proceedings (25)

Embodied online dance learning objectives of CAROUSEL+

Autores: Kenny Mitchell, Babis Koniaris, Monica Tamariz, Jessie Kennedy, Noshaba Cheema,
Publicado en: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Edición 2021, 2021
Editor: IEEE
DOI: 10.1109/vrw52623.2021.00062

Emotional Voice Puppetry

Autores: Ye Pan, Ruisi Zhang, Shengran Cheng, Shuai Tan, Yu Ding, Kenny Mitchell, Xubo Yang
Publicado en: IEEE Transactions on Visualization and Computer Graphics, Edición 2023, 2023, Página(s) 2527 - 2535, ISSN 1077-2626
Editor: IEEE Transactions on Visualization and Computer Graphics
DOI: 10.1109/tvcg.2023.3247101

Vibing Together: Dance Experiences in Social Virtual Reality

Autores: Roosa Piitulainen; Perttu Hämäläinen; Elisa D Mekler
Publicado en: CHI Conference on Human Factors in Computing Systems, Edición 2022, 2021
Editor: ACM
DOI: 10.1145/3491102.3501828

Text-Based Motion Synthesis with a Hierarchical Two-Stream RNN

Autores: Anindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt, Philipp Slusallek
Publicado en: Special Interest Group on Computer Graphics and Interactive Techniques Conference Posters, Edición 2021, 2021, Página(s) 1-2
Editor: ACM
DOI: 10.1145/3450618.3469163

Duet: VR Pair Dancing with Partner Movement Manipulation

Autores: Markus Laattala, Perttu Hämäläinen
Publicado en: Companion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play, Edición 2024, 2024, Página(s) 306-311
Editor: ACM
DOI: 10.1145/3665463.3678838

Synthesis of Compositional Animations from Textual Descriptions. 2021

Autores: Anindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt, Philipp Slusallek.
Publicado en: 2021 International Conference on Computer Vision (ICCV)., Edición 2021, 2021, Página(s) p 1376-1386
Editor: IEEE
DOI: 10.48550/arxiv.2103.14675

Generating Real-time Detailed Ground Visualisations from Sparse Aerial Point Clouds

Autores: Murray, A., Mitchell, S., Bradley, A., Waite, E., Ross, C., Jamrozy, J., & Mitchell, K.
Publicado en: ACM SIGGRAPH European Conference on Visual Media Production Industry Papre, Edición 2022, 2022
Editor: ACM Siggraph

Design Considerations of Voice Articulated Generative AI Virtual Reality Dance Environments

Autores: Llogari Casas, Kenny Mitchell, Monica Tamariz, Samantha Hannah, David Sinclair, Babis Koniaris, and Jessie Kennedy
Publicado en: CHI24 Hybrid WorkshopGenerative AI in User-Generated Content, Edición 2024, 2024
Editor: ACM SIGCHI

Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study

Autores: Perttu Hämäläinen, Mikke Tavast, Anton Kunnari
Publicado en: CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Edición 2023, 2023
Editor: Association for Computing Machinery CHI
DOI: 10.1145/3544548.3580688

Modeling the “Gorilla Arm” Effect with Reinforcement Learning

Autores: Noshaba Cheema, Laura A Frey Law, Kourosh Naderi, Jaakko Lehtinen, Perttu Hamalainen, Philipp Slusallek
Publicado en: 2021 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) Poster., Edición 2021, 2021
Editor: ACM

Toward Fatigue Modeling for Locomotion Tasks.

Autores: Rui Xu*, Noshaba Cheema*, Erik Herrmann, Perttu Hamalainen, Philipp Slusallek
Publicado en: 2021 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) Poster., 2021
Editor: ACM

DeFT-Net: Dual-Window Extended Frequency Transformer for Rhythmic Motion Prediction

Autores: Ademola, Adeyemi; Sinclair, David; Koniaris, Babis; Hannah, Samantha; Mitchell, Kenny
Publicado en: Computer Graphics & Visual Computing (CGVC) 2024, Edición 2024, 2024
Editor: eg.org

MoodFlow: Orchestrating Conversations with Emotionally Intelligent Avatars in Mixed Reality

Autores: Llogari Casas, Samantha Hannah, Kenny Mitchell
Publicado en: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Edición 2024, 2024, Página(s) 86-89, ISBN 979-8-3503-7450-6
Editor: IEEE
DOI: 10.1109/vrw62533.2024.00021

Intermediated Reality with an AI 3D Printed Character

Autores: Llogari Casas, Kenny MItchell
Publicado en: ACM SIGGRAPH 2023 Real Time LIve!, Edición 2023, 2023
Editor: ACM SIGGRAPH
DOI: 10.1145/3588430.3597251

Evaluating User Experiences in Mixed Reality.

Autores: Dmitry Alexandrovsky, Susanne Putze, Valentin Schwind, Elisa D. Mekler, Jan David Smeddinck, Denise Kahl, Antonio Krüger, Rainer Malaka.
Publicado en: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Edición 2021, 2021
Editor: ACM
DOI: 10.1145/3411763.3441337

Discovering Fatigued Movements for Virtual Character Animation

Autores: Noshaba Cheema,Rui Xu,Nam Hee Kim,Perttu Hämäläinen,Vladislav Golyanik, Marc Habermann, Christian Theobalt, Philipp Slusallek
Publicado en: SIGGRAPH ASIA 2023 Conference papers, Edición 2023, 2023
Editor: SIGGRAPH ASIA 2023
DOI: 10.1145/3610548.3618176

WAVE: Anticipatory Movement Visualization for VR Dancing

Autores: Markus Laattala, Roosa Piitulainen, Nadia M. Ady, Monica Tamariz, Perttu Hämäläinen
Publicado en: Proceedings of the CHI Conference on Human Factors in Computing Systems, Edición 2024, 2024, Página(s) 1-9
Editor: ACM
DOI: 10.1145/3613904.3642145

“I Feel My Abs”: Exploring Non-standing VR Locomotion

Autores: Reetu Kontio, Markus Laattala, Robin Welsch, Perttu Hämäläinen
Publicado en: Proceedings of the ACM on Human-Computer Interaction, Edición 2023, 2023, Página(s) 1282–1307
Editor: ACM CHI
DOI: 10.1145/3611069

Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics

Autores: Y. Pan, R. Zhang, J. Wang, Y. Ding, K. Mitchell
Publicado en: Proceedings of the 31st ACM International Conference on Multimedia, Edición 2023, 2023, Página(s) 6851–6859
Editor: ACM Multimedia
DOI: 10.1145/3581783.3613803

Auditory Occlusion Based on the Human Body in the Direct Sound Path: Measured and Perceivable Effects

Autores: Steven McSeveney, Monica Tamariz, Iain McGregor, Babis Koniaris, Kenny Mitchell
Publicado en: Audio Mostly 2024 - Explorations in Sonic Cultures, Edición 2024, 2024, Página(s) 130-143
Editor: ACM
DOI: 10.1145/3678299.3678312

DanceMark: An Open Telemetry Framework for Latency-Sensitive Real-Time Networked Immersive Experiences

Autores: Babis Koniaris, David Sinclair, Kenny Mitchell
Publicado en: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2024, Página(s) 462-463
Editor: IEEE
DOI: 10.1109/vrw62533.2024.00091

MienCap: Performance-based Facial Animation with Live Mood Dynamics

Autores: Ye Pan; Ruisi Zhang; Jingying Wang; Nengfu Chen; Yilin Qiu; Yu Ding; Kenny Mitchell
Publicado en: Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE Conference on, Edición 2022, 2022, ISBN 978-1-6654-8402-2
Editor: IEEE
DOI: 10.1109/vrw55335.2022.00178

DanceGraph: A Complementary Architecture for Synchronous Dancing Online

Autores: David Sinclair, Adeyemi Ademola, Babis Koniaris, Kenny Mitchell
Publicado en: CASA 2023, Edición 2023, 2023
Editor: CASA

Whole Volume Light Scattering in Homogeneous Finite Media

Autores: Zdravko Velinov, Kenny Mitchell
Publicado en: 2022 IEEE Transactions on Visualization and Computer Graphics [TVCG], Edición 2022, 2022
Editor: IEEE
DOI: 10.1109/tvcg.2021.3135764

Structured Teaching Prompt Articulation for Generative-AI Role Embodiment with Augmented Mirror Video Displays

Autores: Llogari Casas, Kenny Mitchell
Publicado en: Proceedings of the 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, Edición 2024, 2025, Página(s) 1-7
Editor: ACM
DOI: 10.1145/3703619.3706049

Non-peer reviewed articles (3)

Editorial: Games Futures I.

Autores: S. Deterding, K. Mitchell, R. Kowert, B. King
Publicado en: ACM Games Research and Practice, Edición 2023, 2023, ISSN 2832-5516
Editor: ACM Games
DOI: 10.1145/3585394

Editorial: Games May Host the First Rightful AI Citizens

Autores: Kenny Mitchell
Publicado en: ACM GAMES, Edición 2023, 2023, ISSN 2832-5516
Editor: ACM Games
DOI: 10.1145/3606834

Inaugural Editorial: A Lighthouse for Games and Playable Media

Autores: Sebastian Deterding, Kenny Mitchell, Rachel Kowert, Brad King
Publicado en: ACM Games Research and Practice, Edición 2023, 2023, ISSN 2832-5516
Editor: ACM Games Research and Practice
DOI: 10.1145/3585393

Peer reviewed articles (4)

NeFT-Net: N-window extended frequency transformer for rhythmic motion prediction

Autores: Adeyemi Ademola, David Sinclair, Babis Koniaris, Samantha Hannah, Kenny Mitchell
Publicado en: Computers & Graphics, Edición 129, 2025, Página(s) 104244, ISSN 0097-8493
Editor: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2025.104244

Expressive Talking Avatars

Autores: Ye Pan, Shuai Tan, Shengran Cheng, Qunfen Lin, Zijiao Zeng, Kenny Mitchell
Publicado en: IEEE Transactions on Visualization and Computer Graphics, Edición 30, 2024, Página(s) 2538-2548, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2024.3372047

Foreword to the Special Section on the Reality-Virtuality Continuum and its Applications (RVCA)

Autores: Mashhuda Glencrossa, Kenny Mitchell, Billinghurst Mark, Ye Pan
Publicado en: ACM Computer & Graphics, Edición Vol 97, 2021, Página(s) A3-A4, ISSN 2577-6193
Editor: ACM
DOI: 10.1016/j.cag.2021.05.007

Improving VIP viewer gaze estimation and engagement using adaptive dynamic anamorphosis

Autores: Ye Pan, Kenny Mitchell
Publicado en: International Journal of Human-Computer Studies, Edición Vol 147, 2022, ISSN 1071-5819
Editor: Academic Press
DOI: 10.1016/j.ijhcs.2020.102563

Other (5)

Moe-Phobia: Effect of Users' Gender on Perceived Sexuality and Likability Toward Manga-Like Virtual Agents

Autores: Tetsuya Matsu, Kenny Mitchell (ed)
Publicado en: Frontiers in Psychology, Edición 9 May 2022, 2022
Editor: Frontiers in sychology
DOI: 10.3389/fpsyg.2022.752748

Rudimentary Examples of Composing with Generative AI for Immersive Applications

Autores: Llogari Casas, Alex Bradley, Kenny Mitchell
Publicado en: ACM SIGGRAPH Asia Birds of a Feather BOF, Edición 2024, 2024
Editor: ACM SIGGRAPH Asia
DOI: 10.5281/zenodo.16411913

X-IRL risks Identifying privacy and security risks in inter-reality attacks and interactions

Autores: Mashhuda Glencross, Kenny Mitchell, Jasim Happa, Anthony Steed, Noelle Martin, Moya Kate Baldry
Publicado en: IEEE Workshop on X-IRL Risks, Edición 2022, 2022
Editor: IEEE

Expressive Avatar Interactions for Safe Social and Interactive Online Dancing Experiences

Autores: Alexandra Schmuklermann, Carmen Mac Williams, Pieter van der Linden, Noshaba Cheema, Kenny Mitchell
Publicado en: DEVCOM Developer Conference, Edición 2024, 2024, Página(s) https://www.instagram.com/reel/C-3KgI2IHqv/
Editor: Kolnmesse
DOI: 10.5281/zenodo.16411704

Frontiers Workshop: Expressive Avatar Interactions in Online Co-Experiences

Autores: Mubbasir Kapadia, Victor Zordan, Ian Sachs, Vivek Virma, Sean Palmer, Tom Sonacki, Anindita Ghosh, Markus Laattala, Kenny Mitchell
Publicado en: ACM SIGGRAPH Frontiers, Edición 2023, 2023
Editor: ACM SIGGRAPH

Book chapters (1)

REMOS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions

Autores: Anindita Ghosh, Rishabh Dabral, Vladislav Golyanik, Christian Theobalt, Philipp Slusallek
Publicado en: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, Edición 2024, 2024, Página(s) 418-437
Editor: Springer Nature Switzerland
DOI: 10.1007/978-3-031-72764-1_24

Derechos de propiedad intelectual

Patent (3)

AUGMENTED REALITY METHODS AND SYSTEMS

Número de solicitud/publicación: 20 707781
Fecha: 2020-02-14
Solicitante(s): EDINBURGH NAPIER UNIVERSITY

SYNCHRONOUS PATTERNED MOTION AVATARS

Número de solicitud/publicación: 20 24064444
Fecha: 2024-05-24
Solicitante(s): EDINBURGH NAPIER UNIVERSITY

AUGMENTED REALITY METHODS AND SYSTEMS

Número de solicitud/publicación: 20 707781
Fecha: 2020-02-14
Solicitante(s): EDINBURGH NAPIER UNIVERSITY