Descripción del proyecto
Tecnologías basadas en inteligencia artificial y realidad virtual para la retransmisión en directo de artes escénicas
La pandemia de COVID-19 y las cuarentenas asociadas pusieron de relieve la necesidad de mejorar las soluciones virtuales en el ámbito de las artes escénicas, incluido el teatro. Las actuaciones tradicionales retransmitidas en directo a menudo se quedaban cortas a la hora de proporcionar a los espectadores una sensación de presencia y compromiso. El equipo del proyecto ACCESS, financiado por las acciones Marie Skłodowska-Curie, aborda esta carencia con el objetivo de mejorar las soluciones de retransmisión en directo para las artes escénicas. Planea lograrlo desarrollando un entorno virtual innovador basado en el aprendizaje profundo y la inteligencia artificial. Este entorno ofrecerá procesamiento de vídeo en tiempo real, lo cual permitirá a los espectadores centrarse en lugares específicos de interés. Además, el equipo del proyecto incorporará avatares virtuales encarnados y vestíbulos para facilitar las interacciones sociales entre los usuarios y proporcionar información o asistencia pertinente.
Objetivo
The vision of ACCESS is to create an integrated framework for remote attendance of (live streamed) performing arts that offers a stronger feeling of presence compared to existing live video streaming products. To this end, we will radically extend the latest advances in Deep Learning (DL)/Artificial Intelligence (AI), we will build upon leading industrial DL capacities, and we will integrate these into mature virtual reality (VR) technologies in a unique and innovative way. Specifically, ACCESS will develop a virtual environment, wherein users:
1) Will be able to watch live-streamed video of performing arts, processed in real-time so that the video appears more focused on areas of the video that the viewer looks at. For instance, a TV director usually points the camera to the person speaking; however, a viewer may want to look at the reactions of another actor.
2) Will be embodied into virtual avatars and be able to interact with a virtual companion. The companion will support short discussions with the viewer, both chit-chat and provision of information related to the presented arts show. This may be able to happen during the live streaming, while waiting for it to start, or at the end of it.
3) Will be able to interact with the virtual personas of other attendants inside a virtual foyer.
These three components offer a stronger feeling of presence when attending a live show online.
To achieve this vision, ACCESS pursues an intersectoral secondment program that fosters knowledge exchange between academic experts and industrial partners in the cutting-edge technological fields of AI and VR. Additionally, the participation of an arts organization dedicated to supporting contemporary culture and digital art is crucial for the success of this project, both technically as well as for implementing our communication and dissemination ambition and plans.
Ámbito científico
- engineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsoptical sensors
- humanitiesarts
- natural sciencescomputer and information sciencesartificial intelligencemachine learningdeep learning
- natural sciencescomputer and information sciencessoftwaresoftware applicationsvirtual reality
Palabras clave
Programa(s)
- HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA) Main Programme
Régimen de financiación
HORIZON-TMA-MSCA-SE - HORIZON TMA MSCA Staff ExchangesCoordinador
3036 Lemesos
Chipre