CORDIS - Forschungsergebnisse der EU
CORDIS

A novel suite of technologies and an inexpensive platform based on Artificial Intelligence for remote access to live performing arts with an immensely improved feeling of presence

Projektbeschreibung

KI- und VR-basierte Technologien für live-gestreamte darstellende Künste

Die COVID-19-Pandemie und die damit verbundenen Quarantänen verdeutlichten die Notwendigkeit verbesserter virtueller Lösungen für das Reich der darstellenden Künste einschließlich des Theaters. Übliche live übertragene Auftritte vermittelten den Zuschauenden oft nicht das Gefühl von Präsenz und Einbeziehung. Das Ziel des im Rahmen der Marie-Skłodowska-Curie-Maßnahmen finanzierten Projekts ACCESS ist, diese Lücke zu schließen, indem Live-Streaming-Lösungen für die darstellende Kunst optimiert werden. Zu diesem Zweck ist geplant, eine innovative virtuelle Umgebung zu entwickeln, die auf Deep Learning und KI beruht. Diese Umgebung wird eine Videoverarbeitung in Echtzeit zulassen, die es den Zuschauenden ermöglicht, sich auf bestimmte Orte von Interesse zu konzentrieren. Zudem werden projektintern virtuelle Avatare und Foyers einbezogen, um soziale Interaktionen zwischen den Nutzenden zu erleichtern und relevante Informationen oder Assistenz bereitzustellen.

Ziel

The vision of ACCESS is to create an integrated framework for remote attendance of (live streamed) performing arts that offers a stronger feeling of presence compared to existing live video streaming products. To this end, we will radically extend the latest advances in Deep Learning (DL)/Artificial Intelligence (AI), we will build upon leading industrial DL capacities, and we will integrate these into mature virtual reality (VR) technologies in a unique and innovative way. Specifically, ACCESS will develop a virtual environment, wherein users:
1) Will be able to watch live-streamed video of performing arts, processed in real-time so that the video appears more focused on areas of the video that the viewer looks at. For instance, a TV director usually points the camera to the person speaking; however, a viewer may want to look at the reactions of another actor.
2) Will be embodied into virtual avatars and be able to interact with a virtual companion. The companion will support short discussions with the viewer, both chit-chat and provision of information related to the presented arts show. This may be able to happen during the live streaming, while waiting for it to start, or at the end of it.
3) Will be able to interact with the virtual personas of other attendants inside a virtual foyer.
These three components offer a stronger feeling of presence when attending a live show online.
To achieve this vision, ACCESS pursues an intersectoral secondment program that fosters knowledge exchange between academic experts and industrial partners in the cutting-edge technological fields of AI and VR. Additionally, the participation of an arts organization dedicated to supporting contemporary culture and digital art is crucial for the success of this project, both technically as well as for implementing our communication and dissemination ambition and plans.

Schlüsselbegriffe

Koordinator

TECHNOLOGIKO PANEPISTIMIO KYPROU
Netto-EU-Beitrag
€ 110 400,00
Adresse
ARCHBISHOP KYPRIANOS 31 SAVINGS COOPERATIVE BANK BUILDING 3RD FLOOR
3036 Lemesos
Zypern

Auf der Karte ansehen

Region
Κύπρος Κύπρος Κύπρος
Aktivitätstyp
Higher or Secondary Education Establishments
Links
Gesamtkosten
Keine Daten

Beteiligte (5)