Project description
AI and VR-based technologies for live-streamed performing arts
The COVID-19 pandemic and associated quarantines underscored the necessity for enhanced virtual solutions in the realm of performing arts, including theatre. Traditional live-streamed performances often fell short in providing viewers with a sense of presence and engagement. The MSCA-funded ACCESS project addresses this gap by aiming to enhance live-streaming solutions for performing arts. It plans to achieve this by developing an innovative virtual environment based on deep learning (DL) and AI. This environment will offer real-time video processing, enabling viewers to focus on specific locations of interest. Additionally, the project will incorporate embodied virtual avatars and foyers to facilitate social interactions among users and provide relevant information or assistance.
Objective
The vision of ACCESS is to create an integrated framework for remote attendance of (live streamed) performing arts that offers a stronger feeling of presence compared to existing live video streaming products. To this end, we will radically extend the latest advances in Deep Learning (DL)/Artificial Intelligence (AI), we will build upon leading industrial DL capacities, and we will integrate these into mature virtual reality (VR) technologies in a unique and innovative way. Specifically, ACCESS will develop a virtual environment, wherein users:
1) Will be able to watch live-streamed video of performing arts, processed in real-time so that the video appears more focused on areas of the video that the viewer looks at. For instance, a TV director usually points the camera to the person speaking; however, a viewer may want to look at the reactions of another actor.
2) Will be embodied into virtual avatars and be able to interact with a virtual companion. The companion will support short discussions with the viewer, both chit-chat and provision of information related to the presented arts show. This may be able to happen during the live streaming, while waiting for it to start, or at the end of it.
3) Will be able to interact with the virtual personas of other attendants inside a virtual foyer.
These three components offer a stronger feeling of presence when attending a live show online.
To achieve this vision, ACCESS pursues an intersectoral secondment program that fosters knowledge exchange between academic experts and industrial partners in the cutting-edge technological fields of AI and VR. Additionally, the participation of an arts organization dedicated to supporting contemporary culture and digital art is crucial for the success of this project, both technically as well as for implementing our communication and dissemination ambition and plans.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
- engineering and technology electrical engineering, electronic engineering, information engineering electronic engineering sensors optical sensors
- humanities arts
You need to log in or register to use this function
We are sorry... an unexpected error occurred during execution.
You need to be authenticated. Your session might have expired.
Thank you for your feedback. You will soon receive an email to confirm the submission. If you have selected to be notified about the reporting status, you will also be contacted when the reporting status will change.
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-SE - HORIZON TMA MSCA Staff Exchanges
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2022-SE-01
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
3036 Lemesos
Cyprus
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.