Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Hybrid Extended reAliTy

Project description

Innovating XR technologies through hybridisation

Extended reality (XR) technologies offer numerous benefits, ranging from enhanced education solutions to innovative entertainment options. However, most XR technologies are still in their early stages and remain inaccessible to many people. The EU-funded HEAT project aims to revolutionise XR technology by addressing current challenges and paving the way for next-generation distributed experiences. The project plans to use hybrid XR technologies, including social virtual reality, point cloud/holographic imaging, and multi-sensorial media, to enable context-aware embodied telepresence experiences. Additionally, it aims to employ new AI-based volumetric data acquisition techniques to enhance performance and reduce costs. The results will be tested in various real-world educational and cultural environments, ensuring that ethical considerations, the AI Act, and GDPR compliance are thoroughly addressed.

Objective

Hybrid Extended reAliTy (HEAT) is born to pave the way for the next-generation distributed experiences by addressing major challenges to make those experiences that up to now could only be in our imagination: being realistically immersed (holo-ported) within real captured omnidirectional and navigable hyper-realistic 3D spaces, feeling their atmosphere, and sharing these experiences with others, regardless of their location. The aim of this proposal is to integrate immersive media technologies such as point cloud/holographic imaging, multi-sensorial media, Social VR in a multi-user, feedback-enabled communication system to provide the construction of compelling context-aware and embodied experiences for innovative hybrid XR applications, where remote users can experience a real captured environment through immersive VR, while in presence users can visualise and interact with the holograms of remote users integrated in the real environment through holographic rendering.
The system will aim at facilitating the exploitation of agile (multi-sensory) 3D data acquisition techniques, enhancing performance while reducing technology costs. It will create a scalable communication pipeline embodying either encapsulation of different media from classical audio-video to multisensorial to holographic video or a combination of them, providing means for efficient and scalable encoding, processing, storage, (real-time) streaming and rendering. In such a way, the system will allow users to provide/exploit the features according to the acquisition/rendering system available.
The project will provide well designed and fully tested scenarios in real-world environments for enhanced XR experiences: a blended learning, a modern theatre act, a music festival and an opera show. All pilot actions will ensure that GDPR and ethics are addressed for end-users (privacy and ethics by design methodology).

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-RIA - HORIZON Research and Innovation Actions

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) HORIZON-CL4-2023-HUMAN-01-CNECT

See all projects funded under this call

Coordinator

UNIVERSITA DEGLI STUDI DI CAGLIARI
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 950 750,00
Address
VIA UNIVERSITA 40
09124 CAGLIARI
Italy

See on map

Region
Isole Sardegna Cagliari
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

€ 950 750,00

Participants (14)

Partners (1)

My booklet 0 0