Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Multimodal Interaction for Remote Physical Artefacts

Project description

Multimodal interaction with remote physical objects

The digital reproduction of the tactile, spatial, and multisensory properties of physical objects remains a challenge, with objects playing a vital role. The ERC-funded MIRA project aims to address this challenge by developing a theory of interaction with remote physical objects, which combines human-computer interaction, psychology, and materials science. The project will also develop multimodal proxies, which are tools for interacting with objects that simulate the visual, auditory, and tactile properties of the objects for the purpose of synchronised remote interaction. The goal is to develop the foundations for the design of systems for interacting with remote objects, as well as the multimodal proxies. It will also establish paradigms for interacting with objects that transcend the co-located experience.

Objective

Digitally replicating the tactile, spatial, and multisensory qualities critical for interacting with physical objects remains an unsolved complex problem. This is challenge is felt acutely in cases such as remote collaboration, which is central to modern work practices, offering flexibility and sustainability. Significant challenges arise when physical objects are integral to collaboration. MIRA answers the question:

How can we create a multimodal proxy for remote physical objects, effectively replicating and going beyond the experience of in-person interaction with the actual object?

MIRA proposes a new Theory of Interaction with Remote Physical Objects by combining research in Human-Computer Interaction, psychological theories, and innovative applications integrating materials science and Multimodal Interaction. Central to this is the creation of a new class of interactive tools, termed multimodal proxies. The effectiveness of these proxies will be tested by designing effective and engaging remote collaboration systems.

MIRA has three objectives:

1. Develop Foundational Principles: Establish a novel set of principles for designing systems supporting remote interaction with physical objects. This has never been done before and will draw on psychological theories and empirical data from large-scale interview and observation studies.
2. Create Multimodal Proxies: Develop a new class of interactive tools that simulate the physical properties of remote objects, integrating sensory feedback—visual, auditory, and haptic—for synchronized interaction, addressing technological asymmetries.
3. Extend Interaction Paradigms: Explore unique affordances of multimodal proxies to unlock interaction possibilities beyond those in traditional co-located settings, for richer, more transformative collaboration.

MIRA’s contributions include a novel theoretical framework, cutting-edge multimodal technologies, and real-world evaluations.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) ERC-2025-COG

See all projects funded under this call

Host institution

AARHUS UNIVERSITET
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 1 999 797,00
Address
NORDRE RINGGADE 1
8000 Aarhus C
Denmark

See on map

Region
Danmark Midtjylland Østjylland
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

€ 1 999 797,00

Beneficiaries (1)

My booklet 0 0