Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Multimodal Interaction for Remote Physical Artefacts

Project description

Multimodal interaction with remote physical objects

The digital reproduction of the tactile, spatial, and multisensory properties of physical objects remains a challenge, with objects playing a vital role. The ERC-funded MIRA project aims to address this challenge by developing a theory of interaction with remote physical objects, which combines human-computer interaction, psychology, and materials science. The project will also develop multimodal proxies, which are tools for interacting with objects that simulate the visual, auditory, and tactile properties of the objects for the purpose of synchronised remote interaction. The goal is to develop the foundations for the design of systems for interacting with remote objects, as well as the multimodal proxies. It will also establish paradigms for interacting with objects that transcend the co-located experience.

Objective

Digitally replicating the tactile, spatial, and multisensory qualities critical for interacting with physical objects remains an unsolved complex problem. This is challenge is felt acutely in cases such as remote collaboration, which is central to modern work practices, offering flexibility and sustainability. Significant challenges arise when physical objects are integral to collaboration. MIRA answers the question:

How can we create a multimodal proxy for remote physical objects, effectively replicating and going beyond the experience of in-person interaction with the actual object?

MIRA proposes a new Theory of Interaction with Remote Physical Objects by combining research in Human-Computer Interaction, psychological theories, and innovative applications integrating materials science and Multimodal Interaction. Central to this is the creation of a new class of interactive tools, termed multimodal proxies. The effectiveness of these proxies will be tested by designing effective and engaging remote collaboration systems.

MIRA has three objectives:

1. Develop Foundational Principles: Establish a novel set of principles for designing systems supporting remote interaction with physical objects. This has never been done before and will draw on psychological theories and empirical data from large-scale interview and observation studies.
2. Create Multimodal Proxies: Develop a new class of interactive tools that simulate the physical properties of remote objects, integrating sensory feedback—visual, auditory, and haptic—for synchronized interaction, addressing technological asymmetries.
3. Extend Interaction Paradigms: Explore unique affordances of multimodal proxies to unlock interaction possibilities beyond those in traditional co-located settings, for richer, more transformative collaboration.

MIRA’s contributions include a novel theoretical framework, cutting-edge multimodal technologies, and real-world evaluations.

Fields of science (EuroSciVoc)

This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2025-COG

See all projects funded under this call

Host institution

AARHUS UNIVERSITET
Net EU contribution
€ 1 999 797,00
Address
NORDRE RINGGADE 1
8000 Aarhus C
Denmark
Region
Danmark Midtjylland Østjylland
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 999 797,00

Beneficiaries (1)