Project description
Natural interaction for smart wearables
Intelligent wearables (IWAs) such as smart glasses can assist users by interacting in a natural and adaptive manner. Supported by the Marie Skłodowska-Curie Actions-funded programme, the IMPACT-IWA project aims to develop interaction systems using implicit multimodal cues, including gaze and gesture, as well as adaptive interfaces based on users’ cognitive and emotional states. By combining human-computer interaction and augmented reality together with machine learning and AI, the project will test solutions in realistic settings. Among the expected outputs, the results would include not only a novel theory but also validated multimodal prototypes and a toolkit for developers of future IWAs. Ultimately, the project may be a significant step towards co-adaptive interaction with advanced AI-powered devices.
Objective
Augmented Reality (AR) smart glasses are rapidly moving from prototypes to mainstream personal assistants, with forecasts predicting 13.8 million devices in use by 2030. Their hands-free, semi-transparent displays allow digital content to blend seamlessly with the physical world. Coupled with Artificial Intelligence (AI) and Machine Learning (ML), they evolve into Intelligent Wearable Assistants (IWAs) that reduce errors, lower cognitive workload, and provide scalable expert-level support across everyday activities.
Yet today's IWAs are constrained by outdated interaction techniques. They rely mainly on speech-based dialogues adapted from desktop and mobile computing, neglecting natural modalities such as gaze and gesture. While some interfaces adapt to context, they rarely consider users’ cognitive or emotional states—limiting personalization and effectiveness.
This project, IMPACT-IWA (Implicit Multimodal Cues and Adaptive Feedback for InTelligent Wearable Assistants), will transform IWA interactions through three objectives:
1) harness implicit multimodal cues (e.g. gaze, gestures) for fluid interaction in dynamic contexts;
2) design adaptive user interfaces that respond in real time to cognitive and affective states;
3) validate these solutions through real-world mobile deployments.
Expected outcomes include a new theoretical framework, validated multimodal prototypes, and an open-source development toolkit to accelerate future IWA applications. These contributions will enable end-users to interact with AR systems in more natural, co-adaptive ways, while empowering researchers and developers with reusable methods and tools.
By integrating Human–Computer Interaction, AR, and AI/ML, IMPACT-IWA will establish the foundations for the next generation of intelligent, user-centered wearable computing—empowering people to seamlessly work, learn, play, and live without device interaction barriers.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
You need to log in or register to use this function
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2025-PF
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
78153 Le Chesnay Cedex
France
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.