Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Research on Embodied Perception and Intelligent Interaction Methods Driven by Multimodal Large Models

Project description

Embodied artificial intelligence: Integrating sensory input intelligently in robotics

Embodied intelligence refers to the ability of ‘agents’ to respond to cues from their ‘bodies’ and environments with intelligent behaviours. It has an important role to play in improving the cognitive capabilities of robots in diverse environments including the home, medical arena and industry compared to current pre-programming of specific behaviours. With the support of the Marie Skłodowska-Curie Actions programme, the Embodied Perception project aims to leverage multimodal models (relying on integration of multiple sensory modalities) supporting embodied intelligence. Specifically, accurate 3D visual orientation, enhanced perception, language understanding, intelligent reasoning and situational awareness will augment the interactive capabilities of robots in complex environments.

Objective

With the rapid development of artificial intelligence technology, embodied intelligence has shown tremendous potential in fields such as home robotics, medical robots, and industrial design. This research focuses on open-world embodied perception and intelligent interaction methods driven by multimodal large models, aiming to develop advanced models that achieve accurate 3D visual grounding and intelligent reasoning, thereby enhancing the perceptual and interactive capabilities of robots in complex environments. The study will explore how to utilize multimodal large models to process and integrate various sensory inputs, enabling robots to accurately perceive 3D environments, understand context, and make intelligent decisions. Additionally, this research will strive to improve robots' natural interaction capabilities with humans and the environment, including language understanding and situational adaptation. This research not only holds significant academic value and profound implications for advancing artificial intelligence and robotics technologies, but also provides innovative solutions to challenges in practical applications, contributing importantly to improving production efficiency, enhancing medical services, and elevating quality of life.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2024-PF-01

See all projects funded under this call

Coordinator

UNIVERSITY COLLEGE LONDON
Net EU contribution
€ 260 347,92
Address
GOWER STREET
WC1E 6BT London
United Kingdom
Region
London Inner London — West Camden and City of London
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data