European Commission logo
English English
CORDIS - EU research results

Natural Hands for Intuitive Virtual 3D Interaction

Project description

A new, hands-on take on digital interactions

Navigating virtual reality environments typically requires clunky controllers or awkward gestures. Haven’t you ever wished you could interact with digital content using your own hands? Unfortunately, current technology falls short in this regard. While human-computer interaction (HCI) and virtual reality (VR) have made great strides, the ability to naturally manipulate digital objects remains elusive. The European Research Council-funded CLAP project aims to link human hands with digital content, creating a seamless and intuitive user experience. Specifically, it will aid in the creation of a market-ready software solution that can be integrated with third-party application-development environments and hand-tracking hardware solutions. The proposed solution could play a key role in future developments in the HCI/VR industry.


Human-computer interaction (HCI) and Virtual reality (VR) are two fields that are succeeding to break from the research setting into the market. The CLAP project follows this trend and will introduce practical advances into both HCI and VR. In a nutshell, it will enable users to interact with digital content directly with their hands.

CLAP is sustained on recent research carried out in the ERC Starting Grant 'Animetrics', which enables interactive simulation of natural hands. Thanks to the results in Animetrics, it is possible to see a high-quality virtual copy of the user's own hands in a virtual world, naturally interact with digital content, and create new interaction possibilities.

The CLAP project will aid in the setup of a market-ready software solution, which can be embedded in third-party application-development environments (e.g. game development software), and coupled to hand-tracking hardware solutions. Developers will obtain in a seamless manner virtual hands which can be robustly coupled to other content.

Prior to this proposal, we have verified market interest on the proposed software solution. Major global players in the software field are working on HCI/VR projects, including hand tracking. But they all miss solutions for natural hand simulation which allows applications with digital objects are naturally and intuitively manipulated. Our proposed solution could play a key role in future developments. A major action in the project will be to determine the best business model (i.e. b2b or b2c), and plan further development steps accordingly.

Host institution

Net EU contribution
€ 149 701,00
28933 Mostoles

See on map

Comunidad de Madrid Comunidad de Madrid Madrid
Activity type
Higher or Secondary Education Establishments
Total cost
€ 149 701,00

Beneficiaries (1)