Skip to main content

Levitation with localised tactile and audio feedback for mid-air interactions

Objective

"This project will be the first to create, prototype and evaluate a radically new human-computer interaction paradigm that
empowers the unadorned user to reach into levitating matter, see it, feel it, manipulate it and hear it. Our users can interact
with the system in a walk-up-and-use manner without any user instrumentation.

As we are moving away from keyboards and mice to touch and touchless interactions, ironically, the main limit is the lack of
any physicality and co-located feedback. In this project, we propose a highly novel vision of bringing the physical interface to
the user in mid-air. In our vision, the computer can control the existence, form, and appearance of complex levitating objects
composed of ""levitating atoms"". Users can reach into the levitating matter, feel it, manipulate it, and hear how they deform it
with all feedback originating from the levitating object's position in mid-air, as it would with objects in real life. This will
completely change how people use technology as it will be the first time that they can interact with technology in the same
way they would with real objects in their natural environment.

We will draw on our understanding of acoustics to implement all of the components in a radically new approach. In particular,
we will draw on ultrasound beam-forming and manipulation techniques to create acoustic forces that can levitate particles
and to provide directional audio cues. By using a phased array of ultrasound transducers, the team will create levitating
objects that can be individually controlled and at the same time create tactile feedback when the user manipulates these
levitating objects. We will then demonstrate that the levitating atoms can each become sound sources through the use of
parametric audio with our ultrasound array serving as the carrier of the audible sound. We will visually project onto the objects to create a rich multimodal display floating in space."

Call for proposal

H2020-FETOPEN-2016-2017

See other projects for this call

Sub call

H2020-FETOPEN-1-2016-2017

Coordinator

UNIVERSITY OF GLASGOW
Net EU contribution
€ 703 993,88
Address
University Avenue
G12 8QQ Glasgow
United Kingdom

See on map

Region
West Central Scotland Glasgow City
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00

Participants (6)

CHALMERS TEKNISKA HOGSKOLA AB
Sweden
Net EU contribution
€ 527 250,36
Address
-
412 96 Goteborg

See on map

Region
Södra Sverige Västsverige Västra Götalands län
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
AARHUS UNIVERSITET

Participation ended

Denmark
Net EU contribution
€ 83 213,73
Address
Nordre Ringgade 1
8000 Aarhus C

See on map

Region
Danmark Midtjylland Østjylland
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
THE UNIVERSITY OF SUSSEX

Participation ended

United Kingdom
Net EU contribution
€ 547 782,50
Address
Sussex House Falmer
BN1 9RH Brighton

See on map

Region
South East (England) Surrey, East and West Sussex Brighton and Hove
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
ULTRALEAP LIMITED
United Kingdom
Net EU contribution
€ 509 557,79
Address
West Wing 1 Glass Wharf
BS2 0EL Bristol

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
South West (England) Gloucestershire, Wiltshire and Bristol/Bath area Bristol, City of
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 0,00
UNIVERSITAT BAYREUTH
Germany
Net EU contribution
€ 513 244,59
Address
Universitatsstrasse 30
95447 Bayreuth

See on map

Region
Bayern Oberfranken Bayreuth, Kreisfreie Stadt
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
UNIVERSITY COLLEGE LONDON
United Kingdom
Net EU contribution
€ 114 827,15
Address
Gower Street
WC1E 6BT London

See on map

Region
London Inner London — West Camden and City of London
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00