Levitation with localised tactile and audio feedback for mid-air interactions

Informations projet

Levitate

N° de convention de subvention: 737087

DOI

10.3030/737087

Projet clôturé

Date de signature de la CE 8 Decembre 2016

Date de début 1 Janvier 2017

Date de fin 31 Mars 2021

Financé au titre de

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Coût total

€ 2 999 870,00

Contribution de l’UE

€ 2 999 870,00

Coordonné par

UNIVERSITY OF GLASGOW
United Kingdom

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Demonstrators, pilots, prototypes (10)

Demonstrator v1 illustrating interaction techniques for atomic selection action
Demonstrator v3 presenting two applications combining all modalities
A working prototype of the transducer array with haptics + audio + visual

The software API concept will be taken from Python toolbox D12 requirements regarding functionality will be identified in WP3 and WP4

"Organization of demonstrators and workshops as part of outreach activities #1"

Organization of demonstrators and workshops as part of outreach activities

"Organization of demonstrators and workshops as part of outreach activities #3"

Organization of demonstrators and workshops as part of outreach activities 3

Demonstrator v2 illustrating interaction techniques for positioning, rotation, scaling and deformation
"Organization of demonstrators and workshops as part of outreach activities #4"
Prototype with levitation + haptics + visual

requirements for this identified in WP3 and WP4

"Organization of demonstrators and workshops as part of outreach activities #2"

Organization of demonstrators and workshops as part of outreach activities 2

Prototype with all modalities

API concept taken from D1.2; requirements identified in WP3 and WP4

Websites, patent fillings, videos etc. (1)

Website and logo. weekly social media tweets/updates

Outwardfacing and internal website weekly social media tweets

Open Research Data Pilot (1)

Data managment plan

plan on how we will manage data generated from the project

Documents, reports (5)

Report on multisensory integration, including ventriloquism and interaction techniques

Report on multisensory integration, including ventriloquism eddefct

Database of broadband radiation characteristics across multiple transducer types
Evaluation report on final demonstrators

Evaluation report on demonstrators

Catalogue of effective haptic experiences, together with guidelines on how to create them

Catalogue of effective haptic experiences together with guidelines on how to create them

Signal processing model for de-modulating non-linearity for a range of operating points

Other (2)

Python toolbox of sound field/beamformer design methods

This will support the full functionality and API of the realtime implementations in WP2

Python tool box - final version

Publications

Conference proceedings (29)

HaptiRead - Reading Braille as Mid-Air Haptic Information

Auteurs: Viktorija Paneva, Sofia Seinfeld, Michael Kraiczi, Jörg Müller
Publié dans: Proceedings of the 2020 ACM Designing Interactive Systems Conference, 2020, Page(s) 13-20, ISBN 9781450369749
Éditeur: ACM
DOI: 10.1145/3357236.3395515

Measurement-Based Modeling of Higher-Order Non-Linearities of the Parametric Loudspeaker

Auteurs: Carl Andersson, Jens Ahrens
Publié dans: 'Fortschritte der Akustik - DAGA 2019, Numéro 2019, 2019, Page(s) 330-333, ISBN 978-3-939296-14-0
Éditeur: DEGA

Levitation Simulator: Prototyping Ultrasonic Levitation Interfaces in Virtual Reality

Auteurs: Viktorija Paneva, Myroslav Bachynskyi, Jörg Müller
Publié dans: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Page(s) 1-12, ISBN 9781450367080
Éditeur: ACM
DOI: 10.1145/3313831.3376409

UltraPower: Powering Tangible & Wearable Devices with Focused Ultrasound

Auteurs: Rafael Morales González, Asier Marzo, Euan Freeman, William Frier, Orestis Georgiou
Publié dans: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2021, Page(s) 1-13, ISBN 9781450382137
Éditeur: ACM
DOI: 10.1145/3430524.3440620

Floating Widgets - Interaction with Acoustically-Levitated Widgets

Auteurs: Euan Freeman, Ross Anderson, Carl Andersson, Julie Williamson, Stephen Brewster
Publié dans: Proceedings of the Interactive Surfaces and Spaces on ZZZ - ISS '17, 2017, Page(s) 417-420, ISBN 9781-450346917
Éditeur: ACM Press
DOI: 10.1145/3132272.3132294

Levitate - interaction with floating particle displays

Auteurs: Julie R. Williamson, Euan Freeman, Stephen Brewster
Publié dans: Proceedings of the 6th ACM International Symposium on Pervasive Displays - PerDis '17, 2017, Page(s) 1-2, ISBN 9781-450350457
Éditeur: ACM Press
DOI: 10.1145/3078810.3084347

TastyFloats - A Contactless Food Delivery System

Auteurs: Chi Thanh Vi, Asier Marzo, Damien Ablart, Gianluca Memoli, Sriram Subramanian, Bruce Drinkwater, Marianna Obrist
Publié dans: Proceedings of the Interactive Surfaces and Spaces on ZZZ - ISS '17, 2017, Page(s) 161-170, ISBN 9781-450346917
Éditeur: ACM Press
DOI: 10.1145/3132272.3134123

Textured surfaces for ultrasound haptic displays

Auteurs: Euan Freeman, Ross Anderson, Julie Williamson, Graham Wilson, Stephen A. Brewster
Publié dans: Proceedings of the 19th ACM International Conference on Multimodal Interaction - ICMI 2017, 2017, Page(s) 491-492, ISBN 9781-450355438
Éditeur: ACM Press
DOI: 10.1145/3136755.3143020

Point-and-Shake - Selecting from Levitating Object Displays

Auteurs: Euan Freeman, Julie Williamson, Sriram Subramanian, Stephen Brewster
Publié dans: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Page(s) 1-10, ISBN 9781-450356206
Éditeur: ACM Press
DOI: 10.1145/3173574.3173592

Touchless Tactile Displays for Digital Signage - Mid-air Haptics meets Large Screens

Auteurs: Loic Corenthy, Sriram Subramanian, Marcello Giordano, Richard Hayden, Daniel Griffiths, Craig Jeffrey, Hannah Limerick, Orestis Georgiou, Tom Carter, Jörg Müller
Publié dans: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Page(s) 1-4, ISBN 9781450356213
Éditeur: ACM Press
DOI: 10.1145/3170427.3186533

A Method for Simultaneous Creation of an Acoustic Trap and a Quiet Zone

Auteurs: Carl Andersson, Jens Ahrens
Publié dans: 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM), 2018, Page(s) 622-626, ISBN 978-1-5386-4752-3
Éditeur: IEEE
DOI: 10.1109/sam.2018.8448949

Levitating Particle Displays with Interactive Voxels

Auteurs: Euan Freeman, Julie R. Williamson, Praxitelis Kourtelos, Stephen Brewster
Publié dans: Proceedings of the 7th ACM International Symposium on Pervasive Displays - PerDis '18, 2018, Page(s) 1-6, ISBN 9781-450357654
Éditeur: ACM Press
DOI: 10.1145/3205873.3205878

Pulsed schlieren imaging of ultrasonic haptics and levitation using phased arrays

Auteurs: Michele Iodice, William Frier, William Frier, James Wilcox, Ben Long, Orestis Georgiou
Publié dans: Proceedings of the ICSV 2018, Numéro 2018, 2018
Éditeur: Elsevier / SCOPUS

LeviCursor - Dexterous Interaction with a Levitating Object

Auteurs: Myroslav Bachynskyi, Viktorija Paneva, Jörg Müller
Publié dans: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces - ISS '18, 2018, Page(s) 253-262, ISBN 9781450356947
Éditeur: ACM Press
DOI: 10.1145/3279778.3279802

Touchless Haptic Feedback for VR Rhythm Games

Auteurs: Orestis Georgiou, Craig Jeffrey, Ziyuan Chen, Bao Xiao Tong, Shing Hei Chan, Boyin Yang, Adam Harwood, Tom Carter
Publié dans: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2018, Page(s) 553-554, ISBN 978-1-5386-3365-6
Éditeur: IEEE
DOI: 10.1109/vr.2018.8446619

Fibonacci Spiral Arranged Ultrasound Phased Array for Mid-Air Haptics

Auteurs: Adam Price, Benjamin Long
Publié dans: 2018 IEEE International Ultrasonics Symposium (IUS), 2018, Page(s) 1-4, ISBN 978-1-5386-3425-7
Éditeur: IEEE
DOI: 10.1109/ultsym.2018.8580072

SoundBender - Dynamic Acoustic Control Behind Obstacles

Auteurs: Mohd Adili Norasikin, Diego Martinez Plasencia, Spyros Polychronopoulos, Gianluca Memoli, Yutaka Tokuda, Sriram Subramanian
Publié dans: The 31st Annual ACM Symposium on User Interface Software and Technology - UIST '18, Numéro 2018, 2018, Page(s) 247-259, ISBN 9781-450359481
Éditeur: ACM Press
DOI: 10.1145/3242587.3242590

Acoustic Levitation from Superposition of Spherical Harmonics Expansions of Elementary Sources: Analysis of Dependency on Wavenumber and Order

Auteurs: Carl Andersson, Jens Ahrens
Publié dans: 2019 IEEE International Ultrasonics Symposium (IUS), Numéro 2019, 2019, Page(s) 920-923, ISBN 978-1-7281-4596-9
Éditeur: IEEE
DOI: 10.1109/ultsym.2019.8926167

Enhancing physical objects with actuated levitating particles

Auteurs: Euan Freeman, Asier Marzo, Praxitelis B. Kourtelos, Julie R. Williamson, Stephen Brewster
Publié dans: Proceedings of the 8th ACM International Symposium on Pervasive Displays, Numéro 2019, 2019, Page(s) 1-7, ISBN 9781-450367516
Éditeur: ACM
DOI: 10.1145/3321335.3324939

HaptiGlow: Helping Users Position their Hands for Better Mid-Air Gestures and Ultrasound Haptic Feedback

Auteurs: Euan Freeman, Dong-Bach Vo, Stephen Brewster
Publié dans: 2019 IEEE World Haptics Conference (WHC), Numéro 2019, 2019, Page(s) 289-294, ISBN 978-1-5386-9461-9
Éditeur: IEEE
DOI: 10.1109/whc.2019.8816092

Sampling Strategy for Ultrasonic Mid-Air Haptics

Auteurs: William Frier, Dario Pittera, Damien Ablart, Marianna Obrist, Sriram Subramanian
Publié dans: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, Numéro 2019, 2019, Page(s) 1-11, ISBN 9781-450359702
Éditeur: ACM Press
DOI: 10.1145/3290605.3300351

Three-in-one - Levitation, Parametric Audio, and Mid-Air Haptic Feedback

Auteurs: Gözel Shakeri, Euan Freeman, William Frier, Michele Iodice, Benjamin Long, Orestis Georgiou, Carl Andersson
Publié dans: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems - CHI EA '19, Numéro 2019, 2019, Page(s) 1-4, ISBN 9781450359719
Éditeur: ACM Press
DOI: 10.1145/3290607.3313264

User engagement for mid-air haptic interactions with digital signage

Auteurs: Hannah Limerick, Richard Hayden, David Beattie, Orestis Georgiou, Jörg Müller
Publié dans: Proceedings of the 8th ACM International Symposium on Pervasive Displays, Numéro 2019, 2019, Page(s) 1-7, ISBN 9781-450367516
Éditeur: ACM
DOI: 10.1145/3321335.3324944

Using Ultrasonic Mid-air Haptic Patterns in Multi-Modal User Experiences

Auteurs: Damien Ablart, William Frier, Hannah Limerick, Orestis Georgiou, Marianna Obrist
Publié dans: 2019 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), Numéro 2019, 2019, Page(s) 1-6, ISBN 978-1-7281-2355-4
Éditeur: IEEE
DOI: 10.1109/have.2019.8920969

LeviProps - Animating Levitated Optimized Fabric Structures using Holographic Acoustic Tweezers

Auteurs: Rafael Morales, Asier Marzo, Sriram Subramanian, Diego Martínez
Publié dans: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019, Page(s) 651-661, ISBN 9781-450368162
Éditeur: ACM
DOI: 10.1145/3332165.3347882

Avoiding Collisions when Interacting with Levitating Particle Displays

Auteurs: Maxime Reynal, Euan Freeman, Stephen Brewster
Publié dans: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Page(s) 1-7, ISBN 9781450368193
Éditeur: ACM
DOI: 10.1145/3334480.3382965

Minimum trap separation for acoustical levitation using phased ultrasonic transducer arrays

Auteurs: Carl Andersson, Jens Ahrens
Publié dans: Proceedings of ICA, Numéro 2019, 2019, Page(s) 1117-1123, ISBN 978-3-939296-15-7
Éditeur: DEGA
DOI: 10.18154/rwth-conv-239242

Levi-loop: A Mid-Air Gesture Controlled Levitating Particle Game

Auteurs: Rafael Morales González, Euan Freeman, Orestis Georgiou
Publié dans: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Page(s) 1-4, ISBN 9781450368193
Éditeur: ACM
DOI: 10.1145/3334480.3383152

Reducing Spiraling in Transducer Array Based Acoustic Levitation

Auteurs: Carl Andersson, Jens Ahrens
Publié dans: 2020 IEEE International Ultrasonics Symposium (IUS), 2020, Page(s) 1-4, ISBN 978-1-7281-5448-0
Éditeur: IEEE
DOI: 10.1109/ius46767.2020.9251489

Peer reviewed articles (6)

Impact of Information Placement and User Representations in VR on Performance and Embodiment

Auteurs: Sofia Seinfeld, Tiare Feuchtner, Johannes Pinzek, Jorg Muller
Publié dans: IEEE Transactions on Visualization and Computer Graphics, 2020, Page(s) 1-1, ISSN 1077-2626
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3021342

Acoustic levitation with optimized reflective metamaterials

Auteurs: Spyros Polychronopoulos, Gianluca Memoli
Publié dans: Scientific Reports, Numéro 10/1, 2020, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-020-60978-4

Impact of visuomotor feedback on the embodiment of virtual hands detached from the body

Auteurs: Sofia Seinfeld, Jörg Müller
Publié dans: Scientific Reports, Numéro 10/1, 2020, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-020-79255-5

User Representations in Human-Computer Interaction

Auteurs: Sofia Seinfeld, Tiare Feuchtner, Antonella Maselli, Jörg Müller
Publié dans: Human–Computer Interaction, Numéro 2020, 2020, Page(s) 1-39, ISSN 0737-0024
Éditeur: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/07370024.2020.1724790

A volumetric display for visual, tactile and audio presentation using acoustic trapping

Auteurs: Ryuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, Sriram Subramanian
Publié dans: Nature, Numéro 575/7782, 2019, Page(s) 320-323, ISSN 0028-0836
Éditeur: Nature Publishing Group
DOI: 10.1038/s41586-019-1739-5

GS-PAT

Auteurs: Diego Martinez Plasencia, Ryuji Hirayama, Roberto Montano-Murillo, Sriram Subramanian
Publié dans: ACM Transactions on Graphics, Numéro 39/4, 2020, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392492

Book chapters (1)

Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air

Auteurs: William Frier, Damien Ablart, Jamie Chilles, Benjamin Long, Marcello Giordano, Marianna Obrist, Sriram Subramanian
Publié dans: Haptics: Science, Technology, and Applications, Numéro 10893, 2018, Page(s) 270-281, ISBN 978-3-319-93444-0
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-93445-7_24