Multimodal haptic with touch devices

Project Information

MULTITOUCH

Grant agreement ID: 860114

DOI

10.3030/860114

Project closed

EC signature date 22 July 2019

Start date 1 March 2020

End date 29 February 2024

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 1 543 335,12

EU contribution

€ 1 543 335,12

Coordinated by

UNIVERSITE DE LILLE
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Other (7)

Participation to ESOF

participation to ESOF

Website and web-based newsletters

continues during the project

Workshop on multisensory integration

International symposium on multisensory integration

Handbook of good practices made available on open access

The D5.4 is made open access

ESRs meet their publication objectives

All ESRs are author or co-author of 4 conference papers and 2 peer-reviewed scientific papers

Summer school on multimodal integration

organization of a summer school on multimodal integration

ESR doctoral degrees awarded

Documents, reports (2)

Handbook of best practices for mixed tactile, visual, and auditory stimuli for enhancing the user experience of touch-based interaction

handbook of best practices for mixed tactile, visual, and auditory stimuli for enhancing the user experience of touch-based interaction

Framework for multimodal haptic in VR

Lead by UniGe

Websites, patent fillings, videos etc. (2)

advertise ESR vacancies
Mobile demonstration package

continue during the project

Publications

Conference proceedings (24)

The role of active touch: differential mechanism in blindness

Author(s): Casado-Palacios, Maria; Campus, Claudio; Tonelli, Alessia; Gori, Monica
Published in: Cognitive Neuroscience Society Annual Meeting, Issue 2, 2022
Publisher: Cognitive Neuroscience Society Annual Meeting

Does visual experience shape body schema ?

Author(s): Iqra, Shahzad; Valeria, Occelli; André, Mouraux; Olivier, Collignon
Published in: International Multisensory Research Forum (IMRF), Issue 1, 2022
Publisher: IMRF

Multisensory spatial processing of dynamic stimuli in sighted and in blind individuals

Author(s): Casado-Palacios, Maria; Campus, Claudio; Gori, Monica
Published in: XXII Congresso Nazionale Sezione di Psicologia Clinica e Dinamica, Issue 1, 2021
Publisher: XXII Congresso Nazionale Sezione di Psicologia Clinica e Dinamica

Electrophysiological responses of the movement-related tactile gating in blindness

Author(s): Casado-Palacios, Maria; Tonelli, Alessia; Campus, Claudio; Gori, Monica
Published in: European Conference on Visual Perception, Issue 1, 2023
Publisher: European Conference on Visual Perception

Measuring oddball responses to vibrotactile textures

Author(s): Esposito, Giulia; Nozaradan, Sylvie; Collignon, Olivier; Mouraux, André
Published in: EUROHAPTICS 2022,, Issue 1, 2022
Publisher: EUROHAPTICS

Aligned motion-direction information for touch and vision in the human brain

Author(s): Iqra Shahzad, undefined; Battal, Ceren; Cerpelloni, Filippo; Van Audenhaege, Alice; Mouraux, André; Collignon, Olivier
Published in: Belgian Society for Neuroscience (BSN), Issue 1, 2023
Publisher: Belgian Society for Neuroscience (BSN)

Auditory pitch modulates the localization of audiotactile stimuli during active touch

Author(s): Casado-Palacios, Maria; Esposito, Giulia; Tonelli, Alessia; Courtin, Arthur; Collignon, Olivier; Mouraux, Andre
Published in: International Multisensory Research Forum, Issue 1, 2023
Publisher: International Multisensory Research Forum

Psychophysical investigation of localization of audio-tactile stimuli in active touch

Author(s): Esposito, Giulia; Courtin, Arthur; Collignon, Olivier; Mouraux, Andre
Published in: International multisensory research forum (IMRF), Issue 1, 2023
Publisher: International multisensory research forum

Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile Device.

Author(s): Yosra Rekik, Adnane Guettaf, Milad Jamalzadeh, and Laurent Grisoni
Published in: Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI '24), 2024
Publisher: Association for Computing Machinery
DOI: 10.1145/3656650.3656651

Cross-modal interaction of stereoscopy, surface deformation and tactile feedback on the perception of texture roughness in an active touch condition

Author(s): Brahimaj, Detjon; Berthaut, Florent; Giraud, Frédéric; Semail, Betty
Published in: https://hal.science/hal-04014962, Issue 5, 2023
Publisher: IHM'23 - 34e Conférence Internationale Francophone sur l'Interaction Humain-Machine

Measuring the User Experience of Vibrotactile Feedback on the Finger, Wrist, and Forearm for Touch Input on Large Displays

Author(s): Mihail Terenti; Radu-Daniel Vatavu
Published in: CHI '22: CHI Conference on Human Factors in Computing Systems, Issue 1, 2022, Page(s) 1-7
Publisher: ACM
DOI: 10.1145/3491101.3519704

Hap2Gest: An Eyes-Free Interaction Concept with Smartphones Using Gestures and Haptic Feedback

Author(s): Milad Jamalzadeh; Yosra Rekik; Alexandru Dancu; Laurent Grisoni
Published in: 19th IFIP TC13 International Conference, Issue 2, 2023, ISBN 9783031422799
Publisher: 19th IFIP TC13 International Conference
DOI: 10.1007/978-3-031-42280-5_31

Effects of Moving Speed and Phone Location on Eyes-Free Gesture Input with Mobile Devices

Author(s): Milad Jamalzadeh; Yosra Rekik; Laurent Grisoni; Radu-Daniel Vatavu; Gualtiero Volpe; Alexandru Dancu
Published in: 19th IFIP TC13 International Conference, Issue 1, 2023, ISBN 9783031422799
Publisher: 19th IFIP TC13 International Conference
DOI: 10.1007/978-3-031-42280-5_30

Interaction intermodale de la stéréoscopie, de la déformation de surface et de la retour tactile sur la perception de la rugosité de la texture dans un état tactile actif

Author(s): Brahimaj, Detjon; Berthaut, Florent; Giraud, Frédéric; Semail, Betty
Published in: IHM'23, Issue 1, 2023
Publisher: 34e Conférence Internationale Francophone sur l'Interaction Humain-Machine AFIHM

Temporal detection threshold of audio-tactile delays under conditions of active touch with and without a visual cue

Author(s): Detjon Brahimaj; Giulia Esposito; Arthur Courtin; Frederic Giraud; Betty Semail; Olivier Collignon; Andre Mouraux
Published in: World Haptics Conference WHC 2023, Issue 9, 2023
Publisher: IEEE
DOI: 10.1109/whc56415.2023.10224451

Spatiotemporal detection threshold of audio-tactile delays under conditions of active touch with and without a visual clue

Author(s): Brahimaj, Detjon; Esposito, Giulia; Mouraux, Andre; Collignon, Olivier; Giraud, Frederic; Semail, Betty
Published in: Cognitive Neuroscience Society, 2022
Publisher: Cognitive Neuroscience Society

What Is the User Experience of Eyes-Free Touch Input with Vibrotactile Feedback Decoupled from the Touchscreen?

Author(s): Mihail Terenti, Maria Casado-Palacios, Monica Gori, and Radu-Daniel Vatavu
Published in: 2024
Publisher: Association for Computing Machinery
DOI: 10.1145/3613905.3650804

The Effect of Attention Saturating Task on Eyes-Free Gesture Production on Mobile Devices

Author(s): Milad Jamalzadeh; Yosra Rekik; Laurent Grisoni
Published in: ISS '23: Conference on Interactive Surfaces and Spaces, Issue 1, 2023
Publisher: ISS '23: Conference on Interactive Surfaces and Spaces
DOI: 10.1145/3626485.3626535

Effects of a non-informative auditory feedback over touch in the blindness

Author(s): Casado-Palacios, Maria; Tonelli, Alessia; Campus, Claudio; Gori, Monica
Published in: International Multisensory Research Forum, Issue 2, 2022
Publisher: International Multisensory Research Forum

EEG frequency-tagging suggests that fine-grained vibrotactile contrast is (partly) implemented in S1

Author(s): Esposito, Giulia; Nozaradan, Sylvie; Collignon, Olivier; Mouraux, Andre
Published in: Belgian Society for Neuroscience Meeting, Issue 1, 2023
Publisher: Belgian Society for Neuroscience Meeting

The Eclectic User Experience of Combined On-Screen and On-Wrist Vibrotactile Feedback in Touchscreen Input

Author(s): Mihail Terenti, Matthieu Rupin, Baptiste Reynal, Laurent Grisoni, Radu-Daniel Vatavu
Published in: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA '24), 2024
Publisher: Association for Computing Machinery
DOI: 10.1145/3613905.3650835

Enhancing Touch Circular Knob with Haptic Feedback when Performing Another Saturating Attention Primary Task

Author(s): Yosra Rekik, Adnane Guettaf, Matthieu Rupin, Milad Jamalzadeh, Laurent Grisoni
Published in: Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI '24), 2024
Publisher: Association for Computing Machinery
DOI: 10.1145/3656650.3656656

How Do HCI Researchers Describe Their Software Tools? Insights from a Synopsis Survey of Tools for Multimodal Interaction

Author(s): Mihail Terenti, Radu-Daniel Vatavu
Published in: Companion Publication of the 2021 International Conference on Multimodal Interaction (ICMI ’21 Companion), 2021
Publisher: ACM

Audio-Tactile dynamic multisensory integration in sighted and blind individuals

Author(s): Casado-Palacios, Maria; Campus, Claudio; Gori, Monica
Published in: International Conference on Spatial Cognition, Issue 1, 2021
Publisher: International Conference on Spatial Cognition

Peer reviewed articles (5)

Temporal Detection Threshold of Audio-Tactile Delays With Virtual Button

Author(s): Detjon Brahimaj; Mondher Ouari; Anis Kaci; Frédéric Giraud; Christophe Giraud-Audine; Betty Semail
Published in: ISSN: 1939-1412, Issue 2, 2023, Page(s) 1-6, ISSN 1939-1412
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/toh.2023.3268842

The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays

Author(s): Mihail Terenti; Cristian Pamparău; Radu-Daniel Vatavu
Published in: Virtual Reality, Issue 28, 2024, Page(s) 1--21, ISSN 1359-4338
Publisher: Springer London
DOI: 10.1007/s10055-024-00977-2

VIREO: Web-based Graphical Authoring of Vibrotactile Feedback for Interactions with Mobile and Wearable Devices

Author(s): Mihail Terenti; Radu-Daniel Vatavu
Published in: International Journal of Human-Computer Interaction, Issue 10447318, 2022, ISSN 1044-7318
Publisher: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10447318.2022.2109584

Wear + Touch: An Exploration of Wearables for Vibrotactile Feedback During Touchscreen Input

Author(s): Mihail Terenti, Radu Daniel Vatavu
Published in: International Journal of Human–Computer Interaction, 2024, ISSN 1044-7318
Publisher: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10447318.2024.2372145

Movement-related tactile gating in blindness

Author(s): Maria Casado-Palacios; Alessia Tonelli; Claudio Campus; Monica Gori
Published in: Scientific Reports, Issue 1, 2023, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-023-43526-8