INnovative Network for Training in ToUch InteracTIVE Interfaces

Informazioni relative al progetto

INTUITIVE

ID dell’accordo di sovvenzione: 861166

DOI

10.3030/861166

Progetto chiuso

Data della firma CE 4 Settembre 2019

Data di avvio 1 Ottobre 2019

Data di completamento 31 Marzo 2024

Finanziato da

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Costo totale

€ 4 092 250,15

Contributo UE

€ 4 092 250,15

Coordinato da

LUNDS UNIVERSITET
Sweden

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Demonstrators, pilots, prototypes (1)

Sensors with memory

Demonstrator of the properties of the sensors based on memristive device

Documents, reports (25)

Third year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the third year of the project

Brain state estimation method

A method to combine information from 1000s of isolated neurons recorded electrophysiologically in the brain in vivo to achieve high-precision brain state estimation for brain interpretation of haptic input features

Predictive coding model of haptic sensing

Abstract model of haptic sensing integrating tactile and proprioceptive information. Predictive coding modelling of tactile sensing in rodents. Human-like computational model of haptic sensing for robots.

Third year progress report

Report on the progress for the first three years

Graphene based touch sensor and benchmarking

Fabrication of graphene based touch sensors

Taxonomy of image processing algorithms in the context of categorizing tactile graphics

Systematic analysis of ‘translating and simplifying visual to tactile graphics’ by a literature review

Design principles and basic version of the intuitive tactile user interface

Software prototype for the new user interface allowing interaction between the Tactonom and computer

Low-power sensory readout and electronic interface

Architectural study of timebased sensor readout in CMOS Circuit design and layout of a lowpower timebased sensor interface in CMOS

First year research schools, workshops, & tutorials

Report on the research schools workshops and tutorials organized the first year of the project

Human-like haptic exploration and manipulation

Comparison of robotic and human manipulation and haptic exploration

Multi-scale model of synthetic materials mimicking tactile sensing in skin

Validate in-silico model with experimental data. Use the in silico model for design and development of realistic tactile sensing skin

Principles of brain state influence on neural representation of haptic input features

Controlled manipulation of brain states via basal ganglia or corticocortical manipulation. Investigation of neural representation of haptic events across brain states

First prototype of tactile transducer for use in rodents developed

Analyse closedform electrothermal scaling laws for miniaturization Realise computer aideddesign based on the analysis and perform multiphysics simulation Implement physical miniaturized system

Haptic integration of proprioception and tactile information for robots

Implementation of predictive coding based haptic exploration with a robot hand. Complex haptic exploration (using Markov chain formalism) and manipulation.

Audio-Tactile Design Pattern Repository

Repository of designed patterns for combination of audio-output with tactile output

Classification of 2D refreshable tactile user interfaces

Literature review of the user interfaces and interaction

Integration on flexible substrates - survey and limitation of existing methods

Literature survey analysing the suitability of some of planar electronics integration methods for soft electronics. Stretchable interconnections and stiff sensor/electronics integration configuration.

softMEMS based stress and slip sensors

Design and fabrication cantilever based sensors on ultra-thin chips. Characterization of sensors for stress and slip. Embedding sensors in soft materials and connecting to electronics with transparent electrodes

Next generation sensory augmentation device

Integration of tactile stimulators in a sensory augmentation device. Design and test mapping of sensory information (orientation, distance to obstacles, dynamics of approach and recess) to degrees of freedom of sensory augmentation device (frequency domain, AM-modulation, selection of simultaneously active tactors (UOS). Usability study and validation of behavioural benefits

Embedded integration of sensors/electronics at various depths in soft substrates

Integration of sensors at various depths in soft substrates – towards 3D integration of sensor distribution.

First representation of haptic input features across a population of cortical neurons

Learning the multiple, parallel in vivo whole cell patch clamp recording technique in the neocortex of the rat. Exploring the representation of haptic input features in neocortical neurons. Tuning properties of neocortical neurons with respect to the haptic input features representation of haptic input features across a population of cortical neurons.

Learning classifier system for high-dimensional sensorimotor data

Characterization of neuromimetic sensorimotor processing. Identification of tactile interaction invariants. Implement learning classifier system for high-dimensional data

Design guidelines for representing audio-tactile graphics on a two-dimensional display

Employ deep learning to categorise certain types of graphics. Development of a prototype to translate visual to tactile information. Evaluate the system with blind users on a two-dimensional tactile display. Investigate the combination of audio-output with tactile output.

Second year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the second year of the project.

Report on molecular scale mechanism of mechanoreceptors in skin

Develop molecular scale model of mechanoreceptors of the skin. Incorporate biomimetic mechanoreceptor models in synthetic material to be used for artificial skin.

Other (3)

Advertising Vacancies

Standardized advertisement for ESR recruitment

Project Website; Welcome kit

Project website and a popularized version of the overall aims and research of INTUITIVE to be provided to ESRs at the start of their training.

Supervisory board

Supervisory board appointed

Open Research Data Pilot (1)

Data Management Plan

Guidlines for Open Data Management within the project

Pubblicazioni

Conference proceedings (11)

Sensitivity Analysis of ZnO NWs Based Soft Capacitive Pressure Sensors Using Finite Element Modeling

Autori: Shashank Mishra; Mahdieh Shojaei Baghini; Dhayalan Shakthivel; Beena Rai; Ravinder Dahiya
Pubblicato in: 2022
Editore: IEEE
DOI: 10.1109/fleps53764.2022.9781566

Accessible Document Layout: An Interface for 2D Tactile Displays

Autori: Omar Moured, Sara Alzalabny, Thorsten Schwarz, Bastian Rapp, Rainer Stiefelhagen
Pubblicato in: 2023
Editore: Association for Computing Machinery
DOI: 10.1145/3594806.3594811

End-to-End Optimization of High-Density e-Skin Design: From Spiking Taxel Readout to Texture Classification

Autori: Jiaqi Wang; Mark Daniel Alea; Jonah Van Assche; Georges G.E. Gielen
Pubblicato in: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2023, ISBN 979-8-3503-9624-9
Editore: IEEE
DOI: 10.23919/date56975.2023.10137077

Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces

Autori: Alexis Devillard; Aruna Ramasamy; Damien Faux; Vincent Hayward; Etienne Burdet
Pubblicato in: 2023, ISBN 979-8-3503-9994-3
Editore: IEEE
DOI: 10.1109/whc56415.2023.10224372

Power-Efficient and Accurate Texture Sensing Using Spiking Readouts for High-Density e-Skins

Autori: Mark Daniel Alea; Ali Safa; Jonah Van Assche; Georges G. E. Gielen
Pubblicato in: 2022 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2022, ISBN 9781665469173
Editore: IEEE
DOI: 10.1109/biocas54905.2022.9948546

Classification of 2d Refreshable Tactile User Interfaces

Autori: Ramôa, Gaspar
Pubblicato in: 2022, ISBN 9783950499780
Editore: Association ICCHP
DOI: 10.35011/icchp-aaate22-p1-24

Human Self-touch vs Other-Touch Resolved by Machine Learning

Autori: Aruna Ramasamy, Damien Faux, Vincent Hayward, Malika Auvray, Xavier Job & Louise Kirsch
Pubblicato in: Haptics: Science, Technology, Applications, 2022, ISBN 978-3-031-06248-3
Editore: Springer, Cham
DOI: 10.1007/978-3-031-06249-0_25

A Fingertip-Mimicking 12×16 200μm-Resolution e-skin Taxel Readout Chip with per-Taxel Spiking Readout and Embedded Receptive Field Processing

Autori: Mark Daniel Alea; Ali Safa; Flavio Giacomozzi; Andrea Adami; Inci Rüya Temel; Leandro Lorenzelli; Georges Gielen
Pubblicato in: 2023 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), 2023
Editore: IEEE
DOI: 10.23919/vlsitechnologyandcir57934.2023.10185346

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

Autori: Omar Moured , Morris Baumgarten-Egemole , Karin Müller , Alina Roitberg , Thorsten Schwarz , Rainer Stiefelhagen
Pubblicato in: 2024
Editore: Association for Computing Machinery
DOI: 10.1145/3640543.3645175

Push to Know! - Visuo-Tactile Based Active Object Parameter Inference with Dual Differentiable Filtering

Autori: Anirvan Dutta; Etienne Burdet; Mohsen Kaboli
Pubblicato in: 2023
Editore: IEEE
DOI: 10.1109/iros55552.2023.10341832

Line Graphics Digitization: A Step Towards Full Automation

Autori: Omar Moured, Jiaming Zhang, Alina Roitberg, Thorsten Schwarz, Rainer Stiefelhagen
Pubblicato in: 2023
Editore: Springer, Cham
DOI: 10.48550/arxiv.2307.02065

Peer reviewed articles (11)

Capacitive-triboelectric based hybrid sensor system for human-like tactile perception

Autori: Mishra, S. , Nair, N. M. , Khandelwal, G. , Rai, B. and Georgiev, V.
Pubblicato in: IEEE Sensors Letters, 2024, ISSN 2475-1472
Editore: IEEE
DOI: 10.1109/lsens.2024.3351692

Ultra-Thin Chips with ISFET Array for Continuous Monitoring of Body Fluids pH

Autori: Mahdieh Shojaei Baghini; Anastasios Vilouras; Ravinder Dahiya
Pubblicato in: IEEE Transactions on Biomedical Circuits and Systems, 2021, ISSN 1932-4545
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbcas.2022.3141553

Active visuo-tactile interactive robotic perception for accurate object pose estimation in dense clutter

Autori: Prajval Kumar Murali, Anirvan Dutta, Michael Gentner, Etienne Burdet, Ravinder Dahiya, Mohsen Kaboli
Pubblicato in: IEEE Robotics and Automation Letters, 2022, ISSN 2377-3766
Editore: IEEE
DOI: 10.1109/lra.2022.3150045

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Autori: Gaspar Ramôa, Vincent Schmidt and Peter König
Pubblicato in: Multimodal Technol. Interact., 2022, ISSN 2414-4088
Editore: MDPI
DOI: 10.3390/mti6120113

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input

Autori: Sofie S. Kristensen, Henrik Jörntell
Pubblicato in: Scientific Reports, 2024, ISSN 2045-2322
Editore: Nature Publishing Group
DOI: 10.1038/s41598-024-65200-3

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Autori: Vincent Schmidt, Sabine U. König, Rabia Dilawar, Tracy Sánchez Pacheco and Peter König
Pubblicato in: Brain Science, Numero 13, 720, 2023, ISSN 2076-3425
Editore: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/brainsci13050720

Bioinspired Distributed Energy in Robotics and Enabling Technologies

Autori: Rudra Mukherjee, Priyanka Ganguly, Ravinder Dahiya
Pubblicato in: Advanced Intelligent Systems, 2021, ISSN 2640-4567
Editore: Wiley
DOI: 10.1002/aisy.202100036

Differential encoding of temporally evolving color patterns across nearby V1 neurons

Autori: Sofie Skårup Kristensen; Henrik Jörntell
Pubblicato in: Front. Cell. Neurosci, 2023, ISSN 1662-5102
Editore: Frontiers Research Foundation
DOI: 10.3389/fncel.2023.1249522

Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning

Autori: Ali Safa; Jonah Van Assche; Mark Daniel Alea; Francky Catthoor; Georges G.E. Gielen
Pubblicato in: IEEE Micro, Numero 42; 6, 2022, Pagina/e 88-95, ISSN 0272-1732
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mm.2022.3195634

Ultra‐High Gauge Factor Strain Sensor with Wide‐Range Stretchability

Autori: Yogeenth Kumaresan, Shashank Mishra, Oliver Ozioko, Radu Chirila, Ravinder Dahiya
Pubblicato in: Advanced Intelligent Systems, 2022, ISSN 2640-4567
Editore: Wiley
DOI: 10.1002/aisy.202200043

Distributed Tactile Display with Dual Array Design

Autori: Yerkebulan Massalim; Damien Faux; Vincent Hayward
Pubblicato in: IEEE Transactions on Haptics, 2023, ISSN 2329-4051
Editore: IEEE
DOI: 10.1109/toh.2023.3254373

Other (2)

High-dimensional cortical signals reveal rich bimodal and working memory-like representations among S1 neuron populations

Autori: Sofie S. Kristensen, Kaan Kesgin, Henrik Jörntell
Pubblicato in: BioRxiv, 2024
Editore: Cold Spring Harbor Laboratory
DOI: 10.1101/2024.01.26.577171

Singular superlet transform achieves markedly improved time-frequency super-resolution for separating complex neural signals

Autori: Kaan Kesgin, Henrik Jörntell
Pubblicato in: BioRxiv, 2023
Editore: Cold Spring Harbor Laboratory
DOI: 10.1101/2023.02.27.530211