Description du projet
La réalité augmentée permet aux malvoyants de recouvrer la vue
Selon les estimations, il existe plus de 30 millions de personnes aveugles et malvoyantes en Europe. La déficience visuelle provoque des problèmes qui ne peuvent pas être corrigés par des moyens habituels tels que les lunettes. Elle réduit également la capacité d’une personne à répondre aux exigences professionnelles, sociales ou personnelles. Le projet TIRESIA, financé par l’UE, sera axé sur les enfants. Il développera une technologie innovante qui étend la vision résiduelle à l’aide de la réalité augmentée (RA). Ainsi, il stimulera la vision automatiquement, en fournissant des informations visuelles de soutien et pertinentes sur le plan social. Il mettra au point des filtres visuels spécialement conçus pour les lunettes de RA. L’objectif à long terme consiste à promouvoir l’inclusion sociale et à améliorer la qualité de vie des personnes malvoyantes.
Objectif
The goal of the TIRESIA project is to implement a novel visual assistive technology that augments the residual sight of visually impaired (VI) individuals, with focus on children, enhancing their access to socially relevant information from visual input. Such a technology is intended to provide: i) an assistive function, based on augmented reality (AR) to automatically increase the saliency of socially relevant visual information, and ii) a rehabilitative function, improving long-term VI subjects’ attention to social visual cues. The TIRESIA goal reflects the need for a timely intervention in the impairments of social and interactive skills associated with a visual deficit, especially in early life when such skills are developed and before atypical patterns emerge.
The project will be implemented throughout three main steps: 1) development of visual filters for social enrichment, exploiting end-to-end learning of visual transformations based on deep networks, 2) integration of the visual filters on AR glasses, and finally 3) validation of the approach at the neuroscientific level on a large sample of VI adults and children. These goals will be achieved thanks to the transfer of knowledge among the partner (MIT) and the host (IIT) institutions, involving advanced expertise in computer vison, neuroscience, visual rehabilitation, as well as solid scientific and clinical collaboration networks.
TIRESIA has a strong interdisciplinary nature and a high applicative potential. It is expected to have an impact: at the scientific level, by introducing an innovative approach to visual assistive technologies based on computer vision; at the individual level, in terms of enhanced career prospects of the experienced researcher; at the organisation level, starting a novel scientific collaboration among the partner and host institutions; and finally, at the societal level, contributing to promote inclusion and better quality of life for impaired individuals.
Champ scientifique
- natural sciencesbiological sciencesneurobiology
- medical and health sciencesclinical medicinephysiotherapy
- natural sciencescomputer and information sciencesartificial intelligencecomputer vision
- engineering and technologymaterials engineering
- natural sciencescomputer and information sciencessoftwaresoftware applicationssimulation software
Mots‑clés
Programme(s)
Régime de financement
MSCA-IF - Marie Skłodowska-Curie Individual Fellowships (IF)Coordinateur
16163 Genova
Italie