ECOMODEProject ID: 644096
Financé au titre de:
Event-Driven Compressive Vision for Multimodal Interaction with Mobile Devices
Détails concernant le projet
Coût total:EUR 3 798 206,50
Contribution de l'UE:EUR 3 798 206,50
Appel à propositions:H2020-ICT-2014-1See other projects for this call
Régime de financement:RIA - Research and Innovation action
The visually impaired and the elderly, often suffering from mild speech and/or motor disabilities, are experiencing a significant and increasing barrier in accessing ICT technology and services. Yet, in order to be able to participate in a modern, interconnected society that relies on ICT technologies for handling everyday issues, there is clear need also for these user groups to have access to ICT, in particular to mobile platforms such as tablet computers or smart-phones.
The proposed project aims at developing and exploiting the recently matured and quickly advancing biologically-inspired technology of event-driven, compressive sensing (EDC) of audio-visual information, to realize a new generation of low-power multi-modal human-computer interface for mobile devices.
The project is based on two main technology pillars: (A) an air gesture control set, and (B) a vision-assisted speech recognition set. (A) exploits EDC vision for low and high level hand and finger gesture recognition and subsequent command execution; (B) combines temporal dynamics from lip and chin motion acquired using EDC vision sensors with the auditory sensor input to gain robustness and background noise immunity of spoken command recognition and speech-to-text input.
In contrast to state-of-the-art technologies, both proposed human-computer communication channels will be designed to work reliably under uncontrolled conditions. Particularly, mobile devices equipped with the proposed interface technology will facilitate unrestricted outdoor use under uncontrolled lighting and background noise conditions. Furthermore, due to the sparse nature of information encoding, EDC excels conventional approaches in energy efficiency, yielding an ideal solution for mobile, battery-powered devices.
ECOMODE is committed to pave the way for industrialization of commercial products by demonstrating the availability of the required hardware and software components and their integrability into a mobile platform.
Contribution de l'UE: EUR 758 125
Place Jussieu 4
Contribution de l'UE: EUR 592 708,75
VIA MOREGO 30
Contribution de l'UE: EUR 556 278,75
CALLE SERRANO 117
Contribution de l'UE: EUR 449 665
17 rue Moreau
Contribution de l'UE: EUR 409 250
CALLE ISABEL COLBRAND 10 OFICINA 113-114
Contribution de l'UE: EUR 488 429
VIA SANTA CROCE 77
Contribution de l'UE: EUR 286 250
1 BIS ALLEE DU SAUZE
69160 TASSIN LA DEMI LUNE
Contribution de l'UE: EUR 257 500
rue de Charenton 28