Objectif The visually impaired and the elderly, often suffering from mild speech and/or motor disabilities, are experiencing a significant and increasing barrier in accessing ICT technology and services. Yet, in order to be able to participate in a modern, interconnected society that relies on ICT technologies for handling everyday issues, there is clear need also for these user groups to have access to ICT, in particular to mobile platforms such as tablet computers or smart-phones. The proposed project aims at developing and exploiting the recently matured and quickly advancing biologically-inspired technology of event-driven, compressive sensing (EDC) of audio-visual information, to realize a new generation of low-power multi-modal human-computer interface for mobile devices. The project is based on two main technology pillars: (A) an air gesture control set, and (B) a vision-assisted speech recognition set. (A) exploits EDC vision for low and high level hand and finger gesture recognition and subsequent command execution; (B) combines temporal dynamics from lip and chin motion acquired using EDC vision sensors with the auditory sensor input to gain robustness and background noise immunity of spoken command recognition and speech-to-text input. In contrast to state-of-the-art technologies, both proposed human-computer communication channels will be designed to work reliably under uncontrolled conditions. Particularly, mobile devices equipped with the proposed interface technology will facilitate unrestricted outdoor use under uncontrolled lighting and background noise conditions. Furthermore, due to the sparse nature of information encoding, EDC excels conventional approaches in energy efficiency, yielding an ideal solution for mobile, battery-powered devices.ECOMODE is committed to pave the way for industrialization of commercial products by demonstrating the availability of the required hardware and software components and their integrability into a mobile platform. Champ scientifique engineering and technologymechanical engineeringvehicle engineeringautomotive engineeringautonomous vehiclesengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsignal processingcompressed sensingnatural sciencescomputer and information sciencesinternetinternet of thingsengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsoptical sensorsengineering and technologyelectrical engineering, electronic engineering, information engineeringinformation engineeringtelecommunicationsmobile phones Programme(s) H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT) Main Programme H2020-EU.2.1.1.4. - Content technologies and information management: ICT for digital content, cultural and creative industries Thème(s) ICT-22-2014 - Multimodal and Natural computer interaction Appel à propositions H2020-ICT-2014 Voir d’autres projets de cet appel Sous appel H2020-ICT-2014-1 Régime de financement RIA - Research and Innovation action Coordinateur SORBONNE UNIVERSITE Contribution nette de l'UE € 758 125,00 Adresse 21 RUE DE L'ECOLE DE MEDECINE 75006 Paris France Voir sur la carte Région Ile-de-France Ile-de-France Paris Type d’activité Higher or Secondary Education Establishments Liens Contacter l’organisation Opens in new window Site web Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 758 125,00 Participants (8) Trier par ordre alphabétique Trier par contribution nette de l'UE Tout développer Tout réduire FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA Italie Contribution nette de l'UE € 592 708,75 Adresse VIA MOREGO 30 16163 Genova Voir sur la carte Région Nord-Ovest Liguria Genova Type d’activité Research Organisations Liens Contacter l’organisation Opens in new window Site web Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 592 708,75 AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS Espagne Contribution nette de l'UE € 556 278,75 Adresse CALLE SERRANO 117 28006 Madrid Voir sur la carte Région Comunidad de Madrid Comunidad de Madrid Madrid Type d’activité Research Organisations Liens Contacter l’organisation Opens in new window Site web Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 556 278,75 Streetlab France Contribution nette de l'UE € 449 665,00 Adresse 17 rue Moreau 75012 Paris Voir sur la carte PME L’entreprise s’est définie comme une PME (petite et moyenne entreprise) au moment de la signature de la convention de subvention. Oui Région Ile-de-France Ile-de-France Val-de-Marne Type d’activité Private for-profit entities (excluding Higher or Secondary Education Establishments) Liens Contacter l’organisation Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 449 665,00 INNOVATI NETWORKS SL Participation terminée Espagne Contribution nette de l'UE € 232 506,30 Adresse CALLE ISABEL COLBRAND 10 OFICINA 113-114 28050 MADRID Voir sur la carte PME L’entreprise s’est définie comme une PME (petite et moyenne entreprise) au moment de la signature de la convention de subvention. Oui Région Comunidad de Madrid Comunidad de Madrid Madrid Type d’activité Private for-profit entities (excluding Higher or Secondary Education Establishments) Liens Contacter l’organisation Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 232 506,30 FONDAZIONE BRUNO KESSLER Italie Contribution nette de l'UE € 488 429,00 Adresse VIA SANTA CROCE 77 38122 Trento Voir sur la carte Région Nord-Est Provincia Autonoma di Trento Trento Type d’activité Research Organisations Liens Contacter l’organisation Opens in new window Site web Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 488 429,00 PROPHESEE France Contribution nette de l'UE € 286 250,00 Adresse 74 RUE DU FAUBOURG SAINT ANTOINE 75012 Paris Voir sur la carte Région Ile-de-France Ile-de-France Val-de-Marne Type d’activité Private for-profit entities (excluding Higher or Secondary Education Establishments) Liens Contacter l’organisation Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 286 250,00 FONDATION DE COOPERATION SCIENTIFIQUE VOIR ET ENTENDRE France Contribution nette de l'UE € 257 500,00 Adresse 17 RUE MOREAU 75012 Paris Voir sur la carte Région Ile-de-France Ile-de-France Val-de-Marne Type d’activité Research Organisations Liens Contacter l’organisation Opens in new window Site web Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 257 500,00 EXPERIS MANPOWERGROUP SL Espagne Contribution nette de l'UE € 176 743,70 Adresse AVENIDA DE BURGOS 18 28036 MADRID Voir sur la carte Région Comunidad de Madrid Comunidad de Madrid Madrid Type d’activité Private for-profit entities (excluding Higher or Secondary Education Establishments) Liens Contacter l’organisation Opens in new window Participation aux programmes de R&I de l'UE Opens in new window Réseau de collaboration HORIZON Opens in new window Coût total € 176 743,70