Descrizione del progetto
Sinergia tra occhi, testa e corpo per il calcolo avanzato senza contatto
I progressi nel campo della tecnologia di tracciamento oculare sono sfociati in nuovi metodi interattivi per interfacce uomo-macchina altamente efficienti che usano il movimento oculare e il controllo visivo per comunicare all’istante l’obiettivo o l’intento. Tuttavia, tali approcci trascurano ancora i movimenti simultanei della testa e del corpo che accompagnano necessariamente i movimenti oculari coordinati in modo naturale. Il progetto GEMINI, finanziato dall’UE, colmerà quel divario creando una base rivoluzionaria, concettuale, scientifica e computazionale per il coordinamento tra occhi, testa e corpo e i movimenti oculari che stabilizzano e adattano la vista. Il progetto definirà l’attenzione visiva in 3D basandosi sui principi del movimento per ampliare lo sguardo occhi-testa con l’interazione prossemica e gestuale, aprendo a possibilità senza precedenti nel campo dell’interazione senza contatto tramite il calcolo ubiquo.
Obiettivo
"Gaze is a compelling modality for human-computer interaction (HCI). Where we look implicitly reflects our goals and information needs, and we are able to direct our gaze at will and speed across our environment, to efficiently communicate interest and express intent. However, in decades of research on gaze interfaces, the approach has been to consider eye movement in isolation and ignore concurrent movement of head and body. GEMINI will develop a fundamentally different approach, from the ground up recognising that visual attention and gaze control are performed in natural and necessary coordination of eyes, head and body.
The project goal is to establish a new conceptual, computational and scientific foundation for gaze and eye movement in interaction, grounded in understanding of eye-head-body coordination and eye movements that stabilise and adapt vision. GEMINI will pioneer motion-based principles for determining gaze attention in 3D, methods for inferring interaction context from synergetic eye, head, and body movement, and a multimodal framework for ""gaze in concert with the body"" in which eye-head gaze is extended with gestural and proxemic interaction for a breakthrough in usable touchless interaction with ubiquitous computing.
GEMINI will radically change how eye movement is approached for interaction, not as isolated and niche, but as central to interaction and dynamically coupled with other movement of the body. The project vision is that users will be able to interact fluidly in 3D with the physical-digital world around them, close-up and at-a-distance, using only their body for input, with eye, head, hand and body movements dynamically combined based on their natural coordination, context and complementarity. This has huge potential for impact on interactive systems where touch is not possible, practical, desirable or safe. If successful, ""gaze in concert with the body"" may well define the next major HCI paradigm."
Parole chiave
Programma(i)
Argomento(i)
Invito a presentare proposte
(si apre in una nuova finestra) ERC-2020-ADG
Vedi altri progetti per questo bandoMeccanismo di finanziamento
ERC-ADG - Advanced GrantIstituzione ospitante
LA1 4YW Lancaster
Regno Unito