Project description
Eye–head–body synergy for advanced touchless computing
Advances in eye-tracking technology have resulted in novel interactive methods for highly efficient human–computer interfaces that use eye movement and gaze control to immediately communicate focus or intent. However, such approaches still overlook the simultaneous head and body movements that necessarily accompany the naturally coordinated eye movements. The EU-funded GEMINI project will fill that gap by creating a groundbreaking, conceptual, computational and scientific basis for eye–head–body coordination and eye movements that stabilise and adapt vision. It will determine gaze attention in 3D based on motion-based principles to extend eye–head gaze with gestural and proxemic interaction, opening unprecedented possibilities in touchless interaction with ubiquitous computing.
Objective
"Gaze is a compelling modality for human-computer interaction (HCI). Where we look implicitly reflects our goals and information needs, and we are able to direct our gaze at will and speed across our environment, to efficiently communicate interest and express intent. However, in decades of research on gaze interfaces, the approach has been to consider eye movement in isolation and ignore concurrent movement of head and body. GEMINI will develop a fundamentally different approach, from the ground up recognising that visual attention and gaze control are performed in natural and necessary coordination of eyes, head and body.
The project goal is to establish a new conceptual, computational and scientific foundation for gaze and eye movement in interaction, grounded in understanding of eye-head-body coordination and eye movements that stabilise and adapt vision. GEMINI will pioneer motion-based principles for determining gaze attention in 3D, methods for inferring interaction context from synergetic eye, head, and body movement, and a multimodal framework for ""gaze in concert with the body"" in which eye-head gaze is extended with gestural and proxemic interaction for a breakthrough in usable touchless interaction with ubiquitous computing.
GEMINI will radically change how eye movement is approached for interaction, not as isolated and niche, but as central to interaction and dynamically coupled with other movement of the body. The project vision is that users will be able to interact fluidly in 3D with the physical-digital world around them, close-up and at-a-distance, using only their body for input, with eye, head, hand and body movements dynamically combined based on their natural coordination, context and complementarity. This has huge potential for impact on interactive systems where touch is not possible, practical, desirable or safe. If successful, ""gaze in concert with the body"" may well define the next major HCI paradigm."
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
H2020-EU.1.1. - EXCELLENT SCIENCE - European Research Council (ERC)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
ERC-ADG - Advanced Grant
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) ERC-2020-ADG
See all projects funded under this callHost institution
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
LA1 4YW LANCASTER
United Kingdom
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.