Skip to main content

Gaze-based communication

Objective

Vision is the dominant perceptual channel through which we interact with information and communication systems, but one major limitation of our visual communication capabilities is that we can attend to only a very limited number of features and events at any one time. This fact has severe consequences for visual communication, because what is effectively communicated depends to a large degree on those mechanisms in the brain that deploy our attentional resources and determine where we direct our gaze.

We therefore propose that future ICT systems should use gaze guidance to help the users deploy their limited attentional resources more effectively. The same technology can be used to create augmented vision aids that improve human visual capabilities by complementing natural vision with computer-vision technology in an unobtrusive way.

Due to the complexity of the questions that we need to address, we here aim at a proof of concept, which still involves high risks due to the demanding real-time computing requirements, the necessary algorithmic complexity, and the incomplete knowledge of visual processing in the brain.

Our objectives are to (i) show that gaze guidance has a high impact on what is perceived and communicated effectively, (ii) advance the level of understanding of the human visual system to the point where gaze guidance becomes feasible, and (iii) build prototype systems that exploit these insights and demonstrate the potential for applications.

If these objectives can be reached, we believe the resulting technology will fundamentally change the way in which information can be communicated in the future information society.

Funding Scheme

STREP - Specific Targeted Research Project

Coordinator

UNIVERSITAET ZU LUEBECK
Address
Ratzeburger Allee 160
23538 Luebeck
Germany

Participants (5)

ACADEMISCH ZIEKENHUIS GRONINGEN
Netherlands
Address
Hanzeplein 1
30001 Groningen
JUSTUS LIEBIG UNIVERSITAET GIESSEN
Germany
Address
Ludwigestrasse 23
35390 Giessen
KATHOLIEKE UNIVERSITEIT LEUVEN
SENSOMOTORIC INSTRUMENTS GESELLSCHAFT FUER INNOVATIVE SENSORIK MBH
Germany
Address
Warthestrasse 21
14513 Teltow
UNIVERSITATEA POLITEHNICA DIN BUCURESTI
Romania
Address
Splaiul Independentei 313
060042 Bucuresti Sectorul 6