Skip to main content

Gaze-based communication

Ziel

Vision is the dominant perceptual channel through which we interact with information and communication systems, but one major limitation of our visual communication capabilities is that we can attend to only a very limited number of features and events at any one time. This fact has severe consequences for visual communication, because what is effectively communicated depends to a large degree on those mechanisms in the brain that deploy our attentional resources and determine where we direct our gaze.

We therefore propose that future ICT systems should use gaze guidance to help the users deploy their limited attentional resources more effectively. The same technology can be used to create augmented vision aids that improve human visual capabilities by complementing natural vision with computer-vision technology in an unobtrusive way.

Due to the complexity of the questions that we need to address, we here aim at a proof of concept, which still involves high risks due to the demanding real-time computing requirements, the necessary algorithmic complexity, and the incomplete knowledge of visual processing in the brain.

Our objectives are to (i) show that gaze guidance has a high impact on what is perceived and communicated effectively, (ii) advance the level of understanding of the human visual system to the point where gaze guidance becomes feasible, and (iii) build prototype systems that exploit these insights and demonstrate the potential for applications.

If these objectives can be reached, we believe the resulting technology will fundamentally change the way in which information can be communicated in the future information society.

Finanzierungsplan

STREP - Specific Targeted Research Project

Koordinator

UNIVERSITAET ZU LUEBECK
Adresse
Ratzeburger Allee 160
23538 Luebeck
Deutschland

Beteiligte (5)

ACADEMISCH ZIEKENHUIS GRONINGEN
Niederlande
Adresse
Hanzeplein 1
30001 Groningen
JUSTUS LIEBIG UNIVERSITAET GIESSEN
Deutschland
Adresse
Ludwigestrasse 23
35390 Giessen
KATHOLIEKE UNIVERSITEIT LEUVEN
SENSOMOTORIC INSTRUMENTS GESELLSCHAFT FUER INNOVATIVE SENSORIK MBH
Deutschland
Adresse
Warthestrasse 21
14513 Teltow
UNIVERSITATEA POLITEHNICA DIN BUCURESTI
Rumänien
Adresse
Splaiul Independentei 313
060042 Bucuresti Sectorul 6