Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Divergence and convergence in dialogue: The dynamic management of mismatches

Project description

Exploring computer-mediated human interaction

As more and more of our interactions take place through digital channels, it has become increasingly important to understand how we communicate and interact with others via computers and digital devices. In this context, the DivCon project, funded by the European Research Council, aims to transform our understanding of human interaction, particularly in computer-mediated communication. It will create a novel experimental platform for live multimodal interactions using avatars and virtual reality and develop a precise theory of divergence and convergence in interaction that unifies verbal and non-verbal dialogue phenomena. Ultimately, the project’s findings will pave the way for more adaptive conversational AI systems that can better simulate human-like communication.

Objective

Human interaction is deceptively simple to engage in, yet surprisingly challenging to account for theoretically. Existing theories of language and cognition cannot fully account for the complex dynamics of verbal and non-verbal behaviours in interaction, which is becoming even more apparent with our increasing use of computer-mediated communication, such as the currently ubiquitous Zoom calls.

With DivCon, my vision is to transform our basic understanding of human interaction by showing how successful dialogue is driven by incremental, local and dynamic processes of mismatch management.In our everyday interactions, we continuously make predictions about what will happen next, based on how our own and others behaviour affects the world, to open up new possible courses of action. In dialogue, these predictions are about sounds, words, inferences and even non-speech actions such as gestures or eye gaze. If our expectations are not met, we have to ascertain if the mismatching input can be resolved, or integrated as a surprising but rewarding outcome (as in the case of humour).

DivCon will produce a suite of corpus and experimental data for exploring the timely issues of communication via different forms of computer-mediated communication, including text-based chats, video calls and virtual reality meetings. To do this, the project will create a novel experimental platform for experiments in real time live multimodal interactions using avatars and virtual reality. The formal arm of the project will develop a precise theory of divergence and convergence in interaction which unifies verbal and non-verbal dialogue phenomena including gesture, gaze, feedback and laughter, using core notions of prediction and underspecification. This model will be implementable in conversational AI an important step in the path to genuinely adaptive conversational AI systems, which are still beyond the reach of researchers despite the promise of recent decades.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2022-STG

See all projects funded under this call

Host institution

GOETEBORGS UNIVERSITET
Net EU contribution
€ 1 499 543,00
Address
VASAPARKEN
405 30 Goeteborg
Sweden
Region
Södra Sverige Västsverige Västra Götalands län
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 499 543,00

Beneficiaries (1)