COnversational BRAins

Informacje na temat projektu

COBRA

Identyfikator umowy o grant: 859588

DOI

10.3030/859588

Projekt został zamknięty

Data podpisania przez KE 4 Września 2019

Data rozpoczęcia 1 Lutego 2020

Data zakończenia 31 Lipca 2024

Finansowanie w ramach

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Koszt całkowity

€ 4 009 380,29

Wkład UE

€ 4 009 380,29

Koordynowany przez

UNIVERSITE D'AIX MARSEILLE
France

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (8)

Student Industry Day

Student Industry Day (M46)

Public understanding event

Public understanding event M21

Second Summer School

Second Summer School E5 UBER + FUB (M34)

First Summer School

First Summer School E3 M21

Closing Event

Closing Event E7 Furhat + ReadSpeaker (M46)

First Winter School

First Winter School E2 M16

Third Winter School

Third Winter School E6 (M40)

Second Winter School

Second Winter School E4 (M28)

Publikacje

Conference proceedings (39)

Unsupervised Auditory and Semantic Entrainment Models with Deep Neural Networks

Autorzy: Jay Kejriwal, Štefan Beňuš, Lina M. Rojas-Barahona
Opublikowane w: INTERSPEECH 2023, Numer 2023, 2024, Strona(/y) 2628-2632
Wydawca: ISCA
DOI: 10.21437/interspeech.2023-1929

Speech Adaptation and Physiological Responses: A Study on f0 and Skin Temperature

Autorzy: Thomaz Offrede, Christine Mooshammer, Alessandro D'Ausilio, Susanne Fuchs
Opublikowane w: Speech Prosody, Numer 2024, 2024
Wydawca: Speech Prosody

Intonation Control for Neural Text-to-Speech Synthesis with Polynomial Models of F0

Autorzy: Niamh Corkey, Johannah O'Mahony, Simon King
Opublikowane w: Proc. INTERSPEECH 2023, Numer 2023, 2023, Strona(/y) 2014-2015
Wydawca: ISCA

Relationship between auditory and semantic entrainment using Deep Neural Networks (DNN)

Autorzy: Jay Kejriwal, Štefan Beňuš
Opublikowane w: INTERSPEECH 2023, Numer 2023, 2024, Strona(/y) 2623-2627
Wydawca: ISCA
DOI: 10.21437/interspeech.2023-1947

Speech Entrainment and Emotion

Autorzy: Jay Kejriwal, Štefan Beňuš
Opublikowane w: 2023 14th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Numer 2023, 2024, Strona(/y) 99-104
Wydawca: IEEE
DOI: 10.1109/coginfocom59411.2023.10397502

Investigating the Perception Production Link through Perceptual Adaptation and Phonetic Convergence.

Autorzy: Lena-Marie Huttner, Noel Nguyen, Martin J. Pickering
Opublikowane w: Proc INTERSPEECH 2023, Numer 2023, 2023, Strona(/y) 3103-3107
Wydawca: ISCA

A Hierarchical Predictive Processing Approach to Modelling Prosody

Autorzy: Juraj Šimko, Adaeze Adigwe, Antti Suni, Martti Vainio
Opublikowane w: Speech Prosody 2022, Numer 2022, 2024
Wydawca: ISCA
DOI: 10.21437/speechprosody.2022-86

Investigating the relationship between prosodic entrainment and interaction style

Autorzy: Joanna Kruyt, Lena-Marie Huttner, Johannah O'Mahony
Opublikowane w: Proceedings of the 20th International Congress of Phonetic Sciences, Numer 2023, 2023, Strona(/y) 3492-3496, ISBN 978-80-908114-2-3
Wydawca: GUARANT International spol. s r.o.

Hierarchical Intonation Modelling for Speech Synthesis using Legendre Polynomial Coefficients

Autorzy: Johannah O'Mahony, Niamh Corkey, Catherine Lai, Esther Klabbers, Simon King
Opublikowane w: Speech Prosody 2024, Numer 2024, 2024
Wydawca: ISCA
DOI: 10.21437/speechprosody.2024-208

Lexical entrainment on target words during task-oriented interaction in children with and without autism spectrum disorder

Autorzy: Kruyt, J., Polónyiová, K., Ostatníková, D., Beňuš, Š.
Opublikowane w: Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue, Numer August 2023, 2023, Strona(/y) 6-14
Wydawca: Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue

Language Proficiency and F0 Entrainment: A Study of L2 English Imitation in Italian, French, and Slovak Speakers

Autorzy: Zheng Yuan, Štefan Beňuš, Alessandro D'Ausilio
Opublikowane w: Speech Prosody, 2024
Wydawca: International Speech Communication Association

What does BERT learn about prosody?

Autorzy: Kakouros, Sofoklis; O'Mahony, Johannah
Opublikowane w: in R Skarnitzl & J Volín (eds) , Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS), Numer 19, 2023, Strona(/y) 1454-1458, ISBN 978-80-908114-2-4
Wydawca: GUARANT International spol. s r.o.
DOI: 10.48550/arxiv.2304.12706

Do Humans Converge Phonetically When Talking to a Robot?

Autorzy: Thomaz Offrede, Chinmaya Mishra, Gabriel Skantze, Susanne Fuchs, Christine Mooshammer
Opublikowane w: International Congress of Phonetic Sciences (ICPhS), Numer 2023, 2023, Strona(/y) 3507--3511, ISBN 978-80-908114-2-3
Wydawca: GUARANT International spol. s r.o.

Prosodic and lexical entrainment in adults with and without schizophrenia

Autorzy: Joanna Kruyt, Štefan Beňuš, Catherine Faget, Christophe Lançon, Maud Champagne-Lavau
Opublikowane w: Speech Prosody 2022, 2024, Strona(/y) 125-129
Wydawca: ISCA
DOI: 10.21437/speechprosody.2022-26

The ART of Conversation: Measuring Phonetic Convergence and Deliberate Imitation in L2-Speech with a Siamese RNN

Autorzy: Zheng Yuan, Aldo Pastore, Dorina de Jong, Hao Xu, Luciano Fadiga, Alessandro D'Ausilio
Opublikowane w: INTERSPEECH 2023, Numer August 2023, 2024, Strona(/y) 132--136
Wydawca: ISCA
DOI: 10.21437/interspeech.2023-2283

Annotation of Communicative Functions of Short Feedback Tokens in Switchboard

Autorzy: Figueroa, Carol; Adigwe, Adaeze; Ochs, Magalie; Skantze, Gabriel
Opublikowane w: Proceedings of the 13th Conference on Language Resources and Evaluation, Jun 2022, Marseille, France, Numer 10, 2022, Strona(/y) 1849–1859
Wydawca: Proceedings of the 13th Conference on Language Resources and Envaluation (LREC 2022)

Strategies for developing a Conversational Speech Dataset for Text-To-Speech Synthesis

Autorzy: Adaeze O. Adigwe, Esther Klabbers
Opublikowane w: Interspeech 2022, Numer 2022, 2024
Wydawca: ISCA
DOI: 10.21437/interspeech.2022-10802

Synthesis after a couple PINTs: Investigating the Role of Pause-Internal Phonetic Particles in Speech Synthesis and Perception

Autorzy: Mikey Elmers, Johannah O'Mahony, Éva Székely
Opublikowane w: INTERSPEECH 2023, Numer 2023, 2024, Strona(/y) 4843-4847
Wydawca: ISCA
DOI: 10.21437/interspeech.2023-2178

Stress detection using non-semantic speech representation

Autorzy: Jay Kejriwal, Stefan Benus, Marian Trnka
Opublikowane w: 2022 32nd International Conference Radioelektronika (RADIOELEKTRONIKA), Numer 2022, 2022, Strona(/y) 1-5
Wydawca: IEEE
DOI: 10.1109/radioelektronika54537.2022.9764916

The effects of prediction in conversational alignment

Autorzy: Kerr, E., Strijkers, K.
Opublikowane w: Proceedings of the 44th Annual Conference of the Cognitive Science Society, Numer Volume 44, 2022
Wydawca: Proceedings of the Annual Meeting of the Cognitive Science Society

Comparing acoustic and textual representations of previous linguistic context for improving Text-to-Speech

Autorzy: Pilar Oplustil-Gallegos, Johannah O'Mahony, Simon King
Opublikowane w: 11th ISCA Speech Synthesis Workshop (SSW 11), Numer 2021, 2024, Strona(/y) 205-210
Wydawca: ISCA
DOI: 10.21437/ssw.2021-36

Relationship between speech entrainment and emotion

Autorzy: Jay Kejriwal
Opublikowane w: 2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Numer 2022, 2024, Strona(/y) 1-4
Wydawca: IEEE
DOI: 10.1109/aciiw57231.2022.10086027

An analysis on the effects of speaker embedding choice in non auto-regressive TTS

Autorzy: Adriana Stan, Johannah O'Mahony
Opublikowane w: 12th ISCA Speech Synthesis Workshop (SSW2023), Numer 2023, 2024, Strona(/y) 134-138
Wydawca: ISCA
DOI: 10.21437/ssw.2023-21

The role of production in perceptual learning

Autorzy: Lena-Marie Huttner, Noel Nguyen, Martin J. Pickering
Opublikowane w: Proceedings of the 20th International Congress of Phonetic Sciences, Numer 2023, 2023, Strona(/y) 496-500
Wydawca: GUARANT International spol. s r.o.

Prosodic Alignment in Different Conversational Feedback Functions

Autorzy: Figueroa, Carol; Beňuš, Štefan; Skantze, Gabriel
Opublikowane w: 20th International Congress of Phonetic Sciences (ICPhS), Aug 2023, Prague, Czech Republic, Numer 1, 2023
Wydawca: 20th International Congress of Phonetic Sciences (ICPHS)

ART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation

Autorzy: Zheng Yuan, Dorina de Jong, Ruitao Feng, Štefan Beňuš, Noël Nguyen, Róbert Sabo, Luciano Fadiga, Alessandro D’Ausilio
Opublikowane w: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Numer May 2024, 2024, Strona(/y) 1548–1562
Wydawca: ELRA and ICCL

Breathing features and their impact on speech perception of COVID-19 patients

Autorzy: Xiaoming Jiang, Lixin Yu, Leinuo Dai, Jinyang Chen, Zheng Yuan
Opublikowane w: Speech Prosody, 2024
Wydawca: International Speech Communication Association

The effect of (non-)native language and task complexity on speech entrainment

Autorzy: Mareková, L., Kruyt, J., Beňuš, Š.
Opublikowane w: International Congress of Phonetic Sciences (ICPhS), 2022, Strona(/y) 1548-1552
Wydawca: GUARANT International spol. s r.o.

The ADAIO System at the BEA-2023 Shared Task: Shared Task Generating AI Teacher Responses in Educational Dialogues

Autorzy: Adaeze Adigwe, Zheng Yuan
Opublikowane w: Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023), Numer July 2023, 2023, Strona(/y) 796–804
Wydawca: Association for Computational Linguistics
DOI: 10.18653/v1/2023.bea-1.65

Classification of Feedback Functions in Spoken Dialog Using Large Language Models and Prosodic Features

Autorzy: Carol Figueroa, Magalie Ochs, Gabriel Skantze
Opublikowane w: Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue, Numer August, 16–17, 2023, 2023
Wydawca: Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue

Synthesising turn-taking cues using natural conversational data

Autorzy: Johannah O'Mahony, Catherine Lai, Simon King
Opublikowane w: 12th ISCA Speech Synthesis Workshop (SSW2023), Numer 2023, 2024, Strona(/y) 75-80
Wydawca: ISCA
DOI: 10.21437/ssw.2023-12

The Badalona Corpus An Audio, Video and Neuro-Physiological Conversational Dataset.

Autorzy: Blache P., Antoine S., de Jong D., Huttner L.-M., Kerr E., et al.
Opublikowane w: Proceedings of the Thirteenth Language Resources and Evaluation Conference, 2022, Strona(/y) 5170–5177
Wydawca: European Language Resources Association

The Slovak Autistic and Non-Autistic Child Speech Corpus: Task-Oriented Child-Adult Interactions

Autorzy: Kruyt, J., Polónyiová, K.,Sabo, R., Ostatníková, D., Beňuš, Š.
Opublikowane w: Proc LREC-COLING 2024, 2024, Strona(/y) 16094–16099
Wydawca: ELRA Language Resource Association

Factors Affecting the Evaluation of Synthetic Speech in Context

Autorzy: Johannah O'Mahony, Pilar Oplustil-Gallegos, Catherine Lai, Simon King
Opublikowane w: 11th ISCA Speech Synthesis Workshop (SSW 11), Numer 2021, 2024, Strona(/y) 148-153
Wydawca: ISCA
DOI: 10.21437/ssw.2021-26

Data-augmented cross-lingual synthesis in a teacher-student framework

Autorzy: Marcel de Korte, Jaebok Kim, Aki Kunikoshi, Adaeze Adigwe, Esther Klabbers
Opublikowane w: Proc. INTERSPEECH 2022, Numer 2022, 2022
Wydawca: ISCA

Combining conversational speech with read speech to improve prosody in Text-to-Speech synthesis

Autorzy: Johannah O'Mahony, Catherine Lai, Simon King
Opublikowane w: Interspeech 2022, Numer 2022, 2024, Strona(/y) 3388-3392
Wydawca: ISCA
DOI: 10.21437/interspeech.2022-10167

Global and local prosodic entrainment in a task-oriented interaction in autistic and neurotypical children

Autorzy: Kruyt, J., Polónyiová, K., Ostatníková, D., Beňuš, Š.
Opublikowane w: Proceedings of the First Workshop on Connecting Multiple Disciplines to AI Techniques in Interaction-centric Autism Research and Diagnosis (ICARD 2023), 2022, Strona(/y) 1-11
Wydawca: Association for Computational Linguistics

Knowing Where to Look: A Planning-based Architecture to Automate the Gaze Behavior of Social Robots

Autorzy: Chinmaya Mishra, Gabriel Skantze
Opublikowane w: 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Numer 29 August 2022 - 02 September 2022, 2022, Strona(/y) 1201-1208, ISSN 1944-9437
Wydawca: IEEE
DOI: 10.1109/ro-man53752.2022.9900740

Speech imitation skills predict automatic phonetic convergence: a GMM-UBM study on L2

Autorzy: Dorina de Jong, Aldo Pastore, Noël Nguyen, Alessandro D'Ausilio
Opublikowane w: Interspeech 2022, 2024
Wydawca: ISCA
DOI: 10.21437/interspeech.2022-10684

Peer reviewed articles (15)

Real-time emotion generation in human-robot dialogue using large language models

Autorzy: Chinmaya Mishra, Rinus Verdonschot, Peter Hagoort, Gabriel Skantze
Opublikowane w: Frontiers in Robotics and AI, Numer 10, 2023, ISSN 2296-9144
Wydawca: Frontiers
DOI: 10.3389/frobt.2023.1271610

Multi‐speaker experimental designs: Methodological considerations

Autorzy: Tom Offrede; Christine Mooshammer; Susanne Fuchs
Opublikowane w: Language and Linguistics Compass, Numer Monthly, 2021, Strona(/y) 1-24, ISSN 1749-818X
Wydawca: Blackwell
DOI: 10.1111/lnc3.12443

Brain signatures predict communicative function of speech production in interaction

Autorzy: Boux, I., Tomasello, R., Grisoni, L. and Pulvermüller, F.
Opublikowane w: Cortex, 2021, ISSN 0010-9452
Wydawca: Masson Publishing
DOI: 10.1016/j.cortex.2020.11.008

Prosodic entrainment in individuals with autism spectrum disorder

Autorzy: Joanna Kruyt, Štefan Beňuš
Opublikowane w: Topics in Linguistics, Numer volume 22, number 2, 2021, Strona(/y) 47-61, ISSN 2199-6504
Wydawca: Sciendo (De Gruyter Poland)
DOI: 10.2478/topling-2021-0010

Breathing and Speech Adaptation: Do Speakers Adapt Toward a Confederate Talking Under Physical Effort?

Autorzy: Tom Offrede, Christine Mooshammer, Susanne Fuchs
Opublikowane w: Journal of Speech, Language, and Hearing Research, Numer 2024, 2024, Strona(/y) 1-17, ISSN 1092-4388
Wydawca: American Speech-Language-Hearing Association
DOI: 10.1044/2023_jslhr-23-00113

Neologisms are epidemic: Modeling the life cycle of neologisms in China 2008-2016

Autorzy: Menghan Jiang, Xiang Ying Shen, Kathleen Ahrens, Chu-Ren Huang
Opublikowane w: PLOS ONE, Numer 16, 2021, Strona(/y) e0245984, ISSN 1932-6203
Wydawca: Public Library of Science
DOI: 10.1371/journal.pone.0245984

Listeners' convergence towards an artificial agent in a joint phoneme categorization task

Autorzy: Noël Nguyen, Leonardo Lancia, Lena Huttner, Jean-Luc Schwartz, Julien Diard
Opublikowane w: Glossa Psycholinguistics, Numer 3, 2024, ISSN 2767-0279
Wydawca: Glossa Psycholinguistics
DOI: 10.5070/g6011165

The Conversational Discourse Unit: Identification and Its Role in Conversational Turn-taking Management

Autorzy: Junfei Hu, Liesbeth Degand
Opublikowane w: Dialogue & Discourse, Numer 14 (2), 2023, ISSN 2152-9620
Wydawca: University of Illinois Libraries
DOI: 10.5210/dad.2023.203

Feedback quality and divided attention: exploring commentaries on alignment in task-oriented dialogue

Autorzy: Ludivine Crible, Greta Gandolfi, Martin J. Pickering
Opublikowane w: Language and Cognition, Numer 2024, 2024, Strona(/y) 1-29, ISSN 1866-9808
Wydawca: Cambridge University Press
DOI: 10.1017/langcog.2023.65

Measuring Prosodic Entrainment in Conversation: A Review and Comparison of Different Methods

Autorzy: Joanna Kruyt, Dorina de Jong, Alessandro D'Ausilio, Štefan Beňuš
Opublikowane w: Journal of Speech, Language, and Hearing Research, Numer 66, 2023, Strona(/y) 4280-4314, ISSN 1092-4388
Wydawca: American Speech-Language-Hearing Association
DOI: 10.1044/2023_jslhr-23-00094

Neurophysiological evidence for rapid processing of verbal and gestural information in understanding communicative actions

Autorzy: Tomasello, R., Kim, C., Dreyer, F. R., Grisoni, L. and Pulvermüller, F.
Opublikowane w: Scientific Reports, 2019, ISSN 2045-2322
Wydawca: Nature Publishing Group
DOI: 10.1038/s41598-019-52158-w

Ideography in interaction

Autorzy: Greta Gandolfi, Martin J. Pickering
Opublikowane w: Behavioral and Brain Sciences, Numer 46, 2023, Strona(/y) e243, ISSN 0140-525X
Wydawca: Cambridge University Press
DOI: 10.1017/s0140525x23000572

Does a robot’s gaze aversion affect human gaze aversion?

Autorzy: Chinmaya Mishra, Tom Offrede, Susanne Fuchs, Christine Mooshammer, Gabriel Skantze
Opublikowane w: Frontiers in Robotics and AI, Numer 10, 2023, ISSN 2296-9144
Wydawca: Frontiers
DOI: 10.3389/frobt.2023.1127626

Mechanisms of alignment: shared control, social cognition and metacognition

Autorzy: Greta Gandolfi, Martin J. Pickering, Simon Garrod
Opublikowane w: Philosophical Transactions of the Royal Society B: Biological Sciences, Numer 378, 2024, Strona(/y) 20210362, ISSN 0962-8436
Wydawca: Royal Society of London
DOI: 10.1098/rstb.2021.0362

Instantaneous Neural Processing of Communicative Functions Conveyed by Speech Prosody

Autorzy: Tomasello, R., Grisoni, L., Boux, I., Sammler, D. and Pulvermüller, F.
Opublikowane w: Cerebral Cortex, 2022, ISSN 1047-3211
Wydawca: Oxford University Press
DOI: 10.1093/cercor/bhab522

Other (1)

Predicting meaning in the dyad.

Autorzy: Emilia Kerr, Benjamin Morillon, Kristof Strijkers
Opublikowane w: Center for Open Science, 2024
Wydawca: Center for Open Science
DOI: 10.31234/osf.io/8cf2m

Book chapters (1)

Lexical Access in Speech Production

Autorzy: Emilia Kerr, Bissera Ivanova, Kristof Strijkers
Opublikowane w: Language Production, Numer 1st Edition, 2023, Strona(/y) 32-65, ISSN 9781-003145790
Wydawca: Routledge
DOI: 10.4324/9781003145790-3