Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Improving social competences of virtual agents through artificial consciousness based on the Attention Schema Theory

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Publications

PoE: A Panel of Experts for Generalized Automatic Dialogue Assessment (opens in new window)

Author(s): Chen Zhang; Luis Fernando D'Haro; Qiquan Zhang; Thomas Friedrichs; Haizhou Li
Published in: IEEE/ACM Transactions on Audio, Speech, and Language Processing, Issue 31, 2023, ISSN 2329-9304
Publisher: IEEE
DOI: 10.48550/arXiv.2212.08992

Sign Language Dataset for Automatic Motion Generation (opens in new window)

Author(s): Villa Monedero, María, Gil Martín, Manuel , Sáez Trigueros, Daniel, Pomirski, Andrzej and San Segundo Hernández, Rubén
Published in: Journal of Imaging, Issue 9 (12), 2023, ISSN 2313-433X
Publisher: MDPI
DOI: 10.3390/JIMAGING9120262

Evaluating emotional and subjective responses in synthetic art-related dialogues: A multi-stage framework with large language models.  (opens in new window)

Author(s): Luna-Jiménez, C., Gil-Martín, M., D’Haro, L. F., Fernández-Martínez, F., & San-Segundo, R.
Published in: Expert Systems with Applications, Issue 255, 124524, 2024, ISSN 1873-6793
Publisher: ELSEVIER
DOI: 10.1016/J.ESWA.2024.124524

Automatic Detection of Inconsistencies and Hierarchical Topic Classification for Open-Domain Chatbots (opens in new window)

Author(s): Mario Rodríguez-Cantelar, Marcos Estecha-Garitagoitia, Luis Fernando D’Haro,Fernando Matía, Ricardo Córdoba
Published in: Applied Sciences, Issue 13 (16), 2023, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/APP13169055

Overview of the Ninth Dialog System Technology Challenge: DSTC9 (opens in new window)

Author(s): Gunasekara, C., Kim, S., D'haro, L.F., Rastogi, A., Chen, Y.N., Eric, M., Hedayatnia, B., Gopalakrishnan, K., Liu, Y., Huang, C.W. and Hakkani-Tür, D.,
Published in: IEEE/ACM Transactions on Audio, Speech, and Language Processing, Issue 32, 4066 - 4076, 2024, ISSN 2329-9304
Publisher: IEEE
DOI: 10.1109/TASLP.2024.3426331

Sign Language Motion Generation from Sign Characteristic (opens in new window)

Author(s): Gil Martín, Manuel , Villa Monedero, María, Pomirski, Andrzej, Sáez Trigueros, Daniel and San Segundo Hernández, Rubén
Published in: Sensors, Issue 23, 2023, ISSN 1424-8220
Publisher: MDPI
DOI: 10.3390/S23239365

Dual Leap Motion Controller 2: A Robust Dataset for Multi-view Hand Pose Recognition (opens in new window)

Author(s): Manuel Gil-Martín, Marco Raoul Marini, Rubén San-Segundo, Luigi Cinque
Published in: Scientific Data, Issue 11, 2024, ISSN 2052-4463
Publisher: Springer Science and Business Media LLC
DOI: 10.1038/S41597-024-03968-9

A dataset of synthetic art dialogues with ChatGPT (opens in new window)

Author(s): Gil-Martín, M., Luna-Jiménez, C., Esteban-Romero, S., Estecha-Garitagoitia, M., Fernández-Martínez, F., & D’Haro, L. F.
Published in: Scientific Data2052-4463, Issue 11(1),825, 2024, ISSN 2052-4463
Publisher: Nature Portfolio
DOI: 10.1038/S41597-024-03661-X

Testing Theory of Mind in GPT Models and Humans (opens in new window)

Author(s): James Strachan, Dalila Albergo, Giulia Borghini, Oriana Pansardi, Eugenio Scaliti, Alessandro Rufo, Guido Manzi, Michael Graziano, Cristina Becchio
Published in: Research Square, 2023, ISSN 2693-5015
Publisher: Research Square
DOI: 10.21203/rs.3.rs-3262385/v1

xDial-Eval: A Multilingual Open-Domain Dialogue Evaluation Benchmark (opens in new window)

Author(s): Chen Zhang, Luis D’Haro, Chengguang Tang, Ke Shi, Guohua Tang, Haizhou Li
Published in: Findings of the Association for Computational Linguistics: EMNLP 2023, Issue 5579–5601, 2023
Publisher: Association for Computational Linguistics
DOI: 10.18653/V1/2023.FINDINGS-EMNLP.371

"Awareness in robotics: An early perspective from the viewpoint of the EIC Pathfinder Challenge"" Awareness Inside''" (opens in new window)

Author(s): Cosimo Della Santina, Carlos Hernandez Corbato, Burak Sisman, Luis A. Leiva, Ioannis Arapakis, Michalis Vakalellis, Jean Vanderdonckt, Luis Fernando D’Haro, Guido Manzi, Cristina Becchio, A ̈ıda Elamrani, Mohsen Alirezaei, Ginevra Castellano, Dimos V. Dim
Published in: European Robotics Forum, 2024
Publisher: European Robotics Forum
DOI: 10.48550/ARXIV.2402.09030

STEPI: System for Triplet Extraction of Personal Information in Dialogue Systems

Author(s): Villa Monedero, M., Bellver, J., Ghebriout, M. I. E., De Cordoba, R., & D'Haro, L. F.
Published in: Iberspeech2024, 2024
Publisher: ISCA

Multilingual Speech Emotion Recognition combining Audio and Text using Small Language Models (opens in new window)

Author(s): Jaime Bellver, Mario Rodríguez Cantelar, Marcos Estecha Garitagoitia, Ricardo De Córdoba Herralde, Luis Fernando D'Haro
Published in: Iberspeech2024, 2024
Publisher: ISCA
DOI: 10.21437/IberSPEECH.2024-43

LLM-Driven Multimodal Fusion for Human Perception Analysis (opens in new window)

Author(s): Esteban-Romero, S., Martín-Fernández, I., Gil-Martín, M., Griol-Barres, D., Callejas-Carrión, Z., & Fernández-Martínez, F
Published in: MuSe'24: Proceedings of the 5th on Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Hum, 2024
Publisher: ACM
DOI: 10.1145/3689062.36890

A comprehensive analysis of the effectiveness of large language models as automatic dialogue evaluators (opens in new window)

Author(s): Zhang, Chen, Luis Fernando D'Haro, Yiming Chen, Malu Zhang, and Haizhou Li.
Published in: AAAI Conference on Artificial Intelligence, Issue vol. 38, no. 17, pp. 19515-19524., 2024, ISSN 2374-3468
Publisher: Advancement of Artifcial Intelligence
DOI: 10.48550/arXiv.2312.15407

Improving Hand Pose Recognition using Localization and Zoom Normalizations over MediaPipe Landmarks (opens in new window)

Author(s): Remiro Pérez, Miguel Ángel, Gil Martín, Manuel and San Segundo Hernández, Rubén
Published in: 10th International Electronic Conference on Sensors and Applications session Sensors and Artificial Intelligence, 2023, ISSN 2673-4591
Publisher: MDPI
DOI: 10.3390/ECSA-10-16215

THAU-UPM at EmoSPeech-IberLEF2024: Efficient Adaptation of Mono-modal and Multi-modal Large Language Models for Automatic Speech Emotion Recognition

Author(s): Esteban-Romero, S., Bellver-Soler, J., Martın-Fernández, I., Gil-Martın, M., D’Haro, L. F., & Fernández-Martınez, F.
Published in: Iberian Languages Evaluation Forum (IberLEF 2024) at SEPLN2024, 2024, ISSN 1613-0073
Publisher: SEPLN

CVQA - Culturally-diverse Multilingual Visual Question Answering Benchmark

Author(s): David Romero*👁️, Chenyang Lyu*👁️, Haryo Akbarianto Wibowo👁️, Teresa Lynn, Injy Hamed, Aditya Nanda Kishore, Aishik Mandal, Alina Dragonetti, Artem Abzaliev, Atnafu Lambebo Tonja, Bontu Fufa Balcha, Chenxi Whitehouse, Christian Salamea, Dan John Velasco
Published in: NeurIPs, 2024
Publisher: NeurIPs

Beyond single-audio: Advancing multi-audio processing in audio large language models

Author(s): Chen, Y., Yue, X., Gao, X., Zhang, C., D'Haro, L. F., Tan, R. T., & Li, H.
Published in: EMNLP2024, 2024
Publisher: Association for Computational Linguistics

Video Memorability Prediction From Jointly-learnt Semantic and Visual Features

Author(s): Martín-Fernández, Iván, Ricardo Kleinlein, Cristina Luna-Jiménez, Manuel Gil-Martín, and Fernando Fernández-Martínez
Published in: 20th International Conference on Content-based Multimedia Indexing, Orleans, France, 2023, ISBN 979-8-4007-0912-8
Publisher: ACM

Interpreting Sign Language Recognition using Transformers and MediaPipe Landmarks (opens in new window)

Author(s): Cristina Luna-Jiménez, Manuel Gil-Martín, Ricardo Kleinlein, Rubén San-Segundo, Fernando Fernández-Martínez
Published in: 25th ACM International Conference on Multimodal Interaction, 2023, ISBN 979-8-4007-0055-2
Publisher: Association for Machinery Computational
DOI: 10.1145/3577190.3614143

Overview of Robust and Multilingual Automatic Evaluation Metricsfor Open-Domain Dialogue Systems at DSTC 11 Track 4

Author(s): Mario Rodríguez-Cantelar, Chen Zhang, Chengguang Tang, Ke Shi, Sarik Ghazarian, João Sedoc, Luis Fernando D’Haro, Alexander I. Rudnicky
Published in: Proceedings of The Eleventh Dialog System Technology Challenge, 2023
Publisher: Association for Computational Linguistics

Larger Encoders, Smaller Regressors: Exploring Label Dimensionality Reduction and Multimodal Large Language Models as Feature Extractors for Predicting Social Perception. (opens in new window)

Author(s): Martín-Fernández, I., Esteban-Romero, S., Bellver-Soler, J., Fernández-Martínez, F., & Gil-Martín, M.
Published in: Martín-Fernández, I., Esteban-Romero, S., Bellver-Soler, J., Fernández-Martínez, F., & Gil-Martín, M., 2024
Publisher: ACM
DOI: 10.1145/3689062.368908

A Comprehensive Analysis of Parkinson’s Disease Detection Through Inertial Signal Processing (opens in new window)

Author(s): Gil Martín, Manuel; Esteban Romero, Sergio; Fernández Martínez, Fernando; San Segundo Hernández, Rubén
Published in: reponame:Archivo Digital UPM, 2024
Publisher: ICAART2024
DOI: 10.5220/0012360100003636

Parkinson’s Disease Detection Through Inertial Signals and Posture Insights (opens in new window)

Author(s): Gil Martín, Manuel; Esteban Romero, Sergio; Fernández Martínez, Fernando; San Segundo Hernández, Rubén
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence | 16th International Conference on Agents and Artificial Intelligence - ICAART24 | 24/02/2024 | Rome, Italy, 2024
Publisher: ICAART
DOI: 10.5220/0012451100003636

Multimodal Audio-Language Model for Speech Emotion Recognition (opens in new window)

Author(s): Bellver, J., Martín-Fernández, I., Bravo-Pacheco, J. M., Esteban, S., Fernández-Martínez, F., & D'Haro, L. F.
Published in: odyssey 2024 , 2024
Publisher: ISCA
DOI: 10.21437/ODYSSEY.2024-41

Attention Schema in Neural Agents (opens in new window)

Author(s): Liu, Dianbo; Bolotta, Samuele; Zhu, He; Bengio, Yoshua; Dumas, Guillaume
Published in: ArXiv, 2023
Publisher: Cornell University
DOI: 10.48550/arxiv.2305.17375

Searching for OpenAIRE data...

There was an error trying to search data from OpenAIRE

No results available

My booklet 0 0