Mental health monitoring through interactive conversations

Project Information

MENHIR

Grant agreement ID: 823907

DOI 10.3030/823907

Project closed

EC signature date 4 October 2018

Start date 1 February 2019

End date 31 January 2024

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost € 749 800,00

EU contribution € 749 800,00

Coordinated by

UNIVERSIDAD DE GRANADA
Spain

Deliverables

Websites, patent fillings, videos etc. (1)

Web page

A website will be generated for internal communication (private area for archiving and sharing materials) and also for the engagement of general public (with access to public materials).

Documents, reports (2)

Report on conversation model following the user experience design and requirements

This deliverable will describe the results achieved in tasks 4.1 and 4.2. The report will include the strategies employed for adapting the system conversational model to the user and build user-system trust. Such strategies will be the basis for the dialog manager of the conversational system that will be developed in task 4.3.

Report on user model including mood and anxiety level

This deliverable is the result of task 3.4, it describes the design of the user model and the methods used to update it dynamically both during conversation and offline. This model will be used as a basis to develop the dialogue manager in task 4.3.

Publications

Book chapters (13)

Conversational Agents for Mental Health and Wellbeing

Author(s): Zoraida Callejas, David Griol
Published in: Dialog Systems - A Perspective from Language, Logic and Computation, Issue 22, 2021, Page(s) 219-244, ISBN 978-3-030-61437-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-61438-6_11

Towards Socially and Emotionally Believable ICT Interfaces

Author(s): Anna Esposito, Marcos Faundez-Zanuy, Francesco Carlo Morabito, Eros Pasero
Published in: Progresses in Artificial Intelligence and Neural Systems, Issue 184, 2021, Page(s) 3-7, ISBN 978-981-15-5092-8
Publisher: Springer Singapore
DOI: 10.1007/978-981-15-5093-5_1

Facial Emotion Recognition Skills and Measures in Children and Adolescents with Attention Deficit Hyperactivity Disorder (ADHD)

Author(s): Aliki Economides, Yiannis Laouris, Massimiliano Conson, Anna Esposito
Published in: Progresses in Artificial Intelligence and Neural Systems, Issue 184, 2021, Page(s) 435-475, ISBN 978-981-15-5092-8
Publisher: Springer Singapore
DOI: 10.1007/978-981-15-5093-5_39

Introduction to Big Data and Data Science: Methods and Applications

Author(s): Gloria Phillips-Wren, Anna Esposito, Lakhmi C. Jain
Published in: Advances in Data Science: Methodologies and Applications, Issue 189, 2021, ISBN 978-3-030-51869-1
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-51870-7_1

Conversational Systems Research in Spain: A Scientometric Approach

Author(s): David Griol, Zoraida Callejas
Published in: Conversational Dialogue Systems for the Next Decade, Issue 704, 2021, Page(s) 393-403, ISBN 978-981-15-8394-0
Publisher: Springer Singapore
DOI: 10.1007/978-981-15-8395-7_31

A Modular Architecture for Multi-Purpose Conversational System Development

Author(s): Adrián Artola, Zoraida Callejas, David Griol
Published in: Intelligent Environments 2021 - Workshop Proceedings of the 17th International Conference on Intelligent Environments, Issue 29, 2021, Page(s) 36-44, ISBN 9781643681863
Publisher: IOS Press
DOI: 10.3233/aise210077

Intelligent Advanced User Interfaces for Monitoring Mental Health Wellbeing

Author(s): Anna Esposito, Zoraida Callejas, Matthias L. Hemmje, Michael Fuchs, Mauro N. Maldonato, Gennaro Cordasco
Published in: Advanced Visual Interfaces. Supporting Artificial Intelligence and Big Data Applications - AVI 2020 Workshops, AVI-BDA and ITAVIS, Ischia, Italy, June 9, 2020 and September 29, 2020, Revised Selected Papers, Issue 12585, 2021, Page(s) 83-95, ISBN 978-3-030-68006-0
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-68007-7_5

Co-creating Requirements and Assessing End-User Acceptability of a Voice-Based Chatbot to Support Mental Health: A Thematic Analysis of a Living Lab Workshop

Author(s): Antonio Benítez-Guijarro, Raymond Bond, Frederick Booth, Zoraida Callejas, Edel Ennis, Anna Esposito, Matthias Kraus, Gavin McConvey, Michael McTear, Maurice Mulvenna, Courtney Potts, Louisa Pragst, Robin Turkington, Nicolas Wagner, Huiru Zheng
Published in: Conversational Dialogue Systems for the Next Decade, Issue 704, 2021, Page(s) 201-212, ISBN 978-981-15-8394-0
Publisher: Springer Singapore
DOI: 10.1007/978-981-15-8395-7_15

Seniors’ Appreciation of Humanoid Robots

Author(s): Anna Esposito, Marialucia Cuciniello, Terry Amorese, Antonietta M. Esposito, Alda Troncone, Mauro N. Maldonato, Carl Vogel, Nikolaos Bourbakis, Gennaro Cordasco
Published in: Neural Approaches to Dynamics of Signal Exchanges, Issue 151, 2020, Page(s) 331-345, ISBN 978-981-13-8949-8
Publisher: Springer Singapore
DOI: 10.1007/978-981-13-8950-4_30

Some Note on Artificial Intelligence

Author(s): Anna Esposito, Marcos Faundez-Zanuy, Francesco Carlo Morabito, Eros Pasero
Published in: Neural Approaches to Dynamics of Signal Exchanges, Issue 151, 2020, Page(s) 3-8, ISBN 978-981-13-8949-8
Publisher: Springer Singapore
DOI: 10.1007/978-981-13-8950-4_1

Conversational Human–Machine Interfaces

Author(s): María Jesús Rodríguez-Sánchez, Kawtar Benghazi, David Griol, Zoraida Callejas
Published in: Handbook of Human-Machine Systems, 2023, Page(s) 115-123, ISBN 9781119863632
Publisher: Wiley
DOI: 10.1002/9781119863663.ch11

Feature Set Ensembles for Sentiment Analysis of Tweets

Author(s): David Griol, C. Kanagal-Balakrishna, Zoraida Callejas
Published in: Advances in Data Science: Methodologies and Applications. Intelligent Systems Reference Library, Issue 189, 2021, ISBN 978-3-030-51869-1
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-51870-7_10

A Content and Knowledge Management System Supporting Emotion Detection from Speech

Author(s): Binh Vu, Mikel deVelasco, Paul Mc Kevitt, Raymond Bond, Robin Turkington, Frederick Booth, Maurice Mulvenna, Michael Fuchs, Matthias Hemmje
Published in: Conversational Dialogue Systems for the Next Decade, Issue 704, 2021, Page(s) 369-378, ISBN 978-981-15-8394-0
Publisher: Springer Singapore
DOI: 10.1007/978-981-15-8395-7_28

Peer reviewed articles (31)

Combining Statistical Dialog Management and Intent Recognition for Enhanced Response Selection

Author(s): David Griol, Zoraida Callejas
Published in: Logic Journal of the IGPL, Issue In Press, 2024, ISSN 1368-9894
Publisher: Oxford University Press

Age and gender effects on the human’s ability to decode posed and naturalistic emotional faces

Author(s): Anna Esposito, Terry Amorese, Marialucia Cuciniello, Maria Teresa Riviello, Gennaro Cordasco
Published in: Pattern Analysis and Applications, Issue 25, 2022, Page(s) 589-617, ISSN 1433-7541
Publisher: Springer Verlag
DOI: 10.1007/s10044-021-01049-w

Analysis of Deep Learning-Based Decision-Making in an Emotional Spontaneous Speech Task

Author(s): Mikel de Velasco, Raquel Justo, Asier López Zorrilla, María Inés Torres
Published in: Applied Sciences, Issue 13(2), 2023, Page(s) 980, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/app13020980

Architecting dietary intake monitoring as a service combining NLP and IoT

Author(s): Antonio Benítez-Guijarro, Zoraida Callejas, Manuel Noguera, Kawtar Benghazi
Published in: Journal of Ambient Intelligence and Humanized Computing, 2019, ISSN 1868-5137
Publisher: Springer Verlag
DOI: 10.1007/s12652-019-01553-2

Humanoid and android robots in the imaginary of adolescents, young adults and seniors

Author(s): Anna Esposito; Marialucia Cuciniello; Terry Amorese; Alessandro Vinciarelli; Gennaro Cordasco
Published in: Journal of Ambient Intelligence and Humanized Computing, 2022, ISSN 1868-5137
Publisher: Springer Verlag
DOI: 10.1007/s12652-022-03806-z

Effect of Attachment and Personality Styles on the Ability to Interpret Emotional Vocal Expressions: A Cross-sectional Study

Author(s): Anna Esposito, Alda Troncone
Published in: Open Psychology Journal, Issue 13, 2020, Page(s) 300-309, ISSN 1874-3501
Publisher: Bentham Open
DOI: 10.2174/1874350102013010300

Handwriting and Drawing Features for Detecting Personality Traits: An Analysis on Big Five Sub-dimensions

Author(s): Anna Esposito, Terry Amorese, Michele Buonanno, Marialucia Cuciniello, Antonietta M. Esposito, Marcos Faundez-Zanuy, Laurence Likforman-Sulem, Maria Teresa Riviello, Carmine Spagnuolo, Alda Troncone, Gennaro Cordasco
Published in: Acta Polytechnica Hungarica, Issue 19(11), 2022, Page(s) 65-84, ISSN 1785-8860
Publisher: Obuda University
DOI: 10.12700/aph.19.11.2022.11.4

Ethical issues in assistive ambient living technologies for ageing well

Author(s): Luigi Trojano; Anna Esposito; Francesco Panico; Carl Vogel; Gennaro Cordasco
Published in: Multimedia Tools and Applications, Issue 79, 2020, Page(s) 36077–36089, ISSN 1573-7721
Publisher: Springer
DOI: 10.1007/s11042-020-09313-7

Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning.

Author(s): Cristina Luna-Jiménez; David Griol; Zoraida Callejas; Ricardo Kleinlein; Juan Manuel Montero; Fernando Fernández-Martínez
Published in: SEnsors, Issue 21(22), 2021, Page(s) 7665, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21227665

On Features and Measures of Psychological Wellbeing

Author(s): Olga Shevleva, Gennaro Cordasco, Carl Vogel, Anna Esposito
Published in: Journal of Health Science Studies, Issue 2(1), 2022, ISSN 2767-9136
Publisher: Annex Publishers

An empirical assessment of deep learning approaches to task-oriented dialog management

Author(s): Lukas Mateju, David Griol, Zoraida Callejas, Jose Manuel Molina, Araceli Sanchis
Published in: Neurocomputing, Issue 439, 2021, Page(s) 327-339, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/j.neucom.2020.01.126

The Role of Trust in Proactive Conversational Assistants

Author(s): Matthias Kraus, Nicolas Wagner, Zoraida Callejas, Wolfgang Minker
Published in: IEEE Access, Issue 9, 2021, Page(s) 112821-112836, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2021.3103893

A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset

Author(s): Cristina Luna-Jiménez; Ricardo Kleinlein; David Griol; Zoraida Callejas; Juan M. Montero; Fernando Fernández-Martínez
Published in: Applied Sciences, Issue 12(1), 2022, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/app12010327

Discriminative Power of EEG-Based Biomarkers in Major Depressive Disorder: A Systematic Review

Author(s): Claudia Greco, Olimpia Matarazzo, Gennaro Cordasco, Alessandro Vinciarelli, Zoraida Callejas, Anna Esposito
Published in: IEEE Access, Issue 9, 2021, Page(s) 112850-112870, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2021.3103047

Fine-Tuning BERT Models for Intent Recognition Using a Frequency Cut-Off Strategy for Domain-Specific Vocabulary Extension

Author(s): Fernando Fernández-Martínez; Cristina Luna-Jiménez; Ricardo Kleinlein; David Griol; Zoraida Callejas; Juan Manuel Montero
Published in: Applied Sciences, Vol 12, Iss 1610, p 1610 (2022), Issue 12(3), 2022, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/app12031610

Digital transformation of mental health services

Author(s): Raymond R. Bond, Maurice D. Mulvenna, Courtney Potts, Siobhan O'Neill, Edel Ennis, John Torous
Published in: npj Mental Health Res, Issue 2, 2023, ISSN 2731-4251
Publisher: Springer Nature
DOI: 10.1038/s44184-023-00033-y

Coordination of Speech Recognition Devices in Intelligent Environments with Multiple Responsive Devices

Author(s): Benítez-Guijarro, Callejas, Noguera, Benghazi
Published in: Proceedings, Issue 31/1, 2019, Page(s) 54, ISSN 2504-3900
Publisher: MDPI
DOI: 10.3390/proceedings2019031054

MENHIR: Mental health monitoring through interactive conversations

Author(s): Callejas Carrión, Zoraida; Benghazi, Kawtar; Noguera, Manuel; Torres Barañano, María Inés; Justo Blanco, Raquel
Published in: Procesamiento del Lenguaje Natural, Issue 63, 2019, Page(s) 139-142, ISSN 1135-5948
Publisher: Sociedad Espanola para el Procesamiento del Lenguaje Natural
DOI: 10.26342/2019-63-15

Advanced Assistive Technologies for Elderly People: A Psychological Perspective on Older Users’ Needs and Preferences (part B)

Author(s): Alda Troncone, Raffaele Saturno, Michele Buonanno, Luca Pugliese, Gennaro Cordasco, Carl Vogel, Anna Esposito
Published in: Acta Polythecnica Hungarica, Issue 18(1), 2021, ISSN 1785-8860
Publisher: Obuda University
DOI: 10.12700/aph.18.1.2021.1.3

Incorporating evidence into mental health Q&A: a novel method to use generative language models for validated clinical content extraction

Author(s): Ksenia Kharitonova, David Pérez-Fernández, Javier Guti érrez-Hernando, Asier Gutiérrez-Fandiño, Zoraida Callejas, David Griol
Published in: Behaviour and Information Technology, 2024, ISSN 0144-929X
Publisher: Taylor & Francis
DOI: 10.1080/0144929x.2024.2321959

Do you like me? Behavioral and physical features for socially and emotionally engaging interactive systems

Author(s): Anna Esposito; Terry Amorese; Marialucia Cuciniello; Antonietta M. Esposito; Gennaro Cordasco
Published in: Frontiers in Computer Science, Issue 5, 2023, ISSN 2624-9898
Publisher: Frontiers
DOI: 10.3389/fcomp.2023.1138501

Towards versatile conversations with data-driven dialog management and its integration in commercial platforms

Author(s): Pablo Cañas; David Griol; Zoraida Callejas
Published in: Journal of Computational Science, 2021, ISSN 1877-7503
Publisher: Elsevier BV
DOI: 10.1016/j.jocs.2021.101443

Modeling and Evaluating Epidemic Control Strategies With High-Order Temporal Networks

Author(s): Alessia Antelmi; Gennaro Cordasco; Vittorio Scarano; Carmine Spagnuolo
Published in: IEEE Access, Issue 9, 2021, Page(s) 140938-140964, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2021.3119459

Reciprocity versus Self-Interest in a Competitive Interaction Context: An Experimental Study

Author(s): Claudia Greco, Anna Esposito, Gennaro Cordasco, Olimpia Matarazzo
Published in: Psychological Reports, 2022, ISSN 0033-2941
Publisher: Ammons Scientific Ltd.
DOI: 10.1177/00332941221129137

Perceptual Borderline for Balancing Multi-Class Spontaneous Emotional Data

Author(s): Leila Ben Letaifa, M. Ines Torres
Published in: IEEE Access, Issue 9, 2021, Page(s) 55939-55954, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2021.3071485

Advanced Assistive Technologies for Elderly People: A Psychological Perspective on Seniors’ Needs and Preferences (part A)

Author(s): Alda Troncone, Terry Amorese, Marialucia Cuciniello, Raffaele Saturno, Luca Pugliese, Gennaro Cordasco, Carl Vogel, Anna Esposito
Published in: Acta Polytechnica Hungarica, Issue 17(2), 2020, ISSN 1785-8860
Publisher: Obuda University
DOI: 10.12700/aph.17.2.2020.2.10

Adaptive dialogue management using intent clustering and fuzzy rules

Author(s): David Griol, Zoraida Callejas, Jose Manuel Molina, Araceli Sanchis
Published in: Expert Systems, 2020, ISSN 0266-4720
Publisher: Blackwell Publishing Inc.
DOI: 10.1111/exsy.12630

Discriminative Power of Handwriting and Drawing Featuresin Depression

Author(s): Claudia Greco, Gennaro Raimo, Terry Amorese, Marialucia Cuciniello, Gavin McConvey, Gennaro Cordasco, Marcos Faundez-Zanuy, Alessandro Vinciarelli, Zoraida Callejas, Anna Esposito
Published in: International Journal of Neural Systems, 2023, ISSN 0129-0657
Publisher: World Scientific Publishing Co
DOI: 10.1142/s0129065723500697

Synthetic vs Human Emotional Faces: What Changes in Humans’ Decoding Accuracy

Author(s): Terry Amorese, Marialucia Cuciniello, Alessandro Vinciarelli, Gennaro Cordasco, Anna Esposito
Published in: IEEE Transactions on Human-Machine Systems, Issue 54(3), 2022, Page(s) 390-399, ISSN 2168-2291
Publisher: IEEE Systems, Man, and Cybernetics Society
DOI: 10.1109/thms.2021.3129714

Perfectionism and Burnout During the COVID-19 Crisis: A Two-Wave Cross-Lagged Study

Author(s): Paola Spagnoli, Carmela Buono, Liliya Scafuri Kovalchuk, Gennaro Cordasco and Anna Esposito
Published in: Frontiers in Psychology, 2021, ISSN 1664-1078
Publisher: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2020.631994

A Synthetic Voice for an Assistive Conversational Agent: A Survey to Discover Italian Preferences regarding Synthetic Voice’s Gender and Quality Level

Author(s): Marialucia Cuciniello,Terry Amorese, Claudia Greco, Zoraida Callejas, Carl Vogel, Gennaro Cordasco, Anna Esposito
Published in: Human Behavior and Emerging Technologies, 2023, ISSN 2578-1863
Publisher: Hindawi
DOI: 10.1155/2023/8858268

Conference proceedings (43)

An application of conversational systems to promote healthy lifestyle habits

Author(s): David Griol, Zoraida Callejas, Fernando Fernández-Martínez, Anna Esposito
Published in: Proc. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 2022
Publisher: IEEE
DOI: 10.1109/dasc/picom/cbdcom/cy55231.2022.9927835

First Workshop on Multimodal e-Coaches

Author(s): Leonardo Angelini, Mira El Kamali, Elena Mugellini, Omar Abou Khaled, Yordan Dimitrov, Vera Veleva, Zlatka Gospodinova, Nadejda Miteva, Richar Wheeler, Zoraida Callejas, David Griol, Kawtar Benghazi, Manuel Noguera, Panagiotis Bamidis, Evdokimos Konstantinidis, Despoina Petsani, Andoni Beristain Iraola, Dimitrios I. Fotiadis, Gérard Chollet, Inés Torres, Anna Esposito, Hannes Schlieter
Published in: Proceedings of the 2020 International Conference on Multimodal Interaction, 2020, Page(s) 890-892, ISBN 9781450375818
Publisher: ACM
DOI: 10.1145/3382507.3420056

A Comparison of Learning Approaches to Dialogue Management in Conversational Systems

Author(s): David Griol, Zoraida Callejas
Published in: 16th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO), 2022, ISBN 978-3-030-87868-9
Publisher: Springer
DOI: 10.1007/978-3-030-87869-6_7

Speaker Recognition using Multiple X-Vector Speaker Representations with Two-Stage Clustering and Outlier Detection Refinement

Author(s): Shrestha, Roman; Glackin, Cornelius; Wall, Julie; Cannings, Nigel; Rajwadi, Marvin; Kada, Satya; Laird, James; Laird, Thea; Woodruff, Chris
Published in: Proc. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), Issue 1, 2022
Publisher: IEEE
DOI: 10.1109/dasc/picom/cbdcom/cy55231.2022.9927875

The Role of Language in Building Automatic Models for Depression Detection

Author(s): Gennaro Raimo, Massimiliano Conson, Terry Amorese, Marialucia Cuciniello, Claudia Greco, Gennaro Cordasco, Zoraida Callejas, Cornelius Glackin, Anna Esposito
Published in: Proc. of 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 2022
Publisher: IEEE
DOI: 10.1109/dasc/picom/cbdcom/cy55231.2022.9927925

Frontal Left Alpha Activity as an Indicator of Willingness to Interact with Virtual Agents: A pilot study

Author(s): Betul Tolgay, Mauro Maldonato, Carl Vogel, Gennaro Cordasco, Luigi Trojano, Anna Esposito
Published in: Proc. 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), 2020, ISBN 978-1-7281-8214-8
Publisher: IEEE
DOI: 10.1109/coginfocom50765.2020.9237885

Mental Health Monitoring from Speech and Language

Author(s): Irune Zubiaga; Ignacio Menchaca; Mikel de Velasco; Raquel Justo
Published in: Proc. Iberspeech 2022, 2022
Publisher: ISCA
DOI: 10.21437/smm.2022-3

Using Eye Tracking to Investigate Interaction Between Humans and Virtual Agents

Author(s): Terry Amorese, Claudia Greco, Marialucia Cuciniello, Carmela Buono, Cristina Palmero, Pau Buch-Cardona, Sergio Escalera, Maria Inés Torres, Gennaro Cordasco, Anna Esposito
Published in: Proc. 2022 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA), 2022
Publisher: IEEE
DOI: 10.1109/cogsima54611.2022.9830686

Towards conversational technology to promote, monitor and protect mental health

Author(s): Zoraida Callejas, David Griol, Kawtar Benghazi, Manuel Noguera, María Inés Torres, Raquel Justo, Anna Esposito, Gennaro Cordasco, Raymond Bond, Maurice Mulvenna, Edel Ennis, Siobhan O'Neill, Huiru Zheng, Matthias Kraus, Nicolas Wagner, Wolfgang Minker, Gavin McConvey, Matthias Hemmje, Michael Fuchs, Neil Glackin, Gérard Chollet
Published in: IberSPEECH 2021, 2021, Page(s) 148-150
Publisher: ISCA
DOI: 10.21437/iberspeech.2021-32

EEGs as potential predictors of virtual agents’ acceptance

Author(s): Betul Tolgay, Silvia Dell'Orco, Mauro N. Maldonato, Carl Vogel, Luigi Trojano, Anna Esposito
Published in: 2019 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), 2019, Page(s) 433-438, ISBN 978-1-7281-4793-2
Publisher: IEEE
DOI: 10.1109/coginfocom47531.2019.9089944

Identifying Synthetic Voices’ Qualities for Conversational Agents

Author(s): Marialucia Cuciniello; Terry Amorese; Gennaro Cordasco; Stefano Marrone; Fiammetta Marulli; Filippo Cavallo; Olga Gordeeva; Zoraida Callejas Carrión; Anna Esposito
Published in: Applied Intelligence and Informatics ISBN: 9783031248016, Issue 7, 2022, Page(s) 333-346, ISBN 978-3-031-24801-6
Publisher: Springer
DOI: 10.1007/978-3-031-24801-6_24

A Proposal for Data Collection and Process Automatization for Ubiquitous Engagement with Mental Health Organizations

Author(s): Rafael Pablos-Sarabia, David Griol, Zoraida Callejas
Published in: Proceedings of the International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2022), 2022, Page(s) 336-341, ISBN 978-3-031-21332-8
Publisher: Springer
DOI: 10.1007/978-3-031-21333-5_34

Towards the Development of a Trustworthy Chatbot for Mental Health Applications

Author(s): Matthias Kraus, Philip Seldschopf, Wolfgang MInker
Published in: 27th International Conference on Multimedia Modeling, 2021
Publisher: Springer
DOI: 10.1007/978-3-030-67835-7_30

Gender Identification through Handwriting: an Online Approach

Author(s): Gennaro Cordasco, Michele Buonanno, Marcos Faundez-Zanuy, María Teresa Riviello, Laurence Likforman-Sulem, Anna Esposito
Published in: Proc. 2020 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), 2020
Publisher: IEEE
DOI: 10.1109/coginfocom50765.2020.9237863

A Comparison Between Convolutional and Transformer Architectures for Speech Emotion Recognition

Author(s): Iyer, Shreyah; Glackin, Cornelius; Cannings, Nigel; Veneziano, Vito; Sun, Yi
Published in: Proc. 2022 International Joint Conference on Neural Networks (IJCNN), 2022
Publisher: IEEE
DOI: 10.1109/ijcnn55064.2022.9891882

Applications of Digital Hermeneutics to Suicide Prevention and Digital Mental Health: Annual Conference of the Research Cluster digital_culture at the FernUniversität in Hagen

Author(s): Edel Ennis, Raymond Bond, Maurice Mulvenna
Published in: Digital Hermeneutics II: Sources, Analysis, Interpretation, Annotation, and Curation, 2023, Page(s) 25-26
Publisher: FernUniversität in Hagen

Behavioral Sentiment Analysis of Depressive States

Author(s): Anna Esposito, Gennaro Raimo, Mauro Maldonato, Carl Vogel, Massimiliano Conson, Gennaro Cordasco
Published in: Proc. 2020 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), 2020, Page(s) 000209-000214
Publisher: IEEE
DOI: 10.1109/coginfocom50765.2020.9237856

Intelligent Voice Speaker Recognition and Diarization System for IberSpeech 2022 Albayzin Evaluations Speaker Diarization and Identity Assignment Challenge

Author(s): Roman Shrestha, Cornelius Glackin, Julie Wall, Nigel Cannings
Published in: Proc. IberSpeech 2022, 2022, Page(s) 281-283
Publisher: ISCA

Findings from a textual analysis of the MENHIR conversational corpus

Author(s): Zoraida Callejas, Marina Ruiz, Chiara Giordano, Marialucia Cuciniello, Gennaro Cordasco, Anna Esposito, David Griol
Published in: Conference Proceedings: International Digital Mental Health & Wellbeing Conference, 2023
Publisher: Ulster University
DOI: 10.21251/egce-qh89-

A proposal for emotion recognition using speech features, transfer learning and convolutional neural networks

Author(s): Roberto Móstoles, David Griol, Zoraida Callejas, Fernando Fernández-Martínez
Published in: IberSPEECH 2021, 2021, Page(s) 56-60
Publisher: ISCA
DOI: 10.21437/iberspeech.2021-12

Seniors’ ability to decode differently aged facial emotional expressions

Author(s): Anna Esposito, Terry Amorese, Nelson Mauro Maldonato, Alessandro Vinciarelli, María Inés Torres, Sergio Escalera, Gennaro Cordasco
Published in: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), 2020
Publisher: IEEE
DOI: 10.1109/fg47880.2020.00077

Impairments in decoding facial and vocal emotional expressions in high functioning autistic adults and adolescents

Author(s): Anna Esposito, Italia Cirillo, Antonietta M. Esposito, Leopoldina Fortunati, Gian Luca Foresti, Sergio Escalera, Nikolaos Bourbakis
Published in: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), 2020, Page(s) 667-674
Publisher: IEEE
DOI: 10.1109/fg47880.2020.00055

Android Robots vs Virtual Agents: which system differently aged users prefer?

Author(s): Claudia Greco, Terry Amorese, Marialucia Cuciniello, Gennaro Cordasco, Anna Esposito
Published in: Proc. 1st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2022, Page(s) 1-7
Publisher: IEEE
DOI: 10.1109/ro-man53752.2022.9900850

Speech emotion recognition in Spanish TV Debates

Author(s): Irune Zubiaga; Raquel Justo; M. Inés Torres; Mikel De Velasco
Published in: Proc. Iberspeech 2022, 2022
Publisher: ISCA
DOI: 10.21437/iberspeech.2022-38

Multimodal Feature Evaluation and Fusion for Emotional Well-Being Monitorization

Author(s): Irune Zubiaga and Raquel Justo
Published in: Pattern Recognition and Image Analysis. IbPRIA 2022. Lecture Notes in Computer Science, Issue 13256, 2022, ISBN 978-3-031-04880-7
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-04881-4_20

Working together to close the gap between digital mental health research and real world implementation: Facilitating dialogues between academics, service providers, industry and the public

Author(s): Raymond Bond, Edel Ennis, Maurice Mulvenna, Zoraida Callejas
Published in: Conference Proceedings: International Digital Mental Health & Wellbeing Conference, 2023
Publisher: Ulster University
DOI: 10.21251/egce-qh89

How Human Likeness, Gender and Ethnicity affect Elders’Acceptance of Assistive Robots

Author(s): Anna Esposito, Terry Amorese, Marialucia Cuciniello, Maria Teresa Riviello, Gennaro Cordasco
Published in: 2020 IEEE International Conference on Human-Machine Systems (ICHMS), 2020, Page(s) 1-6, ISBN 978-1-7281-5871-6
Publisher: IEEE
DOI: 10.1109/ichms49158.2020.9209546

Managing Multi-task Dialogs by Means of a Statistical Dialog Management Technique

Author(s): David Griol, Zoraida Callejas, José F. Quesada
Published in: Increasing Naturalness and Flexibility in Spoken Dialogue Interaction. Lecture Notes in Electrical Engineering, Issue 714, 2021
Publisher: Springer
DOI: 10.1007/978-981-15-9323-9_6

Implementation of a Statistical Dialogue Manager for Commercial Conversational Systems

Author(s): Pablo Cañas, David Griol
Published in: 15th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO), 2021, ISBN 978-3-030-57801-5
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-57802-2_37

Discovering Dialog Rules by Means of an Evolutionary Approach

Author(s): David Griol, Zoraida Callejas
Published in: Interspeech 2019, 2019, Page(s) 1473-1477
Publisher: ISCA
DOI: 10.21437/interspeech.2019-2230

The Dependability of Voice on Elders’ Acceptance of Humanoid Agents

Author(s): Anna Esposito, Terry Amorese, Marialucia Cuciniello, Maria Teresa Riviello, Antonietta M. Esposito, Alda Troncone, Gennaro Cordasco
Published in: Interspeech 2019, 2019, Page(s) 31-35
Publisher: ISCA
DOI: 10.21437/interspeech.2019-1734

Is Autism, Attention Deficit Hyperactivity Disorder (ADHD) and Specific Learning Disorder linked to Impaired Emotion Recognition in Primary School Aged Children?

Author(s): Aliki Economides, Chiara Baiano, Isa Zappullo, Massimiliano Conson, Joulietta Kalli-Laouri, Yiannis Laouris, Anna Esposito
Published in: Proc. IEEE International Conference on Human-Machine Systems (ICHMS), 2020, ISBN 978-1-7281-5872-3
Publisher: IEEE
DOI: 10.1109/ichms49158.2020.9209413

A Proposal for Developing and Deploying Statistical Dialog Management in Commercial Conversational Platforms

Author(s): Pablo Cañas, David Griol, Zoraida Callejas
Published in: Hybrid Artificial Intelligent Systems. HAIS 2022. Lecture Notes in Computer Science, Issue 13469, 2022
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-15471-3_35

Mobile Conversational Agents for Stroke Rehabilitation Therapy

Author(s): David Griol, Zoraida Callejas
Published in: 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), 2019, Page(s) 513-518, ISBN 978-1-7281-2286-1
Publisher: IEEE
DOI: 10.1109/cbms.2019.00104

Emotional Features of Interactions With Empathic Agents

Author(s): Claudia Greco, Carmela Buono, Pau Buch-Cardona, Gennaro Cordasco, Sergio Escalera, Anna Esposito, Anais Fernandez, Daria Kyslitska, Maria Stylianou Kornes, Cristina Palmero, Jofre Tenorio Laranga, Anna Torp Johansen, Maria Inés Torres
Published in: 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2021, Page(s) 2168-2176
Publisher: IEEE
DOI: 10.1109/iccvw54120.2021.00246

Emotional virtual agents: how do young people decode synthetic facial expressions?

Author(s): Anna Esposito, Terry Amorese, Marialucia Cuciniello, Gennaro Cordasco
Published in: Proceedings of the First Workshop on Technology Enhanced Learning Environments for Blended Education (teleXbe2021), 2021
Publisher: CEUR

Measuring and Fostering Engagement with Mental Health e-Coaches

Author(s): Zoraida Callejas, David Griol, Kawtar Benghazi, Manuel Noguera, Gerard Chollet, María Inés Torres, Anna Esposito
Published in: Companion Publication of the 2020 International Conference on Multimodal Interaction, 2020, Page(s) 275-279, ISBN 9781450380027
Publisher: ACM
DOI: 10.1145/3395035.3425316

A Research Agenda for Dementia Care: Prevention, Risk Mitigation and Personalized Interventions

Author(s): Anna Esposito, Alessandro Vinciarelli, Gennaro Cordasco
Published in: Advances in Assistive Technologies. Learning and Analytics in Intelligent Systems, Issue 28, 2022, ISBN 978-3-030-87131-4
Publisher: Springer, Cham
DOI: 10.1007/978-3-030-87132-1_3

Towards a Semantic Data Model for Representing, Storing, and Retrieving Knowledge about Coping Strategies for Use in Digital Mental Health Interventions

Author(s): Edel Ennis, Raymond Bond, Maurice Mulvenna, Zoraida Callejas, Alexander Duttenhöfer, Stephanie Heidepriem, Christian Nawroth, Christopher McCausland, Siobhan O'Neill, Matthias Hemmje
Published in: Book of abstracts, European Conference on Mental Health, 2022
Publisher: European Conference on Mental Health

Comparing Middle-Aged and Seniors’ Preferences Toward Virtual Agents and Android Robots: Is There a Generational Shift in Assistive Technologies’ Preferences?

Author(s): Anna Esposito, Terry Amorese, Marialucia Cuciniello, Filippo Cavallo, Alessandro Vinciarelli, Gennaro Cordasco 
Published in: Ambient Assisted Living. ForItAAL 2020. Lecture Notes in Electrical Engineering, Issue 884, 2022, ISBN 978-3-031-08837-7
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-08838-4_6

A cross-cultural survey to identify Seniors’ preferences towards the Empathic Virtual Coach

Author(s): Marialucia Cuciniello, Terry Amorese, Claudia Greco, Gennaro Raimo, Gennaro Cordasco, Maria Stylianou Kornes, Anna Torp Johansen, Kristin Beck Gjellesvik, Anais Fernandez, Daria Kyslitska, Eduardo González-Fraile, Begoña Fernández-Ruanova, Jofre Tenorio-Laranga, María Inés Torres, Anna Esposito
Published in: Proc. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 2022
Publisher: IEEE
DOI: 10.1109/dasc/picom/cbdcom/cy55231.2022.9927961

Two-stage deep learning approach for speech enhancement and reconstruction in the frequency and time domains

Author(s): Soha A. Nossier; Julie Wall; Mansour Moniri; Cornelius Glackin; Nigel Cannings
Published in: Proc. of the 2022 International Joint Conference on Neural Networks (IJCNN), 2022
Publisher: IEEE
DOI: 10.1109/ijcnn55064.2022.9892355

Handwriting and Drawing for Depression Detection: A Preliminary Study

Author(s): Raimo, Gennaro; Buonanno, Michele; Conson, Massimiliano; Cordasco, Gennaro; Faundez-Zanuy, Marcos; Marrone, Stefano; Marulli, Fiammetta; Vinciarelli, Alessandro; Esposito, Anna
Published in: Applied Intelligence and Informatics, 2022, ISBN 978-3-031-24801-6
Publisher: Springer
DOI: 10.48550/arxiv.2302.02499

Other (3)

Cancer Survivorship and AI for Well-being White Paper: A European research projects collaborative perspective

Author(s): Callejas Carrión, Zoraida; Flynn, Tom
Published in: Issue 10, 2023
Publisher: CS_AIW Cluster

Supplemental Material - Reciprocity versus Self-Interest in a Competitive Interaction Context: An Experimental Study

Author(s): Greco, Claudia; Esposito, Anna; Cordasco, Gennaro; Matarazzo, Olimpia
Published in: Issue 8, 2022
Publisher: SAGE Publishing
DOI: 10.25384/sage.21230366

Conference Proceedings: International Digital Mental Health & Wellbeing Conference: Book of abstracts

Author(s): Raymond Bond, Maurice Mulvenna, Edel Ennis
Published in: 2023
Publisher: Ulster University
DOI: 10.21251/egce-qh89--

Thesis and dissertations (7)

Contributions to attributed probabilistic finite state bi-automata for dialogue management

Author(s): Manex Serras (PhD student), María Aranzazu del Pozo (Supervisor), María Inés Torres (Supervisor)
Published in: 2021
Publisher: Universidad del País Vasco

De lo trágico en las canciones populares infantiles españolas: un análisis del lenguaje textual con métodos mixtos

Author(s): Juan Albacete Maza (PhD Student), Antonio Fernández Cano (Supervisor), Zoraida Callejas (Supervisor)
Published in: 2022
Publisher: Universidad de Granada

Towards structured neural spoken dialogue modelling

Author(s): Asier López Zorrilla (PhD student), María Inés Torres (Supervisor)
Published in: 2023
Publisher: Universidad del País Vasco

Analysis and automatic identification of spontaneous emotions in speech from human-human and human-machine communication

Author(s): Matthias Kraus (PhD student), Raquel Justo (Supervisor), María Inés Torres (Supervisor)
Published in: 2023
Publisher: Universidad del País Vasco

User-centred Proactive Dialogue Modelling for Trustworthy Conversational Assistants

Author(s): Matthias Kraus (PhD student), Wolfgang Minker (Supervisor), Zoraida Callejas (Supervisor)
Published in: DIGIBUG, 2022, ISBN 9788411175739
Publisher: Ulm University / Universidad de Granada

Analytics, Visualisation and Machine Learning of General Practitioner Prescribing using Open Health Data

Author(s): Frederick Booth (PhD student), Maurice Mulvenna (Supervisor), Prof Raymond Bond (Supervisor)
Published in: 2023
Publisher: Ulster University

Machine learning of anonymous call data from national suicide prevention helpline services: Understanding caller behaviour and policy implications

Author(s): Robin Turkington (PhD student), Maurice Mulvenna (Supervisor), Edel Ennis (Supervisor), Siobhán O’Neill (Supervisor), Raymond Bond (Supervisor)
Published in: 2021
Publisher: Ulster University