Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects | ARIA-VALUSPA | Project | Results | H2020 | CORDIS

Rezultaty

Implementation of multi-lingual task-based dialogue system for the chosen scenario

Implementation of multilingual taskbased dialogue system for the chosen scenario

Multi-lingual realisation of Book-ARIA using M2 system

Multilingual realisation of BookARIA using milestone 2 system

Implementation of adaptive task-based dialogue system

Implementation of adaptive taskbased dialogue system

Implementation of cross-domain, context-sensitive speech analysis

Implementation of crossdomain contextsensitive speech analysis

First integrated system with simple support for web and mobile device user interfaces

The first integrated system with simple support for web and mobile device user interfaces

Release of the multilingual, adaptive dialogue toolbox

Release of the multilingual adaptive dialogue toolbox

Implementation of long-term adaptation for speech analysis

Implementation of longterm adaptation for speech analysis

Implementation of adaptive audiovisual communicative behaviour generation
Uni-lingual realisation of Book-ARIA using M1 system

Unilingual realisation of BookARIA using the system delivered at Milestone 1

Implementation of overall dynamic audiovisual communicative behaviour generation
Fine-tuned, multi-lingual realisation of Book-ARIA using M3 system

Finetuned multilingual realisation of BookARIA using M3 system

Second integrated system with improved real-time capabilities in distributed environments

Second integrated system with improved realtime capabilities in distributed environments

Final adaptive audiovisual communicative behaviour generation
Final integrated system with documented support for web standard technologies
Implementation of multi-lingual user- and environment-adaptive speech analysis

Implementation of multilingual user and environmentadaptive speech analysis

Ethical Policies

Report on applied ethical practices including informed consent forms ethical approval for experiments and data collection and certifications of compliance with national and EU legislation

Final report on standardisation and workshops activities
Evaluation report
Data Management Plan

The Data Management Plan will describe the data management life cycle for the Wizard of Oz and fully automatic ARIA generated data sets It will outline how our collected research data will be handled during and after ARIAVALUSPA It will describe what data will be collected processed or generated and following what methodology and standards whether and how this data will be shared andor made open and how it will be curated and preservedWe are committed to making all our data fully available to the research community through easily accessible web interfaces similar to the SEMAINE database A minor part of the data may be temporarily withheld from the public to allow the team to organise challenges for the research community on unseen data

Public access to interactive ARIA-VALUSPA platform under a research license
Project website, first version

Project website first version

Public access to interactive system data
Public access to labelled Wizard-of-Oz data

Public access to labelled WizardofOz data

Publikacje

Cascaded continuous regression for real-time incremental face tracking

Autorzy: E. Sánchez-Lozano, B. Martinez, G. Tzimiropoulos, M.F. Valstar
Opublikowane w: ECCV, 2016
Wydawca: IEEE

Topic switch models for dialogue management in virtual humans

Autorzy: W. Zhu, A. Chowanda, M.F. Valstar
Opublikowane w: IVA, 2016
Wydawca: Springer

Deep canonical time warping

Autorzy: George Trigeorgis, Mihalis A. Nicolaou, Stefanos Zafeiriou, Björn Schuller
Opublikowane w: CVPR, 2016
Wydawca: IEEE

Facing realism in spontaneous emotion recognition from speech: feature enhancement by autoencoder with LSTM neural networks

Autorzy: Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, Björn Schuller
Opublikowane w: Interspeech, 2016
Wydawca: ISCA

Classifying emotion-antecedent appraisal in brain activity using machine learning methods

Autorzy: Kornelia Gentsch, Eduardo Coutinho, Florian Eyben, Björn Schuller, Klaus R. Scherer
Opublikowane w: 2015
Wydawca: ISRE

Dynamic active learning based on agreement, applied to emotion recognition in spoken interactions

Autorzy: Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller
Opublikowane w: ICMI, 2016
Wydawca: ACM

AV+EC 2015 –- The first affect recognition Challenge bridging across audio, video, and physiological Data

Autorzy: Fabien Ringeval, Björn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie, Maja Pantic
Opublikowane w: MM, 2015
Wydawca: ACM

Agreement-based dynamic active learning with least, medium certainty query strategies

Autorzy: Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller
Opublikowane w: Advances in Active Learning : Bridging Theory, Practice Workshop, 2015
Wydawca: IMLS

Cross Modal Evaluation of High Quality Emotional Speech Synthesis with the Virtual Human Toolkit

Autorzy: B. Potard, M. Aylett, D. Braude.
Opublikowane w: IVA, 2016
Wydawca: Springer

Sincerity, deception in speech: Two sides of the same coin? A transfer- and multi-task learning perspective

Autorzy: Yue Zhang, Felix Weninger, Zhao Ren, Björn Schuller
Opublikowane w: ICMI, 2016
Wydawca: ACM

Computational Models of Emotion, Personality, and Social Relationships for Interactions in Games

Autorzy: A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar
Opublikowane w: AAMAS, 2016
Wydawca: IFAAMAS

Combining Hierarchical Classification with Frequency Weighting for the Recognition of Eating Conditions

Autorzy: Johannes Wagner, Andreas Seiderer, Florian Lingenfelser, Elisabeth André
Opublikowane w: Interspeech, 2015
Wydawca: ISCA

Building autonomous sensitive artificial listeners (extended abstract)

Autorzy: Marc Schröder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne de Sevin, Michel Valstar, Martin Wöllmer
Opublikowane w: ACII, 2015
Wydawca: IEEE

TRIC-track: Tracking by Regression with Incrementally Learned Cascades

Autorzy: X. Wang, M.F. Valstar, B. Martinez, M.H. Khan, T.P. Pridmore
Opublikowane w: ICCV, 2015
Wydawca: IEEE

AV+ EC 2015--The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data

Autorzy: Ringeval, F., Schuller, B., Valstar, M., Jaiswal, S., Marchi, E., Lalanne, D., Cowie, R. and Pantic, M
Opublikowane w: AVEC, 2015
Wydawca: ACM

Improving social relationships in face-to-face human-agent interactions: when the agent wants to know user’s likes and dislikes

Autorzy: Caroline Langlet, Chloe Clavel
Opublikowane w: ACL, 2015
Wydawca: Association for Computational Linguistics and The Asian Federation of Natural Language Processing

Don't Say Yes, Say Yes: Interacting with Synthetic Speech Using Tonetable

Autorzy: M. Aylett, B. Potard, G. Pullin, S. Hennig, D. Braude, M. Antunes Ferreira
Opublikowane w: CHI EA '16, 2016
Wydawca: ACM

On rater reliability, correlation based dynamic active learning

Autorzy: Yue Zhang, Eduardo Coutinho, Zixing Zhang, Michael Adam, Björn Schuller
Opublikowane w: ACII, 2015
Wydawca: AAAC

Bird sounds classification by large scale acoustic features, extreme learning machine

Autorzy: Kun Qian, Zixing Zhang, Fabien Ringeval, Björn Schuller
Opublikowane w: GlobalSIP, 2015
Wydawca: IEEE

Face reading from speech –- predicting facial action units from audio cues

Autorzy: Fabien Ringeval, Erik Marchi, Marc Mehu, Klaus Scherer, Björn Schuller
Opublikowane w: Interspeech, 2015
Wydawca: ISCA

The Effects of Interrupting Behavior on Interpersonal Attitude and Engagement in Dyadic Interactions

Autorzy: Angelo Cafaro, Nadine Glas, Catherine Pelachaud
Opublikowane w: AAMAS, 2016
Wydawca: Springer

Exploring the importance of individual differences to the automatic estimation of emotions induced by music

Autorzy: Hesam Sagha, Eduardo Coutinho, Björn Schuller
Opublikowane w: MM, 2015
Wydawca: ACM

Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection

Autorzy: T. Almaev, B. Martinez and M.F. Valstar
Opublikowane w: ICCV, 2015
Wydawca: IEEE

Adapting sentiment analysis to face-to-face human-agent interactions: from detection to evaluation issues

Autorzy: Caroline Langlet, Chloe Clavel
Opublikowane w: ACII, 2016
Wydawca: IEEE

Automatically estimating emotion music using long-short term memory recurrent neural networks

Autorzy: Eduardo Coutinho, George Trigeorgis, Stefanos Zafeiriou, Björn Schuller
Opublikowane w: Interspeech, 2015
Wydawca: CEUR

Artificial Personality and Disfluency

Autorzy: M. Wester, M. Aylett, M. Tomalin, R. Dall
Opublikowane w: Interspeech, 2015
Wydawca: ISCA

Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection

Autorzy: Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini, Björn Schuller
Opublikowane w: OJCNN, 2015
Wydawca: IEEE

The ICL-TUM-PASSAU approach for the MediaEval 2015 “Affective Impact of Movies” task

Autorzy: George Trigeorgis, Eduardo Coutinho, Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou, Björn Schuller
Opublikowane w: Interspeech, 2015
Wydawca: CEUR

Learning to combine local models for Facial Action Unit detection

Autorzy: S. Jaiswal, B. Martinez, M.F. Valstar
Opublikowane w: FERA, 2015
Wydawca: IEEE

AVEC 2015 – The 5th International Audio/Visual Emotion Challenge and Workshop

Autorzy: Fabien Ringeval, Björn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic
Opublikowane w: MM, 2015
Wydawca: ACM

Playing with Social and Emotional Game Companions

Autorzy: A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar
Opublikowane w: IVA, 2016
Wydawca: Springer

Deep bidirectional long short-term memory recurrent neural networks for grapheme-to-phoneme conversion utilizing complex many-to many alignments

Autorzy: Amr El-Desoky Mousa, Björn Schuller
Opublikowane w: Interspeech, 2016
Wydawca: ISCA

The INTERSPEECH 2016 Computational Paralinguistics Challenge: Deception & Sincerity

Autorzy: Björn Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
Opublikowane w: ICMI, 2016
Wydawca: ISCA

AVEC 2016 – Depression, Mood, and Emotion Recognition Workshop and Challenge

Autorzy: Valstar, M.F., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R. and Pantic, M
Opublikowane w: ACM Multimedia 2016, 2016
Wydawca: ACM

Speech analysis in the big data era

Autorzy: Björn Schuller
Opublikowane w: TSD, 2015
Wydawca: Springer

Deep Learning the Dynamic Appearance and Shape of Facial Action Units

Autorzy: S. Jaiswal, M.F. Valstar
Opublikowane w: IEEE WACV, 2016
Wydawca: IEEE

ChaLearn Looking at People and Faces of the World: Face Analysis Workshop and Challenge 2016

Autorzy: Escalera, S., Torres Torres, M., Martinez, B., Baró, X. and Escalante, H.J., Guyon I., Tzimiropoulos, G., Corneau, C., Oliu, M., Bagheri, M.A., Valstar, M.F.
Opublikowane w: CVPR, 2016
Wydawca: IEEE

Enhanced semi-supervised learning for multimodal emotion recognition

Autorzy: Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, Björn Schuller
Opublikowane w: ICASSP, 2016
Wydawca: IEEE

Does my speech rock? Automatic assessment of public speaking skills

Autorzy: Lucas Azais, Adrien Payan, Tianjiao Sun, Guillaume Vidal, Tina Zhang, Eduardo Coutinho, Florian Eyben, Björn Schuller
Opublikowane w: Interspeech, 2015
Wydawca: ISCA

Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis

Autorzy: Yue Zhang, Yuxiang Zhou, Jie Shen, Björn Schuller
Opublikowane w: ICASSP, 2016
Wydawca: IEEE

An Open Source Kaldi Based Parametric Speech Synthesiser based on DNN

Autorzy: B. Potard, M. Aylett, D. Braude, P. Motlicek
Opublikowane w: Interspeech, 2016
Wydawca: ISCA

Adieu features? End-to-end apeech emotion recognition using a deep convolutional recurrent network

Autorzy: George Trigeorgis, Fabien Ringeval, Raymond Brückner, Erik Marchi, Mihalis Nicolaou, Björn Schuller, Stefanos Zafeiriou
Opublikowane w: ICASSP, 2016
Wydawca: IEEE

Sentiment analysis, opinion mining: on optimal parameters and performances

Autorzy: Björn Schuller, Amr El-Desoky Mousa, Vryniotis Vasileios
Opublikowane w: Wiley Interdisciplinary Reviews: Data Mining, Knowledge Discovery, 2015, ISSN 1942-4787
Wydawca: John Wiley and Sons Inc.

A deep matrix factorization method for learning attribute representations

Autorzy: George Trigeorgis, Konstantinos Bousmalis, Stefanos Zafeiriou, Björn Schuller
Opublikowane w: PAMI, 2016, ISSN 0162-8828
Wydawca: Institute of Electrical and Electronics Engineers

Cascaded Regression with Sparsified Feature Covariance Matrix for Facial Landmark Detection

Autorzy: E. Sánchez-Lozano, B. Martinez, M.F. Valstar
Opublikowane w: Pattern Recognition Letters, 2016, ISSN 0167-8655
Wydawca: Elsevier BV

L21-based regression and prediction accumulation across views for robust facial landmark detection

Autorzy: B. Martinez and M.F. Valstar
Opublikowane w: Image and Vision Computing, 2015, ISSN 0262-8856
Wydawca: Elsevier BV

From opinion mining to human-agent interaction

Autorzy: Chloé Clavel, Zoraida Callejas
Opublikowane w: IEEE TAC, 2016, ISSN 1949-3045
Wydawca: Institute of Electrical and Electronics Engineers

Grounding the detection of the user’s likes ´ and dislikes on the topic structure of human-agent interactions

Autorzy: Caroline Langlet, Chloe Clavel
Opublikowane w: KBS, 2016, ISSN 0950-7051
Wydawca: Elsevier BV

Context-Aware Automated Analysis and Annotation of Social Human-Agent Interactions

Autorzy: Tobias Baur, Gregor Mehlmann, Ionut Damian, Florian Lingenfelser, Johannes Wagner, Birgit Lugrin, Elisabeth André, Patrick Gebhard
Opublikowane w: ACM Transactions on Interactive Intelligent Systems (TiiS) 5.2, 2015, ISSN 2160-6455
Wydawca: Association for Computing Machinery (ACM)

Automatic estimation of biosignals from the human voice

Autorzy: Eduardo Coutinho, Björn Schuller
Opublikowane w: Science, Special Supplement on Advances in Computational Psychophysiology, 2015, ISSN 2329-9290
Wydawca: IEEE Advancing Technology for Humanity

Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition

Autorzy: B. Martinez and M.F. Valstar
Opublikowane w: Advances in Face Detection and Facial Image Analysis, 2016
Wydawca: Springer

Fostering user engagement in face-to-face human-agent interactions: a survey

Autorzy: Clavel, C., Cafaro, A., Campano, S., & Pelachaud, C.
Opublikowane w: Toward Robotic Socially Believable Behaving Systems-Volume II, 2016
Wydawca: Springer

Modeling User’s Social Attitude in a Conversational System

Autorzy: Tobias Baur, Dominik Schiller, Elisabeth André
Opublikowane w: Emotions and Personality in Personalized Services, 2016
Wydawca: Springer

Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects

Rezultaty

Publikacje

Udostępnij tę stronę

Pobierz