Automatic Sentiment Estimation in the Wild

Deliverables

D1.1 (M18) (All, ICL): Online SEWA DB containing annotated audio-visual behaviour in the wild. Lead beneficiary - also all Dissemination level - PU - The SEWA database will be made publicly available under the Science Commons license, subject to the appropriate ethics procedures, including anonymisation and signed consent of all the subjects whose data is to be included

Exploitation Plan

D8.3 (M36) (RealEyes): Exploitation Plan

Annual Report 3

D9.3 (M42) (ICL): final report

Annual Report 1

D9.1 (M12) (ICL): annual report 1

Report on user requirements for SEWA applications

D7.1 (M12) (RealEyes): Report on user requirements for each SEWA application

Report on performance evaluation, usage and usability of SEWA applications

D7.8 (M42) (PlayGen): Report on performance evaluation, usage and usability of each SEWA application

Annual Report 2

D9.2 (M24) (ICL): annual report 2

Publications

FERA 2015 - second Facial Expression Recognition and Analysis challenge

Author(s): Michel F. Valstar, Timur Almaev, Jeffrey M. Girard, Gary McKeown, Marc Mehu, Lijun Yin, Maja Pantic, Jeffrey F. Cohn
Published in: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015, Page(s) 1-8, ISBN 978-1-4799-6026-2
Publisher: IEEE
DOI: 10.1109/FG.2015.7284874

Robust Statistical Face Frontalization

Author(s): Christos Sagonas, Yannis Panagakis, Stefanos Zafeiriou, Maja Pantic
Published in: 2015 IEEE International Conference on Computer Vision (ICCV), 2015, Page(s) 3871-3879, ISBN 978-1-4673-8391-2
Publisher: IEEE
DOI: 10.1109/ICCV.2015.441

Sparkle - adaptive sample based scheduling for cluster computing

Author(s): Chunliang Hao, Jie Shen, Heng Zhang, Xiao Zhang, Yanjun Wu, Mingshu Li
Published in: Proceedings of the 5th International Workshop on Cloud Data and Platforms - CloudDP '15, 2015, Page(s) 1-6, ISBN 9781-450334785
Publisher: ACM Press
DOI: 10.1145/2744210.2744212

Multi-conditional Latent Variable Model for Joint Facial Action Unit Detection

Author(s): Stefanos Eleftheriadis, Ognjen Rudovic, Maja Pantic
Published in: 2015 IEEE International Conference on Computer Vision (ICCV), 2015, Page(s) 3792-3800, ISBN 978-1-4673-8391-2
Publisher: IEEE
DOI: 10.1109/ICCV.2015.432

AVEC 2015 - The 5th International Audio/Visual Emotion Challenge and Workshop

Author(s): Fabien Ringeval, Bjoern Schuller, Michel Valstar, Roddy Cowie, Maja Pantic
Published in: Proceedings of the 23rd ACM international conference on Multimedia - MM '15, 2015, Page(s) 1335-1336, ISBN 9781-450334594
Publisher: ACM Press
DOI: 10.1145/2733373.2806408

Copula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic
Published in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, Page(s) 4902-4910, ISBN 978-1-4673-8851-1
Publisher: IEEE
DOI: 10.1109/cvpr.2016.530

Online Attention for Interpretable Conflict Estimation in Political Debates

Author(s): Ruben Vereecken, Stavros Petridis, Yiannis Panagakis, Maja Pantic
Published in: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Issue Proceeding of FG, 2018, Page(s) 389-393, ISBN 978-1-5386-2335-0
Publisher: IEEE
DOI: 10.1109/FG.2018.00062

GAGAN: Geometry-Aware Generative Adversarial Networks

Author(s): Kossaifi, Jean; Tran, Linh; Panagakis, Yannis; Pantic, Maja
Published in: Proceedings of the conference on Computer Vision and Pattern Recognition, Issue 4, 2018
Publisher: IEEE

End-to-End Multi-View Lipreading

Author(s): Petridis, Stavros; Wang, Yujiang; Li, Zuwei; Pantic, Maja
Published in: Proceedings of BMVC, Issue 5, 2017
Publisher: British Machine Vision Association

End-to-end Audiovisual Speech Recognition

Author(s): Petridis, Stavros; Stafylakis, Themos; Ma, Pingchuan; Cai, Feipeng; Tzimiropoulos, Georgios; Pantic, Maja
Published in: Proceedings of ICASSP, Issue 3, 2018
Publisher: IEEE

Robust Kronecker Component Analysis

Author(s): Bahri, Mehdi; Panagakis, Yannis; Zafeiriou, Stefanos
Published in: Proceedings of ICCV, Issue 2, 2017
Publisher: IEEE

Visual-Only Recognition of Normal, Whispered and Silent Speech

Author(s): Petridis, Stavros; Shen, Jie; Cetin, Doruk; Pantic, Maja
Published in: Proceedings of ICASSP, Issue 2, 2018
Publisher: IEEE

End-to-End Audiovisual Fusion with LSTMs

Author(s): Petridis, Stavros; Wang, Yujiang; Li, Zuwei; Pantic, Maja
Published in: Proceedings of AVSP, Issue 5, 2017
Publisher: KTH

Spotting Social Signals in Conversational Speech over IP: A Deep Learning Perspective

Author(s): Raymond Brueckner, Maximilian Schmitt, Maja Pantic, Björn Schuller
Published in: Interspeech 2017, 2017, Page(s) 2371-2375
Publisher: ISCA
DOI: 10.21437/Interspeech.2017-635

Bags in Bag: Generating Context-Aware Bags for Tracking Emotions from Speech

Author(s): Jing Han, Zixing Zhang, Maximilian Schmitt, Zhao Ren, Fabien Ringeval, Bjorn Schuller
Published in: Proceedings 19th Annual conference of the International Speech Communication Association (INTERSPEECH, 2018
Publisher: INTERSPEECH

You Sound Like Your Counterpart: Interpersonal Speech Analysis

Author(s): Jing Han, Maximilian Schmitt, and Bjorn Schuller
Published in: Proceedings 20th International Conference on Speech and Computer (SPECOM), 2018
Publisher: SPECOM

How Good Is Your Model `Really'? On `Wildness' of the In-the-wild Speech-based Affect Recognisers

Author(s): Vedhas Pandit, Maximilian Schmitt, Nicholas Cummins, Franz Graf, Lucas Paletta, and Bj
Published in: In Proceedings 20th International Conference on Speech and Comper (SPECOM), 2018
Publisher: SPECOM

Wavelets Revisited for the Classification of Acoustic Scenes

Author(s): K. Qian, Z. Ren, V. Pandit, Z. Yang, Z. Zhang, and B. Schuller
Published in: Proceedings of the Detection and Classification of Acoustic Scenes and Events Workshop (DCASE), 2018
Publisher: DCASE

Recognising Guitar Effects - Which Acoustic Features Really Matter?

Author(s): Schmitt, Maximilian, Schuller, Björn
Published in: Proceedings in INFORMATIK 2017, 2017
Publisher: INFORMATIK
DOI: 10.18420/in2017_12

Active nonrigid ICP algorithm

Author(s): Shiyang Cheng, Ioannis Marras, Stefanos Zafeiriou, Maja Pantic
Published in: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015, Page(s) 1-8, ISBN 978-1-4799-6026-2
Publisher: IEEE
DOI: 10.1109/FG.2015.7163161

The ICL-TUM-PASSAU Approach for the MediaEval 2015 “Affective Impact of Movies” Task

Author(s): George Trigeorgis, Eduardo Coutinho,Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou , Björn Schuller
Published in: 2015
Publisher: MediaEval

The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results

Author(s): Jie Shen, Stefanos Zafeiriou, Grigoris G. Chrysos, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
Published in: 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), 2015, Page(s) 1003-1011, ISBN 978-1-4673-9711-7
Publisher: IEEE
DOI: 10.1109/ICCVW.2015.132

Sociocognitive Language Processing – Emphasising the Soft Factors

Author(s): Bjorn W. Schuller and Michael F. McTear
Published in: In Proceedings of the Seventh International Workshop on Spoken Dialogue Systems (IWSDS), 2016
Publisher: IWSDS

Deep complementary bottleneck features for visual speech recognition

Author(s): Stavros Petridis, Maja Pantic
Published in: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Page(s) 2304-2308, ISBN 978-1-4799-9988-0
Publisher: IEEE
DOI: 10.1109/ICASSP.2016.7472088

Cross lingual speech emotion recognition using canonical correlation analysis on principal component subspace

Author(s): Hesam Sagha, Jun Deng, Maryna Gavryukova, Jing Han, Bjorn Schuller
Published in: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Page(s) 5800-5804, ISBN 978-1-4799-9988-0
Publisher: IEEE
DOI: 10.1109/ICASSP.2016.7472789

Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network

Author(s): George Trigeorgis, Fabien Ringeval, Raymond Brueckner, Erik Marchi, Mihalis A. Nicolaou, Bjorn Schuller, Stefanos Zafeiriou
Published in: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Page(s) 5200-5204, ISBN 978-1-4799-9988-0
Publisher: IEEE
DOI: 10.1109/ICASSP.2016.7472669

Multimodal Sentiment Analysis in the Wild: Ethical considerations on Data Collection, Annotation, and Exploitation

Author(s): Björn Schuller, Jean-Gabriel Ganascia, Laurence Devillers
Published in: In Proceedings of the Workshop on ETHics in Corpus Collection, Annotation, and Application, satellite of the 10th Language Resources and Evaluation Conference, 2016
Publisher: semanticscholar

Enhanced semi-supervised learning for multimodal emotion recognition

Author(s): Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, Bjorn Schuller
Published in: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Page(s) 5185-5189, ISBN 978-1-4799-9988-0
Publisher: IEEE
DOI: 10.1109/ICASSP.2016.7472666

Empirical Mode Decomposition: A Data-Enrichment Perspective on Speech Emotion Recognition

Author(s): B. Dong, Z. Zhang, and B. Schuller.
Published in: n Proceedings of the 6th International Workshop on Emotion and Sentiment Analysis, 2016
Publisher: tangsoo

A Framework for Joint Estimation and Guided Annotation of Facial Action Unit Intensity

Author(s): Robert Walecki, Ognjen Rudovic, Maja Pantic, Vladimir Pavlovic, Jeffrey F. Cohn
Published in: 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2016, Page(s) 1460-1468, ISBN 978-1-5090-1437-8
Publisher: IEEE
DOI: 10.1109/CVPRW.2016.183

Towards a Common Linked Data Model for Sentiment and Emotion Analysis

Author(s): J. Sanchez-Rada, B. Schuller, V. Patti, P. Buitelaar, G. Vulcu, F. Burkhardt, C. Clavel, M. Petychakis, and C. A. Iglesias
Published in: In Proceedings of the 6th International Workshop on Emotion and Sentiment Analysis (ESA 2016), 2016
Publisher: ESA

Gaussian Process Domain Experts for Model Adaptation in Facial Behavior Analysis

Author(s): Stefanos Eleftheriadis, Ognjen Rudovic, Marc P. Deisenroth, Maja Pantic
Published in: 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2016, Page(s) 1469-1477, ISBN 978-1-5090-1437-8
Publisher: IEEE
DOI: 10.1109/cvprw.2016.184

7 Essential Principles to Make Multimodal Sentiment Analysis Work in the Wild

Author(s): Bjorn Schuller
Published in: Proceedings of the 4th Workshop on Sentiment Analysis where AI meets Psychology (SAAIP 2016), IJCAI 2016, 2016
Publisher: semanticscholar

Discriminatively trained recurrent neural networks for continuous dimensional emotion recognition from audio

Author(s): F. Weninger, F. Ringeval, E. Marchi, and B. Schuller
Published in: IJCAI'16 Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016, ISBN 978-1-57735-770-4
Publisher: AAAI Press ©2016

At the Border of Acoustics and Linguistics: Bag-of-Audio-Words for the Recognition of Emotions in Speech

Author(s): Maximilian Schmitt, Fabien Ringeval, Björn Schuller
Published in: Interspeech 2016, 2016, Page(s) 495-499
Publisher: ISCA
DOI: 10.21437/Interspeech.2016-1124

Facing Realism in Spontaneous Emotion Recognition from Speech: Feature Enhancement by Autoencoder with LSTM Neural Networks

Author(s): Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, Björn Schuller
Published in: Interspeech 2016, 2016, Page(s) 3593-3597
Publisher: ISCA
DOI: 10.21437/Interspeech.2016-998

Towards Cross-lingual Automatic Diagnosis of Autism Spectrum Condition in Children's Voices

Author(s): Maximilian Schmitt ; Erik Marchi ; Fabien Ringeval ; Bjoern Schuller
Published in: Speech Communication; 12. ITG Symposium, 2016, ISBN 978-3-8007-4275-2
Publisher: VDE

A Bag-of-Audio-Words Approach for Snore Sounds’ Excitation Localisation

Author(s): Maximilian Schmitt Christoph Janott Vedhas Pandit Kun Qian Clemens Heiser Werner Hemmert Bjoern Schuller
Published in: Speech Communication; 12. ITG Symposium, 2016, ISBN 978-3-8007-4275-2
Publisher: VDE

The University of Passau Open Emotion Recognition System for the Multimodal Emotion Challenge

Author(s): Jun Deng, Nicholas Cummins, Jing Han, Xinzhou Xu, Zhao Ren, Vedhas Pandit, Zixing Zhang, Björn Schuller
Published in: In Proceedings of the 7th Chinese Conference on Pattern Recognition System for the Multimodal Emotion Challenge,, 2016, Page(s) 652-666
Publisher: Springer Singapore
DOI: 10.1007/978-981-10-3005-5_54

TensorLy: Tensor Learning in Python.

Author(s): Jean Kossaifi, Yannis Panagakis, Anima Anandkumar, Maja Pantic
Published in: NIPS Tensor-Learn Workshop, 2016
Publisher: NIPS

From Hard to Soft - Towards more Human-like Emotion Recognition by Modelling the Perception Uncertainty

Author(s): Jing Han, Zixing Zhang, Maximilian Schmitt, Maja Pantic, Björn Schuller
Published in: Proceedings of the 2017 ACM on Multimedia Conference - MM '17, 2017, Page(s) 890-897, ISBN 9781-450349062
Publisher: ACM Press
DOI: 10.1145/3123266.3123383

Recognising Guitar Effects – Which Acoustic Features Really Matter?

Author(s): Schmitt, Maximilian AND Schuller, Björn
Published in: INFORMATIK 2017, 2017, Page(s) 177-190
Publisher: Gesellschaft für Informatik

“You sound ill, take the day off”: Automatic recognition of speech affected by upper respiratory tract infection

Author(s): Nicholas Cummins, Maximilian Schmitt, Shahin Amiriparian, Jarek Krajewski, Bjorn Schuller
Published in: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017, Page(s) 3806-3809, ISBN 978-1-5090-2809-2
Publisher: IEEE
DOI: 10.1109/EMBC.2017.8037686

Enhancing LSTM RNN-Based Speech Overlap Detection by Artificially Mixed Data

Author(s): G. Hagerer, V. Pandit, F. Eyben, and B. Schuller
Published in: In Proceedings AES 56th International Conference on Semantic Audio, 2017
Publisher: AES

FERA 2017 - Addressing Head Pose in the Third Facial Expression Recognition and Analysis Challenge

Author(s): Michel F. Valstar, Enrique Sanchez-Lozano, Jeffrey F. Cohn, Laszlo A. Jeni, Jeffrey M. Girard, Zheng Zhang, Lijun Yin, Maja Pantic
Published in: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 2017, Page(s) 839-847, ISBN 978-1-5090-4023-0
Publisher: IEEE
DOI: 10.1109/FG.2017.107

Deep Structured Learning for Facial Action Unit Intensity Estimation

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Bjoern Schuller, Maja Pantic
Published in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, Page(s) 5709-5718, ISBN 978-1-5386-0457-1
Publisher: IEEE
DOI: 10.1109/CVPR.2017.605

Multi-Instance Dynamic Ordinal Random Fields for Weakly-Supervised Pain Intensity Estimation

Author(s): Adria Ruiz, Ognjen Rudovic, Xavier Binefa, Maja Pantic
Published in: 2017, Page(s) 171-186
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-54184-6_11

Variational Gaussian Process Auto-Encoder for Ordinal Prediction of Facial Action Units

Author(s): Stefanos Eleftheriadis, Ognjen Rudovic, Marc Peter Deisenroth, Maja Pantic
Published in: 2017, Page(s) 154-170, ISBN 978-3-319-54183-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-54184-6_10

AVEC 2017 - Real-life Depression, and Affect Recognition Workshop and Challenge

Author(s): Fabien Ringeval, Maja Pantic, Björn Schuller, Michel Valstar, Jonathan Gratch, Roddy Cowie, Stefan Scherer, Sharon Mozgai, Nicholas Cummins, Maximilian Schmitt
Published in: Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge - AVEC '17, 2017, Page(s) 3-9, ISBN 9781-450355025
Publisher: ACM Press
DOI: 10.1145/3133944.3133953

Affective Image Content Analysis: A Comprehensive Survey

Author(s): Sicheng Zhao, Guiguang Ding, Qingming Huang, Tat-Seng Chua, Björn W. Schuller, Kurt Keutzer
Published in: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, 2018, Page(s) 5534-5541, ISBN 9780-999241127
Publisher: International Joint Conferences on Artificial Intelligence Organization
DOI: 10.24963/ijcai.2018/780

Face Reading from Speech - Predicting Facial Action Units from Audio Cues

Author(s): F. Ringeval, E. Marchi, M. Mehu, K. Scherer, B. Schuller
Published in: INTERSPEECH 2015, 2015, ISSN 1990-9770
Publisher: Proceedings of INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association (ISCA) 2015

Neural conditional ordinal random fields for agreement level estimation

Author(s): Nemanja Rakicevic, Ognjen Rudovic, Stavros Petridis, Maja Pantic
Published in: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 2015, Page(s) 885-890, ISBN 978-1-4799-9953-8
Publisher: IEEE
DOI: 10.1109/ACII.2015.7344679

Sentiment apprehension in human-robot interaction with NAO

Author(s): Jie Shen, Ognjen Rudovic, Shiyang Cheng, Maja Pantic
Published in: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 2015, Page(s) 867-872, ISBN 978-1-4799-9953-8
Publisher: IEEE
DOI: 10.1109/ACII.2015.7344676

Variable-state latent conditional random fields for facial expression recognition and action unit detection

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic
Published in: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015, Page(s) 1-8, ISBN 978-1-4799-6026-2
Publisher: IEEE
DOI: 10.1109/FG.2015.7163137

Latent trees for estimating intensity of Facial Action Units

Author(s): Sebastian Kaltwang, Sinisa Todorovic, Maja Pantic
Published in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, Page(s) 296-304, ISBN 978-1-4673-6964-0
Publisher: IEEE
DOI: 10.1109/CVPR.2015.7298626

Fast and exact bi-directional fitting of active appearance models

Author(s): Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
Published in: 2015 IEEE International Conference on Image Processing (ICIP), 2015, Page(s) 1135-1139, ISBN 978-1-4799-8339-1
Publisher: IEEE
DOI: 10.1109/ICIP.2015.7350977

Cross-language acoustic emotion recognition: An overview and some tendencies

Author(s): Silvia Monica Feraru, Dagmar Schuller, Bjdrn Schuller
Published in: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 2015, Page(s) 125-131, ISBN 978-1-4799-9953-8
Publisher: IEEE
DOI: 10.1109/ACII.2015.7344561

Detection of negative emotions in speech signals using bags-of-audio-words

Author(s): Florian B. Pokorny, Franz Graf, Franz Pernkopf, Bjorn W. Schuller
Published in: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 2015, Page(s) 879-884, ISBN 978-1-4799-9953-8
Publisher: IEEE
DOI: 10.1109/ACII.2015.7344678

Modelling User Affect and Sentiment in Intelligent User Interfaces - A Tutorial Overview

Author(s): Björn W. Schuller
Published in: Proceedings of the 20th International Conference on Intelligent User Interfaces - IUI '15, 2015, Page(s) 443-446, ISBN 9781-450333061
Publisher: ACM Press
DOI: 10.1145/2678025.2716265

AV+EC 2015 - The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data

Author(s): Fabien Ringeval, Björn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie, Maja Pantic
Published in: Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge - AVEC '15, 2015, Page(s) 3-8, ISBN 9781-450337434
Publisher: ACM Press
DOI: 10.1145/2808196.2811642

Summary for AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challenge

Author(s): Michel Valstar, Jonathan Gratch, Björn Schuller, Fabien Ringeval, Roddy Cowie, Maja Pantic
Published in: Proceedings of the 2016 ACM on Multimedia Conference - MM '16, 2016, Page(s) 1483-1484, ISBN 9781-450336031
Publisher: ACM Press
DOI: 10.1145/2964284.2980532

AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challenge

Author(s): Michel Valstar, Maja Pantic, Jonathan Gratch, Björn Schuller, Fabien Ringeval, Dennis Lalanne, Mercedes Torres Torres, Stefan Scherer, Giota Stratou, Roddy Cowie
Published in: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge - AVEC '16, Issue October 2016, 2016, Page(s) 3-10, ISBN 9781-450345163
Publisher: ACM Press
DOI: 10.1145/2988257.2988258

Deep Structured Ordinal Regression for Facial Action Unit Intensity Estimation

Author(s): R. Walecki, O. Rudovic, V. Pavlovic, B. Schueller, M. Pantic
Published in: Proceedings of the conference on Computer Vision and Pattern Recognition, Issue July 2017, 2017
Publisher: IEEE

Temporal Archetypal Analysis for Action Segmentation

Author(s): Eftychia Fotiadou, Yiannis Panagakis, Maja Pantic
Published in: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 2017, Page(s) 490-496, ISBN 978-1-5090-4023-0
Publisher: IEEE
DOI: 10.1109/FG.2017.66

Prediction-based learning for continuous emotion recognition in speech

Author(s): Jing Han, Zixing Zhang, Fabien Ringeval, Bjorn Schuller
Published in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue March 2017, 2017, Page(s) 5005-5009, ISBN 978-1-5090-4117-6
Publisher: IEEE
DOI: 10.1109/ICASSP.2017.7953109

Reconstruction-error-based learning for continuous emotion recognition in speech

Author(s): Jing Han, Zixing Zhang, Fabien Ringeval, Bjorn Schuller
Published in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017, Page(s) 2367-2371, ISBN 978-1-5090-4117-6
Publisher: IEEE
DOI: 10.1109/ICASSP.2017.7952580

Audio-visual object localization and separation using low-rank and sparsity

Author(s): Jie Pu, Yannis Panagakis, Stavros Petridis, Maja Pantic
Published in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017, Page(s) 2901-2905, ISBN 978-1-5090-4117-6
Publisher: IEEE
DOI: 10.1109/ICASSP.2017.7952687

End-to-end visual speech recognition with LSTMS

Author(s): Stavros Petridis, Zuwei Li, Maja Pantic
Published in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue 2017, 2017, Page(s) 2592-2596, ISBN 978-1-5090-4117-6
Publisher: IEEE
DOI: 10.1109/ICASSP.2017.7952625

You sound ill, take the day off: Classification of speech affected by Upper Respiratory Tract Infection

Author(s): N. Cummins, M. Schmitt, S. Amiriparian, J. Krajewski, and B. Schuller
Published in: Proceedings of International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2017
Publisher: IEEE

A Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic
Published in: IEEE Transactions on Affective Computing, 2018, Page(s) 1-1, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TAFFC.2017.2728534

AFEW-VA database for valence and arousal estimation in-the-wild

Author(s): Jean Kossaifi, Georgios Tzimiropoulos, Sinisa Todorovic, Maja Pantic
Published in: Image and Vision Computing, Issue 65, 2017, Page(s) 23-36, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2017.02.001

Discrimination Between Native and Non-Native Speech Using Visual Features Only

Author(s): Christos Georgakis, Stavros Petridis, Maja Pantic
Published in: IEEE Transactions on Cybernetics, Issue 46/12, 2016, Page(s) 2758-2771, ISSN 2168-2267
Publisher: IEEE Advancing Technology for Humanity
DOI: 10.1109/TCYB.2015.2488592

Doubly Sparse Relevance Vector Machine for Continuous Facial Behavior Estimation

Author(s): Sebastian Kaltwang, Sinisa Todorovic, Maja Pantic
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 38/9, 2016, Page(s) 1748-1761, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TPAMI.2015.2501824

Continuous Estimation of Emotions in Speech by Dynamic Cooperative Speaker Models

Author(s): Arianna Mencattini, Eugenio Martinelli, Fabien Ringeval, Bjorn Schuller, Corrado Di Natale
Published in: IEEE Transactions on Affective Computing, Issue 8/3, 2017, Page(s) 314-327, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TAFFC.2016.2531664

Discriminant Incoherent Component Analysis

Author(s): Christos Georgakis, Yannis Panagakis, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 25/5, 2016, Page(s) 2021-2034, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2016.2539502

openXBOW - Introducing the Passau Open-Source Crossmodal Bag-of-Words Toolkit

Author(s): Schmitt, Maximilian; Schuller, Björn W.
Published in: The Journal of Machine Learning Research, Issue 16, 2016, Page(s) Volume 18 Issue 1, January 2017, pages 3370-3374, ISSN 1532-4435
Publisher: MIT Press

Robust Correlated and Individual Component Analysis

Author(s): Yannis Panagakis, Mihalis A. Nicolaou, Stefanos Zafeiriou, Maja Pantic
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 38/8, 2016, Page(s) 1665-1678, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TPAMI.2015.2497700

Behavioral cues help predict impact of advertising on future sales

Author(s): Gábor Szirtes, Javier Orozco, István Petrás, Dániel Szolgay, Ákos Utasi, Jeffrey F. Cohn
Published in: Image and Vision Computing, Issue 65, 2017, Page(s) 49-57, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2017.03.002

Variable-state Latent Conditional Random Field models for facial expression analysis

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic
Published in: Image and Vision Computing, Issue 58, 2017, Page(s) 25-37, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2016.04.009

Multi-Instance Dynamic Ordinal Random Fields for Weakly Supervised Facial Behavior Analysis

Author(s): Adria Ruiz, Ognjen Rudovic, Xavier Binefa, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 27/8, 2018, Page(s) 3969-3982, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2018.2830189

Gaussian Process Domain Experts for Modeling of Facial Affect

Author(s): Stefanos Eleftheriadis, Ognjen Rudovic, Marc Peter Deisenroth, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 26/10, 2017, Page(s) 4697-4711, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2017.2721114

Nonnegative Decompositions for Dynamic Visual Data Analysis

Author(s): Lazaros Zafeiriou, Yannis Panagakis, Maja Pantic, Stefanos Zafeiriou
Published in: IEEE Transactions on Image Processing, Issue 26/12, 2017, Page(s) 5603-5617, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2017.2735186

A survey of multimodal sentiment analysis

Author(s): Mohammad Soleymani, David Garcia, Brendan Jou, Björn Schuller, Shih-Fu Chang, Maja Pantic
Published in: Image and Vision Computing, Issue 65, 2017, Page(s) 3-14, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2017.08.003

Automatic Analysis of Facial Actions: A Survey

Author(s): Brais Martinez, Michel F. Valstar, Bihan Jiang, Maja Pantic
Published in: IEEE Transactions on Affective Computing, 2017, Page(s) 1-1, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TAFFC.2017.2731763

Leveraging Unlabeled Data for Emotion Recognition With Enhanced Collaborative Semi-Supervised Learning

Author(s): Zixing Zhang, Jing Han, Jun Deng, Xinzhou Xu, Fabien Ringeval, Bjorn Schuller
Published in: IEEE Access, Issue 6, 2018, Page(s) 22196-22209, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2018.2821192

Fast and Exact Newton and Bidirectional Fitting of Active Appearance Models

Author(s): Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 26/2, 2017, Page(s) 1040-1053, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2016.2642828

Fast Algorithms for Fitting Active Appearance Models to Unconstrained Images

Author(s): Georgios Tzimiropoulos, Maja Pantic
Published in: International Journal of Computer Vision, Issue 122/1, 2017, Page(s) 17-33, ISSN 0920-5691
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s11263-016-0950-1

Robust statistical frontalization of human and animal faces

Author(s): Sagonas, Christos; Panagakis, Yannis; Zafeiriou, Stefanos; Pantic, Maja
Published in: urn:issn:0920-5691, Issue 3, 2016, ISSN 0920-5691
Publisher: Kluwer Academic Publishers
DOI: 10.13039/501100000761

300 Faces In-The-Wild Challenge: database and results

Author(s): Christos Sagonas, Epameinondas Antonakos, Georgios Tzimiropoulos, Stefanos Zafeiriou, Maja Pantic
Published in: Image and Vision Computing, Issue 47, 2016, Page(s) 3-18, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2016.01.002

An array of physical sensors and an adaptive regression strategy for emotion recognition in a noisy scenario

Author(s): Francesco Mosciano, Arianna Mencattini, Fabien Ringeval, Björn Schuller, Eugenio Martinelli, Corrado Di Natale
Published in: Sensors and Actuators A: Physical, Issue 267, 2017, Page(s) 48-59, ISSN 0924-4247
Publisher: Elsevier BV
DOI: 10.1016/j.sna.2017.09.056

End-to-End Multimodal Emotion Recognition Using Deep Neural Networks

Author(s): Panagiotis Tzirakis, George Trigeorgis, Mihalis A. Nicolaou, Bjorn W. Schuller, Stefanos Zafeiriou
Published in: IEEE Journal of Selected Topics in Signal Processing, Issue 11/8, 2017, Page(s) 1301-1309, ISSN 1932-4553
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2764438

Connecting Subspace Learning and Extreme Learning Machine in Speech Emotion Recognition

Author(s): Xinzhou Xu, Jun Deng, Eduardo Coutinho, Chen Wu, Li Zhao, Bjorn W. Schuller
Published in: IEEE Transactions on Multimedia, 2018, Page(s) 1-1, ISSN 1520-9210
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TMM.2018.2865834

Prediction-based Audiovisual Fusion for Classification of Non-Linguistic Vocalisations

Author(s): Stavros Petridis, Maja Pantic
Published in: IEEE Transactions on Affective Computing, 2016, Page(s) 1-1, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TAFFC.2015.2446462

Probabilistic Slow Features for Behavior Analysis

Author(s): Lazaros Zafeiriou, Mihalis A. Nicolaou, Stefanos Zafeiriou, Symeon Nikitidis, Maja Pantic
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2016, Page(s) 1-1, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/TNNLS.2015.2435653

The Conflict Escalation Resolution (CONFER) Database

Author(s): Christos Georgakis, Yannis Panagakis, Stefanos Zafeiriou, Maja Pantic
Published in: Image and Vision Computing, 2016, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2016.12.001

Dynamic Behavior Analysis via Structured Rank Minimization

Author(s): Christos Georgakis, Yannis Panagakis, Maja Pantic
Published in: International Journal of Computer Vision, 2016, Page(s) 1-25, ISSN 0920-5691
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s11263-016-0985-3

Strength modelling for real-worldautomatic continuous affect recognition from audiovisual signals

Author(s): Jing Han, Zixing Zhang, Nicholas Cummins, Fabien Ringeval, Björn Schuller
Published in: Image and Vision Computing, 2016, ISSN 0262-8856
Publisher: Elsevier BV
DOI: 10.1016/j.imavis.2016.11.020

Speech Analysis in the Big Data Era

Author(s): Björn W. Schuller
Published in: Text, Speech, and Dialogue, 2015, Page(s) 3-11, ISBN 978-3-319-24033-6
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-24033-6_1

Searching for OpenAIRE data...

Deliverables

Publications

Share this page

Download