Skip to main content

Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities

Deliverables

Project presentation, communication kit, website, communication and dissemination plan

D9.1 will set the major goals of dissemination objectives, will define common guidelines to be used by all partners and will provide the planned dissemination actions including specific SUG actions. It will also include the setup of the project website.

Final system report

D8.9 will on the one side contain: (i) the assessment of the functionality of the final system, compared with the targeted functionality specified for MS5; (ii) the summary of the evaluation of the performance of the individual techniques in accordance with the corresponding performance indicators; (iii) assessment of the overall user satisfaction and the capability of the user to interact with the integrated platform. On the other side, it will also report on the work of the Ethical Board during the third year of the project.

Empirical study of the vocal aspects of the user interventions in dialogues

D3.1 contributes to the achievement of the MSs 2 – 5. It will summarize the analysis of the vocal interventions of users in sample dialogues (collected in WP8) in all languages covered in KRISTINA, from both the verbal and paralinguistic angle, and outline the requirements that result from this analysis towards the technologies for processing of the vocal contributions of the user in KRISTINA.

Requirements for Dialogue Management in adaptive Human-Machine-Communication

D2.1 contributes primarily to the achievement of MS1, but also serves as basis for decisions taken for the achievement of the MSs 2 – 5. It will, on the one side, summarize the analysis of sample dialogues of all scenarios of the PUCs collected in WP8 in terms of the systematicity of turns and turn markers, affection, culture-specific phenomena that influence dialogue, etc. for the languages and cultural settings covered in KRISTINA. On the other side, it will contain the requirements for the DM that result from this analysis.

Empirical study on web resources and social media

D5.1 reports the outcome of the empirical study of Task 5.1.

Public final activity report

D1.5 contributes to Milestone MS5. The deliverable will contain: (i) the presentation of the Consortium, (ii) the presentation of the objectives of PESCaDO; (iii) a summary of the results of the Project; (iv) the impact achieved by the Project.

Empirical study of the non-verbal vocal aspects of the user interventions in dialogues

D4.1 contributes to the achievement of the MSs 2 – 5. It will present the results of the analysis of the facial and gestural contributions of users in sample dialogues (collected in WP8), from both the content and social and emotional angle, and outline the requirements that result from this analysis towards the technologies for processing of the facial and gestural contributions of the user in KRISTINA.

Empirical study of the communication of experts with users

D6.1 will contain the results of the empirical study and the requirements to the communication of the KRISTINA agent with users.

Advanced version of the vocal analysis techniques in KRISTINA

D3.3 contributes to the achievement of MS4 and MS5. It will present the advanced functionality of the vocal analysis techniques in KRISTINA. Two versions of the deliverable will be submitted. The first version will describe the functionality of the second prototype of the KRISTINA agent with respect to vocal analysis and will be due M26. The second version will describe the functionality of the final vocal analysis techniques and will be due M32.

Integration of the OwlSpeak Platform into the KRISTINA architecture

D2.2 contributes to MS2. It will outline the original architecture and functionality of OwlSpeak, discuss them in the light of the requirements of KRISTINA and specify the extensions of OwlSpeak and the interfaces via which OwlSpeak is integrated into KRISTINA. In the demonstration part of D2.2, this integration and the envisaged functionality is shown.

Advanced version of the mimics and gesture analysis techniques

D4.3 contributes to the achievement of MS4 and MS5. It will present the advanced functionality of the non-verbal analysis techniques in KRISTINA. Two versions of the deliverable will be submitted. The first version will describe the functionality of the second prototype of the KRISTINA agent with respect to non-verbal analysis and will be due M26. The second version will describe the functionality of the final non-verbal analysis techniques and will be due M34.

Advanced version of the ontologies and reasoning techniques

D5.4 will describe and show the advanced version of the reasoning techniques as developed in the second half of the project.

Advanced version of the KRISTINA generic adaptive dialogue manager

D2.5 contributes to MS5. It will present the final version of the KRISTINA DM., outlining in detail the language and cultural aspects of the dialogue planning developed in KRISTINA for all languages and cultural contexts tackled in the project. It will also elaborate on the functionality of the final modality merge module.

Advanced version of the avatar communication

D6.3 will describe and show the functionality of the advanced version of the integrated multimodality communication of the KRISTINA avatar. The discourse and speech generation will handle all languages covered in KRISTINA. The developed avatar will realize a holistic animation engine that will cover not only the facial animation, but the whole body animation.

Advanced version of query formulation, search and content extraction

D5.5 will describe and show the final semantic framework (T5.2) and the advanced version of the query formulation, search and content extraction as developed in the second half of the project.

Final System

D7.5 will cover topics specified as objectives of MS5. It will consist of a demonstration and a report part.

Publications

Attentional Parallel RNNs for Generating Punctuation in Transcribed Speech

Author(s): Alp Öktem, Mireia Farrús, Leo Wanner
Published in: Statistical Language and Speech Processing. SLSP 2017. Lecture Notes in Computer Science, vol 10583, 2017, Page(s) 131-142
DOI: 10.1007/978-3-319-68456-7_11

Unsupervised Keyword Extraction Using the GoW Model and Centrality Scores

Author(s): Elissavet Batziou, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Antoniou, Ioannis Kompatsiaris
Published in: Internet Science. INSCI 2017. Lecture Notes in Computer Science, vol 10673, 2017, Page(s) 344-351
DOI: 10.1007/978-3-319-70284-1_26

KRISTINA: A Knowledge-Based Virtual Conversation Agent

Author(s): Leo Wanner, Elisabeth André, Josep Blat, Stamatia Dasiopoulou, Mireia Farrùs, Thiago Fraga, Eleni Kamateri, Florian Lingenfelser, Gerard Llorach, Oriol Martínez, Georgios Meditskos, Simon Mille, Wolfgang Minker, Louisa Pragst, Dominik Schiller, Andries Stam, Ludo Stellingwerff, Federico Sukno, Bianca Vieru, Stefanos Vrochidis
Published in: Advances in Practical Applications of Cyber-Physical Multi-Agent Systems: The PAAMS Collection. PAAMS 2017. Lecture Notes in Computer Science, vol 10349, 2017, Page(s) 284-295
DOI: 10.1007/978-3-319-59930-4_23

A Topic Detection and Visualisation System on Social Media Posts

Author(s): Stelios Andreadis, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Kompatsiaris
Published in: INSCI 2017. Lecture Notes in Computer Science, vol 10673, 2017, Page(s) 421-427
DOI: 10.1007/978-3-319-70284-1_33

Description Logics and Rules for Multimodal Situational Awareness in Healthcare

Author(s): Georgios Meditskos, Stefanos Vrochidis, Ioannis Kompatsiaris
Published in: MultiMedia Modeling. MMM 2017, 2017, Page(s) 714-725
DOI: 10.1007/978-3-319-51811-4_58

Recurrent Neural Network Interaction Quality Estimation

Author(s): Louisa Pragst, Stefan Ultes, Wolfgang Minker
Published in: Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427, 2017, Page(s) 381-393
DOI: 10.1007/978-981-10-2585-3_31

VERGE in VBS 2018

Author(s): Moumtzidou, S. Andreadis, F. Markatopoulou, D. Galanopoulos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras
Published in: MultiMedia Modeling. MMM 2018. Lecture Notes in Computer Science, vol 10705, 2018

VERGE IN VBS 2017

Author(s): Moumtzidou, A., T. Mironidis, F. Markatopoulou, S. Andreadis, I. Gialampoukidis, D. Galanopoulos, A. Ioannidou, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras
Published in: MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science, vol 10133, 2017

Automatic Viseme Vocabulary Construction to Enhance Continuous Lip-reading

Author(s): Adriana Fernandez-Lopez, Federico M. Sukno
Published in: Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2017, Page(s) 52-63
DOI: 10.5220/0006102100520063

Automatic extraction of parallel speech corpora from dubbed movies

Author(s): Öktem, Alp; Farrús, Mireia; Wanner, Leo
Published in: Proceedings of the 10th Workshop on Building and Using Comparable Corpora (BUCC), 2017

A Thematicity-based prosody enrichment tool for CTS

Author(s): Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Published in: INTERSPEECH 2017, 2017

UPF at EPE 2017: transduction-based deep analysis

Author(s): Mille, Simon; Latorre, Iván; Wanner, Leo
Published in: Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation (EPE 2017, 2017

Prosograph: a tool for prosody visualisation of large speech corpora

Author(s): Öktem, Alp; Farrús, Mireia; Wanner, Leo
Published in: INTERSPEECH 2017, 2017

Using Prosody to Classify Discourse Relations

Author(s): Janine Kleinhans, Mireia Farrús, Agustín Gravano, Juan Manuel Pérez, Catherine Lai, Leo Wanner
Published in: Interspeech 2017, 2017, Page(s) 3201-3205
DOI: 10.21437/Interspeech.2017-710

A Social companion and conversation partner for elderly

Author(s): Miehle, Juliana; Bagci, Ilker; Minker, Wolfgang; Ultes, Stefan
Published in: 8th International Workshop On Spoken Dialogue Systems (IWSDS), 2017

Towards reasoned modality selection in an embodied conversation agent

Author(s): Ten-Ventura, Carla; Carlini, Roberto; Dasiopoulou, Stamatia; LLorach Tó, Gerard; Wanner, Leo
Published in: Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science, vol 10498, 2017

A Hybrid approach for biomedical relation extraction using finite state automata and random forest-weighted fusion

Author(s): Mavropoulos, Thanassis; Liparas, Dimitris; Symeonidis, Spyridon; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Published in: 18th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing 2017), 2017

Interaction quality estimation using long short-term memories

Author(s): Rach, Niklas; Minker, Wolfgang; Ultes, Stefan
Published in: Proceedings of the SIGDIAL 2017 Conference, 2017, Page(s) 164-169

Topic detection using the DBSCAN-Martingale and the time operator

Author(s): Gialampoukidis, Ilias; Vrochidis, Stefanos; Kompatsiaris, Ioannis; Antoniou, Ioannis
Published in: The 17th Conference of the Applied Stochastic Models and Data Analysis (ASMDA), 2017

Exploring the applicability of elaborateness and indirectness in dialogue management

Author(s): Pragst, Louisa; Minker, Wolfgang; Ultes, Stefan
Published in: 8th International Workshop On Spoken Dialogue Systems (IWSDS), 2017

Revising the METU-Sabancı Turkish treebank: an exercise in surface-syntactic annotation of agglutinative languages

Author(s): Burga Díaz, Alicia; Öktem, Alp; Wanner, Leo
Published in: Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), 2017

A Demo of FORGe: the Pompeu Fabra open rule-based generator

Author(s): Mille, Simon; Wanner, Leo
Published in: Proceedings of The 10th International Natural Language Generation conference, 2017

Web-Based Live Speech-Driven Lip-Sync

Author(s): Gerard Llorach, Alun Evans, Josep Blat, Giso Grimm, Volker Hohmann
Published in: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), 2016, Page(s) 1-4
DOI: 10.1109/vs-games.2016.7590381

FORGe at SemEval-2017 Task 9: deep sentence generation based on a sequence of graph transducers

Author(s): Mille, Simon; Carlini, Roberto; Burga Díaz, Alicia; Wanner, Leo
Published in: SemEval 2017, 2017

Neural Architectures for Named Entity Recognition

Author(s): Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer
Published in: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Page(s) 260-270
DOI: 10.18653/v1/n16-1030

A hybrid graph-based and non-linear late fusion approach for multimedia retrieval

Author(s): Ilias Gialampoukidis, Anastasia Moumtzidou, Dimitris Liparas, Stefanos Vrochidis, Ioannis Kompatsiaris
Published in: 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI), 2016, Page(s) 1-6
DOI: 10.1109/CBMI.2016.7500252

Automatic Modification of Communication Style in Dialogue Management

Author(s): Louisa Pragst, Juliana Miehle, Stefan Ultes, Wolfgang Minker
Published in: Proceedings of the INLG 2016 Workshop on Computational Creativity in Natural Language Generation, 2016, Page(s) 36-40
DOI: 10.18653/v1/w16-5506

Combining acoustic and linguistic features in phrase-oriented prosody prediction

Author(s): Mónica Dominguez, Mireia Farrús, Leo Wanner
Published in: Speech Prosody 2016, 2016, Page(s) 796-800
DOI: 10.21437/speechprosody.2016-163

Paragraph-based prosodic cues for speech synthesis applications

Author(s): Mireia Farrús, Catherine Lai, Johanna D. Moore
Published in: Speech Prosody 2016, 2016, Page(s) 1143-1147
DOI: 10.21437/speechprosody.2016-235

Semantics-Driven Recognition of Collocations Using Word Embeddings

Author(s): Sara Rodríguez-Fernández, Luis Espinosa Anke, Roberto Carlini, Leo Wanner
Published in: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2016, Page(s) 499-505
DOI: 10.18653/v1/p16-2081

Question Answering over Pattern-Based User Models

Author(s): Georgios Meditskos, Stamatia Dasiopoulou, Stefanos Vrochidis, Leo Wanner, Ioannis Kompatsiaris
Published in: Proceedings of the 12th International Conference on Semantic Systems - SEMANTiCS 2016, 2016, Page(s) 153-160
DOI: 10.1145/2993318.2993331

Using hierarchical information structure for prosody prediction in content-to-speech applications

Author(s): Domínguez Bajo, Mónica; Farrús, Mireia; Burga Díaz, Alicia; Wanner, Leo
Published in: Proceedings of Speech Prosody 8, 2016
DOI: 10.13140/RG.2.1.2643.1128

Towards an Ontology-Driven Adaptive Dialogue Framework

Author(s): Georgios Meditskos, Stamatia Dasiopoulou, Louisa Pragst, Stefan Ultes, Stefanos Vrochidis, Ioannis Kompatsiaris, Leo Wanner
Published in: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 15-20
DOI: 10.1145/2927006.2927009

Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities

Author(s): Leo Wanner, Ioannis Kompatsiaris, Elisabeth André, Florian Lingenfelser, Gregor Mehlmann, Andries Stam, Ludo Stellingwerff, Bianca Vieru, Lori Lamel, Wolfgang Minker, Louisa Pragst, Josep Blat, Stefan Ultes, Stamatia Dasiopoulou, Mónica Domínguez, Gerard Llorach, Simon Mille, Federico Sukno, Eleni Kamateri, Stefanos Vrochidis
Published in: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 21-26
DOI: 10.1145/2927006.2927011

Automatic Paragraph Segmentation with Lexical and Prosodic Features

Author(s): Catherine Lai, Mireia Farrús, Johanna D. Moore
Published in: Interspeech 2016, Issue Proceedings of Interspeech 2016, 2016, Page(s) 1034-1038
DOI: 10.21437/Interspeech.2016-992

An automatic prosody tagger for spontaneous speech

Author(s): Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Published in: Proceedings of COLING, 2016

Transition-based Spinal Parsing

Author(s): Miguel Ballesteros, Xavier Carreras
Published in: Proceedings of the Nineteenth Conference on Computational Natural Language Learning, 2015, Page(s) 289-299
DOI: 10.18653/v1/k15-1029

Recurrent Neural Network Grammars

Author(s): Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
Published in: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Page(s) 199-209
DOI: 10.18653/v1/n16-1024

From Emotions to Action Units with Hidden and Semi-Hidden-Task Learning

Author(s): Adria Ruiz, Joost Van de Weijer, Xavier Binefa
Published in: 2015 IEEE International Conference on Computer Vision (ICCV), 2015, Page(s) 3703-3711
DOI: 10.1109/iccv.2015.422

Combining acoustic and linguistic features in phrase-oriented prosody prediction

Author(s): Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Published in: Proceedings of Speech Prosody 8, 2016
DOI: 10.13140/RG.2.1.3691.6886

A Neural Network Architecture for Multilingual Punctuation Generation

Author(s): Miguel Ballesteros, Leo Wanner
Published in: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, Page(s) 1048-1053
DOI: 10.18653/v1/d16-1111

A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain

Author(s): Federico Sukno, Mónica Domínguez, Adria Ruiz, Dominik Schiller, Florian Lingenfelser, Louisa Pragst, Ekeni Kamateri, Stefanos Vrochidis
Published in: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 9-14
DOI: 10.1145/2927006.2927008

Cultural Communication Idiosyncrasies in Human-Computer Interaction

Author(s): Juliana Miehle, Koichiro Yoshino, Louisa Pragst, Stefan Ultes, Satoshi Nakamura, Wolfgang Minker
Published in: Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2016, Page(s) 74-79
DOI: 10.18653/v1/w16-3610

Improved Transition-based Parsing by Modeling Characters instead of Words with LSTMs

Author(s): Miguel Ballesteros, Chris Dyer, Noah A. Smith
Published in: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015, Page(s) 349-359
DOI: 10.18653/v1/d15-1041

Praat on the Web: an upgrade of Praat for semi-automatic speech annotation

Author(s): Domínguez Bajo, Mónica; Latorre, Iván; Farrús, Mireia; Codina-Filbà, Joan; Wanner, Leo
Published in: Proceedings of COLING 2016, 2016

Ontology-driven context interpretation and conflict resolution for dialogue-based home care assistance

Author(s): Meditskos, Georgios; Kontopoulos, Efstratios; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Published in: Proceedings of the 9th International Conference Semantic Web Applications and Tools for Life Sciences (SWAT4LS), 2016

Extending WordNet with fine-grained collocational information via supervised distributional learning

Author(s): Espinosa-Anke, Luis; Camacho-Collados, Jose; Rodríguez Fernández, Sara; Saggion, Horacio; Wanner, Leo
Published in: Proceedings of COLING 2016, 2016

Example-based acquisition of fine-grained collocational resources

Author(s): Rodríguez Fernández, Sara; Carlini, Roberto; Espinosa-Anke, Luis; Wanner, Leo
Published in: Proceedings of the International Conference on Linguistic Resources and Evaluation (LREC), 2016

Visualizing Deep-Syntactic Parser Output

Author(s): Juan Soler-Company, Miguel Ballesteros, Bernd Bohnet, Simon Mille, Leo Wanner
Published in: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 2015, Page(s) 56-60
DOI: 10.3115/v1/n15-3012

Transition-Based Dependency Parsing with Stack Long Short-Term Memory

Author(s): Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, Noah A. Smith
Published in: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2015, Page(s) 334-343
DOI: 10.3115/v1/p15-1033

Adaptive dialogue management in the KRISTINA project for multicultural health care applications

Author(s): Pragst, Louisa; Ultes, Stefan; Kraus, Matthias; Minker, Wolfgang
Published in: Proceedings of the 19thWorkshop on the Semantics and Pragmatics of Dialogue, 2016

A multimedia interactive search engine based on graph-based and non-linear multimodal fusion

Author(s): Anastasia Moumtzidou, Ilias Gialampoukidis, Theodoros Mironidis, Dimitris Liparas, Stefanos Vrochidis, Ioannis Kompatsiaris
Published in: 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI), 2016, Page(s) 1-4
DOI: 10.1109/CBMI.2016.7500276

Query-based topic detection using concepts and named entities

Author(s): Gialampoukidis, Ilias; Liparas, Dimitris; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Published in: Proceedings of the 1st International Workshop on Multimodal Media Data Analytics, 2016

Data-driven sentence generation with non-isomorphic trees

Author(s): Ballesteros, Miguel; Bohnet, Bernd; Mille, Simon; Wanner, Leo
Published in: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2015

Transition-based dependency parsing with heuristic backtracking

Author(s): Buckman, Jacob; Ballesteros, Miguel; Dyer, Chris
Published in: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

Compilation of Corpora for the Study of the Information Structure-Prosody Interface

Author(s): Domínguez, M., A. Burga, M. Farrús, L. Wanner
Published in: Proceedings of the Language Resources and Evaluation Conferece, 2018

Paragraph prosodic patterns to enhance text-to-speech naturalness

Author(s): Peiró-Lilja, A., M. Farrús
Published in: Proceedings of the Speech Prosody Conference, 2018

Thematicity-based prosody enrichment for text-to-speech applications

Author(s): Domínguez, M., M. Farrús, L. Wanner
Published in: Proceedings of the Speech Prosody Conference, 2018

Effects of Gender Stereotypes on Trust and Likability in Spoken Human-Robot Interaction

Author(s): Kraus, M., J. Kraus, M. Baumann and W. Minker
Published in: Proceedings of LREC, 2018

On the Vector Representation of Utterances in Dialogue Context

Author(s): Pragst, L., N. Rach, W. Minker and S. Ultes
Published in: Proceedings of LREC 2018, 2018

What Causes the Differences in Communication Styles? A Multicultural Study on Directness and Elaborateness

Author(s): Miehle, J., W. Minker and S. Ultes
Published in: Proceedings of LREC 2018, 2018

Compilation of Corpora for the Study of the Information Structure–Prosody Interface

Author(s): Burga, A., M. Domínguez, M. Farrús and L. Wanner
Published in: Proceedings of LREC 2018, 2018

Animation On The Web: A Survey

Author(s): A. Ahire, A. A.Evans, and J. Blat
Published in: ACM Web3D 2015, 2015

Data driven sentence generation with non-isomorphic trees

Author(s): M. Ballesteros, B. Bohnet, S. Mille, and L. Wanner
Published in: Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL), 2015

Improved Transition-Based Parsing by Modeling Characters instead of Words with LSTMs

Author(s): M. Ballesteros, C. Dyer and N. Smith
Published in: International Conference on Empirical Methods in NLP, 2015

Transition-Based Spinal Parsing

Author(s): M. Ballesteros and X. Carreras
Published in: International Conference on Natural Language Learning (CoNLL), 2015

Using Hierarchical Information Structure for Prosody Prediction in Content-to-Speech Application

Author(s): M. Domínguez, M. Farrús, A. Burga, and L. Wanner
Published in: Speech Prosody, 2016

Static and Dynamic Feature Selection in Morphosyntactic Analyzers

Author(s): B. Bohnet., M. Ballesteros, R. McDonald and J. Nivre
Published in: Arxiv, Issue arXiv:1513.655, 2016

Training with Exploration Improves a Greedy Stack-LSTM Parser

Author(s): M. Ballesteros, Y. Goldberg, C. Dyer and N. Smith
Published in: Arxiv, Issue arXiv:1603.03793, 2016

Combining Acoustic and Linguistic Features in Phrase-Oriented Prosody Prediction

Author(s): M. Domínguez, M. Farrús, L. Wanner
Published in: Speech Prosody, 2016

Transition-Based Dependency Parsing with Stack Long Short-Term Memory

Author(s): C. Dyer, M. Ballesteros, W. Ling, A. Matthews and N. Smith
Published in: Annual Meeting of the Association for Computational Linguistics (ACL), 2015

Recurrent Neural Network Grammars

Author(s): C. Dyer, A. Kuncoro, M. Ballesteros and N. Smith
Published in: Annual Meeting of the North American Chapter of the ACL, 2016

Paragraph-based Prosodic Cues for Speech Synthesis Applications

Author(s): M. Farrús, G., Lai, and J.D. Moore
Published in: Speech Prosody, 2016

Retrieval of Multimedia objects by Fusing Multiple Modalities

Author(s): I. Gialampoukidis, A. Moumtzidou, T. Tsikrika, S. Vrochidis and I. Kompatsiaris
Published in: International Conference on Multimedia Retrieval (ICMR), 2016
DOI: 10.1145/2911996.2912068

A hybrid framework for news clustering based on the DBSCAN-Martingale and LDA

Author(s): I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris
Published in: 12th International Conference on Machine Learning and Data Mining, 2016
DOI: 10.1007/978-3-319-41920-6_13

Neural Architectures for Named Entity Recognition

Author(s): G. Lample, M. Ballesteros, K. Kawakami, S. Subramanian and C. Dyer
Published in: Annual Meeting of the North American Chapter of the ACL, 2016

Exploiting visual similarities for ontology alignment

Author(s): C. Doulaverakis, S. Vrochidis, and I. Kompatsiaris
Published in: Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, 2015

Towards an Ontology-driven Adaptive Dialogue Framework

Author(s): G. Meditskos
Published in: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016

Adaptive Dialogue Management in the KRISTINA Project for Multicultural Health Care Applications

Author(s): Louisa Pragst, Stefan Ultes, Matthias Kraus, and Wolfgang Minker
Published in: Proceedings of the 19thWorkshop on the Semantics and Pragmatics of Dialogue (SEMDIAL), 2015, Page(s) 202-203

Fast Visual Vocabulary Construction for Image Retrieval using Skewed-Split k-d trees

Author(s): Ilias Gialampoukidis, Stefanos Vrochidis, and Ioannis Kompatsiaris
Published in: Proceedings of the 22nd International Conference on MultiMedia Modeling (MMM16), 2016

Recurrent Neural Network Interaction Quality Estimation

Author(s): Louisa Pragst, Stefan Ultes, and Wolfgang Minker
Published in: Proceedings of the Seventh International Workshop on Spoken Dialogue Systems, 2016

An Automatic Prosody Tagger for Spontaneous Speech

Author(s): Mónica Domínguez, Mireia Farrús, Leo Wanner
Published in: Proceedings of the International Conference on Computational Linguistics, 2016

Web-based live speech-driven lip-sync

Author(s): Gerard Llorach, Alun Evans, Josep Blat, Giso Grimm, and Volker Hohmann
Published in: Proceedings of VS-Games 2016, the 8th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games 2016), 2016

Question Answering over Pattern-Based User Models

Author(s): Georgios Meditskos, Stamatia Dasiopoulou, Stefanos Vrochidis, Leo Wanner, and Ioannis Kompatsiaris
Published in: Proceedings of the 12th International Conference on Semantic Systems (SEMANTiCS 2016), 2016, Page(s) 153-160

Praat on the Web: An Upgrade of Praat for Semi-Automatic Speech Annotation

Author(s): Mónica Domínguez, Iván Latorre, Mireia Farrús, Joan Codina-Filbà, and Leo Wanner
Published in: Proceedings of the International Conference on Computational Linguistics, 2016

A Multimedia Interactive Search Engine based on Graph-based and Non-linear Multimodal Fusion

Author(s): A. Moumtzidou, I. Gialampoukidis, T. Mironidis, D. Liparas, S. Vrochidis, and I. Kompatsiaris
Published in: Proceedings of the 14th International Workshop on Content-based Multimedia Indexing (CBMI), 2016

A hybrid framework for news clustering based on the DBSCAN-Martingale and LDA

Author(s): I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris . , New York, USA, 16-21 July 2016.
Published in: Proceedings of the 12th International Conference on Machine Learning and Data Mining, 2016

Extending WordNet with Fine-Grained Collocational Information

Author(s): Luis Espinosa Anke, José Camacho-Collados, Sara Rodríguez-Fernández, Horacio Saggion, Leo Wanner
Published in: Proceedings of the International Conference on Computational Linguistics, 2016

KRISTINA - A Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities

Author(s): J. Mohr, V. Sarholz, B. Schäfer et al
Published in: Zukunft Lebensräume, 2016

A Neural Network Architecture for Multilingual Punctuation Generation

Author(s): M. Ballesteros, L. Wanner
Published in: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Short paper track, 2016

Semantics-Driven Recognition of Collocations Using Word Embeddings

Author(s): Sara Rodríguez Fernández, Luis Espinosa Anke, Roberto Carlini, Leo Wanner
Published in: Proceedings of the AnnualMeeting of the Association for Computational Linguistics (ACL), Short paper track, 2016

Ontology-Driven Context Interpretation and Conflict Resolution for Dialogue-Based Home Care Assistance

Author(s): G. Mediskos, E. Kontopoulos, S. Vrochidis, and I. Kompatsiaris
Published in: Proceedings of the International Conference on Semantic Web Applications and Tools for Life Sciences (SWAT4LS), 2016

Multi-instance Dynamic Ordinal Random Fields for weakly-supervised pain intensity estimation

Author(s): A. Ruiz, Rudovic, O., Binefa, X., and Pantic, M.
Published in: Proceedings of the Asian Conference on Computer Vision (ACCV), 2016

Cultural Communication Idiosyncrasies in Human-Computer Interaction

Author(s): Miehle, J., Yoshino, K., Pragst, L., Ultes, S., Nakamura, S. and Minker, W.
Published in: Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2016

Automatic Modification of Communication Style in Dialogue Management

Author(s): Pragst, L., Miehle, J., Ultes, S. and Minker, W.
Published in: Proceedings of the INLG 2016 Workshop on Computational Creativity in Natural Language Generation, 2016

Query-based Topic Detection Using Concepts and Named Entities

Author(s): I. Gialampoukidis, D. Liparas, S. Vrochidis, I. Kompatsiaris
Published in: Proceedings of the 1st International Workshop on Multimodal Media Data Analytics (MMDA), 2016

VERGE IN VBS 2017

Author(s): A. Moumtzidou, T. Mironidis, F. Markatopoulou, S. Andreadis, I. Gialampoukidis, D. Galanopoulos, A. Ioannidou, S. Vrochidis, V. Mezaris, I. Kompatsiaris, and I. Patras
Published in: Proceedings of Video Browser Showdown (VBS'17) at the 23rd International Conference on MultiMedia Modeling (MMM'17), 2017

Description Logics and Rules for Multimodal Situational Awareness in Healthcare

Author(s): G. Meditskos, S. Vrochidis, and I. Kompatsiaris ,, Reykjavik, Iceland, 4-6 January 2017.
Published in: Proceedings of the 23rd International Conference on MultiMedia Modeling (MMM'17), 2017

Dem@Home: Ambient Intelligence for Clinical Support of People Living with Dementia

Author(s): Stelios Andreadis, Thanos G. Stavropoulos, Georgios Meditskos, and Ioannis Kompatsiaris
Published in: Proceedings of the 1st workshop on Semantic Web Technologies in Mobile and Pervasive Environments, in conjunction with ESWC 2016, 2016

Example-based Acquisition of Fine-grained Collocation Resources

Author(s): S. Rodríguez-Fernández, R. Carlini, L. Espinosa Anke, and L. Wanner
Published in: International Conference on Language Resources and Evaluation (LREC), 2016

Visualizing Deep-Syntactic Parser Output

Author(s): J. Soler-Company, M. Ballesteros, B. Bohnet, S. Mille and L. Wanner
Published in: Annual Meeting of the North American Chapter of the ACL, Demo Track, 2015

A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain

Author(s): F. Sukno, M. Dominguez, A. Ruiz Ovejero, D. Schiller, F. Lingenfelser, L. Pragst, E. Kamateri and S. Vrochidis
Published in: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016

Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities

Author(s): L. Wanner et al.
Published in: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016

From Emotions to Action Units with Hidden and Semi-Hidden-Task Learning

Author(s): "A. Ruiz, J. Van de Weijer, and X. Binefa. """
Published in: IEEE International Conference on Computer Vision, 2015

A pipeline for the creation of progressively rendered web 3D scenes

Author(s): Alun Evans, Javi Agenjo, Josep Blat
Published in: Multimedia Tools and Applications, 2017, ISSN 1380-7501
DOI: 10.1007/s11042-017-5463-6

Design of a Knowledge-Based Agent as a Social Companion

Author(s): Leo Wanner, Elisabeth André, Josep Blat, Stamatia Dasiopoulou, Mireia Farrús, Thiago Fraga, Eleni Kamateri, Florian Lingenfelser, Gerard Llorach, Oriol Martínez, Georgios Meditskos, Simon Mille, Wolfgang Minker, Louisa Pragst, Dominik Schiller, Andries Stam, Ludo Stellingwerff, Federico Sukno, Bianca Vieru, Stefanos Vrochidis
Published in: Procedia Computer Science, Issue 121, 2017, Page(s) 920-926, ISSN 1877-0509
DOI: 10.1016/j.procs.2017.11.119

Multimedia retrieval based on non-linear graph-based fusion and partial least squares regression

Author(s): Ilias Gialampoukidis, Anastasia Moumtzidou, Dimitris Liparas, Theodora Tsikrika, Stefanos Vrochidis, Ioannis Kompatsiaris
Published in: Multimedia Tools and Applications, Issue 76/21, 2017, Page(s) 22383-22403, ISSN 1380-7501
DOI: 10.1007/s11042-017-4797-4

Modeling Grounding for Interactive Social Companions

Author(s): Gregor Mehlmann, Kathrin Janowski, Elisabeth André
Published in: KI - Künstliche Intelligenz, Issue 30/1, 2016, Page(s) 45-52, ISSN 0933-1875
DOI: 10.1007/s13218-015-0397-5

Data-driven deep-syntactic dependency parsing

Author(s): MIGUEL BALLESTEROS, BERND BOHNET, SIMON MILLE, LEO WANNER
Published in: Natural Language Engineering, 2015, Page(s) 1-36, ISSN 1351-3249
DOI: 10.1017/S1351324915000285

Modeling Grounding for Interactive Social Companions

Author(s): Gregor Mehlmann, Kathrin Janowski, and Elisabeth André
Published in: KI, Issue 30(1), 2016, Page(s) 45-52, ISSN 0933-1875

KRISTINA, un asistente virtual para superar las barreras lingüísticas en la atención sanitaria

Author(s): Dafa, Lehdia Mohamed; Baudracco, Chiara; Moragas, Ana; Llor Vila, Carles; Molero Trujillo, David; Vilanova Estrada, Pere
Published in: Comunidad, Issue 19(2), 2017, ISSN 2339-7896

FORGe at WebNLG 2017

Author(s): Mille, Simon; Dasiopoulou, Stamatia
Published in: 2017

FORGe at E2E 2017

Author(s): Mille, Simon; Dasiopoulou, Stamatia
Published in: 2017

Datasets

Prosodically annotated TED talks

Author(s): Öktem, Alp,Farrús, Mireia,Lai, Catherine
Published in: Universitat Pompeu Fabra