Multi-modal Context Modelling for Machine Translation

Publications

Phrase Localization Without Paired Training Examples

Author(s): Josiah Wang; Lucia Specia
Published in: ICCV, 2019
Publisher: IEEE
DOI: 10.1109/iccv.2019.00476

Distilling Translations with Visual Awareness

Author(s): Julia Ive; Pranava Madhyastha; Lucia Specia
Published in: ACL, 2019
Publisher: ACL
DOI: 10.18653/v1/p19-1653

How2: A large-scale dataset for multimodal language understanding

Author(s): Sanabria, Ramon; Caglayan, Ozan; Palaskar, Shruti; Elliott, Desmond; Barrault, Loïc; Specia, Lucia; Metze, Florian
Published in: Visually Grounded Interaction and Language, Neurips, 2018
Publisher: Neurips

Findings of the Third Shared Task on Multimodal Machine Translation

Author(s): Loïc Barrault; Fethi Bougares; Lucia Specia; Chiraag Lala; Desmond Elliott; Stella Frank
Published in: WMT, 2018
Publisher: ACL
DOI: 10.18653/v1/w18-6402

Visual Cues and Error Correction for Translation Robustness

Author(s): Zhenhao Li, Marek Rei, Lucia Specia
Published in: EMNLP, 2021
Publisher: ACL
DOI: 10.18653/v1/2021.findings-emnlp.271

Probing the Need for Visual Context in Multimodal Machine Translation

Author(s): Ozan Caglayan; Pranava Madhyastha; Lucia Specia; Loïc Barrault
Published in: NAACL/HLT, 2019
Publisher: ACL
DOI: 10.18653/v1/n19-1422

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Author(s): Julia Ive; Andy Mingren Li; Yishu Miao; Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Published in: EACL, 2021
Publisher: ACL
DOI: 10.18653/v1/2021.eacl-main.281

Object Counts! Bringing Explicit Detections Back into Image Captioning

Author(s): Josiah Wang; Pranava Madhyastha; Lucia Specia
Published in: NAACL/HLT, 2018
Publisher: ACL
DOI: 10.18653/v1/n18-1198

Exploring Supervised and Unsupervised Rewards in Machine Translation

Author(s): Julia Ive; Zixu Wang; Marina Fomicheva; Lucia Specia
Published in: EACL, 2021
Publisher: ACL
DOI: 10.18653/v1/2021.eacl-main.164

End-to-end Image Captioning Exploits Multimodal Distributional Similarity

Author(s): Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Published in: 29th British Machine Vision Conference, 2018
Publisher: BVMC

Simultaneous Machine Translation with Visual Context

Author(s): Ozan Caglayan; Julia Ive; Veneta Haralampieva; Pranava Madhyastha; Loïc Barrault; Lucia Specia
Published in: EMNLP, 2020
Publisher: ACL
DOI: 10.18653/v1/2020.emnlp-main.184

Predicting Actions to Help Predict Translations

Author(s): Wu, Zixiu; Ive, Julia; Wang, Josiah; Madhyastha, Pranava; Specia, Lucia
Published in: Workshop The How2 Challenge: New Tasks for Vision & Language, ICML, 2019
Publisher: ICML

VIFIDEL: Evaluating the Visual Fidelity of Image Descriptions

Author(s): Pranava Madhyastha; Josiah Wang; Lucia Specia
Published in: ACL, 2019
Publisher: ACL
DOI: 10.18653/v1/p19-1654

MultiSubs: A Large-scale Multimodal and Multilingual Dataset

Author(s): Wang, Josiah; Madhyastha, Pranava; Figueiredo, Josiel; Lala, Chiraag; Specia, Lucia
Published in: LREC, 2022
Publisher: LREC

Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale

Author(s): Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Published in: COLING, 2020
Publisher: ACL
DOI: 10.18653/v1/2020.coling-main.210

Imperial College London Submission to VATEX Video Captioning Task

Author(s): Caglayan, Ozan; Wu, Zixiu; Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Published in: 3rd Workshop on Closing the Loop Between Vision and Language, ICCV 2019, 2019
Publisher: ICCV

BERTGen: Multi-task Generation through BERT

Author(s): Faidon Mitzalis; Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Published in: ACL/IJCNLP, 2021
Publisher: ACL
DOI: 10.18653/v1/2021.acl-long.503

Object Counts! Bringing Explicit Detections Back into Image Captioning

Author(s): Wang, Josiah; Madhyastha, Pranava; Specia, Lucia
Published in: Proceedings of 2018 Conference of the North American Chapter of the Association for Computational Linguistics, Issue 2, 2018
Publisher: Computer Vision and Pattern Recognition

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

Author(s): Elliott, Desmond; Frank, Stella; Barrault, Loïc; Bougares, Fethi; Specia, Lucia
Published in: Proceedings of the Second Conference on Machine Translation, Issue 3, 2017, Page(s) 215--233
Publisher: Association for Computational Linguistics

Defoiling Foiled Image Captions

Author(s): Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Published in: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2018), Issue 1, 2018
Publisher: Computer Vision and Pattern Recognition

Sheffield MultiMT: Using Object Posterior Predictions for Multimodal Machine Translation

Author(s): Pranava Swaroop Madhyastha, Josiah Wang, and Lucia Specia
Published in: Second Conference on Machine Translation, 2017, Page(s) 470–476
Publisher: Association for Computational Linguistics

Sheffield submissions for wmt18 multimodal translation shared task

Author(s): C. Lala, P. Swaroop Madhyastha, Carolina Scarton, L. Specia
Published in: Conference on Machine Translation, 2018
Publisher: Association for Computational Linguistics

How2: A Large-scale Dataset for Multimodal Language Understanding

Author(s): R. Sanabria, O. Caglayan, S. Palaskar, D. Elliott, L. Barrault, L. Specia, F. Metze
Published in: NeurIPS Workshop on Visually Grounded Interaction and Language (ViGIL), 2018
Publisher: Neurips

Probing the Tole of Images in Multimodal Machine Translation

Author(s): O. Caglayan, L. Barrault, P. Madhyastha, L. Specia
Published in: NAACL, 2019
Publisher: Association for Computational Linguistics

Findings of the Third Shared Task on Multimodal Machine Translation

Author(s): L. Barrault, F. Bougares, L. Specia, C. Lala, D. Elliott, S. Frank
Published in: Conference on Machine Translation, 2018
Publisher: Association for Computational Linguistics

Semi-supervised Adaptation of RNNLMs by Fine-tuning with Domain-specific Auxiliary Features

Author(s): Salil Deena, Raymond W. M. Ng, Pranava Madhyastha, Lucia Specia, and Thomas Hain
Published in: INTERSPEECH, 2017, Page(s) 2715–2719
Publisher: INTERSPEECH

Multi30K: Multilingual English-German Image Descriptions

Author(s): Desmond Elliott, Stella Frank, Khalil Sima'an, and Lucia Specia
Published in: 5th Workshop on Vision and Language, 2016, Page(s) 70–74
Publisher: Association for Computational Linguistics

Multimodal Lexical Translation

Author(s): Chiraag Lala and Lucia Specia
Published in: Eleventh International Conference on Language Resources and Evaluation, 2018, Page(s) 3810–3817
Publisher: ELRA

Exploring the use of acoustic embeddings in neural machine translation

Author(s): Salil Deena, Raymond Ng, Pranava Madhyastha, Lucia Specia, and Thomas Hain
Published in: IEEE ASRU Workshop, 2017
Publisher: IEEE

SHEF-Multimodal: Grounding Machine Translation on Images

Author(s): Kashif Shah, Josiah Wang and Lucia Specia
Published in: Conference on Machine Translation, 2016
Publisher: Association for Computational Linguistics

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

Author(s): Lucia Specia, Stella Frank, Khalil Sima'an, and Desmond Elliott
Published in: First Conference on Machine Translation, 2016, Page(s) 540–550
Publisher: Association for Computational Linguistics

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

Author(s): Desmond Elliott; Stella Frank; Loïc Barrault; Fethi Bougares; Lucia Specia
Published in: WMT, 2017
Publisher: ACL
DOI: 10.18653/v1/w17-4718

Transformer-based Cascaded Multimodal Speech Translation

Author(s): Wu, Zixiu; Caglayan, Ozan; Ive, Julia; Wang, Josiah; Specia, Lucia
Published in: 16th International Conference on Spoken Language Translation, 2019
Publisher: ACL
DOI: 10.5281/zenodo.3525551

Defoiling Foiled Image Captions

Author(s): Pranava Madhyastha; Josiah Wang; Lucia Specia
Published in: NAACL/HLT, 2018
Publisher: ACL
DOI: 10.18653/v1/n18-2069

Grounded Word Sense Translation

Author(s): Chiraag Lala, Pranava Madhyastha, Lucia Specia
Published in: 2nd Workshop on Shortcomings in Vision and Language, 2019
Publisher: ACL
DOI: 10.18653/v1/w19-1808

Multimodal Quality Estimation for Machine Translation

Author(s): Shu Okabe, Frédéric Blain, Lucia Specia
Published in: ACL, 2020
Publisher: ACL
DOI: 10.18653/v1/2020.acl-main.114

Cross-lingual Visual Pre-training for Multimodal Machine Translation

Author(s): Ozan Caglayan; Menekse Kuyu; Mustafa Sercan Amac; Pranava Madhyastha; Erkut Erdem; Aykut Erdem; Lucia Specia
Published in: EACL, 2021
Publisher: ACL
DOI: 10.18653/v1/2021.eacl-main.112

MSVD-Turkish: a comprehensive multimodal video dataset for integrated vision and language research in Turkish

Author(s): Begum Citamak; Ozan Caglayan; Menekse Kuyu; Erkut Erdem; Aykut Erdem; Pranava Madhyastha; Lucia Specia
Published in: Machine Translation, 2021, ISSN 0922-6567
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10590-021-09276-y

Grounded Sequence to Sequence Transduction

Author(s): Lucia Specia, Loic Barrault, Ozan Caglayan, Amanda Duarte, Desmond Elliott, Spandana Gella, Nils Holzenberger, Chiraag Lala, Sun Jae Lee, Jindrich Libovicky, Pranava Madhyastha, Florian Metze, Karl Mulligan, Alissa Ostapenko, Shruti Palaskar, Ramon Sanabria, Josiah Wang, and Raman Arora
Published in: IEEE Journal of Selected Topics in Signal Processing, 2020, ISSN 1932-4553
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jstsp.2020.2998415

Unraveling the Contribution of Image Captioning and Neural Machine Translation for Multimodal Machine Translation

Author(s): Chiraag Lala, Pranava Madhyastha, Josiah Wang, Lucia Specia
Published in: The Prague Bulletin of Mathematical Linguistics, Issue 108/1, 2017, Page(s) 197–208, ISSN 1804-0462
Publisher: De Gruyter
DOI: 10.1515/pralin-2017-0020

The role of image representations in vision to language tasks

Author(s): PRANAVA MADHYASTHA, JOSIAH WANG, LUCIA SPECIA
Published in: Natural Language Engineering, Issue 24/03, 2018, Page(s) 415-439, ISSN 1351-3249
Publisher: Cambridge University Press
DOI: 10.1017/s1351324918000116

Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

Author(s): STELLA FRANK, DESMOND ELLIOTT, LUCIA SPECIA
Published in: Natural Language Engineering, Issue 24/03, 2018, Page(s) 393-413, ISSN 1351-3249
Publisher: Cambridge University Press
DOI: 10.1017/s1351324918000074

Read, spot and translate

Author(s): Lucia Specia; Josiah Wang; Sun Jae Lee; Alissa Ostapenko; Pranava Madhyastha
Published in: Machine Translation, 2021, ISSN 0922-6567
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10590-021-09259-z

Multimodal machine translation through visuals and speech

Author(s): Umut Sulubacak; Ozan Caglayan; Stig-Arne Grönroos; Aku Rouhe; Desmond Elliott; Lucia Specia; Jörg Tiedemann
Published in: Machine Translation, 2020, ISSN 0922-6567
Publisher: Kluwer Academic Publishers
DOI: 10.5281/zenodo.3690790

Searching for OpenAIRE data...

Publications

Share this page

Download