Multi-modal Context Modelling for Machine Translation

Publications

Phrase Localization Without Paired Training Examples

Auteurs: Josiah Wang; Lucia Specia
Publié dans: ICCV, 2019
Éditeur: IEEE
DOI: 10.1109/iccv.2019.00476

Distilling Translations with Visual Awareness

Auteurs: Julia Ive; Pranava Madhyastha; Lucia Specia
Publié dans: ACL, 2019
Éditeur: ACL
DOI: 10.18653/v1/p19-1653

How2: A large-scale dataset for multimodal language understanding

Auteurs: Sanabria, Ramon; Caglayan, Ozan; Palaskar, Shruti; Elliott, Desmond; Barrault, Loïc; Specia, Lucia; Metze, Florian
Publié dans: Visually Grounded Interaction and Language, Neurips, 2018
Éditeur: Neurips

Findings of the Third Shared Task on Multimodal Machine Translation

Auteurs: Loïc Barrault; Fethi Bougares; Lucia Specia; Chiraag Lala; Desmond Elliott; Stella Frank
Publié dans: WMT, 2018
Éditeur: ACL
DOI: 10.18653/v1/w18-6402

Visual Cues and Error Correction for Translation Robustness

Auteurs: Zhenhao Li, Marek Rei, Lucia Specia
Publié dans: EMNLP, 2021
Éditeur: ACL
DOI: 10.18653/v1/2021.findings-emnlp.271

Probing the Need for Visual Context in Multimodal Machine Translation

Auteurs: Ozan Caglayan; Pranava Madhyastha; Lucia Specia; Loïc Barrault
Publié dans: NAACL/HLT, 2019
Éditeur: ACL
DOI: 10.18653/v1/n19-1422

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Auteurs: Julia Ive; Andy Mingren Li; Yishu Miao; Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Publié dans: EACL, 2021
Éditeur: ACL
DOI: 10.18653/v1/2021.eacl-main.281

Object Counts! Bringing Explicit Detections Back into Image Captioning

Auteurs: Josiah Wang; Pranava Madhyastha; Lucia Specia
Publié dans: NAACL/HLT, 2018
Éditeur: ACL
DOI: 10.18653/v1/n18-1198

Exploring Supervised and Unsupervised Rewards in Machine Translation

Auteurs: Julia Ive; Zixu Wang; Marina Fomicheva; Lucia Specia
Publié dans: EACL, 2021
Éditeur: ACL
DOI: 10.18653/v1/2021.eacl-main.164

End-to-end Image Captioning Exploits Multimodal Distributional Similarity

Auteurs: Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Publié dans: 29th British Machine Vision Conference, 2018
Éditeur: BVMC

Simultaneous Machine Translation with Visual Context

Auteurs: Ozan Caglayan; Julia Ive; Veneta Haralampieva; Pranava Madhyastha; Loïc Barrault; Lucia Specia
Publié dans: EMNLP, 2020
Éditeur: ACL
DOI: 10.18653/v1/2020.emnlp-main.184

Predicting Actions to Help Predict Translations

Auteurs: Wu, Zixiu; Ive, Julia; Wang, Josiah; Madhyastha, Pranava; Specia, Lucia
Publié dans: Workshop The How2 Challenge: New Tasks for Vision & Language, ICML, 2019
Éditeur: ICML

VIFIDEL: Evaluating the Visual Fidelity of Image Descriptions

Auteurs: Pranava Madhyastha; Josiah Wang; Lucia Specia
Publié dans: ACL, 2019
Éditeur: ACL
DOI: 10.18653/v1/p19-1654

MultiSubs: A Large-scale Multimodal and Multilingual Dataset

Auteurs: Wang, Josiah; Madhyastha, Pranava; Figueiredo, Josiel; Lala, Chiraag; Specia, Lucia
Publié dans: LREC, 2022
Éditeur: LREC

Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale

Auteurs: Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Publié dans: COLING, 2020
Éditeur: ACL
DOI: 10.18653/v1/2020.coling-main.210

Imperial College London Submission to VATEX Video Captioning Task

Auteurs: Caglayan, Ozan; Wu, Zixiu; Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Publié dans: 3rd Workshop on Closing the Loop Between Vision and Language, ICCV 2019, 2019
Éditeur: ICCV

BERTGen: Multi-task Generation through BERT

Auteurs: Faidon Mitzalis; Ozan Caglayan; Pranava Madhyastha; Lucia Specia
Publié dans: ACL/IJCNLP, 2021
Éditeur: ACL
DOI: 10.18653/v1/2021.acl-long.503

Object Counts! Bringing Explicit Detections Back into Image Captioning

Auteurs: Wang, Josiah; Madhyastha, Pranava; Specia, Lucia
Publié dans: Proceedings of 2018 Conference of the North American Chapter of the Association for Computational Linguistics, Numéro 2, 2018
Éditeur: Computer Vision and Pattern Recognition

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

Auteurs: Elliott, Desmond; Frank, Stella; Barrault, Loïc; Bougares, Fethi; Specia, Lucia
Publié dans: Proceedings of the Second Conference on Machine Translation, Numéro 3, 2017, Page(s) 215--233
Éditeur: Association for Computational Linguistics

Defoiling Foiled Image Captions

Auteurs: Madhyastha, Pranava; Wang, Josiah; Specia, Lucia
Publié dans: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2018), Numéro 1, 2018
Éditeur: Computer Vision and Pattern Recognition

Sheffield MultiMT: Using Object Posterior Predictions for Multimodal Machine Translation

Auteurs: Pranava Swaroop Madhyastha, Josiah Wang, and Lucia Specia
Publié dans: Second Conference on Machine Translation, 2017, Page(s) 470–476
Éditeur: Association for Computational Linguistics

Sheffield submissions for wmt18 multimodal translation shared task

Auteurs: C. Lala, P. Swaroop Madhyastha, Carolina Scarton, L. Specia
Publié dans: Conference on Machine Translation, 2018
Éditeur: Association for Computational Linguistics

How2: A Large-scale Dataset for Multimodal Language Understanding

Auteurs: R. Sanabria, O. Caglayan, S. Palaskar, D. Elliott, L. Barrault, L. Specia, F. Metze
Publié dans: NeurIPS Workshop on Visually Grounded Interaction and Language (ViGIL), 2018
Éditeur: Neurips

Probing the Tole of Images in Multimodal Machine Translation

Auteurs: O. Caglayan, L. Barrault, P. Madhyastha, L. Specia
Publié dans: NAACL, 2019
Éditeur: Association for Computational Linguistics

Findings of the Third Shared Task on Multimodal Machine Translation

Auteurs: L. Barrault, F. Bougares, L. Specia, C. Lala, D. Elliott, S. Frank
Publié dans: Conference on Machine Translation, 2018
Éditeur: Association for Computational Linguistics

Semi-supervised Adaptation of RNNLMs by Fine-tuning with Domain-specific Auxiliary Features

Auteurs: Salil Deena, Raymond W. M. Ng, Pranava Madhyastha, Lucia Specia, and Thomas Hain
Publié dans: INTERSPEECH, 2017, Page(s) 2715–2719
Éditeur: INTERSPEECH

Multi30K: Multilingual English-German Image Descriptions

Auteurs: Desmond Elliott, Stella Frank, Khalil Sima'an, and Lucia Specia
Publié dans: 5th Workshop on Vision and Language, 2016, Page(s) 70–74
Éditeur: Association for Computational Linguistics

Multimodal Lexical Translation

Auteurs: Chiraag Lala and Lucia Specia
Publié dans: Eleventh International Conference on Language Resources and Evaluation, 2018, Page(s) 3810–3817
Éditeur: ELRA

Exploring the use of acoustic embeddings in neural machine translation

Auteurs: Salil Deena, Raymond Ng, Pranava Madhyastha, Lucia Specia, and Thomas Hain
Publié dans: IEEE ASRU Workshop, 2017
Éditeur: IEEE

SHEF-Multimodal: Grounding Machine Translation on Images

Auteurs: Kashif Shah, Josiah Wang and Lucia Specia
Publié dans: Conference on Machine Translation, 2016
Éditeur: Association for Computational Linguistics

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

Auteurs: Lucia Specia, Stella Frank, Khalil Sima'an, and Desmond Elliott
Publié dans: First Conference on Machine Translation, 2016, Page(s) 540–550
Éditeur: Association for Computational Linguistics

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

Auteurs: Desmond Elliott; Stella Frank; Loïc Barrault; Fethi Bougares; Lucia Specia
Publié dans: WMT, 2017
Éditeur: ACL
DOI: 10.18653/v1/w17-4718

Transformer-based Cascaded Multimodal Speech Translation

Auteurs: Wu, Zixiu; Caglayan, Ozan; Ive, Julia; Wang, Josiah; Specia, Lucia
Publié dans: 16th International Conference on Spoken Language Translation, 2019
Éditeur: ACL
DOI: 10.5281/zenodo.3525551

Defoiling Foiled Image Captions

Auteurs: Pranava Madhyastha; Josiah Wang; Lucia Specia
Publié dans: NAACL/HLT, 2018
Éditeur: ACL
DOI: 10.18653/v1/n18-2069

Grounded Word Sense Translation

Auteurs: Chiraag Lala, Pranava Madhyastha, Lucia Specia
Publié dans: 2nd Workshop on Shortcomings in Vision and Language, 2019
Éditeur: ACL
DOI: 10.18653/v1/w19-1808

Multimodal Quality Estimation for Machine Translation

Auteurs: Shu Okabe, Frédéric Blain, Lucia Specia
Publié dans: ACL, 2020
Éditeur: ACL
DOI: 10.18653/v1/2020.acl-main.114

Cross-lingual Visual Pre-training for Multimodal Machine Translation

Auteurs: Ozan Caglayan; Menekse Kuyu; Mustafa Sercan Amac; Pranava Madhyastha; Erkut Erdem; Aykut Erdem; Lucia Specia
Publié dans: EACL, 2021
Éditeur: ACL
DOI: 10.18653/v1/2021.eacl-main.112

MSVD-Turkish: a comprehensive multimodal video dataset for integrated vision and language research in Turkish

Auteurs: Begum Citamak; Ozan Caglayan; Menekse Kuyu; Erkut Erdem; Aykut Erdem; Pranava Madhyastha; Lucia Specia
Publié dans: Machine Translation, 2021, ISSN 0922-6567
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10590-021-09276-y

Grounded Sequence to Sequence Transduction

Auteurs: Lucia Specia, Loic Barrault, Ozan Caglayan, Amanda Duarte, Desmond Elliott, Spandana Gella, Nils Holzenberger, Chiraag Lala, Sun Jae Lee, Jindrich Libovicky, Pranava Madhyastha, Florian Metze, Karl Mulligan, Alissa Ostapenko, Shruti Palaskar, Ramon Sanabria, Josiah Wang, and Raman Arora
Publié dans: IEEE Journal of Selected Topics in Signal Processing, 2020, ISSN 1932-4553
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jstsp.2020.2998415

Unraveling the Contribution of Image Captioning and Neural Machine Translation for Multimodal Machine Translation

Auteurs: Chiraag Lala, Pranava Madhyastha, Josiah Wang, Lucia Specia
Publié dans: The Prague Bulletin of Mathematical Linguistics, Numéro 108/1, 2017, Page(s) 197–208, ISSN 1804-0462
Éditeur: De Gruyter
DOI: 10.1515/pralin-2017-0020

The role of image representations in vision to language tasks

Auteurs: PRANAVA MADHYASTHA, JOSIAH WANG, LUCIA SPECIA
Publié dans: Natural Language Engineering, Numéro 24/03, 2018, Page(s) 415-439, ISSN 1351-3249
Éditeur: Cambridge University Press
DOI: 10.1017/s1351324918000116

Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

Auteurs: STELLA FRANK, DESMOND ELLIOTT, LUCIA SPECIA
Publié dans: Natural Language Engineering, Numéro 24/03, 2018, Page(s) 393-413, ISSN 1351-3249
Éditeur: Cambridge University Press
DOI: 10.1017/s1351324918000074

Read, spot and translate

Auteurs: Lucia Specia; Josiah Wang; Sun Jae Lee; Alissa Ostapenko; Pranava Madhyastha
Publié dans: Machine Translation, 2021, ISSN 0922-6567
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10590-021-09259-z

Multimodal machine translation through visuals and speech

Auteurs: Umut Sulubacak; Ozan Caglayan; Stig-Arne Grönroos; Aku Rouhe; Desmond Elliott; Lucia Specia; Jörg Tiedemann
Publié dans: Machine Translation, 2020, ISSN 0922-6567
Éditeur: Kluwer Academic Publishers
DOI: 10.5281/zenodo.3690790

Recherche de données OpenAIRE...

Publications

Partager cette page

Télécharger