Natural Language Understanding for non-standard languages and dialects

Project Information

DIALECT

Grant agreement ID: 101043235

DOI

10.3030/101043235

EC signature date 7 July 2022

Start date 1 October 2022

End date 30 September 2027

Funded under

• European Research Council (ERC)

Total cost

€ 1 997 815,00

EU contribution

€ 1 997 815,00

Coordinated by

LUDWIG-MAXIMILIANS-UNIVERSITAET MUENCHEN
Germany

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Data Management Plan (1)

Data Management Plan

Publications

Conference proceedings (52)

IndirectQA: Understanding Indirect Answers to Implicit Polar Questions in French and Spanish

Author(s): Christin Müller, Barbara Plank
Published in: 2024
Publisher: ELRA and ICCL

Findings of the VarDial Evaluation Campaign 2023

Author(s): Aepli, Noëmi; Cöltekin, Çağrı; Van Der Goot, Rob; Jauhiainen, Tommi; Kazzaz, Mourhaf; Ljube\vić, Nikola; North, Kai; Plank, Barbara; Scherrer, Yves; Zampieri, Marcos
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.5167/uzh-233792

MaiNLP at SemEval-2024 Task 1: Analyzing Source Language Selection in Cross-Lingual Textual Relatedness

Author(s): Shijia Zhou, Huangyan Shan, Barbara Plank, Robert Litschko
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.semeval-1.259

“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models

Author(s): Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-acl.441

MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

Author(s): Verena Blaschke, Barbara Kovačić, Siyao Peng, Hinrich Schütze, Barbara Plank
Published in: 2024
Publisher: ELRA and ICCL

Stop Measuring Calibration When Humans Disagree

Author(s): Baan, J.; Aziz, W.; Plank, B.; Fernández, R.
Published in: 2022
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.16133

The “Problem” of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation

Author(s): Barbara Plank
Published in: 2022
Publisher: Association for Computational Linguistics
DOI: 10.18653/V1/2022.EMNLP-MAIN.731

SemEval-2023 Task 11: Learning with Disagreements (LeWiDi)

Author(s): Leonardelli, Elisa; Uma, Alexandra; Abercrombie, Gavin; Almanea, Dina; Basile, Valerio; Fornaciari, Tommaso; Plank, Barbara; Rieser, Verena; Poesio, Massimo
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.semeval-1.314

Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties

Author(s): Artemova, Ekaterina; Blaschke, Verena; Plank, Barbara
Published in: 2024
Publisher: Association for Computational Linguistics

Evidence \textgreater Intuition: Transferability Estimation for Encoder Selection

Author(s): Elisa Bassignana, Max Müller-Eberstein, Mike Zhang, Barbara Plank
Published in: 2022
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.283

Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets?

Author(s): Weber-Genzel, Leon; Litschko, Robert; Artemova, Ekaterina; Plank, Barbara
Published in: 2024
Publisher: Association for Computational Linguistics

The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models

Author(s): Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch, Michael A. Hedderich, Barbara Plank, Frauke Kreuter
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.513

Donkii: Characterizing and Detecting Errors in Instruction-Tuning Datasets

Author(s): Leon Weber, Robert Litschko, Ekaterina Artemova, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics

Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models – A Survey

Author(s): Mondorf, Philipp; Plank, Barbara
Published in: 2024
Publisher: Conference on Language Modeling

Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data

Author(s): Litschko, Robert; Artemova, Ekaterina; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.05295

Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languages

Author(s): Blaschke, Verena; Schütze, Hinrich; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2304.10158

What Do Dialect Speakers Want? A Survey of Attitudes Towards Language Technology for German Dialects

Author(s): Blaschke, Verena; Purschke, Christoph; Schütze, Hinrich; Plank, Barbara
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2402.11968

Deep Learning-based Computational Job Market Analysis: A Survey on Skill Extraction and Classification from Job Postings

Author(s): Elena Senger, Mike Zhang, Rob van der Goot, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics

How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives

Author(s): Wang, Xinpeng; Weissweiler, Leonie; Schütze, Hinrich; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.15032

ActiveAED: A Human in the Loop Improves Annotation Error Detection

Author(s): Weber, Leon; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.20045

What’s wrong with your model? A Quantitative Analysis of Relation Classification

Author(s): Elisa Bassignana, Rob van der Goot, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.starsem-1.20

“Seeing the Big through the Small”: Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Author(s): Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.842

Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification

Author(s): Shanshan Xu, Santosh T.y.s.s, Oana Ichim, Barbara Plank, Matthias Grabmair
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.13

A Survey of Corpora for Germanic Low-Resource Languages and Dialects

Author(s): Blaschke, Verena; Schütze, Hinrich; Plank, Barbara
Published in: 2023
Publisher: University of Tartu Library

Silver Syntax Pre-training for Cross-Domain Relation Extraction

Author(s): Bassignana, Elisa; Ginter, FIlip; Pyysalo, Sampo; van der Goot, Rob; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.11016

Slot and Intent Detection Resources for Bavarian and Lithuanian: Assessing Translations vs Natural Queries to Digital Assistants

Author(s): Miriam Winkler, Virginija Juozapaityte, Rob van der Goot, Barbara Plank
Published in: 2024
Publisher: ELRA and ICCL

EEVEE: An Easy Annotation Tool for Natural Language Processing

Author(s): Sorensen, Axel; Peng, Siyao; Plank, Barbara; van der Goot, Rob
Published in: 2024
Publisher: Association for Computational Linguistics

Comparing Inferential Strategies of Humans and Large Language Models in Deductive Reasoning

Author(s): Philipp Mondorf, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.508

Experimental Standards for Deep Learning in Natural Language Processing Research

Author(s): Ulmer, Dennis; Bassignana, Elisa; Müller-Eberstein, Max; Varab, Daniel; Zhang, Mike; van der Goot, Rob; Hardmeier, Christian; Plank, Barbara
Published in: 2022
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2204.06251

What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability

Author(s): Giulianelli, Mario; Baan, Joris; Aziz, Wilker; Fernández, Raquel; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.887

Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Models

Author(s): Philipp Mondorf, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.emnlp-main.404

ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation

Author(s): Wang, Xinpeng; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.14979

Low-resource Bilingual Dialect Lexicon Induction with Large Language Models

Author(s): Artemova, Ekaterina; Plank, Barbara
Published in: 2023
Publisher: University of Tartu Library

To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity

Author(s): Anastasiia Sedova, Robert Litschko, Diego Frassinelli, Benjamin Roth, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.1003

NNOSE: Nearest Neighbor Occupational Skill Extraction

Author(s): Zhang, Mike; van der Goot, Rob; Kan, Min Yen; Plank, Barbara
Published in: Zhang , M , van der Goot , R , Kan , M Y & Plank , B 2024 , NNOSE : Nearest Neighbor Occupational Skill Extraction . in Y Graham , M Purver & M Purver (eds) , EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference . Association for Computational Linguistics, ACL Anthology , EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference , vol. 1 , pp. 589-608 , 18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024 , St. Julian�s , Malta , 17/03/2024 ., 2024
Publisher: Association for Computational Linguistics

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

Author(s): Müller-Eberstein, Max; van der Goot, Rob; Plank, Barbara; Titov, Ivan
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.16484

VariErr NLI: Separating Annotation Error from Human Label Variation

Author(s): Leon Weber-Genzel, Siyao Peng, Marie-Catherine De Marneffe, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.123

ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain

Author(s): Zhang, Mike; van der Goot, Rob; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.12092

JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

Author(s): Magron, Antoine; Dai, Anna; Zhang, Mike; Montariol, Syrielle; Bosselut, Antoine
Published in: Magron , A , Dai , A , Zhang , M , Montariol , S & Bosselut , A 2024 , JOBSKAPE : A Framework for Generating Synthetic Job Postings to Enhance Skill Matching . in E Hruschka , T Lake , N Otani & T Mitchell (eds) , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop . Association for Computational Linguistics, ACL Anthology , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop , pp. 43-58 , 1st Workshop on Natural Language Processing for Human Resources, NLP4HR 2024 , St. Julian's , Malta , 22/03/2024 ., 2024
Publisher: Association for Computational Linguistics

Establishing Trustworthiness: Rethinking Tasks and Model Evaluation

Author(s): Litschko, Robert; Müller-Eberstein, Max; van der Goot, Rob; Weber-Genzel, Leon; Plank, Barbara
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.05442

From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classification

Author(s): Xu, Shanshan; T.y.s.s, Santosh; Ichim, Oana; Risini, Isabella; Plank, Barbara; Grabmaier, Matthias
Published in: 2023
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.11878

Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?

Author(s): Joris Baan, Raquel Fernández, Barbara Plank, Wilker Aziz
Published in: 2024
Publisher: Association for Computational Linguistics

How to Encode Domain Information in Relation Classification

Author(s): Elisa Bassignana, Viggo Unmack Gascou, Frida Nøhr Laustsen, Gustav Kristensen, Marie Haahr Petersen, Rob van der Goot, Barbara Plank
Published in: 2024
Publisher: ELRA and ICCL

Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data

Author(s): Siyao Peng, Zihang Sun, Huangyan Shan, Marie Kolm, Verena Blaschke, Ekaterina Artemova, Barbara Plank
Published in: 2024
Publisher: ELRA and ICCL

Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations

Author(s): Peng, Siyao; Sun, Zihang; Loftus, Sebastian; Plank, Barbara
Published in: 2024
Publisher: Association for Computational Linguistics

CrossRE: A Cross-Domain Dataset for Relation Extraction

Author(s): Bassignana, Elisa; Plank, Barbara
Published in: 2022
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.09345

Look at the Text: Instruction-Tuned Language Models are More Robust Multiple Choice Selectors than You Think

Author(s): Wang, Xinpeng; Hu, Chengzhi; Ma, Bolei; Röttger, Paul; Plank, Barbara
Published in: 2024
Publisher: Conference on Language Modeling

Entity Linking in the Job Market Domain

Author(s): Zhang, Mike; van der Goot, Rob; Plank, Barbara
Published in: 2024
Publisher: Association for Computational Linguistics

Rethinking Skill Extraction in the Job Market Domain using Large Language Models

Author(s): Nguyen, Khanh Cao; Zhang, Mike; Montariol, Syrielle; Bosselut, Antoine
Published in: Nguyen , K C , Zhang , M , Montariol , S & Bosselut , A 2024 , Rethinking Skill Extraction in the Job Market Domain using Large Language Models . in E Hruschka , T Lake , N Otani & T Mitchell (eds) , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop . Association for Computational Linguistics, ACL Anthology , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop , pp. 27-42 , 1st Workshop on Natural Language Processing for Human Resources, NLP4HR 2024 , St. Julian's , Malta , 22/03/2024 ., 2024
Publisher: Association for Computational Linguistics

Multi-CrossRE A Multi-Lingual Multi-Domain Dataset for Relation Extraction

Author(s): Bassignana, Elisa; Ginter, Filip; Pyysalo, Sampo; van der Goot, Rob; Plank, Barbara
Published in: 2023
Publisher: University of Tartu Library

More Labels or Cases? Assessing Label Variation in Natural Language Inference

Author(s): Cornelia Gruber, Katharina Hechinger, Matthias Assenmacher, Göran Kauermann, Barbara Plank
Published in: 2024
Publisher: Association for Computational Linguistics

Spectral Probing

Author(s): Müller-Eberstein, Max; van der Goot, Rob; Plank, Barbara
Published in: Müller-Eberstein , M , van der Goot , R & Plank , B 2022 , Spectral Probing . in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics , Abu Dhabi, United Arab Emirates , pp. 7730-7741 ., 2022
Publisher: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.11860