Natural Language Understanding for non-standard languages and dialects

Informazioni relative al progetto

DIALECT

ID dell’accordo di sovvenzione: 101043235

DOI

10.3030/101043235

Data della firma CE 7 Luglio 2022

Data di avvio 1 Ottobre 2022

Data di completamento 30 Settembre 2027

Finanziato da

• European Research Council (ERC)

Costo totale

€ 1 997 815,00

Contributo UE

€ 1 997 815,00

Coordinato da

LUDWIG-MAXIMILIANS-UNIVERSITAET MUENCHEN
Germany

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Data Management Plan (1)

Data Management Plan

Pubblicazioni

Conference proceedings (91)

Human-centered LLMs for Inclusive Language Technology: The Need to Embrace Variation Holistically in NLP

Autori: Barbara Plank
Pubblicato in: Annals of Computer Science and Information Systems, Proceedings of the 20th Conference on Computer Science and Intelligence Systems (FedCSIS), Numero 43, 2025
Editore: Polish Information Processing Society
DOI: 10.15439/2025F4610

Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Models

Autori: Philipp Mondorf, Barbara Plank
Pubblicato in: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2024.EMNLP-MAIN.404

LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Autori: Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, Andre Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Surikuchi, Ece Takmaz, Alberto Testoni
Pubblicato in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-SHORT.20

Revisiting Active Learning under (Human) Label Variation

Autori: Cornelia Gruber, Helen Alber, Bernd Bischl, Göran Kauermann, Barbara Plank, Matthias Aßenmacher
Pubblicato in: Proceedings of the The 4th Workshop on Perspectivist Approaches to NLP, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.NLPERSPECTIVES-1.7

IndirectQA: Understanding Indirect Answers to Implicit Polar Questions in French and Spanish

Autori: Christin Müller, Barbara Plank
Pubblicato in: 2024
Editore: ELRA and ICCL

Findings of the VarDial Evaluation Campaign 2023

Autori: Aepli, Noëmi; Cöltekin, Çağrı; Van Der Goot, Rob; Jauhiainen, Tommi; Kazzaz, Mourhaf; Ljube\vić, Nikola; North, Kai; Plank, Barbara; Scherrer, Yves; Zampieri, Marcos
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.5167/uzh-233792

KARRIEREWEGE: A large scale Career Path Prediction Dataset

Autori: Elena Senger, Yuri Campbell, Rob van der Goot, Barbara Plank
Editore: Association for Computational Linguistics

MaiNLP at SemEval-2024 Task 1: Analyzing Source Language Selection in Cross-Lingual Textual Relatedness

Autori: Shijia Zhou, Huangyan Shan, Barbara Plank, Robert Litschko
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.semeval-1.259

“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models

Autori: Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-acl.441

Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges

Autori: Bolei Ma, Yuting Li, Wei Zhou, Ziwei Gong, Yang Janet Liu, Katja Jasinskaja, Annemarie Friedrich, Julia Hirschberg, Frauke Kreuter, Barbara Plank
Editore: ArXiv
DOI: 10.48550/ARXIV.2502.12378

MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

Autori: Verena Blaschke, Barbara Kovačić, Siyao Peng, Hinrich Schütze, Barbara Plank
Pubblicato in: 2024
Editore: ELRA and ICCL

Stop Measuring Calibration When Humans Disagree

Autori: Baan, J.; Aziz, W.; Plank, B.; Fernández, R.
Pubblicato in: 2022
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.16133

The “Problem” of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation

Autori: Barbara Plank
Pubblicato in: 2022
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2022.EMNLP-MAIN.731

SemEval-2023 Task 11: Learning with Disagreements (LeWiDi)

Autori: Leonardelli, Elisa; Uma, Alexandra; Abercrombie, Gavin; Almanea, Dina; Basile, Valerio; Fornaciari, Tommaso; Plank, Barbara; Rieser, Verena; Poesio, Massimo
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2023.semeval-1.314

Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models

Autori: Lovish Madaan, David Esiobu, Pontus Stenetorp, Barbara Plank, Dieuwke Hupkes
Pubblicato in: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.NAACL-LONG.466

A Multi-Dialectal Dataset for German Dialect ASR and Dialect-to-Standard Speech Translation

Autori: Verena Blaschke, Miriam Winkler, Constantin Förster, Gabriele Wenger-Glemser, Barbara Plank
Editore: ArXiv
DOI: 10.21437/INTERSPEECH.2025-318

Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties

Autori: Artemova, Ekaterina; Blaschke, Verena; Plank, Barbara
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Evidence \textgreater Intuition: Transferability Estimation for Encoder Selection

Autori: Elisa Bassignana, Max Müller-Eberstein, Mike Zhang, Barbara Plank
Pubblicato in: 2022
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.283

Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets?

Autori: Weber-Genzel, Leon; Litschko, Robert; Artemova, Ekaterina; Plank, Barbara
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Donkii: Characterizing and Detecting Errors in Instruction-Tuning Datasets

Autori: Leon Weber, Robert Litschko, Ekaterina Artemova, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models – A Survey

Autori: Mondorf, Philipp; Plank, Barbara
Pubblicato in: 2024
Editore: Conference on Language Modeling

Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data

Autori: Litschko, Robert; Artemova, Ekaterina; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.05295

Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languages

Autori: Blaschke, Verena; Schütze, Hinrich; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2304.10158

Make Every Letter Count: Building Dialect Variation Dictionaries from Monolingual Corpora

Autori: Robert Litschko, Verena Blaschke, Diana Burkhardt, Barbara Plank, Diego Frassinelli
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-EMNLP.762

Reason to Rote: Rethinking Memorization in Reasoning

Autori: Yupei Du, Philipp Mondorf, Silvia Casola, Yuekun Yao, Robert Litschko, Barbara Plank
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.437

What Do Dialect Speakers Want? A Survey of Attitudes Towards Language Technology for German Dialects

Autori: Blaschke, Verena; Purschke, Christoph; Schütze, Hinrich; Plank, Barbara
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2402.11968

The Validation Gap: A Mechanistic Analysis of How Language Models Compute Arithmetic but Fail to Validate It

Autori: Leonardo Bertolazzi, Philipp Mondorf, Barbara Plank, Raffaella Bernardi
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1495

BlackboxNLP-2025 MIB Shared Task: Exploring Ensemble Strategies for Circuit Localization Methods

Autori: Philipp Mondorf, Mingyang Wang, Sebastian Gerstner, Ahmad Dawar Hakimi, Yihong Liu, Leonor Veloso, Shijia Zhou, Hinrich Schuetze, Barbara Plank
Pubblicato in: Proceedings of the 8th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.BLACKBOXNLP-1.31

The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models

Autori: Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch, Michael A. Hedderich, Barbara Plank, Frauke Kreuter
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2024, 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2024.FINDINGS-EMNLP.513

MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs

Autori: Raoyuan Zhao, Beiduo Chen, Barbara Plank, Michael A. Hedderich
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-EMNLP.1256

Deep Learning-based Computational Job Market Analysis: A Survey on Skill Extraction and Classification from Job Postings

Autori: Elena Senger, Mike Zhang, Rob van der Goot, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Fine-grained Sexism Detection in Italian Newspapers

Autori: Federica Manzi, Leon Weber-Genzel, Barbara Plank
Pubblicato in: 2024
Editore: CEUR Workshop Proceedings

How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives

Autori: Wang, Xinpeng; Weissweiler, Leonie; Schütze, Hinrich; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.15032

Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models

Autori: Philipp Mondorf, Sondre Wold, Barbara Plank
Pubblicato in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-LONG.727

ActiveAED: A Human in the Loop Improves Annotation Error Detection

Autori: Weber, Leon; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.20045

What’s wrong with your model? A Quantitative Analysis of Relation Classification

Autori: Elisa Bassignana, Rob van der Goot, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.starsem-1.20

“Seeing the Big through the Small”: Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Autori: Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.842

Disentangling Subjectivity and Uncertainty for Hate Speech Annotation and Modeling using Gaze

Autori: Özge Alacam, Sanne Hoeken, Andreas Säuberli, Hannes Gröner, Diego Frassinelli, Sina Zarrieß, Barbara Plank
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1460

What’s the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns

Autori: Michael A. Hedderich, Anyi Wang, Raoyuan Zhao, Florian Eichin, Jonas Fischer, Barbara Plank
Pubblicato in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-LONG.985

Tracing Multilingual Factual Knowledge Acquisition in Pretraining

Autori: Yihong Liu, Mingyang Wang, Amir Hossein Kargaran, Felicia Körner, Ercong Nie, Barbara Plank, François Yvon, Hinrich Schuetze
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-EMNLP.113

Evaluating Large Language Models for Cross-Lingual Retrieval

Autori: Longfei Zuo, Pingjun Hong, Oliver Kraus, Barbara Plank, Robert Litschko
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-EMNLP.612

Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification

Autori: Shanshan Xu, Santosh T.y.s.s, Oana Ichim, Barbara Plank, Matthias Grabmair
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.13

A Survey of Corpora for Germanic Low-Resource Languages and Dialects

Autori: Blaschke, Verena; Schütze, Hinrich; Plank, Barbara
Pubblicato in: 2023
Editore: University of Tartu Library

Silver Syntax Pre-training for Cross-Domain Relation Extraction

Autori: Bassignana, Elisa; Ginter, FIlip; Pyysalo, Sampo; van der Goot, Rob; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.11016

Slot and Intent Detection Resources for Bavarian and Lithuanian: Assessing Translations vs Natural Queries to Digital Assistants

Autori: Miriam Winkler, Virginija Juozapaityte, Rob van der Goot, Barbara Plank
Pubblicato in: 2024
Editore: ELRA and ICCL

To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity

Autori: Anastasiia Sedova, Robert Litschko, Diego Frassinelli, Benjamin Roth, Barbara Plank
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2024, 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2024.FINDINGS-EMNLP.1003

EEVEE: An Easy Annotation Tool for Natural Language Processing

Autori: Sorensen, Axel; Peng, Siyao; Plank, Barbara; van der Goot, Rob
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Comparing Inferential Strategies of Humans and Large Language Models in Deductive Reasoning

Autori: Philipp Mondorf, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.508

Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation

Autori: Xinpeng Wang, Chengzhi Hu, Paul Röttger, Barbara Plank
Editore: ArXiv
DOI: 10.48550/ARXIV.2410.03415

Algorithmic Fidelity of Large Language Models in Generating Synthetic German Public Opinions: A Case Study

Autori: Bolei Ma, Berk Yoztyurk, Anna-Carolina Haensch, Xinpeng Wang, Markus Herklotz, Frauke Kreuter, Barbara Plank, Matthias Aßenmacher
Pubblicato in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-LONG.90

Experimental Standards for Deep Learning in Natural Language Processing Research

Autori: Ulmer, Dennis; Bassignana, Elisa; Müller-Eberstein, Max; Varab, Daniel; Zhang, Mike; van der Goot, Rob; Hardmeier, Christian; Plank, Barbara
Pubblicato in: 2022
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2204.06251

What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability

Autori: Giulianelli, Mario; Baan, Joris; Aziz, Wilker; Fernández, Raquel; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.887

ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation

Autori: Wang, Xinpeng; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.14979

Low-resource Bilingual Dialect Lexicon Induction with Large Language Models

Autori: Artemova, Ekaterina; Plank, Barbara
Pubblicato in: 2023
Editore: University of Tartu Library

To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity

Autori: Anastasiia Sedova, Robert Litschko, Diego Frassinelli, Benjamin Roth, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.1003

NNOSE: Nearest Neighbor Occupational Skill Extraction

Autori: Zhang, Mike; van der Goot, Rob; Kan, Min Yen; Plank, Barbara
Pubblicato in: Zhang , M , van der Goot , R , Kan , M Y & Plank , B 2024 , NNOSE : Nearest Neighbor Occupational Skill Extraction . in Y Graham , M Purver & M Purver (eds) , EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference . Association for Computational Linguistics, ACL Anthology , EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference , vol. 1 , pp. 589-608 , 18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024 , St. Julian�s , Malta , 17/03/2024 ., 2024
Editore: Association for Computational Linguistics

Dialetto, ma Quanto Dialetto? Transcribing and Evaluating Dialects on a Continuum

Autori: Ryan Soh-Eun Shim, Barbara Plank
Pubblicato in: Findings of the Association for Computational Linguistics: NAACL 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-NAACL.48

“Seeing the Big through the Small”: Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Autori: Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2024, 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2024.FINDINGS-EMNLP.842

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

Autori: Müller-Eberstein, Max; van der Goot, Rob; Plank, Barbara; Titov, Ivan
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.16484

VariErr NLI: Separating Annotation Error from Human Label Variation

Autori: Leon Weber-Genzel, Siyao Peng, Marie-Catherine De Marneffe, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.123

ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain

Autori: Zhang, Mike; van der Goot, Rob; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2305.12092

JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

Autori: Magron, Antoine; Dai, Anna; Zhang, Mike; Montariol, Syrielle; Bosselut, Antoine
Pubblicato in: Magron , A , Dai , A , Zhang , M , Montariol , S & Bosselut , A 2024 , JOBSKAPE : A Framework for Generating Synthetic Job Postings to Enhance Skill Matching . in E Hruschka , T Lake , N Otani & T Mitchell (eds) , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop . Association for Computational Linguistics, ACL Anthology , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop , pp. 43-58 , 1st Workshop on Natural Language Processing for Human Resources, NLP4HR 2024 , St. Julian's , Malta , 22/03/2024 ., 2024
Editore: Association for Computational Linguistics

Mind the Uncertainty in Human Disagreement: Evaluating Discrepancies between Model Predictions and Human Responses in VQA

Autori: Jian Lan, Diego Frassinelli, Barbara Plank
Editore: ArXiv
DOI: 10.48550/ARXIV.2410.02773

Establishing Trustworthiness: Rethinking Tasks and Model Evaluation

Autori: Litschko, Robert; Müller-Eberstein, Max; van der Goot, Rob; Weber-Genzel, Leon; Plank, Barbara
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.05442

Aligning NLP Models with Target Population Perspectives using PAIR: Population-Aligned Instance Replication

Autori: Stephanie Eckman, Bolei Ma, Christoph Kern, Rob Chew, Barbara Plank, Frauke Kreuter
Pubblicato in: Proceedings of the The 4th Workshop on Perspectivist Approaches to NLP, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.NLPERSPECTIVES-1.9

From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classification

Autori: Xu, Shanshan; T.y.s.s, Santosh; Ichim, Oana; Risini, Isabella; Plank, Barbara; Grabmaier, Matthias
Pubblicato in: 2023
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2310.11878

Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?

Autori: Joris Baan, Raquel Fernández, Barbara Plank, Wilker Aziz
Pubblicato in: 2024
Editore: Association for Computational Linguistics

How to Encode Domain Information in Relation Classification

Autori: Elisa Bassignana, Viggo Unmack Gascou, Frida Nøhr Laustsen, Gustav Kristensen, Marie Haahr Petersen, Rob van der Goot, Barbara Plank
Pubblicato in: 2024
Editore: ELRA and ICCL

Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data

Autori: Siyao Peng, Zihang Sun, Huangyan Shan, Marie Kolm, Verena Blaschke, Ekaterina Artemova, Barbara Plank
Pubblicato in: 2024
Editore: ELRA and ICCL

LiTEx: A Linguistic Taxonomy of Explanations for Understanding Within-Label Variation in Natural Language Inference

Autori: Pingjun Hong, Beiduo Chen, Siyao Peng, Marie-Catherine de Marneffe, Barbara Plank
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1728

Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations

Autori: Peng, Siyao; Sun, Zihang; Loftus, Sebastian; Plank, Barbara
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Evaluating Pixel Language Models on Non-Standardized Languages

Autori: Alberto Muñoz-Ortiz, Verena Blaschke, Barbara Plank
Editore: Association for Computational Linguistics

CrossRE: A Cross-Domain Dataset for Relation Extraction

Autori: Bassignana, Elisa; Plank, Barbara
Pubblicato in: 2022
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.09345

Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Study

Autori: Xaver Maria Krückl, Verena Blaschke, Barbara Plank
Editore: Association for Computational Linguistics

Look at the Text: Instruction-Tuned Language Models are More Robust Multiple Choice Selectors than You Think

Autori: Wang, Xinpeng; Hu, Chengzhi; Ma, Bolei; Röttger, Paul; Plank, Barbara
Pubblicato in: 2024
Editore: Conference on Language Modeling

Threading the Needle: Reweaving Chain-of-Thought Reasoning to Explain Human Label Variation

Autori: Beiduo Chen, Yang Janet Liu, Anna Korhonen, Barbara Plank
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1682

What Media Frames Reveal About Stance: A Dataset and Study about Memes in Climate Change Discourse

Autori: Shijia Zhou, Siyao Peng, Simon M. Luebke, Jörg Haßler, Mario Haim, Saif M. Mohammad, Barbara Plank
Pubblicato in: Findings of the Association for Computational Linguistics: EMNLP 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-EMNLP.286

A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLI

Autori: Beiduo Chen, Siyao Peng, Anna Korhonen, Barbara Plank
Pubblicato in: Findings of the Association for Computational Linguistics: ACL 2025, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-ACL.562

Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set

Autori: Florian Eichin, Yang Janet Liu, Barbara Plank, Michael A. Hedderich
Pubblicato in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-LONG.915

Cross-Dialect Information Retrieval: Information Access in Low-Resource and High-Variance Languages

Autori: Robert Litschko, Oliver Kraus, Verena Blaschke, Barbara Plank
Editore: Association for Computational Linguistics

References Matter: Investigating the Impact of Reference Set Variation on Summarization Evaluation

Autori: Silvia Casola, Yang Janet Liu, Siyao Peng, Oliver Kraus, Albert Gatt, Barbara Plank
Editore: Association for Computational Linguistics

Refusal Direction is Universal Across Safety-Aligned Languages

Autori: Xinpeng Wang, Mingyang Wang, Yihong Liu, Hinrich Schütze, Barbara Plank
Editore: Curran Associates, Inc.
DOI: 10.48550/ARXIV.2505.17306

Entity Linking in the Job Market Domain

Autori: Zhang, Mike; van der Goot, Rob; Plank, Barbara
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Rethinking Skill Extraction in the Job Market Domain using Large Language Models

Autori: Nguyen, Khanh Cao; Zhang, Mike; Montariol, Syrielle; Bosselut, Antoine
Pubblicato in: Nguyen , K C , Zhang , M , Montariol , S & Bosselut , A 2024 , Rethinking Skill Extraction in the Job Market Domain using Large Language Models . in E Hruschka , T Lake , N Otani & T Mitchell (eds) , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop . Association for Computational Linguistics, ACL Anthology , NLP4HR 2024 - 1st Workshop on Natural Language Processing for Human Resources, Proceedings of the Workshop , pp. 27-42 , 1st Workshop on Natural Language Processing for Human Resources, NLP4HR 2024 , St. Julian's , Malta , 22/03/2024 ., 2024
Editore: Association for Computational Linguistics

Multi-CrossRE A Multi-Lingual Multi-Domain Dataset for Relation Extraction

Autori: Bassignana, Elisa; Ginter, Filip; Pyysalo, Sampo; van der Goot, Rob; Plank, Barbara
Pubblicato in: 2023
Editore: University of Tartu Library

M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis

Autori: ChengYan Wu, Bolei Ma, Yihong Liu, Zheyu Zhang, Ningyuan Deng, Yanshu Li, Baolan Chen, Yi Zhang, Yun Xue, Barbara Plank
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.128

Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases

Autori: Shanshan Xu, Santosh T.y.s.s, Yanai Elazar, Quirin Vogel, Barbara Plank, Matthias Grabmair
Pubblicato in: Proceedings of the First Workshop on Large Language Model Memorization (L2M2), 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.L2M2-1.16

Neural Text Normalization for Luxembourgish Using Real-Life Variation Data

Autori: Anne-Marie Lutgen, Alistair Plum, Christoph Purschke, Barbara Plank
Editore: Association for Computational Linguistics

More Labels or Cases? Assessing Label Variation in Natural Language Inference

Autori: Cornelia Gruber, Katharina Hechinger, Matthias Assenmacher, Göran Kauermann, Barbara Plank
Pubblicato in: 2024
Editore: Association for Computational Linguistics

Spectral Probing

Autori: Müller-Eberstein, Max; van der Goot, Rob; Plank, Barbara
Pubblicato in: Müller-Eberstein , M , van der Goot , R & Plank , B 2022 , Spectral Probing . in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics , Abu Dhabi, United Arab Emirates , pp. 7730-7741 ., 2022
Editore: Association for Computational Linguistics
DOI: 10.48550/arxiv.2210.11860

RAcQUEt: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs

Autori: Alberto Testoni, Barbara Plank, Raquel Fernández
Pubblicato in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editore: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1206

Peer reviewed articles (1)

Using natural language processing to analyse text data in behavioural science

Autori: Stefan Feuerriegel, Abdurahman Maarouf, Dominik Bär, Dominique Geissler, Jonas Schweisthal, Nicolas Pröllochs, Claire E. Robertson, Steve Rathje, Jochen Hartmann, Saif M. Mohammad, Oded Netzer, Alexandra A. Siegel, Barbara Plank, Jay J. Van Bavel
Pubblicato in: Nature Reviews Psychology, Numero 4, 2025, ISSN 2731-0574
Editore: Springer Science and Business Media LLC
DOI: 10.1038/S44159-024-00392-Z