Incorporating Demographic Factors into Natural Language Processing Models

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Publications

No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models

Author(s): Flor Miriam Plaza-del-Arco, Paul Röttger, Nino Scherrer, Emanuele Borgonovo, Elmar Plischke, Dirk Hovy
Published in: Proceedings of the 9th Widening NLP Workshop, Issue November, 2025, Page(s) 268-282
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.winlp-main.39

SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors

Author(s): Tiancheng Hu; Joachim Baumann; Lorenzo Lupo; Nigel Collier; Dirk Hovy; Paul Röttger
Published in: The Fourteenth International Conference on Learning Representations (ICLR 2026), Issue 23–27 April 2026, 2026
Publisher: International Conference on Learning Representations

Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions

Author(s): Matthias Orlikowski, Jiaxin Pei, Paul Röttger, Philipp Cimiano, David Jurgens, Dirk Hovy
Published in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue July, 2025, Page(s) 2092-2111
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.acl-long.104

SocioProbe: What, When, and Where Language Models Learn about Sociodemographics

Author(s): Lauscher, Anne; Bianchi, Federico; Bowman, Samuel R.; Hovy, Dirk
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022, Page(s) 7901–7918
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.539

XLM-EMO: Multilingual Emotion Prediction in Social Media Text

Author(s): Federico Bianchi, Debora Nozza, Dirk Hovy
Published in: Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, 2022, Page(s) 195–203
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.wassa-1.18

Biased Tales: Cultural and Topic Bias in Generating Children’s Stories

Author(s): Donya Rooein, Vilém Zouhar, Debora Nozza, Dirk Hovy
Published in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, Issue November, 2025, Page(s) 52-72
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.emnlp-main.3

“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models

Author(s): Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
Published in: Findings of the Association for Computational Linguistics ACL 2024, Issue August, 2024, Page(s) 7407-7416
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-acl.441

Hard and Soft Evaluation of NLP models with BOOtSTrap SAmpling - BooStSa

Author(s): Tommaso Fornaciari; Alexandra Uma; Massimo Poesio; Dirk Hovy
Published in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2022, Page(s) 127–134
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.acl-demo.12

Classist Tools: Social Class Correlates with Performance in NLP

Author(s): Amanda Cercas Curry, Giuseppe Attanasio, Zeerak Talat, Dirk Hovy
Published in: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue August (Vol. 1 Long Papers), 2024, Page(s) 12643-12655
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.682

Educators’ Perceptions of Large Language Models as Tutors: Comparing Human and AI Tutors in a Blind Text-only Setting

Author(s): Sankalan Pal Chowdhury, Terry Jingchen Zhang, Donya Rooein, Dirk Hovy, Tanja Käser, Mrinmaya Sachan
Published in: Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025), Issue July, 2025, Page(s) 356-374
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.bea-1.28

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

Author(s): Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Kirk, Hinrich Schuetze, Dirk Hovy
Published in: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue August, 2024, Page(s) 15295-15311
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.816

Fair and Argumentative Language Modeling for Computational Argumentation

Author(s): Carolin Holtermann, Anne Lauscher, Simone Ponzetto
Published in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue 1, 2022, Page(s) 7841–7861
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.acl-long.541

Responsible Evaluation of AI for Mental Health

Author(s): Hiba Arnaout, Anmol Goel, H. Andrew Schwartz, Steffen T. Eberhardt, Dana Atzil-Slonim, Gavin Doherty, Brian Schwartz, Wolfgang Lutz, Tim Althoff, Munmun De Choudhury, Hamidreza Jamalabadi, Raj Sanjay Shah, Flor Miriam Plaza-del-Arco, Dirk Hovy, Maria Liakata, Iryna Gurevych
Published in: Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue July, 2026, Page(s) 7625-7660
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2026.acl-long.347

A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translation

Author(s): Giuseppe Attanasio, Flor Plaza del Arco, Debora Nozza, Anne Lauscher
Published in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Issue December, 2023, Page(s) 3996-4014
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.243

Measuring Gender Bias in Language Models in Farsi

Author(s): Hamidreza Saffari, Mohammadamin Shafiei, Donya Rooein, Debora Nozza
Published in: Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP), Issue August, 2025, Page(s) 228-241
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.gebnlp-1.21

Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts

Author(s): Rooein, Donya; Röttger, Paul; Shaitarova, Anastassia; Hovy, Dirk
Published in: Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024), Issue June, 2024, Page(s) 54-67
Publisher: Association for Computational Linguistics

The Pluralistic Moral Gap: Understanding Moral Judgment and Value Differences between Humans and Large Language Models

Author(s): Giuseppe Russo, Debora Nozza, Paul Röttger, Dirk Hovy
Published in: Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), Issue March, 2026, Page(s) 6481-6497
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2026.eacl-long.305

Contrastive Language–Image Pre-training for the Italian Language

Author(s): Federico Bianchi; Giuseppe Attanasio; Raphael Pisoni; Silvia Terragni; Gabriele Sarti; Dario Balestri
Published in: Proceedings of the Ninth Italian Conference on Computational Linguistics (CLiC-it 2023), Issue November, 2023, Page(s) 78-85
Publisher: CEUR Workshop Proceedings

DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog

Author(s): Chia-Chien Hung; Anne Lauscher; Simone Ponzetto; Goran Glavaš
Published in: Findings of the Association for Computational Linguistics: ACL 2022, Issue 1, 2022, Page(s) 891–904
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-acl.72

Pipelines for Social Bias Testing of Large Language Models

Author(s): Debora Nozza; Federico Bianchi; Dirk Hovy
Published in: "Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models", Issue 1, 2022, Page(s) 68–74
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.bigscience-1.6

Measuring Harmful Sentence Completion in Language Models for LGBTQIA+ Individuals

Author(s): Debora Nozza; Federico Bianchi; Anne Lauscher; Dirk Hovy
Published in: Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, 2022, Page(s) 26–34
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.ltedi-1.4

SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems

Author(s): Emily Dinan; Gavin Abercrombie; A. Bergman; Shannon Spruit; Dirk Hovy; Y-Lan Boureau; Verena Rieser
Published in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022, Page(s) 4113–4133
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.acl-long.284

Prioritizing Data Acquisition for end-to-end Speech Model Improvement

Author(s): Alkis Koudounas, Eliana Pastor, Giuseppe Attanasio, Luca de Alfaro, Elena Baralis
Published in: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue 14-19 April 2024, 2024, Page(s) 7000-7004, ISBN 979-8-3503-4485-1
Publisher: IEEE
DOI: 10.1109/icassp48485.2024.10446326

Is It Really That Simple? Prompting Large Language Models for Automatic Text Simplification in Italian.

Author(s): Debora Nozza; Giuseppe Attanasio
Published in: CEUR Workshop Proceedings, 2023
Publisher: CEUR Workshop Proceedings

Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks

Author(s): Paul Rottger; Bertie Vidgen; Dirk Hovy; Janet Pierrehumbert
Published in: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022, Page(s) 175–190
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.naacl-main.13

Wisdom of Instruction-Tuned Language Model Crowds. Exploring Model Label Variation

Author(s): Flor Miriam Plaza-del-Arco, Debora Nozza, Dirk Hovy
Published in: Proceedings of the Language Resources and Evaluation Conference, Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives) @ LREC-COLING 2024, Issue May, 2026, Page(s) 19-30
Publisher: European Language Resources Association (ELRA) and ICCL
DOI: 10.63317/3pst5yw7e4m4

The AI Gap: How Socioeconomic Status Affects Language Technology Interactions

Author(s): Elisa Bassignana, Amanda Cercas Curry, Dirk Hovy
Published in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue July, 2025, Page(s) 18647-18664
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.acl-long.914

Computer says “No”: The Case Against Empathetic Conversational AI

Author(s): Alba Cercas Curry, Amanda Cercas Curry
Published in: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Page(s) 8123–8130
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-acl.515

MilaNLP at SemEval-2023 Task 10: Ensembling Domain-Adapted and Regularized Pretrained Language Models for Robust Sexism Detection

Author(s): Amanda Cercas Curry, Giuseppe Attanasio, Debora Nozza, Dirk Hovy
Published in: Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), 2023, Page(s) 2067–2074
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.semeval-1.285

Countering Hateful and Offensive Speech Online - Open Challenges

Author(s): Leon Derczynski, Marco Guerini, Debora Nozza, Flor Miriam Plaza-del-Arco, Jeffrey Sorensen, Marcos Zampieri
Published in: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts, Issue November, 2024, Page(s) 11-16
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.emnlp-tutorials.2

What about “em”? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns

Author(s): Anne Lauscher, Debora Nozza, Ehm Miltersen, Archie Crowley, Dirk Hovy
Published in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue 1, 2023, Page(s) 377–392
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-long.23

Exposing the limits of Zero-shot Cross-lingual Hate Speech Detection

Author(s): Debora Nozza
Published in: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Issue 2, 2021, Page(s) 907–914
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.acl-short.114

Do Large Language Models Adapt to Language Variation across Socioeconomic Status?

Author(s): Elisa Bassignana, Mike Zhang, Dirk Hovy, Amanda Cercas Curry
Published in: Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects, Issue March, 2026, Page(s) 317-338
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2026.vardial-1.26

Bridging Fairness and Environmental Sustainability in Natural Language Processing

Author(s): Marius Hessenthaler, Emma Strubell, Dirk Hovy, Anne Lauscher
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022, Page(s) 7817–7836
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.533

Temporal and Second Language Influence on Intra-Annotator Agreement and Stability in Hate Speech Labelling

Author(s): Gavin Abercrombie, Dirk Hovy, Vinodkumar Prabhakaran
Published in: Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), 2023, Page(s) 96–103
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.law-1.10

Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists

Author(s): Giuseppe Attanasio; Debora Nozza; Dirk Hovy; Elena Baralis
Published in: Findings of the Association for Computational Linguistics: ACL 2022, 2022, Page(s) 1105–1119
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-acl.88

We Need to Consider Disagreement in Evaluation

Author(s): Valerio Basile, Michael Fell, Tommaso Fornaciari, Dirk Hovy, Silviu Paun, Barbara Plank, Massimo Poesio, Alexandra Uma
Published in: Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future, Issue August, 2021, Page(s) 15-21
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.bppf-1.3

Subjective Isms? On the Danger of Conflating Hate and Offence in Abusive Language Detection

Author(s): Amanda Cercas Curry, Gavin Abercrombie, Zeerak Talat
Published in: Proceedings of the 8th Workshop on Online Abuse and Harms (WOAH 2024), Issue June, 2024, Page(s) 275-282
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.woah-1.22

Can Demographic Factors Improve Text Classification? Revisiting Demographic Adaptation in the Age of Transformers

Author(s): Chia-Chien Hung, Anne Lauscher, Dirk Hovy, Simone Paolo Ponzetto, Goran Glavaš
Published in: Findings of the Association for Computational Linguistics: EACL 2023, 2023, Page(s) 1565–1580
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-eacl.116

HONEST: Measuring Hurtful Sentence Completion in Language Models

Author(s): Debora Nozza; Federico Bianchi; Dirk Hovy
Published in: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Issue 1, 2021, Page(s) 2398–2406
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.naacl-main.191

Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages

Author(s): Röttger, Paul; Nozza, Debora; Bianchi, Federico; Hovy, Dirk
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022, Page(s) 5674–5691
Publisher: Association for Computational Linguistics Abu Dhabi, United Arab Emirates
DOI: 10.18653/v1/2022.emnlp-main.383

Mirages. On Anthropomorphism in Dialogue Systems

Author(s): Gavin Abercrombie, Amanda Curry, Tanvi Dinkar, Verena Rieser, Zeerak Talat
Published in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Issue December, 2023, Page(s) 4776-4790
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.290

Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution

Author(s): Flor Miriam Plaza Del Arco, Amanda Curry, Alba Cercas Curry, Gavin Abercrombie, Dirk Hovy
Published in: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Issue Volume 1, 2024, Page(s) 7682-7696
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-long.415

Divine LLaMAs: Bias, Stereotypes, Stigmatization, and Emotion Representation of Religion in Large Language Models

Author(s): Flor Miriam Plaza-del-Arco, Amanda Cercas Curry, Susanna Paoli, Alba Cercas Curry, Dirk Hovy
Published in: Findings of the Association for Computational Linguistics: EMNLP 2024, Issue Number, 2024, Page(s) 4346-4366
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.findings-emnlp.251

The Importance of Modeling Social Factors of Language: Theory and Practice

Author(s): Dirk Hovy; Diyi Yang
Published in: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Issue 1, 2021, Page(s) 588–602
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.naacl-main.49

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models

Author(s): Paul Röttger, Hannah Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi, Dirk Hovy
Published in: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), Issue June, 2024, Page(s) 5377-5400
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.naacl-long.301

Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance

Author(s): Pedro Henrique Luz de Araujo, Paul Röttger, Dirk Hovy, Benjamin Roth
Published in: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, Issue November, 2025, Page(s) 26845-26874
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.emnlp-main.1364

The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values

Author(s): Hannah Kirk, Andrew Bean, Bertie Vidgen, Paul Rottger, Scott Hale
Published in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Issue December, 2023, Page(s) 2409-2430
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.148

HATE-ITA: Hate Speech Detection in Italian Social Media Text

Author(s): Debora Nozza, Federico Bianchi, Giuseppe Attanasio
Published in: Proceedings of the Sixth Workshop on Online Abuse and Harms (WOAH), Issue July, 2022, Page(s) 252-260
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.woah-1.24

PATS: Personality-Aware Teaching Strategies with Large Language Model Tutors

Author(s): Donya Rooein, Sankalan Pal Chowdhury, Mariia Eremeeva, Yuan Qin, Debora Nozza, Mrinmaya Sachan, Dirk Hovy
Published in: Findings of the Association for Computational Linguistics: EACL 2026, Issue March, 2026, Page(s) 4186-4211
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2026.findings-eacl.219

Language Invariant Properties in Natural Language Processing

Author(s): Federico Bianchi; Debora Nozza; Dirk Hovy
Published in: Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP, 2022, Page(s) 84–92
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.nlppower-1.9

Benchmarking Post-Hoc Interpretability Approaches for Transformer-based Misogyny Detection

Author(s): Giuseppe Attanasio; Debora Nozza; Eliana Pastor; Dirk Hovy
Published in: Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP, 2022, Page(s) 100–112
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.nlppower-1.11

Explaining Speech Classification Models via Word-Level Audio Segments and Paralinguistic Features

Author(s): Eliana Pastor, Alkis Koudounas, Giuseppe Attanasio, Dirk Hovy, Elena Baralis
Published in: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), Issue March, 2026, Page(s) 2221-2238
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.eacl-long.136

Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement

Author(s): Gavin Abercrombie, Tanvi Dinkar, Amanda Cercas Curry, Verena Rieser, Dirk Hovy
Published in: Proceedings of the The 4th Workshop on Perspectivist Approaches to NLP, Issue November, 2025, Page(s) 63-74
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.nlperspectives-1.6

The State of Profanity Obfuscation in Natural Language Processing Scientific Publications

Author(s): Debora Nozza, Dirk Hovy
Published in: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Page(s) 3897–3909
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-acl.240

Compromesso! Italian Many-Shot Jailbreaks undermine the safety of Large Language Models

Author(s): Fabio Pernisi, Dirk Hovy, Paul R�ttger
Published in: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), Issue August (pg 245-251), 2024, Page(s) 339-345
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.acl-srw.29

Twitter-Demographer: A Flow-based Tool to Enrich Twitter Data

Author(s): Federico Bianchi, Vincenzo Cutrona, Dirk Hovy
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2022, Page(s) 289–297
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-demos.29

Sustainable Modular Debiasing of Language Models

Author(s): Anne Lauscher; Tobias Lueken; Goran Glavaš
Published in: Findings of the Association for Computational Linguistics: EMNLP 2021, 2021, Page(s) 4782–4797
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.findings-emnlp.411

The Ecological Fallacy in Annotation: Modeling Human Label Variation goes beyond Sociodemographics

Author(s): Matthias Orlikowski, Paul Röttger, Philipp Cimiano, Dirk Hovy
Published in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Issue 2, 2023, Page(s) 1017–1029
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-short.88

MilaNLP at SemEval-2022 Task 5: Using Perceiver IO for Detecting Misogynous Memes with Text and Image Modalities

Author(s): Giuseppe Attanasio, Debora Nozza, Federico Bianchi
Published in: Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), Issue July, 2022, Page(s) 654-662
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.semeval-1.90

Welcome to the modern world of pronouns: identity-inclusive Natural Language Processing beyond gender

Author(s): Lauscher, Anne; Crowley, Archie; Hovy, Dirk
Published in: Proceedings of the 29th International Conference on Computational Linguistics, 2022, Page(s) 1221–1232
Publisher: International Committee on Computational Linguistics

Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions

Author(s): Flor Miriam Plaza-del-Arco, Alba A. Cercas Curry, Amanda Cercas Curry, Dirk Hovy
Published in: Proceedings of the Language Resources and Evaluation Conference, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Issue May, 2026, Page(s) 5696-5710
Publisher: European Language Resources Association (ELRA) and ICCL
DOI: 10.63317/3kradf7tw6gm

Guiding the Release of Safer E2E Conversational AI through Value Sensitive Design

Author(s): Bergman, A. Stevie; Abercrombie, Gavin; Spruit, Shannon; Hovy, Dirk; Dinan, Emily; Boureau, Y-Lan; Verena Rieser
Published in: Proceedings of the 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2022, Page(s) 39–52
Publisher: Association for Computational Linguistics

Exploring Subjective Tasks in Farsi: A Survey Analysis and Evaluation of Language Model

Author(s): Donya Rooein, Flor Miriam Plaza-del-Arco, Debora Nozza, Dirk Hovy
Published in: The Proceedings for the 15th Workshop on Computational Approaches to Subjectivity, Sentiment Social Media Analysis (WASSA 2026), Issue March, 2026, Page(s) 83-95
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2026.wassa-1.8

Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps

Author(s): Giuseppe Attanasio, Beatrice Savoldi, Dennis Fucci, Dirk Hovy
Published in: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Issue November, 2024, Page(s) 21318-21340
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2024.emnlp-main.1188

Impoverished Language Technology: The Lack of (Social) Class in NLP

Author(s): Amanda Cercas Curry, Zeerak Talat, Dirk Hovy
Published in: Proceedings of the Language Resources and Evaluation Conference, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Issue May, 2026, Page(s) 8675-8682
Publisher: European Language Resources Association (ELRA) and ICCL
DOI: 10.63317/3rkpbzff74pc

SafetyPrompts: A Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety

Author(s): Paul Röttger, Fabio Pernisi, Bertie Vidgen, Dirk Hovy
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 39, 2025, Page(s) 27617-27627, ISSN 2374-3468
Publisher: Association for the Advancement of Artificial Intelligence (AAAI)
DOI: 10.1609/aaai.v39i26.34975

IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance

Author(s): Paul Röttger, Musashi Hinck, Valentin Hofmann, Kobi Hackenburg, Valentina Pyatkin, Faeze Brahman, Dirk Hovy
Published in: Transactions of the Association for Computational Linguistics, Issue 14, 2026, Page(s) 318-340, ISSN 2307-387X
Publisher: MIT Press
DOI: 10.1162/tacl.a.626

Five sources of bias in natural language processing

Author(s): Dirk Hovy, Shrimai Prabhumoye
Published in: Language and Linguistics Compass, Wiley, 2021, ISSN 1749-818X
Publisher: Blackwell
DOI: 10.1111/lnc3.12432

Viewpoint: Artificial Intelligence Accidents Waiting to Happen?

Author(s): Federico Bianchi, Amanda Cercas Curry, Dirk Hovy
Published in: Journal of Artificial Intelligence Research, Issue Vol. 76 (2023), 2023, ISSN 1076-9757
Publisher: Morgan Kaufmann Publishers, Inc.
DOI: 10.1613/jair.1.14263

MSTS: A Multimodal Safety Test Suite for Vision-Language Models

Author(s): Paul Röttger; Giuseppe Attanasio; Felix Friedrich; Janis Goldzycher; Alicia Parrish; Rishabh Bhardwaj; Chiara Di Bonaventura; Roman Eng; Gaia El Khoury Geagea; Subhra S. Goswami; Jieun Han; Dirk Hovy; Seogyeong Jeong; Paloma Jeretic; Flor Miriam Plaza del Arco; Donya Rooein; Patrick Schramowski; Anastassia Shaitarova; Xudong Shen; Richard Willats; Andrea Zugarini; Bertie Vidgen
Published in: ArXiv, Issue arXiv:2501.10057, 2025
Publisher: ArXiv

The Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment

Author(s): Donya Rooein; Luca Benedetto; Dirk Hovy
Published in: arXiv, Issue arXiv:2609.16993, 2026
Publisher: arXiv

WildSEEK: Evaluating Language Models for Information-Seeking

Author(s): Tanise Ceron; Joachim Baumann; Elisa Bassignana; Berat Cabuk; Dirk Hovy; Debora Nozza
Published in: Issue arXiv:2608.30683, 2026
Publisher: Arxiv

Searching for OpenAIRE data...

Project Results

Deliverables

Publications

Download Download the content of the page