Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Data-Driven and User-Centered Content Moderation

Project description

Personalised moderation interventions to combat online misbehaviour

Online platforms use moderation interventions (MIs) to tackle misbehaviour, yet the current one-size-fits-all approach overlooks individual user differences. Content moderation is more of an art than a science, with MIs often crafted based on intuition and subsequently refined through trial and error. Consequently, existing MIs exhibit varying efficacy and fall short of meeting moderation requirements. The ERC-funded DEDUCE project seeks to transform content moderation by introducing personalised moderation interventions (PMIs). This initiative involves evaluating current moderation practices and assessing their effectiveness and fairness. PMIs will be tailored to individual user characteristics, thereby enhancing their efficacy. Additionally, the project aims to develop causal methods and indicators for moderation practices, enabling the proactive evaluation of multiple moderation interventions.

Objective

Online platforms apply moderation interventions (MIs) to mitigate misbehavior. Today, MIs are one-size-fits-all, meaning that each intervention is applied in the same way for all users. However, not all users are the same, as they have diverse demographics, ideologies, and personalities. This naive approach to content moderation is platform-centered and neglects user differences. Moreover, content moderation resembles art more than science. The design of MIs is based on common sense and intuition, and progress is sought via trial-and-error rather than via a rigorous scientific process. The inevitable consequence is that current MIs have variable effectiveness, are highly unreliable, and fall short of the moderation needs.
The ambitious goal of DEDUCE is to initiate a paradigm-shift in content moderation, by building the theoretical and methodological foundations to move from intuition-driven approaches enforced via one-size-fits-all MIs, to science-driven strategies grounded on personalized moderation interventions (PMIs). We will develop causal methods and indicators to evaluate the effectiveness and fairness of current content moderation practices. Then, we will study how user characteristics influence the outcomes of moderation. Finally, we will leverage the acquired knowledge to design and evaluate PMIs, a first-of-its-kind endeavor. Our data-driven approach will enable us to evaluate in advance the effects of many MIs (what-if analyses) and to plan ahead their application, rather than to assess and correct afterwards. The high-gain nature of DEDUCE is evident, as it will open new directions of research (e.g. the design of PMIs), while also providing major practical and social benefits. Our results will yield groundbreaking advancements in the theory and practice of content moderation, and will be embodied in (i) practical guidelines for moderators and policymakers and (ii) an open-source proof-of-concept system to support both human and automated moderation.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2023-STG

See all projects funded under this call

Host institution

CONSIGLIO NAZIONALE DELLE RICERCHE
Net EU contribution
€ 1 149 775,00
Address
PIAZZALE ALDO MORO 7
00185 Roma
Italy
Region
Centro (IT) Lazio Roma
Activity type
Research Organisations
Links
Total cost
€ 1 494 775,00

Beneficiaries (2)