Project description
Tools for cross-lingual pseudo-labelling in computational social science
Large language models (LLMs) are now widely used in natural language processing (NLP) to pseudo-label key data variables, such as emotion markers for psychologists, financial statements for economists, and toxic language for human rights researchers. Supported by the Marie Skłodowska-Curie Actions programme, the LACOS project will advance the use of LLMs in computational social science (CSS). The project will develop tools to efficiently pseudo-label CSS data in a cross-lingual context and create a dataset to evaluate LLMs’ language robustness. It will also identify best practices for cross-lingual pseudo-labelling and explore active learning techniques to minimise manual annotation efforts. The outcomes will save resources for CSS researchers and make tools accessible across languages.
Objective
Large Language Models (LLMs) have become ubiquitous in the area of Natural Language Processing (NLP). This project aims to advance the applications of LLMs in the multidisciplinary field of Computational Social Science (CSS). Specifically, LLMs are often used to pseud-label (at scale) variables in data that are of interest to social scientists (e.g. a psychologist would look for emotion markers, an economist for statements about money, a human rights researcher for toxic language etc.) I will develop and test novel tooling for applying LLMs to efficiently pseudo-label CSS data in a cross-lingual setting. The project will proceed in three phases. First, a dataset and methodology for evaluating the language robustness of LLMs (isolated from all other confounding factors) will be developed. Second, using this methodology a set of general best practices will be determined for the scenario of applying LLMs to cross-lingual pseudo-labeling for CSS. Finally, both existing and novel active learning approaches will be investigated to minimize the manual annotation effort required to oversee the pseudo-labeling process. Using insights from this project a user-friendly freely publicly available tool for pseudo-labeling using LLMs will be published. The methods will be tested on two example tasks: toxicity detection and disinformation detection. Overall, the project results will make the work of CSS researchers more efficient in terms of both time and financial resources. Moreover, the cross-lingual nature of the tool will make it applicable to languages other than English, including small and low-resourced languages. Consequently, this project will contribute to make tooling accessible to a wide and diverse set of CSS researchers, increasing the outreach and inclusivity of CSS research and fostering international collaboration.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service
You need to log in or register to use this function
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2024-PF-01
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
1010 Wien
Austria
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.