Does standardization matter? Evaluating the potential of the Common European Framework of Reference for Languages (CEFR) for reducing employment discrimination faced by immigrants.

Project Information

DISCEFRN

Grant agreement ID: 101065566

DOI

10.3030/101065566

Project closed

EC signature date 22 July 2022

Start date 1 September 2023

End date 30 April 2025

Funded under

• Marie Skłodowska-Curie Actions (MSCA)

Total cost

No data

EU contribution

€ 140 607,36

Coordinated by

HOGSKULEN PA VESTLANDET
Norway

Periodic Reporting for period 1 - DISCEFRN (Does standardization matter? Evaluating the potential of the Common European Framework of Reference for Languages (CEFR) for reducing employment discrimination faced by immigrants.)

Reporting period: 2023-09-01 to 2025-04-30

Summary of the context and overall objectives of the project

Reducing ethnic discrimination and promoting inclusive growth remain key priorities of the European Commission and align with the UN Sustainable Development Goals. However, persistent hiring discrimination against immigrants—often linked to host-country language skills—continues across many countries.

This project examined the potential and pitfalls of introducing standardized language requirements based on the Common European Framework of Reference for Languages (CEFR) in the hiring process to reduce language-based discrimination and to improve labour market access for immigrants. Using web-scraped data from approximately 90,000 job ads, a survey experiment, and expert evaluations, the project addressed three objectives: (1) assessing whether CEFR-based requirements can reduce language-based discrimination in hiring, (2) identifying which groups and sectors might benefit most, and (3) evaluating the adequacy and scope of CEFR-based requirements that are currently set in the labour market (in Norway).

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

Within this project, web-scraped data was collected for around 90,000 job-ads in Norway over the course of 12 months, which corresponds to about 22% of all vacancies that were advertised in Norway within this time-period. This data-base was supplemented with a survey experiment that exploits the real-world variation in CEFR-based requirements within these ads (n vignette ratings= 10,495; n employers= 1,527), as well as with evaluations of the ad content by CEFR experts (n=780). This data was analysed and exploited to address Objectives 1-3. These tasks reflect the main (scientific) activities comprised in WP1-3.

The main scientific achievements/outcomes of the project include 2 data-sets and statistical code packages for re-use among the scientific community (embargoed), conference presentations and network meetings, as well as a submitted journal article (pre-print available) and further manuscripts in preparation. The MSCA fellow, further, obtained funding to develop follow-up project proposals, expanded their scientific and professional networks (e.g. scientific advisory boards, knowledge networks and working groups) and received structured and applied methodological and professional training. Non-scientific achievements/outcomes, such as impacts on relevant stakeholders (e.g. employers, policy makers, language test providers, - developers, and – teachers) are described below.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

Results suggest that CEFR-based requirements can help reduce language-based discrimination, but only if properly implemented—especially through appropriate and differentiated levels. Web-scraped data showed that comparatively few employers in Norway use CEFR-based requirements, with the highest use in public sector roles, notably healthcare and education. Experts found about half of these requirements adequate; when inadequate, they were often set too high—particularly for healthcare assistants. Experts also recommended setting more differentiated CEFR levels (e.g. A2 writing, B1 speaking,listening,reading) instead of flat requirements (e.g. B1 overall), especially in healthcare and education. The survey experiment showed that CEFR-based requirements can improve immigrant applicants' perceived hireability, especially when paired with broader anti-discrimination measures.

These results were shared with employers and other relevant stakeholders (e.g. via workshop, webinar (video recordings), newsletter/briefing, materials on the project homepage), who were thereby also introduced to a “good practice” tool that is currently being developed to support employers in setting adequate CEFR-based requirements (Digital Needs Analysis, currently developed by the ALTE LAMI SIG, WP5/Council of Europe: https://www.alte.org/LAMI-SIG). The project results also informed hearing statements on language requirement legislation in the healthcare sector in Norway. Results were also shared with language test providers, - developers, and – teachers including the executive agency for the Ministry of Education and Research within the higher education and higher vocational education sectors, responsible for the national skills policy (presentations, meetings and network events).

Results were also made available to the scientific community (pre-prints, presentations; data and code preparation) and the general public (presentations and homepage materials available for download, planned newspaper article).

In sum, project results were shared with approx. 43,000 employers and other relevant agents/stakeholders in the field.