Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Machine learning in science and society: A dangerous toy?

Project description

Pros and cons of deep learning technology

The emergence of novel deep learning (DL) and machine learning technologies has led to their widespread adoption across scientific fields and institutions, becoming a central part of new research efforts. However, despite their increasing use, little is known about the potential benefits and risks of widespread DL adoption, particularly in the scientific and educational sectors. The ERC-funded TOY project aims to explore the epistemic strengths, limitations and dangers of DL models and technology in a society increasingly dependent on them. It will accomplish this by studying DL models as ‘toy models’, developing new theories and conducting in-depth analyses of their effects and interdependencies.

Objective

"Deep learning (DL) models are encroaching on nearly all our knowledge institutions. Ever more scientific fields—from medical science to fundamental physics—are turning to DL to solve long-standing problems or make new discoveries. At the same time, DL is used across society to inform and provide knowledge. We urgently need to evaluate the potentials and dangers of adopting DL for epistemic purposes, across science and society. This project uncovers the epistemic strengths and limits of DL models that are becoming the single most way we are structuring all our knowledge, and it does so by starting with an innovative hypothesis: that DL models are toy models.

A toy model is a type of highly idealized model that greatly distorts the gritty details of the real world. Every scientific domain has their own toy models that are used to ""play around"" with different features, gaining insight into complex phenomena. Conceptualizing DL models as toy models exposes the epistemic benefits of DL, but also the enormous risk of overreliance. Since toy models are so divorced from the real world, how do we know they are not leading us astray? TOY addresses this fundamental issue. TOY 1) identifies interlocking model puzzles that face DL models and toy models alike, 2) develops a theory of DL (toy) models in science and society based on the function of their idealizations and 3) develops a philosophical theory for evaluating the epistemic value of DL (toy) models across science and society. In so doing, TOY solves existing problems, answers open questions, and identifies new challenges in philosophy of science, on the nature and epistemic value of idealization and toy models; in philosophy of ML, by looking beyond DL opacity and developing a philosophical method for evaluating the epistemic value of DL models; and by bringing siloed debates in ethics of AI together with philosophy of science, providing necessary guidance on the appropriate use and trustworthiness of DL in society."

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2024-STG

See all projects funded under this call

Host institution

UNIVERSITEIT UTRECHT
Net EU contribution
€ 1 500 000,00
Address
HEIDELBERGLAAN 8
3584 CS Utrecht
Netherlands
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 500 000,00

Beneficiaries (1)