Project description
Value-aware AI for human moral decisions
Value-aware AI means an AI performing human moral functions such as acquiring and maintaining a value system and deciding morally acceptable actions, understanding their intent and properly engaging with them. The EIC-funded VALAWAI project will develop a toolbox to build value-aware AI on two science-based pillars that include an architecture for consciousness and a foundational framework for moral decision-making. The first pillar is inspired by the global neuronal workspace model developed on neurophysiological evidence and psychological data. The second relies on psychology, social cognition and social brain science. The project will focus on social media, which include several negative effects such as disinformation and polarisation, social robots, which can enable manipulation, and medical protocols.
Objective
By Value-Aware AI we mean AI that includes a component performing the same function as human moral consciousness, namely the capacity to acquire and maintain a value system, use this value system to decide whether certain actions are morally acceptable and be aware of the value systems of its users so as to understand the intent and motivation of their actions and to properly and correctly engage with them.
The VALAWAI project will develop a toolbox to build Value-Aware AI resting on two pillars both grounded in science: An architecture for consciousness inspired by the Global Neuronal Workspace model developed on the basis of neurophysiological evidence and psychological data, and a foundational framework for moral decision-making based on psychology, social cognition and social brain science.
The project will demonstrate the utility of Value-Aware AI in three application areas for which a moral dimension urgently needs to be included: (i) social media, where we see many negative side effects such as disinformation, polarisation, and the instigation of asocial and immoral behavior, (ii) social robots, which are designed to be helpful or influence human behavior in positive ways but potentially enable manipulation, deceit and harmful behavior, and (iii) medical protocols, where VALAWAI tries to ensure medical decision making is value aligned.
The project contributes to the general goal of making EU-based AI more competitive by being more reliable, robust, ethically-guided, explainable and hence trustworthy. It does not make new proposals for guidelines and regulations (for which there is already considerable effort) but advances the state of the art in core AI technology so that ethics is embedded inside applications making them grounded in universal, European and personal values.
Fields of science
Keywords
Programme(s)
- HORIZON.3.1 - The European Innovation Council (EIC) Main Programme
Funding Scheme
HORIZON-EIC - HORIZON EIC GrantsCoordinator
28006 Madrid
Spain