Value-Aware Artificial Intelligence

Project Information

VALAWAI

Grant agreement ID: 101070930

DOI

10.3030/101070930

EC signature date 2 November 2022

Start date 1 October 2022

End date 30 September 2026

Funded under

• The European Innovation Council (EIC)

Total cost

€ 3 926 432,51

EU contribution

€ 3 926 432,26

Coordinated by

AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS
Spain

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (9)

Integrative Model of Moral Cognition for AI

White paper bringing state of the art social psychology into the project

Value-aware medical protocols: use case setup

Use case detailed description along with plans on the support to valueaware protocols

Social robots and value-aware AI v1

Report on user studies on perception of value-aware AI, trust and evaluation in complex real world scenarios.

Results of the behavioral testing

Report on the best strategies to support human perception of AI systems as moral agents.

Quantitative measures for Value-Aware AI

Scientific paper proposing and motivating the measures published in high profile journal

Technical report and software components

Technical contributions (available as papers, open source software, documentation, and tutorials) validated in pilot studies.

Detection of markers of moral values in social media

Publication of the research presenting the scientific basis of morality detection and markers of misbehaviour.

Use cases and scenarios

Report on use cases and scenarios eliciting value-laden decisions for robots, design of study protocols.

Draft functional specification of the RGNW Toolbox and Moral Cognition Tool

Reporting on the initial functional specification of the RGNW Toolbox and Moral Cognition Tools

Other (4)

RGNW Toolbox and Moral Cognition Tools v1

Software toolbox and a report describing its release on open platforms as well as its adoption

Moral observatory platform and library

Release of internet platform and software library to visualise moral markers and their dynamics in social media.

Value-aware tools for the management of medical protocols v1

The releases of the components developed for the medical protocols domain.

RGNW Toolbox and Moral Cognition Tools v2

Software toolbox and a report describing its release on open platforms as well as its adoption.

Websites, patent fillings, videos etc. (1)

Project Website and Logo

Delivers the project website and logo

Publications

Peer reviewed articles (18)

The role of political devotion in sharing partisan misinformation and resistance to fact-checking.

Author(s): Clara Pretus, Camila Servin-Barthet, Elizabeth A. Harris, William J. Brady, Oscar Vilarroya, Jay J. Van Bavel
Published in: Journal of Experimental Psychology: General, Issue 152, 2024, ISSN 1939-2222
Publisher: American Psychological Association (APA)
DOI: 10.1037/XGE0001436

Information Sciences

Author(s): Marc Serramià, Maite López-Sánchez, Stefano Moretti, Juan A. Rodríguez-Aguilar
Published in: Information Sciences Journal, 2023, ISSN 0020-0255
Publisher: ELSEVIER
DOI: 10.1016/j.ins.2023.02.063

Knowledge-Based Systems

Author(s): Roger X. Lera-Leri; Enrico Liscio; Filippo Bistaffa; Catholijn M. Jonker; Maite Lopez-Sanchez; Pradeep K. Murukannaiah; Juan A. Rodriguez-Aguilar; Francisco Salas-Molina
Published in: Knowledge-Based Systems, 2024, ISSN 0950-7051
Publisher: Elsevier BV
DOI: 10.1016/J.KNOSYS.2024.111453

Scientific Reports

Author(s): Ziggy O'Reilly; Serena Marchesi; Agnieszka Wykowska
Published in: Scientific Reports, 2024, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.31234/OSF.IO/YBCDZ_V2

Encoding Ethics to Compute Value-Aligned Norms

Author(s): Marc Serramia; Manel Rodriguez-Soto; Maite Lopez-Sanchez; Juan A. Rodriguez-Aguilar; Filippo Bistaffa; Paula Boddington; Michael Wooldridge; Carlos Ansotegui
Published in: Minds and Machines, 2023, ISSN 1572-8641
Publisher: Springer Nature B.V.
DOI: 10.1007/S11023-023-09649-7

The AI4Citizen pilot: Pipelining AI-based technologies to support school-work alternation programmes

Author(s): Athina Georgara, Raman Kazhamiakin, Ornella Mich, Alessio Palmero Aprosio, Jean-Christoph Pazzaglia, Juan Antonio Rodríguez Aguilar, Carles Sierra
Published in: Applied Intelligence, Issue 53, 2023, ISSN 0924-669X
Publisher: Springer Science and Business Media LLC
DOI: 10.1007/S10489-023-04758-3

Combining theory of mind and abductive reasoning in agent-oriented programming

Author(s): Nieves Montes, Michael Luck, Nardine Osman, Odinaldo Rodrigues, Carles Sierra
Published in: Autonomous Agents and Multi-Agent Systems, Issue 37, 2023, ISSN 1387-2532
Publisher: Springer Science and Business Media LLC
DOI: 10.1007/S10458-023-09613-W

A computational model of Ostrom's Institutional Analysis and Development framework

Author(s): Nieves Montes, Nardine Osman, & Carles Sierra
Published in: Artificial Intelligence, Issue 311, 2022, ISSN 0004-3702
Publisher: Elsevier
DOI: 10.1016/j.artint.2022.103756

Is this a violation? Learning and understanding norm violations in online communities

Author(s): Thiago Freitas dos Santos, Nardine Osman, Marco Schorlemmer
Published in: Artificial Intelligence, Issue 327, 2024, ISSN 0004-3702
Publisher: Elsevier BV
DOI: 10.1016/J.ARTINT.2023.104058

Multi-objective reinforcement learning for designing ethical multi-agent environments.

Author(s): Manel Rodríguez-Soto, Maite López-Sánchez, Juan A. Rodríguez-Aguilar
Published in: Neural Computing and Applications Journal, 2023, ISSN 1433-3058
Publisher: Springer-Verlag
DOI: 10.1007/s00521-023-08898-y

International Journal of Social Robotics

Author(s): Qiaoqiao Ren; Tony Belpaeme
Published in: International Journal of Social Robotics, 2024, ISSN 1875-4791
Publisher: Springer Verlag
DOI: 10.48550/ARXIV.2411.12549

A multi-scenario approach to continuously learn and understand norm violations

Author(s): Freitas dos Santos, Thiago; Osman, Nardine; Schorlemmer, Marco
Published in: Autonomous Agents and Multi-Agent Systems, 2023, ISSN 1573-7454
Publisher: Springer Science+Business Media, LLC, part of Springer Nature
DOI: 10.1007/S10458-023-09619-4

Socio-Economic Planning Sciences

Author(s): Francisco Salas-Molina, Filippo Bistaffa, Juan A. Rodríguez-Aguilar
Published in: Socio-Economic Planning Sciences, 2023, ISSN 0038-0121
Publisher: Elsevier
DOI: 10.1016/j.seps.2023.101694

Information Sciences

Author(s): Serramia, Marc; Lopez-Sanchez, Maite; Moretti, Stefano; Rodriguez-Aguilar, Juan A.
Published in: Information Sciences, 2023, ISSN 0020-0255
Publisher: Elsevier BV
DOI: 10.1016/J.INS.2023.02.063

Emotion

Author(s): Clara Pretus; Jillian K. Swencionis; Yifei Pei; Luis Marcos-Vidal; Ingrid J. Haas; William A. Cunningham; Dominic J. Packer; Jay J. Van Bavel
Published in: Emotion, 2023, ISSN 1528-3542
Publisher: American Psychological Association
DOI: 10.31234/OSF.IO/ESBY8

Philosophical Transactions of the Royal Society B: Biological Sciences

Author(s): Clara Pretus; Ali Javeed; Diána R Hughes; Kobi Hackenburg; Manos Tsakiris; Oscar Vilarroya; Jay Joseph Van Bavel
Published in: Philosophical Transactions of the Royal Society B: Biological Sciences, 2022, ISSN 0962-8436
Publisher: Royal Society of London
DOI: 10.1098/RSTB.2023.0040

Understanding the sense of self through robotics

Author(s): Tony J. Prescott, Kai Vogeley, Agnieszka Wykowska
Published in: Science Robotics, Issue 9, 2024, ISSN 2470-9476
Publisher: American Association for the Advancement of Science (AAAS)
DOI: 10.1126/SCIROBOTICS.ADN2733

Online news ecosystem dynamics: supply, demand, diffusion, and the role of disinformation

Author(s): Pietro Gravino; Giulio Prevedello; Emanuele Brugnoli
Published in: Applied Network Science, 2024, ISSN 2364-8228
Publisher: Springer
DOI: 10.1007/S41109-024-00643-1

Other (4)

Moral agents as relational systems: The Contract-Based Model of Moral Cognition for AI

Author(s): Luis Marcos Vidal, Serena Marchesi, Agnieszka Wykowska, Clara Pretus
Published in: 2024
Publisher: Center for Open Science
DOI: 10.31234/OSF.IO/52X74

Modelling Moral Decision-Making in a Contractualist Artificial Agent

Author(s): Giovanni Dalmasso, Luis Marcos Vidal, Clara Pretus
Published in: 2024
Publisher: Center for Open Science
DOI: 10.31219/OSF.IO/658RS

Scaling crowdsourcing interventions to combat partisan misinformation

Author(s): Clara Pretus; Helena Gil-Buitrago; Irene Cisma; Rosamunde C. Hendricks; Daniela Lizarazo-Villarreal
Published in: advances.in/psychology, 2024
Publisher: Elsevier B.V.
DOI: 10.56296/AIP00018

A computational model of Ostrom's Institutional Analysis and Development framework

Author(s): Montes, Nieves; Osman, Nardine; Sierra, Carles
Published in: Artificial Intelligence, 2022
Publisher: Elsevier
DOI: 10.48550/ARXIV.2105.13151

Conference proceedings (17)

Fine-Grained Clustering of Social Media: How Moral Triggers Drive Preferences and Consensus

Author(s): Emanuele Brugnoli, Pietro Gravino, Donald Ruggiero Lo Sardo, Vittorio Loreto, Giulio Prevedello
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012595000003636

Moral Narratives of Robots Increase the Likelihood of Adopting the Intentional Stance

Author(s): Ziggy O'Reilly, Serena Marchesi, Agnieszka Wykowska
Published in: Proceedings of the 12th International Conference on Human-Agent Interaction, 2025
Publisher: ACM
DOI: 10.1145/3687272.3688312

Users' Perspectives on Value Awareness in Social Robots

Author(s): Abbo, Giulio Antonio; Belpaeme, Tony
Published in: 2023
Publisher: Association for Computing Machinery
DOI: 10.5281/zenodo.8123742

Towards Value Awareness in the Medical Field

Author(s): Manel Rodriguez-Soto, Nardine Osman, Carles Sierra, Paula Sánchez Veja, Rocio Cintas Garcia, Cristina Farriols Danes, Montserrat Garcia Retortillo, Silvia Minguez Maso
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012588600003636

A Computational Model of Ostrom's Institutional Analysis and Development Framework (Extended Abstract)

Author(s): Nieves Montes, Nardine Osman, Carles Sierra
Published in: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023
Publisher: International Joint Conferences on Artificial Intelligence Organization
DOI: 10.24963/IJCAI.2023/786

MPG at DisCoTeX: Predicting Text Coherence by Tree-based Modelling of Linguistic Features

Author(s): Martina Galletti, Pietro Gravino, Giulio Prevedello
Published in: Proceedings of the Eighth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2023), 2023, ISSN 1613-0073
Publisher: CEUR-WS

Are Your Keywords Like My Queries? A Corpus-Wide Evaluation of Keyword Extractors with Real Searches

Author(s): Martina Galletti, Giulio Prevedello, Emanuele Brugnoli, Donald Ruggiero Lo Sardo, Pietro Gravino
Published in: Proceedings of the 31st International Conference on Computational Linguistics, 2025
Publisher: ACL Anthology

Towards a Definition of Awareness for Embodied AI

Author(s): Giulio Abbo, Serena Marchesi, Kinga Ciupinska, Agnieszka Wykowska, Tony Belpaeme
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012594800003636

Can Interpretability Layouts Influence Human Perception of Offensive Sentences?

Author(s): Thiago Freitas dos Santos; Nardine Osman; Marco Schorlemmer
Published in: Lecture Notes in Computer Science ISBN: 9783031700736, 2024
Publisher: Springer
DOI: 10.48550/ARXIV.2403.05581

Addressing the Value Alignment Problem Through Online Institutions

Author(s): Pablo Noriega; Harko Verhagen; Julian Padget; Mark d’Inverno
Published in: Lecture Notes in Computer Science ISBN: 9783031491320, 2023
Publisher: Springer
DOI: 10.1007/978-3-031-49133-7_5

Value Inference in Sociotechnical Systems

Author(s): Enrico Liscio, Roger Lera Leri, Filippo Bistaffa, Roel I. J. Dobbe, Catholijn M. Jonker, Maite López Sánchez y Juan A. Rodríguez Aguilar, Pradeep K. Murukannaiah
Published in: Proceedings of the 22nd International Conference on Autonomous Agents and MultiAgent Systems (AAMAS '23), 2023
Publisher: International Foundation for Autonomous Agents and Multiagent SystemsRichlandSC
DOI: 10.5555/3545946.3598838

"Awareness in robotics: An early perspective from the viewpoint of the EIC Pathfinder Challenge ""Awareness Inside"""

Author(s): Della Santina, Cosimo; Hernandez Corbato, Carlos; Sisman, Burak; Leiva, Luis A.; Arapakis, Ioannis; Vakalellis, Michalis; Vanderdonckt, Jean
Published in: arXiv, Vol. 2402, no.1, p. 15 (2024), 2024
Publisher: Springer Proceedings in Advanced Robotics
DOI: 10.1007/978-3-031-76424-0_20

An Agent-Based Model for Poverty and Discrimination Policy-Making

Author(s): Montes, Nieves; Curto, Georgina; Osman, Nardine; Sierra, Carles
Published in: CUER WS, 2023, ISSN 1613-0073
Publisher: CEUR workshop proceedings
DOI: 10.48550/arxiv.2303.13994

Notes on Measures for Information Access in Neuroscience and AI Systems

Author(s): Giulio Prevedello, Luis Marcos-Vidal, Emanuele Brugnoli, Pietro Gravino
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012596000003636

Cross-community Adapter Learning (CAL) to Understand the Evolving Meanings of Norm Violation

Author(s): Thiago Freitas dos Santos, Stephen Cranefield, Bastin Tony Roy Savarimuthu, Nardine Osman, Marco Schorlemmer
Published in: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023
Publisher: International Joint Conferences on Artificial Intelligence Organization
DOI: 10.24963/IJCAI.2023/13

Assessing LLMs Responses in the Field of Domestic Sustainability: An Exploratory Study

Author(s): Mathyas Giudici, Giulio Antonio Abbo, Ottavia Belotti, Alessio Braccini, Francesco Dubini, Riccardo Andrea Izzo, Pietro Crovari, Franca Garzotto
Published in: 2023 Third International Conference on Digital Data Processing (DDP), 2024
Publisher: IEEE
DOI: 10.1109/DDP60485.2023.00019

AwarePrompt: Using Diffusion Models to Create Methods for Measuring Value-Aware AI Architectures

Author(s): Kinga Ciupinska, Serena Marchesi, Giulio Abbo, Tony Belpaeme, Agnieszka Wykowska
Published in: Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012596400003636

Book chapters (11)

Value-Enriched Population Synthesis: Integrating a Motivational Layer

Author(s): Alba Aguilera, Miquel Albertí, Nardine Osman, Georgina Curto
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-85463-7_1

Vision Language Models as Values Detectors

Author(s): Giulio Antonio Abbo, Tony Belpaeme
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-85463-7_5

Towards the Incorporation of Social Values in Automated Negotiation Strategies

Author(s): Laura Rodriguez Cima, Dave De Jonge, Nardine Osman
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-85463-7_12

On the Relationship Between the Intentional Stance and Robot Responsibility

Author(s): Ziggy O’Reilly, Serena Marchesi
Published in: Intentional Stance Towards Humanoid Robots, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-65483-1_7

Value-Aware Multiagent Systems

Author(s): Nardine Osman
Published in: Lecture Notes in Computer Science, Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XVII, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-82039-7_3

User Study Design for Identifying the Semantics of Bioethical Principles

Author(s): Manel Rodriguez-Soto, Nardine Osman, Carles Sierra, Nieves Montes, Jordi Martinez Roldan, Rocio Cintas Garcia, Cristina Farriols Danes, Montserrat Garcia Retortillo, Silvia Minguez Maso
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-85463-7_2

Towards Convention-Based Game Strategies

Author(s): Shuxian Pan, Carles Sierra
Published in: Lecture Notes in Computer Science, Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XVI, 2023
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-49133-7_10

Justifications of Moral Responsibility Attributions Towards a Humanoid Robot

Author(s): Ziggy O’Reilly, Serena Marchesi, Agnieszka Wykowska
Published in: Frontiers in Artificial Intelligence and Applications, Social Robots with AI: Prospects, Risks, and Responsible Methods, 2025
Publisher: IOS Press
DOI: 10.3233/FAIA241504

Social Value Alignment in Large Language Models

Author(s): Giulio Antonio Abbo, Serena Marchesi, Agnieszka Wykowska, Tony Belpaeme
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-58202-8_6

Designing Robots That are Accepted in Human Social Environments: Anthropomorphism, the Intentional Stance, Cultural Norms and Values, and Societal Implications

Author(s): Serena Marchesi, Agnieszka Wykowska
Published in: The De Gruyter Handbook of Robots in Society and Culture, 2024
Publisher: De Gruyter
DOI: 10.1515/9783110792270-004

From the Pascal Wager to Value Engineering: A Glance at AI Risks and How to Address Them

Author(s): Pablo Noriega, Pompeu Casanovas
Published in: Lecture Notes in Computer Science, Value Engineering in Artificial Intelligence, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-85463-7_16

Monographic books (1)

Value Engineering in Artificial Intelligence

Published in: Lecture Notes in Computer Science, 2024
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-58202-8

Intellectual Property Rights

Other (1)

ValueAlignment: Una librería para el cálculo del alineamiento de valores.

Application/Publication number: - IDDN1.ES2.0033.5000014.0005.S6.X7.20238.0009.00000010
Date: 2024-12-12
Applicant(s): AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS