Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Advanced User-centric, Trustworthy and Privacy-preserving AI-powered Search Engine

Project description

Trustworthy, privacy-secure and user-centric AI-powered search engine

The recent advancements of large language models (LLMs) and AI solutions has led to the increased use of AI-powered search engines (AIPSEs) such as Perplexity. AIPSEs could significantly advance the European Green Deal by synthesising key information from multiple sources. However, current AIPSEs pose serious risks, including privacy concerns and biased responses, making them unsuitable for these important tasks. Supported by the Marie Skłodowska-Curie Actions programme, the AURORA project will design a trustworthy, user-centric, and privacy-preserving prototype that complies with the GDPR and the EU AI Act. To achieve this, it will conduct key studies and design models and privacy schemes to block misinformation and protect user privacy.

Objective

The European Green Deal aims to build a resource-efficient, competitive EU economy with net-zero greenhouse gas emissions, clean energy and sustainable industries. Achieving this requires quick and reliable access to information on climate change, energy production, and technological developments. AI-powered search engines (AIPSEs) like Perplexity, can automatically retrieve information from multiple sources and deliver synthesized answers to users—saving them time browsing various websites.

However, AIPSEs are still in their infancy and face critical security challenges, including generating biased or malicious responses, privacy leaks, and limited research in this area. For instance, Google’s AI Overviews generated dangerous responses like suggesting user eat rocks and glue (2024), and attackers can trick AIPSE into citing malicious content from phishing websites. Some AIPSEs track user histories for personalization, raising privacy risks; notably, a ChatGPT glitch exposed users' private conversations (2023).

AURORA (Advanced User-centric, tRustwOrthy and pRivacy-preserving AI-powered search engine) is my proposal to mitigate these challenges, which aims to develop a user-centric AIPSE that provides trustworthy responses while protecting user privacy, and adhering to GDPR and EU AI Act. AURORA includes: 1). a user study on how users perceive malicious responses generated by existing AIPSEs, to guide user-centric design (WP1); 2). a multi-agent debate model with ML-based filters to automatically block fabricated and malicious content (WP2), which is expected to block around 90% of malicious sources, and to reduce hallucinations by about 10%; 3). a local differential privacy scheme to protect user data (WP3). By preventing the spread of misinformation, blocking malicious responses, and protecting privacy, AURORA enables policymakers, researchers, and citizens to make informed decisions about energy, environmental policies, and sustainable practices.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2025-PF

See all projects funded under this call

Coordinator

THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
Net EU contribution
€ 260 347,92
Address
WELLINGTON SQUARE UNIVERSITY OFFICES
OX1 2JD Oxford
United Kingdom
Region
South East (England) Berkshire, Buckinghamshire and Oxfordshire Oxfordshire
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Participants (1)