Practical, Learning-Based Tools for Finding and Fixing Bugs

Información del proyecto

BugGPT

Identificador del acuerdo de subvención: 101155832

DOI

10.3030/101155832

Proyecto cerrado

Fecha de la firma de la CE 26 Enero 2024

Fecha de inicio 1 Junio 2024

Fecha de finalización 30 Noviembre 2025

Financiado con arreglo a

• European Research Council (ERC)

Coste total

Sin datos

Aportación de la UE

€ 150 000,00

Coordinado por

UNIVERSITY OF STUTTGART
Germany

Periodic Reporting for period 1 - BugGPT (Practical, Learning-Based Tools for Finding and Fixing Bugs)

Período documentado: 2024-06-01 hasta 2025-11-30

Resumen del contexto y de los objetivos generales del proyecto

The proposal's main objective is to convert existing AI-based research prototypes for bug detection and repair into practical, deployable tools integrated into real software development workflows. It focuses on building a continuous-integration–based system that analyzes code changes and test failures to automatically propose bug fixes at moments when developers are already engaged with the affected code. The project aims to leverage large language models and learning-based program repair techniques to generate accurate fixes and accompany them with concise, human-readable explanations that clarify the underlying bug and the benefit of the proposed solution. By combining automated bug detection, repair generation, and explanation synthesis into a unified pipeline, the project seeks to create robust, scalable prototypes that can operate on real-world software systems and be refined through empirical evaluation and developer feedback.

Trabajo realizado desde el comienzo del proyecto hasta el final del período abarcado por el informe y los principales resultados hasta la fecha

We developed several new techniques to detect bugs and suggest strategies for fixing them. Several of these techniques apply directly at the point of code change, helping developers avoid introducing bugs in the first place. Most notably, Testora and ChaCo (both to be presented at ICSE’26) analyze code changes provided in pull requests. Testora cross-checks the intent of a code change, as expressed in natural language, against the actual behavior of the changed code. ChaCo fills gaps in coverage by generating new tests that target the changed code and then executes those tests to validate the change. To help developers fix bugs, we developed RepairAgent, an autonomous agent that uses large language models to suggest repairs for buggy code. At the time of its initial publication (March 2024), RepairAgent was the first LLM agent for this task. Since then, many other approaches have been proposed, and our work has already been cited over 260 times. We also identified a key challenge that, if not addressed, may prevent software developers from adopting AI agents in their workflow: trust. Our CACM Communications article on this topic describes the problem and suggests strategies for building trust in AI agents.

Avances que van más allá del estado de la técnica e impacto potencial esperado (incluida la repercusión socioeconómica y las implicaciones sociales más amplias del proyecto hasta la fecha)

As a next step, this line of work can be extended toward more practical, end-to-end tooling that seamlessly fits into industrial development workflows. In particular, future efforts should focus on fully integrating automated bug detection and repair into continuous integration pipelines, enabling repairs to be suggested, validated, and, when appropriate, applied automatically as part of routine code review and testing processes. This includes improving scalability, reliability, and configurability to support large and complex codebases, as well as strengthening validation mechanisms to ensure that suggested fixes preserve intended behavior. Further development of user interfaces, feedback mechanisms, and customization options will also be essential to increase adoption and trust, ultimately enabling AI-based repair systems to function as dependable, long-term collaborators in software development.