Skip to main content
Ir a la página de inicio de la Comisión Europea (se abrirá en una nueva ventana)
español es
CORDIS - Resultados de investigaciones de la UE
CORDIS

Geometric Deep Learning for Neural Artifacts: Symmetry-Aware Learning across Trained Model Weights, Internal Representations, and Gradients

Objetivo

The explosive growth of deep learning has created fundamentally new data modalities: the mathematical byproducts of neural network development. Practitioners generate daily vast amounts of valuable but underutilized data---trained model weights, internal representations from inference, and network gradients from training. These byproducts, which we term Neural Artifacts, contain crucial information about model behavior, optimization, and internal processing.
Learning on neural artifacts holds transformative potential. Learning on Weight Spaces - weights of trained models - could revolutionize model selection, editing and generation. Learning on internal representations enables efficient hallucination detection on Large Language Models and other analyses. Learning on gradient spaces could transform model optimization and analysis. However, existing methods for learning on neural artifacts achieve only a fraction of this potential as they fail to account for fundamental mathematical structure, leaving the field without principled methods to harness the full power of these emerging data types.
The key insight is that neural artifacts share deep mathematical structures—symmetries inherited from their underlying architecture. By developing a geometric deep learning framework that respects these symmetries, we can unlock their full potential. Building on our pioneering equivariant architectures for neural artifacts, we propose developing theoretical foundations and practical tools. This includes designing symmetry-aware architectures, establishing theoretical guarantees, developing novel applications, and delivering open-source implementations.
Success will provide practitioners with powerful tools for understanding, generating, optimizing, and controlling neural artifacts. This research transforms neural computation byproducts into learnable information— extremely challenging due to their high dimensionality and symmetry structure, but with revolutionary potential.

Ámbito científico (EuroSciVoc)

Este proyecto aún no se ha clasificado con EuroSciVoc.
Sugiera los ámbitos científicos que considere más relevantes y ayúdenos a mejorar nuestro servicio de clasificación.

Palabras clave

Programa(s)

Tema(s)

Régimen de financiación

HORIZON-ERC - HORIZON ERC Grants

Ver todos los proyectos financiados en el marco de este régimen de financiación

Convocatoria de propuestas

(se abrirá en una nueva ventana) ERC-2026-STG

Ver todos los proyectos financiados en el marco de esta convocatoria

Institución de acogida

TECHNION - ISRAEL INSTITUTE OF TECHNOLOGY
Aportación neta de la UEn
€ 1 637 500,00
Coste total
€ 1 637 500,00

Beneficiarios (1)