Lifting Methods for Global Matching Problems

Projektinformationen

LiftMatch

ID Finanzhilfevereinbarung: 771136

DOI

10.3030/771136

Das Projekt endete am 7 Februar 2023

EK-Unterschriftsdatum 12 Februar 2018

Startdatum 1 März 2018

Enddatum 28 Februar 2023

Finanziert unter

• EXCELLENT SCIENCE - European Research Council (ERC)

Gesamtkosten

€ 1 675 640,00

EU-Beitrag

€ 1 675 640,00

Koordiniert durch

WEIZMANN INSTITUTE OF SCIENCE
Israel

Periodic Reporting for period 4 - LiftMatch (Lifting Methods for Global Matching Problems)

Berichtszeitraum: 2022-09-01 bis 2023-02-28

Zusammenfassung vom Kontext und den Gesamtzielen des Projekts

This project advocates and develops a certain methodology, called "lifting", for providing means to solving, or approximately solving problems involving different kinds of irregular data such as point clouds, graphs or surfaces. Irregular data is prevalent in nature and science and is used to model or represent different physical objects or phenomena ranging from molecules, and 3D shapes to social graphs and networks.

The basic operation of analyzing, comparing or relating such irregular data is often times a challenging task since these objects do not have a canonical representation and/or can undergo an arbitrary deformation or transformation. The lifting methodology builds on the observation that in certain cases these problems be come easier, or more tractable, when embedded in higher dimensions. This projects develops different lifting methods to analyze and learn irregular data. The project contributed methods to deal with shape matching, using convex and concave relaxations, equivariant/invariant learning, and implicit neural representations. It provided new means to analyze and learn graph and hyper-graph data and developed accompanying theory. Furthermore, the project explored several methods to analyze surface data by representing it with multiple chart, topological covers, and implicit representations.

The project outcomes are computational methods (including code), with corresponding theory, to learn and analyze irregular data that include point clouds, graphs, hyper-graphs, and surfaces.

Arbeit, die ab Beginn des Projekts bis zum Ende des durch den Bericht erfassten Berichtszeitraums geleistet wurde, und die wichtigsten bis dahin erzielten Ergebnisse

The work so far can divided into three groups:

Group A: Shape matching. In this group we have developed formulations, algorithms and numerical solvers for certain matching problems that include the doubly stochastic relaxation, a popular linear program lift, and investigated a concave relaxation which builds upon a surprising measure concentration phenomenon.

Group B: Graphs and hyper-graphs. In this group we introduced and analyzed a novel family of neural network architectures used for learning graphs and hyper-graphs. These architectures learn lifts from the original data representation to higher dimensional tensor spaces and maps between these spaces. We proved in that lifts to high dimensions are required to achieve universal (i.e. maximally expressive) models, and showed that in some cases lower dimensional lifts are suffice to achieve expressiveness.

Group C: Surfaces. In this group of works we studied various surface representations such as: multiple charts, topological covers, and level sets of volumetric functions to represent surfaces. We used these representations for analyzing and learning surface data, surface reconstruction, and generation.

Fortschritte, die über den aktuellen Stand der Technik hinausgehen und voraussichtliche potenzielle Auswirkungen (einschließlich der bis dato erzielten sozioökonomischen Auswirkungen und weiter gefassten gesellschaftlichen Auswirkungen des Projekts)

In all groups (A,B,C) the project introduced new methodologies and state-of-the-art results. Until the end of the project we expect further developments adding to groups B,C; mainly introducing new applications and new problem formulations, as well as keep improving the previously introduced methods. We expect improving our graph and surface data representations, and consider a wider range of problems, e.g. applications to physics. We also aim at generalizing our method to higher dimensional manifolds.

Defining a convolution operator on point clouds using a lift to a higher dimensional space.

Learning a surface by reducing Eikonal loss in the ambient space.

Visualization of the 15 element basis of all 2nd order equivariant linear layers.