Lifting Methods for Global Matching Problems

Informacje na temat projektu

LiftMatch

Identyfikator umowy o grant: 771136

DOI

10.3030/771136

Realizacja projektu zakończyła się 7 Lutego 2023

Data podpisania przez KE 12 Lutego 2018

Data rozpoczęcia 1 Marca 2018

Data zakończenia 28 Lutego 2023

Finansowanie w ramach

• EXCELLENT SCIENCE - European Research Council (ERC)

Koszt całkowity

€ 1 675 640,00

Wkład UE

€ 1 675 640,00

Koordynowany przez

WEIZMANN INSTITUTE OF SCIENCE
Israel

Periodic Reporting for period 4 - LiftMatch (Lifting Methods for Global Matching Problems)

Okres sprawozdawczy: 2022-09-01 do 2023-02-28

Podsumowanie kontekstu i ogólnych celów projektu

This project advocates and develops a certain methodology, called "lifting", for providing means to solving, or approximately solving problems involving different kinds of irregular data such as point clouds, graphs or surfaces. Irregular data is prevalent in nature and science and is used to model or represent different physical objects or phenomena ranging from molecules, and 3D shapes to social graphs and networks.

The basic operation of analyzing, comparing or relating such irregular data is often times a challenging task since these objects do not have a canonical representation and/or can undergo an arbitrary deformation or transformation. The lifting methodology builds on the observation that in certain cases these problems be come easier, or more tractable, when embedded in higher dimensions. This projects develops different lifting methods to analyze and learn irregular data. The project contributed methods to deal with shape matching, using convex and concave relaxations, equivariant/invariant learning, and implicit neural representations. It provided new means to analyze and learn graph and hyper-graph data and developed accompanying theory. Furthermore, the project explored several methods to analyze surface data by representing it with multiple chart, topological covers, and implicit representations.

The project outcomes are computational methods (including code), with corresponding theory, to learn and analyze irregular data that include point clouds, graphs, hyper-graphs, and surfaces.

Prace wykonane od początku projektu do końca okresu sprawozdawczego oraz najważniejsze dotychczasowe rezultaty

The work so far can divided into three groups:

Group A: Shape matching. In this group we have developed formulations, algorithms and numerical solvers for certain matching problems that include the doubly stochastic relaxation, a popular linear program lift, and investigated a concave relaxation which builds upon a surprising measure concentration phenomenon.

Group B: Graphs and hyper-graphs. In this group we introduced and analyzed a novel family of neural network architectures used for learning graphs and hyper-graphs. These architectures learn lifts from the original data representation to higher dimensional tensor spaces and maps between these spaces. We proved in that lifts to high dimensions are required to achieve universal (i.e. maximally expressive) models, and showed that in some cases lower dimensional lifts are suffice to achieve expressiveness.

Group C: Surfaces. In this group of works we studied various surface representations such as: multiple charts, topological covers, and level sets of volumetric functions to represent surfaces. We used these representations for analyzing and learning surface data, surface reconstruction, and generation.

Innowacyjność oraz oczekiwany potencjalny wpływ (w tym dotychczasowe znaczenie społeczno-gospodarcze i szersze implikacje społeczne projektu)

In all groups (A,B,C) the project introduced new methodologies and state-of-the-art results. Until the end of the project we expect further developments adding to groups B,C; mainly introducing new applications and new problem formulations, as well as keep improving the previously introduced methods. We expect improving our graph and surface data representations, and consider a wider range of problems, e.g. applications to physics. We also aim at generalizing our method to higher dimensional manifolds.

Defining a convolution operator on point clouds using a lift to a higher dimensional space.

Learning a surface by reducing Eikonal loss in the ambient space.

Visualization of the 15 element basis of all 2nd order equivariant linear layers.