Skip to main content

Discrete Optimization in Computer Vision: Theory and Practice

Objective

This proposal aims at developing new inference algorithms for graphical models with discrete variables, with a focus on the MAP estimation task. MAP estimation algorithms such as graph cuts have transformed computer vision in the last decade; they are now routinely used and are also utilized in commercial systems.
Topics of this project fall into 3 categories.
Theoretically-oriented: Graph cut techniques come from combinatorial optimization. They can minimize a certain class of functions, namely submodular functions with unary and pairwise terms. Larger classes of functions can be minimized in polynomial time. A complete characterization of such classes has been established. They include k-submodular functions for an integer k _ 1.
I investigate whether such tools from discrete optimization can lead to more efficient inference algorithms for practical problems. I have already found an important application of k-submodular functions for minimizing Potts energy functions that are frequently used in computer vision. The concept of submodularity also recently appeared in the context of the task of computing marginals in graphical models, here discrete optimization tools could be used.
Practically-oriented: Modern techniques such as graph cuts and tree-reweighted message passing give excellent results for some graphical models such as with the Potts energies. However, they fail for more complicated models. I aim to develop new tools for tackling such hard energies. This will include exploring tighter convex relaxations of the problem.
Applications, sequence tagging problems: Recently, we developed new algorithms for inference in pattern-based Conditional Random Fields (CRFs) on a chain. This model can naturally be applied to sequence tagging problems; it generalizes the popular CRF model by giving it more flexibility. I will investigate (i) applications to specific tasks, such as the protein secondary structure prediction, and (ii) ways to extend the model.

Call for proposal

ERC-2013-CoG
See other projects for this call

Host institution

INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA
Address
Am Campus 1
3400 Klosterneuburg
Austria
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 1 641 585
Principal investigator
Vladimir Kolmogorov (Dr.)
Administrative Contact
Carla Mazuheli-Chibidziura (Ms.)

Beneficiaries (1)

INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA
Austria
EU contribution
€ 1 641 585
Address
Am Campus 1
3400 Klosterneuburg
Activity type
Higher or Secondary Education Establishments
Principal investigator
Vladimir Kolmogorov (Dr.)
Administrative Contact
Carla Mazuheli-Chibidziura (Ms.)