Skip to main content
European Commission logo print header

4DVideo: 4D spatio-temporal modeling of real-world events from video streams

Objectif

The focus of this project is the development of algorithms that allow one to capture and analyse dynamic events taking place in the real world. For this, we intend to develop smart camera networks that can perform a multitude of observation tasks, ranging from surveillance and tracking to high-fidelity, immersive reconstructions of important dynamic events (i.e. 4D videos). There are many fundamental questions in computer vision associated with these problems. Can the geometric, topologic and photometric properties of the camera network be obtained from live images? What is changing about the environment in which the network is embedded? How much information can be obtained from dynamic events that are observed by the network? What if the camera network consists of a random collection of sensors that happened to observe a particular event (think hand-held cell phone cameras)? Do we need synchronization? Those questions become even more challenging if one considers active camera networks that can adapt to the vision task at hand. How should resources be prioritized for different tasks? Can we derive optimal strategies to control camera parameters such as pan, tilt and zoom, trade-off resolution, frame-rate and bandwidth? More fundamentally, seeing cameras as points that sample incoming light rays and camera networks as a distributed sensor, how does one decide which rays should be sampled? Many of those issues are particularly interesting when we consider time-varying events. Both spatial and temporal resolution are important and heterogeneous frame-rates and resolution can offer advantages. Prior knowledge or information obtained from earlier samples can be used to restrict the possible range of solutions (e.g. smoothness assumption and motion prediction). My goal is to obtain fundamental answers to many of those question based on thorough theoretical analysis combined with practical algorithms that are proven on real applications.

Appel à propositions

ERC-2007-StG
Voir d’autres projets de cet appel

Régime de financement

ERC-SG - ERC Starting Grant

Institution d’accueil

EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
Contribution de l’UE
€ 1 757 422,00
Adresse
Raemistrasse 101
8092 Zuerich
Suisse

Voir sur la carte

Région
Schweiz/Suisse/Svizzera Zürich Zürich
Type d’activité
Higher or Secondary Education Establishments
Chercheur principal
Marc Pollefeys (Prof.)
Contact administratif
Roland Siegwart (Prof.)
Liens
Coût total
Aucune donnée

Bénéficiaires (1)