Objective
Shannon's Information Theory establishes the fundamental limits of information processing systems. A concept that is hidden in the mathematical proofs most of the Information Theory literature, is that in order to achieve the fundamental limits we need sequences of infinite duration. Practical information processing systems have strict limitations in terms of length, induced by system constraints on delay and complexity. The vast majority of the Information Theory literature ignores these constraints and theoretical studies that provide a finite-length treatment of information processing are hence urgently needed. When finite-lengths are employed, asymptotic techniques (laws of large numbers, large deviations) cannot be invoked and new techniques must be sought. A fundamental understanding of the impact of finite-lengths is crucial to harvesting the potential gains in practice. This project is aimed at contributing towards the ambitious goal of providing a unified framework for the study of finite-length Information Theory. The approach in this project will be based on information-spectrum combined with tight bounding techniques. A comprehensive study of finite-length information theory will represent a major step forward in Information Theory, with the potential to provide new tools and techniques to solve open problems in multiple disciplines. This unconventional and challenging treatment of Information Theory will advance the area and will contribute to disciplines where Information Theory is relevant. Therefore, the results of this project will be of benefit to areas such as communication theory, probability theory, statistics, physics, computer science, mathematics, economics, bioinformatics and computational neuroscience.
Fields of science
Call for proposal
ERC-2010-StG_20091028
See other projects for this call
Funding Scheme
ERC-SG - ERC Starting GrantHost institution
08002 Barcelona
Spain