Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

FAst and energy efficient Learned image and video CompresiON

Project description

Deep learning technology to decarbonise video streaming

Video streaming is bad for the environment. Studies show that 60 minutes of streaming in Europe has a carbon footprint equivalent to driving 250 metres. Video compression technologies may help reverse this trend by reducing the data used to encode digital video content without loss of quality. While major media are investing in methods to revolutionise image/video compression, these methods are difficult to implement in consumer devices. The EU-funded FALCON project will investigate a novel framework for developing fast and energy-efficient deep learning-based image and video compression to reduce their carbon footprint. The findings will benefit important EU policies such as the Paris Agreement and the EU Green Deal.

Objective

The emerging Learned Compression (LC) methods show great potential to revolutionize image/video compression, and major media industries are investing heavily in this field. However, the high computational complexity of these methods makes it difficult to employ them in consumer devices, and this obstacle discourages using them in future compression standards, such as JPEG and MPEG, despite their superior performance compared to traditional methods. This project will investigate a novel framework for developing fast and energy-efficient Deep Learning-based compression. We will develop methods that (1) greatly improve the compression efficiency of LC, and (2) significantly reduce its computational complexity and energy consumption. Given the huge share of video industry in global Greenhouse gas emission, this will be a big step towards important EU policies such as the Paris agreement and the EU Green Deal. The objectives of the project are achieved via: (i) splitting the coding into smaller tasks, (ii) investigating efficient learning methods (including Operational Neural Networks, an invention of the supervisor of the project), and (iii) integrating human perception into image/video coding.
The experienced researcher holds a PhD in computer engineering, during which he worked on accelerating the encoding process of compression standards. He has a background and skill-set in hardware engineering, signal processing, media technology, and machine learning, which is necessary for this interdisciplinary project. The project will be carried out under the supervision of an internationally famous scientist who has extensive experience in both machine learning and video compression. The host institution in Finland has a long experience in EU funding and collaborations with industries. The results and findings will be published in top international journals and conferences. Moreover, some findings will be considered for possible exploitation in future MPEG/JPEG standards.

Keywords

Programme(s)

Topic(s)

Funding Scheme

MSCA-IF - Marie Skłodowska-Curie Individual Fellowships (IF)

See all projects funded under this funding scheme

Call for proposal

(opens in new window) H2020-MSCA-IF-2020

See all projects funded under this call

Coordinator

TAMPEREEN KORKEAKOULUSAATIO SR
Net EU contribution
€ 190 680,96
Total cost
€ 190 680,96