Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Universal Data Compression with Circular Context Trees

Project description

Universal data compression algorithm for arbitrary alphabets

The ITUL project, funded by an ERC Consolidator Grant, introduced a universal data compression algorithm based on circular context trees. This algorithm outperforms commercial algorithms like ZIP and BZIP, as well as advanced ones like PPM and CTW, delivering an impressive average improvement while maintaining linear decoding complexity. Building on this success, the ERC-funded UNIDACT project will enhance the current binary implementation by extending its capabilities to support arbitrary alphabets. It focuses on developing efficient encoder and decoder implementations, alongside creating specialised applications for compressing satellite observation data and genomic information. Additionally, an indexed version of the compression algorithm will be developed, allowing access to specific data without needing to decompress the entire dataset.

Objective

Within the ITUL project, funded by an ERC Consolidator Grant, we have developed a data compression algorithm based on circular context trees. The proposed algorithm is universal in that it can compress any type of data. The proposed compression algorithm offers unprecedented compression performance, and shows an average of at least 82% improvement over commercial algorithms like Lempel-Ziv (ZIP), Burrows-Wheeler transform compression (BZIP), and more complex state-of-the-art algorithms like prediction by partial matching (PPM) and context tree weighting (CTW). The proposed algorithm has linear decoding complexity. The proposed PoC is intended to extend the current binary implementation to arbitrary alphabets, provide fast encoder/decoder implementation, develop specific applications to compress satellite observation data and genomic data, develop an indexed version of the compression algorithm in order to access some of the data without full decompression, and investigate specific software licensing options and opportunities.

Fields of science (EuroSciVoc)

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC-POC - HORIZON ERC Proof of Concept Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2023-POC

See all projects funded under this call

Host institution

UNIVERSITAT POLITECNICA DE CATALUNYA
Net EU contribution
€ 76 000,00
Address
CALLE JORDI GIRONA 31
08034 BARCELONA
Spain
Region
Este Cataluña Barcelona
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Beneficiaries (2)