Information Theory beyond Communications: Distributed Representations and Deep Learning

Project Information

STRUDEL

Grant agreement ID: 797805

DOI

10.3030/797805

Project closed

EC signature date 5 April 2018

Start date 1 September 2018

End date 31 August 2020

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 171 349,20

EU contribution

€ 171 349,20

Coordinated by

CENTRALESUPELEC
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (13)

Detecting Covariate Shift with Black Box Predictors

Author(s): Florence Alberge, Clement Feutry, Pierre Duhamel, Pablo Piantanida
Published in: 2019 26th International Conference on Telecommunications (ICT), 2019, Page(s) 324-329, ISBN 978-1-7281-0273-3
Publisher: IEEE
DOI: 10.1109/ict.2019.8798827

Deep Directed Information-Based Learning for Privacy-Preserving Smart Meter Data Release

Author(s): Mohammadhadi Shateri, Francisco Messina, Pablo Piantanida, Fabrice Labeau
Published in: 2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), 2019, Page(s) 1-7, ISBN 978-1-5386-8099-5
Publisher: IEEE
DOI: 10.1109/smartgridcomm.2019.8909813

Privacy-Preserving Synthetic Smart Meters Data

Author(s): Ganesh Del Grosso, Georg Pichler, Pablo Piantanida
Published in: 2021 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), 2021, Page(s) 1-5, ISBN 978-1-7281-8897-3
Publisher: IEEE
DOI: 10.1109/isgt49243.2021.9372157

Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?

Author(s): Malik Boudiaf, Hoel Kervadec, Ziko Imtiaz Masud, Pablo Piantanida, Ismail Ben Ayed, Jose Dolz
Published in: IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Page(s) 13979-13988, ISBN 978-1-6654-4509-2
Publisher: IEEE
DOI: 10.1109/cvpr46437.2021.01376

A Differential Entropy Estimator for Training Neural Networks

Author(s): Georg Pichler, Pierre Jean A. Colombo, Malik Boudiaf, Günther Koliander, Pablo Piantanida
Published in: International Conference on Machine Learning, Issue 162, 2022, Page(s) 17691-17715
Publisher: PMLR

DOCTOR: A Simple Method for Detecting Misclassification Errors

Author(s): Federica Granese, Marco Romanelli, Daniele Gorla, Catuscia Palamidessi, Pablo Piantanida
Published in: Advances in Neural Information Processing Systems, Issue 34, 2021, Page(s) 5669-5681, ISSN 1049-5258
Publisher: Curran Associates, Inc.
DOI: 10.48550/arxiv.2106.02395

A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representations

Author(s): Pierre Colombo, Pablo Piantanida, Chloé Clavel
Published in: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021, Page(s) 6539–6550
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.acl-long.511

Transductive Information Maximization For Few-Shot Learning

Author(s): Malik Boudiaf, Ziko Imtiaz Masud, Jérôme Rony, Jose Dolz, Pablo Piantanida,Ismail Ben Ayed
Published in: Conference on Neural Information Processing Systems, Issue 33, 2020, ISBN 9781713829546
Publisher: Curran Associates, Inc.

Privacy-Cost Management in Smart Meters Using Deep Reinforcement Learning

Author(s): Mohammadhadi Shateri, Francisco Messina, Pablo Piantanida, Fabrice Labeau
Published in: 2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe), 2020, Page(s) 929-933, ISBN 978-1-7281-7100-5
Publisher: IEEE
DOI: 10.1109/isgt-europe47291.2020.9248831

Estimating g-leakage via machine learning

Author(s): K. Chatzikokolakis, C. Palamidessi, P. Piantanida, and M. Romanelli
Published in: ACM Conference on Computer and Communications Security (CCS), 2020
Publisher: ACM
DOI: 10.1145/3372297.3423363

On the Impact of Side Information on Smart Meter Privacy-Preserving Methods

Author(s): Mohammadhadi Shateri, Francisco Messina, Pablo Piantanida, Fabrice Labeau
Published in: 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), 2020, Page(s) 1-6, ISBN 978-1-7281-6127-3
Publisher: IEEE
DOI: 10.1109/smartgridcomm47815.2020.9302948

Learning Semi-Supervised Anonymized Representations by Mutual Information

Author(s): C. Feutry, P. Piantanida, P. Duhamel
Published in: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, Page(s) 3467-3471, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9053379

On Direct Distribution Matching for Adapting Segmentation Networks SAVE

Author(s): Pichler, Georg; Dolz, Jose; Ayed, Ismail Ben; Piantanida, Pablo
Published in: MIDL 2020 - Medical Imaging with Deep Learning Publications Manually add publicatio, Issue 3, 2020
Publisher: PMLR
DOI: 10.48550/arXiv.1904.02657

Other (2)

Learning anonymized representations with adversarial neural networks

Author(s): C. Feutry, P. Piantanida, Y. Bengio, and P. Duhamel
Published in: Technical report, 2018
Publisher: Online technical report

On the Estimation of Information Measures of Continuous Distributions

Author(s): Georg Pichler, Pablo Piantanida, Günther Koliander
Published in: Technical report, 2020
Publisher: Technical Report

Peer reviewed articles (10)

On Universal D-Semifaithful Coding for Memoryless Sources With Infinite Alphabets

Author(s): Jorge F. Silva, Pablo Piantanida
Published in: IEEE Transactions on Information Theory, Issue Volume: 68, Issue: 4, 2022, Page(s) 1557-9654, ISSN 0018-9448
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tit.2021.3134891

Finite-Length Bounds on Hypothesis Testing Subject to Vanishing Type I Error Restrictions

Author(s): Sebastian Espinosa, Jorge F. Silva, Pablo Piantanida
Published in: IEEE Signal Processing Letters, Issue 28, 2021, Page(s) 229-233, ISSN 1070-9908
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lsp.2021.3050381

Collaborative Information Bottleneck

Author(s): Matias Vera, Leonardo Rey Vega, Pablo Piantanida
Published in: IEEE Transactions on Information Theory, Issue 65/2, 2019, Page(s) 787-815, ISSN 0018-9448
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tit.2018.2883295

The Role of Mutual Information in Variational Classifiers

Author(s): Matias Vera, Leonardo Rey Vega, Pablo Piantanida
Published in: Under revision for publication in Machine Learning, 2023, ISSN 1532-4435
Publisher: MIT Press
DOI: 10.1007/s10994-023-06337-6

Distributed information-theoretic clustering

Author(s): Georg Pichler, Pablo Piantanida, Gerald Matz
Published in: Information and Inference: A Journal of the IMA, 2021, ISSN 2049-8772
Publisher: Oxford University Press
DOI: 10.1093/imaiai/iaab007

Fundamental Limits of Decentralized Data Shuffling

Author(s): Kai Wan, Daniela Tuninetti, Mingyue Ji, Giuseppe Caire, Pablo Piantanida
Published in: IEEE Transactions on Information Theory, Issue 66/6, 2020, Page(s) 3616-3637, ISSN 0018-9448
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tit.2020.2966197

On the Exponential Approximation of Type II Error Probability of Distributed Test of Independence

Author(s): Espinosa, Sebastian; Silva, Jorge F.; Piantanida, Pablo
Published in: IEEE Transactions on Signal and Information Processing over Networks, 2021, Page(s) 777 - 790, ISSN 2373-776X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tsipn.2021.3133192

Adversarial Robustness Via Fisher-Rao Regularization

Author(s): Marine Picot, Francisco Messina, Malik Boudiaf, Fabrice Labeau, Ismail Ben Ayed, Pablo Piantanida
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue vol. 45, no. 3, 2023, Page(s) 2698-2710, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2022.3174724

Privacy-Cost Management in Smart Meters with Mutual Information-Based Reinforcement Learning

Author(s): M. Shateri, F. Messina, P. Piantanida, and F. Labeau
Published in: IEEE Internet of Things Journal, 2021, Page(s) 1 - 1, ISSN 2327-4662
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/jiot.2021.3128488

Real-Time Privacy-Preserving Data Release for Smart Meters

Author(s): Mohammadhadi Shateri, Francisco Messina, Pablo Piantanida, Fabrice Labeau
Published in: IEEE Transactions on Smart Grid, 2020, Page(s) 1-1, ISSN 1949-3053
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tsg.2020.3005634

Book chapters (2)

Information Bottleneck and Representation Learning

Author(s): Pablo Piantanida, Leonardo Rey Vega
Published in: Information-Theoretic Methods in Data Science, 2021, Page(s) 330-358, ISBN 9781108616799
Publisher: Cambridge University Press
DOI: 10.1017/9781108616799.012

A Unifying Mutual Information View of Metric Learning: Cross-Entropy vs. Pairwise Losses

Author(s): Malik Boudiaf, Jérôme Rony, Imtiaz Masud Ziko, Eric Granger, Marco Pedersoli, Pablo Piantanida, Ismail Ben Ayed
Published in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VI, Issue 12351, 2020, Page(s) 548-564, ISBN 978-3-030-58538-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-58539-6_33