Large-Scale Learning with Deep Kernel Machines

Project Information

SOLARIS

Grant agreement ID: 714381

DOI

10.3030/714381

Project closed

EC signature date 28 November 2016

Start date 1 March 2017

End date 28 February 2022

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 498 465,00

EU contribution

€ 1 498 465,00

Coordinated by

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (29)

The spectral bias of polynomial neural networks

Author(s): M. Choraria, L. T. Dadi, G. Chrysos, J. Mairal and V. Cevher
Published in: International Conference on Learning Representations (ICLR), 2022
Publisher: ICLR

Self-Supervised Models are Continual Learners

Author(s): E. Fini, V. G. Turrisi da Costa, X. Alameda-Pineda, E. Ricci, K. Alahari and J. Mairal
Published in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Publisher: IEEE

Fully Trainable and Interpretable Non-local Sparse Models for Image Restoration

Author(s): Bruno Lecouat, Jean Ponce, Julien Mairal
Published in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXII, Issue 12367, 2020, Page(s) 238-254, ISBN 978-3-030-58541-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-58542-6_15

A Generic Acceleration Framework for Stochastic Composite Optimization

Author(s): Kulunchakov, Andrei; Mairal, Julien
Published in: NeurIPS 2019 - Thirty-third Conference Neural Information Processing Systems, Dec 2019, Vancouver, Canada. pp.12556-12567, 2019
Publisher: Neurips

A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restoration

Author(s): Theo Bodrito; Jocelyn Chanussot; Julien Mairal
Published in: Adv. Neural Information Processing Systems (NeurIPS), 2021
Publisher: NeurIPS

Recurrent Kernel Networks

Author(s): Chen, Dexiong; Jacob, Laurent; Mairal, Julien
Published in: NeurIPS 2019 - Neural Information Processing Systems, 2019
Publisher: NeurIPS

Designing and Learning Trainable Priors with Non-Cooperative Games

Author(s): Lecouat, Bruno; Ponce, Jean; Mairal, Julien
Published in: Adv. Neural Information Processing Systems (NeurIPS), 2020
Publisher: NeurIPS

An Optimal Transport Kernel for Feature Aggregation and its Relationship to Attention

Author(s): Mialon, Grégoire; Chen, Dexiong; D'Aspremont, Alexandre; Mairal, Julien
Published in: ICLR 2021 - International Conference on Learning Representations, 2021
Publisher: ICLR

Screening Data Points in Empirical Risk Minimization via Ellipsoidal Regions and Safe Loss Functions

Author(s): Mialon, Grégoire; D'Aspremont, Alexandre; Mairal, Julien
Published in: AISTATS 2020 - 23rd International Conference on Artificial Intelligence and Statistics, 2020
Publisher: PMLR

Lucas-Kanade Reloaded: End-to-End Super-Resolution from Raw Image Bursts

Author(s): Lecouat, Bruno; Ponce, Jean; Mairal, Julien
Published in: International Conference on Computer Vision (ICCV), 2021
Publisher: IEEE
DOI: 10.1109/iccv48922.2021.00237

On the Inductive Bias of Neural Tangent Kernels

Author(s): Bietti, Alberto; Mairal, Julien
Published in: NeurIPS 2019 - Thirty-third Conference on Neural Information Processing Systems, Dec 2019, Vancouver, Canada. pp.12873-12884, 2019
Publisher: Neurips

Catalyst for Gradient-based Nonconvex Optimization

Author(s): Paquette , Courtney; Lin , Hongzhou; Drusvyatskiy , Dmitriy; Mairal , Julien; Harchaoui , Zaid
Published in: AISTATS 2018 - 21st International Conference on Artificial Intelligence and Statistics, Apr 2018, Lanzarote, Spain. pp.1-10, 2018
Publisher: PMLR

Learning Neural Representations of Human Cognition across Many fMRI Studies

Author(s): Mensch, Arthur; Mairal, Julien; Bzdok, Danilo; Thirion, Bertrand; Varoquaux, Gaël
Published in: NIPS 2017 - Advances in Neural Information Processing Systems, 2017
Publisher: NIPS proceedings

Invariance and Stability of Deep Convolutional Representations

Author(s): Bietti , Alberto; Mairal , Julien
Published in: NIPS 2017 - 31st Conference on Advances in Neural Information Processing Systems, 2017
Publisher: NIPS Proceedings

BlitzNet: A Real-Time Deep Network for Scene Understanding

Author(s): Nikita Dvornik, Konstantin Shmelkok, Julien Mairal, Cordelia Schmid
Published in: ICCV 2017 - International Conference on Computer Vision, 2017
Publisher: IEEE

Modeling Visual Context is Key to Augmenting Object Detection Datasets

Author(s): Dvornik , Nikita; Mairal , Julien; Schmid , Cordelia
Published in: ECCV 2018 - European Conference on Computer Vision, 2018
Publisher: Springer

Stochastic Optimization with Variance Reduction for Infinite Datasets with Finite-Sum Structure

Author(s): Bietti , Alberto; Mairal , Julien
Published in: NIPS 2017 - Advances in Neural Information Processing Systems, 2017
Publisher: NIPS proceedings

Unsupervised Learning of Artistic Styles with Archetypal Style Analysis

Author(s): Wynen, Daan; Schmid, Cordelia; Mairal, Julien
Published in: NIPS 2018 - Advances in Neural Information Processing Systems, 2018
Publisher: NIPS proceedings

A Kernel Perspective for Regularizing Deep Neural Networks

Author(s): Bietti, Alberto; Mialon, Grégoire; Chen, Dexiong; Mairal, Julien
Published in: International Conference on Machine Learning (ICML), Issue 97, 2019, ISSN 2640-3498
Publisher: PMLR

Diversity with Cooperation: Ensemble Methods for Few-Shot Classification

Author(s): Dvornik, Nikita; Schmid, Cordelia; Mairal, Julien
Published in: International Conference on Computer Vision (ICCV), 2019
Publisher: IEEE

Estimate Sequences for Variance-Reduced Stochastic Composite Optimization

Author(s): Kulunchakov, Andrei; Mairal, Julien
Published in: International Conference on Machine Learning (ICML), Issue 97, 2019
Publisher: PMLR

Unsupervised Pre-Training of Image Features on Non-Curated Data

Author(s): Caron, Mathilde; Bojanowski, Piotr; Mairal, Julien; Joulin, Armand
Published in: International Conference on Computer Vision (ICCV), 2019
Publisher: IEEE

Unsupervised Learning of Visual Features by Contrasting Cluster Assignments

Author(s): Caron, Mathilde; Misra, Ishan; Mairal, Julien; Goyal, Priya; Bojanowski, Piotr; Joulin, Armand
Published in: NeurIPS 2020 - Neural Information Processing Systems, 2020
Publisher: PMLR

Convolutional Kernel Networks for Graph-Structured Data

Author(s): Chen, Dexiong; Jacob, Laurent; Mairal, Julien
Published in: ICML 2020 - 37th International Conference on Machine Learning, 2020
Publisher: PMLR

Beyond Tikhonov: Faster Learning with Self-Concordant Losses via Iterative Regularization

Author(s): Beugnot, Gaspard; Mairal, Julien; Rudi, Alessandro
Published in: Advances in Neural Information Processing Systems (NeurIPS), 2021
Publisher: NeurIPS

Efficient Kernel UCB for Contextual Bandits

Author(s): H. Zenati, A. Bietti, E. Diemert, J. Mairal, M. Martin and P. Gaillard
Published in: International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Publisher: AISTATS

Selecting Relevant Features from a Multi-domain Representation for Few-Shot Classification

Author(s): Nikita Dvornik, Cordelia Schmid, Julien Mairal
Published in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part X, Issue 12355, 2020, Page(s) 769-786, ISBN 978-3-030-58606-5
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-58607-2_45

Emerging Properties in Self-Supervised Vision Transformers

Author(s): Caron, Mathilde; Touvron, Hugo; Misra, Ishan; Jegou, Hervé; Mairal, Julien; Bojanowski, Piotr; Joulin, Armand
Published in: International Conference on Computer Vision (ICCV), 2021
Publisher: IEEE
DOI: 10.1109/iccv48922.2021.00951

Amortized Implicit Differentiation for Stochastic Bilevel Optimization

Author(s): M. Arbel and J. Mairal
Published in: International Conference on Learning Representations (ICLR), 2022
Publisher: ICLR

Peer reviewed articles (9)

Estimate Sequences for Stochastic Composite Optimization: Variance Reduction, Acceleration, and Robustness to Noise

Author(s): Kulunchakov, Andrei; Mairal, Julien
Published in: Journal of Machine Learning Research (JMLR), Issue 21, 2020, ISSN 1532-4435
Publisher: MIT Press

Extracting representations of cognition across neuroimaging studies improves brain decoding

Author(s): Arthur Mensch, Julien Mairal, Bertrand Thirion, Gaël Varoquaux
Published in: PLOS Computational Biology, Issue 17/5, 2021, Page(s) e1008795, ISSN 1553-734X
Publisher: Public Library of Science
DOI: 10.1371/journal.pcbi.1008795

Stochastic Subsampling for Factorizing Huge Matrices

Author(s): Arthur Mensch, Julien Mairal, Bertrand Thirion, Gael Varoquaux
Published in: IEEE Transactions on Signal Processing, Issue 66/1, 2018, Page(s) 113-128, ISSN 1053-587X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TSP.2017.2752697

Loter: A Software Package to Infer Local Ancestry for a Wide Range of Species

Author(s): Thomas Dias-Alves, Julien Mairal, Michael G B Blum
Published in: Molecular Biology and Evolution, Issue 35/9, 2018, Page(s) 2318-2326, ISSN 0737-4038
Publisher: Oxford University Press
DOI: 10.1093/molbev/msy126

Catalyst Acceleration for First-order Convex Optimization: from Theory to Practice

Author(s): Lin , Hongzhou; Mairal , Julien; Harchaoui , Zaid
Published in: Journal of Machine Learning Research, Issue 18, 2018, ISSN 1532-4435
Publisher: MIT Press

Group Invariance, Stability to Deformations, and Complexity of Deep Convolutional Representations

Author(s): Bietti, Alberto; Mairal, Julien
Published in: Journal of Machine Learning Research, Issue 20, 2019, ISSN 1532-4435
Publisher: MIT Press

An Inexact Variable Metric Proximal Point Algorithm for Generic Quasi-Newton Acceleration

Author(s): Hongzhou Lin, Julien Mairal, Zaid Harchaoui
Published in: SIAM Journal on Optimization, Issue 29/2, 2019, Page(s) 1408-1443, ISSN 1052-6234
Publisher: Society for Industrial and Applied Mathematics
DOI: 10.1137/17M1125157

Biological sequence modeling with convolutional kernel networks

Author(s): Dexiong Chen, Laurent Jacob, Julien Mairal
Published in: Bioinformatics, 2019, ISSN 1367-4803
Publisher: Oxford University Press
DOI: 10.1093/bioinformatics/btz094

On the Importance of Visual Context for Data Augmentation in Scene Understanding

Author(s): Nikita Dvornik, Julien Mairal, Cordelia Schmid
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 43/6, 2021, Page(s) 2014-2028, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2019.2961896