Statistical Mechanics of Learning

Publicaciones

The planted XY model: thermodynamics and inference

Autores: Siyu Chen; Guanhao Huang; Giovanni Piccioli; Lenka Zdeborová
Publicado en: Phys. Rev. E, Edición 106, 2022, Página(s) 054115, ISSN 2470-0045
Editor: American Physical Society
DOI: 10.48550/arxiv.2208.06488

Probing transfer learning with a model of synthetic correlated datasets

Autores: Federica Gerace; Luca Saglietti; Stefano Sarao Mannelli; Andrew Saxe; Lenka Zdeborová
Publicado en: Mach. Learn.: Sci. Technol., Edición 5, 2022, Página(s) 015030, ISSN 2632-2153
Editor: IOP publishing
DOI: 10.1088/2632-2153/ac4f3f

Perturbative construction of mean-field equations in extensive-rank matrix factorization and denoising

Autores: Antoine Maillard; Florent Krzakala; Marc Mézard; and Lenka Zdeborová;
Publicado en: J. Stat. Mech., Edición 2022, 2022, Página(s) 083301, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ac7e4c

Bayesian reconstruction of memories stored in neural networks from their connectivity

Autores: Sebastian Goldt; Florent Krzakala; Lenka Zdeborová; Nicolas Brunel
Publicado en: PLoS Comput Biol, Edición 19, 2023, Página(s) 1, ISSN 1553-734X
Editor: Public Library of Science
DOI: 10.48550/arxiv.2105.07416

Learning curves of generic features maps for realistic datasets with a teacher-student model

Autores: Loureiro, Bruno; Gerbelot, Cédric; Cui, Hugo; Goldt, Sebastian; Krzakala, Florent; Mézard, Marc; Zdeborová, Lenka
Publicado en: J. Stat. Mech., Edición 114001, 2022, Página(s) 114001, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ac9825

Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification*

Autores: Mignacco, Francesca; Krzakala, Florent; Urbani, Pierfrancesco; Zdeborová, Lenka
Publicado en: Journal of Statistical Mechanics: Theory and Experiment,, 2021, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ac3a80

Modeling the Influence of Data Structure on Learning in Neural Networks: The Hidden Manifold Model

Autores: Sebastian Goldt; Marc Mézard; Florent Krzakala; Lenka Zdeborová
Publicado en: PHYSICAL REVIEW X, Edición 10, 041044, 2020, ISSN 2160-3308
Editor: American Physical Society
DOI: 10.1103/physrevx.10.041044

Large Deviations of Semi-supervised Learning in the Stochastic Block Model

Autores: Cui, Hugo; Saglietti, Luca; Zdeborová, Lenka
Publicado en: Phys. Rev. E, Edición 105, 034108, 2022, ISSN 2470-0045
Editor: American Physical Society
DOI: 10.1103/physreve.105.034108

Large deviations for the perceptron model and consequences for active learning

Autores: Cui, Hugo; Saglietti, Luca; Zdeborová, Lenka
Publicado en: Machine Learning: Science and Technology, Edición Volume 2, Number 4, 2021, ISSN 2632-2153
Editor: IOP Publishing Ltd
DOI: 10.1088/2632-2153/abfbbb

Generalisation error in learning with random features and the hidden manifold model*

Autores: Gerace, Federica; Loureiro, Bruno; Krzakala, Florent; Mezard, Marc; Zdeborová, Lenka
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, 2021, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ac3ae6

Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup.

Autores: Sebastian Goldt; Madhu Advani; Andrew M. Saxe; Florent Krzakala; Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, 2020, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/abc61e

Glassy Nature of the Hard Phase in Inference Problems

Autores: Fabrizio Antenucci, Silvio Franz, Pierfrancesco Urbani, Lenka Zdeborová
Publicado en: Physical Review X, Edición 9/1, 2019, ISSN 2160-3308
Editor: American Physical Society
DOI: 10.1103/PhysRevX.9.011020

Optimal errors and phase transitions in high-dimensional generalized linear models

Autores: Jean Barbier, Florent Krzakala, Nicolas Macris, Léo Miolane, Lenka Zdeborová
Publicado en: Proceedings of the National Academy of Sciences, Edición 116/12, 2019, Página(s) 5451-5460, ISSN 0027-8424
Editor: National Academy of Sciences
DOI: 10.1073/pnas.1802705116

Typology of phase transitions in Bayesian inference problems

Autores: Federico Ricci-Tersenghi, Guilhem Semerjian, Lenka Zdeborová
Publicado en: Physical Review E, Edición 99/4, 2019, ISSN 2470-0045
Editor: American Physical Society
DOI: 10.1103/PhysRevE.99.042109

Approximate survey propagation for statistical inference

Autores: Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, Edición 2019/2, 2019, Página(s) 023401, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/aafa7d

Information-theoretic thresholds from the cavity method

Autores: Amin Coja-Oghlan, Florent Krzakala, Will Perkins, Lenka Zdeborová
Publicado en: Advances in Mathematics, Edición 333, 2018, Página(s) 694-795, ISSN 0001-8708
Editor: Academic Press
DOI: 10.1016/j.aim.2018.05.029

Minimal sets to destroy the k -core in random networks

Autores: Christian Schmidt, Henry D. Pfister, Lenka Zdeborová
Publicado en: Physical Review E, Edición 99/2, 2019, ISSN 2470-0045
Editor: American Physical Society
DOI: 10.1103/PhysRevE.99.022310

Storage capacity in symmetric binary perceptrons

Autores: Benjamin Aubin, Will Perkins, Lenka Zdeborová
Publicado en: Journal of Physics A: Mathematical and Theoretical, Edición 52/29, 2019, Página(s) 294003, ISSN 1751-8113
Editor: Institute of Physics Publishing
DOI: 10.1088/1751-8121/ab227a

Machine learning and the physical sciences

Autores: Giuseppe Carleo, Ignacio Cirac, Kyle Cranmer, Laurent Daudet, Maria Schuld, Naftali Tishby, Leslie Vogt-Maranto, Lenka Zdeborová
Publicado en: Reviews of Modern Physics, Edición 91/4, 2019, ISSN 0034-6861
Editor: American Physical Society
DOI: 10.1103/RevModPhys.91.045002

On the universality of noiseless linear estimation with respect to the measurement matrix

Autores: Alia Abbara, Antoine Baker, Florent Krzakala, Lenka Zdeborová
Publicado en: Journal of Physics A: Mathematical and Theoretical, Edición 53/16, 2020, Página(s) 164001, ISSN 1751-8113
Editor: Institute of Physics Publishing
DOI: 10.1088/1751-8121/ab59ef

Entropy and mutual information in models of deep neural networks

Autores: Marylou Gabrié, Andre Manoel, Clément Luneau, Jean Barbier, Nicolas Macris, Florent Krzakala, Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, Edición 2019/12, 2019, Página(s) 124014, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ab3430

The committee machine: computational to statistical gaps in learning a two-layers neural network

Autores: Benjamin Aubin, Antoine Maillard, Jean Barbier, Florent Krzakala, Nicolas Macris, Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, Edición 2019/12, 2019, Página(s) 124023, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ab43d2

Marvels and Pitfalls of the Langevin Algorithm in Noisy High-Dimensional Inference

Autores: Stefano Sarao Mannelli, Giulio Biroli, Chiara Cammarota, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová
Publicado en: Physical Review X, Edición 10/1, 2020, ISSN 2160-3308
Editor: American Physical Society
DOI: 10.1103/physrevx.10.011057

Dense limit of the Dawid–Skene model for crowdsourcing and regions of sub-optimality of message passing algorithms

Autores: Christian Schmidt, Lenka Zdeborová
Publicado en: Journal of Physics A: Mathematical and Theoretical, Edición 53/12, 2020, Página(s) 124001, ISSN 1751-8113
Editor: Institute of Physics Publishing
DOI: 10.1088/1751-8121/ab757f

Thresholds of descending algorithms in inference problems

Autores: Stefano Sarao Mannelli, Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, Edición 2020/3, 2020, Página(s) 034004, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ab7123

Blind calibration for compressed sensing: State evolution and an online algorithm

Autores: Marylou Gabrié, Jean Barbier, Florent Krzakala, Lenka Zdeborova
Publicado en: Journal of Physics A: Mathematical and Theoretical, 2020, ISSN 1751-8113
Editor: Institute of Physics Publishing
DOI: 10.1088/1751-8121/ab8416

High-temperature expansions and message passing algorithms

Autores: Antoine Maillard, Laura Foini, Alejandro Lage Castellanos, Florent Krzakala, Marc Mézard, Lenka Zdeborová
Publicado en: Journal of Statistical Mechanics: Theory and Experiment, Edición 2019/11, 2019, Página(s) 113301, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ab4bbb

Learning curves for the multi-class teacher-student perceptron

Autores: Elisabetta Cornacchia; Francesca Mignacco; Rodrigo Veiga; Cedric Gerbelot; Bruno Loureiro; Lenka Zdeborova
Publicado en: Mach. Learn.: Sci. Technol., Edición 4, 2023, Página(s) 015019, ISSN 2632-2153
Editor: Institute of Physics
DOI: 10.48550/arxiv.2203.12094

Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem

Autores: Francesca Mignacco; Pierfrancesco Urbani; Lenka Zdeborová
Publicado en: Machine Learning: Science and Technology, Edición 2 (3), 2021, Página(s) 035029, ISSN 2632-2153
Editor: IOP Publishing
DOI: 10.1088/2632-2153/ac0615

(Dis)assortative partitions on random regular graphs

Autores: Behrens, Freya; Arpino, Gabriel; Kivva, Yaroslav; Zdeborová, Lenka
Publicado en: J. Phys. A: Math. Theor., Edición 55, 2022, Página(s) 395004, ISSN 1751-8113
Editor: Institute of Physics Publishing
DOI: 10.1088/1751-8121/ac8b46

An analytical theory of curriculum learning in teacher–student networks*

Autores: Luca Saglietti; Stefano Sarao Mannelli; Andrew Saxe
Publicado en: J. Stat. Mech., Edición 2022, 2022, Página(s) 114014, ISSN 1742-5468
Editor: Institute of Physics
DOI: 10.1088/1742-5468/ac9b3c

The Spiked Matrix Model With Generative Priors

Autores: Benjamin Aubin; Bruno Loureiro; Antoine Maillard; Florent Krzakala; Lenka Zdeborová
Publicado en: IEEE Transactions on Information Theory, Edición Volume: 67, Edición: 2, 2021, ISSN 0018-9448
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tit.2020.3033985

Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization

Autores: Aubin, Benjamin; Krzakala, Florent; Lu, Yue M.; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Editor: NeurIPS Proceedings

Multi-layer State Evolution Under Random Convolutional Design

Autores: Max Daniels, Cedric Gerbelot, Florent Krzakala, Lenka Zdeborová
Publicado en: Advances in Neural Information Processing Systems (NeurIPS 2022), Edición 35, 2022
Editor: NuerIPS
DOI: 10.48550/arxiv.2205.13503

Learning Gaussian Mixtures with Generalized Linear Models: Precise Asymptotics in High-dimensions

Autores: Bruno Loureiro, Gabriele Sicuro, Cedric Gerbelot, Alessandro Pacco, Florent Krzakala, Lenka Zdeborová
Publicado en: Advances in Neural Information Processing Systems 34 (NeurIPS 2021), 2021
Editor: NeurIPS Proceedings

The role of regularization in classification of high-dimensional noisy Gaussian mixture

Autores: Mignacco, Francesca; Krzakala, Florent; Lu, Yue,; Zdeborová, Lenka
Publicado en: Proceedings of the 37th International Conference on Machine Learning, Edición PMLR 119:6874-6883, 2020
Editor: Cambridge MA: JMLR

Rademacher complexity and spin glasses: A link between the replica and statistical theories of learning

Autores: Abbara, Alia; Aubin, Benjamin; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Proceedings of The First Mathematical and Scientific Machine Learning Conference,, Edición PMLR 107, 2020, Página(s) 27-54, ISSN 2640-3498
Editor: Cambridge MA: JMLR

Solvable Model for Inheriting the Regularization through Knowledge Distillation

Autores: Saglietti, Luca; Zdeborová, Lenka
Publicado en: Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, Edición 145, 2022, Página(s) 809-846
Editor: PMLR
DOI: 10.48550/arxiv.2012.00194

Exact asymptotics for phase retrieval and compressed sensing with random generative priors

Autores: Aubin, Benjamin; Loureiro, Bruno; Baker, Antoine; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Proceedings of The First Mathematical and Scientific Machine Learning Conference,, Edición PMLR 107, 2020, Página(s) 55-73
Editor: Cambridge MA: JMLR

The Gaussian equivalence of generative models for learning with two-layer neural networks

Autores: Goldt, Sebastian; Loureiro, Bruno; Reeves, Galen; Krzakala, Florent; Mezard, Marc; Zdeborová, Lenka
Publicado en: Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, Edición 145, 2022, Página(s) 426-471
Editor: PMLR
DOI: 10.48550/arxiv.2006.14709

Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed

Autores: Refinetti, Maria; Goldt, Sebastian; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Proceedings of the 38th International Conference on Machine Learning, Edición PMLR 139:8936-8947, 2021
Editor: Cambridge MA: JMLR

Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime

Autores: Cui, Hugo; Loureiro, Bruno; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 34 (NeurIPS 2021), 2021
Editor: NeurIPS Proceedings

Streaming Bayesian inference: Theoretical limits and mini-batch approximate message-passing

Autores: Andre Manoel, Florent Krzakala, Eric W. Tramel, Lenka Zdeborova
Publicado en: 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 2017, Página(s) 1048-1055, ISBN 978-1-5386-3266-6
Editor: IEEE
DOI: 10.1109/allerton.2017.8262853

Who is Afraid of Big Bad Minima? Analysis of Gradient-Flow in a Spiked Matrix-Tensor Model

Autores: Mannelli, Stefano Sarao; Biroli, Giulio; Cammarota, Chiara; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 32, 2019
Editor: Curran Associates, Inc.

Passed & Spurious: Descent Algorithms and Local Minima in Spiked Matrix-Tensor Models

Autores: Mannelli, Stefano Sarao; Krzakala, Florent; Urbani, Pierfrancesco; Zdeborová, Lenka
Publicado en: Proceedings of Machine Learning Research, 2019
Editor: PMLR

Generalisation dynamics of online learning in over-parameterised neural networks

Autores: Goldt, Sebastian; Advani, Madhu S.; Saxe, Andrew M.; Krzakala, Florent; Zdeborová, Lenka
Publicado en: https://hal-cea.archives-ouvertes.fr/cea-02009764, Edición 1, 2019
Editor: N/A

The spiked matrix model with generative priors

Autores: Benjamin Aubin, Bruno Loureiro, Antoine Maillard, Florent Krzakala, Lenka Zdeborová
Publicado en: Advances in Neural Information Processing Systems 32, 2019
Editor: Curran Associates, Inc.

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Autores: Stefano, Sarao Mannelli; Biroli, Giulio; Cammarota, Chiara; Krzakala, Florent; Urbani, Pierfrancesco; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Editor: NeurIPS Proceedings

Construction of optimal spectral methods in phase retrieval

Autores: Maillard, Antoine; Krzakala, Florent; Yue, lu; Zdeborová, Lenka
Publicado en: Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, Edición 145, 2022, Página(s) 693-72
Editor: PMLR
DOI: 10.48550/arxiv.2012.04524

Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gap

Autores: Luca Pesce, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová
Publicado en: Advances in Neural Information Processing Systems (NeurIPS 2022), Edición 35, 2022
Editor: NeurIPS
DOI: 10.48550/arxiv.2205.13527

Phase retrieval in high dimensions: Statistical and computational phase transitions

Autores: Maillard, Antoine; Loureiro, Bruno; Krzakala, Florent; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Editor: NeurIPS Proceedings

Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions

Autores: Sarao Manelli, Stefano; Vanden-Eijnden, Eric; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Editor: NeurIPS Proceedings

Learning curves of generic features maps for realistic datasets with a teacher-student model

Autores: Loureiro, Bruno; Gerbelot, Cédric; Cui, Hugo; Goldt, Sebastian; Krzakala, Florent; Mézard, Marc; Zdeborová, Lenka
Publicado en: Advances in Neural Information Processing Systems 34 (NeurIPS 2021), 2021
Editor: NeurIPS Proceedings

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Autores: Rodrigo Veiga, Ludovic Stephan, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová
Publicado en: Advances in Neural Information Processing Systems (NeurIPS 2022), Edición 35, 2022
Editor: NeurIPS
DOI: 10.48550/arxiv.2202.00293

Optimal denoising of rotationally invariant rectangular matrices

Autores: Emanuele Troiani, Vittorio Erba, Florent Krzakala, Antoine Maillard, Lenka Zdeborova
Publicado en: Proceedings of Mathematical and Scientific Machine Learning, Edición 190, 2022, Página(s) 97-112
Editor: PMLR
DOI: 10.48550/arxiv.2203.07752

Buscando datos de OpenAIRE...

Publicaciones

Compartir esta página

Descargar