DeepLearning 2.0: Meta-Learning Qualitatively New Components

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition

Auteurs: Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P.; White, Colin; Hutter, Frank; Goldblum, Micah
Publié dans: Advances in Neural Information Processing Systems, Numéro 36, 2023, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2210.09943

Multi-objective Tree-structured Parzen Estimator Meets Meta-learning

Auteurs: Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank
Publié dans: Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022
Éditeur: openreview.net

PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces

Auteurs: Watanabe, Shuhei; Bansal, Archit; Hutter, Frank
Publié dans: International Joint Conference on Artificial Intelligence, Numéro 32, 2023, ISSN 1045-0823
Éditeur: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/488

Weight-Entanglement Meets Gradient-Based Neural Architecture Search

Auteurs: Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Safari, Mahmoud; Hutter, Frank
Publié dans: International Conference on Automated Machine Learning, Numéro 4, 2024
Éditeur: openreview.net
DOI: 10.48550/arxiv.2312.10440

Quick-Tune-Tool: A Practical Tool and its User Guide for Automatically Finetuning Pretrained Models

Auteurs: Rapant, Ivo; Purucker, Lennart; Ferreira, Fabio; Arango, Sebastian Pineda; Kadra, Arlind; Grabocka, Josif; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

LMEMs for post-hoc analysis of HPO Benchmarking

Auteurs: Geburek, Anton Merlin; Mallik, Neeratyoy; Stoll, Danny; Bouthillier, Xavier; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

Warmstarting for Scaling Language Models

Auteurs: Mallik, Neeratyoy; Janowski, Maciej; Hog, Johannes; Rakotoarison, Herilalaina; Klein, Aaron; Grabocka, Josif; Hutter, Frank
Publié dans: Workshop on Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning at NeurIPS 2024, 2024
Éditeur: openreview.net

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models

Auteurs: Bhethanabhotla, Sathya Kamesh; Swelam, Omar; Siems, Julien; Salinas, David; Hutter, Frank
Publié dans: Workshop on Time Series in the Age of Large Models at NeurIPS 2024, 2024
Éditeur: openreview.net

Preserving Principal Subspaces to Reduce Catastrophic Forgetting in Fine-tuning

Auteurs: Franke, Jorg K.H.; Hefenbrock, Michael; Hutter, Frank
Publié dans: Workshop on Mathematical and Empirical Understanding of Foundation Models at ICLR 2024, 2024
Éditeur: openreview.net

Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Design

Auteurs: Franke, Jörg K. H.; Runge, Frederic; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 35, 2022, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2205.13927

From Epoch to Sample Size: Developing New Data-driven Priors for Learning Curve Prior-Fitted Networks

Auteurs: Viering, Tom Julian; Adriaensen, Steven; Rakotoarison, Herilalaina; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

Joint Entropy Search For Maximally-Informed Bayesian Optimization

Auteurs: Hvarfner, Carl; Hutter, Frank; Nardi, Luigi
Publié dans: Advances in Neural Information Processing Systems, Numéro 35, 2022, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arXiv.2206.04771

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator

Auteurs: Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank
Publié dans: International Joint Conference on Artificial Intelligence, Numéro 32, 2023, ISSN 1045-0823
Éditeur: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/487

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks

Auteurs: Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank
Publié dans: Advances in neural information processing systems, Numéro 36, 2023, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2310.20447

LoRA-DARTS: Low Rank Adaptation for Differentiable Architecture Search

Auteurs: Krishnakumar, Arjun; Jha, Abhash Kumar; Moradian, Shakiba; Rapp, Martin; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning

Auteurs: Shala, Gresa; Arango, Sebastian Pineda; Biedenkapp, Andre; Hutter, Frank; Grabocka, Josif
Publié dans: International Conference on Automated Machine learning (ABCD Track), Numéro 4, 2024
Éditeur: openreview.net

GraViT-E: Gradient-based Vision Transformer Search with Entangled Weights

Auteurs: Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Patil, Sharat; Hutter, Frank
Publié dans: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022
Éditeur: openreview.net

Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks

Auteurs: Watanabe, Shuhei; Mallik, Neeratyoy; Bergman, Edward; Hutter, Frank
Publié dans: International Conference on Automated Machine Learning, Numéro 4, 2024
Éditeur: openreview.net
DOI: 10.48550/arXiv.2403.01888

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars

Auteurs: Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea; Brox, Thomas; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 36, 2023, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2211.01842

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models

Auteurs: Sukthanker, Rhea Sanjay; Zela, Arber; Staffler, Benedikt; Klein, Aaron; Purucker, Lennart; Franke, Jorg K.H.; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 38, 2024
Éditeur: openreview.net

Towards Quantifying the Effect of Datasets for Benchmarking: A Look at Tabular Machine Learning

Auteurs: Kohli, Ravin; Feurer, Matthias; Eggensperger, Katharina; Bischl, Bernd; Hutter, Frank
Publié dans: Data-centric Machine Learning Research (DMLR) Workshop at ICLR (2024), 2024
Éditeur: openreview.net

Gray-Box Gaussian Processes for Automated Reinforcement Learning

Auteurs: Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif
Publié dans: International Conference on Learning Representations, Numéro 11, 2023
Éditeur: openreview.net

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization

Auteurs: Watanabe, Shuhei; Hutter, Frank
Publié dans: International Joint Conference on Artificial Intelligence, Numéro 32, 2023, ISSN 1045-0823
Éditeur: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/486

Ensembling Finetuned Language Models for Text Classification

Auteurs: Arango, Sebastian Pineda; Janowski, Maciej; Purucker, Lennart; Zela, Arber; Hutter, Frank; Grabocka, Josif
Publié dans: Workshop on Fine-Tuning in Modern Machine Learning: Principles and Scalability at NeurIPS 2024, 2024
Éditeur: openreview.net

Towards Generative RNA Design with Tertiary Interactions

Auteurs: Sharat Patil and Runge, Frederic; Franke, Jorg K.H.; Hutter, Frank
Publié dans: Workshop on Generative and Experimental Perspectives for Biomolecular Design at ICLR 2024, 2024
Éditeur: openreview.net

NOSBench-101: Towards Reproducible Neural Optimizer Search

Auteurs: Karakasli, Goktug; Adriaensen, Steven; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second

Auteurs: Hollmann, Noah; Muller, Samuel; Eggensperger, Katharina; Hutter, Frank
Publié dans: International Conference on Learning Representations, Numéro 11, 2023
Éditeur: openreview.net
DOI: 10.48550/arXiv.2207.01848

Beyond Graph-Based Modeling for Hierarchical Neural Architecture Search

Auteurs: Birinxhiku, Lum; Stoll, Danny; Schrodi, Simon; Hutter, Frank
Publié dans: International Conference on Automated Machine learning (Workshop Track), 2024
Éditeur: openreview.net

Is Mamba Capable of In-Context Learning?

Auteurs: Grazzi, Riccardo; Siems, Julien Niklas; Schrodi, Simon; Brox, Thomas; Hutter, Frank
Publié dans: Workshop on Mathematical and Empirical Understanding of Foundation Models at ICLR 2024, 2024
Éditeur: openreview.net

DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning

Auteurs: Sass, René; Bergman, Eddie; Biedenkapp, André; Hutter, Frank; Lindauer, Marius
Publié dans: Workshop on Adaptive Experimental Design and Active Learning in the Real World at ICML 20222, 2022
Éditeur: PMLR
DOI: 10.48550/arxiv.2206.03493

Self-Correcting Bayesian Optimization through Bayesian Active Learning

Auteurs: Hvarfner, Carl; Hellsten, Erik; Hutter, Frank; Nardi, Luigi
Publié dans: Advances in neural information processing systems, Numéro 36, 2023, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arXiv.2304.11005

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning

Auteurs: Mallik, Neeratyoy; Bergman, Edward; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Lindauer, Marius; Nardi, Luigi; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 36, 2023, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2306.12370

Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data

Auteurs: Helli, Kai; Schnurr, David; Hollmann, Noah; Müller, Samuel; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 38, 2024
Éditeur: openreview.net

On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning

Auteurs: Wagner, Diane; Ferreira, Fabio; Stoll, Danny; Schirrmeister, Robin Tibor; Müller, Samuel; Hutter, Frank
Publié dans: First Workshop of Pre-training: Perspectives, Pitfalls, and Paths at ICML 2022, 2022
Éditeur: PMLR
DOI: 10.48550/arxiv.2207.07875

Improving Deep Learning Optimization through Constrained Parameter Regularization

Auteurs: Franke, Jörg; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank
Publié dans: Advances in Neural Information Processing Systems, Numéro 38, 2024
Éditeur: openreview.net

Large Language Model Compression with Neural Architecture Search

Auteurs: Sukthanker, Rhea Sanjay; Staffler, Benedikt; Hutter, Frank; Klein, Aaron
Publié dans: Workshop on Machine Learning and Compression at NeurIPS 2024, 2024
Éditeur: openreview.net

RNA-Protein Interaction Classification via Sequence Embeddings

Auteurs: Matus, Dominika; Runge, Frederic; Franke, Jorg K.H.; Gerne, Lars; Uhl, Michael; Hutter, Frank; Backofen, Rolf
Publié dans: Workshop on Generative and Experimental Perspectives for Biomolecular Design at ICLR 2024, 2024
Éditeur: openreview.net

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How

Auteurs: Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif
Publié dans: International Conference on Learning Representations, Numéro 11, 2024
Éditeur: OpenReview.net
DOI: 10.48550/arxiv.2306.03828

The Tabular Foundation Model TabPFN Outperforms Specialized Time Series Forecasting Models Based on Simple Features

Auteurs: Hoo, Shi Bin; Muller, Samuel; Salinas, David; Hutter, Frank
Publié dans: Workshop on Table Representation Learning at NeurIPS 2024, Numéro 3, 2024
Éditeur: openreview.net

Zero-Shot AutoML with Pretrained Models

Auteurs: Öztürk, Ekrem; Ferreira, Fabio; Jomaa, Hadi S.; Schmidt-Thieme, Lars; Grabocka, Josif; Hutter, Frank
Publié dans: International Conference on Machine Learning, Numéro 39, 2022, ISSN 2640-3498
Éditeur: PMLR
DOI: 10.48550/arxiv.2206.08476

AutoRL-Bench 1.0

Auteurs: Shala, Gresa; Arango, Sebastian Pineda ; Biedenkapp, André; Hutter, Frank; Grabocka, Josif
Publié dans: Workshop on Meta-Learning at NeurIPS 2022, Numéro 6, 2023
Éditeur: openreview.net

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies

Auteurs: Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank
Publié dans: Neural Information Processing Systems, Numéro 35, 2022, ISSN 1049-5258
Éditeur: Curran Associates, Inc.
DOI: 10.48550/arxiv.2210.03230

GAMformer: Exploring In-Context Learning for Generalized Additive Models

Auteurs: Mueller, Andreas C; Siems, Julien; Nori, Harsha; Salinas, David; Zela, Arber; Caruana, Rich; Hutter, Frank
Publié dans: Workshop Table Representation Learning at NeurIPS 2024, Numéro 3, 2024
Éditeur: openreview.net

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization

Auteurs: Rakotoarison, Herilalaina; Adriaensen, Steven; Mallik, Neeratyoy; Garibov, Samir; Bergman, Eddie; Hutter, Frank
Publié dans: International Conference on Machine Learning, Numéro 41, 2024, ISSN 2640-3498
Éditeur: PMLR
DOI: 10.48550/arXiv.2404.16795

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search

Auteurs: Bansal, Archit; Stoll, Danny; Janowski, Maciej; Zela, Arber; Hutter,Frank
Publié dans: Advances in Neural Information Processing Systems Datasets and Benchmarks Track, Numéro 36, 2022, ISSN 1049-5258
Éditeur: Curran Associates, Inc.

One-shot World Models Using a Transformer Trained on a Synthetic Prior

Auteurs: Ferreira, Fabio; Schlageter, Moreno; Rajan, Raghu; Biedenkapp, Andre; Hutter, Frank
Publié dans: Workshop Open-World Agents at NeurIPS 2024, 2024
Éditeur: openreview.net

New Horizons in Parameter Regularization: A Constraint Approach

Auteurs: Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank
Publié dans: 15th Annual Workshop on Optimization for Machine Learning, 2023
Éditeur: open review.net
DOI: 10.48550/arxiv.2311.09058

Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues

Auteurs: Grazzi, Riccardo; Siems, Julien; Franke, Jorg K.H.; Zela, Arber; Hutter, Frank; Pontil, Massimiliano
Publié dans: Workshop on Mathematics of Modern Machine Learning at NeurIPS 2024, 2024
Éditeur: openreview.net

Multi-objective Differentiable Neural Architecture Search

Auteurs: Sukthanker, Rhea S.; Zela, Arber; Staffler, Benedikt; Dooley, Samuel; Grabocka, Josif; Hutter,Frank
Publié dans: Arxiv, 2024
Éditeur: Arxiv

KinPFN: Bayesian Approximation of RNA Folding Kinetics using Prior-Data Fitted Networks

Auteurs: Dominik Scheuer, Frederic Runge, Jörg K.H. Franke, Michael T. Wolfinger, Christoph Flamm, Frank Hutter
Publié dans: 2024
Éditeur: Cold Spring Harbor Laboratory
DOI: 10.1101/2024.10.15.618378

Partial RNA Design

Auteurs: Runge, Frederic; Franke, Jörg K.H.; Fertmann, Daniel; Backofen, Rolf; Hutter, Frank
Publié dans: Biorxiv, 2024
Éditeur: Cold Spring Harbor Laboratory
DOI: 10.1101/2023.12.29.573656

Neural Architecture Search: Insights from 1000 Papers

Auteurs: White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta, Hutter, Frank
Publié dans: Arxiv, 2023
Éditeur: arxiv
DOI: 10.48550/arXiv.2301.08727

Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML

Auteurs: Weerts, Hilde; Pfisterer, Florian; Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Awad, Noor; Vanschoren, Joaquin; Pechenizkiy, Mykola; Bischl, Bernd; Hutter, Frank
Publié dans: Journal of Artificial Intelligence Research, Numéro 79, 2024, ISSN 1076-9757
Éditeur: Morgan Kaufmann Publishers, Inc.
DOI: 10.1613/jair.1.14747

Publications

Partager cette page Partager cette page sur les réseaux sociaux

Télécharger Télécharger le contenu de la page