DeepLearning 2.0: Meta-Learning Qualitatively New Components

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition

Autores: Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P.; White, Colin; Hutter, Frank; Goldblum, Micah
Publicado en: Advances in Neural Information Processing Systems, Edición 36, 2023, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2210.09943

Multi-objective Tree-structured Parzen Estimator Meets Meta-learning

Autores: Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank
Publicado en: Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022
Editor: openreview.net

PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces

Autores: Watanabe, Shuhei; Bansal, Archit; Hutter, Frank
Publicado en: International Joint Conference on Artificial Intelligence, Edición 32, 2023, ISSN 1045-0823
Editor: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/488

Weight-Entanglement Meets Gradient-Based Neural Architecture Search

Autores: Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Safari, Mahmoud; Hutter, Frank
Publicado en: International Conference on Automated Machine Learning, Edición 4, 2024
Editor: openreview.net
DOI: 10.48550/arxiv.2312.10440

Quick-Tune-Tool: A Practical Tool and its User Guide for Automatically Finetuning Pretrained Models

Autores: Rapant, Ivo; Purucker, Lennart; Ferreira, Fabio; Arango, Sebastian Pineda; Kadra, Arlind; Grabocka, Josif; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

LMEMs for post-hoc analysis of HPO Benchmarking

Autores: Geburek, Anton Merlin; Mallik, Neeratyoy; Stoll, Danny; Bouthillier, Xavier; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

Warmstarting for Scaling Language Models

Autores: Mallik, Neeratyoy; Janowski, Maciej; Hog, Johannes; Rakotoarison, Herilalaina; Klein, Aaron; Grabocka, Josif; Hutter, Frank
Publicado en: Workshop on Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning at NeurIPS 2024, 2024
Editor: openreview.net

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models

Autores: Bhethanabhotla, Sathya Kamesh; Swelam, Omar; Siems, Julien; Salinas, David; Hutter, Frank
Publicado en: Workshop on Time Series in the Age of Large Models at NeurIPS 2024, 2024
Editor: openreview.net

Preserving Principal Subspaces to Reduce Catastrophic Forgetting in Fine-tuning

Autores: Franke, Jorg K.H.; Hefenbrock, Michael; Hutter, Frank
Publicado en: Workshop on Mathematical and Empirical Understanding of Foundation Models at ICLR 2024, 2024
Editor: openreview.net

Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Design

Autores: Franke, Jörg K. H.; Runge, Frederic; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 35, 2022, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2205.13927

From Epoch to Sample Size: Developing New Data-driven Priors for Learning Curve Prior-Fitted Networks

Autores: Viering, Tom Julian; Adriaensen, Steven; Rakotoarison, Herilalaina; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

Joint Entropy Search For Maximally-Informed Bayesian Optimization

Autores: Hvarfner, Carl; Hutter, Frank; Nardi, Luigi
Publicado en: Advances in Neural Information Processing Systems, Edición 35, 2022, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arXiv.2206.04771

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator

Autores: Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank
Publicado en: International Joint Conference on Artificial Intelligence, Edición 32, 2023, ISSN 1045-0823
Editor: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/487

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks

Autores: Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank
Publicado en: Advances in neural information processing systems, Edición 36, 2023, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2310.20447

LoRA-DARTS: Low Rank Adaptation for Differentiable Architecture Search

Autores: Krishnakumar, Arjun; Jha, Abhash Kumar; Moradian, Shakiba; Rapp, Martin; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning

Autores: Shala, Gresa; Arango, Sebastian Pineda; Biedenkapp, Andre; Hutter, Frank; Grabocka, Josif
Publicado en: International Conference on Automated Machine learning (ABCD Track), Edición 4, 2024
Editor: openreview.net

GraViT-E: Gradient-based Vision Transformer Search with Entangled Weights

Autores: Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Patil, Sharat; Hutter, Frank
Publicado en: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022
Editor: openreview.net

Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks

Autores: Watanabe, Shuhei; Mallik, Neeratyoy; Bergman, Edward; Hutter, Frank
Publicado en: International Conference on Automated Machine Learning, Edición 4, 2024
Editor: openreview.net
DOI: 10.48550/arXiv.2403.01888

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars

Autores: Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea; Brox, Thomas; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 36, 2023, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2211.01842

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models

Autores: Sukthanker, Rhea Sanjay; Zela, Arber; Staffler, Benedikt; Klein, Aaron; Purucker, Lennart; Franke, Jorg K.H.; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 38, 2024
Editor: openreview.net

Towards Quantifying the Effect of Datasets for Benchmarking: A Look at Tabular Machine Learning

Autores: Kohli, Ravin; Feurer, Matthias; Eggensperger, Katharina; Bischl, Bernd; Hutter, Frank
Publicado en: Data-centric Machine Learning Research (DMLR) Workshop at ICLR (2024), 2024
Editor: openreview.net

Gray-Box Gaussian Processes for Automated Reinforcement Learning

Autores: Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif
Publicado en: International Conference on Learning Representations, Edición 11, 2023
Editor: openreview.net

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization

Autores: Watanabe, Shuhei; Hutter, Frank
Publicado en: International Joint Conference on Artificial Intelligence, Edición 32, 2023, ISSN 1045-0823
Editor: International Joint Conferences on Artificial Intelligence
DOI: 10.24963/ijcai.2023/486

Ensembling Finetuned Language Models for Text Classification

Autores: Arango, Sebastian Pineda; Janowski, Maciej; Purucker, Lennart; Zela, Arber; Hutter, Frank; Grabocka, Josif
Publicado en: Workshop on Fine-Tuning in Modern Machine Learning: Principles and Scalability at NeurIPS 2024, 2024
Editor: openreview.net

Towards Generative RNA Design with Tertiary Interactions

Autores: Sharat Patil and Runge, Frederic; Franke, Jorg K.H.; Hutter, Frank
Publicado en: Workshop on Generative and Experimental Perspectives for Biomolecular Design at ICLR 2024, 2024
Editor: openreview.net

NOSBench-101: Towards Reproducible Neural Optimizer Search

Autores: Karakasli, Goktug; Adriaensen, Steven; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second

Autores: Hollmann, Noah; Muller, Samuel; Eggensperger, Katharina; Hutter, Frank
Publicado en: International Conference on Learning Representations, Edición 11, 2023
Editor: openreview.net
DOI: 10.48550/arXiv.2207.01848

Beyond Graph-Based Modeling for Hierarchical Neural Architecture Search

Autores: Birinxhiku, Lum; Stoll, Danny; Schrodi, Simon; Hutter, Frank
Publicado en: International Conference on Automated Machine learning (Workshop Track), 2024
Editor: openreview.net

Is Mamba Capable of In-Context Learning?

Autores: Grazzi, Riccardo; Siems, Julien Niklas; Schrodi, Simon; Brox, Thomas; Hutter, Frank
Publicado en: Workshop on Mathematical and Empirical Understanding of Foundation Models at ICLR 2024, 2024
Editor: openreview.net

DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning

Autores: Sass, René; Bergman, Eddie; Biedenkapp, André; Hutter, Frank; Lindauer, Marius
Publicado en: Workshop on Adaptive Experimental Design and Active Learning in the Real World at ICML 20222, 2022
Editor: PMLR
DOI: 10.48550/arxiv.2206.03493

Self-Correcting Bayesian Optimization through Bayesian Active Learning

Autores: Hvarfner, Carl; Hellsten, Erik; Hutter, Frank; Nardi, Luigi
Publicado en: Advances in neural information processing systems, Edición 36, 2023, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arXiv.2304.11005

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning

Autores: Mallik, Neeratyoy; Bergman, Edward; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Lindauer, Marius; Nardi, Luigi; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 36, 2023, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2306.12370

Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data

Autores: Helli, Kai; Schnurr, David; Hollmann, Noah; Müller, Samuel; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 38, 2024
Editor: openreview.net

On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning

Autores: Wagner, Diane; Ferreira, Fabio; Stoll, Danny; Schirrmeister, Robin Tibor; Müller, Samuel; Hutter, Frank
Publicado en: First Workshop of Pre-training: Perspectives, Pitfalls, and Paths at ICML 2022, 2022
Editor: PMLR
DOI: 10.48550/arxiv.2207.07875

Improving Deep Learning Optimization through Constrained Parameter Regularization

Autores: Franke, Jörg; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank
Publicado en: Advances in Neural Information Processing Systems, Edición 38, 2024
Editor: openreview.net

Large Language Model Compression with Neural Architecture Search

Autores: Sukthanker, Rhea Sanjay; Staffler, Benedikt; Hutter, Frank; Klein, Aaron
Publicado en: Workshop on Machine Learning and Compression at NeurIPS 2024, 2024
Editor: openreview.net

RNA-Protein Interaction Classification via Sequence Embeddings

Autores: Matus, Dominika; Runge, Frederic; Franke, Jorg K.H.; Gerne, Lars; Uhl, Michael; Hutter, Frank; Backofen, Rolf
Publicado en: Workshop on Generative and Experimental Perspectives for Biomolecular Design at ICLR 2024, 2024
Editor: openreview.net

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How

Autores: Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif
Publicado en: International Conference on Learning Representations, Edición 11, 2024
Editor: OpenReview.net
DOI: 10.48550/arxiv.2306.03828

The Tabular Foundation Model TabPFN Outperforms Specialized Time Series Forecasting Models Based on Simple Features

Autores: Hoo, Shi Bin; Muller, Samuel; Salinas, David; Hutter, Frank
Publicado en: Workshop on Table Representation Learning at NeurIPS 2024, Edición 3, 2024
Editor: openreview.net

Zero-Shot AutoML with Pretrained Models

Autores: Öztürk, Ekrem; Ferreira, Fabio; Jomaa, Hadi S.; Schmidt-Thieme, Lars; Grabocka, Josif; Hutter, Frank
Publicado en: International Conference on Machine Learning, Edición 39, 2022, ISSN 2640-3498
Editor: PMLR
DOI: 10.48550/arxiv.2206.08476

AutoRL-Bench 1.0

Autores: Shala, Gresa; Arango, Sebastian Pineda ; Biedenkapp, André; Hutter, Frank; Grabocka, Josif
Publicado en: Workshop on Meta-Learning at NeurIPS 2022, Edición 6, 2023
Editor: openreview.net

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies

Autores: Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank
Publicado en: Neural Information Processing Systems, Edición 35, 2022, ISSN 1049-5258
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2210.03230

GAMformer: Exploring In-Context Learning for Generalized Additive Models

Autores: Mueller, Andreas C; Siems, Julien; Nori, Harsha; Salinas, David; Zela, Arber; Caruana, Rich; Hutter, Frank
Publicado en: Workshop Table Representation Learning at NeurIPS 2024, Edición 3, 2024
Editor: openreview.net

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization

Autores: Rakotoarison, Herilalaina; Adriaensen, Steven; Mallik, Neeratyoy; Garibov, Samir; Bergman, Eddie; Hutter, Frank
Publicado en: International Conference on Machine Learning, Edición 41, 2024, ISSN 2640-3498
Editor: PMLR
DOI: 10.48550/arXiv.2404.16795

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search

Autores: Bansal, Archit; Stoll, Danny; Janowski, Maciej; Zela, Arber; Hutter,Frank
Publicado en: Advances in Neural Information Processing Systems Datasets and Benchmarks Track, Edición 36, 2022, ISSN 1049-5258
Editor: Curran Associates, Inc.

One-shot World Models Using a Transformer Trained on a Synthetic Prior

Autores: Ferreira, Fabio; Schlageter, Moreno; Rajan, Raghu; Biedenkapp, Andre; Hutter, Frank
Publicado en: Workshop Open-World Agents at NeurIPS 2024, 2024
Editor: openreview.net

New Horizons in Parameter Regularization: A Constraint Approach

Autores: Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank
Publicado en: 15th Annual Workshop on Optimization for Machine Learning, 2023
Editor: open review.net
DOI: 10.48550/arxiv.2311.09058

Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues

Autores: Grazzi, Riccardo; Siems, Julien; Franke, Jorg K.H.; Zela, Arber; Hutter, Frank; Pontil, Massimiliano
Publicado en: Workshop on Mathematics of Modern Machine Learning at NeurIPS 2024, 2024
Editor: openreview.net

Multi-objective Differentiable Neural Architecture Search

Autores: Sukthanker, Rhea S.; Zela, Arber; Staffler, Benedikt; Dooley, Samuel; Grabocka, Josif; Hutter,Frank
Publicado en: Arxiv, 2024
Editor: Arxiv

KinPFN: Bayesian Approximation of RNA Folding Kinetics using Prior-Data Fitted Networks

Autores: Dominik Scheuer, Frederic Runge, Jörg K.H. Franke, Michael T. Wolfinger, Christoph Flamm, Frank Hutter
Publicado en: 2024
Editor: Cold Spring Harbor Laboratory
DOI: 10.1101/2024.10.15.618378

Partial RNA Design

Autores: Runge, Frederic; Franke, Jörg K.H.; Fertmann, Daniel; Backofen, Rolf; Hutter, Frank
Publicado en: Biorxiv, 2024
Editor: Cold Spring Harbor Laboratory
DOI: 10.1101/2023.12.29.573656

Neural Architecture Search: Insights from 1000 Papers

Autores: White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta, Hutter, Frank
Publicado en: Arxiv, 2023
Editor: arxiv
DOI: 10.48550/arXiv.2301.08727

Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML

Autores: Weerts, Hilde; Pfisterer, Florian; Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Awad, Noor; Vanschoren, Joaquin; Pechenizkiy, Mykola; Bischl, Bernd; Hutter, Frank
Publicado en: Journal of Artificial Intelligence Research, Edición 79, 2024, ISSN 1076-9757
Editor: Morgan Kaufmann Publishers, Inc.
DOI: 10.1613/jair.1.14747

Publicaciones

Compartir esta página Compartir esta página en las redes sociales

Descargar Descargar el contenido de la página