Recurrent Neural Networks and Related Machines That Learn Algorithms

The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization

Autorzy: R Csordás, K Irie, J Schmidhuber
Opublikowane w: ICLR 2022, 2022
Wydawca: ICLR 2022

Linear Transformers Are Secretly Fast Weight Programmers

Autorzy: I. Schlag*, K. Irie*, J. Schmidhuber
Opublikowane w: ICML 2021, Proceedings of the 38th International Conference on Machine Learning, 2021
Wydawca: ICML 2021

Parameter-based value functions

Autorzy: F. Faccio, L. Kirsch, J. Schmidhuber
Opublikowane w: NeurIPS 2020 Workshop on Offline Reinforcement Learning, 2020
Wydawca: NeurIPS 2020 Workshop on Offline Reinforcement Learning

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers

Autorzy: K. Irie*, I. Schlag*, R. Csordás, J. Schmidhuber
Opublikowane w: NeurIPS 2021, 2021
Wydawca: NeurIPS 2021

Training and Generating Neural Networks in Compressed Weight Space

Autorzy: K. Irie, J. Schmidhuber
Opublikowane w: ICLR 2021 Workshop on Neural Compression, 2021
Wydawca: ICLR 2021 Workshop on Neural Compression

A Modern Self-Referential Weight Matrix That Learns to Modify Itself

Autorzy: K. Irie, I. Schlag, R. Csordás, J. Schmidhuber
Opublikowane w: NeurIPS 2021 Workshop on Deep Reinforcement Learning, 2021
Wydawca: NeurIPS 2021 Workshop on Deep Reinforcement Learning

Reward-Weighted Regression Converges to a Global Optimum

Autorzy: M. Štrupl*, F. Faccio*, D. R. Ashley, R. K. Srivastava, J. Schmidhuber
Opublikowane w: AAAI 2022, in press, 2022
Wydawca: AAAI 2022

Learning Associative Inference Using Fast Weight Memory

Autorzy: I. Schlag, T. Munkhdalai, J. Schmidhuber
Opublikowane w: ICLR 2021, 2021
Wydawca: ICLR 2021

The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers

Autorzy: R Csordás, K Irie, J Schmidhuber
Opublikowane w: EMNLP 2021, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021, Strona(/y) 619–634
Wydawca: EMNLP 2021

Bayesian Brains and the Rényi Divergence

Autorzy: N. Sajid*, F. Faccio*, L. Da Costa, T. Parr, J. Schmidhuber, K. Friston
Opublikowane w: CNS*2021, 2021
Wydawca: CNS*2021

Improving Stateful Premise Selection with Transformers

Autorzy: K. Prorokovic, M. Wand, J. Schmidhuber
Opublikowane w: CICM 2021, 2021
Wydawca: CICM 2021

Improving Baselines in the Wild

Autorzy: K. Irie, I. Schlag, R. Csordás, J. Schmidhuber
Opublikowane w: NeurIPS 2021 Workshop on Distribution Shifts, 2021
Wydawca: NeurIPS 2021 Workshop on Distribution Shifts

Unsupervised Object Keypoint Learning using Local Spatial Predictability

Autorzy: A. Gopalakrishnan, S. van Steenkiste, J. Schmidhuber
Opublikowane w: ICML 2020 workshop on Object-Oriented Learning: Perception, Representation and Reasoning, 2020
Wydawca: ICML

Parameter-based value functions

Autorzy: F. Faccio, L. Kirsch, J. Schmidhuber
Opublikowane w: ICLR 2021, 2021
Wydawca: ICLR 2021

Reward-Weighted Regression Converges to a Global Optimum

Autorzy: M. Štrupl*, F. Faccio*, D. R. Ashley, R. K. Srivastava, J. Schmidhuber
Opublikowane w: ICML 2021 Workshop on Reinforcement Learning Theory, 2021
Wydawca: ICML 2021 Workshop on Reinforcement Learning Theory

Policy Optimization via Importance Sampling

Autorzy: A. M. Metelli, M. Papini, F. Faccio, M. Restelli
Opublikowane w: NeurIPS 2018, 2018
Wydawca: published at the Neural Information Processing Systems Conference

Improving Differentiable Neural Computers Through Memory Masking, De-allocation, and Link Distribution Sharpness Control

Autorzy: R. Csordas, J. Schmidhuber
Opublikowane w: ICLR 2019, 2019
Wydawca: Published as a conference paper at ICLR 2019

Modular Networks: Learning to Decompose Neural Computation

Autorzy: L. Kirsch, J. Kunze, D. Barber
Opublikowane w: NeurIPS 2018, 2018
Wydawca: published at the Neural Information Processing Systems Conference

Learning to Reason with Third Order Tensor Products

Autorzy: I. Schlag, J. Schmidhuber
Opublikowane w: NeurIPS 2018, 2018
Wydawca: published at the Neural Information Processing Systems Conference

Recurrent World Models Facilitate Policy Evolution

Autorzy: D. Ha, J. Schmidhuber
Opublikowane w: NeurIPS 2018, 2018
Wydawca: published at the Neural Information Processing Systems Conference

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

Autorzy: I. Schlag, P. Smolensky, R. Fernandez, N. Jojic, J. Schmidhuber, J. Gao
Opublikowane w: Under review, 2020
Wydawca: Not disclosed yet

Improving Generalization in Meta Reinforcement Learning using Neural Objectives

Autorzy: L. Kirsch, S. van Steenkiste, J. Schmidhuber
Opublikowane w: ICLR 2020, 2020
Wydawca: Published as a conference paper at ICLR 2020

Learning Adaptive Control Flow in Transformers for Improved Systematic Generalization

Autorzy: R. Csordás, K. Irie, J. Schmidhuber
Opublikowane w: NeurIPS 2021 Workshop on Advances in Programming Languages and Neurosymbolic Systems, 2021
Wydawca: NeurIPS 2021 Workshop on Advances in Programming Languages and Neurosymbolic Systems

Augmenting Classic Algorithms with Neural Components for Strong Generalisation on Ambiguous and High-Dimensional Data

Autorzy: I. Schlag, J. Schmidhuber
Opublikowane w: NeurIPS 2021 Workshop on Advances in Programming Languages and Neurosymbolic Systems, 2021
Wydawca: NeurIPS 2021 Workshop on Advances in Programming Languages and Neurosymbolic Systems

Parameter-based value functions

Autorzy: F. Faccio, L. Kirsch, J. Schmidhuber
Opublikowane w: NeurIPS 2020 Workshop on Deep Reinforcement Learning, 2021
Wydawca: NeurIPS 2020 Workshop on Deep Reinforcement Learning

Unsupervised Object Keypoint Learning using Local Spatial Predictability

Autorzy: A. Gopalakrishnan, S. van Steenkiste, J. Schmidhuber
Opublikowane w: ICLR 2021, 2021
Wydawca: ICLR 2021

Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks

Autorzy: R Csordás, S van Steenkiste, J Schmidhuber
Opublikowane w: ICLR 2021, 2021
Wydawca: ICLR 2021

Exploring through Random Curiosity with General Value Functions

Autorzy: A. Ramesh, L. Kirsch, S. van Steenkiste, J. Schmidhuber
Opublikowane w: NeurIPS 2021 Workshop on Deep Reinforcement Learning, 2021
Wydawca: NeurIPS 2021 Workshop on Deep Reinforcement Learning

Meta learning backpropagation and improving it

Autorzy: L. Kirsch, J. Schmidhuber
Opublikowane w: NeurIPS 2021, 2021
Wydawca: NeurIPS 2021

Bayesian Brains and the Rényi Divergence

Autorzy: N. Sajid*, F. Faccio*, L. Da Costa, T. Parr, J. Schmidhuber, K. Friston
Opublikowane w: Neural Computation, Numer 34, 829–855 (2022), 2021, ISSN 1530-888X
Wydawca: Neural computation, Cambridge: MIT Press

Generative Adversarial Networks are Special Cases of Artificial Curiosity (1990) and also Closely Related to Predictability Minimization (1991)

Autorzy: J. Schmidhuber
Opublikowane w: Neural Networks, 2020, ISSN 0893-6080
Wydawca: Pergamon Press Ltd.

Automatic Embedding of Stories Into Collections of Independent Media

Autorzy: D. R. Ashley*, V. Herrmann*, Z. Friggstad, K. W. Mathewson, J. Schmidhuber
Opublikowane w: ArXiv, 2021
Wydawca: ArXiv

All You Need Is Supervised Learning: From Imitation Learning to Meta-RL With Upside Down RL

Autorzy: K. Arulkumaran, D. R. Ashley, J. Schmidhuber, R. K. Srivastava
Opublikowane w: RLDM 2022, 2022
Wydawca: RLDM 2022

Learning Relative Return Policies With Upside-Down Reinforcement Learning

Autorzy: D. R. Ashley, K. Arulkumaran, J. Schmidhuber, R. K. Srivastava
Opublikowane w: RLDM 2022, 2022
Wydawca: RLDM 2022

Publikacje

Udostępnij tę stronę

Pobierz