A Low-Power Artificial Intelligence Framework based on Vector Symbolic Architectures

Project Information

devSAFARI

Grant agreement ID: 839179

DOI

10.3030/839179

Project closed

EC signature date 1 April 2019

Start date 9 January 2020

End date 10 July 2023

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 279 192,00

EU contribution

€ 279 192,00

Coordinated by

RISE RESEARCH INSTITUTES OF SWEDEN AB
Sweden

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (6)

HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing Enabled Embedding of n-gram Statistics

Author(s): Pedro Alonso, Kumar Shridhar, Denis Kleyko, Evgeny Osipov, Marcus Liwicki
Published in: International Joint Conference on Neural Networks (IJCNN), 2021, ISSN 78-1-6654-3900-8
Publisher: IEEE
DOI: 10.1109/ijcnn52387.2021.9534359

Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional Computing

Author(s): Cameron Diao; Denis Kleyko; Jan M. Rabaey; Bruno A. Olshausen
Published in: International Joint Conference on Neural Networks (IJCNN), 2021, Page(s) 1-9, ISSN 78-1-6654-3900-8
Publisher: IEEE
DOI: 10.1109/ijcnn52387.2021.9533316

Recursive Binding for Similarity-Preserving Hypervector Representations of Sequences

Author(s): Dmitri A. Rachkovskij, Denis Kleyko
Published in: International Joint Conference on Neural Networks (IJCNN), 2022, ISBN 978-1-7281-8671-9
Publisher: IEEE
DOI: 10.1109/ijcnn55064.2022.9892462

Computing on Functions Using Randomized Vector Representations (in brief)

Author(s): E. Paxon Frady, Denis Kleyko, Christopher J. Kymn, Bruno A. Olshausen, Friedrich T. Sommer
Published in: NICE 2022: Neuro-Inspired Computational Elements Conference, 2022, Page(s) 115-122, ISBN 978-1-4503-9559-5
Publisher: Association for Computing Machinery
DOI: 10.1145/3517343.3522597

Integer Factorization with Compositional Distributed Representations

Author(s): Denis Kleyko, Connor Bybee, Christopher J. Kymn, Bruno A. Olshausen, Amir Khosrowshahi, Dmitri E. Nikonov, Friedrich T. Sommer, E. Paxon Frady
Published in: NICE 2022: Neuro-Inspired Computational Elements Conference, 2022, Page(s) 73-80, ISBN 978-1-4503-9559-5
Publisher: Association for Computing Machinery
DOI: 10.1145/3517343.3517368

End to End Binarized Neural Networks for Text Classification

Author(s): Kumar Shridhar, Harshil Jain, Akshat Agarwal, Denis Kleyko
Published in: Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing, 2020, Page(s) 29-34
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.sustainlp-1.4

Peer reviewed articles (12)

Generalized Key-Value Memory to Flexibly Adjust Redundancy in Memory-Augmented Networks

Author(s): Denis Kleyko, Geethan Karunaratne, Jan M. Rabaey, Abu Sebastian, Abbas Rahimi
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2022, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2022.3159445

Perceptron Theory Can Predict the Accuracy of Neural Networks

Author(s): Denis Kleyko, Antonello Rosato, E. Paxon Frady, Massimo Panella, Friedrich T. Sommer
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2023, Page(s) 1-15, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2023.3237381

Variable Binding for Sparse Distributed Representations: Theory and Applications.

Author(s): Edward Paxon Frady; Denis Kleyko; Friedrich T. Sommer
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2021, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2021.3105949

Density Encoding Enables Resource-Efficient Randomly Connected Neural Networks

Author(s): Denis Kleyko, Mansour Kheffache, E. Paxon Frady, Urban Wiklund, Evgeny Osipov
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2020, Page(s) 1-7, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2020.3015971

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations

Author(s): Denis Kleyko, Dmitri A. Rachkovskij, Evgeny Osipov, Abbas Rahimi
Published in: ACM Computing Surveys, 2022, ISSN 0360-0300
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3538531

Torchhd: An Open Source Python Library to Support Research on Hyperdimensional Computing and Vector Symbolic Architectures

Author(s): Mike Heddes, Igor Nunes, Pere Vergés, Denis Kleyko, Danny Abraham, Tony Givargis, Alexandru Nicolau, Alexander Veidenbaum
Published in: Journal of Machine Learning Research, 2023, Page(s) 1-10, ISSN 1533-7928
Publisher: JMLR, Inc.
DOI: 10.48550/arxiv.2205.09208

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges

Author(s): Denis Kleyko, Dmitri A. Rachkovskij, Evgeny Osipov, Abbas Rahimi
Published in: ACM Computing Surveys, 2023, ISSN 0360-0300
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3558000

On Separating Long- and Short-term Memories in Hyperdimensional Computing

Author(s): Jeffrey L. Teeters, Denis Kleyko, Pentti Kanerva, Bruno A. Olshausen
Published in: Frontiers in Neuroscience, 2023, Page(s) 1-19, ISSN 1662-453X
Publisher: Frontiers Media S.A.
DOI: 10.3389/fnins.2022.867568

Efficient Decoding of Compositional Structure in Holistic Representations

Author(s): Denis Kleyko, Connor Bybee, Ping-Chen Huang, Christopher J. Kymn, Bruno A. Olshausen, E. Paxon Frady, Friedrich T. Sommer
Published in: Neural Computation, 2023, Page(s) 1159–1186, ISSN 0899-7667
Publisher: MIT Press
DOI: 10.1162/neco_a_01590

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware

Author(s): Denis Kleyko, Mike Davies, E. Paxon Frady, Pentti Kanerva, Spencer J. Kent, Bruno A. Olshausen, Evgeny Osipov, Jan M. Rabaey, Dmitri A. Rachkovskij, Abbas Rahimi, Friedrich T. Sommer
Published in: Proceedings of the IEEE, 2022, Page(s) 1538-1571, ISSN 0018-9219
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jproc.2022.3209104

Integer Echo State Networks: Efficient Reservoir Computing for Digital Hardware

Author(s): Denis Kleyko, Edward Paxon Frady, Mansour Kheffache, Evgeny Osipov
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2020, Page(s) 1-14, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2020.3043309

Cellular Automata Can Reduce Memory Requirements of Collective-State Computing

Author(s): Denis Kleyko, E. Paxon Frady, Friedrich T. Sommer
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2022, Page(s) 2701-2713, ISSN 2162-237X
Publisher: IEEE Computational Intelligence Society
DOI: 10.1109/tnnls.2021.3119543