Computation-in-memory architecture based on resistive devices

Projektinformationen

MNEMOSENE

ID Finanzhilfevereinbarung: 780215

DOI

10.3030/780215

Projekt abgeschlossen

EK-Unterschriftsdatum 31 Oktober 2017

Startdatum 1 Januar 2018

Enddatum 30 Juni 2021

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 3 998 120,00

EU-Beitrag

€ 3 998 120,00

Koordiniert durch

TECHNISCHE UNIVERSITEIT DELFT
Netherlands

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (17)

Refined CIM architecture

Final ISA specification of the whole CIM architecture including the instruction set simulator.

Report on mapping of micro-kernels to macro-architecture

This report will detail the methods used to map micro-kernels selected and developed as part of WP1 onto the macro architecture. The report will define performance metrics for the mapping, report different methods used throughout the project and compare their efficiencies.

First version parallelizing orchestrating compiler targeting CIM micro-instructions

The parallelizing compiler for the CIM architecture will embed skeleton-based and polyhedral compilation techniques into a flexible mapping and code generation framework. The first version of this parallelizing compiler will focus on orchestrating the CIM micro-instructions over the complete architecture, including data layout and the management of data transfer.

First version programming interface at the micro- and macro-levels

Description of micro and macro instruction set.

Initial memristor crossbar based logic/ arithmetic and memory designs and models

The memory compiler models of IMEC will incorporate a few most promising non-volatile memory models, together with behavioural models for sense amplifiers and column/row decoder circuits. These models therefore overcome the limitations of NVSim by generating power/performance/area data which can be applied to a wide range of in-memory computing architecture exploration.

Refined CIM microarchitecture

The technology-aware microarchitecture simulator framework of IMEC will be further extended to incorporate the additional features in the macro-architecture simulator developed of WP 3 and the additional memory compiler models from D4.5 We will also use it for extensive T-A-E design space explorations.

Initial communication protocols and infrastructure

In this report, we will detail the results that will describe the circuits and methods to allow efficient data transfer between tiles and the outside world. The report will detail the challenges, and list the potential solutions that were considered. The circuits methods described in this report will form the basis of the initial system being developed I the project, which will then be refined throughout the project.

First version backend compiler for micro-instructions

First compiler generation of micro instruction for the CIM file.

Final report on new algorithmic solutions

Refine and optimize the new algorithms for the targeted applications while considering the features of the CIM architecture and learning from the results of WP2, WP3 and WP4.

Initial models of memristive device

Based on experimental memristive device characteristics and existing physical device models that are mainly based on continuum models, physical and/or behavioural compact models will be derived for use in circuit simulation. This activity includes model building for both ReRAM devices (RTWH) and PCM devices (IBM), while IMEC will bring in their models as “blackboxes”.

Complete parallelization, orchestration and compilation flow

The deliverable will describe the matured prototypes described in D2.2 and D2.3 and their integration into a unified flow. The flow will be made available to all participants ahead of delivery time and early evaluation will complement the description.

Refined models of memristive device

The initial models will be refined in order to include device “imperfections” as variability, degradation and disturb, as well as statistical property distributions as these will strongly influence the logic performance.

Refined memristor crossbar based logic and memory design and models

The memory compiler models of IMEC will be extended and refined to include more emerging NVM options that are of most promise during this 2nd half of the project.

Report on targeted applications, their specifications, requirements

The report will describe some highly relevant problems arising in the emerging fields of cognitive computing and internet of things (IoT) that could benefit from implementation on non-von Neumann computing architecture based on the computation-in-memory (CIM) dies. The CIM dies could implement digital memristive logic or perform certain arithmetic operations such as vector-matrix multiplication. The report will also describe the application-specific requirements on the CIM dies.

Initial CIM microarchitecture

To enable the technology-aware microarchitecture simulator framework for detailed in-memory computing trade-off exploration, in WP4 a bridge has to be created between the macro-architecture simulator developed as part of WP 3 and the memory compiler models from D4.4.

First report on new algorithmic solutions

Develop new algorithms for the targeted applications while considering the features of the new CIM architecture.

Initial macro CIM architecture and CIM-ISA

Initial ISA description for the whole CIM architecture based on the requirements from D1.1

Websites, patent fillings, videos etc. (2)

Promotional material

Material for publicity and promotion including a project leaflet, a poster, a powerpoint presentation and a short film.

Project website

A project website will be designed, including an external facing website and an internal facing secure cloud storage.

Veröffentlichungen

Peer reviewed articles (16)

In‐Memory Database Query

Autoren: Iason Giannopoulos, Abhairaj Singh, Manuel Le Gallo, Vara Prasad Jonnalagadda, Said Hamdioui, Abu Sebastian
Veröffentlicht in: Advanced Intelligent Systems, Ausgabe 2/12, 2020, Seite(n) 2000141, ISSN 2640-4567
Herausgeber: Wiley-VCH GmbH
DOI: 10.1002/aisy.202000141

Binarization Methods for Motor-Imagery Brain–Computer Interface Classification

Autoren: Hersche, Michael; Benini, Luca; Rahimi, Abbas
Veröffentlicht in: IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 10 (4), Ausgabe 1, 2020, ISSN 2156-3357
Herausgeber: IEEE Circuits and Systems Society
DOI: 10.3929/ethz-b-000457995

Variability-Aware Modeling of Filamentary Oxide based Bipolar Resistive Switching Cells Using SPICE Level Compact Models

Autoren: Bengel, Christopher; Siemon, Anne; Cuppers, Felix; Hoffmann-Eifert, Susanne; Hardtdegen, Alexander; Von Witzleben, Moritz; Hellmich, Lena; Waser, Rainer; Menzel, Stephan
Veröffentlicht in: IEEE transactions on circuits and systems / 1 67(12), 4618-4630 (2020). doi:10.1109/TCSI.2020.3018502, Ausgabe 17, 2020, Seite(n) 4618 - 4630, ISSN 1549-8328
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.18154/rwth-2020-11895

In-memory hyperdimensional computing

Autoren: Geethan Karunaratne, Manuel Le Gallo, Giovanni Cherubini, Luca Benini, Abbas Rahimi, Abu Sebastian
Veröffentlicht in: Nature Electronics, Ausgabe 3/6, 2020, Seite(n) 327-337, ISSN 2520-1131
Herausgeber: Springer Nature
DOI: 10.1038/s41928-020-0410-3

Compressed Sensing With Approximate Message Passing Using In-Memory Computing

Autoren: Manuel Le Gallo, Abu Sebastian, Giovanni Cherubini, Heiner Giefers, Evangelos Eleftheriou
Veröffentlicht in: IEEE Transactions on Electron Devices, 2018, Seite(n) 1-9, ISSN 0018-9383
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TED.2018.2865352

A phase-change memory model for neuromorphic computing

Autoren: S. R. Nandakumar, Manuel Le Gallo, Irem Boybat, Bipin Rajendran, Abu Sebastian, Evangelos Eleftheriou
Veröffentlicht in: Journal of Applied Physics, Ausgabe 124/15, 2018, Seite(n) 152135, ISSN 0021-8979
Herausgeber: American Institute of Physics
DOI: 10.1063/1.5042408

Online Learning and Classification of EMG-Based Gestures on a Parallel Ultra-Low Power Platform Using Hyperdimensional Computing

Autoren: Simone Benatti, Fabio Montagna, Victor Kartsch, Abbas Rahimi, Davide Rossi, Luca Benini
Veröffentlicht in: IEEE Transactions on Biomedical Circuits and Systems, Ausgabe 13/3, 2019, Seite(n) 516-528, ISSN 1932-4545
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbcas.2019.2914476

Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory

Autoren: Schmuck, Manuel; Benini, Luca; Rahimi, Abbas
Veröffentlicht in: ACM Journal on Emerging Technologies in Computing Systems, Ausgabe 4, 2019, ISSN 1550-4832
Herausgeber: Association for Computing Machinary, Inc.
DOI: 10.3929/ethz-b-000338354

Hyperdimensional Computing with Local Binary Patterns: One-shot Learning for Seizure Onset Detection and Identification of Ictogenic Brain Regions from Short-time iEEG Recordings

Autoren: Alessio Burrello, Kaspar Anton Schindler, Luca Benini, Abbas Rahimi
Veröffentlicht in: IEEE Transactions on Biomedical Engineering, 2019, Seite(n) 1-1, ISSN 0018-9294
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbme.2019.2919137

The Next 700 Accelerated Layers

Autoren: Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary Devito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen
Veröffentlicht in: ACM Transactions on Architecture and Code Optimization, Ausgabe 16/4, 2019, Seite(n) 1-26, ISSN 1544-3566
Herausgeber: Association for Computing Machinary, Inc.
DOI: 10.1145/3355606

Flextended Tiles

Autoren: Jie Zhao, Albert Cohen
Veröffentlicht in: ACM Transactions on Architecture and Code Optimization, Ausgabe 16/4, 2019, Seite(n) 1-25, ISSN 1544-3566
Herausgeber: Association for Computing Machinary, Inc.
DOI: 10.1145/3369382

Analyses of a 1-layer neuromorphic network using memristive devices with non-continuous resistance levels

Autoren: A. Siemon, S. Ferch, A. Heittmann, R. Waser, D. J. Wouters, S. Menzel
Veröffentlicht in: APL Materials, Ausgabe 7/9, 2019, Seite(n) 091110, ISSN 2166-532X
Herausgeber: AIP Publishing
DOI: 10.1063/1.5108658

Exploiting the switching dynamics of HfO 2 -based ReRAM devices for reliable analog memristive behavior

Autoren: F. Cüppers, S. Menzel, C. Bengel, A. Hardtdegen, M. von Witzleben, U. Böttger, R. Waser, S. Hoffmann-Eifert
Veröffentlicht in: APL Materials, Ausgabe 7/9, 2019, Seite(n) 091105, ISSN 2166-532X
Herausgeber: AIP Publishing
DOI: 10.1063/1.5108654

Energy Efficient In-Memory Hyperdimensional Encoding for Spatio-Temporal Signal Processing

Autoren: Geethan Karunaratne, Manuel Le Gallo, Michael Hersche, Giovanni Cherubini, Luca Benini, Abu Sebastian, Abbas Rahimi
Veröffentlicht in: IEEE Transactions on Circuits and Systems II: Express Briefs, Ausgabe 68/5, 2021, Seite(n) 1725-1729, ISSN 1549-7747
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tcsii.2021.3068126

Experimental Demonstration of Memristor-Aided Logic (MAGIC) Using Valence Change Memory (VCM)

Autoren: Barak Hoffer, Vikas Rana, Stephan Menzel, Rainer Waser, Shahar Kvatinsky
Veröffentlicht in: IEEE Transactions on Electron Devices, Ausgabe 67/8, 2020, Seite(n) 3115-3122, ISSN 0018-9383
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ted.2020.3001247

HRS Instability in Oxide-Based Bipolar Resistive Switching Cells

Autoren: Stefan Wiefels, Christopher Bengel, Nils Kopperberg, Kaihua Zhang, Rainer Waser, Stephan Menzel
Veröffentlicht in: IEEE Transactions on Electron Devices, Ausgabe 67/10, 2020, Seite(n) 4208-4215, ISSN 0018-9383
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ted.2020.3018096

Conference proceedings (21)

PET-to-MLIR: A polyhedral front-end for MLIR

Autoren: Konrad Komisarczyk, Lorenzo Chelini, Kanishkan Vadivel, Roel Jordans, Henk Corporaal
Veröffentlicht in: 2020 23rd Euromicro Conference on Digital System Design (DSD), 2020, Seite(n) 551-556, ISBN 978-1-7281-9535-3
Herausgeber: IEEE
DOI: 10.1109/dsd51259.2020.00091

Integrating Event-based Dynamic Vision Sensors with Sparse Hyperdimensional Computing: A Low-power Accelerator with Online Capability

Autoren: Hersche, Michael; Mello Rella, Edoardo; Di Mauro, Alfio; Benini, Luca; Rahimi, Abbas
Veröffentlicht in: ISLPED '20: Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design, 2020
Herausgeber: Association for Computing Machinery (ACM)
DOI: 10.3929/ethz-b-000425534

TDO-CIM: Transparent Detection and Offloading for Computation In-memory

Autoren: Kanishkan Vadivel, Lorenzo Chelini, Ali BanaGozar, Gagandeep Singh, Stefano Corda, Roel Jordans, Henk Corporaal
Veröffentlicht in: 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2020, Seite(n) 1602-1605, ISBN 978-3-9819263-4-7
Herausgeber: IEEE
DOI: 10.23919/date48585.2020.9116464

Applications of Computation-In-Memory Architectures based on Memristive Devices

Autoren: Said Hamdioui, Hoang Anh Du Nguyen, Mottaqiallah Taouil, Abu Sebastian, Manuel Le Gallo, Sandeep Pande, Siebren Schaafsma, Francky Catthoor, Shidhartha Das, Fernando G. Redondo, G. Karunaratne, Abbas Rahimi, Luca Benini
Veröffentlicht in: 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2019, Seite(n) 486-491, ISBN 978-3-9819263-2-3
Herausgeber: IEEE
DOI: 10.23919/DATE.2019.8715020

Time-division Multiplexing Automata Processor

Autoren: Jintao Yu, Hoang Anh Du Nguyen, Muath Abu Lebdeh, Mottaqiallah Taouil, Said Hamdioui
Veröffentlicht in: 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2019, Seite(n) 794-799, ISBN 978-3-9819263-2-3
Herausgeber: IEEE
DOI: 10.23919/date.2019.8715140

Memristive Device Based Circuits for Computation-in-Memory Architectures

Autoren: Muath Abu Lebdeh, Uljana Reinsalud, Hoang Anh Du Nguyen, Stephan Wong, Said Hamdioui
Veröffentlicht in: 2019 IEEE International Symposium on Circuits and Systems (ISCAS), 2019, Seite(n) 1-5, ISBN 978-1-7281-0397-6
Herausgeber: IEEE
DOI: 10.1109/iscas.2019.8702542

One-shot Learning for iEEG Seizure Detection Using End-to-end Binary Operations: Local Binary Patterns with Hyperdimensional Computing

Autoren: Alessio Burrello, Kaspar Schindler, Luca Benini, Abbas Rahimi
Veröffentlicht in: 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2018, Seite(n) 1-4, ISBN 978-1-5386-3603-9
Herausgeber: IEEE
DOI: 10.1109/BIOCAS.2018.8584751

Memristive Device Modeling and Circuit Design Exploration for Computation-in-Memory

Autoren: Anne Siemon, Dirk Wouters, Said Hamdioui, Stephan Menzel
Veröffentlicht in: 2019 IEEE International Symposium on Circuits and Systems (ISCAS), 2019, Seite(n) 1-5, ISBN 978-1-7281-0397-6
Herausgeber: IEEE
DOI: 10.1109/iscas.2019.8702600

Laelaps: An Energy-Efficient Seizure Detection Algorithm from Long-term Human iEEG Recordings without False Alarms

Autoren: Burrello, Alessio; Cavigelli, Lukas; id_orcid0000-0003-1767-7715; Schindler, Kaspar; Benini, Luca; id_orcid0000-0001-8068-3806; Rahimi, Abbas; id_orcid0000-0003-3141-4970
Veröffentlicht in: Proceedings of the 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE), Ausgabe 4, 2019, ISBN 978-3-9819263-2-3
Herausgeber: IEEE
DOI: 10.3929/ethz-b-000307983

Towards Efficient Code Generation for Exposed Datapath Architectures

Autoren: Kanishkan Vadivel, Roel Jordans, Sander Stujik, Henk Corporaal, Pekka Jääskeläinen, Heikki Kultala
Veröffentlicht in: Proceedings of the 22nd International Workshop on Software and Compilers for Embedded Systems - SCOPES '19, 2019, Seite(n) 86-89, ISBN 9781-450367622
Herausgeber: ACM Press
DOI: 10.1145/3323439.3323990

CIM-SIM - Computation In Memory SIMuIator

Autoren: Ali BanaGozar, Kanishkan Vadivel, Sander Stuijk, Henk Corporaal, Stephan Wong, Muath Abu Lebdeh, Jintao Yu, Said Hamdioui
Veröffentlicht in: Proceedings of the 22nd International Workshop on Software and Compilers for Embedded Systems - SCOPES '19, 2019, Seite(n) 1-4, ISBN 9781-450367622
Herausgeber: ACM Press
DOI: 10.1145/3323439.3323989

Memristive devices for computation-in-memory

Autoren: Jintao Yu, Hoang Anh Du Nguyen, Lei Xie, Mottaqiallah Taouil, Said Hamdioui
Veröffentlicht in: 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2018, Seite(n) 1646-1651, ISBN 978-3-9819263-0-9
Herausgeber: IEEE
DOI: 10.23919/date.2018.8342278

A computation-in-memory accelerator based on resistive devices

Autoren: Hoang Anh Du Nguyen, Jintao Yu, Muath Abu Lebdeh, Mottaqiallah Taouil, Said Hamdioui
Veröffentlicht in: Proceedings of the International Symposium on Memory Systems - MEMSYS '19, 2019, Seite(n) 19-32, ISBN 9781-450372060
Herausgeber: ACM Press
DOI: 10.1145/3357526.3357554

Enhanced Scouting Logic: A Robust Memristive Logic Design Scheme

Autoren: Jintao Yu, Hoang Anh Du Nguyen, Muath Abu Lebdeh, Mottaqiallah Taouil, Said Hamdioui
Veröffentlicht in: 2019
Herausgeber: IEEE

A Time-Domain Current-Mode MAC Engine for Analogue Neural Networks in Flexible Electronics

Autoren: Matthew Douthwaite, Fernando Garcia-Redondo, Pantelis Georgiou, Shidhartha Das
Veröffentlicht in: 2019 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2019, Seite(n) 1-4, ISBN 978-1-5090-0617-5
Herausgeber: IEEE
DOI: 10.1109/BIOCAS.2019.8919190

Evolvable Hyperdimensional Computing: Unsupervised Regeneration of Associative Memory to Recover Faulty Components

Autoren: Hersche, Michael; id_orcid0000-0003-3065-7639; Sangalli, Sara; Benini, Luca; id_orcid0000-0001-8068-3806; Rahimi, Abbas; id_orcid0000-0003-3141-4970
Veröffentlicht in: 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS 2020), Ausgabe 2, 2020
Herausgeber: IEEE
DOI: 10.3929/ethz-b-000387115

Binary Models for Motor-Imagery Brain–Computer Interfaces: Sparse Random Projection and Binarized SVM

Autoren: Hersche, Michael; id_orcid0000-0003-3065-7639; Benini, Luca; id_orcid0000-0001-8068-3806; Rahimi, Abbas; id_orcid0000-0003-3141-4970
Veröffentlicht in: 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS 2020), Ausgabe 1, 2020
Herausgeber: IEEE
DOI: 10.3929/ethz-b-000387116

Compressing Subject-specific Brain–Computer Interface Models into One Model by Superposition in Hyperdimensional Space

Autoren: Hersche, Michael; id_orcid0000-0003-3065-7639; Rupp, Philipp; Benini, Luca; id_orcid0000-0001-8068-3806; Rahimi, Abbas; id_orcid0000-0003-3141-4970
Veröffentlicht in: Design, Automation and Test in Europe (DATE 2020), Ausgabe 1, 2020
Herausgeber: IEEE
DOI: 10.3929/ethz-b-000387117

Training DNN IoT Applications for Deployment On Analog NVM Crossbars

Autoren: Fernando Garcia-Redondo, Shidhartha Das, Glen Rosendale
Veröffentlicht in: 2020 International Joint Conference on Neural Networks (IJCNN), 2020, Seite(n) 1-8, ISBN 978-1-7281-6926-2
Herausgeber: IEEE
DOI: 10.1109/ijcnn48605.2020.9206822

Efficient Organization of Digital Periphery to Support Integer Datatype for Memristor-Based CIM

Autoren: Mahdi Zahedi, Mahta Mayahinia, Muath Abu Lebdeh, Stephan Wong, Said Hamdioui
Veröffentlicht in: 2020 IEEE Computer Society Annual Symposium on VLSI (ISVLSI), 2020, Seite(n) 216-221, ISBN 978-1-7281-5775-7
Herausgeber: IEEE
DOI: 10.1109/isvlsi49217.2020.00047

TC-CIM: Empowering Tensor Comprehensions for Computing-In-Memory

Autoren: A. Drebes, L. Chelini, O. Zinenko, A. Cohen, H. Corporaal, T. Grosser, K. Vadivel, N. Vasilache
Veröffentlicht in: Proceedings of 10th International Workshop on Polyhedral Compilation Techniques, 2020
Herausgeber: HiPEAC 2020

Book chapters (1)

System Simulation of Memristor Based Computation in Memory Platforms

Autoren: Ali BanaGozar, Kanishkan Vadivel, Joonas Multanen, Pekka Jääskeläinen, Sander Stuijk, Henk Corporaal
Veröffentlicht in: Embedded Computer Systems: Architectures, Modeling, and Simulation - 20th International Conference, SAMOS 2020, Samos, Greece, July 5–9, 2020, Proceedings, Ausgabe 12471, 2020, Seite(n) 152-168, ISBN 978-3-030-60938-2
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-030-60939-9_11

Other (1)

Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions

Autoren: Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen
Veröffentlicht in: Computing Research Repository (CoRR), 2018
Herausgeber: Cornell University