Implementation of Ternary Weights With Resistive RAM Using a Single Sense Operation per Synapse - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Circuits and Systems I: Regular Papers Année : 2020

Implementation of Ternary Weights With Resistive RAM Using a Single Sense Operation per Synapse

Résumé

The design of systems implementing low precision neural networks with emerging memories such as resistive random access memory (RRAM) is a significant lead for reducing the energy consumption of artificial intelligence. To achieve maximum energy efficiency in such systems, logic and memory should be integrated as tightly as possible. In this work, we focus on the case of ternary neural networks, where synaptic weights assume ternary values. We propose a two-transistor/two-resistor memory architecture employing a precharge sense amplifier, where the weight value can be extracted in a single sense operation. Based on experimental measurements on a hybrid 130 nm CMOS/RRAM chip featuring this sense amplifier, we show that this technique is particularly appropriate at low supply voltage, and that it is resilient to process, voltage, and temperature variations. We characterize the bit error rate in our scheme. We show based on neural network simulation on the CIFAR-10 image recognition task that the use of ternary neural networks significantly increases neural network performance, with regards to binary ones, which are often preferred for inference hardware. We finally evidence that the neural network is immune to the type of bit errors observed in our scheme, which can therefore be used without error correction.
Fichier principal
Vignette du fichier
2007.14234.pdf (8.15 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02983778 , version 1 (30-10-2020)

Identifiants

Citer

Axel Laborieux, Marc Bocquet, Hirtzlin Tifenn, Jacques-Olivier Klein, Etienne Nowak, et al.. Implementation of Ternary Weights With Resistive RAM Using a Single Sense Operation per Synapse. IEEE Transactions on Circuits and Systems I: Regular Papers, 2020, pp.1-10. ⟨10.1109/TCSI.2020.3031627⟩. ⟨hal-02983778⟩
121 Consultations
84 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More