Abstract
Spiking neural network (SNN) system that uses rank order coding (ROC) as input spike encoding, generally suffers from low recognition accuracy and unnecessary computations that increase complexities. In this paper, we present a Spiking convolutional neural network (Spiking CNN) architecture that significantly improves recognition accuracy as well as computation efficiencies based on a novel ROC and modified kernel sizes. The proposed ROC generates spike trains based on maximum input value without sorting operations. In addition, as the recognition accuracy is affected by the reduced number of spikes as layers become deeper, the proposed ROC is inserted just before the final layer to increase the number of input spikes. The 2 × 2 pooling kernels are also replaced with 4 × 4 to reduce the network size. The hardware architecture of the proposed Spiking CNN has been implemented using 65 nm CMOS process. Neuron-centric membrane voltage update approach is also efficiently exploited in convolutional and fully connected layers to improve the hardware energy efficiencies. The Spiking CNN processor is seamlessly processing 2.85 K classifications per second with 6.79 uJ/classification. It also achieves 90.2% of recognition accuracy for MNIST dataset using unsupervised learning with STDP.
Original language | English |
---|---|
Pages (from-to) | 300-312 |
Number of pages | 13 |
Journal | Neurocomputing |
Volume | 407 |
DOIs | |
Publication status | Published - 2020 Sept 24 |
Bibliographical note
Funding Information:This work was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program ( IITP-2020-2018-0-01433 ) supervised by the IITP (Institute for Information & communications Technology Promotion) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (NRF-2020R1A2C3014820) and the Industrial Strategic Technology Development Program (10077445 , Development of SoC technology based on Spiking Neural Cell for smart mobile and IoT Devices) funded By the Ministry of Trade, Industry & Energy( MOTIE , Korea).
Funding Information:
This work was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2018-0-01433) supervised by the IITP (Institute for Information & communications Technology Promotion) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (NRF-2020R1A2C3014820) and the Industrial Strategic Technology Development Program(10077445, Development of SoC technology based on Spiking Neural Cell for smart mobile and IoT Devices) funded By the Ministry of Trade, Industry & Energy(MOTIE, Korea).
Publisher Copyright:
© 2020 Elsevier B.V.
Keywords
- MNIST
- Neuromorphic
- Rank order coding
- Spike-timing dependent plasticity
- Spiking neural network
- Unsupervised learning
ASJC Scopus subject areas
- Computer Science Applications
- Cognitive Neuroscience
- Artificial Intelligence