Hebbian learning with winner take all for spiking neural networks

Ankur Gupta, Lyle Norman Long

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Citations (Scopus)

Abstract

Learning methods for spiking neural networks are not as well developed as the traditional rate based networks, which widely use the back-propagation learning algorithm. We propose and implement an efficient Hebbian learning method with homeostasis for a network of spiking neurons. Similar to STDP, timing between spikes is used for synaptic modification. Homeostasis ensures that the synaptic weights are bounded and the learning is stable. The winner take all mechanism is also implemented to promote competitive learning among output neurons. We have implemented this method in a C++ object oriented code (called CSpike). We have tested the code on four images of Gabor filters and found bell-shaped tuning curves using 36 test set images of Gabor filters in different orientations. These bell-shapes curves are similar to those experimentally observed in the VI and MT/V5 area of the mammalian brain.

Original languageEnglish (US)
Title of host publication2009 International Joint Conference on Neural Networks, IJCNN 2009
Pages1054-1060
Number of pages7
DOIs
StatePublished - Nov 18 2009
Event2009 International Joint Conference on Neural Networks, IJCNN 2009 - Atlanta, GA, United States
Duration: Jun 14 2009Jun 19 2009

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Other

Other2009 International Joint Conference on Neural Networks, IJCNN 2009
CountryUnited States
CityAtlanta, GA
Period6/14/096/19/09

Fingerprint

Gabor filters
Neurons
Neural networks
Backpropagation
Learning algorithms
Brain
Tuning

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence

Cite this

Gupta, A., & Long, L. N. (2009). Hebbian learning with winner take all for spiking neural networks. In 2009 International Joint Conference on Neural Networks, IJCNN 2009 (pp. 1054-1060). [5178751] (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2009.5178751
Gupta, Ankur ; Long, Lyle Norman. / Hebbian learning with winner take all for spiking neural networks. 2009 International Joint Conference on Neural Networks, IJCNN 2009. 2009. pp. 1054-1060 (Proceedings of the International Joint Conference on Neural Networks).
@inproceedings{f0b2c9dac25c4cebbcab50bc4b3dee04,
title = "Hebbian learning with winner take all for spiking neural networks",
abstract = "Learning methods for spiking neural networks are not as well developed as the traditional rate based networks, which widely use the back-propagation learning algorithm. We propose and implement an efficient Hebbian learning method with homeostasis for a network of spiking neurons. Similar to STDP, timing between spikes is used for synaptic modification. Homeostasis ensures that the synaptic weights are bounded and the learning is stable. The winner take all mechanism is also implemented to promote competitive learning among output neurons. We have implemented this method in a C++ object oriented code (called CSpike). We have tested the code on four images of Gabor filters and found bell-shaped tuning curves using 36 test set images of Gabor filters in different orientations. These bell-shapes curves are similar to those experimentally observed in the VI and MT/V5 area of the mammalian brain.",
author = "Ankur Gupta and Long, {Lyle Norman}",
year = "2009",
month = "11",
day = "18",
doi = "10.1109/IJCNN.2009.5178751",
language = "English (US)",
isbn = "9781424435531",
series = "Proceedings of the International Joint Conference on Neural Networks",
pages = "1054--1060",
booktitle = "2009 International Joint Conference on Neural Networks, IJCNN 2009",

}

Gupta, A & Long, LN 2009, Hebbian learning with winner take all for spiking neural networks. in 2009 International Joint Conference on Neural Networks, IJCNN 2009., 5178751, Proceedings of the International Joint Conference on Neural Networks, pp. 1054-1060, 2009 International Joint Conference on Neural Networks, IJCNN 2009, Atlanta, GA, United States, 6/14/09. https://doi.org/10.1109/IJCNN.2009.5178751

Hebbian learning with winner take all for spiking neural networks. / Gupta, Ankur; Long, Lyle Norman.

2009 International Joint Conference on Neural Networks, IJCNN 2009. 2009. p. 1054-1060 5178751 (Proceedings of the International Joint Conference on Neural Networks).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Hebbian learning with winner take all for spiking neural networks

AU - Gupta, Ankur

AU - Long, Lyle Norman

PY - 2009/11/18

Y1 - 2009/11/18

N2 - Learning methods for spiking neural networks are not as well developed as the traditional rate based networks, which widely use the back-propagation learning algorithm. We propose and implement an efficient Hebbian learning method with homeostasis for a network of spiking neurons. Similar to STDP, timing between spikes is used for synaptic modification. Homeostasis ensures that the synaptic weights are bounded and the learning is stable. The winner take all mechanism is also implemented to promote competitive learning among output neurons. We have implemented this method in a C++ object oriented code (called CSpike). We have tested the code on four images of Gabor filters and found bell-shaped tuning curves using 36 test set images of Gabor filters in different orientations. These bell-shapes curves are similar to those experimentally observed in the VI and MT/V5 area of the mammalian brain.

AB - Learning methods for spiking neural networks are not as well developed as the traditional rate based networks, which widely use the back-propagation learning algorithm. We propose and implement an efficient Hebbian learning method with homeostasis for a network of spiking neurons. Similar to STDP, timing between spikes is used for synaptic modification. Homeostasis ensures that the synaptic weights are bounded and the learning is stable. The winner take all mechanism is also implemented to promote competitive learning among output neurons. We have implemented this method in a C++ object oriented code (called CSpike). We have tested the code on four images of Gabor filters and found bell-shaped tuning curves using 36 test set images of Gabor filters in different orientations. These bell-shapes curves are similar to those experimentally observed in the VI and MT/V5 area of the mammalian brain.

UR - http://www.scopus.com/inward/record.url?scp=70449421908&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70449421908&partnerID=8YFLogxK

U2 - 10.1109/IJCNN.2009.5178751

DO - 10.1109/IJCNN.2009.5178751

M3 - Conference contribution

AN - SCOPUS:70449421908

SN - 9781424435531

T3 - Proceedings of the International Joint Conference on Neural Networks

SP - 1054

EP - 1060

BT - 2009 International Joint Conference on Neural Networks, IJCNN 2009

ER -

Gupta A, Long LN. Hebbian learning with winner take all for spiking neural networks. In 2009 International Joint Conference on Neural Networks, IJCNN 2009. 2009. p. 1054-1060. 5178751. (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2009.5178751