Turing equivalence of neural networks with second order connection weights

Guo Zheng Sun, Hsing Hen Chen, Yee Chun Lee, C. Lee Giles

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

It is widely acknowledged that in principle a potentially infinitely large neural network (either in number of neurons or in the precision of a single neural activity) could possess an equivalent computational power as a Turing machine. In the present work, the authors show such an equivalence of Turing machines to several explicitly constructed neural networks. It is proven that for any given Turing machine there exists a recurrent neural network with local, second-order, and uniformly connected weights (i.e., the weights connecting the second-order product of local 'input neurons' with their corresponding 'output neurons') which can simulate it. The numerical implementation and learning of such a neural Turing machine are also discussed.

Original languageEnglish (US)
Title of host publicationProceedings. IJCNN - International Joint Conference on Neural Networks
Editors Anon
PublisherPubl by IEEE
Pages357-362
Number of pages6
ISBN (Print)0780301641
StatePublished - Jan 1 1992
EventInternational Joint Conference on Neural Networks - IJCNN-91-Seattle - Seattle, WA, USA
Duration: Jul 8 1991Jul 12 1991

Publication series

NameProceedings. IJCNN - International Joint Conference on Neural Networks

Other

OtherInternational Joint Conference on Neural Networks - IJCNN-91-Seattle
CitySeattle, WA, USA
Period7/8/917/12/91

Fingerprint

Turing machines
Neurons
Neural networks
Recurrent neural networks

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Sun, G. Z., Chen, H. H., Lee, Y. C., & Giles, C. L. (1992). Turing equivalence of neural networks with second order connection weights. In Anon (Ed.), Proceedings. IJCNN - International Joint Conference on Neural Networks (pp. 357-362). (Proceedings. IJCNN - International Joint Conference on Neural Networks). Publ by IEEE.
Sun, Guo Zheng ; Chen, Hsing Hen ; Lee, Yee Chun ; Giles, C. Lee. / Turing equivalence of neural networks with second order connection weights. Proceedings. IJCNN - International Joint Conference on Neural Networks. editor / Anon. Publ by IEEE, 1992. pp. 357-362 (Proceedings. IJCNN - International Joint Conference on Neural Networks).
@inproceedings{d3683341123247818ad4ed49abcbd108,
title = "Turing equivalence of neural networks with second order connection weights",
abstract = "It is widely acknowledged that in principle a potentially infinitely large neural network (either in number of neurons or in the precision of a single neural activity) could possess an equivalent computational power as a Turing machine. In the present work, the authors show such an equivalence of Turing machines to several explicitly constructed neural networks. It is proven that for any given Turing machine there exists a recurrent neural network with local, second-order, and uniformly connected weights (i.e., the weights connecting the second-order product of local 'input neurons' with their corresponding 'output neurons') which can simulate it. The numerical implementation and learning of such a neural Turing machine are also discussed.",
author = "Sun, {Guo Zheng} and Chen, {Hsing Hen} and Lee, {Yee Chun} and Giles, {C. Lee}",
year = "1992",
month = "1",
day = "1",
language = "English (US)",
isbn = "0780301641",
series = "Proceedings. IJCNN - International Joint Conference on Neural Networks",
publisher = "Publ by IEEE",
pages = "357--362",
editor = "Anon",
booktitle = "Proceedings. IJCNN - International Joint Conference on Neural Networks",

}

Sun, GZ, Chen, HH, Lee, YC & Giles, CL 1992, Turing equivalence of neural networks with second order connection weights. in Anon (ed.), Proceedings. IJCNN - International Joint Conference on Neural Networks. Proceedings. IJCNN - International Joint Conference on Neural Networks, Publ by IEEE, pp. 357-362, International Joint Conference on Neural Networks - IJCNN-91-Seattle, Seattle, WA, USA, 7/8/91.

Turing equivalence of neural networks with second order connection weights. / Sun, Guo Zheng; Chen, Hsing Hen; Lee, Yee Chun; Giles, C. Lee.

Proceedings. IJCNN - International Joint Conference on Neural Networks. ed. / Anon. Publ by IEEE, 1992. p. 357-362 (Proceedings. IJCNN - International Joint Conference on Neural Networks).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Turing equivalence of neural networks with second order connection weights

AU - Sun, Guo Zheng

AU - Chen, Hsing Hen

AU - Lee, Yee Chun

AU - Giles, C. Lee

PY - 1992/1/1

Y1 - 1992/1/1

N2 - It is widely acknowledged that in principle a potentially infinitely large neural network (either in number of neurons or in the precision of a single neural activity) could possess an equivalent computational power as a Turing machine. In the present work, the authors show such an equivalence of Turing machines to several explicitly constructed neural networks. It is proven that for any given Turing machine there exists a recurrent neural network with local, second-order, and uniformly connected weights (i.e., the weights connecting the second-order product of local 'input neurons' with their corresponding 'output neurons') which can simulate it. The numerical implementation and learning of such a neural Turing machine are also discussed.

AB - It is widely acknowledged that in principle a potentially infinitely large neural network (either in number of neurons or in the precision of a single neural activity) could possess an equivalent computational power as a Turing machine. In the present work, the authors show such an equivalence of Turing machines to several explicitly constructed neural networks. It is proven that for any given Turing machine there exists a recurrent neural network with local, second-order, and uniformly connected weights (i.e., the weights connecting the second-order product of local 'input neurons' with their corresponding 'output neurons') which can simulate it. The numerical implementation and learning of such a neural Turing machine are also discussed.

UR - http://www.scopus.com/inward/record.url?scp=0026715336&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026715336&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0026715336

SN - 0780301641

T3 - Proceedings. IJCNN - International Joint Conference on Neural Networks

SP - 357

EP - 362

BT - Proceedings. IJCNN - International Joint Conference on Neural Networks

A2 - Anon, null

PB - Publ by IEEE

ER -

Sun GZ, Chen HH, Lee YC, Giles CL. Turing equivalence of neural networks with second order connection weights. In Anon, editor, Proceedings. IJCNN - International Joint Conference on Neural Networks. Publ by IEEE. 1992. p. 357-362. (Proceedings. IJCNN - International Joint Conference on Neural Networks).