Rule refinement with recurrent neural networks

C. Lee Giles, Christian W. Omlin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

Recurrent neural networks can be trained to behave like deterministic finite-state automata (DFA's) and methods have been developed for extracting grammatical rules from trained networks. Using a simple method for inserting prior knowledge of a subset of the DFA state transitions into recurrent neural networks, we show that recurrent neural networks are able to perform rule refinement. The results from training a recurrent neural network to recognize a known non-trivial, randomly generated regular grammar show that not only do the networks preserve correct prior knowledge, but that they are able to correct through training inserted prior knowledge which was wrong. (By wrong, we mean that the inserted rules were not the ones in the randomly generated grammar.)

Original languageEnglish (US)
Title of host publication1993 IEEE International Conference on Neural Networks, ICNN 1993
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages801-806
Number of pages6
ISBN (Electronic)0780309995
DOIs
StatePublished - Jan 1 1993
EventIEEE International Conference on Neural Networks, ICNN 1993 - San Francisco, United States
Duration: Mar 28 1993Apr 1 1993

Publication series

NameIEEE International Conference on Neural Networks - Conference Proceedings
Volume1993-January
ISSN (Print)1098-7576

Other

OtherIEEE International Conference on Neural Networks, ICNN 1993
CountryUnited States
CitySan Francisco
Period3/28/934/1/93

Fingerprint

Recurrent neural networks
Finite automata

All Science Journal Classification (ASJC) codes

  • Software

Cite this

Giles, C. L., & Omlin, C. W. (1993). Rule refinement with recurrent neural networks. In 1993 IEEE International Conference on Neural Networks, ICNN 1993 (pp. 801-806). [298658] (IEEE International Conference on Neural Networks - Conference Proceedings; Vol. 1993-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICNN.1993.298658
Giles, C. Lee ; Omlin, Christian W. / Rule refinement with recurrent neural networks. 1993 IEEE International Conference on Neural Networks, ICNN 1993. Institute of Electrical and Electronics Engineers Inc., 1993. pp. 801-806 (IEEE International Conference on Neural Networks - Conference Proceedings).
@inproceedings{1a10cdb1946b4d7f87387e54a7c39e6a,
title = "Rule refinement with recurrent neural networks",
abstract = "Recurrent neural networks can be trained to behave like deterministic finite-state automata (DFA's) and methods have been developed for extracting grammatical rules from trained networks. Using a simple method for inserting prior knowledge of a subset of the DFA state transitions into recurrent neural networks, we show that recurrent neural networks are able to perform rule refinement. The results from training a recurrent neural network to recognize a known non-trivial, randomly generated regular grammar show that not only do the networks preserve correct prior knowledge, but that they are able to correct through training inserted prior knowledge which was wrong. (By wrong, we mean that the inserted rules were not the ones in the randomly generated grammar.)",
author = "Giles, {C. Lee} and Omlin, {Christian W.}",
year = "1993",
month = "1",
day = "1",
doi = "10.1109/ICNN.1993.298658",
language = "English (US)",
series = "IEEE International Conference on Neural Networks - Conference Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "801--806",
booktitle = "1993 IEEE International Conference on Neural Networks, ICNN 1993",
address = "United States",

}

Giles, CL & Omlin, CW 1993, Rule refinement with recurrent neural networks. in 1993 IEEE International Conference on Neural Networks, ICNN 1993., 298658, IEEE International Conference on Neural Networks - Conference Proceedings, vol. 1993-January, Institute of Electrical and Electronics Engineers Inc., pp. 801-806, IEEE International Conference on Neural Networks, ICNN 1993, San Francisco, United States, 3/28/93. https://doi.org/10.1109/ICNN.1993.298658

Rule refinement with recurrent neural networks. / Giles, C. Lee; Omlin, Christian W.

1993 IEEE International Conference on Neural Networks, ICNN 1993. Institute of Electrical and Electronics Engineers Inc., 1993. p. 801-806 298658 (IEEE International Conference on Neural Networks - Conference Proceedings; Vol. 1993-January).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Rule refinement with recurrent neural networks

AU - Giles, C. Lee

AU - Omlin, Christian W.

PY - 1993/1/1

Y1 - 1993/1/1

N2 - Recurrent neural networks can be trained to behave like deterministic finite-state automata (DFA's) and methods have been developed for extracting grammatical rules from trained networks. Using a simple method for inserting prior knowledge of a subset of the DFA state transitions into recurrent neural networks, we show that recurrent neural networks are able to perform rule refinement. The results from training a recurrent neural network to recognize a known non-trivial, randomly generated regular grammar show that not only do the networks preserve correct prior knowledge, but that they are able to correct through training inserted prior knowledge which was wrong. (By wrong, we mean that the inserted rules were not the ones in the randomly generated grammar.)

AB - Recurrent neural networks can be trained to behave like deterministic finite-state automata (DFA's) and methods have been developed for extracting grammatical rules from trained networks. Using a simple method for inserting prior knowledge of a subset of the DFA state transitions into recurrent neural networks, we show that recurrent neural networks are able to perform rule refinement. The results from training a recurrent neural network to recognize a known non-trivial, randomly generated regular grammar show that not only do the networks preserve correct prior knowledge, but that they are able to correct through training inserted prior knowledge which was wrong. (By wrong, we mean that the inserted rules were not the ones in the randomly generated grammar.)

UR - http://www.scopus.com/inward/record.url?scp=0002650755&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0002650755&partnerID=8YFLogxK

U2 - 10.1109/ICNN.1993.298658

DO - 10.1109/ICNN.1993.298658

M3 - Conference contribution

AN - SCOPUS:0002650755

T3 - IEEE International Conference on Neural Networks - Conference Proceedings

SP - 801

EP - 806

BT - 1993 IEEE International Conference on Neural Networks, ICNN 1993

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Giles CL, Omlin CW. Rule refinement with recurrent neural networks. In 1993 IEEE International Conference on Neural Networks, ICNN 1993. Institute of Electrical and Electronics Engineers Inc. 1993. p. 801-806. 298658. (IEEE International Conference on Neural Networks - Conference Proceedings). https://doi.org/10.1109/ICNN.1993.298658