### Abstract

Recurrent neural networks are a natural model for learning and predicting temporal signals.In addition simple recurrent networks have been shown to be both theoretically and experimentally capable of learning finite state automata. However it is difficult to determine what is the minimal neural network structure for a particular automation. Using a large recurrent network, which would be versatile in theory in practice proves to be very difficult to train. Constructive or destructive recurrent methods might offer a solution to this problem. We prove that one current method. Recurrent cascade correlation has fundamental limitations in representation and thus in its learning capabilities. We give a preliminary approach on how to get around these limitation by devising a ″Simple″ constructive training method that adds neurons during training while still preserving the powerful fully recurrent structure. Through simulations we show that such a method can learn many types of regular grammars that the Recurrent Cascade Correlation method is unable to learn.

Original language | English (US) |
---|---|

Title of host publication | 1993 IEEE International Conference on Neural Networks |

Publisher | Publ by IEEE |

Pages | 1192-1201 |

Number of pages | 10 |

ISBN (Print) | 0780312007 |

State | Published - Jan 1 1993 |

Event | 1993 IEEE International Conference on Neural Networks - San Francisco, California, USA Duration: Mar 28 1993 → Apr 1 1993 |

### Publication series

Name | 1993 IEEE International Conference on Neural Networks |
---|

### Other

Other | 1993 IEEE International Conference on Neural Networks |
---|---|

City | San Francisco, California, USA |

Period | 3/28/93 → 4/1/93 |

### All Science Journal Classification (ASJC) codes

- Engineering(all)

## Fingerprint Dive into the research topics of 'Constructive learning of recurrent neural network'. Together they form a unique fingerprint.

## Cite this

*1993 IEEE International Conference on Neural Networks*(pp. 1192-1201). (1993 IEEE International Conference on Neural Networks). Publ by IEEE.