Learning chaotic attractors by neural networks

Rembrandt Bakker, Jaap C. Schouten, C. Lee Giles, Floris Takens, Cor M. Van den Bleek

Research output: Contribution to journalArticle

60 Citations (Scopus)

Abstract

An algorithm is introduced that trains a neural network to identify chaotic dynamics from a single measured time series. During training, the algorithm learns to short-term predict the time series. At the same time a criterion, developed by Diks, van Zwet, Takens, and de Goede (1996) is monitored that tests the hypothesis that the reconstructed attractors of model-generated and measured data are the same. Training is stopped when the prediction error is low and the model passes this test. Two other features of the algorithm are (1) the way the state of the system, consisting of delays from the time series, has its dimension reduced by weighted principal component analysis data reduction, and (2) the user-adjustable prediction horizon obtained by "error propagation" - partially propagating prediction errors to the next time step. The algorithm is first applied to data from an experimental-driven chaotic pendulum, of which two of the three state variables are known. This is a comprehensive example that shows how well the Diks test can distinguish between slightly different attractors. Second, the algorithm is applied to the same problem, but now one of the two known state variables is ignored. Finally, we present a model for the laser data from the Santa Fe time-series competition (set A). It is the first model for these data that is not only useful for short-term predictions but also generates time series with similar chaotic characteristics as the measured data.

Original languageEnglish (US)
Pages (from-to)2355-2383
Number of pages29
JournalNeural Computation
Volume12
Issue number10
DOIs
StatePublished - Jan 1 2000

Fingerprint

Learning
Principal Component Analysis
Neural Networks
Attractor
Lasers
Prediction

All Science Journal Classification (ASJC) codes

  • Arts and Humanities (miscellaneous)
  • Cognitive Neuroscience

Cite this

Bakker, R., Schouten, J. C., Lee Giles, C., Takens, F., & Van den Bleek, C. M. (2000). Learning chaotic attractors by neural networks. Neural Computation, 12(10), 2355-2383. https://doi.org/10.1162/089976600300014971
Bakker, Rembrandt ; Schouten, Jaap C. ; Lee Giles, C. ; Takens, Floris ; Van den Bleek, Cor M. / Learning chaotic attractors by neural networks. In: Neural Computation. 2000 ; Vol. 12, No. 10. pp. 2355-2383.
@article{777f99ed2f3b43ba9c34b6796110c34c,
title = "Learning chaotic attractors by neural networks",
abstract = "An algorithm is introduced that trains a neural network to identify chaotic dynamics from a single measured time series. During training, the algorithm learns to short-term predict the time series. At the same time a criterion, developed by Diks, van Zwet, Takens, and de Goede (1996) is monitored that tests the hypothesis that the reconstructed attractors of model-generated and measured data are the same. Training is stopped when the prediction error is low and the model passes this test. Two other features of the algorithm are (1) the way the state of the system, consisting of delays from the time series, has its dimension reduced by weighted principal component analysis data reduction, and (2) the user-adjustable prediction horizon obtained by {"}error propagation{"} - partially propagating prediction errors to the next time step. The algorithm is first applied to data from an experimental-driven chaotic pendulum, of which two of the three state variables are known. This is a comprehensive example that shows how well the Diks test can distinguish between slightly different attractors. Second, the algorithm is applied to the same problem, but now one of the two known state variables is ignored. Finally, we present a model for the laser data from the Santa Fe time-series competition (set A). It is the first model for these data that is not only useful for short-term predictions but also generates time series with similar chaotic characteristics as the measured data.",
author = "Rembrandt Bakker and Schouten, {Jaap C.} and {Lee Giles}, C. and Floris Takens and {Van den Bleek}, {Cor M.}",
year = "2000",
month = "1",
day = "1",
doi = "10.1162/089976600300014971",
language = "English (US)",
volume = "12",
pages = "2355--2383",
journal = "Neural Computation",
issn = "0899-7667",
publisher = "MIT Press Journals",
number = "10",

}

Bakker, R, Schouten, JC, Lee Giles, C, Takens, F & Van den Bleek, CM 2000, 'Learning chaotic attractors by neural networks', Neural Computation, vol. 12, no. 10, pp. 2355-2383. https://doi.org/10.1162/089976600300014971

Learning chaotic attractors by neural networks. / Bakker, Rembrandt; Schouten, Jaap C.; Lee Giles, C.; Takens, Floris; Van den Bleek, Cor M.

In: Neural Computation, Vol. 12, No. 10, 01.01.2000, p. 2355-2383.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Learning chaotic attractors by neural networks

AU - Bakker, Rembrandt

AU - Schouten, Jaap C.

AU - Lee Giles, C.

AU - Takens, Floris

AU - Van den Bleek, Cor M.

PY - 2000/1/1

Y1 - 2000/1/1

N2 - An algorithm is introduced that trains a neural network to identify chaotic dynamics from a single measured time series. During training, the algorithm learns to short-term predict the time series. At the same time a criterion, developed by Diks, van Zwet, Takens, and de Goede (1996) is monitored that tests the hypothesis that the reconstructed attractors of model-generated and measured data are the same. Training is stopped when the prediction error is low and the model passes this test. Two other features of the algorithm are (1) the way the state of the system, consisting of delays from the time series, has its dimension reduced by weighted principal component analysis data reduction, and (2) the user-adjustable prediction horizon obtained by "error propagation" - partially propagating prediction errors to the next time step. The algorithm is first applied to data from an experimental-driven chaotic pendulum, of which two of the three state variables are known. This is a comprehensive example that shows how well the Diks test can distinguish between slightly different attractors. Second, the algorithm is applied to the same problem, but now one of the two known state variables is ignored. Finally, we present a model for the laser data from the Santa Fe time-series competition (set A). It is the first model for these data that is not only useful for short-term predictions but also generates time series with similar chaotic characteristics as the measured data.

AB - An algorithm is introduced that trains a neural network to identify chaotic dynamics from a single measured time series. During training, the algorithm learns to short-term predict the time series. At the same time a criterion, developed by Diks, van Zwet, Takens, and de Goede (1996) is monitored that tests the hypothesis that the reconstructed attractors of model-generated and measured data are the same. Training is stopped when the prediction error is low and the model passes this test. Two other features of the algorithm are (1) the way the state of the system, consisting of delays from the time series, has its dimension reduced by weighted principal component analysis data reduction, and (2) the user-adjustable prediction horizon obtained by "error propagation" - partially propagating prediction errors to the next time step. The algorithm is first applied to data from an experimental-driven chaotic pendulum, of which two of the three state variables are known. This is a comprehensive example that shows how well the Diks test can distinguish between slightly different attractors. Second, the algorithm is applied to the same problem, but now one of the two known state variables is ignored. Finally, we present a model for the laser data from the Santa Fe time-series competition (set A). It is the first model for these data that is not only useful for short-term predictions but also generates time series with similar chaotic characteristics as the measured data.

UR - http://www.scopus.com/inward/record.url?scp=0034297914&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034297914&partnerID=8YFLogxK

U2 - 10.1162/089976600300014971

DO - 10.1162/089976600300014971

M3 - Article

C2 - 11032038

AN - SCOPUS:0034297914

VL - 12

SP - 2355

EP - 2383

JO - Neural Computation

JF - Neural Computation

SN - 0899-7667

IS - 10

ER -

Bakker R, Schouten JC, Lee Giles C, Takens F, Van den Bleek CM. Learning chaotic attractors by neural networks. Neural Computation. 2000 Jan 1;12(10):2355-2383. https://doi.org/10.1162/089976600300014971