Adaptive stochastic cellular automata: Applications

S. Qian, Y. C. Lee, R. D. Jones, C. W. Barnes, G. W. Flake, M. K. O'Rourke, K. Lee, H. H. Chen, G. Z. Sun, Y. Q. Zhang, D. Chen, C. L. Giles

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

The stochastic learning cellular automata model has been applied to the problem of controlling unstable systems. Two example unstable systems studied are controlled by an adaptive stochastic cellular automata algorithm with an adaptive critic. The reinforcement learning algorithm and the architecture of the stochastic CA controller are presented. Learning to balance a single pole is discussed in detail. Balancing an inverted double pendulum highlights the power of the stochastic CA approach. The stochastic CA model is compared to conventional adaptive control and artificial neural network approaches.

Original languageEnglish (US)
Pages (from-to)181-188
Number of pages8
JournalPhysica D: Nonlinear Phenomena
Volume45
Issue number1-3
DOIs
StatePublished - Sep 2 1990

Fingerprint

cellular automata
learning
adaptive control
pendulums
reinforcement
controllers
poles

All Science Journal Classification (ASJC) codes

  • Statistical and Nonlinear Physics
  • Mathematical Physics
  • Condensed Matter Physics
  • Applied Mathematics

Cite this

Qian, S., Lee, Y. C., Jones, R. D., Barnes, C. W., Flake, G. W., O'Rourke, M. K., ... Giles, C. L. (1990). Adaptive stochastic cellular automata: Applications. Physica D: Nonlinear Phenomena, 45(1-3), 181-188. https://doi.org/10.1016/0167-2789(90)90181-N
Qian, S. ; Lee, Y. C. ; Jones, R. D. ; Barnes, C. W. ; Flake, G. W. ; O'Rourke, M. K. ; Lee, K. ; Chen, H. H. ; Sun, G. Z. ; Zhang, Y. Q. ; Chen, D. ; Giles, C. L. / Adaptive stochastic cellular automata : Applications. In: Physica D: Nonlinear Phenomena. 1990 ; Vol. 45, No. 1-3. pp. 181-188.
@article{f7cecc94aa6143098e4281e78ac459c3,
title = "Adaptive stochastic cellular automata: Applications",
abstract = "The stochastic learning cellular automata model has been applied to the problem of controlling unstable systems. Two example unstable systems studied are controlled by an adaptive stochastic cellular automata algorithm with an adaptive critic. The reinforcement learning algorithm and the architecture of the stochastic CA controller are presented. Learning to balance a single pole is discussed in detail. Balancing an inverted double pendulum highlights the power of the stochastic CA approach. The stochastic CA model is compared to conventional adaptive control and artificial neural network approaches.",
author = "S. Qian and Lee, {Y. C.} and Jones, {R. D.} and Barnes, {C. W.} and Flake, {G. W.} and O'Rourke, {M. K.} and K. Lee and Chen, {H. H.} and Sun, {G. Z.} and Zhang, {Y. Q.} and D. Chen and Giles, {C. L.}",
year = "1990",
month = "9",
day = "2",
doi = "10.1016/0167-2789(90)90181-N",
language = "English (US)",
volume = "45",
pages = "181--188",
journal = "Physica D: Nonlinear Phenomena",
issn = "0167-2789",
publisher = "Elsevier",
number = "1-3",

}

Qian, S, Lee, YC, Jones, RD, Barnes, CW, Flake, GW, O'Rourke, MK, Lee, K, Chen, HH, Sun, GZ, Zhang, YQ, Chen, D & Giles, CL 1990, 'Adaptive stochastic cellular automata: Applications', Physica D: Nonlinear Phenomena, vol. 45, no. 1-3, pp. 181-188. https://doi.org/10.1016/0167-2789(90)90181-N

Adaptive stochastic cellular automata : Applications. / Qian, S.; Lee, Y. C.; Jones, R. D.; Barnes, C. W.; Flake, G. W.; O'Rourke, M. K.; Lee, K.; Chen, H. H.; Sun, G. Z.; Zhang, Y. Q.; Chen, D.; Giles, C. L.

In: Physica D: Nonlinear Phenomena, Vol. 45, No. 1-3, 02.09.1990, p. 181-188.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Adaptive stochastic cellular automata

T2 - Applications

AU - Qian, S.

AU - Lee, Y. C.

AU - Jones, R. D.

AU - Barnes, C. W.

AU - Flake, G. W.

AU - O'Rourke, M. K.

AU - Lee, K.

AU - Chen, H. H.

AU - Sun, G. Z.

AU - Zhang, Y. Q.

AU - Chen, D.

AU - Giles, C. L.

PY - 1990/9/2

Y1 - 1990/9/2

N2 - The stochastic learning cellular automata model has been applied to the problem of controlling unstable systems. Two example unstable systems studied are controlled by an adaptive stochastic cellular automata algorithm with an adaptive critic. The reinforcement learning algorithm and the architecture of the stochastic CA controller are presented. Learning to balance a single pole is discussed in detail. Balancing an inverted double pendulum highlights the power of the stochastic CA approach. The stochastic CA model is compared to conventional adaptive control and artificial neural network approaches.

AB - The stochastic learning cellular automata model has been applied to the problem of controlling unstable systems. Two example unstable systems studied are controlled by an adaptive stochastic cellular automata algorithm with an adaptive critic. The reinforcement learning algorithm and the architecture of the stochastic CA controller are presented. Learning to balance a single pole is discussed in detail. Balancing an inverted double pendulum highlights the power of the stochastic CA approach. The stochastic CA model is compared to conventional adaptive control and artificial neural network approaches.

UR - http://www.scopus.com/inward/record.url?scp=0348174661&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0348174661&partnerID=8YFLogxK

U2 - 10.1016/0167-2789(90)90181-N

DO - 10.1016/0167-2789(90)90181-N

M3 - Article

AN - SCOPUS:0348174661

VL - 45

SP - 181

EP - 188

JO - Physica D: Nonlinear Phenomena

JF - Physica D: Nonlinear Phenomena

SN - 0167-2789

IS - 1-3

ER -

Qian S, Lee YC, Jones RD, Barnes CW, Flake GW, O'Rourke MK et al. Adaptive stochastic cellular automata: Applications. Physica D: Nonlinear Phenomena. 1990 Sep 2;45(1-3):181-188. https://doi.org/10.1016/0167-2789(90)90181-N