Inexact best-response schemes for stochastic Nash games: Linear convergence and Iteration complexity analysis

Uday V. Shanbhag, Jong Shi Pang, Suvrajeet Sen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

We consider a subclass of N-player stochastic Nash games in which each player solves a parametrized stochastic optimization problem. In deterministic regimes, best response schemes have been shown to be convergent under a suitable spectral property associated with the proximal-response map. However, a direct application of this scheme to stochastic settings requires obtaining exact solutions to stochastic optimization problems at every step. Instead, we propose an inexact generalization of this scheme in which an inexact solution to the best response problem is computed where the player-specific inexactness sequence is assumed to be separable. Notably, this scheme is an implementable single-loop scheme that requires a fixed (but increasing) number of stochastic gradient steps to compute an inexact solution to the best response problem. On the basis of this framework, we make several contributions: (i) The presented inexact best-response scheme produces iterates that converge to the unique equilibrium in mean; (ii) Surprisingly, we show that the iterates converge at a prescribed linear rate with a prescribed constant rather than a sub-linear rate; and (iii) Finally, by assuming that an inexact solution is computed by a stochastic approximation scheme, the overall iteration complexity for computing an -Nash equilibrium less that O(√N/)2+δ where δ is a positive scalar. Additionally, we show that the upper bound of this effort is shown to be N=2).

Original languageEnglish (US)
Title of host publication2016 IEEE 55th Conference on Decision and Control, CDC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3591-3596
Number of pages6
ISBN (Electronic)9781509018376
DOIs
StatePublished - Dec 27 2016
Event55th IEEE Conference on Decision and Control, CDC 2016 - Las Vegas, United States
Duration: Dec 12 2016Dec 14 2016

Publication series

Name2016 IEEE 55th Conference on Decision and Control, CDC 2016

Other

Other55th IEEE Conference on Decision and Control, CDC 2016
Country/TerritoryUnited States
CityLas Vegas
Period12/12/1612/14/16

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Decision Sciences (miscellaneous)
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Inexact best-response schemes for stochastic Nash games: Linear convergence and Iteration complexity analysis'. Together they form a unique fingerprint.

Cite this