TY - JOUR
T1 - Randomized Gossiping With Effective Resistance Weights
T2 - Performance Guarantees and Applications
AU - Can, Bugra
AU - Soori, Saeed
AU - Aybat, Necdet Serhat
AU - Dehnavi, Maryam Mehri
AU - Gurbuzbalaban, Mert
N1 - Funding Information:
The work of Bugra Can and Mert Gurbuzbalaban was supported in part by the Office of Naval Research Award under Grant N00014-21-1-2244, and in part by National Science Foundation (NSF) under Grant CCF-1814888, Grant NSF DMS-2053485, and Grant NSF DMS-1723085. The work of Necdet Serhat Aybat was supported by the Office of Naval Research under Grant N00014-21-1-2271 and in part by National Science Foundation under Grant CMMI-1635106.
Publisher Copyright:
© 2014 IEEE.
PY - 2022/6/1
Y1 - 2022/6/1
N2 - The effective resistance (ER) between a pair of nodes in a weighted undirected graph is defined as the potential difference induced when a unit current is injected at one node and extracted from the other, treating edge weights as the conductance values of edges. The ER is a key quantity of interest in many applications, e.g., solving linear systems, Markov chains, and continuous-time averaging networks. In this article, we consider ERs in the context of designing randomized gossiping methods for the consensus problem, where the aim is to compute the average of node values in a distributed manner through iteratively computing weighted averages among randomly chosen neighbors. For barbell graphs, we prove that choosing wake-up and communication probabilities proportional to ER weights improves the averaging time corresponding to the traditional choice of uniform weights. For c-barbell graphs, we show that ER weights admit lower and upper bounds on the averaging time that improves upon the lower and upper bounds available for uniform weights. Furthermore, for graphs with a small diameter, we can show that ER weights can improve upon the existing bounds for Metropolis weights by a constant factor under some assumptions. We illustrate these results through numerical experiments, where we showcase the efficiency of our approach on several graph topologies, including barbell and small-world graphs. We also present an application of ER gossiping to distributed optimization: we numerically verify that using ER gossiping within EXTRA and DPGA-W methods improves their practical performance in terms of communication efficiency.
AB - The effective resistance (ER) between a pair of nodes in a weighted undirected graph is defined as the potential difference induced when a unit current is injected at one node and extracted from the other, treating edge weights as the conductance values of edges. The ER is a key quantity of interest in many applications, e.g., solving linear systems, Markov chains, and continuous-time averaging networks. In this article, we consider ERs in the context of designing randomized gossiping methods for the consensus problem, where the aim is to compute the average of node values in a distributed manner through iteratively computing weighted averages among randomly chosen neighbors. For barbell graphs, we prove that choosing wake-up and communication probabilities proportional to ER weights improves the averaging time corresponding to the traditional choice of uniform weights. For c-barbell graphs, we show that ER weights admit lower and upper bounds on the averaging time that improves upon the lower and upper bounds available for uniform weights. Furthermore, for graphs with a small diameter, we can show that ER weights can improve upon the existing bounds for Metropolis weights by a constant factor under some assumptions. We illustrate these results through numerical experiments, where we showcase the efficiency of our approach on several graph topologies, including barbell and small-world graphs. We also present an application of ER gossiping to distributed optimization: we numerically verify that using ER gossiping within EXTRA and DPGA-W methods improves their practical performance in terms of communication efficiency.
UR - http://www.scopus.com/inward/record.url?scp=85127053001&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85127053001&partnerID=8YFLogxK
U2 - 10.1109/TCNS.2022.3161201
DO - 10.1109/TCNS.2022.3161201
M3 - Article
AN - SCOPUS:85127053001
SN - 2325-5870
VL - 9
SP - 524
EP - 536
JO - IEEE Transactions on Control of Network Systems
JF - IEEE Transactions on Control of Network Systems
IS - 2
ER -