Mathematics > Optimization and Control
[Submitted on 14 May 2023 (v1), last revised 29 Apr 2024 (this version, v7)]
Title:Prox-DBRO-VR: A Unified Analysis on Decentralized Byzantine-Resilient Composite Stochastic Optimization with Variance Reduction and Non-Asymptotic Convergence Rates
View PDF HTML (experimental)Abstract:Decentralized stochastic gradient algorithms resolve efficiently large-scale finite-sum optimization problems when all agents over networks are reliable. However, most of these algorithms are not resilient to adverse conditions, such as malfunctioning agents, software bugs, and cyber attacks. This paper aims to handle a class of general composite finite-sum optimization problems over multi-agent cyber-physical systems (CPSs) in the presence of an unknown number of Byzantine agents. Based on the proximal mapping method, variance-reduced (VR) techniques, and a norm-penalized approximation strategy, we propose a decentralized Byzantine-resilient and proximal-gradient algorithmic framework, dubbed Prox-DBRO-VR,which achieves an optimization and control goal using only local computations and communications. To reduce asymptotically the variance generated by evaluating the local noisy stochastic gradients, we incorporate two localized VR techniques (SAGA and LSVRG) into Prox-DBRO-VR to design Prox-DBRO-SAGA and Prox-DBRO-LSVRG. By analyzing the contraction relationships among the gradient-learning error, robust consensus condition, and optimality gap in a unified theoretical framework, it is demonstrated that both Prox-DBRO-SAGA and Prox-DBRO-LSVRG,with a well-designed constant (resp., decaying) step-size, converge linearly (resp., sublinearly) inside an error ball around the optimal solution to the original problem under standard assumptions. The trade-off between convergence accuracy and the number of Byzantine agents in both linear and sub-linear cases is also characterized. In simulation, the effectiveness and practicability of the proposed algorithms are manifested via resolving a decentralized sparse machine-learning problem over multi-agent CPSs under various Byzantine attacks.
Submission history
From: Jinhui Hu [view email][v1] Sun, 14 May 2023 03:17:29 UTC (48 KB)
[v2] Sun, 21 May 2023 08:34:19 UTC (48 KB)
[v3] Wed, 20 Sep 2023 05:12:18 UTC (346 KB)
[v4] Fri, 3 Nov 2023 09:06:00 UTC (344 KB)
[v5] Mon, 27 Nov 2023 05:21:11 UTC (353 KB)
[v6] Tue, 12 Dec 2023 12:25:21 UTC (330 KB)
[v7] Mon, 29 Apr 2024 10:42:18 UTC (1,104 KB)
Current browse context:
math.OC
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.