- An Inexact Primal-Dual Smoothing Framework for Large-Scale Non-Bilinear Saddle Point Problems Thi Khanh Hien Le (thikhanhhien.leumons.ac.be) Renbo Zhao(renbozmit.edu) William Haskell(isehwbnus.edu.sg) Abstract: We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the primal oracle complexity, while it has competitive dual oracle complexity. In addition, we consider the situation where the primal-dual coupling term has a large number of component functions. To efficiently handle this situation, we develop a randomized version of our smoothing framework, which allows the primal and dual sub-problems in each iteration to be solved by randomized algorithms inexactly in expectation. The convergence of this framework is analyzed both in expectation and with high probability. In terms of the primal and dual oracle complexities, this framework significantly improves over its deterministic counterpart. As an important application, we adapt both frameworks for solving convex optimization problems with many functional constraints. To obtain an $\varepsilon$-optimal and $\varepsilon$-feasible solution, both frameworks achieve the best-known oracle complexities (in terms of their dependence on $\varepsilon$). Keywords: Non-bilinear saddle point problems, Inexact primal-dual smoothing, Convex optimization with functional constraints, Stochastic optimization, Large-scale optimization Category 1: Convex and Nonsmooth Optimization (Convex Optimization ) Citation: Download: [PDF]Entry Submitted: 05/07/2019Entry Accepted: 05/07/2019Entry Last Modified: 05/07/2019Modify/Update this entry Visitors Authors More about us Links Subscribe, Unsubscribe Digest Archive Search, Browse the Repository Submit Update Policies Coordinator's Board Classification Scheme Credits Give us feedback Optimization Journals, Sites, Societies Optimization Online is supported by the Mathematical Optmization Society.