Optimization Online


Unifying abstract inexact convergence theorems and block coordinate variable metric iPiano

Peter Ochs(ochs***at***math.uni-sb.de)

Abstract: An abstract convergence theorem for a class of generalized descent methods that explicitly models relative errors is proved. The convergence theorem generalizes and unifies several recent abstract convergence theorems. It is applicable to possibly non-smooth and non-convex lower semi-continuous functions that satisfy the Kurdyka--Lojasiewicz (KL) inequality, which comprises a huge class of problems. Most of the recent algorithms that explicitly prove convergence using the KL inequality can cast into the abstract framework in this paper and, therefore, the generated sequence converges to a stationary point of the objective function. Additional flexibility compared to related approaches is gained by a descent property that is formulated with respect to a function that is allowed to change along the iterations, a generic distance measure, and an explicit/implicit relative error condition with respect to finite linear combinations of distance terms. As an application of the gained flexibility, the convergence of a block coordinate variable metric version of iPiano (an inertial forward--backward splitting algorithm) is proved, which performs favorably on an inpainting problem with a Mumford--Shah-like regularization from image processing.

Keywords: abstract convergence theorem, Kurdyka--Lojasiewicz inequality, descent method, relative errors, block coordinate method, variable metric method, inertial method, iPiano, inpainting, Mumford--Shah regularizer

Category 1: Convex and Nonsmooth Optimization (Nonsmooth Optimization )

Citation: arXiv:1602.07283

Download: [PDF]

Entry Submitted: 11/21/2017
Entry Accepted: 11/21/2017
Entry Last Modified: 11/21/2017

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society