Optimization Online


Local Convergence of the Method of Multipliers for Variational and Optimization Problems under the Sole Noncriticality Assumption

A.F. Izmailov (izmaf***at***ccas.ru)
A.S. Kurennoy (alex-kurennoy***at***yandex.ru)
M.V. Solodov (solodov***at***impa.br)

Abstract: We present local convergence analysis of the method of multipliers for equality-constrained variational problems (in the special case of optimization, also called the augmented Lagrangian method) under the sole assumption that the dual starting point is close to a noncritical Lagrange multiplier (which is weaker than second-order sufficiency). Local superlinear convergence is established under the appropriate control of the penalty parameter values. For optimization problems, we demonstrate in addition local linear convergence for sufficiently large fixed penalty parameters. Both exact and inexact versions of the method are considered. Contributions with respect to previous state-of-the-art analyses for equality-constrained problems consist in the extension to the variational setting, in using the weaker noncriticality assumption instead of the usual second-order sufficient optimality condition, and in relaxing the smoothness requirements on the problem data. In the context of optimization problems, this gives the first local convergence results for the augmented Lagrangian method under the assumptions that do not include any constraint qualifications and are weaker than the second-order sufficient optimality condition. We also show that the analysis under the noncriticality assumption cannot be extended to the case with inequality constraints, unless the strict complementarity condition is added (this, however, still gives a new result).

Keywords: variational problem, Karush-Kuhn-Tucker system, augmented Lagrangian, method of multipliers, noncritical Lagrange multiplier, superlinear convergence, generalized Jacobian

Category 1: Nonlinear Optimization (Constrained Nonlinear Optimization )

Category 2: Complementarity and Variational Inequalities


Download: [PDF]

Entry Submitted: 08/19/2013
Entry Accepted: 08/19/2013
Entry Last Modified: 03/03/2014

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society