Optimization Online


Adaptive Augmented Lagrangian Methods: Algorithms and Practical Numerical Experience

Frank E. Curtis (frank.e.curtis***at***gmail.com)
Nicholas I. M. Gould (nick.gould***at***stfc.ac.uk)
Hao Jiang (hjiang13***at***jhu.edu)
Daniel P. Robinson (daniel.p.robinson***at***gmail.com)

Abstract: In this paper, we consider augmented Lagrangian (AL) algorithms for solving large-scale nonlinear optimization problems that execute adaptive strategies for updating the penalty parameter. Our work is motivated by the recently proposed adaptive AL trust region method by Curtis et al. [An adaptive augmented Lagrangian method for large-scale constrained optimization, Math. Program. 152 (2015), pp.201245.]. The first focal point of this paper is a new variant of the approach that employs a line search rather than a trust region strategy, where a critical algorithmic feature for the line search strategy is the use of convexified piecewise quadratic models of the AL function for computing the search directions. We prove global convergence guarantees for our line search algorithm that are on par with those for the previously proposed trust region method. A second focal point of this paper is the practical performance of the line search and trust region algorithm variants in Matlab software, as well as that of an adaptive penalty parameter updating strategy incorporated into the Lancelot software. We test these methods on problems from the CUTEst and COPS collections, as well as on challenging test problems related to optimal power flow. Our numerical experience suggests that the adaptive algorithms outperform traditional AL methods in terms of efficiency and reliability. As with traditional AL algorithms, the adaptive methods are matrix-free and thus represent a viable option for solving large-scale problems.

Keywords: nonlinear optimization, nonconvex optimization, large-scale optimization, augmented Lagrangians, matrix-free methods, steering methods

Category 1: Nonlinear Optimization

Category 2: Nonlinear Optimization (Constrained Nonlinear Optimization )

Citation: F. E. Curtis, N. I. M. Gould, H. Jiang, and D. P. Robinson. Adaptive Augmented Lagrangian Methods: Algorithms and Practical Numerical Experience. Optimization Methods and Software, 31(1):157-186, 2016.


Entry Submitted: 08/19/2014
Entry Accepted: 08/19/2014
Entry Last Modified: 01/02/2017

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society