A conjugate directions approach to improve the limited-memory BFGS method
Abstract: Simple modifiations of the limited-memory BFGS method (L-BFGS) for large scale unconstrained optimization are considered, which consist in corrections (derived from the idea of conjugate directions) of the used difference vectors, utilizing information from the preceding iteration. In case of quadratic objective functions, the improvement of convergence is the best one in some sense and all stored difference vectors are conjugate for unit stepsizes. Global convergence of algorithm is established for convex su±ciently smooth functions. Numerical experiments indicate that the new method often improves the L-BFGS method signifiantly.
Keywords: Unconstrained minimization, variable metric methods, limited-memory methods, the BFGS update, conjugate directions, numerical results
Category 1: Nonlinear Optimization
Category 2: Nonlinear Optimization (Unconstrained Optimization )
Citation: Technical report No. V 1120. Institute of Computer Science, Academy of Sciences of the Czech Republic, Pod vodarenskou Vezi 2, 182 07 Prague 8, Czech Republic. September 2011.
Entry Submitted: 08/08/2011
Modify/Update this entry
|Visitors||Authors||More about us||Links|
Search, Browse the Repository
Give us feedback
|Optimization Journals, Sites, Societies|