Optimization Online


Exploiting problem structure in derivative free optimization

Margherita Porcelli (margherita.porcelli***at***unibo.it)
Philippe L. Toint (philippe.toint***at***unamur.be)

Abstract: A structured version of derivative-free random pattern search optimization algorithms is introduced which is able to exploit coordinate partially separable structure (typically associated with sparsity) often present in unconstrained and bound-constrained optimization problems. This technique improves performance by orders of magnitude and makes it possible to solve large problems that otherwise are totally intractable by other derivative-free methods. A library of interpolation-based modelling tools is also described, which can be associated to the structured or unstructured versions of the initial pattern search algorithm. The use of the library further enhances performance, especially when associated with structure. The significant gains in performance associated with these two techniques are illustrated using a new freely-available release of the BFO (Brute Force Optimizer) package firstly introduced in [Porcelli,Toint, ACM TOMS, 2017], which incorporates them. An interesting conclusion of the numerical results presented is that providing global structural information on a problem can result in significantly less evaluations of the objective function than attempting to building local Taylor-like models.

Keywords: derivative-free optimization, direct-search methods, structured problems, interpolation models.

Category 1: Nonlinear Optimization

Category 2: Optimization Software and Modeling Systems

Citation: M. Porcelli and Ph. L. Toint, "Exploiting problem structure in derivative free optimization", arXiv:2001.04801, 2020.

Download: [PDF]

Entry Submitted: 01/15/2020
Entry Accepted: 01/15/2020
Entry Last Modified: 01/12/2021

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society