Nonlinear Optimization Submissions  2021
December 2021
Graph topology invariant gradient and sampling complexity for decentralized and stochastic optimization
Guanghui Lan, Yuyuan Ouyang, Yi Zhou
January 2021
Exponential Decay of Sensitivity in GraphStructured Nonlinear Programs
Sungho Shin, Mihai Anitescu, Victor Zavala
Constrained Nonlinear Optimization
A MatrixFree TrustRegion Newton Algorithm for ConvexConstrained Optimization
Drew P. Kouri
Constrained Nonlinear Optimization
ALESQP: An augmented Lagrangian equalityconstrained SQP method for optimization with general constraints
Harbir Antil, Drew P. Kouri, Denis Ridzal
Quadratic Programming
New notions of simultaneous diagonalizability of quadratic forms with applications to QCQPs
Alex L. Wang, Rujun Jiang
February 2021
Implicit Regularization of SubGradient Method in Robust Matrix Recovery: Don't be Afraid of Outliers
Jianhao Ma, Salar Fattahi
Quadratic Programming
Cutting Plane Generation Through Sparse Principal Component Analysis
Santanu S. Dey, Aleksandr M. Kazachkov, Andrea Lodi, Gonzalo Muńoz
Scalable Subspace Methods for DerivativeFree Nonlinear LeastSquares Optimization
Coralia Cartis, Lindon Roberts
An inexact successive quadratic approximation method for a class of differenceofconvex optimization problems
Tianxiang Liu, Akiko Takeda
DirectSearch for a Class of Stochastic MinMax Problems
Sotiris Anagnostidis, Aurelien Lucchi, Youssef Diouane
On the Numerical Performance of DerivativeFree Optimization Methods Based on FiniteDifference Approximations
HaoJun Shi, Melody Xuan, Figen Oztoprak, Jorge Nocedal
March 2021
Constrained Nonlinear Optimization
A Framework of Inertial Alternating Direction Method of Multipliers for \NonConvex NonSmooth Optimization
Le Thi Khanh Hien, Duy Nhat Phan, Nicolas Gillis
Constrained Nonlinear Optimization
A Penaltyfree Infeasible Approach for a Class of Nonsmooth Opimtization Problems over the Stiefel Manifold
Nachuan Xiao, Xin Liu, Yaxiang Yuan
Constrained Nonlinear Optimization
Activeset identification with complexity guarantees of an almost cyclic 2coordinate descent method with Armijo line search
Andrea Cristofari
Use of static surrogates in hyperparameter optimization
Dounia Lakhmiri, Sébastien Le Digabel
Global convergence of Riemannian line search methods with a ZhangHagertype condition
Harry Oviedo
Unconstrained Optimization
Further developments of methods for traversing regions of nonconvexity in optimization problems
Michael BartholomewBiggs, Salah Beddiaf, Bruce Christianson
Fast cluster detection in networks by firstorder optimization
Immanuel Bomze, Francesco Rinaldi, Damiano Zeffiro
Boundconstrained Optimization
Complexity of Projected Newton Methods for Boundconstrained Optimization
Yue Xie, Stephen Wright
Unconstrained Optimization
Scalable adaptive cubic regularization methods
JeanPierre Dussault, Dominique Orban
April 2021
Algorithms for DifferenceofConvex (DC) Programs Based on DifferenceofMoreauEnvelopes Smoothing
Kaizhao Sun, Xu Andy Sun
Unconstrained Optimization
Hölder Gradient Descent and Adaptive Regularization Methods in Banach Spaces for FirstOrder Points
Serge Gratton, Sadok Jerad, Philippe L. Toint
Unconstrained Optimization
The Impact of Noise on Evaluation Complexity: The Deterministic TrustRegion Case
Stefania Bellavia, Gianmarco Gurioli, Benedetta Morini, Philippe L. Toint
Nonlinear Systems and LeastSquares
Accelerated derivativefree nonlinear leastsquares applied to the estimation of Manning coefficients
E. G. Birgin, J. M. Martínez
A Riemannian smoothing steepest descent method for nonLipschitz optimization on submanifolds
Chao Zhang, Xiaojun Chen, Shiqian Ma
Smoothing fast iterative hard thresholding algorithm for $\ell_0$ regularized nonsmooth convex regression problem
Fan Wu, Wei Bian, Xiaoping Xue
NOMAD version 4: Nonlinear optimization with the MADS algorithm
Charles Audet, Sébastien Le Digabel, Viviane Rochon Montplaisir, Christophe Tribes
Quadratic Programming
SOSSDP: an Exact Solver for Minimum SumofSquares Clustering
Veronica Piccialli, Antonio M. Sudoso, Angelika Wiegele
Constrained Nonlinear Optimization
A Unifying Framework for Sparsity Constrained Optimization
Matteo Lapucci, Tommaso Levato, Francesco Rinaldi, Marco Sciandrone
Nonlinear Systems and LeastSquares
Accelerated derivativefree spectral residual method for nonlinear systems of equations
Ernesto G. Birgin, John L. Gardenghi, Diaulas S. Marcondes, José M. Martínez
Constrained Nonlinear Optimization
An augmented Lagrangian method exploiting secondorder information
Andrea Cristofari, Gianni Di Pillo, Giampaolo Liuzzi, Stefano Lucidi
Constrained Nonlinear Optimization
A globally trustregion LPNewton method for nonsmooth functions under the Hölder metric subregularity
Leticia Becher, Damian Fernandez, Alberto Ramos
May 2021
Homogeneous polynomials and spurious local minima on the unit sphere
Jean B. Lasserre
Unconstrained Optimization
An Accelerated Minimal Gradient Method with Momentum for Convex Quadratic Optimization
Harry Oviedo, Oscar Dalmau, Rafael Herrera
Constrained Nonlinear Optimization
Solving Weighted Orthogonal Procrustes Problems via a Projected Gradient Method
Harry Oviedo, Shaday Guerrero
Other
Radial Duality Part I: Foundations
Benjamin Grimmer
Other
Radial Duality Part II: Applications and Algorithms
Benjamin Grimmer
New Bregman proximal type algorithms for solving DC optimization problems
Shota Takahashi, Mituhiro Fukuda, Mirai Tanaka
Average Curvature FISTA for Nonconvex Smooth Composite Optimization Problems
Jiaming Liang, Renato D. C. Monteiro
Constrained Nonlinear Optimization
ACCELERATING CONVERGENCE OF A GLOBALIZED SEQUENTIAL QUADRATIC PROGRAMMING METHOD TO CRITICAL LAGRANGE MULTIPLIERS
Alexey F. Izmailov
Unconstrained Optimization
Adaptive Regularization Minimization Algorithms with NonSmooth Norms
Serge Gratton, Philippe L. Toint
Other
Linear Convergence of QuasiNewton Methods for Solving Constrained Generalized Equations
R. Andreani, R. M. Carvalho, L. D. Secchin, G. N. Silva
Constrained Nonlinear Optimization
Proximal Point Algorithm on the Stiefel Manifold
Harry Oviedo
Tight bounds on the maximal perimeter of convex equilateral small polygons
Christian Bingane, Charles Audet
June 2021
Maximal perimeter and maximal width of a convex small polygon
Christian Bingane
Constrained Nonlinear Optimization
Sequential constant rank constraint qualifications for nonlinear semidefinite and secondorder cone programming with applications
Roberto Andreani, Gabriel Haeser, Leonardo M. Mito, Héctor Ramírez C.
LSOS: Linesearch SecondOrder Stochastic optimization methods for nonconvex finite sums
Daniela di Serafino, Nataa Krejić, Nataa Krklec Jerinkić, Marco Viola
Constrained Nonlinear Optimization
Cardinality Minimization, Constraints, and Regularization: A Survey
Andreas M. Tillmann, Daniel Bienstock, Andrea Lodi, Alexandra Schwartz
FrankWolfe and friends: a journey into projectionfree firstorder optimization methods
Immanuel Bomze, Francesco Rinaldi, Damiano Zeffiro
A stochastic firstorder trustregion method with inexact restoration for finitesum minimization
Stefania Bellavia, Nataa Krejić, Benedetta Morini, Simone Rebegoldi
Constrained Nonlinear Optimization
A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with RankDeficient Jacobians
Albert S. Berahas, Frank E. Curtis, Michael O'Neill, Daniel P. Robinson
July 2021
Constrained Nonlinear Optimization
An Efficient Retraction Mapping for the Symplectic Stiefel Manifold
Harry Oviedo, Rafael Herrera
Nonlinear Systems and LeastSquares
A framework for convexconstrained monotone nonlinear equations and its special cases
Max Gonçalves, Tiago Menezes
Constrained Nonlinear Optimization
Inexact Sequential Quadratic Optimization for Minimizing a Stochastic Objective Function Subject to Deterministic Nonlinear Equality Constraints
Frank E. Curtis, Daniel P. Robinson, Baoyu Zhou
Quantifying uncertainty with ensembles of surrogates for blackbox optimization
Charles Audet, Sébastien Le Digabel, Renaud Saltet
Constrained Nonlinear Optimization
First and secondorder optimality conditions for secondorder cone and semidefinite programming under a constant rank condition
Roberto Andreani, Gabriel Haeser, Leonardo M. Mito, Héctor Ramírez C., Thiago P. Silveira
Systems governed by Differential Equations Optimization
TimeDomain Decomposition for Optimal Control Problems Governed by Semilinear Hyperbolic Systems with Mixed TwoPoint Boundary Conditions
Richard Krug, Günter Leugering, Alexander Martin, Martin Schmidt, Dieter Weninger
Quadratic Programming
Generating Cutting Inequalities Successively for Quadratic Optimization Problems in Binary Variables
Sunyoung Kim, Masakazu Kojima
Unconstrained Optimization
Derivativefree separable quadratic modeling and cubic regularization for unconstrained optimization
A. L. Custódio, R. Garmanjani, M. Raydan
Constrained Nonlinear Optimization
A novel approach for bilevel programs based on Wolfe duality
Yuwei Li, Guihua Lin, Jin Zhang, Xide Zhu
Constrained Nonlinear Optimization
A TensorTrain Dictionary Learning algorithm based on Spectral Proximal Alternating Linearized Minimization
Domitilla Brandoni, Margherita Porcelli, Valeria Simoncini
A New Multipoint Symmetric Secant Method with a Dense Initial Matrix
Jennifer Erway, Mostafa Rezapour
Fulllow evaluation methods for derivativefree optimization
Albert S. Berahas, Oumaima Sohab, Luis Nunes Vicente
Minimization over the l1ball using an activeset nonmonotone projected gradient
Andrea Cristofari, Marianna De Santis, Stefano Lucidi, Francesco Rinaldi
August 2021
Quadratic Programming
QCQP with Extra Constant Modulus Constraints: Theory and Applications on QoS Constrained Hybrid Beamforming for mmWave MUMIMO
Xin He
An abstract convergence framework with application to inertial inexact forwardbackward methods
Silvia Bonettini, Peter Ochs, Marco Prato, Simone Rebegoldi
Quadratic Programming
On Piecewise Linear Approximations of Bilinear Terms: Structural Comparison of Univariate and Bivariate MixedInteger Programming Formulations
Andreas Bärmann, Robert Burlacu, Lukas Hager, Thomas Kleinert
Worstcase evaluation complexity of derivativefree nonmonotone line search methods for solving nonlinear systems of equations
Geovani Grapiglia, Flávia Chorobura
Systems governed by Differential Equations Optimization
TimeDomain Decomposition for MixedInteger Optimal Control Problems
Falk M. Hante, Richard Krug, Martin Schmidt
A Trilevel Model for Segmentation of the Power Transmission Grid Cyber Network
Bryan Arguello, Emma Johnson, Jared Gearhart
SABRINA: A Stochastic Subspace MajorizationMinimization Algorithm
JeanBaptiste Fest, Emilie Chouzenoux
September 2021
Two limitedmemory optimization methods with minimum violation of the previous quasiNewton equations
Jan Vlček, Ladislav Lukan
A Cubic Regularization of Newton's Method with FiniteDifference Hessian Approximations
Geovani Grapiglia, Max Gonçalves, Gilson Silva
Unconstrained Optimization
Extension of the delayed weighted gradient method for the minimization of strongly convex functions
R. Andreani, H. Oviedo, M. Raydan, L.D. Secchin
Constrained Nonlinear Optimization
A Local MM Subspace Method for Solving Constrained Variational Problems in Image Recovery
Emilie Chouzenoux, Ségolčne Martin, JeanChristophe Pesquet
Adaptive Sampling QuasiNewton Methods for ZerothOrder Stochastic Optimization
Raghu Bollapragada, Stefan Wild
Dual descent ALM and ADMM
Kaizhao Sun , Andy Sun
A Riemannian Block Coordinate Descent Method for Computing the Projection Robust Wasserstein Distance
Minhui Huang, Shiqian Ma, Lifeng Lai
Projection Robust Wasserstein Barycenters
Minhui Huang, Shiqian Ma, Lifeng Lai
Unconstrained Optimization
Regularized Step Directions in Conjugate Gradient Minimization for Machine Learning
Cassidy K. Buhler, Hande Y. Benson, David F. Shanno
The equilateral small octagon of maximal width
Christian Bingane, Charles Audet
October 2021
Bilevel stochastic methods for optimization and machine learning: Bilevel stochastic descent and DARTS
Tommaso Giovannelli, Griffin Kent, Luis Nunes Vicente
Constrained Nonlinear Optimization
Constrained Optimization in the Presence of Noise
Jorge Nocedal, Richard Byrd, Figen Oztoprak
Solving Optimization Problems over the Stiefel Manifold by Smooth Exact Penalty Function
Nachuan Xiao, Xin Liu
Adaptive FiniteDifference Interval Estimation for Noisy DerivativeFree Optimization
HaoJun Shi, Yuchen Xie, Melody Xuan, Jorge Nocedal
Tight bounds on the maximal area of small polygons: Improved Mossinghoff polygons
Christian Bingane
Global Complexity Bound of a Proximal ADMM for LinearlyConstrained Nonseperable Nonconvex Composite Programming
Weiwei Kong, Renato D.C. Monteiro
November 2021
Quadratic Regularization Methods with FiniteDifference Gradient Approximations
Geovani Grapiglia
On Componental Operators in Hilbert Space
Andrzej Cegielski, Yair Censor
Constrained Nonlinear Optimization
ModelBased DerivativeFree Methods for ConvexConstrained Optimization
Matthew Hough, Lindon Roberts
Unconstrained Optimization
Bolstering Stochastic Gradient Descent with Model Building
S. Ilker Birbil, Ozgur Martin, Gonenc Onay, Figen Oztoprak
Other
Hierarchically constrained blackbox optimization
Stéphane Alarie, Charles Audet, Paulin Jacquot, Sébastien Le Digabel
December 2021
Training Structured Neural Networks Through Manifold Identification and Variance Reduction
ZihSyuan Huang, Chingpei Lee
Unconstrained Optimization
Convergence Analysis of Block MajorizeMinimize Subspace Approaches
JeanBaptiste Fest, Emilie Chouzenoux
Unconstrained Optimization
OPM, a collection of Optimization Problems in Matlab
Serge Gratton, Philippe L. Toint
Unconstrained Optimization
Trustregion algorithms: probabilistic complexity and intrinsic noise with applications to subsampling techniques
Stefania Bellavia, Gianmarco Gurioli, Benedetta Morini, Philippe L. Toint
Unconstrained Optimization
An adaptive regularization algorithm for unconstrained optimization with inexact function and derivatives values
Nicholas I. M. Gould, Philippe L. Toint
A unified analysis of descent sequences in weakly convex optimization, including convergence rates for bundle methods
Felipe Atenas, Claudia Sagastizábal, Paulo J. S. Silva, Mikhail Solodov
Constrained Nonlinear Optimization
A Globally Convergent Distributed Jacobi Scheme for BlockStructured Nonconvex Constrained Optimization Problems
Anirudh Subramanyam, Youngdae Kim, Michel Schanen, Francois Pacaud, Mihai Anitescu
Constrained Nonlinear Optimization
An adaptive cubic regularisation method for nonlinear equality constrained optimization
Yonggang Pei, Shaofang Song
Orbital $\varphi$regularity in coincidence and fixed point problems in metric spaces
Tron Nguyen
Constrained Nonlinear Optimization
WorstCase Complexity of an SQP Method for Nonlinear Equality Constrained Stochastic Optimization
Robinson Daniel, Michael O'Neill, Curtis Frank
