Dual decomposition is a powerful technique for deriving decomposition schemes for convex optimization problems with specific structure. Although the Augmented Lagrangian is computationally more stable than the ordinary Lagrangian, the \textit{prox-term} destroys the separability of the given problem. In this paper we use another approach to obtain a smooth Lagrangian, based on a smoothing technique developed by Nesterov, which preserves separability of the problem. With this approach we derive a new decomposition method, which from the viewpoint of efficiency estimates improves the bounds on the number of iterations of the classical dual gradient scheme by an order of magnitude. This can be achieved with the new decomposition algorithm since the resulting dual function has good smoothness properties and since we make use of the particular structure of the corresponding problem.
Citation
I. Necoara and J. Suykens, Application of a smoothing technique to decomposition in convex optimization'', IEEE Transactions on Automatic Control, Vol 53, nr. 11, 2008.
Article
View Application of a smoothing technique to decomposition in convex optimization