Optimization Online


A Server for Automated Performance Analysis of Benchmarking Data

Hans D Mittelmann (mittelmann***at***asu.edu)
Armin Pruessner (apruessner***at***gams.com)

Abstract: As part of Performance World, we describe an automation server (PAVER: http://www.gamsworld.org/performance/paver) to help facilitate reproducible performance analysis of benchmarking data for optimization software. Although PAVER does not solve optimization problems, it automates the task of performance data analysis and visualization, taking into account various performance metrics. These include not only robustness and efficiency, but also quality of solution. This paper discusses the tools and the performance metrics used, as well as the design of the server. We give illustrative examples of performance data analysis using an instance of the COPS test case for nonlinear programming.

Keywords: Performance data analysis, performance metrics, automation

Category 1: Optimization Software and Modeling Systems (Optimization Software Benchmark )

Category 2: Optimization Software and Modeling Systems (Modeling Languages and Systems )


Download: [PDF]

Entry Submitted: 02/26/2003
Entry Accepted: 02/26/2003
Entry Last Modified: 09/03/2003

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Programming Society