Efficient unconstrained black box optimization

  • AbstractFor the unconstrained optimization of black box functions, this paper introduces a new randomized algorithm called . In practice, matches the quality of other state-of-the-art algorithms for finding, in small and large dimensions, a local minimizer with reasonable accuracy. Although our theory guarantees only local minimizers our heuristic techniques turn into an efficient global solver. In very thorough numerical experiments, we found in most cases either a global minimizer, or where this could not be checked, at least a point of similar quality to the best competitive global solvers. For smooth, everywhere defined functions, it is proved that, with probability arbitrarily close to 1, a basic version of our algorithm finds with function evaluations a point whose unknown exact gradient 2-norm is below a given threshold, where n is the dimension. In the smooth convex case, this number improves to and in the smooth (strongly) convex case to. This matches known recent complexity results for reaching a slightly different goal, namely the expected unknown exact gradient 2-norm is below a given threshold. Numerical results show that is effective and robust in comparison with the state-of-the-art local and global solvers on the unconstrained test problems of Gould et al. (Comput Optim Appl 60:545–557, 2014) for optimization and the test problems of Jamil and Yang (Int J Math Model Numer Optim 4:150, 2013) for global optimization with 2–5000 variables.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Morteza Kimiaei, Arnold Neumaier
DOI:https://doi.org/10.1007/s12532-021-00215-9
ISSN:1867-2949
Parent Title (English):Mathematical Programming Computation
Publisher:Springer Science and Business Media LLC
Document Type:Article
Language:English
Year of Completion:2022
Volume:14
Issue:2
Page Number:50
First Page:365
Last Page:414
Mathematical Programming Computation :MPC 2022 - Issue 2
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.