TY - JOUR A1 - Koch, Thorsten A1 - Bernal Neira, David E. A1 - Chen, Ying A1 - Cortiana, Giorgio A1 - Egger, Daniel J. A1 - Heese, Raoul A1 - Hegade, Narendra N. A1 - Gomez Cadavid, Alejandro A1 - Huang, Rhea A1 - Itoko, Toshinari A1 - Kleinert, Thomas A1 - Maciel Xavier, Pedro A1 - Mohseni, Naeimeh A1 - Montanez-Barrera, Jhon A. A1 - Nakano, Koji A1 - Nannicini, Giacomo A1 - O'Meara, Corey A1 - Pauckert, Justin A1 - Proissl, Manuel A1 - Ramesh, Anurag A1 - Schicker, Maximilian A1 - Shimada, Noriaki A1 - Takeori, Mitsuharu A1 - Valls, Victor A1 - Van Bulck, David A1 - Woerner, Stefan A1 - Zoufal, Christa T1 - Quantum Optimization Benchmark Library -- The Intractable Decathlon N2 - Through recent progress in hardware development, quantum computers have advanced to the point where benchmarking of (heuristic) quantum algorithms at scale is within reach. Particularly in combinatorial optimization -- where most algorithms are heuristics -- it is key to empirically analyze their performance on hardware and track progress towards quantum advantage. To this extent, we present ten optimization problem classes that are difficult for existing classical algorithms and can (mostly) be linked to practically-relevant applications, with the goal to enable systematic, fair, and comparable benchmarks for quantum optimization methods. Further, we introduce the Quantum Optimization Benchmark Library (QOBLIB) where the problem instances and solution track records can be found. The individual properties of the problem classes vary in terms of objective and variable type, coefficient ranges, and density. Crucially, they all become challenging for established classical methods already at system sizes ranging from less than 100 to, at most, an order of 100,000 decision variables, allowing to approach them with today's quantum computers. We reference the results from state-of-the-art solvers for instances from all problem classes and demonstrate exemplary baseline results obtained with quantum solvers for selected problems. The baseline results illustrate a standardized form to present benchmarking solutions, which has been designed to ensure comparability of the used methods, reproducibility of the respective results, and trackability of algorithmic and hardware improvements over time. We encourage the optimization community to explore the performance of available classical or quantum algorithms and hardware platforms with the benchmarking problem instances presented in this work toward demonstrating quantum advantage in optimization. Y1 - 2025 ER -