论文标题
通过问卷调查现实世界优化问题的属性
Identifying Properties of Real-World Optimisation Problems through a Questionnaire
论文作者
论文摘要
通常在基准测试中比较优化算法，以深入了解性能差异。但是，尚不清楚基准如何与实际问题的属性匹配，因为这些属性在很大程度上未知。这项工作通过问卷调查调查了现实世界问题的属性，以使未来基准问题的设计与现实世界中发现的问题更相似。这些结果虽然仅基于45个响应，但结果表明许多问题至少具有以下属性：它们是约束，确定性的，仅具有连续变量，需要对目标和约束的大量计算时间，或者允许有限的评估。诸如已知最佳解决方案和分析梯度之类的属性很少可用，从而限制了指导优化过程的选项。在设计现实的基准问题时，这些都是要考虑的重要方面。同时，很难进行实际的基准设计，因为据报道，物镜通常是黑框，并且许多问题属性尚不清楚。为了进一步提高对现实世界问题的理解，鼓励从事现实世界优化问题的读者填写问卷：https：//tinyurl.com/opt-survey
Optimisation algorithms are commonly compared on benchmarks to get insight into performance differences. However, it is not clear how closely benchmarks match the properties of real-world problems because these properties are largely unknown. This work investigates the properties of real-world problems through a questionnaire to enable the design of future benchmark problems that more closely resemble those found in the real world. The results, while not representative as they are based on only 45 responses, indicate that many problems possess at least one of the following properties: they are constrained, deterministic, have only continuous variables, require substantial computation times for both the objectives and the constraints, or allow a limited number of evaluations. Properties like known optimal solutions and analytical gradients are rarely available, limiting the options in guiding the optimisation process. These are all important aspects to consider when designing realistic benchmark problems. At the same time, the design of realistic benchmarks is difficult, because objective functions are often reported to be black-box and many problem properties are unknown. To further improve the understanding of real-world problems, readers working on a real-world optimisation problem are encouraged to fill out the questionnaire: https://tinyurl.com/opt-survey
