论文标题

改进的最大值熵搜索具有约束的多目标贝叶斯优化

Improved Max-value Entropy Search for Multi-objective Bayesian Optimization with Constraints

论文作者

Fernández-Sánchez, Daniel, Garrido-Merchán, Eduardo C., Hernández-Lobato, Daniel

论文摘要

我们提出MESMOC+,这是一种改进的Max-value熵搜索,以搜索具有约束(MESMOC)的多目标贝叶斯优化。当目标和限制因素评估昂贵时,MESMOC+可用于解决受约束的多目标问题。 MESMOC+通过最小化功能空间中优化问题的解的熵来起作用,即Pareto Frontier,以指导搜索最佳的搜索。 MESMOC+的成本在目标和约束的数量中是线性的。此外,它通常比最大程度地减少帕累托集合的熵的替代方法的成本明显小。这样做的原因是,在MESMOC+中近似所需的计算更容易。此外,MESMOC+的采集函数表示为每个黑框(客观或约束)的一次采集之和。因此,它可以用于脱钩的评估设置中,其中人们不仅选择了要评估的下一个输入位置,还可以选择哪种黑框进行评估。我们将MESMOC+与合成和实际优化问题中的相关方法进行比较。这些实验表明,MESMOC+提供的熵估计比以前的方法更准确。这会带来更好的优化结果。 MESMOC+也与其他基于信息的方法进行竞争,用于受约束的多目标贝叶斯优化,但它的速度明显更快。

We present MESMOC+, an improved version of Max-value Entropy search for Multi-Objective Bayesian optimization with Constraints (MESMOC). MESMOC+ can be used to solve constrained multi-objective problems when the objectives and the constraints are expensive to evaluate. MESMOC+ works by minimizing the entropy of the solution of the optimization problem in function space, i.e., the Pareto frontier, to guide the search for the optimum. The cost of MESMOC+ is linear in the number of objectives and constraints. Furthermore, it is often significantly smaller than the cost of alternative methods based on minimizing the entropy of the Pareto set. The reason for this is that it is easier to approximate the required computations in MESMOC+. Moreover, MESMOC+'s acquisition function is expressed as the sum of one acquisition per each black-box (objective or constraint). Thus, it can be used in a decoupled evaluation setting in which one chooses not only the next input location to evaluate, but also which black-box to evaluate there. We compare MESMOC+ with related methods in synthetic and real optimization problems. These experiments show that the entropy estimation provided by MESMOC+ is more accurate than that of previous methods. This leads to better optimization results. MESMOC+ is also competitive with other information-based methods for constrained multi-objective Bayesian optimization, but it is significantly faster.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源