论文标题
平滑紧凑型歧管上的无模型优化:使用零阶混合动力学克服拓扑障碍
Model-Free Optimization on Smooth Compact Manifolds: Overcoming Topological Obstructions using Zeroth-Order Hybrid Dynamics
论文作者
论文摘要
通过普通微分方程(ODE)建模的平滑自主动力系统不能坚固和全球稳定在紧凑,无边界的歧管中。这种障碍本质上是拓扑的,这意味着传统的平滑优化动力学无法在此类空间中牢固地解决全球优化问题。反过来,通常从基于模型的对应物中继承其稳定性和收敛性的无模型优化算法也可能会受到相似的拓扑障碍。例如,在零级方法和基于扰动的技术中就是这种情况,其中通常通过测量或评估成本函数实时估算梯度和黑姐妹。为了解决这个问题,我们引入了一类无混合模型的优化动力学,这些动力学结合了连续时间和离散的时间反馈,以克服在基于传统的基于ode的优化算法中出现的障碍,这些算法在光滑的紧凑型歧管上演变而来。特别是,我们介绍了一个混合控制器,该混合控制器通过将合适的探索性地理涂鸦涂在一个协同的差异性范围内应用于定义优化问题的成本函数,通过将合适的探索性地理涂鸦涂在获得的不同的无模型反馈法之间进行切换。地球涂层可以在保留其正向不变性的同时探索流形,这对于许多实际应用很重要,基于物理的约束限制了系统的可行轨迹。混合控制器利用了从测地钉获得的信息,以实现成本最小化器集的强大全球实践稳定性。所提出的方法是无模型性质的,因为它仅需要对成本函数的测量或评估。提出了数值结果,以说明该方法的主要思想和优势。
Smooth autonomous dynamical systems modeled by ordinary differential equations (ODEs) cannot robustly and globally stabilize a point in compact, boundaryless manifolds. This obstruction, which is topological in nature, implies that traditional smooth optimization dynamics are not able to robustly solve global optimization problems in such spaces. In turn, model-free optimization algorithms, which usually inherit their stability and convergence properties from their model-based counterparts, might also suffer from similar topological obstructions. For example, this is the case in zeroth-order methods and perturbation-based techniques, where gradients and Hessians are usually estimated in real time via measurements or evaluations of the cost function. To address this issue, we introduce a class of hybrid model-free optimization dynamics that combine continuous-time and discrete-time feedback to overcome the obstructions that emerge in traditional ODE-based optimization algorithms evolving on smooth compact manifolds. In particular, we introduce a hybrid controller that switches between different model-free feedback-laws obtained by applying suitable exploratory geodesic dithers to a family of synergistic diffeomorphisms adapted to the cost function that defines the optimization problem. The geodesic dithers enable exploration of the manifold while preserving its forward invariance, a property that is important for many practical applications where physics-based constraints limit the feasible trajectories of the system. The hybrid controller exploits the information obtained from the geodesic dithers to achieve robust global practical stability of the set of minimizers of the cost. The proposed method is of model-free nature since it only requires measurements or evaluations of the cost function. Numerical results are presented to illustrate the main ideas and advantages of the method.