Exact (Non-)Accelerations of Heavy-Ball Discretizations

2026-11-11来源 arXiv cs.NAEnglish
arXiv:2611.13584v1 Announce Type: cross Abstract: Momentum methods with the same slow dynamics can have different worst-case rates on smooth strongly convex functions. We identify a half-step phase barrier in the gradient query that governs this difference. For momentum with extrapolation $\tau_\kappa\to\tau$, $\beta=1-\theta/\sqrt\kappa+o(\kappa^{-1/2})$ and $hL\to y$, where $\kappa=L/\mu$ and $\theta,y>0$, the exact uniform distance factor is $1-c/\sqrt\kappa+o(\kappa^{-1/2})$, with $c=\min\{\theta/3,c_Q(\theta,y)\}$, when $\tau>1/2$ and $y(1+2\tau)

原文:https://www.a8q9.cn/en/article/exact-non-accelerations-of-heavy-ball-discretizations-887236.html

相关文章