会员服务
动量方法 (Polyak, 1964) 旨在加速学习，特别是处理高曲率、小但一致的梯度，或是带噪声的梯度。 动量算法积累了之前梯度指数级衰减的移动平均，并且继续沿该方向移动。
DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizers
Arxiv
0+阅读 · 10月31日
A geometric framework for momentum-based optimizers for low-rank training
Arxiv
0+阅读 · 10月30日
Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training
Arxiv
0+阅读 · 10月29日
A Two-step Krasnosel'skii-Mann Algorithm with Adaptive Momentum and Its Applications to Image Denoising and Matrix Completion
A Two-step Krasnosel'skii-Mann Algorithm with Adaptive Momentum and Its Applications to Image Denoising and Matrix Completion
Arxiv
0+阅读 · 10月28日
Random Walks, Faber Polynomials and Accelerated Power Methods
Arxiv
0+阅读 · 10月28日
Distributed Stochastic Momentum Tracking with Local Updates: Achieving Optimal Communication and Iteration Complexities
Arxiv
0+阅读 · 10月28日
An extensive search for stable periodic orbits of the equal-mass zero angular momentum three-body problem
Arxiv
0+阅读 · 10月26日
Are penalty shootouts better than a coin toss? Evidence from European football
Arxiv
0+阅读 · 10月27日
A numerical method for the fractional Zakharov-Kuznetsov equation
Arxiv
0+阅读 · 10月24日
MoTVLA: A Vision-Language-Action Model with Unified Fast-Slow Reasoning
Arxiv
0+阅读 · 10月23日
Heavy-Ball Momentum Method in Continuous Time and Discretization Error Analysis
Arxiv
0+阅读 · 10月22日
A quantitative comparison of high-order asymptotic-preserving and asymptotically-accurate IMEX methods for the Euler equations with non-ideal gases
Arxiv
0+阅读 · 10月22日
A New Type of Adversarial Examples
Arxiv
0+阅读 · 10月22日
MoTVLA: A Vision-Language-Action Model with Unified Fast-Slow Reasoning
Arxiv
0+阅读 · 10月22日
AutoVARP - a framework for automated reproducible inducibility testing in computational models of cardiac electrophysiology
Arxiv
0+阅读 · 10月21日
参考链接
父主题
机器学习
神经网络
子主题
Nesterov 动量
微信扫码咨询专知VIP会员
Top