论文标题
自适应随机优化
Adaptive Stochastic Optimization
论文作者
论文摘要
优化是机器学习和信号处理的核心。基于随机梯度方法的当代方法是非自适应的，因为它们的实现采用了需要对每个应用程序调整的规定参数值。本文总结了最近的研究，并激发了未来的自适应随机优化方法的工作，这些方法有可能在训练大规模系统时提供大量的计算节省。
Optimization lies at the heart of machine learning and signal processing. Contemporary approaches based on the stochastic gradient method are non-adaptive in the sense that their implementation employs prescribed parameter values that need to be tuned for each application. This article summarizes recent research and motivates future work on adaptive stochastic optimization methods, which have the potential to offer significant computational savings when training large-scale systems.
