Quasi-hyperbolic momentum and Adam for deep learning

Jerry Ma and Denis Yarats. ICLR 2019. (Poster PDF · Paper)