Quasi-hyperbolic momentum and Adam for deep learning

Jerry Ma, Denis Yarats. ICLR 2019.  (Poster PDF)