Fixup Initialization: Residual Learning Without Normalization

Hongyi Zhang, Yann N. Dauphin, and Tengyu Ma. ICLR 2019. (Poster PDF · Paper)