We gratefully acknowledge support from
the Simons Foundation and member institutions.

Fei Yang is qualified to endorse.

On the Performance and Memory Footprint of Distributed Training: An Empirical Study on Transformers

Fangyu Wang: Is registered as an author of this paper.
Not currently an endorser. (why?)
Fei Yang: Is registered as an author of this paper.
Can endorse for cs.LO. (why?)

Zhengxian Lu, Zhiwei Xu and Tao Li are not registered as owners of this paper. (why?)