Jiaqi Li, Shaohuai Shi , Jing Peng, Tiejun Wang, Jiqing Gu, Xi Wu. Low-bit and Sparsified Gradient Communication for Accelerating Distributed Deep Learning with Convergence Guarantees. Proceedings of the 55th International Conference on Parallel Processing (ICPP 2026), Singapore, 2026.

Jing Peng, Zihan Li, Shaohuai Shi, Bo Li. Sparse Gradient Communication with AlltoAll for Accelerating Distributed Deep Learning. ICPP 2024, 2024.