Low-bit and Sparsified Gradient Communication for Accelerating Distributed Deep Learning with Convergence Guarantees
Jan 1, 2026·
,
,·
0 min read
Jiaqi Li
Shaohuai Shi
Jing Peng
Tiejun Wang
Jiqing Gu
Xi Wu
Authors
Jiaqi Li
(he/him)
M.S. Student
Received B.E. in Computer Science and Technology from CUIT in June 2023. Currently pursuing Master’s degree in Artificial Intelligence at CUIT since 2024.
Authors
Jing Peng
(she/her)
Faculty Member
Ph.D., Lecturer at School of Computer Science, Chengdu University of Information Technology. Received Ph.D. in Computer Software and Theory from University of Chinese Academy of Sciences in 2022. Postdoctoral researcher at HKUST Department of Computer Science and Engineering (2023-2024). Research interests include advanced computing, intelligent image processing, and distributed machine learning. Has led over 10 research projects including Sichuan Provincial Major Science and Technology Special Project. Published 10+ papers in journals and conferences. Authorized 2 invention patents and 6 software copyrights. Won National First Prize in Teaching Innovation Competition.
Authors
Tiejun Wang
(he/him)
Team Leader
Received Ph.D. in Computer Application Technology from University of Electronic Science and Technology of China (UESTC) in December 2010. Has undertaken more than 10 research projects including the National Science and Technology Support Program, Sichuan Provincial Science and Technology Program, and projects from State Grid Corporation of China. Awarded two Second-Class Provincial Science and Technology Progress Awards. Published over 20 academic papers (10+ indexed by SCI/EI), authorized 5 national invention patents, obtained 14 software copyrights, and published 4 textbooks.
Authors
Jiqing Gu
(she/her)
Faculty Member
Received Ph.D. in Computer Science and Technology from UESTC in December 2022. Research interests include distributed computing, parallel computing optimization, and data mining. Published 18 papers in international conferences and journals. Participated in multiple national and provincial projects including the National Key R&D Program of China.
Authors
Faculty
Faculty member at the School of Computer Science, Chengdu University of Information Technology. Research interests include image processing, machine learning, and distributed computing.