Sparse Gradient Communication with AlltoAll for Accelerating Distributed Deep Learning
Aug 1, 2024·
,,,·
0 min read
Jing Peng
Zihan Li
Shaohuai Shi
Bo Li
Type
Publication
Proceedings of the 53rd International Conference on Parallel Processing (ICPP 2024), Gotland Sweden

Authors
Jing Peng
(she/her)
Faculty Member
Ph.D., Lecturer at School of Computer Science, Chengdu University of Information Technology. Received Ph.D. in Computer Software and Theory from University of Chinese Academy of Sciences in 2022. Postdoctoral researcher at HKUST Department of Computer Science and Engineering (2023-2024). Research interests include advanced computing, intelligent image processing, and distributed machine learning. Has led over 10 research projects including Sichuan Provincial Major Science and Technology Special Project. Published 10+ papers in journals and conferences. Authorized 2 invention patents and 6 software copyrights. Won National First Prize in Teaching Innovation Competition.