Sparse Gradient Communication with AlltoAll for Accelerating Distributed Deep Learning

Aug 1, 2024·
Jing Peng
Jing Peng
,
Zihan Li
,
Shaohuai Shi
,
Bo Li
· 0 min read
Type
Publication
Proceedings of the 53rd International Conference on Parallel Processing (ICPP 2024), Gotland Sweden
publications
Sina Weibo
Jing Peng
Authors
Jing Peng (she/her)
Faculty Member
Ph.D., Lecturer at School of Computer Science, Chengdu University of Information Technology. Received Ph.D. in Computer Software and Theory from University of Chinese Academy of Sciences in 2022. Postdoctoral researcher at HKUST Department of Computer Science and Engineering (2023-2024). Research interests include advanced computing, intelligent image processing, and distributed machine learning. Has led over 10 research projects including Sichuan Provincial Major Science and Technology Special Project. Published 10+ papers in journals and conferences. Authorized 2 invention patents and 6 software copyrights. Won National First Prize in Teaching Innovation Competition.